2024-04-26T12:14:09.215 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T12:14:09.215 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214 --name teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsstress thrashosds-health} --verbose -- /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/orig.config.yaml 2024-04-26T12:14:09.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T12:14:09.332 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674214' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: reef ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: dc093b5e41f728edab6e0330295fdf9156d31664 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: dc093b5e41f728edab6e0330295fdf9156d31664 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 1136 sha1: dc093b5e41f728edab6e0330295fdf9156d31664 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOwiUwa+K6ig8SPG/Kd3AYUjMwkMv+5acMpb3doHsT8eZ8Z3FnGdgjKnv1M81bGxxiop4njqYAEaksLFSjscu9k= smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOfLlFQTkys/5SxJPoTuyVXMw234mFIFOILuDi0HtTRbmibAow8NFk73M7b2P9HeNX8Gr+E+yGVZGGl+9zGoPSI= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNcYRQiHUj77ZXMgbNdzVt8hZOOsCKO/bHLcbZ0mv+tIXZcR08CxKWnyV6NZOTfCc2myZTPoflj44wCYWVvjGSg= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMyGMggjqH2VxO+mu8AaF0IUD0lpkVh5PIYW9tAeQiu4S6Pf6PCv11tL/AahwLWZ5eZuYTQ4FivSCotkWWP8XSk= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T12:14:09.332 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa; will attempt to use it 2024-04-26T12:14:09.333 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa/tasks 2024-04-26T12:14:09.333 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T12:14:09.335 INFO:teuthology.task.internal:Checking packages... 2024-04-26T12:14:09.360 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'dc093b5e41f728edab6e0330295fdf9156d31664' 2024-04-26T12:14:09.360 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T12:14:09.360 INFO:teuthology.packaging:ref: None 2024-04-26T12:14:09.360 INFO:teuthology.packaging:tag: None 2024-04-26T12:14:09.360 INFO:teuthology.packaging:branch: reef 2024-04-26T12:14:09.360 INFO:teuthology.packaging:sha1: dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:14:09.361 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-26T12:14:09.688 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1258.g7d2137f0 2024-04-26T12:14:09.689 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T12:14:09.696 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T12:14:09.696 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T12:14:09.743 INFO:teuthology.task.internal:Saving configuration 2024-04-26T12:14:09.755 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T12:14:09.767 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T12:14:09.794 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:08:55.458851', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOwiUwa+K6ig8SPG/Kd3AYUjMwkMv+5acMpb3doHsT8eZ8Z3FnGdgjKnv1M81bGxxiop4njqYAEaksLFSjscu9k='} 2024-04-26T12:14:09.814 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:08:55.459707', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOfLlFQTkys/5SxJPoTuyVXMw234mFIFOILuDi0HtTRbmibAow8NFk73M7b2P9HeNX8Gr+E+yGVZGGl+9zGoPSI='} 2024-04-26T12:14:09.834 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:08:55.456892', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNcYRQiHUj77ZXMgbNdzVt8hZOOsCKO/bHLcbZ0mv+tIXZcR08CxKWnyV6NZOTfCc2myZTPoflj44wCYWVvjGSg='} 2024-04-26T12:14:09.854 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:08:55.458012', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMyGMggjqH2VxO+mu8AaF0IUD0lpkVh5PIYW9tAeQiu4S6Pf6PCv11tL/AahwLWZ5eZuYTQ4FivSCotkWWP8XSk='} 2024-04-26T12:14:09.855 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T12:14:09.861 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-26T12:14:09.861 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['osd.0'] 2024-04-26T12:14:09.861 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['osd.1'] 2024-04-26T12:14:09.861 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['osd.2'] 2024-04-26T12:14:09.861 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T12:14:10.010 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f120ad2d0d0>, signals=[15]) 2024-04-26T12:14:10.010 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T12:14:10.017 INFO:teuthology.task.internal:Opening connections... 2024-04-26T12:14:10.017 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-04-26T12:14:10.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:14:10.098 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2024-04-26T12:14:10.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:14:10.169 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T12:14:10.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:14:10.241 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T12:14:10.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:14:10.313 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T12:14:10.319 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-04-26T12:14:10.342 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-04-26T12:14:10.342 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-04-26T12:14:10.405 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-04-26T12:14:10.405 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8" 2024-04-26T12:14:10.405 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-04-26T12:14:10.405 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-04-26T12:14:10.405 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8" 2024-04-26T12:14:10.405 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2024-04-26T12:14:10.405 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T12:14:10.405 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-04-26T12:14:10.405 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T12:14:10.405 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-04-26T12:14:10.405 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T12:14:10.406 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T12:14:10.406 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T12:14:10.406 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-04-26T12:14:10.435 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-04-26T12:14:10.457 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-04-26T12:14:10.457 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-04-26T12:14:10.519 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-04-26T12:14:10.519 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8" 2024-04-26T12:14:10.519 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-04-26T12:14:10.519 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-04-26T12:14:10.519 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8" 2024-04-26T12:14:10.519 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2024-04-26T12:14:10.519 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T12:14:10.519 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-04-26T12:14:10.519 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T12:14:10.519 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-04-26T12:14:10.519 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T12:14:10.520 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T12:14:10.520 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T12:14:10.520 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-04-26T12:14:10.543 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-04-26T12:14:10.565 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-04-26T12:14:10.565 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-04-26T12:14:10.627 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-04-26T12:14:10.627 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8" 2024-04-26T12:14:10.627 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-04-26T12:14:10.627 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-04-26T12:14:10.627 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8" 2024-04-26T12:14:10.627 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2024-04-26T12:14:10.627 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T12:14:10.627 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-04-26T12:14:10.627 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T12:14:10.627 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-04-26T12:14:10.627 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T12:14:10.627 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T12:14:10.628 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T12:14:10.628 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-04-26T12:14:10.651 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-04-26T12:14:10.673 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-04-26T12:14:10.673 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-04-26T12:14:10.734 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-04-26T12:14:10.734 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2024-04-26T12:14:10.734 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-04-26T12:14:10.734 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-04-26T12:14:10.734 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2024-04-26T12:14:10.734 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2024-04-26T12:14:10.735 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T12:14:10.735 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-04-26T12:14:10.735 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T12:14:10.735 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-04-26T12:14:10.735 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T12:14:10.735 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T12:14:10.735 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T12:14:10.735 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-04-26T12:14:10.759 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T12:14:10.769 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T12:14:10.818 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T12:14:10.818 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:14:10.821 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:14:10.823 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:14:10.825 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:14:10.845 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T12:14:10.854 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T12:14:10.854 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:14:10.883 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:14:10.885 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:14:10.887 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:14:10.923 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T12:14:11.019 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T12:14:11.033 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-26T12:14:11.033 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-26T12:14:11.033 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:14:11.034 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:14:11.034 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:14:11.035 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:14:11.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:14:11.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:14:11.056 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-04-26T12:14:11.057 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-04-26T12:14:11.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:14:11.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:14:11.059 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-04-26T12:14:11.059 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-26T12:14:11.117 INFO:teuthology.orchestra.run.smithi142.stdout:4.18.0-489.el8.x86_64 2024-04-26T12:14:11.117 INFO:teuthology.task.kernel:Running kernel on smithi142: 4.18.0-489.el8.x86_64 2024-04-26T12:14:11.117 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2024-04-26T12:14:11.118 INFO:teuthology.orchestra.run.smithi136.stdout:4.18.0-489.el8.x86_64 2024-04-26T12:14:11.118 INFO:teuthology.task.kernel:Running kernel on smithi136: 4.18.0-489.el8.x86_64 2024-04-26T12:14:11.118 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum install -y kernel 2024-04-26T12:14:11.120 INFO:teuthology.orchestra.run.smithi115.stdout:4.18.0-489.el8.x86_64 2024-04-26T12:14:11.120 INFO:teuthology.task.kernel:Running kernel on smithi115: 4.18.0-489.el8.x86_64 2024-04-26T12:14:11.120 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum install -y kernel 2024-04-26T12:14:11.121 INFO:teuthology.orchestra.run.smithi046.stdout:4.18.0-489.el8.x86_64 2024-04-26T12:14:11.121 INFO:teuthology.task.kernel:Running kernel on smithi046: 4.18.0-489.el8.x86_64 2024-04-26T12:14:11.121 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2024-04-26T12:14:17.179 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 8 - AppStream 8.3 MB/s | 28 MB 00:03 2024-04-26T12:14:20.445 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 8 - AppStream 4.1 MB/s | 28 MB 00:06 2024-04-26T12:14:23.764 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 8 - BaseOS 8.5 MB/s | 10 MB 00:01 2024-04-26T12:14:25.763 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 8 - Extras 65 kB/s | 18 kB 00:00 2024-04-26T12:14:26.462 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 8 - BaseOS 9.8 MB/s | 10 MB 00:01 2024-04-26T12:14:26.764 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 8 - Extras common packages 8.7 kB/s | 7.7 kB 00:00 2024-04-26T12:14:27.007 INFO:teuthology.orchestra.run.smithi046.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-04-26T12:14:28.270 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 8 - Extras 89 kB/s | 18 kB 00:00 2024-04-26T12:14:28.359 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2024-04-26T12:14:28.963 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 7.7 kB 00:00 2024-04-26T12:14:29.197 INFO:teuthology.orchestra.run.smithi136.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-04-26T12:14:30.815 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-04-26T12:14:32.466 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 416 kB/s | 24 kB 00:00 2024-04-26T12:14:34.581 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 390 kB/s | 24 kB 00:00 2024-04-26T12:14:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T12:14:35.746 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T12:14:35.884 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-04-26T12:14:35.885 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-04-26T12:14:35.885 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-04-26T12:14:35.885 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-04-26T12:14:35.885 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-04-26T12:14:35.885 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T12:14:35.885 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-04-26T12:14:35.885 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T12:14:35.886 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T12:14:35.886 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:14:35.886 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-04-26T12:14:35.886 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-04-26T12:14:35.886 INFO:teuthology.orchestra.run.smithi046.stdout:Install 3 Packages 2024-04-26T12:14:35.886 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:14:35.887 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 90 M 2024-04-26T12:14:35.887 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 96 M 2024-04-26T12:14:35.887 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-04-26T12:14:37.113 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - AppStream 1.2 MB/s | 28 MB 00:23 2024-04-26T12:14:37.142 INFO:teuthology.orchestra.run.smithi046.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 9.7 MB/s | 10 MB 00:01 2024-04-26T12:14:37.636 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T12:14:37.636 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T12:14:37.745 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-04-26T12:14:37.746 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-04-26T12:14:37.746 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-04-26T12:14:37.746 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-04-26T12:14:37.746 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-04-26T12:14:37.746 INFO:teuthology.orchestra.run.smithi136.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T12:14:37.746 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-04-26T12:14:37.746 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T12:14:37.746 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T12:14:37.746 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:14:37.746 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-04-26T12:14:37.747 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-04-26T12:14:37.747 INFO:teuthology.orchestra.run.smithi136.stdout:Install 3 Packages 2024-04-26T12:14:37.747 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:14:37.747 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 90 M 2024-04-26T12:14:37.747 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 96 M 2024-04-26T12:14:37.748 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-04-26T12:14:38.151 INFO:teuthology.orchestra.run.smithi046.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 18 MB/s | 36 MB 00:02 2024-04-26T12:14:38.263 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - AppStream 1.1 MB/s | 28 MB 00:24 2024-04-26T12:14:39.007 INFO:teuthology.orchestra.run.smithi136.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 8.6 MB/s | 10 MB 00:01 2024-04-26T12:14:39.484 INFO:teuthology.orchestra.run.smithi046.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 13 MB/s | 44 MB 00:03 2024-04-26T12:14:39.484 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:14:39.485 INFO:teuthology.orchestra.run.smithi046.stdout:Total 25 MB/s | 90 MB 00:03 2024-04-26T12:14:40.204 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-04-26T12:14:40.465 INFO:teuthology.orchestra.run.smithi136.stdout:(2/3): kernel-core-4.18.0-552.el8.x86_64.rpm 16 MB/s | 44 MB 00:02 2024-04-26T12:14:40.663 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-04-26T12:14:40.663 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-04-26T12:14:40.799 INFO:teuthology.orchestra.run.smithi136.stdout:(3/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 12 MB/s | 36 MB 00:02 2024-04-26T12:14:40.799 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:14:40.800 INFO:teuthology.orchestra.run.smithi136.stdout:Total 30 MB/s | 90 MB 00:03 2024-04-26T12:14:41.482 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-04-26T12:14:41.906 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-04-26T12:14:41.906 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-04-26T12:14:41.997 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-04-26T12:14:42.024 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-04-26T12:14:43.156 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-04-26T12:14:43.181 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-04-26T12:14:43.379 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - BaseOS 8.7 MB/s | 10 MB 00:01 2024-04-26T12:14:44.285 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - BaseOS 9.9 MB/s | 10 MB 00:01 2024-04-26T12:14:44.969 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-04-26T12:14:45.171 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - Extras 93 kB/s | 18 kB 00:00 2024-04-26T12:14:45.488 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T12:14:45.956 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-04-26T12:14:46.030 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - Extras common packages 10 kB/s | 7.7 kB 00:00 2024-04-26T12:14:46.244 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - Extras 54 kB/s | 18 kB 00:00 2024-04-26T12:14:46.290 INFO:teuthology.orchestra.run.smithi115.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2024-04-26T12:14:46.536 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T12:14:46.944 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 7.7 kB 00:00 2024-04-26T12:14:47.288 INFO:teuthology.orchestra.run.smithi142.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2024-04-26T12:14:48.709 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2024-04-26T12:14:49.249 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T12:14:49.301 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 5.6 MB/s | 16 MB 00:02 2024-04-26T12:14:49.646 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T12:14:50.095 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T12:14:50.526 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T12:14:52.488 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 323 kB/s | 24 kB 00:00 2024-04-26T12:14:53.084 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 605 kB/s | 24 kB 00:00 2024-04-26T12:14:53.331 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T12:14:53.617 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:14:53.963 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T12:14:54.250 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:14:55.535 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T12:14:55.535 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T12:14:55.646 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-26T12:14:55.646 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-26T12:14:55.646 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-04-26T12:14:55.646 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-26T12:14:55.646 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-26T12:14:55.647 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T12:14:55.647 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-26T12:14:55.647 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T12:14:55.647 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T12:14:55.647 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:14:55.647 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-26T12:14:55.647 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-26T12:14:55.647 INFO:teuthology.orchestra.run.smithi142.stdout:Install 3 Packages 2024-04-26T12:14:55.647 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:14:55.648 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 90 M 2024-04-26T12:14:55.648 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 96 M 2024-04-26T12:14:55.648 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-26T12:14:56.130 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T12:14:56.131 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T12:14:56.238 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-26T12:14:56.238 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-26T12:14:56.238 INFO:teuthology.orchestra.run.smithi115.stdout: Package Architecture Version Repository Size 2024-04-26T12:14:56.238 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-26T12:14:56.238 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-26T12:14:56.239 INFO:teuthology.orchestra.run.smithi115.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T12:14:56.239 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-04-26T12:14:56.239 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T12:14:56.239 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T12:14:56.239 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:14:56.239 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-26T12:14:56.239 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-26T12:14:56.239 INFO:teuthology.orchestra.run.smithi115.stdout:Install 3 Packages 2024-04-26T12:14:56.239 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:14:56.239 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 90 M 2024-04-26T12:14:56.240 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 96 M 2024-04-26T12:14:56.240 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-26T12:14:56.764 INFO:teuthology.orchestra.run.smithi142.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 9.7 MB/s | 10 MB 00:01 2024-04-26T12:14:57.806 INFO:teuthology.orchestra.run.smithi142.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 17 MB/s | 36 MB 00:02 2024-04-26T12:14:58.235 INFO:teuthology.orchestra.run.smithi115.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 5.8 MB/s | 10 MB 00:01 2024-04-26T12:14:58.832 INFO:teuthology.orchestra.run.smithi142.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 14 MB/s | 44 MB 00:03 2024-04-26T12:14:58.832 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:14:58.832 INFO:teuthology.orchestra.run.smithi142.stdout:Total 28 MB/s | 90 MB 00:03 2024-04-26T12:14:59.523 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-26T12:14:59.901 INFO:teuthology.orchestra.run.smithi115.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 11 MB/s | 36 MB 00:03 2024-04-26T12:14:59.940 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-26T12:14:59.941 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-26T12:15:00.460 INFO:teuthology.orchestra.run.smithi115.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 11 MB/s | 44 MB 00:04 2024-04-26T12:15:00.460 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:15:00.460 INFO:teuthology.orchestra.run.smithi115.stdout:Total 21 MB/s | 90 MB 00:04 2024-04-26T12:15:01.142 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-26T12:15:01.195 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-26T12:15:01.231 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-26T12:15:01.563 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-26T12:15:01.563 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-26T12:15:02.815 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-26T12:15:02.854 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-26T12:15:04.007 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-26T12:15:04.572 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T12:15:05.633 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-26T12:15:06.213 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T12:15:08.150 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T12:15:08.537 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T12:15:09.785 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T12:15:10.196 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T12:15:11.974 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T12:15:12.269 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:13.637 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T12:15:13.936 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:16.214 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:16.239 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:16.594 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:16.594 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T12:15:16.594 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T12:15:17.102 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:17.102 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:15:17.102 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-04-26T12:15:17.102 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T12:15:17.102 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T12:15:17.102 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:15:17.102 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-04-26T12:15:17.200 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:17.225 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:17.241 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:15:17.463 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T12:15:17.464 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T12:15:17.464 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T12:15:17.464 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T12:15:17.464 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T12:15:17.464 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-26T12:15:17.464 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T12:15:17.465 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:15:17.596 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:17.596 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T12:15:17.596 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T12:15:17.676 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T12:15:17.676 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T12:15:17.676 DEBUG:teuthology.orchestra.run.smithi136:> sudo rpm -qi grub2-tools 2024-04-26T12:15:17.710 INFO:teuthology.orchestra.run.smithi136.stdout:Name : grub2-tools 2024-04-26T12:15:17.710 INFO:teuthology.orchestra.run.smithi136.stdout:Epoch : 1 2024-04-26T12:15:17.710 INFO:teuthology.orchestra.run.smithi136.stdout:Version : 2.02 2024-04-26T12:15:17.710 INFO:teuthology.orchestra.run.smithi136.stdout:Release : 129.el8 2024-04-26T12:15:17.710 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: x86_64 2024-04-26T12:15:17.710 INFO:teuthology.orchestra.run.smithi136.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T12:15:17.710 INFO:teuthology.orchestra.run.smithi136.stdout:Group : System Environment/Base 2024-04-26T12:15:17.710 INFO:teuthology.orchestra.run.smithi136.stdout:Size : 9265586 2024-04-26T12:15:17.711 INFO:teuthology.orchestra.run.smithi136.stdout:License : GPLv3+ 2024-04-26T12:15:17.711 INFO:teuthology.orchestra.run.smithi136.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T12:15:17.711 INFO:teuthology.orchestra.run.smithi136.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T12:15:17.711 INFO:teuthology.orchestra.run.smithi136.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T12:15:17.711 INFO:teuthology.orchestra.run.smithi136.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T12:15:17.711 INFO:teuthology.orchestra.run.smithi136.stdout:Relocations : (not relocatable) 2024-04-26T12:15:17.711 INFO:teuthology.orchestra.run.smithi136.stdout:Packager : CentOS BuildSystem 2024-04-26T12:15:17.711 INFO:teuthology.orchestra.run.smithi136.stdout:Vendor : CentOS 2024-04-26T12:15:17.711 INFO:teuthology.orchestra.run.smithi136.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T12:15:17.711 INFO:teuthology.orchestra.run.smithi136.stdout:Summary : Support tools for GRUB. 2024-04-26T12:15:17.711 INFO:teuthology.orchestra.run.smithi136.stdout:Description : 2024-04-26T12:15:17.711 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:15:17.712 INFO:teuthology.orchestra.run.smithi136.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T12:15:17.712 INFO:teuthology.orchestra.run.smithi136.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T12:15:17.712 INFO:teuthology.orchestra.run.smithi136.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T12:15:17.712 INFO:teuthology.orchestra.run.smithi136.stdout:hardware devices. 2024-04-26T12:15:17.712 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:15:17.712 INFO:teuthology.orchestra.run.smithi136.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T12:15:17.713 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T12:15:17.713 INFO:teuthology.task.kernel:Updating grub on smithi136 to boot 4.18.0-552.el8.x86_64 2024-04-26T12:15:17.713 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:15:18.256 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-04-26T12:15:18.430 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:15:18.657 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T12:15:18.657 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T12:15:18.657 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T12:15:18.657 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T12:15:18.657 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T12:15:18.658 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-26T12:15:18.658 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T12:15:18.658 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:15:18.880 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T12:15:18.880 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T12:15:18.880 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.02 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 129.el8 2024-04-26T12:15:18.914 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi046.stdout:Group : System Environment/Base 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 9265586 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi046.stdout:Relocations : (not relocatable) 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : CentOS BuildSystem 2024-04-26T12:15:18.915 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:15:18.916 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T12:15:18.917 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T12:15:18.917 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 4.18.0-552.el8.x86_64 2024-04-26T12:15:18.917 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T12:15:19.205 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2024-04-26T12:15:20.136 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-04-26T12:15:21.146 INFO:teuthology.orchestra.run.smithi136.stderr:done 2024-04-26T12:15:21.147 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-04-26T12:15:21.185 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.tnCgDtdviZ 2024-04-26T12:15:21.185 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tnCgDtdviZ 2024-04-26T12:15:21.259 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.tnCgDtdviZ 2024-04-26T12:15:21.400 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.tnCgDtdviZ is 6KB 2024-04-26T12:15:21.448 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.tnCgDtdviZ 2024-04-26T12:15:21.465 DEBUG:teuthology.orchestra.run.smithi136:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T12:15:21.530 INFO:teuthology.orchestra.run.smithi136.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T12:15:21.530 INFO:teuthology.orchestra.run.smithi136.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T12:15:21.531 INFO:teuthology.orchestra.run.smithi136.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T12:15:21.531 INFO:teuthology.orchestra.run.smithi136.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T12:15:21.532 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T12:15:21.693 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2024-04-26T12:15:21.861 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-04-26T12:15:21.862 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-04-26T12:15:21.883 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.lojAQAsgiw 2024-04-26T12:15:21.884 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lojAQAsgiw 2024-04-26T12:15:21.977 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.lojAQAsgiw 2024-04-26T12:15:22.085 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.lojAQAsgiw is 6KB 2024-04-26T12:15:22.135 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.lojAQAsgiw 2024-04-26T12:15:22.153 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T12:15:22.219 INFO:teuthology.orchestra.run.smithi046.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T12:15:22.219 INFO:teuthology.orchestra.run.smithi046.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T12:15:22.219 INFO:teuthology.orchestra.run.smithi046.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T12:15:22.219 INFO:teuthology.orchestra.run.smithi046.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T12:15:22.220 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T12:15:22.395 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-04-26T12:15:34.363 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:34.386 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:34.738 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:34.738 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T12:15:34.739 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T12:15:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:15:35.248 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-26T12:15:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T12:15:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T12:15:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:15:35.248 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-26T12:15:35.391 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:15:35.612 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T12:15:35.612 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T12:15:35.612 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T12:15:35.612 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T12:15:35.612 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T12:15:35.613 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-26T12:15:35.613 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T12:15:35.613 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:15:35.795 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:35.823 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T12:15:35.824 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T12:15:35.825 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-04-26T12:15:35.859 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-04-26T12:15:35.859 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-04-26T12:15:35.859 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.02 2024-04-26T12:15:35.859 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 129.el8 2024-04-26T12:15:35.859 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-04-26T12:15:35.859 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T12:15:35.859 INFO:teuthology.orchestra.run.smithi142.stdout:Group : System Environment/Base 2024-04-26T12:15:35.859 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 9265586 2024-04-26T12:15:35.859 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-04-26T12:15:35.859 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T12:15:35.859 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T12:15:35.860 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T12:15:35.860 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T12:15:35.860 INFO:teuthology.orchestra.run.smithi142.stdout:Relocations : (not relocatable) 2024-04-26T12:15:35.860 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : CentOS BuildSystem 2024-04-26T12:15:35.860 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-04-26T12:15:35.860 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T12:15:35.860 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-04-26T12:15:35.860 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-04-26T12:15:35.860 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:15:35.860 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T12:15:35.860 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T12:15:35.860 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T12:15:35.860 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-04-26T12:15:35.861 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:15:35.861 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T12:15:35.861 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T12:15:35.861 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 4.18.0-552.el8.x86_64 2024-04-26T12:15:35.861 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T12:15:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T12:15:36.666 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T12:15:36.666 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:15:36.666 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-26T12:15:36.666 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T12:15:36.667 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T12:15:36.667 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:15:36.667 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-26T12:15:36.813 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:15:37.031 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T12:15:37.032 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T12:15:37.032 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T12:15:37.032 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T12:15:37.032 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T12:15:37.032 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-26T12:15:37.032 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T12:15:37.032 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T12:15:37.243 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T12:15:37.243 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T12:15:37.243 DEBUG:teuthology.orchestra.run.smithi115:> sudo rpm -qi grub2-tools 2024-04-26T12:15:37.276 INFO:teuthology.orchestra.run.smithi115.stdout:Name : grub2-tools 2024-04-26T12:15:37.277 INFO:teuthology.orchestra.run.smithi115.stdout:Epoch : 1 2024-04-26T12:15:37.277 INFO:teuthology.orchestra.run.smithi115.stdout:Version : 2.02 2024-04-26T12:15:37.277 INFO:teuthology.orchestra.run.smithi115.stdout:Release : 129.el8 2024-04-26T12:15:37.277 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: x86_64 2024-04-26T12:15:37.277 INFO:teuthology.orchestra.run.smithi115.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T12:15:37.277 INFO:teuthology.orchestra.run.smithi115.stdout:Group : System Environment/Base 2024-04-26T12:15:37.277 INFO:teuthology.orchestra.run.smithi115.stdout:Size : 9265586 2024-04-26T12:15:37.277 INFO:teuthology.orchestra.run.smithi115.stdout:License : GPLv3+ 2024-04-26T12:15:37.277 INFO:teuthology.orchestra.run.smithi115.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T12:15:37.277 INFO:teuthology.orchestra.run.smithi115.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T12:15:37.277 INFO:teuthology.orchestra.run.smithi115.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T12:15:37.277 INFO:teuthology.orchestra.run.smithi115.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T12:15:37.277 INFO:teuthology.orchestra.run.smithi115.stdout:Relocations : (not relocatable) 2024-04-26T12:15:37.278 INFO:teuthology.orchestra.run.smithi115.stdout:Packager : CentOS BuildSystem 2024-04-26T12:15:37.278 INFO:teuthology.orchestra.run.smithi115.stdout:Vendor : CentOS 2024-04-26T12:15:37.278 INFO:teuthology.orchestra.run.smithi115.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T12:15:37.278 INFO:teuthology.orchestra.run.smithi115.stdout:Summary : Support tools for GRUB. 2024-04-26T12:15:37.278 INFO:teuthology.orchestra.run.smithi115.stdout:Description : 2024-04-26T12:15:37.278 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:15:37.278 INFO:teuthology.orchestra.run.smithi115.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T12:15:37.278 INFO:teuthology.orchestra.run.smithi115.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T12:15:37.278 INFO:teuthology.orchestra.run.smithi115.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T12:15:37.278 INFO:teuthology.orchestra.run.smithi115.stdout:hardware devices. 2024-04-26T12:15:37.278 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:15:37.278 INFO:teuthology.orchestra.run.smithi115.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T12:15:37.279 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T12:15:37.279 INFO:teuthology.task.kernel:Updating grub on smithi115 to boot 4.18.0-552.el8.x86_64 2024-04-26T12:15:37.280 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T12:15:37.536 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-04-26T12:15:39.132 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2024-04-26T12:15:39.855 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-04-26T12:15:39.856 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-04-26T12:15:39.887 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.erGsY4y3hF 2024-04-26T12:15:39.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.erGsY4y3hF 2024-04-26T12:15:39.960 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.erGsY4y3hF 2024-04-26T12:15:40.104 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.erGsY4y3hF is 6KB 2024-04-26T12:15:40.151 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.erGsY4y3hF 2024-04-26T12:15:40.168 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T12:15:40.245 INFO:teuthology.orchestra.run.smithi142.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T12:15:40.245 INFO:teuthology.orchestra.run.smithi142.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T12:15:40.245 INFO:teuthology.orchestra.run.smithi142.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T12:15:40.245 INFO:teuthology.orchestra.run.smithi142.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T12:15:40.246 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T12:15:40.387 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-04-26T12:15:41.271 INFO:teuthology.orchestra.run.smithi115.stderr:done 2024-04-26T12:15:41.273 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-04-26T12:15:41.297 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.8AfvmaMz5D 2024-04-26T12:15:41.298 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8AfvmaMz5D 2024-04-26T12:15:41.385 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.8AfvmaMz5D 2024-04-26T12:15:41.489 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.8AfvmaMz5D is 6KB 2024-04-26T12:15:41.537 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.8AfvmaMz5D 2024-04-26T12:15:41.555 DEBUG:teuthology.orchestra.run.smithi115:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T12:15:41.627 INFO:teuthology.orchestra.run.smithi115.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T12:15:41.628 INFO:teuthology.orchestra.run.smithi115.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T12:15:41.628 INFO:teuthology.orchestra.run.smithi115.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T12:15:41.628 INFO:teuthology.orchestra.run.smithi115.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T12:15:41.629 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T12:15:41.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2024-04-26T12:15:51.702 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-26T12:15:51.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T12:15:51.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:15:52.399 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T12:15:52.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-04-26T12:15:52.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:10.270 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-26T12:16:10.390 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-26T12:16:10.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-26T12:16:10.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:10.782 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-04-26T12:16:11.814 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-26T12:16:11.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-26T12:16:11.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:19.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T12:16:19.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:19.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-04-26T12:16:19.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:22.338 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-26T12:16:22.850 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-04-26T12:16:28.962 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-26T12:16:30.238 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-26T12:16:34.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T12:16:34.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:34.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-04-26T12:16:34.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:37.406 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-26T12:16:37.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-26T12:16:37.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:39.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-26T12:16:39.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:41.022 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-26T12:16:42.306 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-26T12:16:52.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T12:16:52.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:53.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-26T12:16:53.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:54.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-26T12:16:54.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:16:55.486 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-26T12:17:06.768 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-04-26T12:17:07.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-04-26T12:17:07.104 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-552.el8.x86_64"... 2024-04-26T12:17:07.105 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-04-26T12:17:07.122 INFO:teuthology.orchestra.run.smithi046.stdout:4.18.0-552.el8.x86_64 2024-04-26T12:17:07.122 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T12:17:07.122 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T12:17:07.122 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T12:17:08.123 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T12:17:08.123 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:17:08.227 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2024-04-26T12:17:08.240 DEBUG:teuthology.parallel:result is None 2024-04-26T12:17:12.734 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-26T12:17:13.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T12:17:13.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:17:13.880 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-04-26T12:17:14.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T12:17:14.157 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "4.18.0-552.el8.x86_64"... 2024-04-26T12:17:14.157 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-04-26T12:17:14.176 INFO:teuthology.orchestra.run.smithi136.stdout:4.18.0-552.el8.x86_64 2024-04-26T12:17:14.177 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T12:17:14.177 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T12:17:14.177 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T12:17:15.178 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-26T12:17:15.178 DEBUG:teuthology.orchestra.run.smithi136:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:17:15.248 INFO:teuthology.orchestra.run.smithi136.stdout:ttyS1 2024-04-26T12:17:15.261 DEBUG:teuthology.parallel:result is None 2024-04-26T12:17:25.768 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-26T12:17:26.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-26T12:17:26.589 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "4.18.0-552.el8.x86_64"... 2024-04-26T12:17:26.590 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-04-26T12:17:26.608 INFO:teuthology.orchestra.run.smithi142.stdout:4.18.0-552.el8.x86_64 2024-04-26T12:17:26.608 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T12:17:26.608 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T12:17:26.609 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T12:17:27.610 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-26T12:17:27.610 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:17:27.682 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-04-26T12:17:27.697 DEBUG:teuthology.parallel:result is None 2024-04-26T12:17:27.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-26T12:17:27.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:17:28.839 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-26T12:17:29.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-26T12:17:29.511 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "4.18.0-552.el8.x86_64"... 2024-04-26T12:17:29.511 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-26T12:17:29.528 INFO:teuthology.orchestra.run.smithi115.stdout:4.18.0-552.el8.x86_64 2024-04-26T12:17:29.528 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T12:17:29.528 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T12:17:29.528 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T12:17:30.530 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-26T12:17:30.530 DEBUG:teuthology.orchestra.run.smithi115:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:17:30.613 INFO:teuthology.orchestra.run.smithi115.stdout:ttyS1 2024-04-26T12:17:30.628 DEBUG:teuthology.parallel:result is None 2024-04-26T12:17:30.629 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T12:17:30.636 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T12:17:30.636 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:17:30.641 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:17:30.642 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:17:30.645 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:17:30.667 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T12:17:30.681 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T12:17:30.713 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T12:17:30.714 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:17:30.716 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:17:30.718 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:17:30.721 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:17:30.763 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T12:17:30.770 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T12:17:30.771 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:17:30.790 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:17:30.793 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:17:30.796 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:17:30.830 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:17:30.832 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:17:30.834 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:17:30.840 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:17:30.841 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:17:30.845 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:17:30.846 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:17:30.851 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:17:30.852 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T12:17:30.861 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T12:17:30.861 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:17:30.888 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:17:30.890 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:17:30.893 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:17:30.923 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T12:17:30.932 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T12:17:30.933 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:17:30.959 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:17:30.961 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:17:30.964 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:17:30.982 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:17:31.063 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:17:31.122 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:17:31.181 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:17:31.213 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:17:31.214 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:17:31.282 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:17:31.328 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:17:31.376 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:17:31.457 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:17:31.501 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-26T12:17:31.501 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:17:31.567 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:17:31.613 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:17:31.677 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:17:31.724 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:17:31.768 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T12:17:31.768 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:17:31.835 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:17:31.884 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:17:31.940 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:17:32.028 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:17:32.072 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T12:17:32.073 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:17:32.142 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-04-26T12:17:32.144 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2024-04-26T12:17:32.147 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-04-26T12:17:32.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-04-26T12:17:32.200 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:17:32.202 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:17:32.239 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:17:32.249 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:17:32.721 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T12:17:32.729 INFO:teuthology.task.internal:Starting timer... 2024-04-26T12:17:32.729 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T12:17:32.778 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T12:17:32.813 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-26T12:17:32.814 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-04-26T12:17:32.898 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-04-26T12:17:32.900 DEBUG:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2024-04-26T12:17:32.969 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: 2024-04-26T12:17:32.971 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2024-04-26T12:17:33.045 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2024-04-26T12:17:33.047 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-04-26T12:17:33.111 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-04-26T12:17:33.112 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T12:17:33.112 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-04-26T12:17:33.191 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-04-26T12:17:33.191 DEBUG:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2024-04-26T12:17:33.223 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2024-04-26T12:17:33.223 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2024-04-26T12:17:33.243 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2024-04-26T12:17:33.244 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-04-26T12:17:33.302 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-04-26T12:17:33.303 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi115.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi136.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2024-04-26T12:17:33.303 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:17:33.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:17:33.334 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:17:33.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:17:33.362 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:17:33.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:17:33.389 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:17:33.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:17:33.417 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T12:17:33.417 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-04-26T12:17:33.447 DEBUG:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2024-04-26T12:17:33.474 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2024-04-26T12:17:33.500 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-04-26T12:17:33.529 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T12:17:33.540 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T12:17:33.546 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T12:17:33.670 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T12:17:33.687 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T12:17:33.688 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi115.front.sepia.ceph.com,smithi136.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T12:23:46.010 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi115.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-04-26T12:23:46.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-04-26T12:23:46.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:23:46.092 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-04-26T12:23:46.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-04-26T12:23:46.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-26T12:23:46.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:23:46.262 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-26T12:23:46.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-26T12:23:46.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T12:23:46.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:23:46.411 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-04-26T12:23:46.439 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T12:23:46.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-26T12:23:46.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:23:46.515 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-26T12:23:46.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-26T12:23:46.589 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T12:23:46.601 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T12:23:46.602 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:23:46.602 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:23:46.605 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:23:46.605 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:23:46.607 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:23:46.607 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:23:46.609 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:23:46.610 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:23:46.641 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:23:46.642 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:23:46.642 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:23:46.656 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:23:46.656 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:23:46.657 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:23:46.664 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T12:23:46.679 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T12:23:46.717 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2024-04-26T12:23:46.722 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: ntpd: command not found 2024-04-26T12:23:46.729 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2024-04-26T12:23:46.729 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-04-26T12:23:46.734 INFO:teuthology.orchestra.run.smithi115.stdout:506 Cannot talk to daemon 2024-04-26T12:23:46.742 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-04-26T12:23:46.743 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:23:46.748 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:23:46.750 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-04-26T12:23:46.756 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:23:46.756 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:23:46.761 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:23:46.762 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-04-26T12:23:46.771 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:23:46.776 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T12:23:46.790 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T12:23:46.821 INFO:teuthology.orchestra.run.smithi136.stderr:bash: ntpq: command not found 2024-04-26T12:23:46.824 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:23:46.825 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-04-26T12:23:46.825 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.825 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.825 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.825 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.831 INFO:teuthology.orchestra.run.smithi115.stderr:bash: ntpq: command not found 2024-04-26T12:23:46.835 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:23:46.835 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-04-26T12:23:46.835 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.835 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.835 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.835 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.841 INFO:teuthology.orchestra.run.smithi046.stderr:bash: ntpq: command not found 2024-04-26T12:23:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:23:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-04-26T12:23:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.845 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.864 INFO:teuthology.orchestra.run.smithi142.stderr:bash: ntpq: command not found 2024-04-26T12:23:46.869 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:23:46.869 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-04-26T12:23:46.869 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.869 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.869 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.869 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:23:46.869 INFO:teuthology.run_tasks:Running task install... 2024-04-26T12:23:46.877 DEBUG:teuthology.task.install:project ceph 2024-04-26T12:23:46.878 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}} 2024-04-26T12:23:46.878 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'} 2024-04-26T12:23:46.878 INFO:teuthology.task.install:Using flavor: default 2024-04-26T12:23:46.884 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T12:23:46.884 INFO:teuthology.task.install:extra packages: [] 2024-04-26T12:23:46.885 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:23:46.885 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:23:46.887 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:23:46.888 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:23:46.889 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:23:46.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:23:46.890 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T12:23:46.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:23:47.039 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T12:23:47.040 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:23:47.051 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T12:23:47.052 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:23:47.103 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T12:23:47.103 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:23:47.123 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T12:23:47.123 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T12:23:47.159 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:23:47.159 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:23:47.159 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:23:47.162 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:23:47.162 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T12:23:47.162 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:23:47.191 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:23:47.191 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:23:47.192 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:23:47.192 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:23:47.230 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:23:47.230 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T12:23:47.231 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:23:47.258 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:23:47.262 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:23:47.263 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:23:47.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:23:47.268 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T12:23:47.269 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-26T12:23:47.269 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T12:23:47.296 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T12:23:47.296 DEBUG:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T12:23:47.334 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:23:47.336 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:23:47.345 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:23:47.365 DEBUG:teuthology.orchestra.run.smithi115:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T12:23:47.402 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2024-04-26T12:23:47.403 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2024-04-26T12:23:47.414 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-04-26T12:23:47.415 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:23:47.416 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-04-26T12:23:47.442 DEBUG:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T12:23:47.482 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-04-26T12:23:47.484 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-04-26T12:23:47.508 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2024-04-26T12:23:47.509 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum clean all 2024-04-26T12:23:47.668 INFO:teuthology.orchestra.run.smithi136.stdout:78 files removed 2024-04-26T12:23:47.695 INFO:teuthology.orchestra.run.smithi046.stdout:78 files removed 2024-04-26T12:23:47.696 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:23:47.724 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:23:47.748 INFO:teuthology.orchestra.run.smithi142.stdout:78 files removed 2024-04-26T12:23:47.776 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:23:47.784 INFO:teuthology.orchestra.run.smithi115.stdout:78 files removed 2024-04-26T12:23:47.813 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T12:23:48.442 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 238 kB/s | 80 kB 00:00 2024-04-26T12:23:48.532 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 235 kB/s | 80 kB 00:00 2024-04-26T12:23:48.549 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 202 kB/s | 80 kB 00:00 2024-04-26T12:23:48.621 INFO:teuthology.orchestra.run.smithi115.stdout:ceph packages for x86_64 203 kB/s | 80 kB 00:00 2024-04-26T12:23:48.776 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 38 kB/s | 11 kB 00:00 2024-04-26T12:23:48.866 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 41 kB/s | 11 kB 00:00 2024-04-26T12:23:48.883 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 36 kB/s | 11 kB 00:00 2024-04-26T12:23:48.979 INFO:teuthology.orchestra.run.smithi115.stdout:ceph noarch packages 36 kB/s | 11 kB 00:00 2024-04-26T12:23:49.135 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2024-04-26T12:23:49.242 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2024-04-26T12:23:49.267 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 4.0 kB/s | 1.5 kB 00:00 2024-04-26T12:23:49.330 INFO:teuthology.orchestra.run.smithi115.stdout:ceph source packages 4.6 kB/s | 1.5 kB 00:00 2024-04-26T12:23:51.334 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 8 - AppStream 14 MB/s | 28 MB 00:02 2024-04-26T12:23:51.651 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - AppStream 12 MB/s | 28 MB 00:02 2024-04-26T12:23:52.763 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - AppStream 8.2 MB/s | 28 MB 00:03 2024-04-26T12:23:57.860 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - BaseOS 8.5 MB/s | 10 MB 00:01 2024-04-26T12:23:57.910 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 8 - BaseOS 8.4 MB/s | 10 MB 00:01 2024-04-26T12:23:59.446 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - BaseOS 6.1 MB/s | 10 MB 00:01 2024-04-26T12:23:59.960 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 8 - Extras 54 kB/s | 18 kB 00:00 2024-04-26T12:23:59.985 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - Extras 36 kB/s | 18 kB 00:00 2024-04-26T12:24:00.661 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 7.7 kB 00:00 2024-04-26T12:24:00.677 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 7.7 kB 00:00 2024-04-26T12:24:01.230 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - Extras 96 kB/s | 18 kB 00:00 2024-04-26T12:24:01.309 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 8 - AppStream 2.3 MB/s | 28 MB 00:12 2024-04-26T12:24:01.795 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 8 - PowerTools 4.8 MB/s | 5.0 MB 00:01 2024-04-26T12:24:01.812 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 8 - PowerTools 4.8 MB/s | 5.0 MB 00:01 2024-04-26T12:24:02.930 INFO:teuthology.orchestra.run.smithi142.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2024-04-26T12:24:02.938 INFO:teuthology.orchestra.run.smithi046.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2024-04-26T12:24:03.875 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2024-04-26T12:24:04.017 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2024-04-26T12:24:04.971 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - Extras common packages 2.1 kB/s | 7.7 kB 00:03 2024-04-26T12:24:06.282 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - PowerTools 4.1 MB/s | 5.0 MB 00:01 2024-04-26T12:24:07.358 INFO:teuthology.orchestra.run.smithi115.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-04-26T12:24:07.723 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 386 kB/s | 24 kB 00:00 2024-04-26T12:24:08.090 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 328 kB/s | 24 kB 00:00 2024-04-26T12:24:08.693 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 8 - BaseOS 4.4 MB/s | 10 MB 00:02 2024-04-26T12:24:10.552 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 8 - Extras 75 kB/s | 18 kB 00:00 2024-04-26T12:24:11.261 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 7.7 kB 00:00 2024-04-26T12:24:11.325 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:24:11.326 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:24:11.407 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-26T12:24:11.420 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-04-26T12:24:11.420 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-26T12:24:11.420 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-04-26T12:24:11.420 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-26T12:24:11.420 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-26T12:24:11.420 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T12:24:11.420 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T12:24:11.420 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T12:24:11.420 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T12:24:11.421 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T12:24:11.421 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T12:24:11.421 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T12:24:11.421 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T12:24:11.421 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T12:24:11.421 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T12:24:11.421 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T12:24:11.421 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T12:24:11.421 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T12:24:11.421 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-26T12:24:11.421 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-26T12:24:11.421 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-26T12:24:11.421 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T12:24:11.422 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T12:24:11.422 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T12:24:11.422 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-26T12:24:11.422 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-26T12:24:11.422 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-26T12:24:11.422 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T12:24:11.422 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T12:24:11.422 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T12:24:11.422 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T12:24:11.422 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T12:24:11.422 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T12:24:11.423 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T12:24:11.423 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-26T12:24:11.423 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-04-26T12:24:11.423 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-26T12:24:11.423 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-26T12:24:11.423 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-26T12:24:11.423 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-26T12:24:11.423 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-26T12:24:11.423 INFO:teuthology.orchestra.run.smithi142.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-26T12:24:11.423 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T12:24:11.423 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T12:24:11.424 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-26T12:24:11.424 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-26T12:24:11.424 INFO:teuthology.orchestra.run.smithi142.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-26T12:24:11.424 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-26T12:24:11.424 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-26T12:24:11.424 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-26T12:24:11.424 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-26T12:24:11.424 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-26T12:24:11.424 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-26T12:24:11.424 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T12:24:11.424 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T12:24:11.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T12:24:11.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T12:24:11.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T12:24:11.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T12:24:11.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T12:24:11.425 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T12:24:11.425 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T12:24:11.425 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T12:24:11.425 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T12:24:11.425 INFO:teuthology.orchestra.run.smithi142.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-26T12:24:11.425 INFO:teuthology.orchestra.run.smithi142.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-26T12:24:11.425 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T12:24:11.425 INFO:teuthology.orchestra.run.smithi142.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-26T12:24:11.426 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-04-26T12:24:11.426 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T12:24:11.426 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-04-26T12:24:11.426 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T12:24:11.426 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T12:24:11.426 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T12:24:11.426 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T12:24:11.426 INFO:teuthology.orchestra.run.smithi142.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-26T12:24:11.426 INFO:teuthology.orchestra.run.smithi142.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-26T12:24:11.426 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T12:24:11.426 INFO:teuthology.orchestra.run.smithi142.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-26T12:24:11.426 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-26T12:24:11.427 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T12:24:11.427 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T12:24:11.427 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-26T12:24:11.427 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-26T12:24:11.427 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-26T12:24:11.427 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-26T12:24:11.427 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-26T12:24:11.427 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T12:24:11.427 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-26T12:24:11.427 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T12:24:11.427 INFO:teuthology.orchestra.run.smithi142.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T12:24:11.427 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T12:24:11.428 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T12:24:11.428 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T12:24:11.428 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T12:24:11.428 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T12:24:11.428 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T12:24:11.428 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T12:24:11.428 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T12:24:11.428 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T12:24:11.428 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T12:24:11.428 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T12:24:11.428 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-26T12:24:11.428 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-26T12:24:11.428 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-26T12:24:11.429 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-26T12:24:11.429 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T12:24:11.429 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T12:24:11.429 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T12:24:11.429 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T12:24:11.429 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T12:24:11.429 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T12:24:11.429 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-26T12:24:11.429 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-26T12:24:11.429 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-26T12:24:11.429 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-26T12:24:11.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T12:24:11.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T12:24:11.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T12:24:11.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T12:24:11.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-26T12:24:11.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-26T12:24:11.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T12:24:11.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T12:24:11.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T12:24:11.430 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-26T12:24:11.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T12:24:11.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T12:24:11.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-26T12:24:11.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T12:24:11.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T12:24:11.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T12:24:11.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T12:24:11.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T12:24:11.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T12:24:11.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T12:24:11.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T12:24:11.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T12:24:11.431 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T12:24:11.431 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T12:24:11.432 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T12:24:11.432 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T12:24:11.432 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-26T12:24:11.432 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:24:11.432 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-26T12:24:11.432 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-04-26T12:24:11.432 INFO:teuthology.orchestra.run.smithi142.stdout:Install 122 Packages 2024-04-26T12:24:11.432 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 15 Packages 2024-04-26T12:24:11.432 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:24:11.433 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 207 M 2024-04-26T12:24:11.433 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-26T12:24:11.974 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:24:11.974 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:24:12.063 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-04-26T12:24:12.076 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================================ 2024-04-26T12:24:12.077 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-04-26T12:24:12.077 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================================ 2024-04-26T12:24:12.077 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-04-26T12:24:12.077 INFO:teuthology.orchestra.run.smithi046.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-26T12:24:12.077 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T12:24:12.077 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T12:24:12.077 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T12:24:12.077 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T12:24:12.077 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T12:24:12.077 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T12:24:12.077 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T12:24:12.077 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T12:24:12.078 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T12:24:12.078 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T12:24:12.078 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T12:24:12.078 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T12:24:12.078 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T12:24:12.078 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-26T12:24:12.078 INFO:teuthology.orchestra.run.smithi046.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-26T12:24:12.078 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-26T12:24:12.078 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T12:24:12.078 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T12:24:12.078 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T12:24:12.078 INFO:teuthology.orchestra.run.smithi046.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-26T12:24:12.079 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-26T12:24:12.079 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-26T12:24:12.079 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T12:24:12.079 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T12:24:12.079 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T12:24:12.079 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T12:24:12.079 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T12:24:12.079 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T12:24:12.079 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T12:24:12.079 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-26T12:24:12.079 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-04-26T12:24:12.079 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-26T12:24:12.079 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-26T12:24:12.080 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-26T12:24:12.080 INFO:teuthology.orchestra.run.smithi046.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-26T12:24:12.080 INFO:teuthology.orchestra.run.smithi046.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-26T12:24:12.080 INFO:teuthology.orchestra.run.smithi046.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-26T12:24:12.080 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T12:24:12.080 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T12:24:12.080 INFO:teuthology.orchestra.run.smithi046.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-26T12:24:12.080 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-26T12:24:12.080 INFO:teuthology.orchestra.run.smithi046.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-26T12:24:12.080 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-26T12:24:12.080 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-26T12:24:12.080 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-26T12:24:12.080 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-26T12:24:12.081 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-04-26T12:24:12.081 INFO:teuthology.orchestra.run.smithi046.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-26T12:24:12.081 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T12:24:12.081 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T12:24:12.081 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T12:24:12.081 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T12:24:12.081 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T12:24:12.081 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T12:24:12.081 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T12:24:12.081 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T12:24:12.081 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T12:24:12.081 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T12:24:12.081 INFO:teuthology.orchestra.run.smithi046.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T12:24:12.081 INFO:teuthology.orchestra.run.smithi046.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-26T12:24:12.082 INFO:teuthology.orchestra.run.smithi046.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-26T12:24:12.082 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T12:24:12.082 INFO:teuthology.orchestra.run.smithi046.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-26T12:24:12.082 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-04-26T12:24:12.082 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T12:24:12.082 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-04-26T12:24:12.082 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T12:24:12.082 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T12:24:12.082 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T12:24:12.083 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T12:24:12.083 INFO:teuthology.orchestra.run.smithi046.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-26T12:24:12.083 INFO:teuthology.orchestra.run.smithi046.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-26T12:24:12.083 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T12:24:12.083 INFO:teuthology.orchestra.run.smithi046.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-26T12:24:12.083 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-26T12:24:12.083 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T12:24:12.083 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T12:24:12.083 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-26T12:24:12.083 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-26T12:24:12.083 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-26T12:24:12.084 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-26T12:24:12.084 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-26T12:24:12.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T12:24:12.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-26T12:24:12.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T12:24:12.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T12:24:12.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T12:24:12.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T12:24:12.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T12:24:12.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T12:24:12.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T12:24:12.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T12:24:12.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T12:24:12.084 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T12:24:12.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T12:24:12.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T12:24:12.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T12:24:12.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-26T12:24:12.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-26T12:24:12.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-26T12:24:12.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-26T12:24:12.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T12:24:12.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T12:24:12.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T12:24:12.085 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T12:24:12.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T12:24:12.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T12:24:12.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-26T12:24:12.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-26T12:24:12.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-26T12:24:12.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-26T12:24:12.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T12:24:12.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T12:24:12.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T12:24:12.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T12:24:12.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-26T12:24:12.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-26T12:24:12.086 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T12:24:12.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T12:24:12.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T12:24:12.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-26T12:24:12.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T12:24:12.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T12:24:12.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-26T12:24:12.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T12:24:12.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T12:24:12.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T12:24:12.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T12:24:12.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T12:24:12.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T12:24:12.087 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T12:24:12.088 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T12:24:12.088 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T12:24:12.088 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T12:24:12.088 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T12:24:12.088 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T12:24:12.088 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T12:24:12.088 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-26T12:24:12.088 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:24:12.088 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-04-26T12:24:12.088 INFO:teuthology.orchestra.run.smithi046.stdout:============================================================================================ 2024-04-26T12:24:12.088 INFO:teuthology.orchestra.run.smithi046.stdout:Install 122 Packages 2024-04-26T12:24:12.088 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 15 Packages 2024-04-26T12:24:12.088 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:24:12.089 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 207 M 2024-04-26T12:24:12.089 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-04-26T12:24:12.174 INFO:teuthology.orchestra.run.smithi142.stdout:(1/137): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 50 kB/s | 6.4 kB 00:00 2024-04-26T12:24:12.366 INFO:teuthology.orchestra.run.smithi142.stdout:(2/137): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 4.4 MB/s | 859 kB 00:00 2024-04-26T12:24:12.433 INFO:teuthology.orchestra.run.smithi142.stdout:(3/137): ceph-immutable-object-cache-18.2.2-125 2.4 MB/s | 165 kB 00:00 2024-04-26T12:24:12.520 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 8 - PowerTools 4.2 MB/s | 5.0 MB 00:01 2024-04-26T12:24:12.691 INFO:teuthology.orchestra.run.smithi046.stdout:(1/137): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 26 kB/s | 6.4 kB 00:00 2024-04-26T12:24:12.725 INFO:teuthology.orchestra.run.smithi142.stdout:(4/137): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 7.8 MB/s | 2.3 MB 00:00 2024-04-26T12:24:12.942 INFO:teuthology.orchestra.run.smithi142.stdout:(5/137): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 7.2 MB/s | 1.6 MB 00:00 2024-04-26T12:24:13.517 INFO:teuthology.orchestra.run.smithi046.stdout:(2/137): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.0 MB/s | 859 kB 00:00 2024-04-26T12:24:13.601 INFO:teuthology.orchestra.run.smithi142.stdout:(6/137): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 7.3 MB/s | 4.8 MB 00:00 2024-04-26T12:24:13.617 INFO:teuthology.orchestra.run.smithi046.stdout:(3/137): ceph-immutable-object-cache-18.2.2-125 1.6 MB/s | 165 kB 00:00 2024-04-26T12:24:13.622 INFO:teuthology.orchestra.run.smithi136.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-04-26T12:24:13.835 INFO:teuthology.orchestra.run.smithi142.stdout:(7/137): ceph-common-18.2.2-1256.gdc093b5e.el8. 12 MB/s | 22 MB 00:01 2024-04-26T12:24:13.918 INFO:teuthology.orchestra.run.smithi142.stdout:(8/137): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 2.9 MB/s | 5.5 MB 00:01 2024-04-26T12:24:14.026 INFO:teuthology.orchestra.run.smithi142.stdout:(9/137): ceph-selinux-18.2.2-1256.gdc093b5e.el8 225 kB/s | 24 kB 00:00 2024-04-26T12:24:14.109 INFO:teuthology.orchestra.run.smithi046.stdout:(4/137): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 4.6 MB/s | 2.3 MB 00:00 2024-04-26T12:24:14.626 INFO:teuthology.orchestra.run.smithi046.stdout:(5/137): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 3.0 MB/s | 1.6 MB 00:00 2024-04-26T12:24:14.906 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-04-26T12:24:14.909 INFO:teuthology.orchestra.run.smithi046.stdout:(6/137): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 2.2 MB/s | 5.5 MB 00:02 2024-04-26T12:24:15.252 INFO:teuthology.orchestra.run.smithi142.stdout:(10/137): ceph-radosgw-18.2.2-1256.gdc093b5e.el 9.2 MB/s | 13 MB 00:01 2024-04-26T12:24:15.327 INFO:teuthology.orchestra.run.smithi142.stdout:(11/137): libcephfs-devel-18.2.2-1256.gdc093b5e 414 kB/s | 31 kB 00:00 2024-04-26T12:24:15.494 INFO:teuthology.orchestra.run.smithi142.stdout:(12/137): libcephfs2-18.2.2-1256.gdc093b5e.el8. 4.6 MB/s | 781 kB 00:00 2024-04-26T12:24:15.510 INFO:teuthology.orchestra.run.smithi046.stdout:(7/137): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 5.5 MB/s | 4.8 MB 00:00 2024-04-26T12:24:15.561 INFO:teuthology.orchestra.run.smithi142.stdout:(13/137): libcephsqlite-18.2.2-1256.gdc093b5e.e 2.1 MB/s | 142 kB 00:00 2024-04-26T12:24:15.794 INFO:teuthology.orchestra.run.smithi142.stdout:(14/137): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 8.4 MB/s | 18 MB 00:02 2024-04-26T12:24:15.820 INFO:teuthology.orchestra.run.smithi142.stdout:(15/137): librados-devel-18.2.2-1256.gdc093b5e. 537 kB/s | 139 kB 00:00 2024-04-26T12:24:15.928 INFO:teuthology.orchestra.run.smithi142.stdout:(16/137): libradosstriper1-18.2.2-1256.gdc093b5 3.5 MB/s | 474 kB 00:00 2024-04-26T12:24:16.029 INFO:teuthology.orchestra.run.smithi142.stdout:(17/137): python3-ceph-argparse-18.2.2-1256.gdc 446 kB/s | 45 kB 00:00 2024-04-26T12:24:16.129 INFO:teuthology.orchestra.run.smithi142.stdout:(18/137): python3-ceph-common-18.2.2-1256.gdc09 1.3 MB/s | 129 kB 00:00 2024-04-26T12:24:16.238 INFO:teuthology.orchestra.run.smithi142.stdout:(19/137): python3-cephfs-18.2.2-1256.gdc093b5e. 1.8 MB/s | 197 kB 00:00 2024-04-26T12:24:16.338 INFO:teuthology.orchestra.run.smithi142.stdout:(20/137): python3-rados-18.2.2-1256.gdc093b5e.e 3.6 MB/s | 371 kB 00:00 2024-04-26T12:24:16.430 INFO:teuthology.orchestra.run.smithi142.stdout:(21/137): python3-rbd-18.2.2-1256.gdc093b5e.el8 3.9 MB/s | 364 kB 00:00 2024-04-26T12:24:16.513 INFO:teuthology.orchestra.run.smithi142.stdout:(22/137): python3-rgw-18.2.2-1256.gdc093b5e.el8 1.3 MB/s | 107 kB 00:00 2024-04-26T12:24:16.589 INFO:teuthology.orchestra.run.smithi142.stdout:(23/137): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.2 MB/s | 95 kB 00:00 2024-04-26T12:24:16.685 INFO:teuthology.orchestra.run.smithi046.stdout:(8/137): ceph-radosgw-18.2.2-1256.gdc093b5e.el8 11 MB/s | 13 MB 00:01 2024-04-26T12:24:16.719 INFO:teuthology.orchestra.run.smithi142.stdout:(24/137): librgw2-18.2.2-1256.gdc093b5e.el8.x86 7.3 MB/s | 6.6 MB 00:00 2024-04-26T12:24:16.719 INFO:teuthology.orchestra.run.smithi046.stdout:(9/137): ceph-selinux-18.2.2-1256.gdc093b5e.el8 739 kB/s | 24 kB 00:00 2024-04-26T12:24:16.823 INFO:teuthology.orchestra.run.smithi142.stdout:(25/137): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 1.7 MB/s | 181 kB 00:00 2024-04-26T12:24:16.915 INFO:teuthology.orchestra.run.smithi142.stdout:(26/137): ceph-grafana-dashboards-18.2.2-1256.g 265 kB/s | 24 kB 00:00 2024-04-26T12:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout:(27/137): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 8.6 MB/s | 3.5 MB 00:00 2024-04-26T12:24:17.015 INFO:teuthology.orchestra.run.smithi142.stdout:(28/137): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.3 MB/s | 138 kB 00:00 2024-04-26T12:24:17.499 INFO:teuthology.orchestra.run.smithi142.stdout:(29/137): ceph-mgr-dashboard-18.2.2-1256.gdc093 6.9 MB/s | 3.5 MB 00:00 2024-04-26T12:24:17.566 INFO:teuthology.orchestra.run.smithi142.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1256.gdc 3.6 MB/s | 246 kB 00:00 2024-04-26T12:24:17.633 INFO:teuthology.orchestra.run.smithi142.stdout:(31/137): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 740 kB/s | 49 kB 00:00 2024-04-26T12:24:17.708 INFO:teuthology.orchestra.run.smithi142.stdout:(32/137): ceph-prometheus-alerts-18.2.2-1256.gd 202 kB/s | 15 kB 00:00 2024-04-26T12:24:17.809 INFO:teuthology.orchestra.run.smithi142.stdout:(33/137): ceph-volume-18.2.2-1256.gdc093b5e.el8 2.6 MB/s | 263 kB 00:00 2024-04-26T12:24:17.884 INFO:teuthology.orchestra.run.smithi142.stdout:(34/137): cephadm-18.2.2-1256.gdc093b5e.el8.noa 2.3 MB/s | 173 kB 00:00 2024-04-26T12:24:18.059 INFO:teuthology.orchestra.run.smithi142.stdout:(35/137): automake-1.16.1-8.el8.noarch.rpm 4.1 MB/s | 740 kB 00:00 2024-04-26T12:24:18.151 INFO:teuthology.orchestra.run.smithi142.stdout:(36/137): ceph-mgr-diskprediction-local-18.2.2- 6.5 MB/s | 7.4 MB 00:01 2024-04-26T12:24:18.210 INFO:teuthology.orchestra.run.smithi142.stdout:(37/137): bison-3.0.4-10.el8.x86_64.rpm 4.5 MB/s | 688 kB 00:00 2024-04-26T12:24:18.293 INFO:teuthology.orchestra.run.smithi142.stdout:(38/137): flex-2.6.1-9.el8.x86_64.rpm 2.2 MB/s | 320 kB 00:00 2024-04-26T12:24:18.319 INFO:teuthology.orchestra.run.smithi142.stdout:(39/137): jq-1.6-8.el8.x86_64.rpm 1.8 MB/s | 203 kB 00:00 2024-04-26T12:24:18.402 INFO:teuthology.orchestra.run.smithi142.stdout:(40/137): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2024-04-26T12:24:18.511 INFO:teuthology.orchestra.run.smithi142.stdout:(41/137): librdkafka-1.6.1-1.el8.x86_64.rpm 3.0 MB/s | 677 kB 00:00 2024-04-26T12:24:18.536 INFO:teuthology.orchestra.run.smithi142.stdout:(42/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2024-04-26T12:24:18.586 INFO:teuthology.orchestra.run.smithi142.stdout:(43/137): oniguruma-6.8.2-3.el8.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-04-26T12:24:18.823 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 492 kB/s | 24 kB 00:00 2024-04-26T12:24:19.795 INFO:teuthology.orchestra.run.smithi142.stdout:(44/137): openblas-0.3.15-4.el8.x86_64.rpm 3.8 MB/s | 4.7 MB 00:01 2024-04-26T12:24:20.104 INFO:teuthology.orchestra.run.smithi142.stdout:(45/137): openblas-threads-0.3.15-4.el8.x86_64. 3.2 MB/s | 4.9 MB 00:01 2024-04-26T12:24:20.210 INFO:teuthology.orchestra.run.smithi046.stdout:(10/137): ceph-test-18.2.2-1256.gdc093b5e.el8.x 14 MB/s | 47 MB 00:03 2024-04-26T12:24:20.252 INFO:teuthology.orchestra.run.smithi046.stdout:(11/137): libcephfs-devel-18.2.2-1256.gdc093b5e 747 kB/s | 31 kB 00:00 2024-04-26T12:24:20.304 INFO:teuthology.orchestra.run.smithi142.stdout:(46/137): python3-jinja2-2.10.1-4.el8.noarch.rp 2.8 MB/s | 578 kB 00:00 2024-04-26T12:24:20.346 INFO:teuthology.orchestra.run.smithi142.stdout:(47/137): python3-jsonpatch-1.21-2.el8.noarch.r 643 kB/s | 27 kB 00:00 2024-04-26T12:24:20.388 INFO:teuthology.orchestra.run.smithi142.stdout:(48/137): python3-jsonpointer-1.10-11.el8.noarc 479 kB/s | 20 kB 00:00 2024-04-26T12:24:20.461 INFO:teuthology.orchestra.run.smithi046.stdout:(12/137): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 3.3 MB/s | 18 MB 00:05 2024-04-26T12:24:20.463 INFO:teuthology.orchestra.run.smithi142.stdout:(49/137): python3-mako-1.0.6-14.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2024-04-26T12:24:20.495 INFO:teuthology.orchestra.run.smithi046.stdout:(13/137): libcephfs2-18.2.2-1256.gdc093b5e.el8. 3.2 MB/s | 781 kB 00:00 2024-04-26T12:24:20.505 INFO:teuthology.orchestra.run.smithi142.stdout:(50/137): python3-markupsafe-0.23-19.el8.x86_64 936 kB/s | 39 kB 00:00 2024-04-26T12:24:20.528 INFO:teuthology.orchestra.run.smithi046.stdout:(14/137): libcephsqlite-18.2.2-1256.gdc093b5e.e 2.1 MB/s | 142 kB 00:00 2024-04-26T12:24:20.554 INFO:teuthology.orchestra.run.smithi046.stdout:(15/137): librados-devel-18.2.2-1256.gdc093b5e. 2.3 MB/s | 139 kB 00:00 2024-04-26T12:24:20.709 INFO:teuthology.orchestra.run.smithi046.stdout:(16/137): libradosstriper1-18.2.2-1256.gdc093b5 2.6 MB/s | 474 kB 00:00 2024-04-26T12:24:20.779 INFO:teuthology.orchestra.run.smithi046.stdout:(17/137): python3-ceph-argparse-18.2.2-1256.gdc 641 kB/s | 45 kB 00:00 2024-04-26T12:24:20.854 INFO:teuthology.orchestra.run.smithi046.stdout:(18/137): python3-ceph-common-18.2.2-1256.gdc09 1.7 MB/s | 129 kB 00:00 2024-04-26T12:24:20.938 INFO:teuthology.orchestra.run.smithi046.stdout:(19/137): python3-cephfs-18.2.2-1256.gdc093b5e. 2.3 MB/s | 197 kB 00:00 2024-04-26T12:24:21.138 INFO:teuthology.orchestra.run.smithi046.stdout:(20/137): librgw2-18.2.2-1256.gdc093b5e.el8.x86 11 MB/s | 6.6 MB 00:00 2024-04-26T12:24:21.163 INFO:teuthology.orchestra.run.smithi046.stdout:(21/137): python3-rados-18.2.2-1256.gdc093b5e.e 1.6 MB/s | 371 kB 00:00 2024-04-26T12:24:21.189 INFO:teuthology.orchestra.run.smithi046.stdout:(22/137): python3-rbd-18.2.2-1256.gdc093b5e.el8 7.1 MB/s | 364 kB 00:00 2024-04-26T12:24:21.248 INFO:teuthology.orchestra.run.smithi046.stdout:(23/137): python3-rgw-18.2.2-1256.gdc093b5e.el8 1.2 MB/s | 107 kB 00:00 2024-04-26T12:24:21.256 INFO:teuthology.orchestra.run.smithi142.stdout:(51/137): python3-babel-2.5.1-7.el8.noarch.rpm 3.3 MB/s | 4.8 MB 00:01 2024-04-26T12:24:21.273 INFO:teuthology.orchestra.run.smithi046.stdout:(24/137): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.1 MB/s | 95 kB 00:00 2024-04-26T12:24:21.323 INFO:teuthology.orchestra.run.smithi046.stdout:(25/137): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 3.5 MB/s | 181 kB 00:00 2024-04-26T12:24:21.356 INFO:teuthology.orchestra.run.smithi142.stdout:(52/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2024-04-26T12:24:21.374 INFO:teuthology.orchestra.run.smithi046.stdout:(26/137): ceph-grafana-dashboards-18.2.2-1256.g 488 kB/s | 24 kB 00:00 2024-04-26T12:24:21.398 INFO:teuthology.orchestra.run.smithi142.stdout:(53/137): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2024-04-26T12:24:21.424 INFO:teuthology.orchestra.run.smithi046.stdout:(27/137): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 2.7 MB/s | 138 kB 00:00 2024-04-26T12:24:21.456 INFO:teuthology.orchestra.run.smithi142.stdout:(54/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2024-04-26T12:24:21.532 INFO:teuthology.orchestra.run.smithi142.stdout:(55/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.6 MB/s | 126 kB 00:00 2024-04-26T12:24:21.590 INFO:teuthology.orchestra.run.smithi142.stdout:(56/137): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2024-04-26T12:24:21.632 INFO:teuthology.orchestra.run.smithi142.stdout:(57/137): python3-pytz-2017.2-11.el8.noarch.rpm 1.3 MB/s | 57 kB 00:00 2024-04-26T12:24:21.691 INFO:teuthology.orchestra.run.smithi046.stdout:(28/137): ceph-mgr-dashboard-18.2.2-1256.gdc093 13 MB/s | 3.5 MB 00:00 2024-04-26T12:24:21.691 INFO:teuthology.orchestra.run.smithi142.stdout:(58/137): python3-numpy-1.14.3-10.el8.x86_64.rp 3.1 MB/s | 3.7 MB 00:01 2024-04-26T12:24:21.866 INFO:teuthology.orchestra.run.smithi142.stdout:(59/137): python3-werkzeug-0.12.2-4.el8.noarch. 2.6 MB/s | 457 kB 00:00 2024-04-26T12:24:21.992 INFO:teuthology.orchestra.run.smithi142.stdout:(60/137): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2024-04-26T12:24:22.050 INFO:teuthology.orchestra.run.smithi142.stdout:(61/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2024-04-26T12:24:22.141 INFO:teuthology.orchestra.run.smithi046.stdout:(29/137): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 3.9 MB/s | 3.5 MB 00:00 2024-04-26T12:24:22.252 INFO:teuthology.orchestra.run.smithi046.stdout:(30/137): ceph-mgr-diskprediction-local-18.2.2- 13 MB/s | 7.4 MB 00:00 2024-04-26T12:24:22.300 INFO:teuthology.orchestra.run.smithi046.stdout:(31/137): ceph-mgr-modules-core-18.2.2-1256.gdc 1.5 MB/s | 246 kB 00:00 2024-04-26T12:24:22.325 INFO:teuthology.orchestra.run.smithi046.stdout:(32/137): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 674 kB/s | 49 kB 00:00 2024-04-26T12:24:22.375 INFO:teuthology.orchestra.run.smithi046.stdout:(33/137): ceph-prometheus-alerts-18.2.2-1256.gd 202 kB/s | 15 kB 00:00 2024-04-26T12:24:22.384 INFO:teuthology.orchestra.run.smithi142.stdout:(62/137): elfutils-libelf-devel-0.190-2.el8.x86 187 kB/s | 62 kB 00:00 2024-04-26T12:24:22.400 INFO:teuthology.orchestra.run.smithi046.stdout:(34/137): ceph-volume-18.2.2-1256.gdc093b5e.el8 3.4 MB/s | 263 kB 00:00 2024-04-26T12:24:22.443 INFO:teuthology.orchestra.run.smithi046.stdout:(35/137): cephadm-18.2.2-1256.gdc093b5e.el8.noa 2.5 MB/s | 173 kB 00:00 2024-04-26T12:24:22.443 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:24:22.444 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:24:22.524 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-04-26T12:24:22.537 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================================ 2024-04-26T12:24:22.537 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-04-26T12:24:22.537 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================================ 2024-04-26T12:24:22.537 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-04-26T12:24:22.537 INFO:teuthology.orchestra.run.smithi136.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-26T12:24:22.538 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T12:24:22.538 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T12:24:22.538 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T12:24:22.538 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T12:24:22.538 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T12:24:22.539 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T12:24:22.539 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T12:24:22.539 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T12:24:22.539 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T12:24:22.539 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T12:24:22.539 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T12:24:22.540 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T12:24:22.540 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T12:24:22.540 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-26T12:24:22.540 INFO:teuthology.orchestra.run.smithi136.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-26T12:24:22.540 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-26T12:24:22.540 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T12:24:22.541 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T12:24:22.541 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T12:24:22.541 INFO:teuthology.orchestra.run.smithi136.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-26T12:24:22.541 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-26T12:24:22.541 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-26T12:24:22.542 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T12:24:22.542 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T12:24:22.542 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T12:24:22.542 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T12:24:22.543 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T12:24:22.543 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T12:24:22.543 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T12:24:22.543 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-26T12:24:22.543 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2024-04-26T12:24:22.544 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-26T12:24:22.544 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-26T12:24:22.544 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-26T12:24:22.544 INFO:teuthology.orchestra.run.smithi136.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-26T12:24:22.544 INFO:teuthology.orchestra.run.smithi136.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-26T12:24:22.544 INFO:teuthology.orchestra.run.smithi136.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-26T12:24:22.545 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T12:24:22.545 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T12:24:22.545 INFO:teuthology.orchestra.run.smithi136.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-26T12:24:22.545 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-26T12:24:22.545 INFO:teuthology.orchestra.run.smithi136.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-26T12:24:22.545 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-26T12:24:22.546 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-26T12:24:22.546 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-26T12:24:22.546 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-26T12:24:22.546 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-04-26T12:24:22.546 INFO:teuthology.orchestra.run.smithi136.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-26T12:24:22.546 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T12:24:22.547 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T12:24:22.547 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T12:24:22.547 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T12:24:22.547 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T12:24:22.547 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T12:24:22.547 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T12:24:22.548 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T12:24:22.548 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T12:24:22.548 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T12:24:22.548 INFO:teuthology.orchestra.run.smithi136.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T12:24:22.548 INFO:teuthology.orchestra.run.smithi136.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-26T12:24:22.548 INFO:teuthology.orchestra.run.smithi136.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-26T12:24:22.549 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T12:24:22.549 INFO:teuthology.orchestra.run.smithi136.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-26T12:24:22.549 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-04-26T12:24:22.549 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T12:24:22.549 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-04-26T12:24:22.549 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T12:24:22.550 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T12:24:22.550 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T12:24:22.550 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T12:24:22.550 INFO:teuthology.orchestra.run.smithi136.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-26T12:24:22.550 INFO:teuthology.orchestra.run.smithi136.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-26T12:24:22.551 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T12:24:22.551 INFO:teuthology.orchestra.run.smithi136.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-26T12:24:22.551 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-26T12:24:22.551 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T12:24:22.551 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T12:24:22.551 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-26T12:24:22.551 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-26T12:24:22.552 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-26T12:24:22.552 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-26T12:24:22.552 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-26T12:24:22.552 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T12:24:22.552 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-26T12:24:22.552 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T12:24:22.553 INFO:teuthology.orchestra.run.smithi136.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T12:24:22.553 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T12:24:22.553 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T12:24:22.553 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T12:24:22.553 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T12:24:22.554 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T12:24:22.554 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T12:24:22.554 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T12:24:22.554 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T12:24:22.554 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T12:24:22.554 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T12:24:22.555 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T12:24:22.555 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-26T12:24:22.555 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-26T12:24:22.555 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-26T12:24:22.555 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-26T12:24:22.555 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T12:24:22.556 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T12:24:22.556 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T12:24:22.556 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T12:24:22.556 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T12:24:22.556 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T12:24:22.556 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-26T12:24:22.557 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-26T12:24:22.557 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-26T12:24:22.557 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-26T12:24:22.557 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T12:24:22.557 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T12:24:22.557 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T12:24:22.558 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T12:24:22.558 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-26T12:24:22.558 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-26T12:24:22.558 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T12:24:22.558 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T12:24:22.558 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T12:24:22.559 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-26T12:24:22.559 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T12:24:22.559 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T12:24:22.559 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-26T12:24:22.559 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T12:24:22.559 INFO:teuthology.orchestra.run.smithi136.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T12:24:22.559 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T12:24:22.560 INFO:teuthology.orchestra.run.smithi136.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T12:24:22.560 INFO:teuthology.orchestra.run.smithi136.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T12:24:22.560 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T12:24:22.560 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T12:24:22.560 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T12:24:22.560 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T12:24:22.561 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T12:24:22.561 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T12:24:22.561 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T12:24:22.561 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T12:24:22.561 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-26T12:24:22.561 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:24:22.562 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-04-26T12:24:22.562 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================================ 2024-04-26T12:24:22.562 INFO:teuthology.orchestra.run.smithi136.stdout:Install 122 Packages 2024-04-26T12:24:22.562 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 15 Packages 2024-04-26T12:24:22.562 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:24:22.563 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 207 M 2024-04-26T12:24:22.563 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-04-26T12:24:22.617 INFO:teuthology.orchestra.run.smithi142.stdout:(63/137): fuse-2.9.7-19.el8.x86_64.rpm 357 kB/s | 83 kB 00:00 2024-04-26T12:24:22.759 INFO:teuthology.orchestra.run.smithi142.stdout:(64/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 340 kB/s | 48 kB 00:00 2024-04-26T12:24:22.885 INFO:teuthology.orchestra.run.smithi046.stdout:(36/137): bison-3.0.4-10.el8.x86_64.rpm 1.5 MB/s | 688 kB 00:00 2024-04-26T12:24:22.918 INFO:teuthology.orchestra.run.smithi046.stdout:(37/137): automake-1.16.1-8.el8.noarch.rpm 1.4 MB/s | 740 kB 00:00 2024-04-26T12:24:23.009 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 16 MB 00:15 2024-04-26T12:24:23.054 INFO:teuthology.orchestra.run.smithi046.stdout:(38/137): jq-1.6-8.el8.x86_64.rpm 1.5 MB/s | 203 kB 00:00 2024-04-26T12:24:23.219 INFO:teuthology.orchestra.run.smithi046.stdout:(39/137): librdkafka-1.6.1-1.el8.x86_64.rpm 4.0 MB/s | 677 kB 00:00 2024-04-26T12:24:23.244 INFO:teuthology.orchestra.run.smithi046.stdout:(40/137): flex-2.6.1-9.el8.x86_64.rpm 889 kB/s | 320 kB 00:00 2024-04-26T12:24:23.290 INFO:teuthology.orchestra.run.smithi136.stdout:(1/137): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 52 kB/s | 6.4 kB 00:00 2024-04-26T12:24:23.310 INFO:teuthology.orchestra.run.smithi142.stdout:(65/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.0 MB/s | 561 kB 00:00 2024-04-26T12:24:23.344 INFO:teuthology.orchestra.run.smithi046.stdout:(41/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2024-04-26T12:24:23.403 INFO:teuthology.orchestra.run.smithi046.stdout:(42/137): oniguruma-6.8.2-3.el8.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-04-26T12:24:23.443 INFO:teuthology.orchestra.run.smithi142.stdout:(66/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 140 kB/s | 19 kB 00:00 2024-04-26T12:24:23.491 INFO:teuthology.orchestra.run.smithi136.stdout:(2/137): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 4.2 MB/s | 859 kB 00:00 2024-04-26T12:24:23.544 INFO:teuthology.orchestra.run.smithi142.stdout:(67/137): libcom_err-devel-1.45.6-5.el8.x86_64. 387 kB/s | 39 kB 00:00 2024-04-26T12:24:23.549 INFO:teuthology.orchestra.run.smithi136.stdout:(3/137): ceph-immutable-object-cache-18.2.2-125 2.8 MB/s | 165 kB 00:00 2024-04-26T12:24:23.858 INFO:teuthology.orchestra.run.smithi136.stdout:(4/137): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 7.4 MB/s | 2.3 MB 00:00 2024-04-26T12:24:23.920 INFO:teuthology.orchestra.run.smithi046.stdout:(43/137): openblas-0.3.15-4.el8.x86_64.rpm 9.1 MB/s | 4.7 MB 00:00 2024-04-26T12:24:23.960 INFO:teuthology.orchestra.run.smithi142.stdout:(68/137): libgfortran-8.5.0-22.el8.x86_64.rpm 1.5 MB/s | 645 kB 00:00 2024-04-26T12:24:24.083 INFO:teuthology.orchestra.run.smithi136.stdout:(5/137): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 6.9 MB/s | 1.6 MB 00:00 2024-04-26T12:24:24.127 INFO:teuthology.orchestra.run.smithi142.stdout:(69/137): libquadmath-8.5.0-22.el8.x86_64.rpm 1.0 MB/s | 172 kB 00:00 2024-04-26T12:24:24.137 INFO:teuthology.orchestra.run.smithi046.stdout:(44/137): libtool-2.4.6-25.el8.x86_64.rpm 772 kB/s | 709 kB 00:00 2024-04-26T12:24:24.228 INFO:teuthology.orchestra.run.smithi142.stdout:(70/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 471 kB/s | 47 kB 00:00 2024-04-26T12:24:24.388 INFO:teuthology.orchestra.run.smithi046.stdout:(45/137): openblas-threads-0.3.15-4.el8.x86_64. 10 MB/s | 4.9 MB 00:00 2024-04-26T12:24:24.412 INFO:teuthology.orchestra.run.smithi142.stdout:(71/137): libselinux-devel-2.9-8.el8.x86_64.rpm 1.1 MB/s | 200 kB 00:00 2024-04-26T12:24:24.479 INFO:teuthology.orchestra.run.smithi046.stdout:(46/137): python3-jinja2-2.10.1-4.el8.noarch.rp 6.2 MB/s | 578 kB 00:00 2024-04-26T12:24:24.512 INFO:teuthology.orchestra.run.smithi142.stdout:(72/137): libsepol-devel-2.9-3.el8.x86_64.rpm 872 kB/s | 87 kB 00:00 2024-04-26T12:24:24.588 INFO:teuthology.orchestra.run.smithi046.stdout:(47/137): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2024-04-26T12:24:24.612 INFO:teuthology.orchestra.run.smithi142.stdout:(73/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 1.0 MB/s | 100 kB 00:00 2024-04-26T12:24:24.613 INFO:teuthology.orchestra.run.smithi046.stdout:(48/137): python3-jsonpatch-1.21-2.el8.noarch.r 199 kB/s | 27 kB 00:00 2024-04-26T12:24:24.655 INFO:teuthology.orchestra.run.smithi046.stdout:(49/137): python3-jsonpointer-1.10-11.el8.noarc 482 kB/s | 20 kB 00:00 2024-04-26T12:24:24.680 INFO:teuthology.orchestra.run.smithi046.stdout:(50/137): python3-mako-1.0.6-14.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2024-04-26T12:24:24.695 INFO:teuthology.orchestra.run.smithi142.stdout:(74/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 217 kB/s | 18 kB 00:00 2024-04-26T12:24:24.706 INFO:teuthology.orchestra.run.smithi046.stdout:(51/137): python3-markupsafe-0.23-19.el8.x86_64 772 kB/s | 39 kB 00:00 2024-04-26T12:24:24.748 INFO:teuthology.orchestra.run.smithi046.stdout:(52/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2024-04-26T12:24:24.788 INFO:teuthology.orchestra.run.smithi142.stdout:(75/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 478 kB/s | 44 kB 00:00 2024-04-26T12:24:24.789 INFO:teuthology.orchestra.run.smithi046.stdout:(53/137): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2024-04-26T12:24:24.857 INFO:teuthology.orchestra.run.smithi046.stdout:(54/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.5 MB/s | 103 kB 00:00 2024-04-26T12:24:24.899 INFO:teuthology.orchestra.run.smithi046.stdout:(55/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.0 MB/s | 126 kB 00:00 2024-04-26T12:24:24.941 INFO:teuthology.orchestra.run.smithi046.stdout:(56/137): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2024-04-26T12:24:24.967 INFO:teuthology.orchestra.run.smithi136.stdout:(6/137): ceph-common-18.2.2-1256.gdc093b5e.el8. 12 MB/s | 22 MB 00:01 2024-04-26T12:24:24.983 INFO:teuthology.orchestra.run.smithi046.stdout:(57/137): python3-pytz-2017.2-11.el8.noarch.rpm 1.3 MB/s | 57 kB 00:00 2024-04-26T12:24:25.034 INFO:teuthology.orchestra.run.smithi136.stdout:(7/137): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 5.1 MB/s | 4.8 MB 00:00 2024-04-26T12:24:25.109 INFO:teuthology.orchestra.run.smithi136.stdout:(8/137): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 2.8 MB/s | 5.5 MB 00:01 2024-04-26T12:24:25.133 INFO:teuthology.orchestra.run.smithi046.stdout:(58/137): python3-numpy-1.14.3-10.el8.x86_64.rp 8.3 MB/s | 3.7 MB 00:00 2024-04-26T12:24:25.209 INFO:teuthology.orchestra.run.smithi136.stdout:(9/137): ceph-selinux-18.2.2-1256.gdc093b5e.el8 244 kB/s | 24 kB 00:00 2024-04-26T12:24:25.217 INFO:teuthology.orchestra.run.smithi046.stdout:(59/137): python3-werkzeug-0.12.2-4.el8.noarch. 5.4 MB/s | 457 kB 00:00 2024-04-26T12:24:25.259 INFO:teuthology.orchestra.run.smithi046.stdout:(60/137): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2024-04-26T12:24:25.292 INFO:teuthology.orchestra.run.smithi046.stdout:(61/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 71 kB 00:00 2024-04-26T12:24:25.350 INFO:teuthology.orchestra.run.smithi142.stdout:(76/137): python3-scipy-1.0.0-21.module_el8+762 3.8 MB/s | 14 MB 00:03 2024-04-26T12:24:25.626 INFO:teuthology.orchestra.run.smithi046.stdout:(62/137): elfutils-libelf-devel-0.190-2.el8.x86 187 kB/s | 62 kB 00:00 2024-04-26T12:24:25.793 INFO:teuthology.orchestra.run.smithi046.stdout:(63/137): fuse-2.9.7-19.el8.x86_64.rpm 500 kB/s | 83 kB 00:00 2024-04-26T12:24:25.893 INFO:teuthology.orchestra.run.smithi046.stdout:(64/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 480 kB/s | 48 kB 00:00 2024-04-26T12:24:25.988 INFO:teuthology.orchestra.run.smithi142.stdout:(77/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 2.7 MB/s | 3.2 MB 00:01 2024-04-26T12:24:26.013 INFO:teuthology.orchestra.run.smithi142.stdout:(78/137): pcre2-devel-10.32-3.el8.x86_64.rpm 913 kB/s | 605 kB 00:00 2024-04-26T12:24:26.125 INFO:teuthology.orchestra.run.smithi142.stdout:(79/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2024-04-26T12:24:26.162 INFO:teuthology.orchestra.run.smithi046.stdout:(65/137): python3-scipy-1.0.0-21.module_el8+762 12 MB/s | 14 MB 00:01 2024-04-26T12:24:26.322 INFO:teuthology.orchestra.run.smithi142.stdout:(80/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 715 kB/s | 220 kB 00:00 2024-04-26T12:24:26.344 INFO:teuthology.orchestra.run.smithi046.stdout:(66/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.2 MB/s | 561 kB 00:00 2024-04-26T12:24:26.439 INFO:teuthology.orchestra.run.smithi142.stdout:(81/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 794 kB/s | 249 kB 00:00 2024-04-26T12:24:26.611 INFO:teuthology.orchestra.run.smithi046.stdout:(67/137): ceph-common-18.2.2-1256.gdc093b5e.el8 1.5 MB/s | 22 MB 00:14 2024-04-26T12:24:26.618 INFO:teuthology.orchestra.run.smithi136.stdout:(10/137): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 11 MB/s | 18 MB 00:01 2024-04-26T12:24:26.622 INFO:teuthology.orchestra.run.smithi142.stdout:(82/137): python3-cryptography-3.2.1-7.el8.x86_ 2.1 MB/s | 641 kB 00:00 2024-04-26T12:24:26.636 INFO:teuthology.orchestra.run.smithi046.stdout:(68/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 39 kB/s | 19 kB 00:00 2024-04-26T12:24:26.648 INFO:teuthology.orchestra.run.smithi142.stdout:(83/137): python3-jwt-1.6.1-2.el8.noarch.rpm 204 kB/s | 43 kB 00:00 2024-04-26T12:24:26.661 INFO:teuthology.orchestra.run.smithi046.stdout:(69/137): libcom_err-devel-1.45.6-5.el8.x86_64. 122 kB/s | 39 kB 00:00 2024-04-26T12:24:26.668 INFO:teuthology.orchestra.run.smithi136.stdout:(11/137): libcephfs-devel-18.2.2-1256.gdc093b5e 621 kB/s | 31 kB 00:00 2024-04-26T12:24:26.723 INFO:teuthology.orchestra.run.smithi142.stdout:(84/137): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2024-04-26T12:24:26.753 INFO:teuthology.orchestra.run.smithi046.stdout:(70/137): libquadmath-8.5.0-22.el8.x86_64.rpm 1.4 MB/s | 172 kB 00:00 2024-04-26T12:24:26.765 INFO:teuthology.orchestra.run.smithi142.stdout:(85/137): python3-pycparser-2.14-14.el8.noarch. 933 kB/s | 109 kB 00:00 2024-04-26T12:24:26.776 INFO:teuthology.orchestra.run.smithi136.stdout:(12/137): libcephfs2-18.2.2-1256.gdc093b5e.el8. 7.1 MB/s | 781 kB 00:00 2024-04-26T12:24:26.823 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 428 kB/s | 24 kB 00:00 2024-04-26T12:24:26.824 INFO:teuthology.orchestra.run.smithi142.stdout:(86/137): python3-requests-oauthlib-1.0.0-1.el8 425 kB/s | 43 kB 00:00 2024-04-26T12:24:26.837 INFO:teuthology.orchestra.run.smithi046.stdout:(71/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 268 kB/s | 47 kB 00:00 2024-04-26T12:24:26.843 INFO:teuthology.orchestra.run.smithi136.stdout:(13/137): libcephsqlite-18.2.2-1256.gdc093b5e.e 2.1 MB/s | 142 kB 00:00 2024-04-26T12:24:26.857 INFO:teuthology.orchestra.run.smithi142.stdout:(87/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 809 kB/s | 74 kB 00:00 2024-04-26T12:24:26.862 INFO:teuthology.orchestra.run.smithi046.stdout:(72/137): libselinux-devel-2.9-8.el8.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2024-04-26T12:24:26.910 INFO:teuthology.orchestra.run.smithi136.stdout:(14/137): librados-devel-18.2.2-1256.gdc093b5e. 2.0 MB/s | 139 kB 00:00 2024-04-26T12:24:26.916 INFO:teuthology.orchestra.run.smithi142.stdout:(88/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 631 kB/s | 58 kB 00:00 2024-04-26T12:24:26.986 INFO:teuthology.orchestra.run.smithi136.stdout:(15/137): libradosstriper1-18.2.2-1256.gdc093b5 6.2 MB/s | 474 kB 00:00 2024-04-26T12:24:26.988 INFO:teuthology.orchestra.run.smithi046.stdout:(73/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 801 kB/s | 100 kB 00:00 2024-04-26T12:24:27.005 INFO:teuthology.orchestra.run.smithi046.stdout:(74/137): libsepol-devel-2.9-3.el8.x86_64.rpm 520 kB/s | 87 kB 00:00 2024-04-26T12:24:27.080 INFO:teuthology.orchestra.run.smithi046.stdout:(75/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 197 kB/s | 18 kB 00:00 2024-04-26T12:24:27.122 INFO:teuthology.orchestra.run.smithi046.stdout:(76/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 375 kB/s | 44 kB 00:00 2024-04-26T12:24:27.253 INFO:teuthology.orchestra.run.smithi136.stdout:(16/137): ceph-radosgw-18.2.2-1256.gdc093b5e.el 5.9 MB/s | 13 MB 00:02 2024-04-26T12:24:27.255 INFO:teuthology.orchestra.run.smithi046.stdout:(77/137): libgfortran-8.5.0-22.el8.x86_64.rpm 1.0 MB/s | 645 kB 00:00 2024-04-26T12:24:27.320 INFO:teuthology.orchestra.run.smithi136.stdout:(17/137): python3-ceph-argparse-18.2.2-1256.gdc 672 kB/s | 45 kB 00:00 2024-04-26T12:24:27.355 INFO:teuthology.orchestra.run.smithi046.stdout:(78/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2024-04-26T12:24:27.358 INFO:teuthology.orchestra.run.smithi142.stdout:(89/137): ceph-test-18.2.2-1256.gdc093b5e.el8.x 3.5 MB/s | 47 MB 00:13 2024-04-26T12:24:27.439 INFO:teuthology.orchestra.run.smithi046.stdout:(79/137): pcre2-devel-10.32-3.el8.x86_64.rpm 1.9 MB/s | 605 kB 00:00 2024-04-26T12:24:27.445 INFO:teuthology.orchestra.run.smithi136.stdout:(18/137): librgw2-18.2.2-1256.gdc093b5e.el8.x86 14 MB/s | 6.6 MB 00:00 2024-04-26T12:24:27.462 INFO:teuthology.orchestra.run.smithi136.stdout:(19/137): python3-ceph-common-18.2.2-1256.gdc09 907 kB/s | 129 kB 00:00 2024-04-26T12:24:27.486 INFO:teuthology.orchestra.run.smithi046.stdout:(80/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2024-04-26T12:24:27.496 INFO:teuthology.orchestra.run.smithi136.stdout:(20/137): python3-cephfs-18.2.2-1256.gdc093b5e. 3.8 MB/s | 197 kB 00:00 2024-04-26T12:24:27.539 INFO:teuthology.orchestra.run.smithi046.stdout:(81/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.4 MB/s | 249 kB 00:00 2024-04-26T12:24:27.546 INFO:teuthology.orchestra.run.smithi136.stdout:(21/137): python3-rados-18.2.2-1256.gdc093b5e.e 4.3 MB/s | 371 kB 00:00 2024-04-26T12:24:27.571 INFO:teuthology.orchestra.run.smithi136.stdout:(22/137): python3-rbd-18.2.2-1256.gdc093b5e.el8 4.7 MB/s | 364 kB 00:00 2024-04-26T12:24:27.590 INFO:teuthology.orchestra.run.smithi046.stdout:(82/137): python3-cryptography-3.2.1-7.el8.x86_ 6.1 MB/s | 641 kB 00:00 2024-04-26T12:24:27.597 INFO:teuthology.orchestra.run.smithi136.stdout:(23/137): python3-rgw-18.2.2-1256.gdc093b5e.el8 2.1 MB/s | 107 kB 00:00 2024-04-26T12:24:27.600 INFO:teuthology.orchestra.run.smithi142.stdout:(90/137): python3-packaging-16.8-9.el8.noarch.r 65 kB/s | 48 kB 00:00 2024-04-26T12:24:27.622 INFO:teuthology.orchestra.run.smithi136.stdout:(24/137): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.8 MB/s | 95 kB 00:00 2024-04-26T12:24:27.625 INFO:teuthology.orchestra.run.smithi142.stdout:(91/137): liboath-2.6.2-3.el8.x86_64.rpm 221 kB/s | 59 kB 00:00 2024-04-26T12:24:27.632 INFO:teuthology.orchestra.run.smithi046.stdout:(83/137): python3-jwt-1.6.1-2.el8.noarch.rpm 464 kB/s | 43 kB 00:00 2024-04-26T12:24:27.673 INFO:teuthology.orchestra.run.smithi136.stdout:(25/137): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 3.5 MB/s | 181 kB 00:00 2024-04-26T12:24:27.690 INFO:teuthology.orchestra.run.smithi046.stdout:(84/137): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2024-04-26T12:24:27.723 INFO:teuthology.orchestra.run.smithi136.stdout:(26/137): ceph-grafana-dashboards-18.2.2-1256.g 486 kB/s | 24 kB 00:00 2024-04-26T12:24:27.734 INFO:teuthology.orchestra.run.smithi142.stdout:(92/137): gperftools-libs-2.7-9.el8.x86_64.rpm 375 kB/s | 306 kB 00:00 2024-04-26T12:24:27.782 INFO:teuthology.orchestra.run.smithi136.stdout:(27/137): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 2.3 MB/s | 138 kB 00:00 2024-04-26T12:24:27.790 INFO:teuthology.orchestra.run.smithi046.stdout:(85/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 4.5 MB/s | 3.2 MB 00:00 2024-04-26T12:24:27.809 INFO:teuthology.orchestra.run.smithi142.stdout:(93/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 582 kB/s | 44 kB 00:00 2024-04-26T12:24:27.815 INFO:teuthology.orchestra.run.smithi046.stdout:(86/137): python3-requests-oauthlib-1.0.0-1.el8 340 kB/s | 43 kB 00:00 2024-04-26T12:24:27.841 INFO:teuthology.orchestra.run.smithi046.stdout:(87/137): python3-pycparser-2.14-14.el8.noarch. 522 kB/s | 109 kB 00:00 2024-04-26T12:24:27.851 INFO:teuthology.orchestra.run.smithi142.stdout:(94/137): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2024-04-26T12:24:27.876 INFO:teuthology.orchestra.run.smithi142.stdout:(95/137): libunwind-1.3.1-3.el8.x86_64.rpm 272 kB/s | 75 kB 00:00 2024-04-26T12:24:27.891 INFO:teuthology.orchestra.run.smithi046.stdout:(88/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 741 kB/s | 74 kB 00:00 2024-04-26T12:24:27.902 INFO:teuthology.orchestra.run.smithi142.stdout:(96/137): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2024-04-26T12:24:27.916 INFO:teuthology.orchestra.run.smithi046.stdout:(89/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 577 kB/s | 58 kB 00:00 2024-04-26T12:24:27.918 INFO:teuthology.orchestra.run.smithi142.stdout:(97/137): python3-cachetools-3.1.1-4.el8.noarch 491 kB/s | 33 kB 00:00 2024-04-26T12:24:27.970 INFO:teuthology.orchestra.run.smithi142.stdout:(98/137): python3-certifi-2018.10.15-7.el8.noar 177 kB/s | 16 kB 00:00 2024-04-26T12:24:27.994 INFO:teuthology.orchestra.run.smithi142.stdout:(99/137): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2024-04-26T12:24:28.019 INFO:teuthology.orchestra.run.smithi142.stdout:(100/137): python3-cherrypy-18.4.0-1.el8.noarch 3.7 MB/s | 384 kB 00:00 2024-04-26T12:24:28.062 INFO:teuthology.orchestra.run.smithi142.stdout:(101/137): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2024-04-26T12:24:28.087 INFO:teuthology.orchestra.run.smithi142.stdout:(102/137): python3-google-auth-1.1.1-10.el8.noa 693 kB/s | 81 kB 00:00 2024-04-26T12:24:28.090 INFO:teuthology.orchestra.run.smithi136.stdout:(28/137): ceph-mgr-dashboard-18.2.2-1256.gdc093 11 MB/s | 3.5 MB 00:00 2024-04-26T12:24:28.112 INFO:teuthology.orchestra.run.smithi142.stdout:(103/137): python3-jaraco-functools-2.0-4.el8.n 190 kB/s | 18 kB 00:00 2024-04-26T12:24:28.157 INFO:teuthology.orchestra.run.smithi136.stdout:(29/137): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 6.2 MB/s | 3.5 MB 00:00 2024-04-26T12:24:28.158 INFO:teuthology.orchestra.run.smithi046.stdout:(90/137): python3-packaging-16.8-9.el8.noarch.r 152 kB/s | 48 kB 00:00 2024-04-26T12:24:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:(104/137): python3-logutils-0.3.5-11.el8.noarch 647 kB/s | 49 kB 00:00 2024-04-26T12:24:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:(105/137): python3-more-itertools-7.2.0-3.el8.n 880 kB/s | 59 kB 00:00 2024-04-26T12:24:28.192 INFO:teuthology.orchestra.run.smithi046.stdout:(91/137): liboath-2.6.2-3.el8.x86_64.rpm 214 kB/s | 59 kB 00:00 2024-04-26T12:24:28.276 INFO:teuthology.orchestra.run.smithi136.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1256.gdc 2.0 MB/s | 246 kB 00:00 2024-04-26T12:24:28.284 INFO:teuthology.orchestra.run.smithi142.stdout:(106/137): python3-kubernetes-11.0.0-6.el8.noar 5.2 MB/s | 1.2 MB 00:00 2024-04-26T12:24:28.301 INFO:teuthology.orchestra.run.smithi046.stdout:(92/137): gperftools-libs-2.7-9.el8.x86_64.rpm 748 kB/s | 306 kB 00:00 2024-04-26T12:24:28.313 INFO:teuthology.orchestra.run.smithi142.stdout:(107/137): python3-natsort-7.1.1-2.el8.noarch.r 400 kB/s | 60 kB 00:00 2024-04-26T12:24:28.338 INFO:teuthology.orchestra.run.smithi142.stdout:(108/137): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2024-04-26T12:24:28.364 INFO:teuthology.orchestra.run.smithi142.stdout:(109/137): python3-portend-2.6-1.el8.noarch.rpm 197 kB/s | 16 kB 00:00 2024-04-26T12:24:28.366 INFO:teuthology.orchestra.run.smithi136.stdout:(31/137): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 550 kB/s | 49 kB 00:00 2024-04-26T12:24:28.384 INFO:teuthology.orchestra.run.smithi046.stdout:(93/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 524 kB/s | 44 kB 00:00 2024-04-26T12:24:28.397 INFO:teuthology.orchestra.run.smithi142.stdout:(110/137): python3-repoze-lru-0.7-6.el8.noarch. 400 kB/s | 34 kB 00:00 2024-04-26T12:24:28.418 INFO:teuthology.orchestra.run.smithi046.stdout:(94/137): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2024-04-26T12:24:28.431 INFO:teuthology.orchestra.run.smithi142.stdout:(111/137): python3-routes-2.4.1-12.el8.noarch.r 2.1 MB/s | 196 kB 00:00 2024-04-26T12:24:28.441 INFO:teuthology.orchestra.run.smithi136.stdout:(32/137): ceph-prometheus-alerts-18.2.2-1256.gd 203 kB/s | 15 kB 00:00 2024-04-26T12:24:28.443 INFO:teuthology.orchestra.run.smithi046.stdout:(95/137): libunwind-1.3.1-3.el8.x86_64.rpm 263 kB/s | 75 kB 00:00 2024-04-26T12:24:28.456 INFO:teuthology.orchestra.run.smithi142.stdout:(112/137): python3-rsa-4.9-2.el8.noarch.rpm 695 kB/s | 64 kB 00:00 2024-04-26T12:24:28.477 INFO:teuthology.orchestra.run.smithi046.stdout:(96/137): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2024-04-26T12:24:28.482 INFO:teuthology.orchestra.run.smithi142.stdout:(113/137): python3-simplegeneric-0.8.1-17.el8.n 223 kB/s | 19 kB 00:00 2024-04-26T12:24:28.507 INFO:teuthology.orchestra.run.smithi142.stdout:(114/137): python3-singledispatch-3.4.0.3-18.el 316 kB/s | 24 kB 00:00 2024-04-26T12:24:28.527 INFO:teuthology.orchestra.run.smithi046.stdout:(97/137): python3-cachetools-3.1.1-4.el8.noarch 303 kB/s | 33 kB 00:00 2024-04-26T12:24:28.532 INFO:teuthology.orchestra.run.smithi142.stdout:(115/137): python3-tempora-1.14.1-5.el8.noarch. 386 kB/s | 29 kB 00:00 2024-04-26T12:24:28.533 INFO:teuthology.orchestra.run.smithi136.stdout:(33/137): ceph-volume-18.2.2-1256.gdc093b5e.el8 2.8 MB/s | 263 kB 00:00 2024-04-26T12:24:28.544 INFO:teuthology.orchestra.run.smithi046.stdout:(98/137): python3-certifi-2018.10.15-7.el8.noar 162 kB/s | 16 kB 00:00 2024-04-26T12:24:28.558 INFO:teuthology.orchestra.run.smithi142.stdout:(116/137): python3-trustme-0.6.0-4.el8.noarch.r 363 kB/s | 27 kB 00:00 2024-04-26T12:24:28.569 INFO:teuthology.orchestra.run.smithi046.stdout:(99/137): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2024-04-26T12:24:28.583 INFO:teuthology.orchestra.run.smithi142.stdout:(117/137): python3-waitress-1.4.3-1.el8.noarch. 3.3 MB/s | 255 kB 00:00 2024-04-26T12:24:28.617 INFO:teuthology.orchestra.run.smithi142.stdout:(118/137): python3-webob-1.8.5-1.el8.1.noarch.r 2.9 MB/s | 251 kB 00:00 2024-04-26T12:24:28.617 INFO:teuthology.orchestra.run.smithi136.stdout:(34/137): ceph-mgr-diskprediction-local-18.2.2- 14 MB/s | 7.4 MB 00:00 2024-04-26T12:24:28.628 INFO:teuthology.orchestra.run.smithi046.stdout:(100/137): python3-cherrypy-18.4.0-1.el8.noarch 3.7 MB/s | 384 kB 00:00 2024-04-26T12:24:28.642 INFO:teuthology.orchestra.run.smithi136.stdout:(35/137): cephadm-18.2.2-1256.gdc093b5e.el8.noa 1.6 MB/s | 173 kB 00:00 2024-04-26T12:24:28.645 INFO:teuthology.orchestra.run.smithi046.stdout:(101/137): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2024-04-26T12:24:28.650 INFO:teuthology.orchestra.run.smithi142.stdout:(119/137): python3-websocket-client-0.56.0-5.el 666 kB/s | 61 kB 00:00 2024-04-26T12:24:28.670 INFO:teuthology.orchestra.run.smithi046.stdout:(102/137): python3-google-auth-1.1.1-10.el8.noa 646 kB/s | 81 kB 00:00 2024-04-26T12:24:28.675 INFO:teuthology.orchestra.run.smithi142.stdout:(120/137): python3-webtest-2.0.33-1.el8.noarch. 928 kB/s | 85 kB 00:00 2024-04-26T12:24:28.687 INFO:teuthology.orchestra.run.smithi046.stdout:(103/137): python3-jaraco-functools-2.0-4.el8.n 300 kB/s | 18 kB 00:00 2024-04-26T12:24:28.701 INFO:teuthology.orchestra.run.smithi142.stdout:(121/137): python3-zc-lockfile-2.0-2.el8.noarch 274 kB/s | 23 kB 00:00 2024-04-26T12:24:28.788 INFO:teuthology.orchestra.run.smithi046.stdout:(104/137): python3-logutils-0.3.5-11.el8.noarch 417 kB/s | 49 kB 00:00 2024-04-26T12:24:28.813 INFO:teuthology.orchestra.run.smithi046.stdout:(105/137): python3-more-itertools-7.2.0-3.el8.n 468 kB/s | 59 kB 00:00 2024-04-26T12:24:28.847 INFO:teuthology.orchestra.run.smithi046.stdout:(106/137): python3-kubernetes-11.0.0-6.el8.noar 5.8 MB/s | 1.2 MB 00:00 2024-04-26T12:24:28.872 INFO:teuthology.orchestra.run.smithi046.stdout:(107/137): python3-natsort-7.1.1-2.el8.noarch.r 719 kB/s | 60 kB 00:00 2024-04-26T12:24:28.901 INFO:teuthology.orchestra.run.smithi136.stdout:(36/137): automake-1.16.1-8.el8.noarch.rpm 2.5 MB/s | 740 kB 00:00 2024-04-26T12:24:28.905 INFO:teuthology.orchestra.run.smithi046.stdout:(108/137): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2024-04-26T12:24:28.926 INFO:teuthology.orchestra.run.smithi136.stdout:(37/137): bison-3.0.4-10.el8.x86_64.rpm 2.4 MB/s | 688 kB 00:00 2024-04-26T12:24:28.931 INFO:teuthology.orchestra.run.smithi046.stdout:(109/137): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2024-04-26T12:24:28.943 INFO:teuthology.orchestra.run.smithi142.stdout:(122/137): thrift-0.13.0-2.el8.x86_64.rpm 5.9 MB/s | 1.7 MB 00:00 2024-04-26T12:24:28.948 INFO:teuthology.orchestra.run.smithi046.stdout:(110/137): python3-repoze-lru-0.7-6.el8.noarch. 445 kB/s | 34 kB 00:00 2024-04-26T12:24:28.960 INFO:teuthology.orchestra.run.smithi136.stdout:(38/137): flex-2.6.1-9.el8.x86_64.rpm 5.4 MB/s | 320 kB 00:00 2024-04-26T12:24:28.985 INFO:teuthology.orchestra.run.smithi136.stdout:(39/137): jq-1.6-8.el8.x86_64.rpm 3.4 MB/s | 203 kB 00:00 2024-04-26T12:24:29.029 INFO:teuthology.orchestra.run.smithi046.stdout:(111/137): python3-routes-2.4.1-12.el8.noarch.r 1.6 MB/s | 196 kB 00:00 2024-04-26T12:24:29.057 INFO:teuthology.orchestra.run.smithi046.stdout:(112/137): python3-simplegeneric-0.8.1-17.el8.n 172 kB/s | 19 kB 00:00 2024-04-26T12:24:29.082 INFO:teuthology.orchestra.run.smithi046.stdout:(113/137): python3-rsa-4.9-2.el8.noarch.rpm 426 kB/s | 64 kB 00:00 2024-04-26T12:24:29.084 INFO:teuthology.orchestra.run.smithi142.stdout:(123/137): librados2-18.2.2-1256.gdc093b5e.el8. 9.0 MB/s | 3.7 MB 00:00 2024-04-26T12:24:29.107 INFO:teuthology.orchestra.run.smithi046.stdout:(114/137): python3-singledispatch-3.4.0.3-18.el 309 kB/s | 24 kB 00:00 2024-04-26T12:24:29.111 INFO:teuthology.orchestra.run.smithi136.stdout:(40/137): librdkafka-1.6.1-1.el8.x86_64.rpm 4.4 MB/s | 677 kB 00:00 2024-04-26T12:24:29.133 INFO:teuthology.orchestra.run.smithi046.stdout:(115/137): python3-tempora-1.14.1-5.el8.noarch. 388 kB/s | 29 kB 00:00 2024-04-26T12:24:29.144 INFO:teuthology.orchestra.run.smithi136.stdout:(41/137): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2024-04-26T12:24:29.157 INFO:teuthology.orchestra.run.smithi046.stdout:(116/137): python3-trustme-0.6.0-4.el8.noarch.r 365 kB/s | 27 kB 00:00 2024-04-26T12:24:29.185 INFO:teuthology.orchestra.run.smithi142.stdout:(124/137): elfutils-debuginfod-client-0.190-2.e 317 kB/s | 77 kB 00:00 2024-04-26T12:24:29.199 INFO:teuthology.orchestra.run.smithi046.stdout:(117/137): python3-waitress-1.4.3-1.el8.noarch. 2.7 MB/s | 255 kB 00:00 2024-04-26T12:24:29.225 INFO:teuthology.orchestra.run.smithi046.stdout:(118/137): python3-websocket-client-0.56.0-5.el 915 kB/s | 61 kB 00:00 2024-04-26T12:24:29.270 INFO:teuthology.orchestra.run.smithi136.stdout:(42/137): oniguruma-6.8.2-3.el8.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-26T12:24:29.295 INFO:teuthology.orchestra.run.smithi136.stdout:(43/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.4 MB/s | 259 kB 00:00 2024-04-26T12:24:29.309 INFO:teuthology.orchestra.run.smithi046.stdout:(119/137): python3-webtest-2.0.33-1.el8.noarch. 786 kB/s | 85 kB 00:00 2024-04-26T12:24:29.334 INFO:teuthology.orchestra.run.smithi046.stdout:(120/137): python3-zc-lockfile-2.0-2.el8.noarch 211 kB/s | 23 kB 00:00 2024-04-26T12:24:29.359 INFO:teuthology.orchestra.run.smithi046.stdout:(121/137): python3-webob-1.8.5-1.el8.1.noarch.r 1.1 MB/s | 251 kB 00:00 2024-04-26T12:24:29.427 INFO:teuthology.orchestra.run.smithi142.stdout:(125/137): elfutils-libs-0.190-2.el8.x86_64.rpm 1.2 MB/s | 305 kB 00:00 2024-04-26T12:24:29.469 INFO:teuthology.orchestra.run.smithi142.stdout:(126/137): elfutils-libelf-0.190-2.el8.x86_64.r 606 kB/s | 233 kB 00:00 2024-04-26T12:24:29.509 INFO:teuthology.orchestra.run.smithi046.stdout:(122/137): thrift-0.13.0-2.el8.x86_64.rpm 8.7 MB/s | 1.7 MB 00:00 2024-04-26T12:24:29.561 INFO:teuthology.orchestra.run.smithi142.stdout:(127/137): libblkid-2.32.1-46.el8.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-04-26T12:24:29.604 INFO:teuthology.orchestra.run.smithi136.stdout:(44/137): openblas-threads-0.3.15-4.el8.x86_64. 16 MB/s | 4.9 MB 00:00 2024-04-26T12:24:29.620 INFO:teuthology.orchestra.run.smithi142.stdout:(128/137): librbd1-18.2.2-1256.gdc093b5e.el8.x8 3.9 MB/s | 3.6 MB 00:00 2024-04-26T12:24:29.645 INFO:teuthology.orchestra.run.smithi142.stdout:(129/137): libfdisk-2.32.1-46.el8.x86_64.rpm 1.4 MB/s | 254 kB 00:00 2024-04-26T12:24:29.670 INFO:teuthology.orchestra.run.smithi142.stdout:(130/137): libmount-2.32.1-46.el8.x86_64.rpm 2.1 MB/s | 237 kB 00:00 2024-04-26T12:24:29.727 INFO:teuthology.orchestra.run.smithi046.stdout:(123/137): librados2-18.2.2-1256.gdc093b5e.el8. 9.4 MB/s | 3.7 MB 00:00 2024-04-26T12:24:29.737 INFO:teuthology.orchestra.run.smithi136.stdout:(45/137): openblas-0.3.15-4.el8.x86_64.rpm 10 MB/s | 4.7 MB 00:00 2024-04-26T12:24:29.745 INFO:teuthology.orchestra.run.smithi142.stdout:(131/137): libuuid-2.32.1-46.el8.x86_64.rpm 991 kB/s | 99 kB 00:00 2024-04-26T12:24:29.796 INFO:teuthology.orchestra.run.smithi046.stdout:(124/137): elfutils-debuginfod-client-0.190-2.e 268 kB/s | 77 kB 00:00 2024-04-26T12:24:29.813 INFO:teuthology.orchestra.run.smithi136.stdout:(46/137): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2024-04-26T12:24:29.846 INFO:teuthology.orchestra.run.smithi136.stdout:(47/137): python3-jinja2-2.10.1-4.el8.noarch.rp 5.2 MB/s | 578 kB 00:00 2024-04-26T12:24:29.863 INFO:teuthology.orchestra.run.smithi136.stdout:(48/137): python3-jsonpatch-1.21-2.el8.noarch.r 527 kB/s | 27 kB 00:00 2024-04-26T12:24:29.929 INFO:teuthology.orchestra.run.smithi136.stdout:(49/137): python3-jsonpointer-1.10-11.el8.noarc 243 kB/s | 20 kB 00:00 2024-04-26T12:24:29.937 INFO:teuthology.orchestra.run.smithi142.stdout:(132/137): openssl-1.1.1k-12.el8.x86_64.rpm 2.7 MB/s | 738 kB 00:00 2024-04-26T12:24:29.955 INFO:teuthology.orchestra.run.smithi136.stdout:(50/137): python3-mako-1.0.6-14.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2024-04-26T12:24:30.004 INFO:teuthology.orchestra.run.smithi142.stdout:(133/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 5.7 MB/s | 1.5 MB 00:00 2024-04-26T12:24:30.055 INFO:teuthology.orchestra.run.smithi142.stdout:(134/137): libsmartcols-2.32.1-46.el8.x86_64.rp 414 kB/s | 180 kB 00:00 2024-04-26T12:24:30.086 INFO:teuthology.orchestra.run.smithi046.stdout:(125/137): elfutils-libs-0.190-2.el8.x86_64.rpm 1.0 MB/s | 305 kB 00:00 2024-04-26T12:24:30.096 INFO:teuthology.orchestra.run.smithi142.stdout:(135/137): util-linux-user-2.32.1-46.el8.x86_64 1.1 MB/s | 103 kB 00:00 2024-04-26T12:24:30.161 INFO:teuthology.orchestra.run.smithi046.stdout:(126/137): elfutils-libelf-0.190-2.el8.x86_64.r 537 kB/s | 233 kB 00:00 2024-04-26T12:24:30.186 INFO:teuthology.orchestra.run.smithi046.stdout:(127/137): libblkid-2.32.1-46.el8.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-04-26T12:24:30.318 INFO:teuthology.orchestra.run.smithi046.stdout:(128/137): libmount-2.32.1-46.el8.x86_64.rpm 1.8 MB/s | 237 kB 00:00 2024-04-26T12:24:30.414 INFO:teuthology.orchestra.run.smithi136.stdout:(51/137): ceph-test-18.2.2-1256.gdc093b5e.el8.x 9.1 MB/s | 47 MB 00:05 2024-04-26T12:24:30.425 INFO:teuthology.orchestra.run.smithi115.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:24:30.425 INFO:teuthology.orchestra.run.smithi115.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T12:24:30.431 INFO:teuthology.orchestra.run.smithi136.stdout:(52/137): python3-markupsafe-0.23-19.el8.x86_64 77 kB/s | 39 kB 00:00 2024-04-26T12:24:30.478 INFO:teuthology.orchestra.run.smithi046.stdout:(129/137): librbd1-18.2.2-1256.gdc093b5e.el8.x8 3.2 MB/s | 3.6 MB 00:01 2024-04-26T12:24:30.498 INFO:teuthology.orchestra.run.smithi136.stdout:(53/137): python3-numpy-1.14.3-10.el8.x86_64.rp 6.9 MB/s | 3.7 MB 00:00 2024-04-26T12:24:30.502 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-26T12:24:30.503 INFO:teuthology.orchestra.run.smithi046.stdout:(130/137): libfdisk-2.32.1-46.el8.x86_64.rpm 742 kB/s | 254 kB 00:00 2024-04-26T12:24:30.516 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================================ 2024-04-26T12:24:30.516 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-04-26T12:24:30.516 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================================ 2024-04-26T12:24:30.516 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-26T12:24:30.516 INFO:teuthology.orchestra.run.smithi115.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-26T12:24:30.517 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T12:24:30.517 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T12:24:30.517 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T12:24:30.517 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T12:24:30.517 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T12:24:30.517 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T12:24:30.518 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T12:24:30.518 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T12:24:30.518 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T12:24:30.518 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T12:24:30.518 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T12:24:30.519 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T12:24:30.519 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T12:24:30.519 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-26T12:24:30.519 INFO:teuthology.orchestra.run.smithi115.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-26T12:24:30.519 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-26T12:24:30.520 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T12:24:30.520 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T12:24:30.520 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T12:24:30.520 INFO:teuthology.orchestra.run.smithi115.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-26T12:24:30.520 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-26T12:24:30.520 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-26T12:24:30.521 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T12:24:30.521 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T12:24:30.521 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T12:24:30.521 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T12:24:30.521 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T12:24:30.522 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T12:24:30.522 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T12:24:30.522 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-26T12:24:30.522 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2024-04-26T12:24:30.522 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-26T12:24:30.522 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-26T12:24:30.523 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-26T12:24:30.523 INFO:teuthology.orchestra.run.smithi115.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-26T12:24:30.523 INFO:teuthology.orchestra.run.smithi115.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-26T12:24:30.523 INFO:teuthology.orchestra.run.smithi115.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-26T12:24:30.523 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T12:24:30.523 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T12:24:30.524 INFO:teuthology.orchestra.run.smithi115.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-26T12:24:30.524 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-26T12:24:30.524 INFO:teuthology.orchestra.run.smithi115.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-26T12:24:30.524 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-26T12:24:30.524 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-26T12:24:30.524 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-26T12:24:30.525 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-26T12:24:30.525 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-04-26T12:24:30.525 INFO:teuthology.orchestra.run.smithi115.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-26T12:24:30.525 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T12:24:30.525 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T12:24:30.525 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T12:24:30.526 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T12:24:30.526 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T12:24:30.526 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T12:24:30.526 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T12:24:30.526 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T12:24:30.526 INFO:teuthology.orchestra.run.smithi115.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T12:24:30.527 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T12:24:30.527 INFO:teuthology.orchestra.run.smithi115.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T12:24:30.527 INFO:teuthology.orchestra.run.smithi115.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-26T12:24:30.527 INFO:teuthology.orchestra.run.smithi115.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-26T12:24:30.527 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T12:24:30.527 INFO:teuthology.orchestra.run.smithi115.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-26T12:24:30.527 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-04-26T12:24:30.528 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T12:24:30.528 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-04-26T12:24:30.528 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T12:24:30.528 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T12:24:30.528 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T12:24:30.528 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T12:24:30.529 INFO:teuthology.orchestra.run.smithi115.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-26T12:24:30.529 INFO:teuthology.orchestra.run.smithi115.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-26T12:24:30.529 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T12:24:30.529 INFO:teuthology.orchestra.run.smithi115.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-26T12:24:30.529 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-26T12:24:30.529 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T12:24:30.530 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T12:24:30.530 INFO:teuthology.orchestra.run.smithi115.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-26T12:24:30.530 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-26T12:24:30.530 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-26T12:24:30.530 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-26T12:24:30.530 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-26T12:24:30.531 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T12:24:30.531 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-26T12:24:30.531 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T12:24:30.531 INFO:teuthology.orchestra.run.smithi115.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T12:24:30.531 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T12:24:30.531 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T12:24:30.532 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T12:24:30.532 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T12:24:30.532 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T12:24:30.532 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T12:24:30.532 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T12:24:30.532 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T12:24:30.533 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T12:24:30.533 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T12:24:30.533 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T12:24:30.533 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-26T12:24:30.533 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-26T12:24:30.533 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-26T12:24:30.534 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-26T12:24:30.534 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T12:24:30.534 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T12:24:30.534 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T12:24:30.534 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T12:24:30.534 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T12:24:30.535 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T12:24:30.535 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-26T12:24:30.535 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-26T12:24:30.535 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-26T12:24:30.535 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-26T12:24:30.535 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T12:24:30.536 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T12:24:30.536 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T12:24:30.536 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T12:24:30.536 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-26T12:24:30.536 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-26T12:24:30.536 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T12:24:30.536 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T12:24:30.537 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T12:24:30.537 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-26T12:24:30.537 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T12:24:30.537 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T12:24:30.537 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-26T12:24:30.537 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T12:24:30.538 INFO:teuthology.orchestra.run.smithi115.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T12:24:30.538 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T12:24:30.538 INFO:teuthology.orchestra.run.smithi115.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T12:24:30.538 INFO:teuthology.orchestra.run.smithi115.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T12:24:30.538 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T12:24:30.539 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T12:24:30.539 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T12:24:30.539 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T12:24:30.539 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T12:24:30.539 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T12:24:30.539 INFO:teuthology.orchestra.run.smithi115.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T12:24:30.540 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T12:24:30.540 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-26T12:24:30.540 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:24:30.540 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-26T12:24:30.540 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================================ 2024-04-26T12:24:30.540 INFO:teuthology.orchestra.run.smithi115.stdout:Install 122 Packages 2024-04-26T12:24:30.541 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 15 Packages 2024-04-26T12:24:30.541 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:24:30.542 INFO:teuthology.orchestra.run.smithi046.stdout:(131/137): libsmartcols-2.32.1-46.el8.x86_64.rp 856 kB/s | 180 kB 00:00 2024-04-26T12:24:30.543 INFO:teuthology.orchestra.run.smithi136.stdout:(54/137): python3-prettytable-0.7.2-14.el8.noar 477 kB/s | 44 kB 00:00 2024-04-26T12:24:30.543 INFO:teuthology.orchestra.run.smithi142.stdout:(136/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 2.3 MB/s | 1.1 MB 00:00 2024-04-26T12:24:30.543 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 207 M 2024-04-26T12:24:30.543 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-26T12:24:30.549 INFO:teuthology.orchestra.run.smithi136.stdout:(55/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2024-04-26T12:24:30.583 INFO:teuthology.orchestra.run.smithi136.stdout:(56/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2024-04-26T12:24:30.597 INFO:teuthology.orchestra.run.smithi142.stdout:(137/137): util-linux-2.32.1-46.el8.x86_64.rpm 3.9 MB/s | 2.6 MB 00:00 2024-04-26T12:24:30.603 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:24:30.603 INFO:teuthology.orchestra.run.smithi142.stdout:Total 11 MB/s | 207 MB 00:19 2024-04-26T12:24:30.608 INFO:teuthology.orchestra.run.smithi136.stdout:(57/137): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2024-04-26T12:24:30.642 INFO:teuthology.orchestra.run.smithi136.stdout:(58/137): python3-pytz-2017.2-11.el8.noarch.rpm 974 kB/s | 57 kB 00:00 2024-04-26T12:24:30.700 INFO:teuthology.orchestra.run.smithi136.stdout:(59/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 789 kB/s | 225 kB 00:00 2024-04-26T12:24:30.726 INFO:teuthology.orchestra.run.smithi136.stdout:(60/137): python3-werkzeug-0.12.2-4.el8.noarch. 5.3 MB/s | 457 kB 00:00 2024-04-26T12:24:30.784 INFO:teuthology.orchestra.run.smithi136.stdout:(61/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2024-04-26T12:24:30.835 INFO:teuthology.orchestra.run.smithi136.stdout:(62/137): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2024-04-26T12:24:30.838 INFO:teuthology.orchestra.run.smithi046.stdout:(132/137): libuuid-2.32.1-46.el8.x86_64.rpm 277 kB/s | 99 kB 00:00 2024-04-26T12:24:30.871 INFO:teuthology.orchestra.run.smithi046.stdout:(133/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 4.3 MB/s | 1.5 MB 00:00 2024-04-26T12:24:30.988 INFO:teuthology.orchestra.run.smithi046.stdout:(134/137): util-linux-user-2.32.1-46.el8.x86_64 882 kB/s | 103 kB 00:00 2024-04-26T12:24:31.027 INFO:teuthology.orchestra.run.smithi136.stdout:(63/137): python3-scipy-1.0.0-21.module_el8+762 34 MB/s | 14 MB 00:00 2024-04-26T12:24:31.094 INFO:teuthology.orchestra.run.smithi136.stdout:(64/137): elfutils-libelf-devel-0.190-2.el8.x86 201 kB/s | 62 kB 00:00 2024-04-26T12:24:31.096 INFO:teuthology.orchestra.run.smithi046.stdout:(135/137): openssl-1.1.1k-12.el8.x86_64.rpm 1.2 MB/s | 738 kB 00:00 2024-04-26T12:24:31.255 INFO:teuthology.orchestra.run.smithi046.stdout:(136/137): util-linux-2.32.1-46.el8.x86_64.rpm 6.2 MB/s | 2.6 MB 00:00 2024-04-26T12:24:31.269 INFO:teuthology.orchestra.run.smithi136.stdout:(65/137): fuse-2.9.7-19.el8.x86_64.rpm 192 kB/s | 83 kB 00:00 2024-04-26T12:24:31.288 INFO:teuthology.orchestra.run.smithi046.stdout:(137/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 3.6 MB/s | 1.1 MB 00:00 2024-04-26T12:24:31.294 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:24:31.294 INFO:teuthology.orchestra.run.smithi046.stdout:Total 11 MB/s | 207 MB 00:19 2024-04-26T12:24:31.336 INFO:teuthology.orchestra.run.smithi136.stdout:(66/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 156 kB/s | 48 kB 00:00 2024-04-26T12:24:31.365 INFO:teuthology.orchestra.run.smithi115.stdout:(1/137): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 38 kB/s | 6.4 kB 00:00 2024-04-26T12:24:31.464 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-26T12:24:31.486 INFO:teuthology.orchestra.run.smithi136.stdout:(67/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 86 kB/s | 19 kB 00:00 2024-04-26T12:24:31.520 INFO:teuthology.orchestra.run.smithi136.stdout:(68/137): libcom_err-devel-1.45.6-5.el8.x86_64. 211 kB/s | 39 kB 00:00 2024-04-26T12:24:31.554 INFO:teuthology.orchestra.run.smithi136.stdout:(69/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.2 MB/s | 561 kB 00:00 2024-04-26T12:24:31.582 INFO:teuthology.orchestra.run.smithi115.stdout:(2/137): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 3.9 MB/s | 859 kB 00:00 2024-04-26T12:24:31.649 INFO:teuthology.orchestra.run.smithi115.stdout:(3/137): ceph-immutable-object-cache-18.2.2-125 2.4 MB/s | 165 kB 00:00 2024-04-26T12:24:31.654 INFO:teuthology.orchestra.run.smithi136.stdout:(70/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 471 kB/s | 47 kB 00:00 2024-04-26T12:24:31.687 INFO:teuthology.orchestra.run.smithi136.stdout:(71/137): libquadmath-8.5.0-22.el8.x86_64.rpm 1.0 MB/s | 172 kB 00:00 2024-04-26T12:24:31.763 INFO:teuthology.orchestra.run.smithi136.stdout:(72/137): libgfortran-8.5.0-22.el8.x86_64.rpm 2.3 MB/s | 645 kB 00:00 2024-04-26T12:24:31.788 INFO:teuthology.orchestra.run.smithi136.stdout:(73/137): libselinux-devel-2.9-8.el8.x86_64.rpm 1.5 MB/s | 200 kB 00:00 2024-04-26T12:24:31.813 INFO:teuthology.orchestra.run.smithi136.stdout:(74/137): libsepol-devel-2.9-3.el8.x86_64.rpm 693 kB/s | 87 kB 00:00 2024-04-26T12:24:31.872 INFO:teuthology.orchestra.run.smithi136.stdout:(75/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 920 kB/s | 100 kB 00:00 2024-04-26T12:24:31.897 INFO:teuthology.orchestra.run.smithi136.stdout:(76/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 166 kB/s | 18 kB 00:00 2024-04-26T12:24:31.918 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-26T12:24:31.918 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-26T12:24:31.922 INFO:teuthology.orchestra.run.smithi136.stdout:(77/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 403 kB/s | 44 kB 00:00 2024-04-26T12:24:31.932 INFO:teuthology.orchestra.run.smithi115.stdout:(4/137): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 8.0 MB/s | 2.3 MB 00:00 2024-04-26T12:24:32.006 INFO:teuthology.orchestra.run.smithi136.stdout:(78/137): pcre2-devel-10.32-3.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2024-04-26T12:24:32.031 INFO:teuthology.orchestra.run.smithi136.stdout:(79/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.1 MB/s | 229 kB 00:00 2024-04-26T12:24:32.106 INFO:teuthology.orchestra.run.smithi136.stdout:(80/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.2 MB/s | 220 kB 00:00 2024-04-26T12:24:32.132 INFO:teuthology.orchestra.run.smithi136.stdout:(81/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.4 MB/s | 249 kB 00:00 2024-04-26T12:24:32.137 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-04-26T12:24:32.141 INFO:teuthology.orchestra.run.smithi115.stdout:(5/137): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 7.5 MB/s | 1.6 MB 00:00 2024-04-26T12:24:32.190 INFO:teuthology.orchestra.run.smithi136.stdout:(82/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 10 MB/s | 3.2 MB 00:00 2024-04-26T12:24:32.224 INFO:teuthology.orchestra.run.smithi136.stdout:(83/137): python3-cryptography-3.2.1-7.el8.x86_ 5.4 MB/s | 641 kB 00:00 2024-04-26T12:24:32.241 INFO:teuthology.orchestra.run.smithi136.stdout:(84/137): python3-jwt-1.6.1-2.el8.noarch.rpm 391 kB/s | 43 kB 00:00 2024-04-26T12:24:32.291 INFO:teuthology.orchestra.run.smithi136.stdout:(85/137): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2024-04-26T12:24:32.316 INFO:teuthology.orchestra.run.smithi136.stdout:(86/137): python3-pycparser-2.14-14.el8.noarch. 1.2 MB/s | 109 kB 00:00 2024-04-26T12:24:32.358 INFO:teuthology.orchestra.run.smithi136.stdout:(87/137): python3-requests-oauthlib-1.0.0-1.el8 364 kB/s | 43 kB 00:00 2024-04-26T12:24:32.417 INFO:teuthology.orchestra.run.smithi136.stdout:(88/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 594 kB/s | 74 kB 00:00 2024-04-26T12:24:32.443 INFO:teuthology.orchestra.run.smithi136.stdout:(89/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 462 kB/s | 58 kB 00:00 2024-04-26T12:24:32.543 INFO:teuthology.orchestra.run.smithi136.stdout:(90/137): liboath-2.6.2-3.el8.x86_64.rpm 589 kB/s | 59 kB 00:00 2024-04-26T12:24:32.610 INFO:teuthology.orchestra.run.smithi136.stdout:(91/137): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2024-04-26T12:24:32.625 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-04-26T12:24:32.626 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-04-26T12:24:32.635 INFO:teuthology.orchestra.run.smithi136.stdout:(92/137): libunwind-1.3.1-3.el8.x86_64.rpm 818 kB/s | 75 kB 00:00 2024-04-26T12:24:32.685 INFO:teuthology.orchestra.run.smithi136.stdout:(93/137): python3-packaging-16.8-9.el8.noarch.r 147 kB/s | 48 kB 00:00 2024-04-26T12:24:32.709 INFO:teuthology.orchestra.run.smithi115.stdout:(6/137): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 8.5 MB/s | 4.8 MB 00:00 2024-04-26T12:24:32.710 INFO:teuthology.orchestra.run.smithi136.stdout:(94/137): python3-asyncssh-2.7.0-2.el8.noarch.r 4.6 MB/s | 476 kB 00:00 2024-04-26T12:24:32.736 INFO:teuthology.orchestra.run.smithi136.stdout:(95/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 433 kB/s | 44 kB 00:00 2024-04-26T12:24:32.761 INFO:teuthology.orchestra.run.smithi136.stdout:(96/137): python3-cachetools-3.1.1-4.el8.noarch 658 kB/s | 33 kB 00:00 2024-04-26T12:24:32.795 INFO:teuthology.orchestra.run.smithi136.stdout:(97/137): python3-certifi-2018.10.15-7.el8.noar 277 kB/s | 16 kB 00:00 2024-04-26T12:24:32.821 INFO:teuthology.orchestra.run.smithi136.stdout:(98/137): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2024-04-26T12:24:32.846 INFO:teuthology.orchestra.run.smithi136.stdout:(99/137): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2024-04-26T12:24:32.871 INFO:teuthology.orchestra.run.smithi136.stdout:(100/137): python3-google-auth-1.1.1-10.el8.noa 1.6 MB/s | 81 kB 00:00 2024-04-26T12:24:32.896 INFO:teuthology.orchestra.run.smithi136.stdout:(101/137): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2024-04-26T12:24:32.917 INFO:teuthology.orchestra.run.smithi115.stdout:(7/137): ceph-common-18.2.2-1256.gdc093b5e.el8. 13 MB/s | 22 MB 00:01 2024-04-26T12:24:32.922 INFO:teuthology.orchestra.run.smithi136.stdout:(102/137): python3-jaraco-functools-2.0-4.el8.n 351 kB/s | 18 kB 00:00 2024-04-26T12:24:32.947 INFO:teuthology.orchestra.run.smithi136.stdout:(103/137): python3-cherrypy-18.4.0-1.el8.noarch 2.5 MB/s | 384 kB 00:00 2024-04-26T12:24:32.973 INFO:teuthology.orchestra.run.smithi136.stdout:(104/137): python3-logutils-0.3.5-11.el8.noarch 966 kB/s | 49 kB 00:00 2024-04-26T12:24:32.992 INFO:teuthology.orchestra.run.smithi115.stdout:(8/137): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 3.1 MB/s | 5.5 MB 00:01 2024-04-26T12:24:32.998 INFO:teuthology.orchestra.run.smithi136.stdout:(105/137): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2024-04-26T12:24:33.023 INFO:teuthology.orchestra.run.smithi136.stdout:(106/137): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2024-04-26T12:24:33.065 INFO:teuthology.orchestra.run.smithi136.stdout:(107/137): python3-portend-2.6-1.el8.noarch.rpm 376 kB/s | 16 kB 00:00 2024-04-26T12:24:33.093 INFO:teuthology.orchestra.run.smithi115.stdout:(9/137): ceph-selinux-18.2.2-1256.gdc093b5e.el8 243 kB/s | 24 kB 00:00 2024-04-26T12:24:33.098 INFO:teuthology.orchestra.run.smithi136.stdout:(108/137): python3-pecan-1.3.2-9.el8.noarch.rpm 2.7 MB/s | 283 kB 00:00 2024-04-26T12:24:33.124 INFO:teuthology.orchestra.run.smithi136.stdout:(109/137): python3-repoze-lru-0.7-6.el8.noarch. 574 kB/s | 34 kB 00:00 2024-04-26T12:24:33.188 INFO:teuthology.orchestra.run.smithi136.stdout:(110/137): python3-kubernetes-11.0.0-6.el8.noar 4.0 MB/s | 1.2 MB 00:00 2024-04-26T12:24:33.216 INFO:teuthology.orchestra.run.smithi136.stdout:(111/137): python3-rsa-4.9-2.el8.noarch.rpm 697 kB/s | 64 kB 00:00 2024-04-26T12:24:33.242 INFO:teuthology.orchestra.run.smithi136.stdout:(112/137): python3-routes-2.4.1-12.el8.noarch.r 1.3 MB/s | 196 kB 00:00 2024-04-26T12:24:33.267 INFO:teuthology.orchestra.run.smithi136.stdout:(113/137): python3-simplegeneric-0.8.1-17.el8.n 237 kB/s | 19 kB 00:00 2024-04-26T12:24:33.292 INFO:teuthology.orchestra.run.smithi136.stdout:(114/137): python3-singledispatch-3.4.0.3-18.el 317 kB/s | 24 kB 00:00 2024-04-26T12:24:33.298 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-26T12:24:33.302 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-26T12:24:33.317 INFO:teuthology.orchestra.run.smithi136.stdout:(115/137): python3-tempora-1.14.1-5.el8.noarch. 388 kB/s | 29 kB 00:00 2024-04-26T12:24:33.343 INFO:teuthology.orchestra.run.smithi136.stdout:(116/137): python3-trustme-0.6.0-4.el8.noarch.r 364 kB/s | 27 kB 00:00 2024-04-26T12:24:33.368 INFO:teuthology.orchestra.run.smithi136.stdout:(117/137): python3-webob-1.8.5-1.el8.1.noarch.r 4.9 MB/s | 251 kB 00:00 2024-04-26T12:24:33.394 INFO:teuthology.orchestra.run.smithi136.stdout:(118/137): python3-waitress-1.4.3-1.el8.noarch. 2.5 MB/s | 255 kB 00:00 2024-04-26T12:24:33.410 INFO:teuthology.orchestra.run.smithi136.stdout:(119/137): python3-websocket-client-0.56.0-5.el 912 kB/s | 61 kB 00:00 2024-04-26T12:24:33.436 INFO:teuthology.orchestra.run.smithi136.stdout:(120/137): python3-webtest-2.0.33-1.el8.noarch. 1.2 MB/s | 85 kB 00:00 2024-04-26T12:24:33.461 INFO:teuthology.orchestra.run.smithi136.stdout:(121/137): python3-zc-lockfile-2.0-2.el8.noarch 342 kB/s | 23 kB 00:00 2024-04-26T12:24:33.703 INFO:teuthology.orchestra.run.smithi136.stdout:(122/137): thrift-0.13.0-2.el8.x86_64.rpm 5.9 MB/s | 1.7 MB 00:00 2024-04-26T12:24:33.804 INFO:teuthology.orchestra.run.smithi136.stdout:(123/137): elfutils-debuginfod-client-0.190-2.e 766 kB/s | 77 kB 00:00 2024-04-26T12:24:33.970 INFO:teuthology.orchestra.run.smithi136.stdout:(124/137): elfutils-libelf-0.190-2.el8.x86_64.r 1.4 MB/s | 233 kB 00:00 2024-04-26T12:24:34.071 INFO:teuthology.orchestra.run.smithi136.stdout:(125/137): elfutils-libs-0.190-2.el8.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-04-26T12:24:34.091 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-04-26T12:24:34.095 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-04-26T12:24:34.196 INFO:teuthology.orchestra.run.smithi136.stdout:(126/137): librbd1-18.2.2-1256.gdc093b5e.el8.x8 4.9 MB/s | 3.6 MB 00:00 2024-04-26T12:24:34.217 INFO:teuthology.orchestra.run.smithi115.stdout:(10/137): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 12 MB/s | 18 MB 00:01 2024-04-26T12:24:34.221 INFO:teuthology.orchestra.run.smithi136.stdout:(127/137): libblkid-2.32.1-46.el8.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-04-26T12:24:34.322 INFO:teuthology.orchestra.run.smithi136.stdout:(128/137): libmount-2.32.1-46.el8.x86_64.rpm 2.3 MB/s | 237 kB 00:00 2024-04-26T12:24:34.359 INFO:teuthology.orchestra.run.smithi115.stdout:(11/137): ceph-radosgw-18.2.2-1256.gdc093b5e.el 9.1 MB/s | 13 MB 00:01 2024-04-26T12:24:34.376 INFO:teuthology.orchestra.run.smithi115.stdout:(12/137): libcephfs-devel-18.2.2-1256.gdc093b5e 195 kB/s | 31 kB 00:00 2024-04-26T12:24:34.426 INFO:teuthology.orchestra.run.smithi115.stdout:(13/137): libcephsqlite-18.2.2-1256.gdc093b5e.e 2.8 MB/s | 142 kB 00:00 2024-04-26T12:24:34.430 INFO:teuthology.orchestra.run.smithi136.stdout:(129/137): libfdisk-2.32.1-46.el8.x86_64.rpm 1.1 MB/s | 254 kB 00:00 2024-04-26T12:24:34.456 INFO:teuthology.orchestra.run.smithi136.stdout:(130/137): libsmartcols-2.32.1-46.el8.x86_64.rp 1.3 MB/s | 180 kB 00:00 2024-04-26T12:24:34.485 INFO:teuthology.orchestra.run.smithi115.stdout:(14/137): libcephfs2-18.2.2-1256.gdc093b5e.el8. 6.1 MB/s | 781 kB 00:00 2024-04-26T12:24:34.522 INFO:teuthology.orchestra.run.smithi136.stdout:(131/137): libuuid-2.32.1-46.el8.x86_64.rpm 1.1 MB/s | 99 kB 00:00 2024-04-26T12:24:34.527 INFO:teuthology.orchestra.run.smithi115.stdout:(15/137): librados-devel-18.2.2-1256.gdc093b5e. 1.4 MB/s | 139 kB 00:00 2024-04-26T12:24:34.552 INFO:teuthology.orchestra.run.smithi115.stdout:(16/137): libradosstriper1-18.2.2-1256.gdc093b5 6.9 MB/s | 474 kB 00:00 2024-04-26T12:24:34.581 INFO:teuthology.orchestra.run.smithi136.stdout:(132/137): librados2-18.2.2-1256.gdc093b5e.el8. 3.2 MB/s | 3.7 MB 00:01 2024-04-26T12:24:34.602 INFO:teuthology.orchestra.run.smithi115.stdout:(17/137): python3-ceph-argparse-18.2.2-1256.gdc 896 kB/s | 45 kB 00:00 2024-04-26T12:24:34.661 INFO:teuthology.orchestra.run.smithi115.stdout:(18/137): python3-ceph-common-18.2.2-1256.gdc09 2.2 MB/s | 129 kB 00:00 2024-04-26T12:24:34.673 INFO:teuthology.orchestra.run.smithi136.stdout:(133/137): openssl-1.1.1k-12.el8.x86_64.rpm 3.3 MB/s | 738 kB 00:00 2024-04-26T12:24:34.720 INFO:teuthology.orchestra.run.smithi115.stdout:(19/137): python3-cephfs-18.2.2-1256.gdc093b5e. 3.3 MB/s | 197 kB 00:00 2024-04-26T12:24:34.787 INFO:teuthology.orchestra.run.smithi115.stdout:(20/137): python3-rados-18.2.2-1256.gdc093b5e.e 5.4 MB/s | 371 kB 00:00 2024-04-26T12:24:34.798 INFO:teuthology.orchestra.run.smithi136.stdout:(134/137): util-linux-user-2.32.1-46.el8.x86_64 825 kB/s | 103 kB 00:00 2024-04-26T12:24:34.862 INFO:teuthology.orchestra.run.smithi115.stdout:(21/137): python3-rbd-18.2.2-1256.gdc093b5e.el8 4.8 MB/s | 364 kB 00:00 2024-04-26T12:24:34.882 INFO:teuthology.orchestra.run.smithi136.stdout:(135/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 4.1 MB/s | 1.5 MB 00:00 2024-04-26T12:24:34.912 INFO:teuthology.orchestra.run.smithi115.stdout:(22/137): python3-rgw-18.2.2-1256.gdc093b5e.el8 2.1 MB/s | 107 kB 00:00 2024-04-26T12:24:34.924 INFO:teuthology.orchestra.run.smithi136.stdout:(136/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 8.6 MB/s | 1.1 MB 00:00 2024-04-26T12:24:34.971 INFO:teuthology.orchestra.run.smithi115.stdout:(23/137): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.6 MB/s | 95 kB 00:00 2024-04-26T12:24:35.088 INFO:teuthology.orchestra.run.smithi115.stdout:(24/137): librgw2-18.2.2-1256.gdc093b5e.el8.x86 12 MB/s | 6.6 MB 00:00 2024-04-26T12:24:35.155 INFO:teuthology.orchestra.run.smithi115.stdout:(25/137): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 2.7 MB/s | 181 kB 00:00 2024-04-26T12:24:35.199 INFO:teuthology.orchestra.run.smithi136.stdout:(137/137): util-linux-2.32.1-46.el8.x86_64.rpm 4.2 MB/s | 2.6 MB 00:00 2024-04-26T12:24:35.202 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:24:35.202 INFO:teuthology.orchestra.run.smithi136.stdout:Total 16 MB/s | 207 MB 00:12 2024-04-26T12:24:35.205 INFO:teuthology.orchestra.run.smithi115.stdout:(26/137): ceph-grafana-dashboards-18.2.2-1256.g 489 kB/s | 24 kB 00:00 2024-04-26T12:24:35.297 INFO:teuthology.orchestra.run.smithi115.stdout:(27/137): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 11 MB/s | 3.5 MB 00:00 2024-04-26T12:24:35.322 INFO:teuthology.orchestra.run.smithi115.stdout:(28/137): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.2 MB/s | 138 kB 00:00 2024-04-26T12:24:35.641 INFO:teuthology.orchestra.run.smithi115.stdout:(29/137): ceph-mgr-dashboard-18.2.2-1256.gdc093 10 MB/s | 3.5 MB 00:00 2024-04-26T12:24:35.706 INFO:teuthology.orchestra.run.smithi115.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1256.gdc 3.7 MB/s | 246 kB 00:00 2024-04-26T12:24:35.748 INFO:teuthology.orchestra.run.smithi115.stdout:(31/137): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 1.2 MB/s | 49 kB 00:00 2024-04-26T12:24:35.782 INFO:teuthology.orchestra.run.smithi115.stdout:(32/137): ceph-prometheus-alerts-18.2.2-1256.gd 459 kB/s | 15 kB 00:00 2024-04-26T12:24:35.840 INFO:teuthology.orchestra.run.smithi115.stdout:(33/137): ceph-volume-18.2.2-1256.gdc093b5e.el8 4.4 MB/s | 263 kB 00:00 2024-04-26T12:24:35.891 INFO:teuthology.orchestra.run.smithi115.stdout:(34/137): cephadm-18.2.2-1256.gdc093b5e.el8.noa 3.4 MB/s | 173 kB 00:00 2024-04-26T12:24:35.975 INFO:teuthology.orchestra.run.smithi115.stdout:(35/137): ceph-mgr-diskprediction-local-18.2.2- 11 MB/s | 7.4 MB 00:00 2024-04-26T12:24:36.052 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-04-26T12:24:36.250 INFO:teuthology.orchestra.run.smithi115.stdout:(36/137): automake-1.16.1-8.el8.noarch.rpm 2.0 MB/s | 740 kB 00:00 2024-04-26T12:24:36.283 INFO:teuthology.orchestra.run.smithi115.stdout:(37/137): bison-3.0.4-10.el8.x86_64.rpm 2.2 MB/s | 688 kB 00:00 2024-04-26T12:24:36.317 INFO:teuthology.orchestra.run.smithi115.stdout:(38/137): flex-2.6.1-9.el8.x86_64.rpm 4.7 MB/s | 320 kB 00:00 2024-04-26T12:24:36.342 INFO:teuthology.orchestra.run.smithi115.stdout:(39/137): jq-1.6-8.el8.x86_64.rpm 3.4 MB/s | 203 kB 00:00 2024-04-26T12:24:36.410 INFO:teuthology.orchestra.run.smithi115.stdout:(40/137): librdkafka-1.6.1-1.el8.x86_64.rpm 7.2 MB/s | 677 kB 00:00 2024-04-26T12:24:36.468 INFO:teuthology.orchestra.run.smithi115.stdout:(41/137): libtool-2.4.6-25.el8.x86_64.rpm 5.5 MB/s | 709 kB 00:00 2024-04-26T12:24:36.493 INFO:teuthology.orchestra.run.smithi115.stdout:(42/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.0 MB/s | 259 kB 00:00 2024-04-26T12:24:36.507 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-04-26T12:24:36.507 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-04-26T12:24:36.594 INFO:teuthology.orchestra.run.smithi115.stdout:(43/137): oniguruma-6.8.2-3.el8.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-26T12:24:36.952 INFO:teuthology.orchestra.run.smithi115.stdout:(44/137): openblas-threads-0.3.15-4.el8.x86_64. 14 MB/s | 4.9 MB 00:00 2024-04-26T12:24:37.111 INFO:teuthology.orchestra.run.smithi115.stdout:(45/137): python3-babel-2.5.1-7.el8.noarch.rpm 30 MB/s | 4.8 MB 00:00 2024-04-26T12:24:37.178 INFO:teuthology.orchestra.run.smithi115.stdout:(46/137): python3-jinja2-2.10.1-4.el8.noarch.rp 8.5 MB/s | 578 kB 00:00 2024-04-26T12:24:37.237 INFO:teuthology.orchestra.run.smithi115.stdout:(47/137): python3-jsonpatch-1.21-2.el8.noarch.r 455 kB/s | 27 kB 00:00 2024-04-26T12:24:37.295 INFO:teuthology.orchestra.run.smithi115.stdout:(48/137): python3-jsonpointer-1.10-11.el8.noarc 343 kB/s | 20 kB 00:00 2024-04-26T12:24:37.379 INFO:teuthology.orchestra.run.smithi115.stdout:(49/137): python3-mako-1.0.6-14.el8.noarch.rpm 1.8 MB/s | 157 kB 00:00 2024-04-26T12:24:37.437 INFO:teuthology.orchestra.run.smithi115.stdout:(50/137): python3-markupsafe-0.23-19.el8.x86_64 665 kB/s | 39 kB 00:00 2024-04-26T12:24:37.579 INFO:teuthology.orchestra.run.smithi115.stdout:(51/137): python3-numpy-1.14.3-10.el8.x86_64.rp 26 MB/s | 3.7 MB 00:00 2024-04-26T12:24:37.638 INFO:teuthology.orchestra.run.smithi115.stdout:(52/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2024-04-26T12:24:37.688 INFO:teuthology.orchestra.run.smithi115.stdout:(53/137): python3-prettytable-0.7.2-14.el8.noar 877 kB/s | 44 kB 00:00 2024-04-26T12:24:37.748 INFO:teuthology.orchestra.run.smithi115.stdout:(54/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2024-04-26T12:24:37.807 INFO:teuthology.orchestra.run.smithi115.stdout:(55/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2024-04-26T12:24:37.861 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-04-26T12:24:37.864 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-04-26T12:24:37.864 INFO:teuthology.orchestra.run.smithi115.stdout:(56/137): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2024-04-26T12:24:37.923 INFO:teuthology.orchestra.run.smithi115.stdout:(57/137): python3-pytz-2017.2-11.el8.noarch.rpm 979 kB/s | 57 kB 00:00 2024-04-26T12:24:38.315 INFO:teuthology.orchestra.run.smithi115.stdout:(58/137): python3-scipy-1.0.0-21.module_el8+762 36 MB/s | 14 MB 00:00 2024-04-26T12:24:38.373 INFO:teuthology.orchestra.run.smithi115.stdout:(59/137): python3-werkzeug-0.12.2-4.el8.noarch. 7.7 MB/s | 457 kB 00:00 2024-04-26T12:24:38.432 INFO:teuthology.orchestra.run.smithi115.stdout:(60/137): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2024-04-26T12:24:38.465 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-26T12:24:38.482 INFO:teuthology.orchestra.run.smithi115.stdout:(61/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-04-26T12:24:38.631 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-26T12:24:38.791 INFO:teuthology.orchestra.run.smithi115.stdout:(62/137): elfutils-libelf-devel-0.190-2.el8.x86 202 kB/s | 62 kB 00:00 2024-04-26T12:24:38.852 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T12:24:38.983 INFO:teuthology.orchestra.run.smithi115.stdout:(63/137): openblas-0.3.15-4.el8.x86_64.rpm 1.9 MB/s | 4.7 MB 00:02 2024-04-26T12:24:39.008 INFO:teuthology.orchestra.run.smithi115.stdout:(64/137): fuse-2.9.7-19.el8.x86_64.rpm 383 kB/s | 83 kB 00:00 2024-04-26T12:24:39.075 INFO:teuthology.orchestra.run.smithi115.stdout:(65/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 522 kB/s | 48 kB 00:00 2024-04-26T12:24:39.104 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T12:24:39.176 INFO:teuthology.orchestra.run.smithi115.stdout:(66/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 186 kB/s | 19 kB 00:00 2024-04-26T12:24:39.276 INFO:teuthology.orchestra.run.smithi115.stdout:(67/137): libcom_err-devel-1.45.6-5.el8.x86_64. 388 kB/s | 39 kB 00:00 2024-04-26T12:24:39.329 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-26T12:24:39.479 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T12:24:39.526 INFO:teuthology.orchestra.run.smithi115.stdout:(68/137): libgfortran-8.5.0-22.el8.x86_64.rpm 2.5 MB/s | 645 kB 00:00 2024-04-26T12:24:39.547 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T12:24:39.551 INFO:teuthology.orchestra.run.smithi115.stdout:(69/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.0 MB/s | 561 kB 00:00 2024-04-26T12:24:39.652 INFO:teuthology.orchestra.run.smithi115.stdout:(70/137): libquadmath-8.5.0-22.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-04-26T12:24:39.677 INFO:teuthology.orchestra.run.smithi115.stdout:(71/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 375 kB/s | 47 kB 00:00 2024-04-26T12:24:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T12:24:39.752 INFO:teuthology.orchestra.run.smithi115.stdout:(72/137): libselinux-devel-2.9-8.el8.x86_64.rpm 2.0 MB/s | 200 kB 00:00 2024-04-26T12:24:39.778 INFO:teuthology.orchestra.run.smithi115.stdout:(73/137): libsepol-devel-2.9-3.el8.x86_64.rpm 867 kB/s | 87 kB 00:00 2024-04-26T12:24:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T12:24:39.836 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-04-26T12:24:39.845 INFO:teuthology.orchestra.run.smithi115.stdout:(74/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 1.1 MB/s | 100 kB 00:00 2024-04-26T12:24:39.870 INFO:teuthology.orchestra.run.smithi115.stdout:(75/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 196 kB/s | 18 kB 00:00 2024-04-26T12:24:39.937 INFO:teuthology.orchestra.run.smithi115.stdout:(76/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 477 kB/s | 44 kB 00:00 2024-04-26T12:24:40.004 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-26T12:24:40.065 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-26T12:24:40.077 INFO:teuthology.orchestra.run.smithi115.stdout:(77/137): pcre2-devel-10.32-3.el8.x86_64.rpm 4.2 MB/s | 605 kB 00:00 2024-04-26T12:24:40.187 INFO:teuthology.orchestra.run.smithi115.stdout:(78/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.0 MB/s | 229 kB 00:00 2024-04-26T12:24:40.228 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-26T12:24:40.249 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T12:24:40.287 INFO:teuthology.orchestra.run.smithi115.stdout:(79/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.2 MB/s | 220 kB 00:00 2024-04-26T12:24:40.338 INFO:teuthology.orchestra.run.smithi115.stdout:(80/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 6.8 MB/s | 3.2 MB 00:00 2024-04-26T12:24:40.396 INFO:teuthology.orchestra.run.smithi115.stdout:(81/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.2 MB/s | 249 kB 00:00 2024-04-26T12:24:40.425 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-26T12:24:40.438 INFO:teuthology.orchestra.run.smithi115.stdout:(82/137): python3-cryptography-3.2.1-7.el8.x86_ 6.2 MB/s | 641 kB 00:00 2024-04-26T12:24:40.473 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T12:24:40.488 INFO:teuthology.orchestra.run.smithi115.stdout:(83/137): python3-jwt-1.6.1-2.el8.noarch.rpm 463 kB/s | 43 kB 00:00 2024-04-26T12:24:40.539 INFO:teuthology.orchestra.run.smithi115.stdout:(84/137): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2024-04-26T12:24:40.589 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T12:24:40.589 INFO:teuthology.orchestra.run.smithi115.stdout:(85/137): python3-pycparser-2.14-14.el8.noarch. 1.1 MB/s | 109 kB 00:00 2024-04-26T12:24:40.631 INFO:teuthology.orchestra.run.smithi115.stdout:(86/137): python3-requests-oauthlib-1.0.0-1.el8 464 kB/s | 43 kB 00:00 2024-04-26T12:24:40.715 INFO:teuthology.orchestra.run.smithi115.stdout:(87/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 595 kB/s | 74 kB 00:00 2024-04-26T12:24:40.727 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-26T12:24:40.740 INFO:teuthology.orchestra.run.smithi115.stdout:(88/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 535 kB/s | 58 kB 00:00 2024-04-26T12:24:40.866 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T12:24:40.984 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T12:24:41.004 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T12:24:41.057 INFO:teuthology.orchestra.run.smithi115.stdout:(89/137): python3-packaging-16.8-9.el8.noarch.r 141 kB/s | 48 kB 00:00 2024-04-26T12:24:41.141 INFO:teuthology.orchestra.run.smithi115.stdout:(90/137): gperftools-libs-2.7-9.el8.x86_64.rpm 765 kB/s | 306 kB 00:00 2024-04-26T12:24:41.166 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T12:24:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T12:24:41.224 INFO:teuthology.orchestra.run.smithi115.stdout:(91/137): libunwind-1.3.1-3.el8.x86_64.rpm 903 kB/s | 75 kB 00:00 2024-04-26T12:24:41.254 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T12:24:41.316 INFO:teuthology.orchestra.run.smithi115.stdout:(92/137): liboath-2.6.2-3.el8.x86_64.rpm 227 kB/s | 59 kB 00:00 2024-04-26T12:24:41.408 INFO:teuthology.orchestra.run.smithi115.stdout:(93/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 477 kB/s | 44 kB 00:00 2024-04-26T12:24:41.482 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-26T12:24:41.550 INFO:teuthology.orchestra.run.smithi115.stdout:(94/137): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2024-04-26T12:24:41.609 INFO:teuthology.orchestra.run.smithi115.stdout:(95/137): python3-asyncssh-2.7.0-2.el8.noarch.r 1.2 MB/s | 476 kB 00:00 2024-04-26T12:24:41.616 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T12:24:41.634 INFO:teuthology.orchestra.run.smithi115.stdout:(96/137): python3-cachetools-3.1.1-4.el8.noarch 394 kB/s | 33 kB 00:00 2024-04-26T12:24:41.684 INFO:teuthology.orchestra.run.smithi115.stdout:(97/137): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2024-04-26T12:24:41.727 INFO:teuthology.orchestra.run.smithi115.stdout:(98/137): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2024-04-26T12:24:41.804 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T12:24:41.807 INFO:teuthology.orchestra.run.smithi115.stdout:(99/137): python3-cherrypy-18.4.0-1.el8.noarch. 3.1 MB/s | 384 kB 00:00 2024-04-26T12:24:41.838 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-26T12:24:41.893 INFO:teuthology.orchestra.run.smithi115.stdout:(100/137): python3-google-auth-1.1.1-10.el8.noa 487 kB/s | 81 kB 00:00 2024-04-26T12:24:41.910 INFO:teuthology.orchestra.run.smithi115.stdout:(101/137): python3-jaraco-6.2-6.el8.noarch.rpm 108 kB/s | 11 kB 00:00 2024-04-26T12:24:41.934 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T12:24:41.952 INFO:teuthology.orchestra.run.smithi115.stdout:(102/137): python3-jaraco-functools-2.0-4.el8.n 299 kB/s | 18 kB 00:00 2024-04-26T12:24:42.028 INFO:teuthology.orchestra.run.smithi115.stdout:(103/137): python3-logutils-0.3.5-11.el8.noarch 650 kB/s | 49 kB 00:00 2024-04-26T12:24:42.053 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-26T12:24:42.106 INFO:teuthology.orchestra.run.smithi115.stdout:(104/137): python3-more-itertools-7.2.0-3.el8.n 783 kB/s | 59 kB 00:00 2024-04-26T12:24:42.137 INFO:teuthology.orchestra.run.smithi115.stdout:(105/137): python3-kubernetes-11.0.0-6.el8.noar 5.2 MB/s | 1.2 MB 00:00 2024-04-26T12:24:42.179 INFO:teuthology.orchestra.run.smithi115.stdout:(106/137): python3-natsort-7.1.1-2.el8.noarch.r 802 kB/s | 60 kB 00:00 2024-04-26T12:24:42.204 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T12:24:42.212 INFO:teuthology.orchestra.run.smithi115.stdout:(107/137): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2024-04-26T12:24:42.224 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T12:24:42.246 INFO:teuthology.orchestra.run.smithi115.stdout:(108/137): python3-portend-2.6-1.el8.noarch.rpm 232 kB/s | 16 kB 00:00 2024-04-26T12:24:42.280 INFO:teuthology.orchestra.run.smithi115.stdout:(109/137): python3-repoze-lru-0.7-6.el8.noarch. 502 kB/s | 34 kB 00:00 2024-04-26T12:24:42.288 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T12:24:42.330 INFO:teuthology.orchestra.run.smithi115.stdout:(110/137): python3-routes-2.4.1-12.el8.noarch.r 2.3 MB/s | 196 kB 00:00 2024-04-26T12:24:42.355 INFO:teuthology.orchestra.run.smithi115.stdout:(111/137): python3-rsa-4.9-2.el8.noarch.rpm 851 kB/s | 64 kB 00:00 2024-04-26T12:24:42.397 INFO:teuthology.orchestra.run.smithi115.stdout:(112/137): python3-simplegeneric-0.8.1-17.el8.n 280 kB/s | 19 kB 00:00 2024-04-26T12:24:42.423 INFO:teuthology.orchestra.run.smithi115.stdout:(113/137): python3-singledispatch-3.4.0.3-18.el 358 kB/s | 24 kB 00:00 2024-04-26T12:24:42.465 INFO:teuthology.orchestra.run.smithi115.stdout:(114/137): python3-tempora-1.14.1-5.el8.noarch. 436 kB/s | 29 kB 00:00 2024-04-26T12:24:42.490 INFO:teuthology.orchestra.run.smithi115.stdout:(115/137): python3-trustme-0.6.0-4.el8.noarch.r 411 kB/s | 27 kB 00:00 2024-04-26T12:24:42.499 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T12:24:42.548 INFO:teuthology.orchestra.run.smithi115.stdout:(116/137): python3-waitress-1.4.3-1.el8.noarch. 3.0 MB/s | 255 kB 00:00 2024-04-26T12:24:42.574 INFO:teuthology.orchestra.run.smithi115.stdout:(117/137): python3-webob-1.8.5-1.el8.1.noarch.r 2.9 MB/s | 251 kB 00:00 2024-04-26T12:24:42.624 INFO:teuthology.orchestra.run.smithi115.stdout:(118/137): python3-websocket-client-0.56.0-5.el 811 kB/s | 61 kB 00:00 2024-04-26T12:24:42.641 INFO:teuthology.orchestra.run.smithi115.stdout:(119/137): python3-webtest-2.0.33-1.el8.noarch. 1.2 MB/s | 85 kB 00:00 2024-04-26T12:24:42.694 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-26T12:24:42.694 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T12:24:42.708 INFO:teuthology.orchestra.run.smithi115.stdout:(120/137): python3-zc-lockfile-2.0-2.el8.noarch 275 kB/s | 23 kB 00:00 2024-04-26T12:24:42.809 INFO:teuthology.orchestra.run.smithi115.stdout:(121/137): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2024-04-26T12:24:42.907 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T12:24:42.926 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-26T12:24:43.007 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-04-26T12:24:43.117 INFO:teuthology.orchestra.run.smithi115.stdout:(122/137): librados2-18.2.2-1256.gdc093b5e.el8. 9.0 MB/s | 3.7 MB 00:00 2024-04-26T12:24:43.141 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-26T12:24:43.176 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-26T12:24:43.226 INFO:teuthology.orchestra.run.smithi115.stdout:(123/137): librbd1-18.2.2-1256.gdc093b5e.el8.x8 8.6 MB/s | 3.6 MB 00:00 2024-04-26T12:24:43.245 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T12:24:43.313 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T12:24:43.359 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T12:24:43.393 INFO:teuthology.orchestra.run.smithi115.stdout:(124/137): elfutils-debuginfod-client-0.190-2.e 279 kB/s | 77 kB 00:00 2024-04-26T12:24:43.401 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T12:24:43.482 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T12:24:43.487 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T12:24:43.597 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T12:24:43.621 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T12:24:43.684 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T12:24:43.749 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T12:24:43.832 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T12:24:43.890 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-26T12:24:43.895 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T12:24:43.993 INFO:teuthology.orchestra.run.smithi115.stdout:(125/137): ceph-test-18.2.2-1256.gdc093b5e.el8. 4.3 MB/s | 47 MB 00:10 2024-04-26T12:24:44.004 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T12:24:44.018 INFO:teuthology.orchestra.run.smithi115.stdout:(126/137): elfutils-libelf-0.190-2.el8.x86_64.r 294 kB/s | 233 kB 00:00 2024-04-26T12:24:44.036 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T12:24:44.043 INFO:teuthology.orchestra.run.smithi115.stdout:(127/137): elfutils-libs-0.190-2.el8.x86_64.rpm 469 kB/s | 305 kB 00:00 2024-04-26T12:24:44.114 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T12:24:44.136 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T12:24:44.193 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-26T12:24:44.277 INFO:teuthology.orchestra.run.smithi115.stdout:(128/137): libmount-2.32.1-46.el8.x86_64.rpm 1.0 MB/s | 237 kB 00:00 2024-04-26T12:24:44.328 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T12:24:44.352 INFO:teuthology.orchestra.run.smithi115.stdout:(129/137): libfdisk-2.32.1-46.el8.x86_64.rpm 761 kB/s | 254 kB 00:00 2024-04-26T12:24:44.370 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-26T12:24:44.387 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-26T12:24:44.420 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T12:24:44.453 INFO:teuthology.orchestra.run.smithi115.stdout:(130/137): libblkid-2.32.1-46.el8.x86_64.rpm 482 kB/s | 221 kB 00:00 2024-04-26T12:24:44.519 INFO:teuthology.orchestra.run.smithi115.stdout:(131/137): libsmartcols-2.32.1-46.el8.x86_64.rp 743 kB/s | 180 kB 00:00 2024-04-26T12:24:44.528 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T12:24:44.544 INFO:teuthology.orchestra.run.smithi115.stdout:(132/137): libuuid-2.32.1-46.el8.x86_64.rpm 517 kB/s | 99 kB 00:00 2024-04-26T12:24:44.603 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-26T12:24:44.646 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-26T12:24:44.651 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T12:24:44.703 INFO:teuthology.orchestra.run.smithi115.stdout:(133/137): openssl-1.1.1k-12.el8.x86_64.rpm 2.9 MB/s | 738 kB 00:00 2024-04-26T12:24:44.770 INFO:teuthology.orchestra.run.smithi115.stdout:(134/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 5.9 MB/s | 1.5 MB 00:00 2024-04-26T12:24:44.829 INFO:teuthology.orchestra.run.smithi115.stdout:(135/137): util-linux-user-2.32.1-46.el8.x86_64 823 kB/s | 103 kB 00:00 2024-04-26T12:24:44.837 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T12:24:44.841 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-26T12:24:44.858 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-26T12:24:44.895 INFO:teuthology.orchestra.run.smithi115.stdout:(136/137): util-linux-2.32.1-46.el8.x86_64.rpm 7.4 MB/s | 2.6 MB 00:00 2024-04-26T12:24:44.991 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T12:24:45.014 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-26T12:24:45.046 INFO:teuthology.orchestra.run.smithi115.stdout:(137/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 3.9 MB/s | 1.1 MB 00:00 2024-04-26T12:24:45.051 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-26T12:24:45.051 INFO:teuthology.orchestra.run.smithi115.stdout:Total 14 MB/s | 207 MB 00:14 2024-04-26T12:24:45.095 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T12:24:45.194 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T12:24:45.249 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T12:24:45.418 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T12:24:45.444 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T12:24:45.595 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T12:24:45.606 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T12:24:45.732 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T12:24:45.836 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T12:24:45.855 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T12:24:45.878 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-26T12:24:46.097 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-26T12:24:46.231 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T12:24:46.237 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T12:24:46.281 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-26T12:24:46.332 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-26T12:24:46.332 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-26T12:24:46.399 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T12:24:46.403 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T12:24:46.444 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T12:24:46.563 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T12:24:46.576 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T12:24:46.736 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T12:24:46.757 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T12:24:46.816 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T12:24:47.140 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T12:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T12:24:47.363 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-26T12:24:47.399 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T12:24:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-26T12:24:47.564 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-26T12:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T12:24:47.676 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-26T12:24:47.709 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-26T12:24:47.713 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-26T12:24:47.790 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-26T12:24:47.825 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-26T12:24:47.918 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T12:24:48.017 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-26T12:24:48.020 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T12:24:48.177 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T12:24:48.193 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/152 2024-04-26T12:24:48.278 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T12:24:48.356 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/152 2024-04-26T12:24:48.381 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T12:24:48.448 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T12:24:48.594 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/152 2024-04-26T12:24:48.610 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T12:24:48.719 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T12:24:48.924 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-26T12:24:49.098 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-26T12:24:49.218 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T12:24:49.285 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T12:24:49.410 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T12:24:49.547 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-26T12:24:49.560 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T12:24:49.624 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-26T12:24:49.731 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-26T12:24:49.920 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-26T12:24:49.976 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-26T12:24:50.158 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T12:24:50.165 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-26T12:24:50.254 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-26T12:24:50.385 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T12:24:50.402 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T12:24:50.505 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/152 2024-04-26T12:24:50.678 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/152 2024-04-26T12:24:50.944 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/152 2024-04-26T12:24:51.002 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T12:24:51.210 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T12:24:51.910 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T12:24:52.028 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-26T12:24:52.270 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T12:24:52.372 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-26T12:24:52.436 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-26T12:24:52.601 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-26T12:24:52.657 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-26T12:24:52.664 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-26T12:24:52.773 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-26T12:24:52.789 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-26T12:24:52.804 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-26T12:24:52.952 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-26T12:24:52.984 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-26T12:24:53.010 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-26T12:24:53.164 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-26T12:24:53.171 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T12:24:53.232 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/152 2024-04-26T12:24:53.273 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T12:24:53.376 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-26T12:24:53.391 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T12:24:53.421 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/152 2024-04-26T12:24:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 41/152 2024-04-26T12:24:53.638 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/152 2024-04-26T12:24:53.651 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-26T12:24:53.722 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 42/152 2024-04-26T12:24:53.795 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T12:24:53.868 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T12:24:53.927 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T12:24:54.003 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T12:24:54.079 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T12:24:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T12:24:54.168 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T12:24:54.237 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T12:24:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-26T12:24:54.418 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-26T12:24:54.598 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-26T12:24:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-26T12:24:54.635 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-26T12:24:54.760 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T12:24:54.791 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-26T12:24:54.945 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T12:24:54.979 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-26T12:24:55.196 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T12:24:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-26T12:24:55.306 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T12:24:55.346 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T12:24:55.408 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T12:24:55.537 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-26T12:24:55.553 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T12:24:55.560 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T12:24:55.576 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T12:24:55.716 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-26T12:24:55.764 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-26T12:24:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T12:24:55.955 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-26T12:24:56.008 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-26T12:24:56.136 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T12:24:56.187 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-26T12:24:56.235 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-26T12:24:56.273 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T12:24:56.413 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-26T12:24:56.414 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-26T12:24:56.478 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T12:24:56.560 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T12:24:56.579 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-26T12:24:56.580 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 41/152 2024-04-26T12:24:56.753 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T12:24:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-26T12:24:56.774 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 42/152 2024-04-26T12:24:56.973 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-26T12:24:56.989 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T12:24:56.990 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-26T12:24:57.071 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T12:24:57.191 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T12:24:57.206 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-26T12:24:57.214 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-26T12:24:57.272 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T12:24:57.339 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T12:24:57.532 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-26T12:24:57.599 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-26T12:24:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-26T12:24:57.720 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-26T12:24:57.726 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-26T12:24:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T12:24:57.830 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T12:24:57.908 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-26T12:24:57.934 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-26T12:24:57.939 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T12:24:57.995 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T12:24:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-26T12:24:58.149 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-26T12:24:58.195 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T12:24:58.265 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-26T12:24:58.312 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-26T12:24:58.426 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-26T12:24:58.444 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T12:24:58.513 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T12:24:58.516 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-26T12:24:58.563 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T12:24:58.593 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-26T12:24:58.689 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 41/152 2024-04-26T12:24:58.781 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T12:24:58.792 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-26T12:24:58.795 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-26T12:24:58.797 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T12:24:58.892 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 42/152 2024-04-26T12:24:58.966 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-26T12:24:58.994 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-26T12:24:59.009 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-26T12:24:59.091 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T12:24:59.094 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T12:24:59.168 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T12:24:59.233 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T12:24:59.238 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-26T12:24:59.247 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-26T12:24:59.349 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T12:24:59.386 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T12:24:59.419 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T12:24:59.488 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-26T12:24:59.595 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-26T12:24:59.614 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-26T12:24:59.660 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-26T12:24:59.811 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-26T12:24:59.826 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-26T12:24:59.859 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-26T12:24:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T12:24:59.991 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T12:25:00.038 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-26T12:25:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-26T12:25:00.169 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T12:25:00.345 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-26T12:25:00.477 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T12:25:00.578 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-26T12:25:00.724 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T12:25:00.725 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-26T12:25:00.742 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T12:25:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T12:25:00.809 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-26T12:25:00.910 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-26T12:25:00.920 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-26T12:25:00.951 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T12:25:00.969 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T12:25:01.041 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T12:25:01.135 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-26T12:25:01.174 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-26T12:25:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 71/152 2024-04-26T12:25:01.328 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-26T12:25:01.389 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-26T12:25:01.432 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-26T12:25:01.489 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-26T12:25:01.562 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-26T12:25:01.655 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-26T12:25:01.685 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T12:25:01.697 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-26T12:25:01.726 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-26T12:25:01.915 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-26T12:25:01.943 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-26T12:25:01.994 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-26T12:25:02.015 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-26T12:25:02.135 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-26T12:25:02.216 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-26T12:25:02.225 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-26T12:25:02.309 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-26T12:25:02.321 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-26T12:25:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-26T12:25:02.461 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-26T12:25:02.468 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-26T12:25:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-26T12:25:02.603 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-26T12:25:02.621 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-26T12:25:02.736 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-26T12:25:02.800 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/152 2024-04-26T12:25:02.803 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-26T12:25:02.846 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-26T12:25:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/152 2024-04-26T12:25:02.979 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-26T12:25:03.033 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-26T12:25:03.149 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-26T12:25:03.173 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-26T12:25:03.187 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/152 2024-04-26T12:25:03.306 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-26T12:25:03.350 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-26T12:25:03.516 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-26T12:25:03.765 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-26T12:25:03.984 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-26T12:25:04.130 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-26T12:25:04.171 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-26T12:25:04.237 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-26T12:25:04.326 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-26T12:25:04.413 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T12:25:04.484 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-26T12:25:04.491 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T12:25:04.515 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-26T12:25:04.540 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-26T12:25:04.691 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 71/152 2024-04-26T12:25:04.700 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-26T12:25:04.757 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-26T12:25:04.805 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-26T12:25:04.931 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-26T12:25:04.937 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-26T12:25:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T12:25:05.171 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-26T12:25:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-26T12:25:05.468 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-26T12:25:05.544 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-26T12:25:05.563 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-26T12:25:05.698 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T12:25:05.721 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-26T12:25:05.766 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T12:25:05.867 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-26T12:25:05.938 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-26T12:25:05.999 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 71/152 2024-04-26T12:25:06.075 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-26T12:25:06.218 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-26T12:25:06.266 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-26T12:25:06.357 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-26T12:25:06.441 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-26T12:25:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-26T12:25:06.602 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-26T12:25:06.621 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-26T12:25:06.776 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T12:25:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-26T12:25:06.803 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-26T12:25:07.054 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-26T12:25:07.086 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-26T12:25:07.103 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-26T12:25:07.218 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-26T12:25:07.249 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-26T12:25:07.329 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-26T12:25:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-26T12:25:07.465 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-26T12:25:07.559 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-26T12:25:07.653 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-26T12:25:07.668 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-26T12:25:07.773 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-26T12:25:07.812 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-26T12:25:07.880 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-26T12:25:07.901 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-26T12:25:08.072 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 41/152 2024-04-26T12:25:08.110 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-26T12:25:08.170 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-26T12:25:08.306 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 42/152 2024-04-26T12:25:08.309 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-26T12:25:08.387 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-26T12:25:08.467 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-26T12:25:08.500 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T12:25:08.575 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T12:25:08.625 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-26T12:25:08.759 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T12:25:08.809 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T12:25:08.834 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-26T12:25:08.967 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-26T12:25:09.012 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-26T12:25:09.194 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-26T12:25:09.206 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-26T12:25:09.207 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-26T12:25:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T12:25:09.413 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-26T12:25:09.542 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-26T12:25:09.638 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-26T12:25:09.776 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-26T12:25:09.887 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T12:25:09.928 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-26T12:25:10.134 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T12:25:10.148 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T12:25:10.154 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-26T12:25:10.156 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-26T12:25:10.327 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-26T12:25:10.368 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-26T12:25:10.416 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-26T12:25:10.540 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-26T12:25:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-26T12:25:10.650 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-26T12:25:10.704 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-26T12:25:10.792 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-26T12:25:10.971 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-26T12:25:11.023 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T12:25:11.032 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-26T12:25:11.065 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-26T12:25:11.118 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-26T12:25:11.235 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-26T12:25:11.241 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T12:25:11.281 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-26T12:25:11.334 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-26T12:25:11.383 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-26T12:25:11.485 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-26T12:25:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-26T12:25:11.569 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-26T12:25:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-26T12:25:11.733 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-26T12:25:11.838 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T12:25:11.861 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-26T12:25:11.865 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-26T12:25:11.973 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-26T12:25:12.014 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-26T12:25:12.101 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-26T12:25:12.130 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T12:25:12.179 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-26T12:25:12.199 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-26T12:25:12.237 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T12:25:12.251 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-26T12:25:12.364 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-26T12:25:12.414 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-26T12:25:12.415 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T12:25:12.488 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-26T12:25:12.524 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-26T12:25:12.546 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-26T12:25:12.699 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-26T12:25:12.815 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-26T12:25:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-26T12:25:13.015 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-26T12:25:13.122 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-26T12:25:13.247 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-26T12:25:13.335 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-26T12:25:13.397 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-26T12:25:13.651 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-26T12:25:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-26T12:25:14.110 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-26T12:25:14.898 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-26T12:25:15.074 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T12:25:15.146 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T12:25:15.325 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T12:25:15.358 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 71/152 2024-04-26T12:25:15.561 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-26T12:25:15.580 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T12:25:15.767 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-26T12:25:15.911 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T12:25:16.130 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T12:25:16.137 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-26T12:25:16.226 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T12:25:16.427 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-26T12:25:16.595 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T12:25:16.642 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-26T12:25:16.694 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T12:25:16.728 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T12:25:16.886 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-26T12:25:16.911 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T12:25:17.036 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T12:25:17.153 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-26T12:25:17.165 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T12:25:17.362 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T12:25:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-26T12:25:18.572 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-26T12:25:18.781 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-26T12:25:19.016 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-26T12:25:19.337 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-26T12:25:19.590 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-26T12:25:19.861 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-26T12:25:20.103 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-26T12:25:20.451 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-26T12:25:20.644 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-26T12:25:20.791 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-26T12:25:21.011 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-26T12:25:21.300 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-26T12:25:21.518 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-26T12:25:21.659 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-26T12:25:21.860 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-26T12:25:22.081 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-26T12:25:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-26T12:25:22.455 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-26T12:25:22.606 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-26T12:25:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T12:25:25.397 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T12:25:26.012 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T12:25:26.355 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T12:25:26.461 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T12:25:26.654 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T12:25:31.804 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T12:25:31.804 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-04-26T12:25:31.804 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-04-26T12:25:31.804 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /dev 2024-04-26T12:25:31.804 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /run 2024-04-26T12:25:31.804 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-04-26T12:25:31.804 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-04-26T12:25:31.804 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-04-26T12:25:31.804 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-04-26T12:25:31.805 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /dev 2024-04-26T12:25:31.805 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:25:32.164 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T12:25:33.803 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T12:25:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T12:25:34.228 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T12:25:34.404 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T12:25:34.879 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T12:25:35.095 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T12:25:35.120 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T12:25:35.338 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-26T12:25:35.532 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-26T12:25:35.678 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T12:25:35.969 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T12:25:36.270 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-26T12:25:36.503 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-26T12:25:36.767 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T12:25:36.767 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2024-04-26T12:25:36.767 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2024-04-26T12:25:36.767 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /dev 2024-04-26T12:25:36.767 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /run 2024-04-26T12:25:36.767 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2024-04-26T12:25:36.767 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2024-04-26T12:25:36.767 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2024-04-26T12:25:36.767 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2024-04-26T12:25:36.767 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /dev 2024-04-26T12:25:36.767 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:25:37.019 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T12:25:37.144 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T12:25:37.144 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-04-26T12:25:37.144 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-04-26T12:25:37.144 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /dev 2024-04-26T12:25:37.144 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /run 2024-04-26T12:25:37.145 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-04-26T12:25:37.145 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-04-26T12:25:37.145 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-04-26T12:25:37.145 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-04-26T12:25:37.145 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /dev 2024-04-26T12:25:37.145 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:25:37.167 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T12:25:37.195 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T12:25:37.301 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 112/152 2024-04-26T12:25:37.481 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 113/152 2024-04-26T12:25:37.526 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T12:25:37.719 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T12:25:38.763 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T12:25:38.823 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T12:25:39.000 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T12:25:39.031 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T12:25:39.250 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T12:25:39.285 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T12:25:39.433 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T12:25:39.500 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T12:25:39.732 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T12:25:39.912 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T12:25:39.926 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T12:25:39.969 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T12:25:40.107 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T12:25:40.131 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T12:25:40.146 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T12:25:40.251 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T12:25:40.356 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-26T12:25:40.430 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T12:25:40.551 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-26T12:25:40.620 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 117/152 2024-04-26T12:25:40.642 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T12:25:40.667 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T12:25:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T12:25:40.784 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T12:25:40.834 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T12:25:40.873 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T12:25:40.916 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-26T12:25:41.044 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T12:25:41.055 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T12:25:41.060 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-26T12:25:41.154 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-26T12:25:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 120/152 2024-04-26T12:25:41.274 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-26T12:25:41.342 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T12:25:41.377 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T12:25:41.422 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T12:25:41.711 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-26T12:25:41.777 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T12:25:41.942 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-26T12:25:41.958 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T12:25:42.071 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 112/152 2024-04-26T12:25:42.273 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 113/152 2024-04-26T12:25:42.473 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T12:25:42.564 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T12:25:42.762 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T12:25:42.894 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 112/152 2024-04-26T12:25:43.099 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 113/152 2024-04-26T12:25:43.325 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T12:25:43.490 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T12:25:43.738 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T12:25:44.423 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T12:25:44.674 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T12:25:44.707 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T12:25:44.915 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T12:25:45.007 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T12:25:45.393 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 117/152 2024-04-26T12:25:45.613 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T12:25:45.650 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T12:25:45.701 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T12:25:45.831 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T12:25:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T12:25:45.842 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T12:25:45.908 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T12:25:46.006 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T12:25:46.013 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T12:25:46.013 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /sys 2024-04-26T12:25:46.014 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /proc 2024-04-26T12:25:46.014 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /dev 2024-04-26T12:25:46.014 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /run 2024-04-26T12:25:46.014 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /mnt 2024-04-26T12:25:46.014 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /var/tmp 2024-04-26T12:25:46.014 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /home 2024-04-26T12:25:46.014 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /tmp 2024-04-26T12:25:46.014 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /dev 2024-04-26T12:25:46.014 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:25:46.020 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 120/152 2024-04-26T12:25:46.172 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T12:25:46.379 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 117/152 2024-04-26T12:25:46.386 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T12:25:46.575 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T12:25:46.613 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T12:25:46.816 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T12:25:46.827 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T12:25:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 120/152 2024-04-26T12:25:47.216 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T12:25:47.278 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/152 2024-04-26T12:25:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T12:25:47.508 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T12:25:47.701 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T12:25:48.029 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T12:25:48.047 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T12:25:48.235 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T12:25:48.250 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T12:25:48.327 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T12:25:48.468 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T12:25:48.650 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T12:25:49.123 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T12:25:49.229 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/152 2024-04-26T12:25:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T12:25:49.356 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T12:25:49.550 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-26T12:25:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-26T12:25:49.732 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-26T12:25:49.777 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-26T12:25:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-26T12:25:49.958 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T12:25:50.040 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T12:25:50.106 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-26T12:25:50.311 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-26T12:25:50.327 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 131/152 2024-04-26T12:25:50.527 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/152 2024-04-26T12:25:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-26T12:25:50.689 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T12:25:50.836 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 133/152 2024-04-26T12:25:51.082 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T12:25:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-26T12:25:51.244 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T12:25:51.315 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-26T12:25:51.347 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 112/152 2024-04-26T12:25:51.533 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 113/152 2024-04-26T12:25:51.542 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T12:25:51.630 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T12:25:51.765 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T12:25:51.895 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T12:25:51.917 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T12:25:51.994 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T12:25:52.094 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-26T12:25:52.095 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/152 2024-04-26T12:25:52.253 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-26T12:25:52.269 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T12:25:52.303 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T12:25:52.460 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-26T12:25:52.461 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T12:25:52.471 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T12:25:52.722 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T12:25:52.722 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T12:25:52.779 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T12:25:52.822 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T12:25:52.939 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T12:25:52.939 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T12:25:52.997 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T12:25:53.032 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T12:25:53.090 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T12:25:53.222 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T12:25:53.391 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-26T12:25:53.516 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/152 2024-04-26T12:25:53.602 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-26T12:25:53.602 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T12:25:53.699 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T12:25:53.734 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T12:25:53.787 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T12:25:53.787 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T12:25:53.948 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/152 2024-04-26T12:25:53.949 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T12:25:53.993 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T12:25:54.002 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T12:25:54.003 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T12:25:54.192 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T12:25:54.219 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T12:25:54.220 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T12:25:54.242 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-26T12:25:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T12:25:54.318 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T12:25:54.419 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T12:25:54.419 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T12:25:54.434 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-26T12:25:54.474 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T12:25:54.571 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T12:25:54.614 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T12:25:54.614 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T12:25:54.648 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-26T12:25:54.668 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 117/152 2024-04-26T12:25:54.816 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-26T12:25:54.867 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T12:25:54.891 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T12:25:54.927 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T12:25:55.004 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 131/152 2024-04-26T12:25:55.059 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T12:25:55.123 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T12:25:55.134 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T12:25:55.204 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/152 2024-04-26T12:25:55.312 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 120/152 2024-04-26T12:25:55.473 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T12:25:55.500 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 133/152 2024-04-26T12:25:55.551 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/152 2024-04-26T12:25:55.652 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T12:25:55.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/152 2024-04-26T12:25:55.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/152 2024-04-26T12:25:55.652 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/152 2024-04-26T12:25:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/152 2024-04-26T12:25:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/152 2024-04-26T12:25:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/152 2024-04-26T12:25:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/152 2024-04-26T12:25:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/152 2024-04-26T12:25:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T12:25:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T12:25:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T12:25:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T12:25:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/152 2024-04-26T12:25:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/152 2024-04-26T12:25:55.653 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/152 2024-04-26T12:25:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/152 2024-04-26T12:25:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T12:25:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/152 2024-04-26T12:25:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/152 2024-04-26T12:25:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/152 2024-04-26T12:25:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/152 2024-04-26T12:25:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/152 2024-04-26T12:25:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/152 2024-04-26T12:25:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/152 2024-04-26T12:25:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/152 2024-04-26T12:25:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/152 2024-04-26T12:25:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/152 2024-04-26T12:25:55.654 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/152 2024-04-26T12:25:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/152 2024-04-26T12:25:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/152 2024-04-26T12:25:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/152 2024-04-26T12:25:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/152 2024-04-26T12:25:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/152 2024-04-26T12:25:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/152 2024-04-26T12:25:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/152 2024-04-26T12:25:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/152 2024-04-26T12:25:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-26T12:25:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-26T12:25:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-26T12:25:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-26T12:25:55.655 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-26T12:25:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-26T12:25:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-26T12:25:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-26T12:25:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-26T12:25:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-26T12:25:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-26T12:25:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-26T12:25:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-26T12:25:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-26T12:25:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-26T12:25:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-26T12:25:55.656 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-26T12:25:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-26T12:25:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-26T12:25:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-26T12:25:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-26T12:25:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-26T12:25:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-26T12:25:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-26T12:25:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-26T12:25:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-26T12:25:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-26T12:25:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-26T12:25:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-26T12:25:55.657 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-26T12:25:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-26T12:25:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-26T12:25:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-26T12:25:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 70/152 2024-04-26T12:25:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 71/152 2024-04-26T12:25:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-26T12:25:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-26T12:25:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-26T12:25:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-26T12:25:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-26T12:25:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-26T12:25:55.658 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-26T12:25:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-26T12:25:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-26T12:25:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-26T12:25:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-26T12:25:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-26T12:25:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-26T12:25:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-26T12:25:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-26T12:25:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-26T12:25:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-26T12:25:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-26T12:25:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-26T12:25:55.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-26T12:25:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-26T12:25:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-26T12:25:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-26T12:25:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-26T12:25:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-26T12:25:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-26T12:25:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-26T12:25:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-26T12:25:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-26T12:25:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-26T12:25:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-26T12:25:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-26T12:25:55.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-26T12:25:55.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-26T12:25:55.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-26T12:25:55.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-26T12:25:55.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-26T12:25:55.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-26T12:25:55.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-26T12:25:55.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-26T12:25:55.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-26T12:25:55.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-26T12:25:55.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-26T12:25:55.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-26T12:25:55.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-26T12:25:55.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-26T12:25:55.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-26T12:25:55.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-26T12:25:55.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-26T12:25:55.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-26T12:25:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-26T12:25:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T12:25:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-26T12:25:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T12:25:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-26T12:25:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-26T12:25:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-26T12:25:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-26T12:25:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-26T12:25:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-26T12:25:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-26T12:25:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-26T12:25:55.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-26T12:25:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-26T12:25:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-26T12:25:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-26T12:25:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-26T12:25:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-26T12:25:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-26T12:25:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-26T12:25:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-26T12:25:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-26T12:25:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-26T12:25:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-26T12:25:55.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-26T12:25:55.665 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-26T12:25:55.665 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-26T12:25:55.665 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-26T12:25:55.665 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-26T12:25:55.665 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-26T12:25:55.755 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-26T12:25:55.878 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-26T12:25:55.950 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-26T12:25:56.046 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-26T12:25:56.178 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T12:25:56.227 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-26T12:25:56.267 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T12:25:56.420 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-26T12:25:56.504 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T12:25:56.520 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T12:25:56.658 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 131/152 2024-04-26T12:25:56.672 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-26T12:25:56.842 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/152 2024-04-26T12:25:56.856 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-26T12:25:57.050 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-26T12:25:57.051 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T12:25:57.176 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 133/152 2024-04-26T12:25:57.282 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T12:25:57.282 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T12:25:57.458 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-26T12:25:57.499 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T12:25:57.499 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T12:25:57.503 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-26T12:25:57.503 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:25:57.503 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-04-26T12:25:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-26T12:25:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-26T12:25:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-26T12:25:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-26T12:25:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-26T12:25:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-26T12:25:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-26T12:25:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-26T12:25:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-26T12:25:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-26T12:25:57.504 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-26T12:25:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-26T12:25:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T12:25:57.505 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-26T12:25:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T12:25:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T12:25:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:25:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.505 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:25:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:25:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:25:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:25:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:25:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:25:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.506 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:25:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:25:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-26T12:25:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T12:25:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-26T12:25:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T12:25:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.6-8.el8.x86_64 2024-04-26T12:25:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T12:25:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-26T12:25:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T12:25:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-26T12:25:57.507 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-04-26T12:25:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T12:25:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-04-26T12:25:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T12:25:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T12:25:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-26T12:25:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T12:25:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T12:25:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T12:25:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-26T12:25:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-26T12:25:57.508 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T12:25:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T12:25:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-26T12:25:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-26T12:25:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-26T12:25:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-26T12:25:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-26T12:25:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-26T12:25:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-26T12:25:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T12:25:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T12:25:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T12:25:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T12:25:57.509 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T12:25:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T12:25:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T12:25:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T12:25:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T12:25:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T12:25:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T12:25:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T12:25:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T12:25:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-26T12:25:57.510 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T12:25:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T12:25:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T12:25:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T12:25:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T12:25:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T12:25:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T12:25:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T12:25:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T12:25:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T12:25:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T12:25:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T12:25:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T12:25:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T12:25:57.511 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T12:25:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T12:25:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T12:25:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T12:25:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T12:25:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T12:25:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T12:25:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T12:25:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T12:25:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T12:25:57.512 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:25:57.513 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T12:25:57.514 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T12:25:57.514 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T12:25:57.514 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T12:25:57.514 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-26T12:25:57.514 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:25:57.514 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-26T12:25:57.634 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-26T12:25:57.719 DEBUG:teuthology.parallel:result is None 2024-04-26T12:25:57.756 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T12:25:57.864 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T12:25:57.923 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-26T12:25:57.967 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T12:25:58.147 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-26T12:25:58.147 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T12:25:58.223 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T12:25:58.241 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T12:25:58.339 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T12:25:58.340 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T12:25:58.408 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-26T12:25:58.556 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T12:25:58.556 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T12:25:58.603 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-26T12:25:58.747 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T12:25:58.747 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T12:25:58.861 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-26T12:25:58.861 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T12:25:58.939 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T12:25:58.939 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T12:25:59.076 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T12:25:59.077 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T12:25:59.132 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T12:25:59.132 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T12:25:59.319 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T12:25:59.319 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T12:25:59.403 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T12:25:59.584 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T12:25:59.587 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T12:25:59.747 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-26T12:25:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T12:25:59.966 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-26T12:25:59.967 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T12:26:00.201 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T12:26:00.201 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T12:26:00.210 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T12:26:00.210 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/152 2024-04-26T12:26:00.211 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/152 2024-04-26T12:26:00.211 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/152 2024-04-26T12:26:00.211 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/152 2024-04-26T12:26:00.211 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/152 2024-04-26T12:26:00.211 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/152 2024-04-26T12:26:00.211 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/152 2024-04-26T12:26:00.211 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/152 2024-04-26T12:26:00.211 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T12:26:00.212 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T12:26:00.212 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T12:26:00.212 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T12:26:00.212 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/152 2024-04-26T12:26:00.212 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/152 2024-04-26T12:26:00.212 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/152 2024-04-26T12:26:00.212 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/152 2024-04-26T12:26:00.212 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T12:26:00.212 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/152 2024-04-26T12:26:00.212 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/152 2024-04-26T12:26:00.212 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/152 2024-04-26T12:26:00.212 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/152 2024-04-26T12:26:00.213 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/152 2024-04-26T12:26:00.213 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/152 2024-04-26T12:26:00.213 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/152 2024-04-26T12:26:00.213 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/152 2024-04-26T12:26:00.213 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/152 2024-04-26T12:26:00.213 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/152 2024-04-26T12:26:00.213 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/152 2024-04-26T12:26:00.213 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/152 2024-04-26T12:26:00.213 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/152 2024-04-26T12:26:00.213 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/152 2024-04-26T12:26:00.214 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/152 2024-04-26T12:26:00.214 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/152 2024-04-26T12:26:00.214 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/152 2024-04-26T12:26:00.214 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/152 2024-04-26T12:26:00.214 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/152 2024-04-26T12:26:00.214 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-26T12:26:00.214 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-26T12:26:00.214 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-26T12:26:00.214 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-26T12:26:00.214 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-26T12:26:00.214 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-26T12:26:00.214 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-26T12:26:00.215 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-26T12:26:00.215 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-26T12:26:00.215 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-26T12:26:00.215 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-26T12:26:00.215 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-26T12:26:00.215 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-26T12:26:00.215 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-26T12:26:00.215 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-26T12:26:00.215 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-26T12:26:00.215 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-26T12:26:00.215 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-26T12:26:00.215 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-26T12:26:00.215 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-26T12:26:00.216 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-26T12:26:00.216 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-26T12:26:00.216 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-26T12:26:00.216 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-26T12:26:00.216 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-26T12:26:00.216 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-26T12:26:00.216 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-26T12:26:00.216 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-26T12:26:00.216 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-26T12:26:00.216 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-26T12:26:00.216 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-26T12:26:00.216 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-26T12:26:00.216 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-26T12:26:00.216 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 70/152 2024-04-26T12:26:00.217 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 71/152 2024-04-26T12:26:00.217 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-26T12:26:00.217 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-26T12:26:00.217 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-26T12:26:00.217 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-26T12:26:00.217 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-26T12:26:00.217 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-26T12:26:00.217 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-26T12:26:00.217 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-26T12:26:00.217 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-26T12:26:00.217 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-26T12:26:00.218 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-26T12:26:00.218 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-26T12:26:00.218 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-26T12:26:00.218 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-26T12:26:00.218 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-26T12:26:00.218 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-26T12:26:00.218 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-26T12:26:00.219 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-26T12:26:00.219 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-26T12:26:00.219 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-26T12:26:00.219 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-26T12:26:00.219 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-26T12:26:00.219 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-26T12:26:00.219 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-26T12:26:00.219 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-26T12:26:00.219 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-26T12:26:00.219 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-26T12:26:00.219 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-26T12:26:00.219 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-26T12:26:00.220 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-26T12:26:00.220 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-26T12:26:00.220 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-26T12:26:00.220 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-26T12:26:00.220 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-26T12:26:00.220 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-26T12:26:00.220 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-26T12:26:00.220 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-26T12:26:00.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-26T12:26:00.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-26T12:26:00.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-26T12:26:00.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-26T12:26:00.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-26T12:26:00.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-26T12:26:00.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-26T12:26:00.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-26T12:26:00.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-26T12:26:00.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-26T12:26:00.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-26T12:26:00.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-26T12:26:00.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-26T12:26:00.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-26T12:26:00.222 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T12:26:00.222 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-26T12:26:00.222 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T12:26:00.222 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-26T12:26:00.222 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-26T12:26:00.222 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-26T12:26:00.222 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-26T12:26:00.222 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-26T12:26:00.222 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-26T12:26:00.222 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-26T12:26:00.222 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-26T12:26:00.222 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-26T12:26:00.222 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-26T12:26:00.223 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-26T12:26:00.223 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-26T12:26:00.223 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-26T12:26:00.223 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-26T12:26:00.223 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-26T12:26:00.223 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-26T12:26:00.223 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-26T12:26:00.223 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-26T12:26:00.223 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-26T12:26:00.223 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-26T12:26:00.223 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-26T12:26:00.223 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-26T12:26:00.223 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-26T12:26:00.223 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-26T12:26:00.224 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-26T12:26:00.224 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-26T12:26:00.426 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T12:26:00.426 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T12:26:00.659 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T12:26:00.659 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T12:26:00.901 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T12:26:00.902 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T12:26:01.119 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T12:26:01.119 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T12:26:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/152 2024-04-26T12:26:01.425 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T12:26:01.581 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T12:26:01.616 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T12:26:01.633 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T12:26:01.839 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T12:26:01.996 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-26T12:26:01.996 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:01.996 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2024-04-26T12:26:01.996 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-26T12:26:01.996 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-26T12:26:01.996 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-26T12:26:01.997 INFO:teuthology.orchestra.run.smithi136.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-26T12:26:01.997 INFO:teuthology.orchestra.run.smithi136.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-26T12:26:01.997 INFO:teuthology.orchestra.run.smithi136.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-26T12:26:01.997 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:01.997 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:01.997 INFO:teuthology.orchestra.run.smithi136.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-26T12:26:01.997 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-26T12:26:01.997 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-26T12:26:01.997 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-26T12:26:01.997 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-26T12:26:01.997 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-26T12:26:01.998 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T12:26:01.998 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-04-26T12:26:01.998 INFO:teuthology.orchestra.run.smithi136.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T12:26:01.998 INFO:teuthology.orchestra.run.smithi136.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T12:26:01.998 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:01.998 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:01.998 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:01.998 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:01.998 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:01.998 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:01.998 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:01.998 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:01.999 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:01.999 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:01.999 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:01.999 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:01.999 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:01.999 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:01.999 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:01.999 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:01.999 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:01.999 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:01.999 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:01.999 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:01.999 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:02.000 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-26T12:26:02.000 INFO:teuthology.orchestra.run.smithi136.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T12:26:02.000 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-26T12:26:02.000 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T12:26:02.000 INFO:teuthology.orchestra.run.smithi136.stdout: jq-1.6-8.el8.x86_64 2024-04-26T12:26:02.000 INFO:teuthology.orchestra.run.smithi136.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T12:26:02.000 INFO:teuthology.orchestra.run.smithi136.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-26T12:26:02.000 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T12:26:02.000 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.000 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.000 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.001 INFO:teuthology.orchestra.run.smithi136.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-26T12:26:02.001 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-04-26T12:26:02.001 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T12:26:02.001 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-04-26T12:26:02.001 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T12:26:02.001 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.001 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.001 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T12:26:02.001 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.001 INFO:teuthology.orchestra.run.smithi136.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-26T12:26:02.001 INFO:teuthology.orchestra.run.smithi136.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T12:26:02.001 INFO:teuthology.orchestra.run.smithi136.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T12:26:02.002 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T12:26:02.002 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-26T12:26:02.002 INFO:teuthology.orchestra.run.smithi136.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-26T12:26:02.002 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T12:26:02.002 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T12:26:02.002 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-26T12:26:02.002 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-26T12:26:02.002 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-26T12:26:02.002 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-26T12:26:02.002 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-26T12:26:02.002 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-26T12:26:02.002 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-26T12:26:02.002 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T12:26:02.003 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T12:26:02.003 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T12:26:02.003 INFO:teuthology.orchestra.run.smithi136.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T12:26:02.003 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T12:26:02.003 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.003 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.003 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.003 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T12:26:02.003 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T12:26:02.003 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T12:26:02.003 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T12:26:02.003 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T12:26:02.003 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T12:26:02.004 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T12:26:02.004 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T12:26:02.004 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-26T12:26:02.004 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T12:26:02.004 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T12:26:02.004 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T12:26:02.004 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T12:26:02.004 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T12:26:02.004 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T12:26:02.004 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T12:26:02.004 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T12:26:02.004 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T12:26:02.004 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T12:26:02.005 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T12:26:02.005 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T12:26:02.005 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T12:26:02.005 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T12:26:02.005 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T12:26:02.005 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T12:26:02.005 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T12:26:02.005 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T12:26:02.005 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T12:26:02.005 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T12:26:02.005 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T12:26:02.005 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.005 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.005 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T12:26:02.006 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T12:26:02.006 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.006 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T12:26:02.006 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T12:26:02.006 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-26T12:26:02.006 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T12:26:02.006 INFO:teuthology.orchestra.run.smithi136.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T12:26:02.006 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T12:26:02.006 INFO:teuthology.orchestra.run.smithi136.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T12:26:02.006 INFO:teuthology.orchestra.run.smithi136.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T12:26:02.006 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T12:26:02.006 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T12:26:02.006 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T12:26:02.007 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T12:26:02.007 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T12:26:02.007 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.007 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.007 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:02.007 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T12:26:02.007 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T12:26:02.007 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T12:26:02.007 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T12:26:02.008 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-26T12:26:02.008 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:02.008 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-04-26T12:26:02.184 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T12:26:02.196 DEBUG:teuthology.parallel:result is None 2024-04-26T12:26:02.217 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T12:26:02.217 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/152 2024-04-26T12:26:02.217 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/152 2024-04-26T12:26:02.217 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/152 2024-04-26T12:26:02.217 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/152 2024-04-26T12:26:02.217 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/152 2024-04-26T12:26:02.217 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/152 2024-04-26T12:26:02.217 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/152 2024-04-26T12:26:02.218 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/152 2024-04-26T12:26:02.218 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T12:26:02.218 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T12:26:02.218 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T12:26:02.218 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T12:26:02.218 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/152 2024-04-26T12:26:02.218 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/152 2024-04-26T12:26:02.218 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/152 2024-04-26T12:26:02.218 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/152 2024-04-26T12:26:02.218 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T12:26:02.218 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/152 2024-04-26T12:26:02.218 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/152 2024-04-26T12:26:02.219 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/152 2024-04-26T12:26:02.219 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/152 2024-04-26T12:26:02.219 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/152 2024-04-26T12:26:02.219 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/152 2024-04-26T12:26:02.219 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/152 2024-04-26T12:26:02.219 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/152 2024-04-26T12:26:02.219 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/152 2024-04-26T12:26:02.219 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/152 2024-04-26T12:26:02.234 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/152 2024-04-26T12:26:02.234 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/152 2024-04-26T12:26:02.234 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/152 2024-04-26T12:26:02.234 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/152 2024-04-26T12:26:02.235 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/152 2024-04-26T12:26:02.235 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/152 2024-04-26T12:26:02.235 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/152 2024-04-26T12:26:02.235 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/152 2024-04-26T12:26:02.235 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/152 2024-04-26T12:26:02.235 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-26T12:26:02.235 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-26T12:26:02.235 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-26T12:26:02.235 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-26T12:26:02.235 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-26T12:26:02.235 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-26T12:26:02.235 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-26T12:26:02.235 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-26T12:26:02.236 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-26T12:26:02.236 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-26T12:26:02.236 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-26T12:26:02.236 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-26T12:26:02.236 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-26T12:26:02.236 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-26T12:26:02.236 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-26T12:26:02.236 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-26T12:26:02.236 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-26T12:26:02.236 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-26T12:26:02.237 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-26T12:26:02.237 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-26T12:26:02.237 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-26T12:26:02.237 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-26T12:26:02.237 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-26T12:26:02.237 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-26T12:26:02.237 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-26T12:26:02.237 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-26T12:26:02.237 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-26T12:26:02.237 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-26T12:26:02.237 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-26T12:26:02.237 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-26T12:26:02.238 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-26T12:26:02.238 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-26T12:26:02.238 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-26T12:26:02.238 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 70/152 2024-04-26T12:26:02.238 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 71/152 2024-04-26T12:26:02.238 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-26T12:26:02.238 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-26T12:26:02.238 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-26T12:26:02.238 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-26T12:26:02.238 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-26T12:26:02.238 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-26T12:26:02.238 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-26T12:26:02.239 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-26T12:26:02.239 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-26T12:26:02.239 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-26T12:26:02.239 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-26T12:26:02.239 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-26T12:26:02.239 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-26T12:26:02.239 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-26T12:26:02.239 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-26T12:26:02.239 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-26T12:26:02.239 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-26T12:26:02.239 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-26T12:26:02.239 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-26T12:26:02.239 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-26T12:26:02.240 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-26T12:26:02.240 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-26T12:26:02.240 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-26T12:26:02.240 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-26T12:26:02.240 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-26T12:26:02.240 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-26T12:26:02.240 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-26T12:26:02.240 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-26T12:26:02.240 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-26T12:26:02.240 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-26T12:26:02.240 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-26T12:26:02.240 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-26T12:26:02.240 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-26T12:26:02.241 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-26T12:26:02.241 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-26T12:26:02.241 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-26T12:26:02.241 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-26T12:26:02.241 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-26T12:26:02.241 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-26T12:26:02.241 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-26T12:26:02.241 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-26T12:26:02.241 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-26T12:26:02.241 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-26T12:26:02.241 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-26T12:26:02.241 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-26T12:26:02.241 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-26T12:26:02.241 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-26T12:26:02.242 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-26T12:26:02.242 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-26T12:26:02.242 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-26T12:26:02.242 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-26T12:26:02.242 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T12:26:02.242 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-26T12:26:02.242 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T12:26:02.242 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-26T12:26:02.242 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-26T12:26:02.242 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-26T12:26:02.242 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-26T12:26:02.242 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-26T12:26:02.243 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-26T12:26:02.243 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-26T12:26:02.243 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-26T12:26:02.243 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-26T12:26:02.243 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-26T12:26:02.243 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-26T12:26:02.243 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-26T12:26:02.243 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-26T12:26:02.243 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-26T12:26:02.243 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-26T12:26:02.243 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-26T12:26:02.243 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-26T12:26:02.243 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-26T12:26:02.243 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-26T12:26:02.244 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-26T12:26:02.244 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-26T12:26:02.244 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-26T12:26:02.244 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-26T12:26:02.244 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-26T12:26:02.244 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-26T12:26:02.244 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-26T12:26:02.380 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T12:26:02.474 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T12:26:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/152 2024-04-26T12:26:03.636 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-26T12:26:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-26T12:26:04.024 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-26T12:26:04.182 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-26T12:26:04.183 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:04.183 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-04-26T12:26:04.183 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-26T12:26:04.183 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-26T12:26:04.183 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-26T12:26:04.183 INFO:teuthology.orchestra.run.smithi046.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-26T12:26:04.183 INFO:teuthology.orchestra.run.smithi046.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-26T12:26:04.183 INFO:teuthology.orchestra.run.smithi046.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-26T12:26:04.183 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.183 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.183 INFO:teuthology.orchestra.run.smithi046.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-26T12:26:04.183 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-26T12:26:04.184 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-26T12:26:04.184 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-26T12:26:04.184 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-26T12:26:04.184 INFO:teuthology.orchestra.run.smithi046.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-26T12:26:04.184 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T12:26:04.184 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-04-26T12:26:04.184 INFO:teuthology.orchestra.run.smithi046.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T12:26:04.184 INFO:teuthology.orchestra.run.smithi046.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T12:26:04.184 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.184 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.184 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.184 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.184 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:04.185 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.185 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.185 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.185 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:04.185 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:04.185 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:04.185 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:04.185 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:04.185 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.185 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.185 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:04.185 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.185 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.185 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.186 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:04.186 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:04.186 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-26T12:26:04.186 INFO:teuthology.orchestra.run.smithi046.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T12:26:04.186 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-26T12:26:04.186 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T12:26:04.186 INFO:teuthology.orchestra.run.smithi046.stdout: jq-1.6-8.el8.x86_64 2024-04-26T12:26:04.186 INFO:teuthology.orchestra.run.smithi046.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T12:26:04.186 INFO:teuthology.orchestra.run.smithi046.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-26T12:26:04.186 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T12:26:04.187 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.187 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.187 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.187 INFO:teuthology.orchestra.run.smithi046.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-26T12:26:04.187 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-04-26T12:26:04.187 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T12:26:04.187 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-04-26T12:26:04.187 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T12:26:04.187 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.187 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.187 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T12:26:04.187 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.187 INFO:teuthology.orchestra.run.smithi046.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-26T12:26:04.188 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T12:26:04.189 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T12:26:04.189 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T12:26:04.189 INFO:teuthology.orchestra.run.smithi046.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T12:26:04.189 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T12:26:04.189 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.189 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T12:26:04.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T12:26:04.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T12:26:04.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T12:26:04.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T12:26:04.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T12:26:04.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T12:26:04.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T12:26:04.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-26T12:26:04.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T12:26:04.190 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T12:26:04.191 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T12:26:04.191 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T12:26:04.191 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T12:26:04.191 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T12:26:04.191 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T12:26:04.191 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T12:26:04.191 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T12:26:04.191 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T12:26:04.191 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T12:26:04.191 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T12:26:04.191 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T12:26:04.191 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T12:26:04.191 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T12:26:04.192 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T12:26:04.192 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T12:26:04.192 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T12:26:04.192 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T12:26:04.192 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T12:26:04.192 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T12:26:04.192 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.192 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.192 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T12:26:04.192 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T12:26:04.192 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.192 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T12:26:04.192 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T12:26:04.192 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-26T12:26:04.193 INFO:teuthology.orchestra.run.smithi046.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T12:26:04.193 INFO:teuthology.orchestra.run.smithi046.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T12:26:04.193 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T12:26:04.193 INFO:teuthology.orchestra.run.smithi046.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T12:26:04.193 INFO:teuthology.orchestra.run.smithi046.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T12:26:04.193 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T12:26:04.193 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T12:26:04.193 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T12:26:04.193 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T12:26:04.193 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T12:26:04.193 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.193 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.193 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:04.193 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T12:26:04.194 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T12:26:04.194 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T12:26:04.194 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T12:26:04.194 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-26T12:26:04.194 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-26T12:26:04.194 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:04.194 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-04-26T12:26:04.380 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 131/152 2024-04-26T12:26:04.412 DEBUG:teuthology.parallel:result is None 2024-04-26T12:26:04.613 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/152 2024-04-26T12:26:04.902 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 133/152 2024-04-26T12:26:05.139 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-26T12:26:05.329 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-26T12:26:05.562 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T12:26:05.654 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T12:26:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T12:26:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T12:26:06.156 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-26T12:26:06.317 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-26T12:26:06.569 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-26T12:26:06.569 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T12:26:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T12:26:06.818 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T12:26:07.068 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T12:26:07.068 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T12:26:07.298 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T12:26:07.460 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-26T12:26:07.681 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-26T12:26:07.681 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T12:26:07.940 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T12:26:07.940 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T12:26:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T12:26:08.140 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T12:26:08.365 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T12:26:08.365 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T12:26:08.606 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T12:26:08.606 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T12:26:08.826 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T12:26:08.826 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T12:26:09.098 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T12:26:09.296 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T12:26:09.871 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T12:26:09.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/152 2024-04-26T12:26:09.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/152 2024-04-26T12:26:09.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/152 2024-04-26T12:26:09.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/152 2024-04-26T12:26:09.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/152 2024-04-26T12:26:09.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/152 2024-04-26T12:26:09.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/152 2024-04-26T12:26:09.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/152 2024-04-26T12:26:09.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T12:26:09.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T12:26:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T12:26:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T12:26:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/152 2024-04-26T12:26:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/152 2024-04-26T12:26:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/152 2024-04-26T12:26:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/152 2024-04-26T12:26:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T12:26:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/152 2024-04-26T12:26:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/152 2024-04-26T12:26:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/152 2024-04-26T12:26:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/152 2024-04-26T12:26:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/152 2024-04-26T12:26:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/152 2024-04-26T12:26:09.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/152 2024-04-26T12:26:09.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/152 2024-04-26T12:26:09.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/152 2024-04-26T12:26:09.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/152 2024-04-26T12:26:09.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/152 2024-04-26T12:26:09.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/152 2024-04-26T12:26:09.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/152 2024-04-26T12:26:09.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/152 2024-04-26T12:26:09.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/152 2024-04-26T12:26:09.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/152 2024-04-26T12:26:09.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/152 2024-04-26T12:26:09.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/152 2024-04-26T12:26:09.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/152 2024-04-26T12:26:09.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-26T12:26:09.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-26T12:26:09.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-26T12:26:09.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-26T12:26:09.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-26T12:26:09.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-26T12:26:09.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-26T12:26:09.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-26T12:26:09.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-26T12:26:09.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-26T12:26:09.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-26T12:26:09.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-26T12:26:09.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-26T12:26:09.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-26T12:26:09.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-26T12:26:09.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-26T12:26:09.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-26T12:26:09.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-26T12:26:09.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-26T12:26:09.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-26T12:26:09.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-26T12:26:09.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-26T12:26:09.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-26T12:26:09.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-26T12:26:09.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-26T12:26:09.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-26T12:26:09.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-26T12:26:09.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-26T12:26:09.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-26T12:26:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-26T12:26:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-26T12:26:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-26T12:26:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-26T12:26:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 70/152 2024-04-26T12:26:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 71/152 2024-04-26T12:26:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-26T12:26:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-26T12:26:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-26T12:26:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-26T12:26:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-26T12:26:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-26T12:26:09.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-26T12:26:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-26T12:26:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-26T12:26:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-26T12:26:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-26T12:26:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-26T12:26:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-26T12:26:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-26T12:26:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-26T12:26:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-26T12:26:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-26T12:26:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-26T12:26:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-26T12:26:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-26T12:26:09.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-26T12:26:09.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-26T12:26:09.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-26T12:26:09.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-26T12:26:09.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-26T12:26:09.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-26T12:26:09.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-26T12:26:09.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-26T12:26:09.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-26T12:26:09.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-26T12:26:09.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-26T12:26:09.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-26T12:26:09.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-26T12:26:09.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-26T12:26:09.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-26T12:26:09.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-26T12:26:09.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-26T12:26:09.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-26T12:26:09.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-26T12:26:09.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-26T12:26:09.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-26T12:26:09.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-26T12:26:09.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-26T12:26:09.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-26T12:26:09.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-26T12:26:09.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-26T12:26:09.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-26T12:26:09.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-26T12:26:09.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-26T12:26:09.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-26T12:26:09.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-26T12:26:09.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T12:26:09.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-26T12:26:09.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T12:26:09.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-26T12:26:09.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-26T12:26:09.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-26T12:26:09.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-26T12:26:09.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-26T12:26:09.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-26T12:26:09.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-26T12:26:09.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-26T12:26:09.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-26T12:26:09.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-26T12:26:09.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-26T12:26:09.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-26T12:26:09.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-26T12:26:09.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-26T12:26:09.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-26T12:26:09.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-26T12:26:09.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-26T12:26:09.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-26T12:26:09.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-26T12:26:09.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-26T12:26:09.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-26T12:26:09.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-26T12:26:09.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-26T12:26:09.882 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-26T12:26:09.882 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-26T12:26:09.882 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-26T12:26:11.690 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-26T12:26:11.690 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:11.691 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2024-04-26T12:26:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-26T12:26:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-26T12:26:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-26T12:26:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-26T12:26:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-26T12:26:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-26T12:26:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-26T12:26:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-26T12:26:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-26T12:26:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-26T12:26:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-26T12:26:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-26T12:26:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T12:26:11.692 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-26T12:26:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T12:26:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T12:26:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T12:26:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-26T12:26:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T12:26:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-26T12:26:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T12:26:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: jq-1.6-8.el8.x86_64 2024-04-26T12:26:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T12:26:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-26T12:26:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T12:26:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-26T12:26:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-04-26T12:26:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T12:26:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-04-26T12:26:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T12:26:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T12:26:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-26T12:26:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T12:26:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T12:26:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T12:26:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-26T12:26:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-26T12:26:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T12:26:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T12:26:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-26T12:26:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-26T12:26:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-26T12:26:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-26T12:26:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-26T12:26:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-26T12:26:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-26T12:26:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T12:26:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T12:26:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T12:26:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T12:26:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T12:26:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T12:26:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T12:26:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T12:26:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T12:26:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T12:26:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T12:26:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T12:26:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T12:26:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-26T12:26:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T12:26:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T12:26:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T12:26:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T12:26:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T12:26:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T12:26:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T12:26:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T12:26:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T12:26:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T12:26:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T12:26:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T12:26:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T12:26:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T12:26:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T12:26:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T12:26:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T12:26:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T12:26:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T12:26:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T12:26:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T12:26:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T12:26:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T12:26:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T12:26:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T12:26:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-26T12:26:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T12:26:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T12:26:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T12:26:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T12:26:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T12:26:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T12:26:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T12:26:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T12:26:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T12:26:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T12:26:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T12:26:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T12:26:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T12:26:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T12:26:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T12:26:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-26T12:26:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:11.702 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-26T12:26:11.916 DEBUG:teuthology.parallel:result is None 2024-04-26T12:26:11.916 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:26:12.067 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:26:12.096 INFO:teuthology.orchestra.run.smithi046.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T12:26:12.097 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T12:26:12.097 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:26:12.099 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:26:12.334 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:26:12.358 INFO:teuthology.orchestra.run.smithi115.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T12:26:12.358 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T12:26:12.358 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:26:12.360 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:26:12.501 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:26:12.530 INFO:teuthology.orchestra.run.smithi136.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T12:26:12.531 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T12:26:12.531 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:26:12.534 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T12:26:12.688 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T12:26:12.717 INFO:teuthology.orchestra.run.smithi142.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T12:26:12.717 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T12:26:12.717 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T12:26:12.719 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T12:26:12.719 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:26:12.720 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:26:12.757 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-26T12:26:12.757 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:26:12.787 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T12:26:12.787 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:26:12.823 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T12:26:12.823 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:26:12.859 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T12:26:12.859 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:26:12.859 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:26:12.892 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:26:12.963 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-26T12:26:12.963 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:26:12.989 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:26:13.055 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T12:26:13.055 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:26:13.088 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:26:13.160 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T12:26:13.160 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:26:13.193 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:26:13.262 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T12:26:13.263 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:26:13.263 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:26:13.296 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:26:13.368 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-26T12:26:13.368 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:26:13.395 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:26:13.463 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T12:26:13.463 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:26:13.495 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:26:13.566 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T12:26:13.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:26:13.598 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:26:13.669 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T12:26:13.669 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:26:13.669 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:26:13.702 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:26:13.774 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-26T12:26:13.774 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:26:13.801 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:26:13.868 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T12:26:13.869 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:26:13.903 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:26:13.974 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T12:26:13.975 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:26:14.007 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:26:14.076 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T12:26:14.160 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T12:26:14.160 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2024-04-26T12:26:14.162 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /var/log/ceph 2024-04-26T12:26:14.164 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /var/log/ceph 2024-04-26T12:26:14.167 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-04-26T12:26:14.197 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T12:26:14.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:26:14.237 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:26:14.239 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:26:14.241 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:26:14.270 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T12:26:14.270 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:26:14.311 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:26:14.313 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:26:14.316 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:26:14.355 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T12:26:14.356 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T12:26:14.356 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674214', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 1136, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6', 'targets': {'smithi046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOwiUwa+K6ig8SPG/Kd3AYUjMwkMv+5acMpb3doHsT8eZ8Z3FnGdgjKnv1M81bGxxiop4njqYAEaksLFSjscu9k=', 'smithi115.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOfLlFQTkys/5SxJPoTuyVXMw234mFIFOILuDi0HtTRbmibAow8NFk73M7b2P9HeNX8Gr+E+yGVZGGl+9zGoPSI=', 'smithi136.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNcYRQiHUj77ZXMgbNdzVt8hZOOsCKO/bHLcbZ0mv+tIXZcR08CxKWnyV6NZOTfCc2myZTPoflj44wCYWVvjGSg=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMyGMggjqH2VxO+mu8AaF0IUD0lpkVh5PIYW9tAeQiu4S6Pf6PCv11tL/AahwLWZ5eZuYTQ4FivSCotkWWP8XSk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T12:26:14.356 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:26:14.382 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:26:14.384 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:26:14.386 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:26:14.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:26:14.442 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:26:14.445 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:26:14.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:26:14.474 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-26T12:26:14.474 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:26:14.527 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:26:14.527 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2024-04-26T12:26:14.585 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:26:14.585 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:26:14.585 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 168660 Links: 1 2024-04-26T12:26:14.585 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:26:14.586 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:26:14.586 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-04-26 12:26:09.514434151 +0000 2024-04-26T12:26:14.586 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-04-26 12:22:58.656408231 +0000 2024-04-26T12:26:14.586 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-04-26 12:22:58.656408231 +0000 2024-04-26T12:26:14.586 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-04-26T12:26:14.586 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:26:14.651 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-04-26T12:26:14.651 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-04-26T12:26:14.651 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000259691 s, 2.0 MB/s 2024-04-26T12:26:14.652 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:26:14.711 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2024-04-26T12:26:14.768 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:26:14.769 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:26:14.769 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 161792 Links: 1 2024-04-26T12:26:14.769 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:26:14.769 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:26:14.769 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-04-26 12:26:09.514434151 +0000 2024-04-26T12:26:14.769 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-04-26 12:22:58.988402109 +0000 2024-04-26T12:26:14.769 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-04-26 12:22:58.988402109 +0000 2024-04-26T12:26:14.769 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-04-26T12:26:14.769 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:26:14.833 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-04-26T12:26:14.833 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-04-26T12:26:14.833 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000198295 s, 2.6 MB/s 2024-04-26T12:26:14.834 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:26:14.893 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2024-04-26T12:26:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:26:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:26:14.951 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 168782 Links: 1 2024-04-26T12:26:14.951 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:26:14.951 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:26:14.951 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-04-26 12:26:09.515434132 +0000 2024-04-26T12:26:14.951 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-04-26 12:22:59.321395964 +0000 2024-04-26T12:26:14.951 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-04-26 12:22:59.321395964 +0000 2024-04-26T12:26:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-04-26T12:26:14.952 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:26:15.016 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-04-26T12:26:15.016 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-04-26T12:26:15.016 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000162763 s, 3.1 MB/s 2024-04-26T12:26:15.017 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:26:15.076 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2024-04-26T12:26:15.133 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:26:15.133 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:26:15.133 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 6h/6d Inode: 168864 Links: 1 2024-04-26T12:26:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:26:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:26:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-04-26 12:26:09.515434132 +0000 2024-04-26T12:26:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-04-26 12:22:59.683389285 +0000 2024-04-26T12:26:15.134 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-04-26 12:22:59.683389285 +0000 2024-04-26T12:26:15.134 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-04-26T12:26:15.134 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:26:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-04-26T12:26:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-04-26T12:26:15.199 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000230903 s, 2.2 MB/s 2024-04-26T12:26:15.200 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:26:15.258 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T12:26:15.259 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T12:26:15.259 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:26:15.280 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:26:15.280 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-04-26T12:26:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:26:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:26:15.342 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 167207 Links: 1 2024-04-26T12:26:15.342 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:26:15.342 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:26:15.342 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-26 12:25:59.808124642 +0000 2024-04-26T12:26:15.342 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-26 12:22:58.670068889 +0000 2024-04-26T12:26:15.342 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-26 12:22:58.670068889 +0000 2024-04-26T12:26:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-04-26T12:26:15.343 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:26:15.411 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-26T12:26:15.411 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-26T12:26:15.411 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000224894 s, 2.3 MB/s 2024-04-26T12:26:15.412 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:26:15.473 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-04-26T12:26:15.533 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:26:15.533 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:26:15.533 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 165610 Links: 1 2024-04-26T12:26:15.533 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:26:15.533 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:26:15.533 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-26 12:25:59.808124642 +0000 2024-04-26T12:26:15.533 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-26 12:22:59.002061503 +0000 2024-04-26T12:26:15.533 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-26 12:22:59.002061503 +0000 2024-04-26T12:26:15.533 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-04-26T12:26:15.534 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:26:15.599 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-26T12:26:15.599 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-26T12:26:15.599 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000206169 s, 2.5 MB/s 2024-04-26T12:26:15.600 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:26:15.661 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-04-26T12:26:15.720 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:26:15.720 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:26:15.720 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 172050 Links: 1 2024-04-26T12:26:15.720 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:26:15.720 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:26:15.721 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-26 12:25:59.808124642 +0000 2024-04-26T12:26:15.721 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-26 12:22:59.333054140 +0000 2024-04-26T12:26:15.721 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-26 12:22:59.333054140 +0000 2024-04-26T12:26:15.721 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-04-26T12:26:15.722 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:26:15.787 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-26T12:26:15.787 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-26T12:26:15.787 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.00020273 s, 2.5 MB/s 2024-04-26T12:26:15.788 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:26:15.848 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-04-26T12:26:15.908 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:26:15.908 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:26:15.909 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 165723 Links: 1 2024-04-26T12:26:15.909 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:26:15.909 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:26:15.909 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-26 12:25:59.808124642 +0000 2024-04-26T12:26:15.909 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-26 12:22:59.692046154 +0000 2024-04-26T12:26:15.909 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-26 12:22:59.692046154 +0000 2024-04-26T12:26:15.910 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-04-26T12:26:15.910 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:26:15.976 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-26T12:26:15.976 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-26T12:26:15.976 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000244901 s, 2.1 MB/s 2024-04-26T12:26:15.977 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:26:16.037 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T12:26:16.037 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T12:26:16.037 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:26:16.059 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:26:16.059 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-04-26T12:26:16.121 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:26:16.121 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:26:16.121 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 170046 Links: 1 2024-04-26T12:26:16.121 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:26:16.121 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:26:16.121 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-26 12:25:55.287029687 +0000 2024-04-26T12:26:16.121 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-26 12:22:59.181998051 +0000 2024-04-26T12:26:16.121 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-26 12:22:59.181998051 +0000 2024-04-26T12:26:16.121 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2024-04-26T12:26:16.122 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:26:16.190 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-26T12:26:16.190 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-26T12:26:16.190 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000231639 s, 2.2 MB/s 2024-04-26T12:26:16.191 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:26:16.253 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-04-26T12:26:16.313 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:26:16.313 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:26:16.313 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 166684 Links: 1 2024-04-26T12:26:16.314 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:26:16.314 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:26:16.314 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-26 12:25:55.287029687 +0000 2024-04-26T12:26:16.314 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-26 12:22:59.520991528 +0000 2024-04-26T12:26:16.314 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-26 12:22:59.520991528 +0000 2024-04-26T12:26:16.314 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2024-04-26T12:26:16.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:26:16.382 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-26T12:26:16.382 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-26T12:26:16.382 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000219086 s, 2.3 MB/s 2024-04-26T12:26:16.383 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:26:16.444 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-04-26T12:26:16.504 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:26:16.504 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:26:16.504 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 166746 Links: 1 2024-04-26T12:26:16.504 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:26:16.504 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:26:16.504 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-26 12:25:55.287029687 +0000 2024-04-26T12:26:16.504 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-26 12:22:59.866984869 +0000 2024-04-26T12:26:16.504 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-26 12:22:59.866984869 +0000 2024-04-26T12:26:16.504 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2024-04-26T12:26:16.504 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:26:16.571 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-26T12:26:16.571 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-26T12:26:16.571 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000193329 s, 2.6 MB/s 2024-04-26T12:26:16.572 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:26:16.632 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-04-26T12:26:16.691 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:26:16.691 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:26:16.691 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 168690 Links: 1 2024-04-26T12:26:16.691 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:26:16.691 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T12:26:16.691 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-26 12:25:55.287029687 +0000 2024-04-26T12:26:16.691 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-26 12:23:00.234977788 +0000 2024-04-26T12:26:16.691 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-26 12:23:00.234977788 +0000 2024-04-26T12:26:16.691 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2024-04-26T12:26:16.692 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:26:16.758 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-26T12:26:16.758 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-26T12:26:16.758 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000236218 s, 2.2 MB/s 2024-04-26T12:26:16.759 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:26:16.818 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T12:26:16.818 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T12:26:16.818 INFO:tasks.ceph:Generating config... 2024-04-26T12:26:16.820 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T12:26:16.820 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T12:26:16.820 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T12:26:16.820 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T12:26:16.820 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T12:26:16.820 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T12:26:16.820 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-04-26T12:26:16.820 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-26T12:26:16.820 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T12:26:16.820 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T12:26:16.820 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T12:26:16.820 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T12:26:16.820 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T12:26:16.821 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T12:26:16.821 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T12:26:16.821 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T12:26:16.821 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T12:26:16.821 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T12:26:16.821 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T12:26:16.821 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T12:26:16.821 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T12:26:16.821 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T12:26:16.821 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T12:26:16.890 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T12:26:16.893 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T12:26:16.944 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:26:16.973 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46'), ('mon.b', '[v2:172.21.15.46:3301,v1:172.21.15.46:6790]'), ('mon.c', '[v2:172.21.15.46:3302,v1:172.21.15.46:6791]')] 2024-04-26T12:26:16.973 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],[v2:172.21.15.46:3302,v1:172.21.15.46:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-26T12:26:16.974 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:26:16.974 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:26:17.033 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --addv b '[v2:172.21.15.46:3301,v1:172.21.15.46:6790]' --addv c '[v2:172.21.15.46:3302,v1:172.21.15.46:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:26:17.124 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:26:17.124 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid 3dd84416-f290-4721-94ce-52b0ffaacf34 2024-04-26T12:26:17.125 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = pacific 2024-04-26T12:26:17.125 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2024-04-26T12:26:17.125 INFO:teuthology.orchestra.run.smithi046.stdout:fsid 3dd84416-f290-4721-94ce-52b0ffaacf34 2024-04-26T12:26:17.125 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2024-04-26T12:26:17.124361+0000 2024-04-26T12:26:17.125 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-04-26T12:26:17.124361+0000 2024-04-26T12:26:17.125 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 16 (pacific) 2024-04-26T12:26:17.125 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2024-04-26T12:26:17.125 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-04-26T12:26:17.125 INFO:teuthology.orchestra.run.smithi046.stdout:1: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.b 2024-04-26T12:26:17.125 INFO:teuthology.orchestra.run.smithi046.stdout:2: [v2:172.21.15.46:3302/0,v1:172.21.15.46:6791/0] mon.c 2024-04-26T12:26:17.125 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T12:26:17.126 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:26:17.144 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3dd84416-f290-4721-94ce-52b0ffaacf34... 2024-04-26T12:26:17.145 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:26:17.187 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:26:17.190 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:26:17.192 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:26:17.231 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-04-26T12:26:17.231 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2024-04-26T12:26:17.231 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:26:17.231 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2024-04-26T12:26:17.231 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.231 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2024-04-26T12:26:17.231 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.231 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2024-04-26T12:26:17.232 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.232 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2024-04-26T12:26:17.232 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2024-04-26T12:26:17.232 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.232 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2024-04-26T12:26:17.232 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2024-04-26T12:26:17.232 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.232 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:26:17.232 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2024-04-26T12:26:17.232 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.232 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:26:17.232 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.233 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:26:17.234 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.234 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2024-04-26T12:26:17.234 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.234 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2024-04-26T12:26:17.234 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.234 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2024-04-26T12:26:17.234 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2024-04-26T12:26:17.234 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2024-04-26T12:26:17.234 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = "172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],[v2:172.21.15.46:3302,v1:172.21.15.46:6791]" 2024-04-26T12:26:17.234 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = 3dd84416-f290-4721-94ce-52b0ffaacf34 2024-04-26T12:26:17.235 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.235 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2024-04-26T12:26:17.235 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2024-04-26T12:26:17.235 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.235 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2024-04-26T12:26:17.235 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2024-04-26T12:26:17.235 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:26:17.235 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.235 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2024-04-26T12:26:17.235 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2024-04-26T12:26:17.235 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.235 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2024-04-26T12:26:17.235 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2024-04-26T12:26:17.236 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2024-04-26T12:26:17.236 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.236 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2024-04-26T12:26:17.236 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2024-04-26T12:26:17.236 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.236 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:26:17.236 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.236 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2024-04-26T12:26:17.236 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.236 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2024-04-26T12:26:17.236 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.236 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore block size = 96636764160 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore compression algorithm = snappy 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore compression mode = aggressive 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore fsck on mount = True 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluefs = 1/20 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluestore = 1/20 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: debug rocksdb = 4/10 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:26:17.237 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd full ratio = 0.9 2024-04-26T12:26:17.238 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:26:17.238 INFO:teuthology.orchestra.run.smithi046.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:26:17.238 INFO:teuthology.orchestra.run.smithi046.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:26:17.238 INFO:teuthology.orchestra.run.smithi046.stdout: osd max markdown count = 1000 2024-04-26T12:26:17.238 INFO:teuthology.orchestra.run.smithi046.stdout: osd objectstore = bluestore 2024-04-26T12:26:17.238 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.238 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2024-04-26T12:26:17.238 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-04-26T12:26:17.238 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2024-04-26T12:26:17.238 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-04-26T12:26:17.238 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-04-26T12:26:17.238 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:26:17.238 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:26:17.238 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2024-04-26T12:26:17.239 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.239 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2024-04-26T12:26:17.239 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-04-26T12:26:17.239 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-04-26T12:26:17.239 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2024-04-26T12:26:17.239 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-04-26T12:26:17.239 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2024-04-26T12:26:17.239 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2024-04-26T12:26:17.239 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:26:17.239 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2024-04-26T12:26:17.239 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2024-04-26T12:26:17.239 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:26:17.239 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.240 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:26:17.240 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:26:17.240 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:26:17.240 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.240 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:26:17.240 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:26:17.240 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:26:17.240 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.240 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2024-04-26T12:26:17.240 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:26:17.240 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.240 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:26:17.240 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:17.240 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2024-04-26T12:26:17.241 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2024-04-26T12:26:17.241 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2024-04-26T12:26:17.241 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2024-04-26T12:26:17.241 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:26:17.241 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:26:17.241 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2024-04-26T12:26:17.241 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.b] 2024-04-26T12:26:17.241 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.c] 2024-04-26T12:26:17.241 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-04-26T12:26:17.242 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-04-26T12:26:17.242 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-04-26T12:26:17.242 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:26:17.242 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-04-26T12:26:17.242 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.242 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-04-26T12:26:17.242 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.242 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-04-26T12:26:17.242 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-04-26T12:26:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-04-26T12:26:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-04-26T12:26:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-04-26T12:26:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:26:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-04-26T12:26:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:26:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:26:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-04-26T12:26:17.243 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-04-26T12:26:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-04-26T12:26:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:26:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:26:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-04-26T12:26:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:26:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-04-26T12:26:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:26:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:26:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-04-26T12:26:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:26:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.244 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],[v2:172.21.15.46:3302,v1:172.21.15.46:6791]" 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 3dd84416-f290-4721-94ce-52b0ffaacf34 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2024-04-26T12:26:17.245 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:26:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-04-26T12:26:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-04-26T12:26:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-04-26T12:26:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-04-26T12:26:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-04-26T12:26:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-04-26T12:26:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-04-26T12:26:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:26:17.246 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-04-26T12:26:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-04-26T12:26:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:26:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-04-26T12:26:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-04-26T12:26:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-04-26T12:26:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-04-26T12:26:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore compression algorithm = snappy 2024-04-26T12:26:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore compression mode = aggressive 2024-04-26T12:26:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-04-26T12:26:17.247 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 1/20 2024-04-26T12:26:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 1/20 2024-04-26T12:26:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-26T12:26:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-04-26T12:26:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 4/10 2024-04-26T12:26:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:26:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-04-26T12:26:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:26:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:26:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:26:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: osd max markdown count = 1000 2024-04-26T12:26:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-04-26T12:26:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.248 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-04-26T12:26:17.248 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-04-26T12:26:17.249 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-04-26T12:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-04-26T12:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-04-26T12:26:17.250 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:26:17.251 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.251 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:26:17.251 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T12:26:17.251 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-04-26T12:26:17.251 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-04-26T12:26:17.251 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-04-26T12:26:17.251 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-04-26T12:26:17.251 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:26:17.251 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:26:17.251 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-04-26T12:26:17.251 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2024-04-26T12:26:17.251 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2024-04-26T12:26:17.251 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-04-26T12:26:17.252 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2024-04-26T12:26:17.252 INFO:teuthology.orchestra.run.smithi115.stdout: chdir = "" 2024-04-26T12:26:17.252 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:26:17.252 INFO:teuthology.orchestra.run.smithi115.stdout: auth supported = cephx 2024-04-26T12:26:17.252 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.252 INFO:teuthology.orchestra.run.smithi115.stdout: filestore xattr use omap = true 2024-04-26T12:26:17.252 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.252 INFO:teuthology.orchestra.run.smithi115.stdout: mon clock drift allowed = 1.000 2024-04-26T12:26:17.252 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.252 INFO:teuthology.orchestra.run.smithi115.stdout: osd crush chooseleaf type = 0 2024-04-26T12:26:17.252 INFO:teuthology.orchestra.run.smithi115.stdout: auth debug = true 2024-04-26T12:26:17.253 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.253 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on old message = true 2024-04-26T12:26:17.253 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on bug = true 2024-04-26T12:26:17.253 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.253 INFO:teuthology.orchestra.run.smithi115.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:26:17.253 INFO:teuthology.orchestra.run.smithi115.stdout: mon pg warn max object skew = 0 2024-04-26T12:26:17.253 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.253 INFO:teuthology.orchestra.run.smithi115.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:26:17.253 INFO:teuthology.orchestra.run.smithi115.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:26:17.253 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.253 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default size = 2 2024-04-26T12:26:17.253 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.254 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow primary affinity = true 2024-04-26T12:26:17.254 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow pg remap = true 2024-04-26T12:26:17.254 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:26:17.254 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:26:17.254 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on no sortbitwise = false 2024-04-26T12:26:17.254 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:26:17.254 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on too few osds = false 2024-04-26T12:26:17.254 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:26:17.254 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:26:17.254 INFO:teuthology.orchestra.run.smithi115.stdout: mon_allow_pool_size_one = true 2024-04-26T12:26:17.254 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.254 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:26:17.254 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.254 INFO:teuthology.orchestra.run.smithi115.stdout: osd default data pool replay window = 5 2024-04-26T12:26:17.255 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.255 INFO:teuthology.orchestra.run.smithi115.stdout: mon allow pool delete = true 2024-04-26T12:26:17.255 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.255 INFO:teuthology.orchestra.run.smithi115.stdout: mon cluster log file level = debug 2024-04-26T12:26:17.255 INFO:teuthology.orchestra.run.smithi115.stdout: debug asserts on shutdown = true 2024-04-26T12:26:17.255 INFO:teuthology.orchestra.run.smithi115.stdout: mon health detail to clog = false 2024-04-26T12:26:17.255 INFO:teuthology.orchestra.run.smithi115.stdout: mon host = "172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],[v2:172.21.15.46:3302,v1:172.21.15.46:6791]" 2024-04-26T12:26:17.255 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = 3dd84416-f290-4721-94ce-52b0ffaacf34 2024-04-26T12:26:17.255 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.255 INFO:teuthology.orchestra.run.smithi115.stdout:[osd] 2024-04-26T12:26:17.255 INFO:teuthology.orchestra.run.smithi115.stdout: osd journal size = 100 2024-04-26T12:26:17.255 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.255 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub load threshold = 5.0 2024-04-26T12:26:17.255 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub max interval = 600 2024-04-26T12:26:17.256 INFO:teuthology.orchestra.run.smithi115.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:26:17.256 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.256 INFO:teuthology.orchestra.run.smithi115.stdout: osd recover clone overlap = true 2024-04-26T12:26:17.256 INFO:teuthology.orchestra.run.smithi115.stdout: osd recovery max chunk = 1048576 2024-04-26T12:26:17.256 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.256 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug shutdown = true 2024-04-26T12:26:17.256 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug op order = true 2024-04-26T12:26:17.256 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug verify stray on activate = true 2024-04-26T12:26:17.256 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.256 INFO:teuthology.orchestra.run.smithi115.stdout: osd open classes on start = true 2024-04-26T12:26:17.256 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug pg log writeout = true 2024-04-26T12:26:17.256 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.256 INFO:teuthology.orchestra.run.smithi115.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:26:17.257 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.257 INFO:teuthology.orchestra.run.smithi115.stdout: osd map max advance = 10 2024-04-26T12:26:17.257 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.257 INFO:teuthology.orchestra.run.smithi115.stdout: journal zero on create = true 2024-04-26T12:26:17.257 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.257 INFO:teuthology.orchestra.run.smithi115.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:26:17.257 INFO:teuthology.orchestra.run.smithi115.stdout: filestore apply finisher threads = 3 2024-04-26T12:26:17.257 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.257 INFO:teuthology.orchestra.run.smithi115.stdout: bdev debug aio = true 2024-04-26T12:26:17.257 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug misdirected ops = true 2024-04-26T12:26:17.257 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore block size = 96636764160 2024-04-26T12:26:17.257 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore compression algorithm = snappy 2024-04-26T12:26:17.257 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore compression mode = aggressive 2024-04-26T12:26:17.257 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore fsck on mount = True 2024-04-26T12:26:17.258 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluefs = 1/20 2024-04-26T12:26:17.258 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluestore = 1/20 2024-04-26T12:26:17.258 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-04-26T12:26:17.258 INFO:teuthology.orchestra.run.smithi115.stdout: debug osd = 20 2024-04-26T12:26:17.258 INFO:teuthology.orchestra.run.smithi115.stdout: debug rocksdb = 4/10 2024-04-26T12:26:17.258 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:26:17.258 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd full ratio = 0.9 2024-04-26T12:26:17.258 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:26:17.258 INFO:teuthology.orchestra.run.smithi115.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:26:17.258 INFO:teuthology.orchestra.run.smithi115.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:26:17.258 INFO:teuthology.orchestra.run.smithi115.stdout: osd max markdown count = 1000 2024-04-26T12:26:17.258 INFO:teuthology.orchestra.run.smithi115.stdout: osd objectstore = bluestore 2024-04-26T12:26:17.258 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr] 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgr = 20 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout: mgr/telemetry/nag = false 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout:[mon] 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout: debug paxos = 20 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2024-04-26T12:26:17.259 INFO:teuthology.orchestra.run.smithi115.stdout: mon data avail warn = 5 2024-04-26T12:26:17.260 INFO:teuthology.orchestra.run.smithi115.stdout: mon mgr mkfs grace = 240 2024-04-26T12:26:17.260 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:26:17.260 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd reporter subtree level = osd 2024-04-26T12:26:17.260 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd prime pg temp = true 2024-04-26T12:26:17.260 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:26:17.260 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.260 INFO:teuthology.orchestra.run.smithi115.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:26:17.260 INFO:teuthology.orchestra.run.smithi115.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:26:17.260 INFO:teuthology.orchestra.run.smithi115.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:26:17.260 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.260 INFO:teuthology.orchestra.run.smithi115.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:26:17.260 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:26:17.260 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:26:17.260 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout: # 1m isn't quite enough 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout:[client] 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout: rgw cache enabled = true 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable ops log = true 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable usage log = true 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.a] 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.b] 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.c] 2024-04-26T12:26:17.261 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2024-04-26T12:26:17.264 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2024-04-26T12:26:17.264 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2024-04-26T12:26:17.264 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:26:17.264 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2024-04-26T12:26:17.264 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.264 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2024-04-26T12:26:17.264 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.264 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2024-04-26T12:26:17.264 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.265 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2024-04-26T12:26:17.265 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2024-04-26T12:26:17.265 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.265 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2024-04-26T12:26:17.265 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2024-04-26T12:26:17.265 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.265 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:26:17.265 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2024-04-26T12:26:17.265 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.265 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:26:17.265 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:26:17.265 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.265 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2024-04-26T12:26:17.265 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2024-04-26T12:26:17.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2024-04-26T12:26:17.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:26:17.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:26:17.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2024-04-26T12:26:17.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:26:17.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2024-04-26T12:26:17.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:26:17.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:26:17.266 INFO:teuthology.orchestra.run.smithi136.stdout: mon_allow_pool_size_one = true 2024-04-26T12:26:17.266 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.266 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:26:17.266 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.267 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2024-04-26T12:26:17.267 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.267 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2024-04-26T12:26:17.267 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.267 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2024-04-26T12:26:17.267 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2024-04-26T12:26:17.267 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2024-04-26T12:26:17.267 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],[v2:172.21.15.46:3302,v1:172.21.15.46:6791]" 2024-04-26T12:26:17.267 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = 3dd84416-f290-4721-94ce-52b0ffaacf34 2024-04-26T12:26:17.267 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.267 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2024-04-26T12:26:17.267 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2024-04-26T12:26:17.267 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2024-04-26T12:26:17.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2024-04-26T12:26:17.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:26:17.268 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2024-04-26T12:26:17.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2024-04-26T12:26:17.268 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2024-04-26T12:26:17.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2024-04-26T12:26:17.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2024-04-26T12:26:17.268 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2024-04-26T12:26:17.268 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2024-04-26T12:26:17.269 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.269 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:26:17.269 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.269 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2024-04-26T12:26:17.269 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.269 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2024-04-26T12:26:17.269 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.269 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:26:17.269 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2024-04-26T12:26:17.269 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.269 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2024-04-26T12:26:17.269 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2024-04-26T12:26:17.269 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2024-04-26T12:26:17.270 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore compression algorithm = snappy 2024-04-26T12:26:17.270 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore compression mode = aggressive 2024-04-26T12:26:17.270 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2024-04-26T12:26:17.270 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 1/20 2024-04-26T12:26:17.270 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 1/20 2024-04-26T12:26:17.270 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-04-26T12:26:17.270 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2024-04-26T12:26:17.270 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 4/10 2024-04-26T12:26:17.270 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:26:17.270 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2024-04-26T12:26:17.270 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:26:17.270 INFO:teuthology.orchestra.run.smithi136.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:26:17.270 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:26:17.270 INFO:teuthology.orchestra.run.smithi136.stdout: osd max markdown count = 1000 2024-04-26T12:26:17.271 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2024-04-26T12:26:17.271 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.271 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2024-04-26T12:26:17.271 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-04-26T12:26:17.271 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2024-04-26T12:26:17.271 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-04-26T12:26:17.271 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-04-26T12:26:17.271 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:26:17.271 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:26:17.271 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2024-04-26T12:26:17.271 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.271 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:26:17.272 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.273 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:26:17.273 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:26:17.273 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:26:17.273 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.273 INFO:teuthology.orchestra.run.smithi136.stdout: # 1m isn't quite enough 2024-04-26T12:26:17.273 INFO:teuthology.orchestra.run.smithi136.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:26:17.273 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.273 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:26:17.273 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T12:26:17.273 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2024-04-26T12:26:17.273 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2024-04-26T12:26:17.273 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2024-04-26T12:26:17.273 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2024-04-26T12:26:17.274 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:26:17.274 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:26:17.274 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2024-04-26T12:26:17.274 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2024-04-26T12:26:17.274 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2024-04-26T12:26:17.274 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2024-04-26T12:26:17.274 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T12:26:17.274 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T12:26:17.361 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T12:26:17.361 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:26:17.361 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T12:26:17.379 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:26:17.379 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T12:26:17.437 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2024-04-26T12:26:17.437 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:26:17.437 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:26:17.437 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:26:17.514 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:26:17.514 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:26:17.571 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi115.front.sepia.ceph.com 2024-04-26T12:26:17.572 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-26T12:26:17.572 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:26:17.572 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:26:17.614 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-26T12:26:17.614 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:26:17.674 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T12:26:17.674 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T12:26:17.674 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:26:17.674 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:26:17.717 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T12:26:17.717 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:26:17.778 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T12:26:17.778 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T12:26:17.778 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:26:17.778 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:26:17.821 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T12:26:17.821 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:26:17.881 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T12:26:17.881 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T12:26:17.881 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:26:17.940 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:26:17.942 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T12:26:17.998 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T12:26:18.000 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T12:26:18.000 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T12:26:18.054 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T12:26:18.056 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T12:26:18.085 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T12:26:18.086 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T12:26:18.170 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T12:26:18.210 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T12:26:18.210 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T12:26:18.210 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T12:26:18.242 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T12:26:18.242 INFO:tasks.ceph:role: osd.0 2024-04-26T12:26:18.242 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com 2024-04-26T12:26:18.243 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:26:18.321 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:26:18.321 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:26:18.321 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:26:18.321 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:26:18.321 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:26:18.321 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:26:18.321 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:26:18.322 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:26:18.322 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:26:18.322 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:26:18.750 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-04-26T12:26:18.752 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-04-26T12:26:18.752 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T12:26:18.920 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T12:26:18.956 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:26:19.065 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-26T12:26:19.065+0000 7f3d7eff8800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T12:26:19.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-26T12:26:19.066+0000 7f3d7eff8800 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T12:26:19.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-26T12:26:19.066+0000 7f3d7eff8800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:26:19.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-26T12:26:19.066+0000 7f3d7eff8800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:26:19.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-26T12:26:19.066+0000 7f3d7eff8800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:26:19.074 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-26T12:26:19.074+0000 7f3d7eff8800 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T12:26:21.920 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T12:26:21.953 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T12:26:21.984 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T12:26:21.984 INFO:tasks.ceph:role: osd.1 2024-04-26T12:26:21.984 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T12:26:21.984 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:26:22.061 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:26:22.061 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:26:22.061 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:26:22.061 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:26:22.061 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:26:22.061 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:26:22.061 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:26:22.061 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:26:22.062 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:26:22.062 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:26:22.541 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-04-26T12:26:22.543 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-04-26T12:26:22.543 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T12:26:22.659 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T12:26:22.696 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:26:22.804 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T12:26:22.802+0000 7fa0f8223800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T12:26:22.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T12:26:22.803+0000 7fa0f8223800 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T12:26:22.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T12:26:22.803+0000 7fa0f8223800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:26:22.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T12:26:22.803+0000 7fa0f8223800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:26:22.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T12:26:22.803+0000 7fa0f8223800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:26:22.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T12:26:22.806+0000 7fa0f8223800 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T12:26:25.659 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T12:26:25.691 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T12:26:25.724 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T12:26:25.724 INFO:tasks.ceph:role: osd.2 2024-04-26T12:26:25.724 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T12:26:25.725 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:26:25.804 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:26:25.804 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:26:25.804 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:26:25.804 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:26:25.804 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:26:25.804 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:26:25.804 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:26:25.804 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:26:25.805 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:26:25.805 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:26:26.235 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-04-26T12:26:26.236 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-04-26T12:26:26.237 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-26T12:26:26.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T12:26:26.438 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:26:26.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T12:26:26.541+0000 7efe1d01d800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T12:26:26.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T12:26:26.544+0000 7efe1d01d800 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T12:26:26.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T12:26:26.544+0000 7efe1d01d800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:26:26.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T12:26:26.544+0000 7efe1d01d800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:26:26.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T12:26:26.544+0000 7efe1d01d800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:26:26.551 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T12:26:26.551+0000 7efe1d01d800 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T12:26:29.405 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T12:26:29.438 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T12:26:29.438 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:26:29.438 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T12:26:29.472 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:26:29.472 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T12:26:29.545 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:26:29.545 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T12:26:29.617 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-26T12:26:29.617 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T12:26:29.651 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T12:26:29.651 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T12:26:29.684 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T12:26:29.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T12:26:29.717 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:26:29.717 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T12:26:29.738 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T12:26:29.738 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T12:26:29.809 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2024-04-26T12:26:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBpnStmIiQJOBAAJYqm4fFq3AlXaRP98sFXdA== 2024-04-26T12:26:29.809 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.y] 2024-04-26T12:26:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBpnStmPY99OxAA+OnfReqO1ZByXQ8jtj1PoQ== 2024-04-26T12:26:29.809 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-04-26T12:26:29.809 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBqnStmyz05AxAANc75YG1mKaqQza/w61T8Rw== 2024-04-26T12:26:29.810 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2024-04-26T12:26:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBrnStmX33kAxAACs+9GX6WIjBXy/h3BfBbDg== 2024-04-26T12:26:29.810 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2024-04-26T12:26:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBunStmuk/zLxAAM2zX6ZXxF3L1NmmFQLDX5g== 2024-04-26T12:26:29.810 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2024-04-26T12:26:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBynStmn11RIBAAo5DhalS+9D9d2v/hdhiobQ== 2024-04-26T12:26:29.810 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-04-26T12:26:29.810 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBqnStm5IIpChAAwgcLkcxejo4sh3Jcy5yRmQ== 2024-04-26T12:26:29.811 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:26:29.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:26:29.968 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T12:26:30.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:26:30.081 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:26:30.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:26:30.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T12:26:30.247 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T12:26:30.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T12:26:30.274 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:26:30.388 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T12:26:30.415 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T12:26:30.483 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:26:30.583 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T12:26:30.611 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T12:26:30.678 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:26:30.777 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T12:26:30.805 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:26:30.863 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T12:26:30.863 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T12:26:30.863 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T12:26:30.905 INFO:tasks.ceph.mon.a:Started 2024-04-26T12:26:30.905 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T12:26:30.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T12:26:30.907 INFO:tasks.ceph.mon.b:Started 2024-04-26T12:26:30.907 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T12:26:30.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T12:26:30.909 INFO:tasks.ceph.mon.c:Started 2024-04-26T12:26:30.909 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T12:26:30.909 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T12:26:30.910 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T12:26:30.911 INFO:tasks.ceph.mgr.x:Started 2024-04-26T12:26:30.911 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T12:26:30.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T12:26:30.913 INFO:tasks.ceph.mgr.y:Started 2024-04-26T12:26:30.914 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T12:26:30.914 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T12:26:37.162 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:37.161+0000 7fce6987b240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T12:26:37.166 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:37.165+0000 7f280a5f1240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T12:26:37.178 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-04-26T12:26:37.190 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T12:26:37.190 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T12:26:37.191 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-26T12:26:37.191 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T12:26:37.224 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T12:26:37.224 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T12:26:37.258 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T12:26:37.259 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T12:26:37.293 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 06efe013-b786-41a5-b434-e2198a85a028 0 2024-04-26T12:26:37.362 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:37.360+0000 7f280a5f1240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T12:26:37.368 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:37.367+0000 7fce6987b240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T12:26:37.553 INFO:teuthology.orchestra.run.smithi142.stdout:0 2024-04-26T12:26:37.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 13cadead-33ea-4874-9a87-7419790ff37a 1 2024-04-26T12:26:37.775 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-04-26T12:26:37.786 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:37.785+0000 7fce6987b240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T12:26:37.787 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 4e4c8095-c2d1-42a3-8da1-e3b41ca2a870 2 2024-04-26T12:26:37.788 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:37.786+0000 7f280a5f1240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T12:26:37.996 INFO:teuthology.orchestra.run.smithi142.stdout:2 2024-04-26T12:26:38.009 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T12:26:38.009 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T12:26:38.011 INFO:tasks.ceph.osd.0:Started 2024-04-26T12:26:38.011 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T12:26:38.011 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T12:26:38.014 INFO:tasks.ceph.osd.1:Started 2024-04-26T12:26:38.014 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T12:26:38.014 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T12:26:38.016 INFO:tasks.ceph.osd.2:Started 2024-04-26T12:26:38.016 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:26:38.235 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:38.236 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:26:37.993949+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:26:38.249 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T12:26:38.249 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T12:26:38.306 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:38.305+0000 7fce6987b240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T12:26:38.307 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:38.306+0000 7f280a5f1240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T12:26:38.538 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:38.537+0000 7fce6987b240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T12:26:38.541 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:38.540+0000 7f280a5f1240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T12:26:38.551 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:26:38.604 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:26:38.603+0000 7fd43b5e8800 -1 Falling back to public interface 2024-04-26T12:26:38.613 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:26:38.611+0000 7f76a4f45800 -1 Falling back to public interface 2024-04-26T12:26:38.617 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:26:38.616+0000 7f559de76800 -1 Falling back to public interface 2024-04-26T12:26:38.793 INFO:teuthology.misc.health.smithi046.stdout: 2024-04-26T12:26:38.793 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":5,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:26:37.993949+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:26:38.809 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T12:26:38.955 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:38.954+0000 7fce6987b240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T12:26:38.978 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:38.977+0000 7f280a5f1240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T12:26:39.675 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:39.674+0000 7fce6987b240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T12:26:39.676 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:39.675+0000 7f280a5f1240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T12:26:39.753 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:39.752+0000 7fce6987b240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T12:26:39.753 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:39.752+0000 7f280a5f1240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T12:26:39.897 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:39.895+0000 7fce6987b240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T12:26:39.897 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:39.896+0000 7f280a5f1240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T12:26:40.085 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:40.084+0000 7fce6987b240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T12:26:40.085 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:40.084+0000 7f280a5f1240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T12:26:40.164 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:40.163+0000 7fce6987b240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T12:26:40.164 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:40.164+0000 7f280a5f1240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T12:26:40.248 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:40.247+0000 7fce6987b240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T12:26:40.248 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:40.248+0000 7f280a5f1240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T12:26:40.330 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:40.329+0000 7fce6987b240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T12:26:40.331 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:40.330+0000 7f280a5f1240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T12:26:40.422 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:40.421+0000 7fce6987b240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T12:26:40.422 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:40.421+0000 7f280a5f1240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T12:26:40.631 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:40.630+0000 7fce6987b240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T12:26:40.632 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:40.630+0000 7f280a5f1240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T12:26:40.863 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:40.862+0000 7f280a5f1240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T12:26:40.863 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:40.862+0000 7fce6987b240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T12:26:41.030 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:41.029+0000 7fce6987b240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T12:26:41.032 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:41.031+0000 7f280a5f1240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T12:26:41.107 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:41.106+0000 7fce6987b240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T12:26:41.108 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:41.108+0000 7f280a5f1240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T12:26:41.832 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:41.831+0000 7fce6987b240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T12:26:41.833 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:41.832+0000 7f280a5f1240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T12:26:42.009 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:42.008+0000 7fce6987b240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T12:26:42.010 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:42.009+0000 7f280a5f1240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T12:26:42.029 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:26:42.029+0000 7fd43b5e8800 -1 osd.2 0 log_to_monitors true 2024-04-26T12:26:42.045 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:26:42.043+0000 7f76a4f45800 -1 osd.0 0 log_to_monitors true 2024-04-26T12:26:42.046 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:26:42.046+0000 7f559de76800 -1 osd.1 0 log_to_monitors true 2024-04-26T12:26:42.182 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:42.181+0000 7fce6987b240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:26:42.183 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:42.182+0000 7f280a5f1240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:26:42.610 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:42.609+0000 7fce6987b240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T12:26:42.616 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:42.615+0000 7f280a5f1240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T12:26:42.785 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:42.784+0000 7fce6987b240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:26:42.790 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:42.787+0000 7f280a5f1240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:26:43.175 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:43.174+0000 7fce6987b240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T12:26:43.176 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:43.175+0000 7f280a5f1240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T12:26:43.282 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-04-26T12:26:43.281+0000 7fce6987b240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T12:26:43.282 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:43.281+0000 7f280a5f1240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T12:26:43.775 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:26:43.774+0000 7f5592a18700 -1 osd.1 0 waiting for initial osdmap 2024-04-26T12:26:43.781 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:26:43.780+0000 7fd43018a700 -1 osd.2 0 waiting for initial osdmap 2024-04-26T12:26:43.786 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:26:43.786+0000 7f5589df1700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:26:43.790 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:26:43.790+0000 7fd427563700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:26:43.795 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:26:43.793+0000 7f76992e6700 -1 osd.0 0 waiting for initial osdmap 2024-04-26T12:26:43.805 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:26:43.804+0000 7f7690ec0700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:26:44.298 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:44.297+0000 7f27cba81700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T12:26:44.298 INFO:tasks.ceph.mgr.x.smithi046.stderr:2024-04-26T12:26:44.297+0000 7f27cba81700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T12:26:45.111 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:26:45.457 INFO:teuthology.misc.health.smithi046.stdout: 2024-04-26T12:26:45.457 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":8,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:26:44.796790+0000","last_up_change":"2024-04-26T12:26:44.796790+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":41393},{"type":"v1","addr":"172.21.15.136:6801","nonce":41393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":41393},{"type":"v1","addr":"172.21.15.136:6803","nonce":41393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":41393},{"type":"v1","addr":"172.21.15.136:6807","nonce":41393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":41393},{"type":"v1","addr":"172.21.15.136:6805","nonce":41393}]},"public_addr":"172.21.15.136:6801/41393","cluster_addr":"172.21.15.136:6803/41393","heartbeat_back_addr":"172.21.15.136:6807/41393","heartbeat_front_addr":"172.21.15.136:6805/41393","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:26:45.470 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-26T12:26:45.471 INFO:tasks.ceph:Creating RBD pool 2024-04-26T12:26:45.471 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T12:26:46.808 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'rbd' created 2024-04-26T12:26:46.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T12:26:47.812 INFO:teuthology.orchestra.run.smithi046.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T12:26:47.824 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T12:26:47.824 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T12:26:47.824 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T12:26:47.827 INFO:tasks.ceph.mds.a:Started 2024-04-26T12:26:47.827 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T12:26:47.827 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:26:47.908 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-04-26T12:26:48.171 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:48.172 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":11,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:26:47.800846+0000","last_up_change":"2024-04-26T12:26:44.796790+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":41393},{"type":"v1","addr":"172.21.15.136:6801","nonce":41393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":41393},{"type":"v1","addr":"172.21.15.136:6803","nonce":41393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":41393},{"type":"v1","addr":"172.21.15.136:6807","nonce":41393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":41393},{"type":"v1","addr":"172.21.15.136:6805","nonce":41393}]},"public_addr":"172.21.15.136:6801/41393","cluster_addr":"172.21.15.136:6803/41393","heartbeat_back_addr":"172.21.15.136:6807/41393","heartbeat_front_addr":"172.21.15.136:6805/41393","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:26:48.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:26:45.341269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:26:45.839095+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:26:48.186 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:26:48.530 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-04-26T12:26:48.544 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:26:48.883 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2024-04-26T12:26:48.898 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:26:49.286 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:49.286 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6803/2009845799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2009845799},{"type":"v1","addr":"172.21.15.46:6803","nonce":2009845799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-26T12:26:49.289 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 2 2024-04-26T12:26:49.301 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:26:49.639 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:49.639 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":12,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:26:48.805522+0000","last_up_change":"2024-04-26T12:26:44.796790+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":41393},{"type":"v1","addr":"172.21.15.136:6801","nonce":41393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":41393},{"type":"v1","addr":"172.21.15.136:6803","nonce":41393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":41393},{"type":"v1","addr":"172.21.15.136:6807","nonce":41393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":41393},{"type":"v1","addr":"172.21.15.136:6805","nonce":41393}]},"public_addr":"172.21.15.136:6801/41393","cluster_addr":"172.21.15.136:6803/41393","heartbeat_back_addr":"172.21.15.136:6807/41393","heartbeat_front_addr":"172.21.15.136:6805/41393","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:26:49.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:26:45.341269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:26:45.839095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:26:49.654 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:26:49.996 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-04-26T12:26:50.010 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:26:50.350 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2024-04-26T12:26:50.367 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T12:26:50.706 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:50.707 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-04-26T12:26:50.707 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:26:50.707 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2024-04-26T12:26:50.707 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2024-04-26T12:26:50.707 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:26:50.707 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:26:50.708 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 2, 2024-04-26T12:26:50.708 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": "rbd" 2024-04-26T12:26:50.708 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:26:50.708 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-04-26T12:26:50.720 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T12:26:50.720 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T12:26:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2024-04-26T12:26:51.840 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T12:26:52.832 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2024-04-26T12:26:52.847 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T12:26:53.252 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 3 and data pool 4 2024-04-26T12:26:53.265 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:26:53.606 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:53.606 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:26:53.243866+0000","last_up_change":"2024-04-26T12:26:44.796790+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:26:51.091400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:26:52.222159+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":41393},{"type":"v1","addr":"172.21.15.136:6801","nonce":41393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":41393},{"type":"v1","addr":"172.21.15.136:6803","nonce":41393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":41393},{"type":"v1","addr":"172.21.15.136:6807","nonce":41393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":41393},{"type":"v1","addr":"172.21.15.136:6805","nonce":41393}]},"public_addr":"172.21.15.136:6801/41393","cluster_addr":"172.21.15.136:6803/41393","heartbeat_back_addr":"172.21.15.136:6807/41393","heartbeat_front_addr":"172.21.15.136:6805/41393","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:26:53.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:26:53.959 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:53.959 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:26:53.243866+0000","last_up_change":"2024-04-26T12:26:44.796790+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:26:51.091400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:26:52.222159+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":41393},{"type":"v1","addr":"172.21.15.136:6801","nonce":41393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":41393},{"type":"v1","addr":"172.21.15.136:6803","nonce":41393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":41393},{"type":"v1","addr":"172.21.15.136:6807","nonce":41393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":41393},{"type":"v1","addr":"172.21.15.136:6805","nonce":41393}]},"public_addr":"172.21.15.136:6801/41393","cluster_addr":"172.21.15.136:6803/41393","heartbeat_back_addr":"172.21.15.136:6807/41393","heartbeat_front_addr":"172.21.15.136:6805/41393","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:26:53.974 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T12:26:55.272 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T12:26:55.272 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T12:26:56.274 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T12:26:56.274 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:26:56.663 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:56.663 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:26:53.244246+0000","modified":"2024-04-26T12:26:56.250552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14150":{"gid":14150,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6803/2009845799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2009845799},{"type":"v1","addr":"172.21.15.46:6803","nonce":2009845799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:26:56.666 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 6 2024-04-26T12:26:56.677 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:26:57.019 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:57.019 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":16,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:26:54.245547+0000","last_up_change":"2024-04-26T12:26:44.796790+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:26:51.091400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:26:52.222159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":41393},{"type":"v1","addr":"172.21.15.136:6801","nonce":41393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":41393},{"type":"v1","addr":"172.21.15.136:6803","nonce":41393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":41393},{"type":"v1","addr":"172.21.15.136:6807","nonce":41393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":41393},{"type":"v1","addr":"172.21.15.136:6805","nonce":41393}]},"public_addr":"172.21.15.136:6801/41393","cluster_addr":"172.21.15.136:6803/41393","heartbeat_back_addr":"172.21.15.136:6807/41393","heartbeat_front_addr":"172.21.15.136:6805/41393","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:26:57.033 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T12:26:57.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:26:57.382 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:57.384 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:26:57.393 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-26T12:26:57.289800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81664,"kb_used_data":600,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033856,"statfs":{"total":289910292480,"available":289826668544,"internally_reserved":0,"allocated":614400,"data_stored":1332646,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.469975"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.255057+0000","last_change":"2024-04-26T12:26:53.255588+0000","last_active":"2024-04-26T12:26:54.255057+0000","last_peered":"2024-04-26T12:26:54.255057+0000","last_clean":"2024-04-26T12:26:54.255057+0000","last_became_active":"2024-04-26T12:26:53.255201+0000","last_became_peered":"2024-04-26T12:26:53.255201+0000","last_unstale":"2024-04-26T12:26:54.255057+0000","last_undegraded":"2024-04-26T12:26:54.255057+0000","last_fullsized":"2024-04-26T12:26:54.255057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:09.233018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254502+0000","last_change":"2024-04-26T12:26:53.256136+0000","last_active":"2024-04-26T12:26:54.254502+0000","last_peered":"2024-04-26T12:26:54.254502+0000","last_clean":"2024-04-26T12:26:54.254502+0000","last_became_active":"2024-04-26T12:26:53.255297+0000","last_became_peered":"2024-04-26T12:26:53.255297+0000","last_unstale":"2024-04-26T12:26:54.254502+0000","last_undegraded":"2024-04-26T12:26:54.254502+0000","last_fullsized":"2024-04-26T12:26:54.254502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253859+0000","last_change":"2024-04-26T12:26:53.265584+0000","last_active":"2024-04-26T12:26:54.253859+0000","last_peered":"2024-04-26T12:26:54.253859+0000","last_clean":"2024-04-26T12:26:54.253859+0000","last_became_active":"2024-04-26T12:26:53.264555+0000","last_became_peered":"2024-04-26T12:26:53.264555+0000","last_unstale":"2024-04-26T12:26:54.253859+0000","last_undegraded":"2024-04-26T12:26:54.253859+0000","last_fullsized":"2024-04-26T12:26:54.253859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:20:03.207903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253538+0000","last_change":"2024-04-26T12:26:53.263004+0000","last_active":"2024-04-26T12:26:54.253538+0000","last_peered":"2024-04-26T12:26:54.253538+0000","last_clean":"2024-04-26T12:26:54.253538+0000","last_became_active":"2024-04-26T12:26:53.261193+0000","last_became_peered":"2024-04-26T12:26:53.261193+0000","last_unstale":"2024-04-26T12:26:54.253538+0000","last_undegraded":"2024-04-26T12:26:54.253538+0000","last_fullsized":"2024-04-26T12:26:54.253538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254277+0000","last_change":"2024-04-26T12:26:53.255483+0000","last_active":"2024-04-26T12:26:54.254277+0000","last_peered":"2024-04-26T12:26:54.254277+0000","last_clean":"2024-04-26T12:26:54.254277+0000","last_became_active":"2024-04-26T12:26:53.255001+0000","last_became_peered":"2024-04-26T12:26:53.255001+0000","last_unstale":"2024-04-26T12:26:54.254277+0000","last_undegraded":"2024-04-26T12:26:54.254277+0000","last_fullsized":"2024-04-26T12:26:54.254277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:34.496560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252949+0000","last_change":"2024-04-26T12:26:53.264139+0000","last_active":"2024-04-26T12:26:54.252949+0000","last_peered":"2024-04-26T12:26:54.252949+0000","last_clean":"2024-04-26T12:26:54.252949+0000","last_became_active":"2024-04-26T12:26:53.262002+0000","last_became_peered":"2024-04-26T12:26:53.262002+0000","last_unstale":"2024-04-26T12:26:54.252949+0000","last_undegraded":"2024-04-26T12:26:54.252949+0000","last_fullsized":"2024-04-26T12:26:54.252949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253027+0000","last_change":"2024-04-26T12:26:53.262987+0000","last_active":"2024-04-26T12:26:54.253027+0000","last_peered":"2024-04-26T12:26:54.253027+0000","last_clean":"2024-04-26T12:26:54.253027+0000","last_became_active":"2024-04-26T12:26:53.262113+0000","last_became_peered":"2024-04-26T12:26:53.262113+0000","last_unstale":"2024-04-26T12:26:54.253027+0000","last_undegraded":"2024-04-26T12:26:54.253027+0000","last_fullsized":"2024-04-26T12:26:54.253027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252720+0000","last_change":"2024-04-26T12:26:53.264092+0000","last_active":"2024-04-26T12:26:54.252720+0000","last_peered":"2024-04-26T12:26:54.252720+0000","last_clean":"2024-04-26T12:26:54.252720+0000","last_became_active":"2024-04-26T12:26:53.260501+0000","last_became_peered":"2024-04-26T12:26:53.260501+0000","last_unstale":"2024-04-26T12:26:54.252720+0000","last_undegraded":"2024-04-26T12:26:54.252720+0000","last_fullsized":"2024-04-26T12:26:54.252720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252461+0000","last_change":"2024-04-26T12:26:53.259692+0000","last_active":"2024-04-26T12:26:54.252461+0000","last_peered":"2024-04-26T12:26:54.252461+0000","last_clean":"2024-04-26T12:26:54.252461+0000","last_became_active":"2024-04-26T12:26:53.258709+0000","last_became_peered":"2024-04-26T12:26:53.258709+0000","last_unstale":"2024-04-26T12:26:54.252461+0000","last_undegraded":"2024-04-26T12:26:54.252461+0000","last_fullsized":"2024-04-26T12:26:54.252461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254822+0000","last_change":"2024-04-26T12:26:53.256190+0000","last_active":"2024-04-26T12:26:54.254822+0000","last_peered":"2024-04-26T12:26:54.254822+0000","last_clean":"2024-04-26T12:26:54.254822+0000","last_became_active":"2024-04-26T12:26:53.255382+0000","last_became_peered":"2024-04-26T12:26:53.255382+0000","last_unstale":"2024-04-26T12:26:54.254822+0000","last_undegraded":"2024-04-26T12:26:54.254822+0000","last_fullsized":"2024-04-26T12:26:54.254822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:53.950315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253701+0000","last_change":"2024-04-26T12:26:53.262951+0000","last_active":"2024-04-26T12:26:54.253701+0000","last_peered":"2024-04-26T12:26:54.253701+0000","last_clean":"2024-04-26T12:26:54.253701+0000","last_became_active":"2024-04-26T12:26:53.261842+0000","last_became_peered":"2024-04-26T12:26:53.261842+0000","last_unstale":"2024-04-26T12:26:54.253701+0000","last_undegraded":"2024-04-26T12:26:54.253701+0000","last_fullsized":"2024-04-26T12:26:54.253701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:35.327049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254183+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:26:54.254183+0000","last_peered":"2024-04-26T12:26:54.254183+0000","last_clean":"2024-04-26T12:26:54.254183+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:26:54.254183+0000","last_undegraded":"2024-04-26T12:26:54.254183+0000","last_fullsized":"2024-04-26T12:26:54.254183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254377+0000","last_change":"2024-04-26T12:26:53.254930+0000","last_active":"2024-04-26T12:26:54.254377+0000","last_peered":"2024-04-26T12:26:54.254377+0000","last_clean":"2024-04-26T12:26:54.254377+0000","last_became_active":"2024-04-26T12:26:53.253988+0000","last_became_peered":"2024-04-26T12:26:53.253988+0000","last_unstale":"2024-04-26T12:26:54.254377+0000","last_undegraded":"2024-04-26T12:26:54.254377+0000","last_fullsized":"2024-04-26T12:26:54.254377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253678+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:26:54.253678+0000","last_peered":"2024-04-26T12:26:54.253678+0000","last_clean":"2024-04-26T12:26:54.253678+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:26:54.253678+0000","last_undegraded":"2024-04-26T12:26:54.253678+0000","last_fullsized":"2024-04-26T12:26:54.253678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252782+0000","last_change":"2024-04-26T12:26:53.266568+0000","last_active":"2024-04-26T12:26:54.252782+0000","last_peered":"2024-04-26T12:26:54.252782+0000","last_clean":"2024-04-26T12:26:54.252782+0000","last_became_active":"2024-04-26T12:26:53.265846+0000","last_became_peered":"2024-04-26T12:26:53.265846+0000","last_unstale":"2024-04-26T12:26:54.252782+0000","last_undegraded":"2024-04-26T12:26:54.252782+0000","last_fullsized":"2024-04-26T12:26:54.252782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:10.849502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252784+0000","last_change":"2024-04-26T12:26:53.265459+0000","last_active":"2024-04-26T12:26:54.252784+0000","last_peered":"2024-04-26T12:26:54.252784+0000","last_clean":"2024-04-26T12:26:54.252784+0000","last_became_active":"2024-04-26T12:26:53.262898+0000","last_became_peered":"2024-04-26T12:26:53.262898+0000","last_unstale":"2024-04-26T12:26:54.252784+0000","last_undegraded":"2024-04-26T12:26:54.252784+0000","last_fullsized":"2024-04-26T12:26:54.252784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252546+0000","last_change":"2024-04-26T12:26:53.259864+0000","last_active":"2024-04-26T12:26:54.252546+0000","last_peered":"2024-04-26T12:26:54.252546+0000","last_clean":"2024-04-26T12:26:54.252546+0000","last_became_active":"2024-04-26T12:26:53.259025+0000","last_became_peered":"2024-04-26T12:26:53.259025+0000","last_unstale":"2024-04-26T12:26:54.252546+0000","last_undegraded":"2024-04-26T12:26:54.252546+0000","last_fullsized":"2024-04-26T12:26:54.252546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254951+0000","last_change":"2024-04-26T12:26:53.261186+0000","last_active":"2024-04-26T12:26:54.254951+0000","last_peered":"2024-04-26T12:26:54.254951+0000","last_clean":"2024-04-26T12:26:54.254951+0000","last_became_active":"2024-04-26T12:26:53.260820+0000","last_became_peered":"2024-04-26T12:26:53.260820+0000","last_unstale":"2024-04-26T12:26:54.254951+0000","last_undegraded":"2024-04-26T12:26:54.254951+0000","last_fullsized":"2024-04-26T12:26:54.254951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:00.602708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252225+0000","last_change":"2024-04-26T12:26:53.259728+0000","last_active":"2024-04-26T12:26:54.252225+0000","last_peered":"2024-04-26T12:26:54.252225+0000","last_clean":"2024-04-26T12:26:54.252225+0000","last_became_active":"2024-04-26T12:26:53.258952+0000","last_became_peered":"2024-04-26T12:26:53.258952+0000","last_unstale":"2024-04-26T12:26:54.252225+0000","last_undegraded":"2024-04-26T12:26:54.252225+0000","last_fullsized":"2024-04-26T12:26:54.252225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253512+0000","last_change":"2024-04-26T12:26:53.257321+0000","last_active":"2024-04-26T12:26:54.253512+0000","last_peered":"2024-04-26T12:26:54.253512+0000","last_clean":"2024-04-26T12:26:54.253512+0000","last_became_active":"2024-04-26T12:26:53.256192+0000","last_became_peered":"2024-04-26T12:26:53.256192+0000","last_unstale":"2024-04-26T12:26:54.253512+0000","last_undegraded":"2024-04-26T12:26:54.253512+0000","last_fullsized":"2024-04-26T12:26:54.253512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253202+0000","last_change":"2024-04-26T12:26:53.261669+0000","last_active":"2024-04-26T12:26:54.253202+0000","last_peered":"2024-04-26T12:26:54.253202+0000","last_clean":"2024-04-26T12:26:54.253202+0000","last_became_active":"2024-04-26T12:26:53.259854+0000","last_became_peered":"2024-04-26T12:26:53.259854+0000","last_unstale":"2024-04-26T12:26:54.253202+0000","last_undegraded":"2024-04-26T12:26:54.253202+0000","last_fullsized":"2024-04-26T12:26:54.253202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254141+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:26:54.254141+0000","last_peered":"2024-04-26T12:26:54.254141+0000","last_clean":"2024-04-26T12:26:54.254141+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:26:54.254141+0000","last_undegraded":"2024-04-26T12:26:54.254141+0000","last_fullsized":"2024-04-26T12:26:54.254141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251798+0000","last_change":"2024-04-26T12:26:53.262898+0000","last_active":"2024-04-26T12:26:54.251798+0000","last_peered":"2024-04-26T12:26:54.251798+0000","last_clean":"2024-04-26T12:26:54.251798+0000","last_became_active":"2024-04-26T12:26:53.262603+0000","last_became_peered":"2024-04-26T12:26:53.262603+0000","last_unstale":"2024-04-26T12:26:54.251798+0000","last_undegraded":"2024-04-26T12:26:54.251798+0000","last_fullsized":"2024-04-26T12:26:54.251798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254215+0000","last_change":"2024-04-26T12:26:53.254395+0000","last_active":"2024-04-26T12:26:54.254215+0000","last_peered":"2024-04-26T12:26:54.254215+0000","last_clean":"2024-04-26T12:26:54.254215+0000","last_became_active":"2024-04-26T12:26:53.253946+0000","last_became_peered":"2024-04-26T12:26:53.253946+0000","last_unstale":"2024-04-26T12:26:54.254215+0000","last_undegraded":"2024-04-26T12:26:54.254215+0000","last_fullsized":"2024-04-26T12:26:54.254215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:41.501818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254992+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:26:54.254992+0000","last_peered":"2024-04-26T12:26:54.254992+0000","last_clean":"2024-04-26T12:26:54.254992+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:26:54.254992+0000","last_undegraded":"2024-04-26T12:26:54.254992+0000","last_fullsized":"2024-04-26T12:26:54.254992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252630+0000","last_change":"2024-04-26T12:26:53.261876+0000","last_active":"2024-04-26T12:26:54.252630+0000","last_peered":"2024-04-26T12:26:54.252630+0000","last_clean":"2024-04-26T12:26:54.252630+0000","last_became_active":"2024-04-26T12:26:53.261485+0000","last_became_peered":"2024-04-26T12:26:53.261485+0000","last_unstale":"2024-04-26T12:26:54.252630+0000","last_undegraded":"2024-04-26T12:26:54.252630+0000","last_fullsized":"2024-04-26T12:26:54.252630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253751+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:26:54.253751+0000","last_peered":"2024-04-26T12:26:54.253751+0000","last_clean":"2024-04-26T12:26:54.253751+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:26:54.253751+0000","last_undegraded":"2024-04-26T12:26:54.253751+0000","last_fullsized":"2024-04-26T12:26:54.253751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254119+0000","last_change":"2024-04-26T12:26:52.839543+0000","last_active":"2024-04-26T12:26:54.254119+0000","last_peered":"2024-04-26T12:26:54.254119+0000","last_clean":"2024-04-26T12:26:54.254119+0000","last_became_active":"2024-04-26T12:26:52.839080+0000","last_became_peered":"2024-04-26T12:26:52.839080+0000","last_unstale":"2024-04-26T12:26:54.254119+0000","last_undegraded":"2024-04-26T12:26:54.254119+0000","last_fullsized":"2024-04-26T12:26:54.254119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:18.329898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254904+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:26:54.254904+0000","last_peered":"2024-04-26T12:26:54.254904+0000","last_clean":"2024-04-26T12:26:54.254904+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:26:54.254904+0000","last_undegraded":"2024-04-26T12:26:54.254904+0000","last_fullsized":"2024-04-26T12:26:54.254904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251794+0000","last_change":"2024-04-26T12:26:52.838082+0000","last_active":"2024-04-26T12:26:54.251794+0000","last_peered":"2024-04-26T12:26:54.251794+0000","last_clean":"2024-04-26T12:26:54.251794+0000","last_became_active":"2024-04-26T12:26:52.837596+0000","last_became_peered":"2024-04-26T12:26:52.837596+0000","last_unstale":"2024-04-26T12:26:54.251794+0000","last_undegraded":"2024-04-26T12:26:54.251794+0000","last_fullsized":"2024-04-26T12:26:54.251794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:08.892977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252572+0000","last_change":"2024-04-26T12:26:53.262665+0000","last_active":"2024-04-26T12:26:54.252572+0000","last_peered":"2024-04-26T12:26:54.252572+0000","last_clean":"2024-04-26T12:26:54.252572+0000","last_became_active":"2024-04-26T12:26:53.262161+0000","last_became_peered":"2024-04-26T12:26:53.262161+0000","last_unstale":"2024-04-26T12:26:54.252572+0000","last_undegraded":"2024-04-26T12:26:54.252572+0000","last_fullsized":"2024-04-26T12:26:54.252572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251650+0000","last_change":"2024-04-26T12:26:52.833500+0000","last_active":"2024-04-26T12:26:54.251650+0000","last_peered":"2024-04-26T12:26:54.251650+0000","last_clean":"2024-04-26T12:26:54.251650+0000","last_became_active":"2024-04-26T12:26:52.833152+0000","last_became_peered":"2024-04-26T12:26:52.833152+0000","last_unstale":"2024-04-26T12:26:54.251650+0000","last_undegraded":"2024-04-26T12:26:54.251650+0000","last_fullsized":"2024-04-26T12:26:54.251650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:28.165579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.255028+0000","last_change":"2024-04-26T12:26:53.260764+0000","last_active":"2024-04-26T12:26:54.255028+0000","last_peered":"2024-04-26T12:26:54.255028+0000","last_clean":"2024-04-26T12:26:54.255028+0000","last_became_active":"2024-04-26T12:26:53.260388+0000","last_became_peered":"2024-04-26T12:26:53.260388+0000","last_unstale":"2024-04-26T12:26:54.255028+0000","last_undegraded":"2024-04-26T12:26:54.255028+0000","last_fullsized":"2024-04-26T12:26:54.255028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252735+0000","last_change":"2024-04-26T12:26:52.837792+0000","last_active":"2024-04-26T12:26:54.252735+0000","last_peered":"2024-04-26T12:26:54.252735+0000","last_clean":"2024-04-26T12:26:54.252735+0000","last_became_active":"2024-04-26T12:26:52.837272+0000","last_became_peered":"2024-04-26T12:26:52.837272+0000","last_unstale":"2024-04-26T12:26:54.252735+0000","last_undegraded":"2024-04-26T12:26:54.252735+0000","last_fullsized":"2024-04-26T12:26:54.252735+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:12.837493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251539+0000","last_change":"2024-04-26T12:26:53.255423+0000","last_active":"2024-04-26T12:26:54.251539+0000","last_peered":"2024-04-26T12:26:54.251539+0000","last_clean":"2024-04-26T12:26:54.251539+0000","last_became_active":"2024-04-26T12:26:53.253812+0000","last_became_peered":"2024-04-26T12:26:53.253812+0000","last_unstale":"2024-04-26T12:26:54.251539+0000","last_undegraded":"2024-04-26T12:26:54.251539+0000","last_fullsized":"2024-04-26T12:26:54.251539+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:37.907024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253542+0000","last_change":"2024-04-26T12:26:52.840163+0000","last_active":"2024-04-26T12:26:54.253542+0000","last_peered":"2024-04-26T12:26:54.253542+0000","last_clean":"2024-04-26T12:26:54.253542+0000","last_became_active":"2024-04-26T12:26:52.839246+0000","last_became_peered":"2024-04-26T12:26:52.839246+0000","last_unstale":"2024-04-26T12:26:54.253542+0000","last_undegraded":"2024-04-26T12:26:54.253542+0000","last_fullsized":"2024-04-26T12:26:54.253542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:44.809454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251997+0000","last_change":"2024-04-26T12:26:53.258963+0000","last_active":"2024-04-26T12:26:54.251997+0000","last_peered":"2024-04-26T12:26:54.251997+0000","last_clean":"2024-04-26T12:26:54.251997+0000","last_became_active":"2024-04-26T12:26:53.258171+0000","last_became_peered":"2024-04-26T12:26:53.258171+0000","last_unstale":"2024-04-26T12:26:54.251997+0000","last_undegraded":"2024-04-26T12:26:54.251997+0000","last_fullsized":"2024-04-26T12:26:54.251997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254770+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:26:54.254770+0000","last_peered":"2024-04-26T12:26:54.254770+0000","last_clean":"2024-04-26T12:26:54.254770+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:26:54.254770+0000","last_undegraded":"2024-04-26T12:26:54.254770+0000","last_fullsized":"2024-04-26T12:26:54.254770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251746+0000","last_change":"2024-04-26T12:26:53.259209+0000","last_active":"2024-04-26T12:26:54.251746+0000","last_peered":"2024-04-26T12:26:54.251746+0000","last_clean":"2024-04-26T12:26:54.251746+0000","last_became_active":"2024-04-26T12:26:53.258620+0000","last_became_peered":"2024-04-26T12:26:53.258620+0000","last_unstale":"2024-04-26T12:26:54.251746+0000","last_undegraded":"2024-04-26T12:26:54.251746+0000","last_fullsized":"2024-04-26T12:26:54.251746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253386+0000","last_change":"2024-04-26T12:26:52.841280+0000","last_active":"2024-04-26T12:26:54.253386+0000","last_peered":"2024-04-26T12:26:54.253386+0000","last_clean":"2024-04-26T12:26:54.253386+0000","last_became_active":"2024-04-26T12:26:52.839398+0000","last_became_peered":"2024-04-26T12:26:52.839398+0000","last_unstale":"2024-04-26T12:26:54.253386+0000","last_undegraded":"2024-04-26T12:26:54.253386+0000","last_fullsized":"2024-04-26T12:26:54.253386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:53.889623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253612+0000","last_change":"2024-04-26T12:26:53.260830+0000","last_active":"2024-04-26T12:26:54.253612+0000","last_peered":"2024-04-26T12:26:54.253612+0000","last_clean":"2024-04-26T12:26:54.253612+0000","last_became_active":"2024-04-26T12:26:53.259452+0000","last_became_peered":"2024-04-26T12:26:53.259452+0000","last_unstale":"2024-04-26T12:26:54.253612+0000","last_undegraded":"2024-04-26T12:26:54.253612+0000","last_fullsized":"2024-04-26T12:26:54.253612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253560+0000","last_change":"2024-04-26T12:26:52.840521+0000","last_active":"2024-04-26T12:26:54.253560+0000","last_peered":"2024-04-26T12:26:54.253560+0000","last_clean":"2024-04-26T12:26:54.253560+0000","last_became_active":"2024-04-26T12:26:52.839442+0000","last_became_peered":"2024-04-26T12:26:52.839442+0000","last_unstale":"2024-04-26T12:26:54.253560+0000","last_undegraded":"2024-04-26T12:26:54.253560+0000","last_fullsized":"2024-04-26T12:26:54.253560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:28.165579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254485+0000","last_change":"2024-04-26T12:26:53.254489+0000","last_active":"2024-04-26T12:26:54.254485+0000","last_peered":"2024-04-26T12:26:54.254485+0000","last_clean":"2024-04-26T12:26:54.254485+0000","last_became_active":"2024-04-26T12:26:53.254099+0000","last_became_peered":"2024-04-26T12:26:53.254099+0000","last_unstale":"2024-04-26T12:26:54.254485+0000","last_undegraded":"2024-04-26T12:26:54.254485+0000","last_fullsized":"2024-04-26T12:26:54.254485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251939+0000","last_change":"2024-04-26T12:26:52.837857+0000","last_active":"2024-04-26T12:26:54.251939+0000","last_peered":"2024-04-26T12:26:54.251939+0000","last_clean":"2024-04-26T12:26:54.251939+0000","last_became_active":"2024-04-26T12:26:52.837402+0000","last_became_peered":"2024-04-26T12:26:52.837402+0000","last_unstale":"2024-04-26T12:26:54.251939+0000","last_undegraded":"2024-04-26T12:26:54.251939+0000","last_fullsized":"2024-04-26T12:26:54.251939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:53.889623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254865+0000","last_change":"2024-04-26T12:26:53.255659+0000","last_active":"2024-04-26T12:26:54.254865+0000","last_peered":"2024-04-26T12:26:54.254865+0000","last_clean":"2024-04-26T12:26:54.254865+0000","last_became_active":"2024-04-26T12:26:53.255253+0000","last_became_peered":"2024-04-26T12:26:53.255253+0000","last_unstale":"2024-04-26T12:26:54.254865+0000","last_undegraded":"2024-04-26T12:26:54.254865+0000","last_fullsized":"2024-04-26T12:26:54.254865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.236196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254021+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:26:54.254021+0000","last_peered":"2024-04-26T12:26:54.254021+0000","last_clean":"2024-04-26T12:26:54.254021+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:26:54.254021+0000","last_undegraded":"2024-04-26T12:26:54.254021+0000","last_fullsized":"2024-04-26T12:26:54.254021+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252460+0000","last_change":"2024-04-26T12:26:53.261880+0000","last_active":"2024-04-26T12:26:54.252460+0000","last_peered":"2024-04-26T12:26:54.252460+0000","last_clean":"2024-04-26T12:26:54.252460+0000","last_became_active":"2024-04-26T12:26:53.261373+0000","last_became_peered":"2024-04-26T12:26:53.261373+0000","last_unstale":"2024-04-26T12:26:54.252460+0000","last_undegraded":"2024-04-26T12:26:54.252460+0000","last_fullsized":"2024-04-26T12:26:54.252460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253014+0000","last_change":"2024-04-26T12:26:52.840810+0000","last_active":"2024-04-26T12:26:54.253014+0000","last_peered":"2024-04-26T12:26:54.253014+0000","last_clean":"2024-04-26T12:26:54.253014+0000","last_became_active":"2024-04-26T12:26:52.840059+0000","last_became_peered":"2024-04-26T12:26:52.840059+0000","last_unstale":"2024-04-26T12:26:54.253014+0000","last_undegraded":"2024-04-26T12:26:54.253014+0000","last_fullsized":"2024-04-26T12:26:54.253014+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:17.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252819+0000","last_change":"2024-04-26T12:26:53.265200+0000","last_active":"2024-04-26T12:26:54.252819+0000","last_peered":"2024-04-26T12:26:54.252819+0000","last_clean":"2024-04-26T12:26:54.252819+0000","last_became_active":"2024-04-26T12:26:53.264830+0000","last_became_peered":"2024-04-26T12:26:53.264830+0000","last_unstale":"2024-04-26T12:26:54.252819+0000","last_undegraded":"2024-04-26T12:26:54.252819+0000","last_fullsized":"2024-04-26T12:26:54.252819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253700+0000","last_change":"2024-04-26T12:26:52.840684+0000","last_active":"2024-04-26T12:26:54.253700+0000","last_peered":"2024-04-26T12:26:54.253700+0000","last_clean":"2024-04-26T12:26:54.253700+0000","last_became_active":"2024-04-26T12:26:52.839414+0000","last_became_peered":"2024-04-26T12:26:52.839414+0000","last_unstale":"2024-04-26T12:26:54.253700+0000","last_undegraded":"2024-04-26T12:26:54.253700+0000","last_fullsized":"2024-04-26T12:26:54.253700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:12.837493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253759+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:26:54.253759+0000","last_peered":"2024-04-26T12:26:54.253759+0000","last_clean":"2024-04-26T12:26:54.253759+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:26:54.253759+0000","last_undegraded":"2024-04-26T12:26:54.253759+0000","last_fullsized":"2024-04-26T12:26:54.253759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254691+0000","last_change":"2024-04-26T12:26:52.839692+0000","last_active":"2024-04-26T12:26:54.254691+0000","last_peered":"2024-04-26T12:26:54.254691+0000","last_clean":"2024-04-26T12:26:54.254691+0000","last_became_active":"2024-04-26T12:26:52.839419+0000","last_became_peered":"2024-04-26T12:26:52.839419+0000","last_unstale":"2024-04-26T12:26:54.254691+0000","last_undegraded":"2024-04-26T12:26:54.254691+0000","last_fullsized":"2024-04-26T12:26:54.254691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:25.416851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254179+0000","last_change":"2024-04-26T12:26:53.254395+0000","last_active":"2024-04-26T12:26:54.254179+0000","last_peered":"2024-04-26T12:26:54.254179+0000","last_clean":"2024-04-26T12:26:54.254179+0000","last_became_active":"2024-04-26T12:26:53.253926+0000","last_became_peered":"2024-04-26T12:26:53.253926+0000","last_unstale":"2024-04-26T12:26:54.254179+0000","last_undegraded":"2024-04-26T12:26:54.254179+0000","last_fullsized":"2024-04-26T12:26:54.254179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:59.517606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253817+0000","last_change":"2024-04-26T12:26:52.842023+0000","last_active":"2024-04-26T12:26:54.253817+0000","last_peered":"2024-04-26T12:26:54.253817+0000","last_clean":"2024-04-26T12:26:54.253817+0000","last_became_active":"2024-04-26T12:26:52.840857+0000","last_became_peered":"2024-04-26T12:26:52.840857+0000","last_unstale":"2024-04-26T12:26:54.253817+0000","last_undegraded":"2024-04-26T12:26:54.253817+0000","last_fullsized":"2024-04-26T12:26:54.253817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:08.892977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253219+0000","last_change":"2024-04-26T12:26:53.263148+0000","last_active":"2024-04-26T12:26:54.253219+0000","last_peered":"2024-04-26T12:26:54.253219+0000","last_clean":"2024-04-26T12:26:54.253219+0000","last_became_active":"2024-04-26T12:26:53.261904+0000","last_became_peered":"2024-04-26T12:26:53.261904+0000","last_unstale":"2024-04-26T12:26:54.253219+0000","last_undegraded":"2024-04-26T12:26:54.253219+0000","last_fullsized":"2024-04-26T12:26:54.253219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253194+0000","last_change":"2024-04-26T12:26:52.841895+0000","last_active":"2024-04-26T12:26:54.253194+0000","last_peered":"2024-04-26T12:26:54.253194+0000","last_clean":"2024-04-26T12:26:54.253194+0000","last_became_active":"2024-04-26T12:26:52.840195+0000","last_became_peered":"2024-04-26T12:26:52.840195+0000","last_unstale":"2024-04-26T12:26:54.253194+0000","last_undegraded":"2024-04-26T12:26:54.253194+0000","last_fullsized":"2024-04-26T12:26:54.253194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:03.469888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252358+0000","last_change":"2024-04-26T12:26:53.265195+0000","last_active":"2024-04-26T12:26:54.252358+0000","last_peered":"2024-04-26T12:26:54.252358+0000","last_clean":"2024-04-26T12:26:54.252358+0000","last_became_active":"2024-04-26T12:26:53.264819+0000","last_became_peered":"2024-04-26T12:26:53.264819+0000","last_unstale":"2024-04-26T12:26:54.252358+0000","last_undegraded":"2024-04-26T12:26:54.252358+0000","last_fullsized":"2024-04-26T12:26:54.252358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252231+0000","last_change":"2024-04-26T12:26:52.837057+0000","last_active":"2024-04-26T12:26:54.252231+0000","last_peered":"2024-04-26T12:26:54.252231+0000","last_clean":"2024-04-26T12:26:54.252231+0000","last_became_active":"2024-04-26T12:26:52.836594+0000","last_became_peered":"2024-04-26T12:26:52.836594+0000","last_unstale":"2024-04-26T12:26:54.252231+0000","last_undegraded":"2024-04-26T12:26:54.252231+0000","last_fullsized":"2024-04-26T12:26:54.252231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:42.768206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253143+0000","last_change":"2024-04-26T12:26:53.263194+0000","last_active":"2024-04-26T12:26:54.253143+0000","last_peered":"2024-04-26T12:26:54.253143+0000","last_clean":"2024-04-26T12:26:54.253143+0000","last_became_active":"2024-04-26T12:26:53.262366+0000","last_became_peered":"2024-04-26T12:26:53.262366+0000","last_unstale":"2024-04-26T12:26:54.253143+0000","last_undegraded":"2024-04-26T12:26:54.253143+0000","last_fullsized":"2024-04-26T12:26:54.253143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253105+0000","last_change":"2024-04-26T12:26:52.842337+0000","last_active":"2024-04-26T12:26:54.253105+0000","last_peered":"2024-04-26T12:26:54.253105+0000","last_clean":"2024-04-26T12:26:54.253105+0000","last_became_active":"2024-04-26T12:26:52.842009+0000","last_became_peered":"2024-04-26T12:26:52.842009+0000","last_unstale":"2024-04-26T12:26:54.253105+0000","last_undegraded":"2024-04-26T12:26:54.253105+0000","last_fullsized":"2024-04-26T12:26:54.253105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253989+0000","last_change":"2024-04-26T12:26:53.266014+0000","last_active":"2024-04-26T12:26:54.253989+0000","last_peered":"2024-04-26T12:26:54.253989+0000","last_clean":"2024-04-26T12:26:54.253989+0000","last_became_active":"2024-04-26T12:26:53.264254+0000","last_became_peered":"2024-04-26T12:26:53.264254+0000","last_unstale":"2024-04-26T12:26:54.253989+0000","last_undegraded":"2024-04-26T12:26:54.253989+0000","last_fullsized":"2024-04-26T12:26:54.253989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:04.369827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253838+0000","last_change":"2024-04-26T12:26:52.839759+0000","last_active":"2024-04-26T12:26:54.253838+0000","last_peered":"2024-04-26T12:26:54.253838+0000","last_clean":"2024-04-26T12:26:54.253838+0000","last_became_active":"2024-04-26T12:26:52.839445+0000","last_became_peered":"2024-04-26T12:26:52.839445+0000","last_unstale":"2024-04-26T12:26:54.253838+0000","last_undegraded":"2024-04-26T12:26:54.253838+0000","last_fullsized":"2024-04-26T12:26:54.253838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:40.499263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253688+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:26:54.253688+0000","last_peered":"2024-04-26T12:26:54.253688+0000","last_clean":"2024-04-26T12:26:54.253688+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:26:54.253688+0000","last_undegraded":"2024-04-26T12:26:54.253688+0000","last_fullsized":"2024-04-26T12:26:54.253688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253924+0000","last_change":"2024-04-26T12:26:52.839211+0000","last_active":"2024-04-26T12:26:54.253924+0000","last_peered":"2024-04-26T12:26:54.253924+0000","last_clean":"2024-04-26T12:26:54.253924+0000","last_became_active":"2024-04-26T12:26:52.838988+0000","last_became_peered":"2024-04-26T12:26:52.838988+0000","last_unstale":"2024-04-26T12:26:54.253924+0000","last_undegraded":"2024-04-26T12:26:54.253924+0000","last_fullsized":"2024-04-26T12:26:54.253924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:04.569832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252653+0000","last_change":"2024-04-26T12:26:53.260098+0000","last_active":"2024-04-26T12:26:54.252653+0000","last_peered":"2024-04-26T12:26:54.252653+0000","last_clean":"2024-04-26T12:26:54.252653+0000","last_became_active":"2024-04-26T12:26:53.259188+0000","last_became_peered":"2024-04-26T12:26:53.259188+0000","last_unstale":"2024-04-26T12:26:54.252653+0000","last_undegraded":"2024-04-26T12:26:54.252653+0000","last_fullsized":"2024-04-26T12:26:54.252653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:34.496560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.248033+0000","last_change":"2024-04-26T12:26:47.810338+0000","last_active":"2024-04-26T12:26:53.248033+0000","last_peered":"2024-04-26T12:26:53.248033+0000","last_clean":"2024-04-26T12:26:53.248033+0000","last_became_active":"2024-04-26T12:26:47.810127+0000","last_became_peered":"2024-04-26T12:26:47.810127+0000","last_unstale":"2024-04-26T12:26:53.248033+0000","last_undegraded":"2024-04-26T12:26:53.248033+0000","last_fullsized":"2024-04-26T12:26:53.248033+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:11.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253912+0000","last_change":"2024-04-26T12:26:52.841192+0000","last_active":"2024-04-26T12:26:54.253912+0000","last_peered":"2024-04-26T12:26:54.253912+0000","last_clean":"2024-04-26T12:26:54.253912+0000","last_became_active":"2024-04-26T12:26:52.840137+0000","last_became_peered":"2024-04-26T12:26:52.840137+0000","last_unstale":"2024-04-26T12:26:54.253912+0000","last_undegraded":"2024-04-26T12:26:54.253912+0000","last_fullsized":"2024-04-26T12:26:54.253912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:20.488738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254278+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:26:54.254278+0000","last_peered":"2024-04-26T12:26:54.254278+0000","last_clean":"2024-04-26T12:26:54.254278+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:26:54.254278+0000","last_undegraded":"2024-04-26T12:26:54.254278+0000","last_fullsized":"2024-04-26T12:26:54.254278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.257442+0000","last_change":"2024-04-26T12:26:47.811997+0000","last_active":"2024-04-26T12:26:53.257442+0000","last_peered":"2024-04-26T12:26:53.257442+0000","last_clean":"2024-04-26T12:26:53.257442+0000","last_became_active":"2024-04-26T12:26:47.811819+0000","last_became_peered":"2024-04-26T12:26:47.811819+0000","last_unstale":"2024-04-26T12:26:53.257442+0000","last_undegraded":"2024-04-26T12:26:53.257442+0000","last_fullsized":"2024-04-26T12:26:53.257442+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:11.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253332+0000","last_change":"2024-04-26T12:26:52.841195+0000","last_active":"2024-04-26T12:26:54.253332+0000","last_peered":"2024-04-26T12:26:54.253332+0000","last_clean":"2024-04-26T12:26:54.253332+0000","last_became_active":"2024-04-26T12:26:52.839558+0000","last_became_peered":"2024-04-26T12:26:52.839558+0000","last_unstale":"2024-04-26T12:26:54.253332+0000","last_undegraded":"2024-04-26T12:26:54.253332+0000","last_fullsized":"2024-04-26T12:26:54.253332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:54.208845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252177+0000","last_change":"2024-04-26T12:26:53.259270+0000","last_active":"2024-04-26T12:26:54.252177+0000","last_peered":"2024-04-26T12:26:54.252177+0000","last_clean":"2024-04-26T12:26:54.252177+0000","last_became_active":"2024-04-26T12:26:53.258588+0000","last_became_peered":"2024-04-26T12:26:53.258588+0000","last_unstale":"2024-04-26T12:26:54.252177+0000","last_undegraded":"2024-04-26T12:26:54.252177+0000","last_fullsized":"2024-04-26T12:26:54.252177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:09.233018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.247515+0000","last_change":"2024-04-26T12:26:47.811787+0000","last_active":"2024-04-26T12:26:53.247515+0000","last_peered":"2024-04-26T12:26:53.247515+0000","last_clean":"2024-04-26T12:26:53.247515+0000","last_became_active":"2024-04-26T12:26:47.811512+0000","last_became_peered":"2024-04-26T12:26:47.811512+0000","last_unstale":"2024-04-26T12:26:53.247515+0000","last_undegraded":"2024-04-26T12:26:53.247515+0000","last_fullsized":"2024-04-26T12:26:53.247515+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:56.379533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253871+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:26:54.253871+0000","last_peered":"2024-04-26T12:26:54.253871+0000","last_clean":"2024-04-26T12:26:54.253871+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:26:54.253871+0000","last_undegraded":"2024-04-26T12:26:54.253871+0000","last_fullsized":"2024-04-26T12:26:54.253871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252748+0000","last_change":"2024-04-26T12:26:53.260244+0000","last_active":"2024-04-26T12:26:54.252748+0000","last_peered":"2024-04-26T12:26:54.252748+0000","last_clean":"2024-04-26T12:26:54.252748+0000","last_became_active":"2024-04-26T12:26:53.259917+0000","last_became_peered":"2024-04-26T12:26:53.259917+0000","last_unstale":"2024-04-26T12:26:54.252748+0000","last_undegraded":"2024-04-26T12:26:54.252748+0000","last_fullsized":"2024-04-26T12:26:54.252748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258160+0000","last_change":"2024-04-26T12:26:47.812045+0000","last_active":"2024-04-26T12:26:53.258160+0000","last_peered":"2024-04-26T12:26:53.258160+0000","last_clean":"2024-04-26T12:26:53.258160+0000","last_became_active":"2024-04-26T12:26:47.811787+0000","last_became_peered":"2024-04-26T12:26:47.811787+0000","last_unstale":"2024-04-26T12:26:53.258160+0000","last_undegraded":"2024-04-26T12:26:53.258160+0000","last_fullsized":"2024-04-26T12:26:53.258160+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:30.757169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":211,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258235+0000","last_change":"2024-04-26T12:26:46.810189+0000","last_active":"2024-04-26T12:26:53.258235+0000","last_peered":"2024-04-26T12:26:53.258235+0000","last_clean":"2024-04-26T12:26:53.258235+0000","last_became_active":"2024-04-26T12:26:46.809453+0000","last_became_peered":"2024-04-26T12:26:46.809453+0000","last_unstale":"2024-04-26T12:26:53.258235+0000","last_undegraded":"2024-04-26T12:26:53.258235+0000","last_fullsized":"2024-04-26T12:26:53.258235+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:18.618650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251680+0000","last_change":"2024-04-26T12:26:52.833869+0000","last_active":"2024-04-26T12:26:54.251680+0000","last_peered":"2024-04-26T12:26:54.251680+0000","last_clean":"2024-04-26T12:26:54.251680+0000","last_became_active":"2024-04-26T12:26:52.833257+0000","last_became_peered":"2024-04-26T12:26:52.833257+0000","last_unstale":"2024-04-26T12:26:54.251680+0000","last_undegraded":"2024-04-26T12:26:54.251680+0000","last_fullsized":"2024-04-26T12:26:54.251680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253947+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:26:54.253947+0000","last_peered":"2024-04-26T12:26:54.253947+0000","last_clean":"2024-04-26T12:26:54.253947+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:26:54.253947+0000","last_undegraded":"2024-04-26T12:26:54.253947+0000","last_fullsized":"2024-04-26T12:26:54.253947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258561+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:26:53.258561+0000","last_peered":"2024-04-26T12:26:53.258561+0000","last_clean":"2024-04-26T12:26:53.258561+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:26:53.258561+0000","last_undegraded":"2024-04-26T12:26:53.258561+0000","last_fullsized":"2024-04-26T12:26:53.258561+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251513+0000","last_change":"2024-04-26T12:26:52.836395+0000","last_active":"2024-04-26T12:26:54.251513+0000","last_peered":"2024-04-26T12:26:54.251513+0000","last_clean":"2024-04-26T12:26:54.251513+0000","last_became_active":"2024-04-26T12:26:52.836023+0000","last_became_peered":"2024-04-26T12:26:52.836023+0000","last_unstale":"2024-04-26T12:26:54.251513+0000","last_undegraded":"2024-04-26T12:26:54.251513+0000","last_fullsized":"2024-04-26T12:26:54.251513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:54.208845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254838+0000","last_change":"2024-04-26T12:26:53.260768+0000","last_active":"2024-04-26T12:26:54.254838+0000","last_peered":"2024-04-26T12:26:54.254838+0000","last_clean":"2024-04-26T12:26:54.254838+0000","last_became_active":"2024-04-26T12:26:53.259807+0000","last_became_peered":"2024-04-26T12:26:53.259807+0000","last_unstale":"2024-04-26T12:26:54.254838+0000","last_undegraded":"2024-04-26T12:26:54.254838+0000","last_fullsized":"2024-04-26T12:26:54.254838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.250666+0000","last_change":"2024-04-26T12:26:47.812595+0000","last_active":"2024-04-26T12:26:53.250666+0000","last_peered":"2024-04-26T12:26:53.250666+0000","last_clean":"2024-04-26T12:26:53.250666+0000","last_became_active":"2024-04-26T12:26:47.812366+0000","last_became_peered":"2024-04-26T12:26:47.812366+0000","last_unstale":"2024-04-26T12:26:53.250666+0000","last_undegraded":"2024-04-26T12:26:53.250666+0000","last_fullsized":"2024-04-26T12:26:53.250666+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:57.920665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252434+0000","last_change":"2024-04-26T12:26:52.833996+0000","last_active":"2024-04-26T12:26:54.252434+0000","last_peered":"2024-04-26T12:26:54.252434+0000","last_clean":"2024-04-26T12:26:54.252434+0000","last_became_active":"2024-04-26T12:26:52.833452+0000","last_became_peered":"2024-04-26T12:26:52.833452+0000","last_unstale":"2024-04-26T12:26:54.252434+0000","last_undegraded":"2024-04-26T12:26:54.252434+0000","last_fullsized":"2024-04-26T12:26:54.252434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254460+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:26:54.254460+0000","last_peered":"2024-04-26T12:26:54.254460+0000","last_clean":"2024-04-26T12:26:54.254460+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:26:54.254460+0000","last_undegraded":"2024-04-26T12:26:54.254460+0000","last_fullsized":"2024-04-26T12:26:54.254460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252570+0000","last_change":"2024-04-26T12:26:52.837167+0000","last_active":"2024-04-26T12:26:54.252570+0000","last_peered":"2024-04-26T12:26:54.252570+0000","last_clean":"2024-04-26T12:26:54.252570+0000","last_became_active":"2024-04-26T12:26:52.836534+0000","last_became_peered":"2024-04-26T12:26:52.836534+0000","last_unstale":"2024-04-26T12:26:54.252570+0000","last_undegraded":"2024-04-26T12:26:54.252570+0000","last_fullsized":"2024-04-26T12:26:54.252570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:17.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.248427+0000","last_change":"2024-04-26T12:26:47.811807+0000","last_active":"2024-04-26T12:26:53.248427+0000","last_peered":"2024-04-26T12:26:53.248427+0000","last_clean":"2024-04-26T12:26:53.248427+0000","last_became_active":"2024-04-26T12:26:47.811527+0000","last_became_peered":"2024-04-26T12:26:47.811527+0000","last_unstale":"2024-04-26T12:26:53.248427+0000","last_undegraded":"2024-04-26T12:26:53.248427+0000","last_fullsized":"2024-04-26T12:26:53.248427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:02.127354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251466+0000","last_change":"2024-04-26T12:26:53.265773+0000","last_active":"2024-04-26T12:26:54.251466+0000","last_peered":"2024-04-26T12:26:54.251466+0000","last_clean":"2024-04-26T12:26:54.251466+0000","last_became_active":"2024-04-26T12:26:53.265567+0000","last_became_peered":"2024-04-26T12:26:53.265567+0000","last_unstale":"2024-04-26T12:26:54.251466+0000","last_undegraded":"2024-04-26T12:26:54.251466+0000","last_fullsized":"2024-04-26T12:26:54.251466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258624+0000","last_change":"2024-04-26T12:26:47.811204+0000","last_active":"2024-04-26T12:26:53.258624+0000","last_peered":"2024-04-26T12:26:53.258624+0000","last_clean":"2024-04-26T12:26:53.258624+0000","last_became_active":"2024-04-26T12:26:47.810997+0000","last_became_peered":"2024-04-26T12:26:47.810997+0000","last_unstale":"2024-04-26T12:26:53.258624+0000","last_undegraded":"2024-04-26T12:26:53.258624+0000","last_fullsized":"2024-04-26T12:26:53.258624+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:24.967175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252473+0000","last_change":"2024-04-26T12:26:52.837269+0000","last_active":"2024-04-26T12:26:54.252473+0000","last_peered":"2024-04-26T12:26:54.252473+0000","last_clean":"2024-04-26T12:26:54.252473+0000","last_became_active":"2024-04-26T12:26:52.836310+0000","last_became_peered":"2024-04-26T12:26:52.836310+0000","last_unstale":"2024-04-26T12:26:54.252473+0000","last_undegraded":"2024-04-26T12:26:54.252473+0000","last_fullsized":"2024-04-26T12:26:54.252473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:20.488738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254362+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:26:54.254362+0000","last_peered":"2024-04-26T12:26:54.254362+0000","last_clean":"2024-04-26T12:26:54.254362+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:26:54.254362+0000","last_undegraded":"2024-04-26T12:26:54.254362+0000","last_fullsized":"2024-04-26T12:26:54.254362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254162+0000","last_change":"2024-04-26T12:26:52.840797+0000","last_active":"2024-04-26T12:26:54.254162+0000","last_peered":"2024-04-26T12:26:54.254162+0000","last_clean":"2024-04-26T12:26:54.254162+0000","last_became_active":"2024-04-26T12:26:52.840409+0000","last_became_peered":"2024-04-26T12:26:52.840409+0000","last_unstale":"2024-04-26T12:26:54.254162+0000","last_undegraded":"2024-04-26T12:26:54.254162+0000","last_fullsized":"2024-04-26T12:26:54.254162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:57.898978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254682+0000","last_change":"2024-04-26T12:26:53.255044+0000","last_active":"2024-04-26T12:26:54.254682+0000","last_peered":"2024-04-26T12:26:54.254682+0000","last_clean":"2024-04-26T12:26:54.254682+0000","last_became_active":"2024-04-26T12:26:53.254164+0000","last_became_peered":"2024-04-26T12:26:53.254164+0000","last_unstale":"2024-04-26T12:26:54.254682+0000","last_undegraded":"2024-04-26T12:26:54.254682+0000","last_fullsized":"2024-04-26T12:26:54.254682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:07.899699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253335+0000","last_change":"2024-04-26T12:26:52.841338+0000","last_active":"2024-04-26T12:26:54.253335+0000","last_peered":"2024-04-26T12:26:54.253335+0000","last_clean":"2024-04-26T12:26:54.253335+0000","last_became_active":"2024-04-26T12:26:52.840770+0000","last_became_peered":"2024-04-26T12:26:52.840770+0000","last_unstale":"2024-04-26T12:26:54.253335+0000","last_undegraded":"2024-04-26T12:26:54.253335+0000","last_fullsized":"2024-04-26T12:26:54.253335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:33.466992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253384+0000","last_change":"2024-04-26T12:26:53.260953+0000","last_active":"2024-04-26T12:26:54.253384+0000","last_peered":"2024-04-26T12:26:54.253384+0000","last_clean":"2024-04-26T12:26:54.253384+0000","last_became_active":"2024-04-26T12:26:53.259228+0000","last_became_peered":"2024-04-26T12:26:53.259228+0000","last_unstale":"2024-04-26T12:26:54.253384+0000","last_undegraded":"2024-04-26T12:26:54.253384+0000","last_fullsized":"2024-04-26T12:26:54.253384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254744+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:26:54.254744+0000","last_peered":"2024-04-26T12:26:54.254744+0000","last_clean":"2024-04-26T12:26:54.254744+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:26:54.254744+0000","last_undegraded":"2024-04-26T12:26:54.254744+0000","last_fullsized":"2024-04-26T12:26:54.254744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253334+0000","last_change":"2024-04-26T12:26:53.262221+0000","last_active":"2024-04-26T12:26:54.253334+0000","last_peered":"2024-04-26T12:26:54.253334+0000","last_clean":"2024-04-26T12:26:54.253334+0000","last_became_active":"2024-04-26T12:26:53.261112+0000","last_became_peered":"2024-04-26T12:26:53.261112+0000","last_unstale":"2024-04-26T12:26:54.253334+0000","last_undegraded":"2024-04-26T12:26:54.253334+0000","last_fullsized":"2024-04-26T12:26:54.253334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252558+0000","last_change":"2024-04-26T12:26:52.837399+0000","last_active":"2024-04-26T12:26:54.252558+0000","last_peered":"2024-04-26T12:26:54.252558+0000","last_clean":"2024-04-26T12:26:54.252558+0000","last_became_active":"2024-04-26T12:26:52.835974+0000","last_became_peered":"2024-04-26T12:26:52.835974+0000","last_unstale":"2024-04-26T12:26:54.252558+0000","last_undegraded":"2024-04-26T12:26:54.252558+0000","last_fullsized":"2024-04-26T12:26:54.252558+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:03.469888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254323+0000","last_change":"2024-04-26T12:26:53.254495+0000","last_active":"2024-04-26T12:26:54.254323+0000","last_peered":"2024-04-26T12:26:54.254323+0000","last_clean":"2024-04-26T12:26:54.254323+0000","last_became_active":"2024-04-26T12:26:53.254149+0000","last_became_peered":"2024-04-26T12:26:53.254149+0000","last_unstale":"2024-04-26T12:26:54.254323+0000","last_undegraded":"2024-04-26T12:26:54.254323+0000","last_fullsized":"2024-04-26T12:26:54.254323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:37.907024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252663+0000","last_change":"2024-04-26T12:26:52.836279+0000","last_active":"2024-04-26T12:26:54.252663+0000","last_peered":"2024-04-26T12:26:54.252663+0000","last_clean":"2024-04-26T12:26:54.252663+0000","last_became_active":"2024-04-26T12:26:52.835916+0000","last_became_peered":"2024-04-26T12:26:52.835916+0000","last_unstale":"2024-04-26T12:26:54.252663+0000","last_undegraded":"2024-04-26T12:26:54.252663+0000","last_fullsized":"2024-04-26T12:26:54.252663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:33.466992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253090+0000","last_change":"2024-04-26T12:26:53.259112+0000","last_active":"2024-04-26T12:26:54.253090+0000","last_peered":"2024-04-26T12:26:54.253090+0000","last_clean":"2024-04-26T12:26:54.253090+0000","last_became_active":"2024-04-26T12:26:53.256762+0000","last_became_peered":"2024-04-26T12:26:53.256762+0000","last_unstale":"2024-04-26T12:26:54.253090+0000","last_undegraded":"2024-04-26T12:26:54.253090+0000","last_fullsized":"2024-04-26T12:26:54.253090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252967+0000","last_change":"2024-04-26T12:26:53.263131+0000","last_active":"2024-04-26T12:26:54.252967+0000","last_peered":"2024-04-26T12:26:54.252967+0000","last_clean":"2024-04-26T12:26:54.252967+0000","last_became_active":"2024-04-26T12:26:53.260489+0000","last_became_peered":"2024-04-26T12:26:53.260489+0000","last_unstale":"2024-04-26T12:26:54.252967+0000","last_undegraded":"2024-04-26T12:26:54.252967+0000","last_fullsized":"2024-04-26T12:26:54.252967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251606+0000","last_change":"2024-04-26T12:26:53.259832+0000","last_active":"2024-04-26T12:26:54.251606+0000","last_peered":"2024-04-26T12:26:54.251606+0000","last_clean":"2024-04-26T12:26:54.251606+0000","last_became_active":"2024-04-26T12:26:53.259028+0000","last_became_peered":"2024-04-26T12:26:53.259028+0000","last_unstale":"2024-04-26T12:26:54.251606+0000","last_undegraded":"2024-04-26T12:26:54.251606+0000","last_fullsized":"2024-04-26T12:26:54.251606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254286+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:26:54.254286+0000","last_peered":"2024-04-26T12:26:54.254286+0000","last_clean":"2024-04-26T12:26:54.254286+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:26:54.254286+0000","last_undegraded":"2024-04-26T12:26:54.254286+0000","last_fullsized":"2024-04-26T12:26:54.254286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252363+0000","last_change":"2024-04-26T12:26:53.259057+0000","last_active":"2024-04-26T12:26:54.252363+0000","last_peered":"2024-04-26T12:26:54.252363+0000","last_clean":"2024-04-26T12:26:54.252363+0000","last_became_active":"2024-04-26T12:26:53.257816+0000","last_became_peered":"2024-04-26T12:26:53.257816+0000","last_unstale":"2024-04-26T12:26:54.252363+0000","last_undegraded":"2024-04-26T12:26:54.252363+0000","last_fullsized":"2024-04-26T12:26:54.252363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:53.950315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254747+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:26:54.254747+0000","last_peered":"2024-04-26T12:26:54.254747+0000","last_clean":"2024-04-26T12:26:54.254747+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:26:54.254747+0000","last_undegraded":"2024-04-26T12:26:54.254747+0000","last_fullsized":"2024-04-26T12:26:54.254747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":641176,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":641792,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":147456,"data_stored":49678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:26:57.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:26:57.781 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:57.782 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:26:57.790 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-26T12:26:57.289800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81664,"kb_used_data":600,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033856,"statfs":{"total":289910292480,"available":289826668544,"internally_reserved":0,"allocated":614400,"data_stored":1332646,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.469975"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.255057+0000","last_change":"2024-04-26T12:26:53.255588+0000","last_active":"2024-04-26T12:26:54.255057+0000","last_peered":"2024-04-26T12:26:54.255057+0000","last_clean":"2024-04-26T12:26:54.255057+0000","last_became_active":"2024-04-26T12:26:53.255201+0000","last_became_peered":"2024-04-26T12:26:53.255201+0000","last_unstale":"2024-04-26T12:26:54.255057+0000","last_undegraded":"2024-04-26T12:26:54.255057+0000","last_fullsized":"2024-04-26T12:26:54.255057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:09.233018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254502+0000","last_change":"2024-04-26T12:26:53.256136+0000","last_active":"2024-04-26T12:26:54.254502+0000","last_peered":"2024-04-26T12:26:54.254502+0000","last_clean":"2024-04-26T12:26:54.254502+0000","last_became_active":"2024-04-26T12:26:53.255297+0000","last_became_peered":"2024-04-26T12:26:53.255297+0000","last_unstale":"2024-04-26T12:26:54.254502+0000","last_undegraded":"2024-04-26T12:26:54.254502+0000","last_fullsized":"2024-04-26T12:26:54.254502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253859+0000","last_change":"2024-04-26T12:26:53.265584+0000","last_active":"2024-04-26T12:26:54.253859+0000","last_peered":"2024-04-26T12:26:54.253859+0000","last_clean":"2024-04-26T12:26:54.253859+0000","last_became_active":"2024-04-26T12:26:53.264555+0000","last_became_peered":"2024-04-26T12:26:53.264555+0000","last_unstale":"2024-04-26T12:26:54.253859+0000","last_undegraded":"2024-04-26T12:26:54.253859+0000","last_fullsized":"2024-04-26T12:26:54.253859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:20:03.207903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253538+0000","last_change":"2024-04-26T12:26:53.263004+0000","last_active":"2024-04-26T12:26:54.253538+0000","last_peered":"2024-04-26T12:26:54.253538+0000","last_clean":"2024-04-26T12:26:54.253538+0000","last_became_active":"2024-04-26T12:26:53.261193+0000","last_became_peered":"2024-04-26T12:26:53.261193+0000","last_unstale":"2024-04-26T12:26:54.253538+0000","last_undegraded":"2024-04-26T12:26:54.253538+0000","last_fullsized":"2024-04-26T12:26:54.253538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254277+0000","last_change":"2024-04-26T12:26:53.255483+0000","last_active":"2024-04-26T12:26:54.254277+0000","last_peered":"2024-04-26T12:26:54.254277+0000","last_clean":"2024-04-26T12:26:54.254277+0000","last_became_active":"2024-04-26T12:26:53.255001+0000","last_became_peered":"2024-04-26T12:26:53.255001+0000","last_unstale":"2024-04-26T12:26:54.254277+0000","last_undegraded":"2024-04-26T12:26:54.254277+0000","last_fullsized":"2024-04-26T12:26:54.254277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:34.496560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252949+0000","last_change":"2024-04-26T12:26:53.264139+0000","last_active":"2024-04-26T12:26:54.252949+0000","last_peered":"2024-04-26T12:26:54.252949+0000","last_clean":"2024-04-26T12:26:54.252949+0000","last_became_active":"2024-04-26T12:26:53.262002+0000","last_became_peered":"2024-04-26T12:26:53.262002+0000","last_unstale":"2024-04-26T12:26:54.252949+0000","last_undegraded":"2024-04-26T12:26:54.252949+0000","last_fullsized":"2024-04-26T12:26:54.252949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253027+0000","last_change":"2024-04-26T12:26:53.262987+0000","last_active":"2024-04-26T12:26:54.253027+0000","last_peered":"2024-04-26T12:26:54.253027+0000","last_clean":"2024-04-26T12:26:54.253027+0000","last_became_active":"2024-04-26T12:26:53.262113+0000","last_became_peered":"2024-04-26T12:26:53.262113+0000","last_unstale":"2024-04-26T12:26:54.253027+0000","last_undegraded":"2024-04-26T12:26:54.253027+0000","last_fullsized":"2024-04-26T12:26:54.253027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252720+0000","last_change":"2024-04-26T12:26:53.264092+0000","last_active":"2024-04-26T12:26:54.252720+0000","last_peered":"2024-04-26T12:26:54.252720+0000","last_clean":"2024-04-26T12:26:54.252720+0000","last_became_active":"2024-04-26T12:26:53.260501+0000","last_became_peered":"2024-04-26T12:26:53.260501+0000","last_unstale":"2024-04-26T12:26:54.252720+0000","last_undegraded":"2024-04-26T12:26:54.252720+0000","last_fullsized":"2024-04-26T12:26:54.252720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252461+0000","last_change":"2024-04-26T12:26:53.259692+0000","last_active":"2024-04-26T12:26:54.252461+0000","last_peered":"2024-04-26T12:26:54.252461+0000","last_clean":"2024-04-26T12:26:54.252461+0000","last_became_active":"2024-04-26T12:26:53.258709+0000","last_became_peered":"2024-04-26T12:26:53.258709+0000","last_unstale":"2024-04-26T12:26:54.252461+0000","last_undegraded":"2024-04-26T12:26:54.252461+0000","last_fullsized":"2024-04-26T12:26:54.252461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254822+0000","last_change":"2024-04-26T12:26:53.256190+0000","last_active":"2024-04-26T12:26:54.254822+0000","last_peered":"2024-04-26T12:26:54.254822+0000","last_clean":"2024-04-26T12:26:54.254822+0000","last_became_active":"2024-04-26T12:26:53.255382+0000","last_became_peered":"2024-04-26T12:26:53.255382+0000","last_unstale":"2024-04-26T12:26:54.254822+0000","last_undegraded":"2024-04-26T12:26:54.254822+0000","last_fullsized":"2024-04-26T12:26:54.254822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:53.950315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253701+0000","last_change":"2024-04-26T12:26:53.262951+0000","last_active":"2024-04-26T12:26:54.253701+0000","last_peered":"2024-04-26T12:26:54.253701+0000","last_clean":"2024-04-26T12:26:54.253701+0000","last_became_active":"2024-04-26T12:26:53.261842+0000","last_became_peered":"2024-04-26T12:26:53.261842+0000","last_unstale":"2024-04-26T12:26:54.253701+0000","last_undegraded":"2024-04-26T12:26:54.253701+0000","last_fullsized":"2024-04-26T12:26:54.253701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:35.327049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254183+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:26:54.254183+0000","last_peered":"2024-04-26T12:26:54.254183+0000","last_clean":"2024-04-26T12:26:54.254183+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:26:54.254183+0000","last_undegraded":"2024-04-26T12:26:54.254183+0000","last_fullsized":"2024-04-26T12:26:54.254183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254377+0000","last_change":"2024-04-26T12:26:53.254930+0000","last_active":"2024-04-26T12:26:54.254377+0000","last_peered":"2024-04-26T12:26:54.254377+0000","last_clean":"2024-04-26T12:26:54.254377+0000","last_became_active":"2024-04-26T12:26:53.253988+0000","last_became_peered":"2024-04-26T12:26:53.253988+0000","last_unstale":"2024-04-26T12:26:54.254377+0000","last_undegraded":"2024-04-26T12:26:54.254377+0000","last_fullsized":"2024-04-26T12:26:54.254377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253678+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:26:54.253678+0000","last_peered":"2024-04-26T12:26:54.253678+0000","last_clean":"2024-04-26T12:26:54.253678+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:26:54.253678+0000","last_undegraded":"2024-04-26T12:26:54.253678+0000","last_fullsized":"2024-04-26T12:26:54.253678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252782+0000","last_change":"2024-04-26T12:26:53.266568+0000","last_active":"2024-04-26T12:26:54.252782+0000","last_peered":"2024-04-26T12:26:54.252782+0000","last_clean":"2024-04-26T12:26:54.252782+0000","last_became_active":"2024-04-26T12:26:53.265846+0000","last_became_peered":"2024-04-26T12:26:53.265846+0000","last_unstale":"2024-04-26T12:26:54.252782+0000","last_undegraded":"2024-04-26T12:26:54.252782+0000","last_fullsized":"2024-04-26T12:26:54.252782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:10.849502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252784+0000","last_change":"2024-04-26T12:26:53.265459+0000","last_active":"2024-04-26T12:26:54.252784+0000","last_peered":"2024-04-26T12:26:54.252784+0000","last_clean":"2024-04-26T12:26:54.252784+0000","last_became_active":"2024-04-26T12:26:53.262898+0000","last_became_peered":"2024-04-26T12:26:53.262898+0000","last_unstale":"2024-04-26T12:26:54.252784+0000","last_undegraded":"2024-04-26T12:26:54.252784+0000","last_fullsized":"2024-04-26T12:26:54.252784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252546+0000","last_change":"2024-04-26T12:26:53.259864+0000","last_active":"2024-04-26T12:26:54.252546+0000","last_peered":"2024-04-26T12:26:54.252546+0000","last_clean":"2024-04-26T12:26:54.252546+0000","last_became_active":"2024-04-26T12:26:53.259025+0000","last_became_peered":"2024-04-26T12:26:53.259025+0000","last_unstale":"2024-04-26T12:26:54.252546+0000","last_undegraded":"2024-04-26T12:26:54.252546+0000","last_fullsized":"2024-04-26T12:26:54.252546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254951+0000","last_change":"2024-04-26T12:26:53.261186+0000","last_active":"2024-04-26T12:26:54.254951+0000","last_peered":"2024-04-26T12:26:54.254951+0000","last_clean":"2024-04-26T12:26:54.254951+0000","last_became_active":"2024-04-26T12:26:53.260820+0000","last_became_peered":"2024-04-26T12:26:53.260820+0000","last_unstale":"2024-04-26T12:26:54.254951+0000","last_undegraded":"2024-04-26T12:26:54.254951+0000","last_fullsized":"2024-04-26T12:26:54.254951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:00.602708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252225+0000","last_change":"2024-04-26T12:26:53.259728+0000","last_active":"2024-04-26T12:26:54.252225+0000","last_peered":"2024-04-26T12:26:54.252225+0000","last_clean":"2024-04-26T12:26:54.252225+0000","last_became_active":"2024-04-26T12:26:53.258952+0000","last_became_peered":"2024-04-26T12:26:53.258952+0000","last_unstale":"2024-04-26T12:26:54.252225+0000","last_undegraded":"2024-04-26T12:26:54.252225+0000","last_fullsized":"2024-04-26T12:26:54.252225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253512+0000","last_change":"2024-04-26T12:26:53.257321+0000","last_active":"2024-04-26T12:26:54.253512+0000","last_peered":"2024-04-26T12:26:54.253512+0000","last_clean":"2024-04-26T12:26:54.253512+0000","last_became_active":"2024-04-26T12:26:53.256192+0000","last_became_peered":"2024-04-26T12:26:53.256192+0000","last_unstale":"2024-04-26T12:26:54.253512+0000","last_undegraded":"2024-04-26T12:26:54.253512+0000","last_fullsized":"2024-04-26T12:26:54.253512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253202+0000","last_change":"2024-04-26T12:26:53.261669+0000","last_active":"2024-04-26T12:26:54.253202+0000","last_peered":"2024-04-26T12:26:54.253202+0000","last_clean":"2024-04-26T12:26:54.253202+0000","last_became_active":"2024-04-26T12:26:53.259854+0000","last_became_peered":"2024-04-26T12:26:53.259854+0000","last_unstale":"2024-04-26T12:26:54.253202+0000","last_undegraded":"2024-04-26T12:26:54.253202+0000","last_fullsized":"2024-04-26T12:26:54.253202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254141+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:26:54.254141+0000","last_peered":"2024-04-26T12:26:54.254141+0000","last_clean":"2024-04-26T12:26:54.254141+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:26:54.254141+0000","last_undegraded":"2024-04-26T12:26:54.254141+0000","last_fullsized":"2024-04-26T12:26:54.254141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251798+0000","last_change":"2024-04-26T12:26:53.262898+0000","last_active":"2024-04-26T12:26:54.251798+0000","last_peered":"2024-04-26T12:26:54.251798+0000","last_clean":"2024-04-26T12:26:54.251798+0000","last_became_active":"2024-04-26T12:26:53.262603+0000","last_became_peered":"2024-04-26T12:26:53.262603+0000","last_unstale":"2024-04-26T12:26:54.251798+0000","last_undegraded":"2024-04-26T12:26:54.251798+0000","last_fullsized":"2024-04-26T12:26:54.251798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254215+0000","last_change":"2024-04-26T12:26:53.254395+0000","last_active":"2024-04-26T12:26:54.254215+0000","last_peered":"2024-04-26T12:26:54.254215+0000","last_clean":"2024-04-26T12:26:54.254215+0000","last_became_active":"2024-04-26T12:26:53.253946+0000","last_became_peered":"2024-04-26T12:26:53.253946+0000","last_unstale":"2024-04-26T12:26:54.254215+0000","last_undegraded":"2024-04-26T12:26:54.254215+0000","last_fullsized":"2024-04-26T12:26:54.254215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:41.501818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254992+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:26:54.254992+0000","last_peered":"2024-04-26T12:26:54.254992+0000","last_clean":"2024-04-26T12:26:54.254992+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:26:54.254992+0000","last_undegraded":"2024-04-26T12:26:54.254992+0000","last_fullsized":"2024-04-26T12:26:54.254992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252630+0000","last_change":"2024-04-26T12:26:53.261876+0000","last_active":"2024-04-26T12:26:54.252630+0000","last_peered":"2024-04-26T12:26:54.252630+0000","last_clean":"2024-04-26T12:26:54.252630+0000","last_became_active":"2024-04-26T12:26:53.261485+0000","last_became_peered":"2024-04-26T12:26:53.261485+0000","last_unstale":"2024-04-26T12:26:54.252630+0000","last_undegraded":"2024-04-26T12:26:54.252630+0000","last_fullsized":"2024-04-26T12:26:54.252630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253751+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:26:54.253751+0000","last_peered":"2024-04-26T12:26:54.253751+0000","last_clean":"2024-04-26T12:26:54.253751+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:26:54.253751+0000","last_undegraded":"2024-04-26T12:26:54.253751+0000","last_fullsized":"2024-04-26T12:26:54.253751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254119+0000","last_change":"2024-04-26T12:26:52.839543+0000","last_active":"2024-04-26T12:26:54.254119+0000","last_peered":"2024-04-26T12:26:54.254119+0000","last_clean":"2024-04-26T12:26:54.254119+0000","last_became_active":"2024-04-26T12:26:52.839080+0000","last_became_peered":"2024-04-26T12:26:52.839080+0000","last_unstale":"2024-04-26T12:26:54.254119+0000","last_undegraded":"2024-04-26T12:26:54.254119+0000","last_fullsized":"2024-04-26T12:26:54.254119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:18.329898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254904+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:26:54.254904+0000","last_peered":"2024-04-26T12:26:54.254904+0000","last_clean":"2024-04-26T12:26:54.254904+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:26:54.254904+0000","last_undegraded":"2024-04-26T12:26:54.254904+0000","last_fullsized":"2024-04-26T12:26:54.254904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251794+0000","last_change":"2024-04-26T12:26:52.838082+0000","last_active":"2024-04-26T12:26:54.251794+0000","last_peered":"2024-04-26T12:26:54.251794+0000","last_clean":"2024-04-26T12:26:54.251794+0000","last_became_active":"2024-04-26T12:26:52.837596+0000","last_became_peered":"2024-04-26T12:26:52.837596+0000","last_unstale":"2024-04-26T12:26:54.251794+0000","last_undegraded":"2024-04-26T12:26:54.251794+0000","last_fullsized":"2024-04-26T12:26:54.251794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:08.892977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252572+0000","last_change":"2024-04-26T12:26:53.262665+0000","last_active":"2024-04-26T12:26:54.252572+0000","last_peered":"2024-04-26T12:26:54.252572+0000","last_clean":"2024-04-26T12:26:54.252572+0000","last_became_active":"2024-04-26T12:26:53.262161+0000","last_became_peered":"2024-04-26T12:26:53.262161+0000","last_unstale":"2024-04-26T12:26:54.252572+0000","last_undegraded":"2024-04-26T12:26:54.252572+0000","last_fullsized":"2024-04-26T12:26:54.252572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251650+0000","last_change":"2024-04-26T12:26:52.833500+0000","last_active":"2024-04-26T12:26:54.251650+0000","last_peered":"2024-04-26T12:26:54.251650+0000","last_clean":"2024-04-26T12:26:54.251650+0000","last_became_active":"2024-04-26T12:26:52.833152+0000","last_became_peered":"2024-04-26T12:26:52.833152+0000","last_unstale":"2024-04-26T12:26:54.251650+0000","last_undegraded":"2024-04-26T12:26:54.251650+0000","last_fullsized":"2024-04-26T12:26:54.251650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:28.165579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.255028+0000","last_change":"2024-04-26T12:26:53.260764+0000","last_active":"2024-04-26T12:26:54.255028+0000","last_peered":"2024-04-26T12:26:54.255028+0000","last_clean":"2024-04-26T12:26:54.255028+0000","last_became_active":"2024-04-26T12:26:53.260388+0000","last_became_peered":"2024-04-26T12:26:53.260388+0000","last_unstale":"2024-04-26T12:26:54.255028+0000","last_undegraded":"2024-04-26T12:26:54.255028+0000","last_fullsized":"2024-04-26T12:26:54.255028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252735+0000","last_change":"2024-04-26T12:26:52.837792+0000","last_active":"2024-04-26T12:26:54.252735+0000","last_peered":"2024-04-26T12:26:54.252735+0000","last_clean":"2024-04-26T12:26:54.252735+0000","last_became_active":"2024-04-26T12:26:52.837272+0000","last_became_peered":"2024-04-26T12:26:52.837272+0000","last_unstale":"2024-04-26T12:26:54.252735+0000","last_undegraded":"2024-04-26T12:26:54.252735+0000","last_fullsized":"2024-04-26T12:26:54.252735+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:12.837493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251539+0000","last_change":"2024-04-26T12:26:53.255423+0000","last_active":"2024-04-26T12:26:54.251539+0000","last_peered":"2024-04-26T12:26:54.251539+0000","last_clean":"2024-04-26T12:26:54.251539+0000","last_became_active":"2024-04-26T12:26:53.253812+0000","last_became_peered":"2024-04-26T12:26:53.253812+0000","last_unstale":"2024-04-26T12:26:54.251539+0000","last_undegraded":"2024-04-26T12:26:54.251539+0000","last_fullsized":"2024-04-26T12:26:54.251539+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:37.907024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253542+0000","last_change":"2024-04-26T12:26:52.840163+0000","last_active":"2024-04-26T12:26:54.253542+0000","last_peered":"2024-04-26T12:26:54.253542+0000","last_clean":"2024-04-26T12:26:54.253542+0000","last_became_active":"2024-04-26T12:26:52.839246+0000","last_became_peered":"2024-04-26T12:26:52.839246+0000","last_unstale":"2024-04-26T12:26:54.253542+0000","last_undegraded":"2024-04-26T12:26:54.253542+0000","last_fullsized":"2024-04-26T12:26:54.253542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:44.809454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251997+0000","last_change":"2024-04-26T12:26:53.258963+0000","last_active":"2024-04-26T12:26:54.251997+0000","last_peered":"2024-04-26T12:26:54.251997+0000","last_clean":"2024-04-26T12:26:54.251997+0000","last_became_active":"2024-04-26T12:26:53.258171+0000","last_became_peered":"2024-04-26T12:26:53.258171+0000","last_unstale":"2024-04-26T12:26:54.251997+0000","last_undegraded":"2024-04-26T12:26:54.251997+0000","last_fullsized":"2024-04-26T12:26:54.251997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254770+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:26:54.254770+0000","last_peered":"2024-04-26T12:26:54.254770+0000","last_clean":"2024-04-26T12:26:54.254770+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:26:54.254770+0000","last_undegraded":"2024-04-26T12:26:54.254770+0000","last_fullsized":"2024-04-26T12:26:54.254770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251746+0000","last_change":"2024-04-26T12:26:53.259209+0000","last_active":"2024-04-26T12:26:54.251746+0000","last_peered":"2024-04-26T12:26:54.251746+0000","last_clean":"2024-04-26T12:26:54.251746+0000","last_became_active":"2024-04-26T12:26:53.258620+0000","last_became_peered":"2024-04-26T12:26:53.258620+0000","last_unstale":"2024-04-26T12:26:54.251746+0000","last_undegraded":"2024-04-26T12:26:54.251746+0000","last_fullsized":"2024-04-26T12:26:54.251746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253386+0000","last_change":"2024-04-26T12:26:52.841280+0000","last_active":"2024-04-26T12:26:54.253386+0000","last_peered":"2024-04-26T12:26:54.253386+0000","last_clean":"2024-04-26T12:26:54.253386+0000","last_became_active":"2024-04-26T12:26:52.839398+0000","last_became_peered":"2024-04-26T12:26:52.839398+0000","last_unstale":"2024-04-26T12:26:54.253386+0000","last_undegraded":"2024-04-26T12:26:54.253386+0000","last_fullsized":"2024-04-26T12:26:54.253386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:53.889623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253612+0000","last_change":"2024-04-26T12:26:53.260830+0000","last_active":"2024-04-26T12:26:54.253612+0000","last_peered":"2024-04-26T12:26:54.253612+0000","last_clean":"2024-04-26T12:26:54.253612+0000","last_became_active":"2024-04-26T12:26:53.259452+0000","last_became_peered":"2024-04-26T12:26:53.259452+0000","last_unstale":"2024-04-26T12:26:54.253612+0000","last_undegraded":"2024-04-26T12:26:54.253612+0000","last_fullsized":"2024-04-26T12:26:54.253612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253560+0000","last_change":"2024-04-26T12:26:52.840521+0000","last_active":"2024-04-26T12:26:54.253560+0000","last_peered":"2024-04-26T12:26:54.253560+0000","last_clean":"2024-04-26T12:26:54.253560+0000","last_became_active":"2024-04-26T12:26:52.839442+0000","last_became_peered":"2024-04-26T12:26:52.839442+0000","last_unstale":"2024-04-26T12:26:54.253560+0000","last_undegraded":"2024-04-26T12:26:54.253560+0000","last_fullsized":"2024-04-26T12:26:54.253560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:28.165579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254485+0000","last_change":"2024-04-26T12:26:53.254489+0000","last_active":"2024-04-26T12:26:54.254485+0000","last_peered":"2024-04-26T12:26:54.254485+0000","last_clean":"2024-04-26T12:26:54.254485+0000","last_became_active":"2024-04-26T12:26:53.254099+0000","last_became_peered":"2024-04-26T12:26:53.254099+0000","last_unstale":"2024-04-26T12:26:54.254485+0000","last_undegraded":"2024-04-26T12:26:54.254485+0000","last_fullsized":"2024-04-26T12:26:54.254485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251939+0000","last_change":"2024-04-26T12:26:52.837857+0000","last_active":"2024-04-26T12:26:54.251939+0000","last_peered":"2024-04-26T12:26:54.251939+0000","last_clean":"2024-04-26T12:26:54.251939+0000","last_became_active":"2024-04-26T12:26:52.837402+0000","last_became_peered":"2024-04-26T12:26:52.837402+0000","last_unstale":"2024-04-26T12:26:54.251939+0000","last_undegraded":"2024-04-26T12:26:54.251939+0000","last_fullsized":"2024-04-26T12:26:54.251939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:53.889623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254865+0000","last_change":"2024-04-26T12:26:53.255659+0000","last_active":"2024-04-26T12:26:54.254865+0000","last_peered":"2024-04-26T12:26:54.254865+0000","last_clean":"2024-04-26T12:26:54.254865+0000","last_became_active":"2024-04-26T12:26:53.255253+0000","last_became_peered":"2024-04-26T12:26:53.255253+0000","last_unstale":"2024-04-26T12:26:54.254865+0000","last_undegraded":"2024-04-26T12:26:54.254865+0000","last_fullsized":"2024-04-26T12:26:54.254865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.236196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254021+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:26:54.254021+0000","last_peered":"2024-04-26T12:26:54.254021+0000","last_clean":"2024-04-26T12:26:54.254021+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:26:54.254021+0000","last_undegraded":"2024-04-26T12:26:54.254021+0000","last_fullsized":"2024-04-26T12:26:54.254021+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252460+0000","last_change":"2024-04-26T12:26:53.261880+0000","last_active":"2024-04-26T12:26:54.252460+0000","last_peered":"2024-04-26T12:26:54.252460+0000","last_clean":"2024-04-26T12:26:54.252460+0000","last_became_active":"2024-04-26T12:26:53.261373+0000","last_became_peered":"2024-04-26T12:26:53.261373+0000","last_unstale":"2024-04-26T12:26:54.252460+0000","last_undegraded":"2024-04-26T12:26:54.252460+0000","last_fullsized":"2024-04-26T12:26:54.252460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253014+0000","last_change":"2024-04-26T12:26:52.840810+0000","last_active":"2024-04-26T12:26:54.253014+0000","last_peered":"2024-04-26T12:26:54.253014+0000","last_clean":"2024-04-26T12:26:54.253014+0000","last_became_active":"2024-04-26T12:26:52.840059+0000","last_became_peered":"2024-04-26T12:26:52.840059+0000","last_unstale":"2024-04-26T12:26:54.253014+0000","last_undegraded":"2024-04-26T12:26:54.253014+0000","last_fullsized":"2024-04-26T12:26:54.253014+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:17.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252819+0000","last_change":"2024-04-26T12:26:53.265200+0000","last_active":"2024-04-26T12:26:54.252819+0000","last_peered":"2024-04-26T12:26:54.252819+0000","last_clean":"2024-04-26T12:26:54.252819+0000","last_became_active":"2024-04-26T12:26:53.264830+0000","last_became_peered":"2024-04-26T12:26:53.264830+0000","last_unstale":"2024-04-26T12:26:54.252819+0000","last_undegraded":"2024-04-26T12:26:54.252819+0000","last_fullsized":"2024-04-26T12:26:54.252819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253700+0000","last_change":"2024-04-26T12:26:52.840684+0000","last_active":"2024-04-26T12:26:54.253700+0000","last_peered":"2024-04-26T12:26:54.253700+0000","last_clean":"2024-04-26T12:26:54.253700+0000","last_became_active":"2024-04-26T12:26:52.839414+0000","last_became_peered":"2024-04-26T12:26:52.839414+0000","last_unstale":"2024-04-26T12:26:54.253700+0000","last_undegraded":"2024-04-26T12:26:54.253700+0000","last_fullsized":"2024-04-26T12:26:54.253700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:12.837493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253759+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:26:54.253759+0000","last_peered":"2024-04-26T12:26:54.253759+0000","last_clean":"2024-04-26T12:26:54.253759+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:26:54.253759+0000","last_undegraded":"2024-04-26T12:26:54.253759+0000","last_fullsized":"2024-04-26T12:26:54.253759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254691+0000","last_change":"2024-04-26T12:26:52.839692+0000","last_active":"2024-04-26T12:26:54.254691+0000","last_peered":"2024-04-26T12:26:54.254691+0000","last_clean":"2024-04-26T12:26:54.254691+0000","last_became_active":"2024-04-26T12:26:52.839419+0000","last_became_peered":"2024-04-26T12:26:52.839419+0000","last_unstale":"2024-04-26T12:26:54.254691+0000","last_undegraded":"2024-04-26T12:26:54.254691+0000","last_fullsized":"2024-04-26T12:26:54.254691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:25.416851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254179+0000","last_change":"2024-04-26T12:26:53.254395+0000","last_active":"2024-04-26T12:26:54.254179+0000","last_peered":"2024-04-26T12:26:54.254179+0000","last_clean":"2024-04-26T12:26:54.254179+0000","last_became_active":"2024-04-26T12:26:53.253926+0000","last_became_peered":"2024-04-26T12:26:53.253926+0000","last_unstale":"2024-04-26T12:26:54.254179+0000","last_undegraded":"2024-04-26T12:26:54.254179+0000","last_fullsized":"2024-04-26T12:26:54.254179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:59.517606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253817+0000","last_change":"2024-04-26T12:26:52.842023+0000","last_active":"2024-04-26T12:26:54.253817+0000","last_peered":"2024-04-26T12:26:54.253817+0000","last_clean":"2024-04-26T12:26:54.253817+0000","last_became_active":"2024-04-26T12:26:52.840857+0000","last_became_peered":"2024-04-26T12:26:52.840857+0000","last_unstale":"2024-04-26T12:26:54.253817+0000","last_undegraded":"2024-04-26T12:26:54.253817+0000","last_fullsized":"2024-04-26T12:26:54.253817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:08.892977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253219+0000","last_change":"2024-04-26T12:26:53.263148+0000","last_active":"2024-04-26T12:26:54.253219+0000","last_peered":"2024-04-26T12:26:54.253219+0000","last_clean":"2024-04-26T12:26:54.253219+0000","last_became_active":"2024-04-26T12:26:53.261904+0000","last_became_peered":"2024-04-26T12:26:53.261904+0000","last_unstale":"2024-04-26T12:26:54.253219+0000","last_undegraded":"2024-04-26T12:26:54.253219+0000","last_fullsized":"2024-04-26T12:26:54.253219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253194+0000","last_change":"2024-04-26T12:26:52.841895+0000","last_active":"2024-04-26T12:26:54.253194+0000","last_peered":"2024-04-26T12:26:54.253194+0000","last_clean":"2024-04-26T12:26:54.253194+0000","last_became_active":"2024-04-26T12:26:52.840195+0000","last_became_peered":"2024-04-26T12:26:52.840195+0000","last_unstale":"2024-04-26T12:26:54.253194+0000","last_undegraded":"2024-04-26T12:26:54.253194+0000","last_fullsized":"2024-04-26T12:26:54.253194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:03.469888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252358+0000","last_change":"2024-04-26T12:26:53.265195+0000","last_active":"2024-04-26T12:26:54.252358+0000","last_peered":"2024-04-26T12:26:54.252358+0000","last_clean":"2024-04-26T12:26:54.252358+0000","last_became_active":"2024-04-26T12:26:53.264819+0000","last_became_peered":"2024-04-26T12:26:53.264819+0000","last_unstale":"2024-04-26T12:26:54.252358+0000","last_undegraded":"2024-04-26T12:26:54.252358+0000","last_fullsized":"2024-04-26T12:26:54.252358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252231+0000","last_change":"2024-04-26T12:26:52.837057+0000","last_active":"2024-04-26T12:26:54.252231+0000","last_peered":"2024-04-26T12:26:54.252231+0000","last_clean":"2024-04-26T12:26:54.252231+0000","last_became_active":"2024-04-26T12:26:52.836594+0000","last_became_peered":"2024-04-26T12:26:52.836594+0000","last_unstale":"2024-04-26T12:26:54.252231+0000","last_undegraded":"2024-04-26T12:26:54.252231+0000","last_fullsized":"2024-04-26T12:26:54.252231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:42.768206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253143+0000","last_change":"2024-04-26T12:26:53.263194+0000","last_active":"2024-04-26T12:26:54.253143+0000","last_peered":"2024-04-26T12:26:54.253143+0000","last_clean":"2024-04-26T12:26:54.253143+0000","last_became_active":"2024-04-26T12:26:53.262366+0000","last_became_peered":"2024-04-26T12:26:53.262366+0000","last_unstale":"2024-04-26T12:26:54.253143+0000","last_undegraded":"2024-04-26T12:26:54.253143+0000","last_fullsized":"2024-04-26T12:26:54.253143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253105+0000","last_change":"2024-04-26T12:26:52.842337+0000","last_active":"2024-04-26T12:26:54.253105+0000","last_peered":"2024-04-26T12:26:54.253105+0000","last_clean":"2024-04-26T12:26:54.253105+0000","last_became_active":"2024-04-26T12:26:52.842009+0000","last_became_peered":"2024-04-26T12:26:52.842009+0000","last_unstale":"2024-04-26T12:26:54.253105+0000","last_undegraded":"2024-04-26T12:26:54.253105+0000","last_fullsized":"2024-04-26T12:26:54.253105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253989+0000","last_change":"2024-04-26T12:26:53.266014+0000","last_active":"2024-04-26T12:26:54.253989+0000","last_peered":"2024-04-26T12:26:54.253989+0000","last_clean":"2024-04-26T12:26:54.253989+0000","last_became_active":"2024-04-26T12:26:53.264254+0000","last_became_peered":"2024-04-26T12:26:53.264254+0000","last_unstale":"2024-04-26T12:26:54.253989+0000","last_undegraded":"2024-04-26T12:26:54.253989+0000","last_fullsized":"2024-04-26T12:26:54.253989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:04.369827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253838+0000","last_change":"2024-04-26T12:26:52.839759+0000","last_active":"2024-04-26T12:26:54.253838+0000","last_peered":"2024-04-26T12:26:54.253838+0000","last_clean":"2024-04-26T12:26:54.253838+0000","last_became_active":"2024-04-26T12:26:52.839445+0000","last_became_peered":"2024-04-26T12:26:52.839445+0000","last_unstale":"2024-04-26T12:26:54.253838+0000","last_undegraded":"2024-04-26T12:26:54.253838+0000","last_fullsized":"2024-04-26T12:26:54.253838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:40.499263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253688+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:26:54.253688+0000","last_peered":"2024-04-26T12:26:54.253688+0000","last_clean":"2024-04-26T12:26:54.253688+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:26:54.253688+0000","last_undegraded":"2024-04-26T12:26:54.253688+0000","last_fullsized":"2024-04-26T12:26:54.253688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253924+0000","last_change":"2024-04-26T12:26:52.839211+0000","last_active":"2024-04-26T12:26:54.253924+0000","last_peered":"2024-04-26T12:26:54.253924+0000","last_clean":"2024-04-26T12:26:54.253924+0000","last_became_active":"2024-04-26T12:26:52.838988+0000","last_became_peered":"2024-04-26T12:26:52.838988+0000","last_unstale":"2024-04-26T12:26:54.253924+0000","last_undegraded":"2024-04-26T12:26:54.253924+0000","last_fullsized":"2024-04-26T12:26:54.253924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:04.569832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252653+0000","last_change":"2024-04-26T12:26:53.260098+0000","last_active":"2024-04-26T12:26:54.252653+0000","last_peered":"2024-04-26T12:26:54.252653+0000","last_clean":"2024-04-26T12:26:54.252653+0000","last_became_active":"2024-04-26T12:26:53.259188+0000","last_became_peered":"2024-04-26T12:26:53.259188+0000","last_unstale":"2024-04-26T12:26:54.252653+0000","last_undegraded":"2024-04-26T12:26:54.252653+0000","last_fullsized":"2024-04-26T12:26:54.252653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:34.496560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.248033+0000","last_change":"2024-04-26T12:26:47.810338+0000","last_active":"2024-04-26T12:26:53.248033+0000","last_peered":"2024-04-26T12:26:53.248033+0000","last_clean":"2024-04-26T12:26:53.248033+0000","last_became_active":"2024-04-26T12:26:47.810127+0000","last_became_peered":"2024-04-26T12:26:47.810127+0000","last_unstale":"2024-04-26T12:26:53.248033+0000","last_undegraded":"2024-04-26T12:26:53.248033+0000","last_fullsized":"2024-04-26T12:26:53.248033+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:11.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253912+0000","last_change":"2024-04-26T12:26:52.841192+0000","last_active":"2024-04-26T12:26:54.253912+0000","last_peered":"2024-04-26T12:26:54.253912+0000","last_clean":"2024-04-26T12:26:54.253912+0000","last_became_active":"2024-04-26T12:26:52.840137+0000","last_became_peered":"2024-04-26T12:26:52.840137+0000","last_unstale":"2024-04-26T12:26:54.253912+0000","last_undegraded":"2024-04-26T12:26:54.253912+0000","last_fullsized":"2024-04-26T12:26:54.253912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:20.488738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254278+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:26:54.254278+0000","last_peered":"2024-04-26T12:26:54.254278+0000","last_clean":"2024-04-26T12:26:54.254278+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:26:54.254278+0000","last_undegraded":"2024-04-26T12:26:54.254278+0000","last_fullsized":"2024-04-26T12:26:54.254278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.257442+0000","last_change":"2024-04-26T12:26:47.811997+0000","last_active":"2024-04-26T12:26:53.257442+0000","last_peered":"2024-04-26T12:26:53.257442+0000","last_clean":"2024-04-26T12:26:53.257442+0000","last_became_active":"2024-04-26T12:26:47.811819+0000","last_became_peered":"2024-04-26T12:26:47.811819+0000","last_unstale":"2024-04-26T12:26:53.257442+0000","last_undegraded":"2024-04-26T12:26:53.257442+0000","last_fullsized":"2024-04-26T12:26:53.257442+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:11.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253332+0000","last_change":"2024-04-26T12:26:52.841195+0000","last_active":"2024-04-26T12:26:54.253332+0000","last_peered":"2024-04-26T12:26:54.253332+0000","last_clean":"2024-04-26T12:26:54.253332+0000","last_became_active":"2024-04-26T12:26:52.839558+0000","last_became_peered":"2024-04-26T12:26:52.839558+0000","last_unstale":"2024-04-26T12:26:54.253332+0000","last_undegraded":"2024-04-26T12:26:54.253332+0000","last_fullsized":"2024-04-26T12:26:54.253332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:54.208845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252177+0000","last_change":"2024-04-26T12:26:53.259270+0000","last_active":"2024-04-26T12:26:54.252177+0000","last_peered":"2024-04-26T12:26:54.252177+0000","last_clean":"2024-04-26T12:26:54.252177+0000","last_became_active":"2024-04-26T12:26:53.258588+0000","last_became_peered":"2024-04-26T12:26:53.258588+0000","last_unstale":"2024-04-26T12:26:54.252177+0000","last_undegraded":"2024-04-26T12:26:54.252177+0000","last_fullsized":"2024-04-26T12:26:54.252177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:09.233018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.247515+0000","last_change":"2024-04-26T12:26:47.811787+0000","last_active":"2024-04-26T12:26:53.247515+0000","last_peered":"2024-04-26T12:26:53.247515+0000","last_clean":"2024-04-26T12:26:53.247515+0000","last_became_active":"2024-04-26T12:26:47.811512+0000","last_became_peered":"2024-04-26T12:26:47.811512+0000","last_unstale":"2024-04-26T12:26:53.247515+0000","last_undegraded":"2024-04-26T12:26:53.247515+0000","last_fullsized":"2024-04-26T12:26:53.247515+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:56.379533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253871+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:26:54.253871+0000","last_peered":"2024-04-26T12:26:54.253871+0000","last_clean":"2024-04-26T12:26:54.253871+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:26:54.253871+0000","last_undegraded":"2024-04-26T12:26:54.253871+0000","last_fullsized":"2024-04-26T12:26:54.253871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252748+0000","last_change":"2024-04-26T12:26:53.260244+0000","last_active":"2024-04-26T12:26:54.252748+0000","last_peered":"2024-04-26T12:26:54.252748+0000","last_clean":"2024-04-26T12:26:54.252748+0000","last_became_active":"2024-04-26T12:26:53.259917+0000","last_became_peered":"2024-04-26T12:26:53.259917+0000","last_unstale":"2024-04-26T12:26:54.252748+0000","last_undegraded":"2024-04-26T12:26:54.252748+0000","last_fullsized":"2024-04-26T12:26:54.252748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258160+0000","last_change":"2024-04-26T12:26:47.812045+0000","last_active":"2024-04-26T12:26:53.258160+0000","last_peered":"2024-04-26T12:26:53.258160+0000","last_clean":"2024-04-26T12:26:53.258160+0000","last_became_active":"2024-04-26T12:26:47.811787+0000","last_became_peered":"2024-04-26T12:26:47.811787+0000","last_unstale":"2024-04-26T12:26:53.258160+0000","last_undegraded":"2024-04-26T12:26:53.258160+0000","last_fullsized":"2024-04-26T12:26:53.258160+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:30.757169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":211,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258235+0000","last_change":"2024-04-26T12:26:46.810189+0000","last_active":"2024-04-26T12:26:53.258235+0000","last_peered":"2024-04-26T12:26:53.258235+0000","last_clean":"2024-04-26T12:26:53.258235+0000","last_became_active":"2024-04-26T12:26:46.809453+0000","last_became_peered":"2024-04-26T12:26:46.809453+0000","last_unstale":"2024-04-26T12:26:53.258235+0000","last_undegraded":"2024-04-26T12:26:53.258235+0000","last_fullsized":"2024-04-26T12:26:53.258235+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:18.618650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251680+0000","last_change":"2024-04-26T12:26:52.833869+0000","last_active":"2024-04-26T12:26:54.251680+0000","last_peered":"2024-04-26T12:26:54.251680+0000","last_clean":"2024-04-26T12:26:54.251680+0000","last_became_active":"2024-04-26T12:26:52.833257+0000","last_became_peered":"2024-04-26T12:26:52.833257+0000","last_unstale":"2024-04-26T12:26:54.251680+0000","last_undegraded":"2024-04-26T12:26:54.251680+0000","last_fullsized":"2024-04-26T12:26:54.251680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253947+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:26:54.253947+0000","last_peered":"2024-04-26T12:26:54.253947+0000","last_clean":"2024-04-26T12:26:54.253947+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:26:54.253947+0000","last_undegraded":"2024-04-26T12:26:54.253947+0000","last_fullsized":"2024-04-26T12:26:54.253947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258561+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:26:53.258561+0000","last_peered":"2024-04-26T12:26:53.258561+0000","last_clean":"2024-04-26T12:26:53.258561+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:26:53.258561+0000","last_undegraded":"2024-04-26T12:26:53.258561+0000","last_fullsized":"2024-04-26T12:26:53.258561+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251513+0000","last_change":"2024-04-26T12:26:52.836395+0000","last_active":"2024-04-26T12:26:54.251513+0000","last_peered":"2024-04-26T12:26:54.251513+0000","last_clean":"2024-04-26T12:26:54.251513+0000","last_became_active":"2024-04-26T12:26:52.836023+0000","last_became_peered":"2024-04-26T12:26:52.836023+0000","last_unstale":"2024-04-26T12:26:54.251513+0000","last_undegraded":"2024-04-26T12:26:54.251513+0000","last_fullsized":"2024-04-26T12:26:54.251513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:54.208845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254838+0000","last_change":"2024-04-26T12:26:53.260768+0000","last_active":"2024-04-26T12:26:54.254838+0000","last_peered":"2024-04-26T12:26:54.254838+0000","last_clean":"2024-04-26T12:26:54.254838+0000","last_became_active":"2024-04-26T12:26:53.259807+0000","last_became_peered":"2024-04-26T12:26:53.259807+0000","last_unstale":"2024-04-26T12:26:54.254838+0000","last_undegraded":"2024-04-26T12:26:54.254838+0000","last_fullsized":"2024-04-26T12:26:54.254838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.250666+0000","last_change":"2024-04-26T12:26:47.812595+0000","last_active":"2024-04-26T12:26:53.250666+0000","last_peered":"2024-04-26T12:26:53.250666+0000","last_clean":"2024-04-26T12:26:53.250666+0000","last_became_active":"2024-04-26T12:26:47.812366+0000","last_became_peered":"2024-04-26T12:26:47.812366+0000","last_unstale":"2024-04-26T12:26:53.250666+0000","last_undegraded":"2024-04-26T12:26:53.250666+0000","last_fullsized":"2024-04-26T12:26:53.250666+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:57.920665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252434+0000","last_change":"2024-04-26T12:26:52.833996+0000","last_active":"2024-04-26T12:26:54.252434+0000","last_peered":"2024-04-26T12:26:54.252434+0000","last_clean":"2024-04-26T12:26:54.252434+0000","last_became_active":"2024-04-26T12:26:52.833452+0000","last_became_peered":"2024-04-26T12:26:52.833452+0000","last_unstale":"2024-04-26T12:26:54.252434+0000","last_undegraded":"2024-04-26T12:26:54.252434+0000","last_fullsized":"2024-04-26T12:26:54.252434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254460+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:26:54.254460+0000","last_peered":"2024-04-26T12:26:54.254460+0000","last_clean":"2024-04-26T12:26:54.254460+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:26:54.254460+0000","last_undegraded":"2024-04-26T12:26:54.254460+0000","last_fullsized":"2024-04-26T12:26:54.254460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252570+0000","last_change":"2024-04-26T12:26:52.837167+0000","last_active":"2024-04-26T12:26:54.252570+0000","last_peered":"2024-04-26T12:26:54.252570+0000","last_clean":"2024-04-26T12:26:54.252570+0000","last_became_active":"2024-04-26T12:26:52.836534+0000","last_became_peered":"2024-04-26T12:26:52.836534+0000","last_unstale":"2024-04-26T12:26:54.252570+0000","last_undegraded":"2024-04-26T12:26:54.252570+0000","last_fullsized":"2024-04-26T12:26:54.252570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:17.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.248427+0000","last_change":"2024-04-26T12:26:47.811807+0000","last_active":"2024-04-26T12:26:53.248427+0000","last_peered":"2024-04-26T12:26:53.248427+0000","last_clean":"2024-04-26T12:26:53.248427+0000","last_became_active":"2024-04-26T12:26:47.811527+0000","last_became_peered":"2024-04-26T12:26:47.811527+0000","last_unstale":"2024-04-26T12:26:53.248427+0000","last_undegraded":"2024-04-26T12:26:53.248427+0000","last_fullsized":"2024-04-26T12:26:53.248427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:02.127354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251466+0000","last_change":"2024-04-26T12:26:53.265773+0000","last_active":"2024-04-26T12:26:54.251466+0000","last_peered":"2024-04-26T12:26:54.251466+0000","last_clean":"2024-04-26T12:26:54.251466+0000","last_became_active":"2024-04-26T12:26:53.265567+0000","last_became_peered":"2024-04-26T12:26:53.265567+0000","last_unstale":"2024-04-26T12:26:54.251466+0000","last_undegraded":"2024-04-26T12:26:54.251466+0000","last_fullsized":"2024-04-26T12:26:54.251466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258624+0000","last_change":"2024-04-26T12:26:47.811204+0000","last_active":"2024-04-26T12:26:53.258624+0000","last_peered":"2024-04-26T12:26:53.258624+0000","last_clean":"2024-04-26T12:26:53.258624+0000","last_became_active":"2024-04-26T12:26:47.810997+0000","last_became_peered":"2024-04-26T12:26:47.810997+0000","last_unstale":"2024-04-26T12:26:53.258624+0000","last_undegraded":"2024-04-26T12:26:53.258624+0000","last_fullsized":"2024-04-26T12:26:53.258624+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:24.967175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252473+0000","last_change":"2024-04-26T12:26:52.837269+0000","last_active":"2024-04-26T12:26:54.252473+0000","last_peered":"2024-04-26T12:26:54.252473+0000","last_clean":"2024-04-26T12:26:54.252473+0000","last_became_active":"2024-04-26T12:26:52.836310+0000","last_became_peered":"2024-04-26T12:26:52.836310+0000","last_unstale":"2024-04-26T12:26:54.252473+0000","last_undegraded":"2024-04-26T12:26:54.252473+0000","last_fullsized":"2024-04-26T12:26:54.252473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:20.488738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254362+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:26:54.254362+0000","last_peered":"2024-04-26T12:26:54.254362+0000","last_clean":"2024-04-26T12:26:54.254362+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:26:54.254362+0000","last_undegraded":"2024-04-26T12:26:54.254362+0000","last_fullsized":"2024-04-26T12:26:54.254362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254162+0000","last_change":"2024-04-26T12:26:52.840797+0000","last_active":"2024-04-26T12:26:54.254162+0000","last_peered":"2024-04-26T12:26:54.254162+0000","last_clean":"2024-04-26T12:26:54.254162+0000","last_became_active":"2024-04-26T12:26:52.840409+0000","last_became_peered":"2024-04-26T12:26:52.840409+0000","last_unstale":"2024-04-26T12:26:54.254162+0000","last_undegraded":"2024-04-26T12:26:54.254162+0000","last_fullsized":"2024-04-26T12:26:54.254162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:57.898978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254682+0000","last_change":"2024-04-26T12:26:53.255044+0000","last_active":"2024-04-26T12:26:54.254682+0000","last_peered":"2024-04-26T12:26:54.254682+0000","last_clean":"2024-04-26T12:26:54.254682+0000","last_became_active":"2024-04-26T12:26:53.254164+0000","last_became_peered":"2024-04-26T12:26:53.254164+0000","last_unstale":"2024-04-26T12:26:54.254682+0000","last_undegraded":"2024-04-26T12:26:54.254682+0000","last_fullsized":"2024-04-26T12:26:54.254682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:07.899699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253335+0000","last_change":"2024-04-26T12:26:52.841338+0000","last_active":"2024-04-26T12:26:54.253335+0000","last_peered":"2024-04-26T12:26:54.253335+0000","last_clean":"2024-04-26T12:26:54.253335+0000","last_became_active":"2024-04-26T12:26:52.840770+0000","last_became_peered":"2024-04-26T12:26:52.840770+0000","last_unstale":"2024-04-26T12:26:54.253335+0000","last_undegraded":"2024-04-26T12:26:54.253335+0000","last_fullsized":"2024-04-26T12:26:54.253335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:33.466992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253384+0000","last_change":"2024-04-26T12:26:53.260953+0000","last_active":"2024-04-26T12:26:54.253384+0000","last_peered":"2024-04-26T12:26:54.253384+0000","last_clean":"2024-04-26T12:26:54.253384+0000","last_became_active":"2024-04-26T12:26:53.259228+0000","last_became_peered":"2024-04-26T12:26:53.259228+0000","last_unstale":"2024-04-26T12:26:54.253384+0000","last_undegraded":"2024-04-26T12:26:54.253384+0000","last_fullsized":"2024-04-26T12:26:54.253384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254744+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:26:54.254744+0000","last_peered":"2024-04-26T12:26:54.254744+0000","last_clean":"2024-04-26T12:26:54.254744+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:26:54.254744+0000","last_undegraded":"2024-04-26T12:26:54.254744+0000","last_fullsized":"2024-04-26T12:26:54.254744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253334+0000","last_change":"2024-04-26T12:26:53.262221+0000","last_active":"2024-04-26T12:26:54.253334+0000","last_peered":"2024-04-26T12:26:54.253334+0000","last_clean":"2024-04-26T12:26:54.253334+0000","last_became_active":"2024-04-26T12:26:53.261112+0000","last_became_peered":"2024-04-26T12:26:53.261112+0000","last_unstale":"2024-04-26T12:26:54.253334+0000","last_undegraded":"2024-04-26T12:26:54.253334+0000","last_fullsized":"2024-04-26T12:26:54.253334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252558+0000","last_change":"2024-04-26T12:26:52.837399+0000","last_active":"2024-04-26T12:26:54.252558+0000","last_peered":"2024-04-26T12:26:54.252558+0000","last_clean":"2024-04-26T12:26:54.252558+0000","last_became_active":"2024-04-26T12:26:52.835974+0000","last_became_peered":"2024-04-26T12:26:52.835974+0000","last_unstale":"2024-04-26T12:26:54.252558+0000","last_undegraded":"2024-04-26T12:26:54.252558+0000","last_fullsized":"2024-04-26T12:26:54.252558+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:03.469888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254323+0000","last_change":"2024-04-26T12:26:53.254495+0000","last_active":"2024-04-26T12:26:54.254323+0000","last_peered":"2024-04-26T12:26:54.254323+0000","last_clean":"2024-04-26T12:26:54.254323+0000","last_became_active":"2024-04-26T12:26:53.254149+0000","last_became_peered":"2024-04-26T12:26:53.254149+0000","last_unstale":"2024-04-26T12:26:54.254323+0000","last_undegraded":"2024-04-26T12:26:54.254323+0000","last_fullsized":"2024-04-26T12:26:54.254323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:37.907024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252663+0000","last_change":"2024-04-26T12:26:52.836279+0000","last_active":"2024-04-26T12:26:54.252663+0000","last_peered":"2024-04-26T12:26:54.252663+0000","last_clean":"2024-04-26T12:26:54.252663+0000","last_became_active":"2024-04-26T12:26:52.835916+0000","last_became_peered":"2024-04-26T12:26:52.835916+0000","last_unstale":"2024-04-26T12:26:54.252663+0000","last_undegraded":"2024-04-26T12:26:54.252663+0000","last_fullsized":"2024-04-26T12:26:54.252663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:33.466992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253090+0000","last_change":"2024-04-26T12:26:53.259112+0000","last_active":"2024-04-26T12:26:54.253090+0000","last_peered":"2024-04-26T12:26:54.253090+0000","last_clean":"2024-04-26T12:26:54.253090+0000","last_became_active":"2024-04-26T12:26:53.256762+0000","last_became_peered":"2024-04-26T12:26:53.256762+0000","last_unstale":"2024-04-26T12:26:54.253090+0000","last_undegraded":"2024-04-26T12:26:54.253090+0000","last_fullsized":"2024-04-26T12:26:54.253090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252967+0000","last_change":"2024-04-26T12:26:53.263131+0000","last_active":"2024-04-26T12:26:54.252967+0000","last_peered":"2024-04-26T12:26:54.252967+0000","last_clean":"2024-04-26T12:26:54.252967+0000","last_became_active":"2024-04-26T12:26:53.260489+0000","last_became_peered":"2024-04-26T12:26:53.260489+0000","last_unstale":"2024-04-26T12:26:54.252967+0000","last_undegraded":"2024-04-26T12:26:54.252967+0000","last_fullsized":"2024-04-26T12:26:54.252967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251606+0000","last_change":"2024-04-26T12:26:53.259832+0000","last_active":"2024-04-26T12:26:54.251606+0000","last_peered":"2024-04-26T12:26:54.251606+0000","last_clean":"2024-04-26T12:26:54.251606+0000","last_became_active":"2024-04-26T12:26:53.259028+0000","last_became_peered":"2024-04-26T12:26:53.259028+0000","last_unstale":"2024-04-26T12:26:54.251606+0000","last_undegraded":"2024-04-26T12:26:54.251606+0000","last_fullsized":"2024-04-26T12:26:54.251606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254286+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:26:54.254286+0000","last_peered":"2024-04-26T12:26:54.254286+0000","last_clean":"2024-04-26T12:26:54.254286+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:26:54.254286+0000","last_undegraded":"2024-04-26T12:26:54.254286+0000","last_fullsized":"2024-04-26T12:26:54.254286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252363+0000","last_change":"2024-04-26T12:26:53.259057+0000","last_active":"2024-04-26T12:26:54.252363+0000","last_peered":"2024-04-26T12:26:54.252363+0000","last_clean":"2024-04-26T12:26:54.252363+0000","last_became_active":"2024-04-26T12:26:53.257816+0000","last_became_peered":"2024-04-26T12:26:53.257816+0000","last_unstale":"2024-04-26T12:26:54.252363+0000","last_undegraded":"2024-04-26T12:26:54.252363+0000","last_fullsized":"2024-04-26T12:26:54.252363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:53.950315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254747+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:26:54.254747+0000","last_peered":"2024-04-26T12:26:54.254747+0000","last_clean":"2024-04-26T12:26:54.254747+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:26:54.254747+0000","last_undegraded":"2024-04-26T12:26:54.254747+0000","last_fullsized":"2024-04-26T12:26:54.254747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":641176,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":641792,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":147456,"data_stored":49678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:26:57.795 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T12:26:57.795 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T12:26:57.795 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T12:26:57.795 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T12:26:57.796 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T12:26:58.237 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:58.250 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":40889},{"type":"v1","addr":"172.21.15.46:6801","nonce":40889}]},"active_addr":"172.21.15.46:6801/40889","active_change":"2024-04-26T12:26:43.283412+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4102,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2017367599}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":514208781}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2196737142}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":3334967508}]}]} 2024-04-26T12:26:58.253 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T12:26:58.254 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T12:26:58.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:26:58.591 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:58.591 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":16,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:26:54.245547+0000","last_up_change":"2024-04-26T12:26:44.796790+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:26:51.091400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:26:52.222159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":41393},{"type":"v1","addr":"172.21.15.136:6801","nonce":41393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":41393},{"type":"v1","addr":"172.21.15.136:6803","nonce":41393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":41393},{"type":"v1","addr":"172.21.15.136:6807","nonce":41393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":41393},{"type":"v1","addr":"172.21.15.136:6805","nonce":41393}]},"public_addr":"172.21.15.136:6801/41393","cluster_addr":"172.21.15.136:6803/41393","heartbeat_back_addr":"172.21.15.136:6807/41393","heartbeat_front_addr":"172.21.15.136:6805/41393","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:26:58.604 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T12:26:58.605 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:26:58.946 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:26:58.946 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":16,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:26:54.245547+0000","last_up_change":"2024-04-26T12:26:44.796790+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:26:51.091400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:26:52.222159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":41393},{"type":"v1","addr":"172.21.15.136:6801","nonce":41393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":41393},{"type":"v1","addr":"172.21.15.136:6803","nonce":41393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":41393},{"type":"v1","addr":"172.21.15.136:6807","nonce":41393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":41393},{"type":"v1","addr":"172.21.15.136:6805","nonce":41393}]},"public_addr":"172.21.15.136:6801/41393","cluster_addr":"172.21.15.136:6803/41393","heartbeat_back_addr":"172.21.15.136:6807/41393","heartbeat_front_addr":"172.21.15.136:6805/41393","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:26:58.964 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T12:26:58.965 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T12:26:58.966 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T12:26:59.138 INFO:teuthology.orchestra.run.smithi046.stdout:34359738373 2024-04-26T12:26:59.139 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:26:59.148 INFO:teuthology.orchestra.run.smithi046.stdout:34359738372 2024-04-26T12:26:59.149 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:26:59.149 INFO:teuthology.orchestra.run.smithi046.stdout:34359738373 2024-04-26T12:26:59.150 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:26:59.508 INFO:teuthology.orchestra.run.smithi046.stdout:34359738372 2024-04-26T12:26:59.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.2 2024-04-26T12:26:59.544 INFO:teuthology.orchestra.run.smithi046.stdout:34359738372 2024-04-26T12:26:59.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.0 2024-04-26T12:26:59.558 INFO:teuthology.orchestra.run.smithi046.stdout:34359738371 2024-04-26T12:26:59.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.1 2024-04-26T12:27:00.523 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:27:00.559 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:27:00.573 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:27:00.892 INFO:teuthology.orchestra.run.smithi046.stdout:34359738373 2024-04-26T12:27:00.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.2 2024-04-26T12:27:00.906 DEBUG:teuthology.parallel:result is None 2024-04-26T12:27:00.926 INFO:teuthology.orchestra.run.smithi046.stdout:34359738373 2024-04-26T12:27:00.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.0 2024-04-26T12:27:00.940 DEBUG:teuthology.parallel:result is None 2024-04-26T12:27:00.962 INFO:teuthology.orchestra.run.smithi046.stdout:34359738372 2024-04-26T12:27:00.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.1 2024-04-26T12:27:00.977 DEBUG:teuthology.parallel:result is None 2024-04-26T12:27:00.977 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:27:00.977 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:27:01.364 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:27:01.366 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:27:01.375 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-26T12:27:01.290622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81664,"kb_used_data":600,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033856,"statfs":{"total":289910292480,"available":289826668544,"internally_reserved":0,"allocated":614400,"data_stored":1332646,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.043204"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.255057+0000","last_change":"2024-04-26T12:26:53.255588+0000","last_active":"2024-04-26T12:26:54.255057+0000","last_peered":"2024-04-26T12:26:54.255057+0000","last_clean":"2024-04-26T12:26:54.255057+0000","last_became_active":"2024-04-26T12:26:53.255201+0000","last_became_peered":"2024-04-26T12:26:53.255201+0000","last_unstale":"2024-04-26T12:26:54.255057+0000","last_undegraded":"2024-04-26T12:26:54.255057+0000","last_fullsized":"2024-04-26T12:26:54.255057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:09.233018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254502+0000","last_change":"2024-04-26T12:26:53.256136+0000","last_active":"2024-04-26T12:26:54.254502+0000","last_peered":"2024-04-26T12:26:54.254502+0000","last_clean":"2024-04-26T12:26:54.254502+0000","last_became_active":"2024-04-26T12:26:53.255297+0000","last_became_peered":"2024-04-26T12:26:53.255297+0000","last_unstale":"2024-04-26T12:26:54.254502+0000","last_undegraded":"2024-04-26T12:26:54.254502+0000","last_fullsized":"2024-04-26T12:26:54.254502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253859+0000","last_change":"2024-04-26T12:26:53.265584+0000","last_active":"2024-04-26T12:26:54.253859+0000","last_peered":"2024-04-26T12:26:54.253859+0000","last_clean":"2024-04-26T12:26:54.253859+0000","last_became_active":"2024-04-26T12:26:53.264555+0000","last_became_peered":"2024-04-26T12:26:53.264555+0000","last_unstale":"2024-04-26T12:26:54.253859+0000","last_undegraded":"2024-04-26T12:26:54.253859+0000","last_fullsized":"2024-04-26T12:26:54.253859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:20:03.207903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253538+0000","last_change":"2024-04-26T12:26:53.263004+0000","last_active":"2024-04-26T12:26:54.253538+0000","last_peered":"2024-04-26T12:26:54.253538+0000","last_clean":"2024-04-26T12:26:54.253538+0000","last_became_active":"2024-04-26T12:26:53.261193+0000","last_became_peered":"2024-04-26T12:26:53.261193+0000","last_unstale":"2024-04-26T12:26:54.253538+0000","last_undegraded":"2024-04-26T12:26:54.253538+0000","last_fullsized":"2024-04-26T12:26:54.253538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254277+0000","last_change":"2024-04-26T12:26:53.255483+0000","last_active":"2024-04-26T12:26:54.254277+0000","last_peered":"2024-04-26T12:26:54.254277+0000","last_clean":"2024-04-26T12:26:54.254277+0000","last_became_active":"2024-04-26T12:26:53.255001+0000","last_became_peered":"2024-04-26T12:26:53.255001+0000","last_unstale":"2024-04-26T12:26:54.254277+0000","last_undegraded":"2024-04-26T12:26:54.254277+0000","last_fullsized":"2024-04-26T12:26:54.254277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:34.496560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252949+0000","last_change":"2024-04-26T12:26:53.264139+0000","last_active":"2024-04-26T12:26:54.252949+0000","last_peered":"2024-04-26T12:26:54.252949+0000","last_clean":"2024-04-26T12:26:54.252949+0000","last_became_active":"2024-04-26T12:26:53.262002+0000","last_became_peered":"2024-04-26T12:26:53.262002+0000","last_unstale":"2024-04-26T12:26:54.252949+0000","last_undegraded":"2024-04-26T12:26:54.252949+0000","last_fullsized":"2024-04-26T12:26:54.252949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253027+0000","last_change":"2024-04-26T12:26:53.262987+0000","last_active":"2024-04-26T12:26:54.253027+0000","last_peered":"2024-04-26T12:26:54.253027+0000","last_clean":"2024-04-26T12:26:54.253027+0000","last_became_active":"2024-04-26T12:26:53.262113+0000","last_became_peered":"2024-04-26T12:26:53.262113+0000","last_unstale":"2024-04-26T12:26:54.253027+0000","last_undegraded":"2024-04-26T12:26:54.253027+0000","last_fullsized":"2024-04-26T12:26:54.253027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252720+0000","last_change":"2024-04-26T12:26:53.264092+0000","last_active":"2024-04-26T12:26:54.252720+0000","last_peered":"2024-04-26T12:26:54.252720+0000","last_clean":"2024-04-26T12:26:54.252720+0000","last_became_active":"2024-04-26T12:26:53.260501+0000","last_became_peered":"2024-04-26T12:26:53.260501+0000","last_unstale":"2024-04-26T12:26:54.252720+0000","last_undegraded":"2024-04-26T12:26:54.252720+0000","last_fullsized":"2024-04-26T12:26:54.252720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252461+0000","last_change":"2024-04-26T12:26:53.259692+0000","last_active":"2024-04-26T12:26:54.252461+0000","last_peered":"2024-04-26T12:26:54.252461+0000","last_clean":"2024-04-26T12:26:54.252461+0000","last_became_active":"2024-04-26T12:26:53.258709+0000","last_became_peered":"2024-04-26T12:26:53.258709+0000","last_unstale":"2024-04-26T12:26:54.252461+0000","last_undegraded":"2024-04-26T12:26:54.252461+0000","last_fullsized":"2024-04-26T12:26:54.252461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254822+0000","last_change":"2024-04-26T12:26:53.256190+0000","last_active":"2024-04-26T12:26:54.254822+0000","last_peered":"2024-04-26T12:26:54.254822+0000","last_clean":"2024-04-26T12:26:54.254822+0000","last_became_active":"2024-04-26T12:26:53.255382+0000","last_became_peered":"2024-04-26T12:26:53.255382+0000","last_unstale":"2024-04-26T12:26:54.254822+0000","last_undegraded":"2024-04-26T12:26:54.254822+0000","last_fullsized":"2024-04-26T12:26:54.254822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:53.950315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253701+0000","last_change":"2024-04-26T12:26:53.262951+0000","last_active":"2024-04-26T12:26:54.253701+0000","last_peered":"2024-04-26T12:26:54.253701+0000","last_clean":"2024-04-26T12:26:54.253701+0000","last_became_active":"2024-04-26T12:26:53.261842+0000","last_became_peered":"2024-04-26T12:26:53.261842+0000","last_unstale":"2024-04-26T12:26:54.253701+0000","last_undegraded":"2024-04-26T12:26:54.253701+0000","last_fullsized":"2024-04-26T12:26:54.253701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:35.327049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254183+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:26:54.254183+0000","last_peered":"2024-04-26T12:26:54.254183+0000","last_clean":"2024-04-26T12:26:54.254183+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:26:54.254183+0000","last_undegraded":"2024-04-26T12:26:54.254183+0000","last_fullsized":"2024-04-26T12:26:54.254183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254377+0000","last_change":"2024-04-26T12:26:53.254930+0000","last_active":"2024-04-26T12:26:54.254377+0000","last_peered":"2024-04-26T12:26:54.254377+0000","last_clean":"2024-04-26T12:26:54.254377+0000","last_became_active":"2024-04-26T12:26:53.253988+0000","last_became_peered":"2024-04-26T12:26:53.253988+0000","last_unstale":"2024-04-26T12:26:54.254377+0000","last_undegraded":"2024-04-26T12:26:54.254377+0000","last_fullsized":"2024-04-26T12:26:54.254377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253678+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:26:54.253678+0000","last_peered":"2024-04-26T12:26:54.253678+0000","last_clean":"2024-04-26T12:26:54.253678+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:26:54.253678+0000","last_undegraded":"2024-04-26T12:26:54.253678+0000","last_fullsized":"2024-04-26T12:26:54.253678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252782+0000","last_change":"2024-04-26T12:26:53.266568+0000","last_active":"2024-04-26T12:26:54.252782+0000","last_peered":"2024-04-26T12:26:54.252782+0000","last_clean":"2024-04-26T12:26:54.252782+0000","last_became_active":"2024-04-26T12:26:53.265846+0000","last_became_peered":"2024-04-26T12:26:53.265846+0000","last_unstale":"2024-04-26T12:26:54.252782+0000","last_undegraded":"2024-04-26T12:26:54.252782+0000","last_fullsized":"2024-04-26T12:26:54.252782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:10.849502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252784+0000","last_change":"2024-04-26T12:26:53.265459+0000","last_active":"2024-04-26T12:26:54.252784+0000","last_peered":"2024-04-26T12:26:54.252784+0000","last_clean":"2024-04-26T12:26:54.252784+0000","last_became_active":"2024-04-26T12:26:53.262898+0000","last_became_peered":"2024-04-26T12:26:53.262898+0000","last_unstale":"2024-04-26T12:26:54.252784+0000","last_undegraded":"2024-04-26T12:26:54.252784+0000","last_fullsized":"2024-04-26T12:26:54.252784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252546+0000","last_change":"2024-04-26T12:26:53.259864+0000","last_active":"2024-04-26T12:26:54.252546+0000","last_peered":"2024-04-26T12:26:54.252546+0000","last_clean":"2024-04-26T12:26:54.252546+0000","last_became_active":"2024-04-26T12:26:53.259025+0000","last_became_peered":"2024-04-26T12:26:53.259025+0000","last_unstale":"2024-04-26T12:26:54.252546+0000","last_undegraded":"2024-04-26T12:26:54.252546+0000","last_fullsized":"2024-04-26T12:26:54.252546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254951+0000","last_change":"2024-04-26T12:26:53.261186+0000","last_active":"2024-04-26T12:26:54.254951+0000","last_peered":"2024-04-26T12:26:54.254951+0000","last_clean":"2024-04-26T12:26:54.254951+0000","last_became_active":"2024-04-26T12:26:53.260820+0000","last_became_peered":"2024-04-26T12:26:53.260820+0000","last_unstale":"2024-04-26T12:26:54.254951+0000","last_undegraded":"2024-04-26T12:26:54.254951+0000","last_fullsized":"2024-04-26T12:26:54.254951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:00.602708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252225+0000","last_change":"2024-04-26T12:26:53.259728+0000","last_active":"2024-04-26T12:26:54.252225+0000","last_peered":"2024-04-26T12:26:54.252225+0000","last_clean":"2024-04-26T12:26:54.252225+0000","last_became_active":"2024-04-26T12:26:53.258952+0000","last_became_peered":"2024-04-26T12:26:53.258952+0000","last_unstale":"2024-04-26T12:26:54.252225+0000","last_undegraded":"2024-04-26T12:26:54.252225+0000","last_fullsized":"2024-04-26T12:26:54.252225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253512+0000","last_change":"2024-04-26T12:26:53.257321+0000","last_active":"2024-04-26T12:26:54.253512+0000","last_peered":"2024-04-26T12:26:54.253512+0000","last_clean":"2024-04-26T12:26:54.253512+0000","last_became_active":"2024-04-26T12:26:53.256192+0000","last_became_peered":"2024-04-26T12:26:53.256192+0000","last_unstale":"2024-04-26T12:26:54.253512+0000","last_undegraded":"2024-04-26T12:26:54.253512+0000","last_fullsized":"2024-04-26T12:26:54.253512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253202+0000","last_change":"2024-04-26T12:26:53.261669+0000","last_active":"2024-04-26T12:26:54.253202+0000","last_peered":"2024-04-26T12:26:54.253202+0000","last_clean":"2024-04-26T12:26:54.253202+0000","last_became_active":"2024-04-26T12:26:53.259854+0000","last_became_peered":"2024-04-26T12:26:53.259854+0000","last_unstale":"2024-04-26T12:26:54.253202+0000","last_undegraded":"2024-04-26T12:26:54.253202+0000","last_fullsized":"2024-04-26T12:26:54.253202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254141+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:26:54.254141+0000","last_peered":"2024-04-26T12:26:54.254141+0000","last_clean":"2024-04-26T12:26:54.254141+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:26:54.254141+0000","last_undegraded":"2024-04-26T12:26:54.254141+0000","last_fullsized":"2024-04-26T12:26:54.254141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251798+0000","last_change":"2024-04-26T12:26:53.262898+0000","last_active":"2024-04-26T12:26:54.251798+0000","last_peered":"2024-04-26T12:26:54.251798+0000","last_clean":"2024-04-26T12:26:54.251798+0000","last_became_active":"2024-04-26T12:26:53.262603+0000","last_became_peered":"2024-04-26T12:26:53.262603+0000","last_unstale":"2024-04-26T12:26:54.251798+0000","last_undegraded":"2024-04-26T12:26:54.251798+0000","last_fullsized":"2024-04-26T12:26:54.251798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254215+0000","last_change":"2024-04-26T12:26:53.254395+0000","last_active":"2024-04-26T12:26:54.254215+0000","last_peered":"2024-04-26T12:26:54.254215+0000","last_clean":"2024-04-26T12:26:54.254215+0000","last_became_active":"2024-04-26T12:26:53.253946+0000","last_became_peered":"2024-04-26T12:26:53.253946+0000","last_unstale":"2024-04-26T12:26:54.254215+0000","last_undegraded":"2024-04-26T12:26:54.254215+0000","last_fullsized":"2024-04-26T12:26:54.254215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:41.501818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254992+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:26:54.254992+0000","last_peered":"2024-04-26T12:26:54.254992+0000","last_clean":"2024-04-26T12:26:54.254992+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:26:54.254992+0000","last_undegraded":"2024-04-26T12:26:54.254992+0000","last_fullsized":"2024-04-26T12:26:54.254992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252630+0000","last_change":"2024-04-26T12:26:53.261876+0000","last_active":"2024-04-26T12:26:54.252630+0000","last_peered":"2024-04-26T12:26:54.252630+0000","last_clean":"2024-04-26T12:26:54.252630+0000","last_became_active":"2024-04-26T12:26:53.261485+0000","last_became_peered":"2024-04-26T12:26:53.261485+0000","last_unstale":"2024-04-26T12:26:54.252630+0000","last_undegraded":"2024-04-26T12:26:54.252630+0000","last_fullsized":"2024-04-26T12:26:54.252630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253751+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:26:54.253751+0000","last_peered":"2024-04-26T12:26:54.253751+0000","last_clean":"2024-04-26T12:26:54.253751+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:26:54.253751+0000","last_undegraded":"2024-04-26T12:26:54.253751+0000","last_fullsized":"2024-04-26T12:26:54.253751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254119+0000","last_change":"2024-04-26T12:26:52.839543+0000","last_active":"2024-04-26T12:26:54.254119+0000","last_peered":"2024-04-26T12:26:54.254119+0000","last_clean":"2024-04-26T12:26:54.254119+0000","last_became_active":"2024-04-26T12:26:52.839080+0000","last_became_peered":"2024-04-26T12:26:52.839080+0000","last_unstale":"2024-04-26T12:26:54.254119+0000","last_undegraded":"2024-04-26T12:26:54.254119+0000","last_fullsized":"2024-04-26T12:26:54.254119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:18.329898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254904+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:26:54.254904+0000","last_peered":"2024-04-26T12:26:54.254904+0000","last_clean":"2024-04-26T12:26:54.254904+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:26:54.254904+0000","last_undegraded":"2024-04-26T12:26:54.254904+0000","last_fullsized":"2024-04-26T12:26:54.254904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251794+0000","last_change":"2024-04-26T12:26:52.838082+0000","last_active":"2024-04-26T12:26:54.251794+0000","last_peered":"2024-04-26T12:26:54.251794+0000","last_clean":"2024-04-26T12:26:54.251794+0000","last_became_active":"2024-04-26T12:26:52.837596+0000","last_became_peered":"2024-04-26T12:26:52.837596+0000","last_unstale":"2024-04-26T12:26:54.251794+0000","last_undegraded":"2024-04-26T12:26:54.251794+0000","last_fullsized":"2024-04-26T12:26:54.251794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:08.892977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252572+0000","last_change":"2024-04-26T12:26:53.262665+0000","last_active":"2024-04-26T12:26:54.252572+0000","last_peered":"2024-04-26T12:26:54.252572+0000","last_clean":"2024-04-26T12:26:54.252572+0000","last_became_active":"2024-04-26T12:26:53.262161+0000","last_became_peered":"2024-04-26T12:26:53.262161+0000","last_unstale":"2024-04-26T12:26:54.252572+0000","last_undegraded":"2024-04-26T12:26:54.252572+0000","last_fullsized":"2024-04-26T12:26:54.252572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251650+0000","last_change":"2024-04-26T12:26:52.833500+0000","last_active":"2024-04-26T12:26:54.251650+0000","last_peered":"2024-04-26T12:26:54.251650+0000","last_clean":"2024-04-26T12:26:54.251650+0000","last_became_active":"2024-04-26T12:26:52.833152+0000","last_became_peered":"2024-04-26T12:26:52.833152+0000","last_unstale":"2024-04-26T12:26:54.251650+0000","last_undegraded":"2024-04-26T12:26:54.251650+0000","last_fullsized":"2024-04-26T12:26:54.251650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:28.165579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.255028+0000","last_change":"2024-04-26T12:26:53.260764+0000","last_active":"2024-04-26T12:26:54.255028+0000","last_peered":"2024-04-26T12:26:54.255028+0000","last_clean":"2024-04-26T12:26:54.255028+0000","last_became_active":"2024-04-26T12:26:53.260388+0000","last_became_peered":"2024-04-26T12:26:53.260388+0000","last_unstale":"2024-04-26T12:26:54.255028+0000","last_undegraded":"2024-04-26T12:26:54.255028+0000","last_fullsized":"2024-04-26T12:26:54.255028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252735+0000","last_change":"2024-04-26T12:26:52.837792+0000","last_active":"2024-04-26T12:26:54.252735+0000","last_peered":"2024-04-26T12:26:54.252735+0000","last_clean":"2024-04-26T12:26:54.252735+0000","last_became_active":"2024-04-26T12:26:52.837272+0000","last_became_peered":"2024-04-26T12:26:52.837272+0000","last_unstale":"2024-04-26T12:26:54.252735+0000","last_undegraded":"2024-04-26T12:26:54.252735+0000","last_fullsized":"2024-04-26T12:26:54.252735+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:12.837493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251539+0000","last_change":"2024-04-26T12:26:53.255423+0000","last_active":"2024-04-26T12:26:54.251539+0000","last_peered":"2024-04-26T12:26:54.251539+0000","last_clean":"2024-04-26T12:26:54.251539+0000","last_became_active":"2024-04-26T12:26:53.253812+0000","last_became_peered":"2024-04-26T12:26:53.253812+0000","last_unstale":"2024-04-26T12:26:54.251539+0000","last_undegraded":"2024-04-26T12:26:54.251539+0000","last_fullsized":"2024-04-26T12:26:54.251539+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:37.907024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253542+0000","last_change":"2024-04-26T12:26:52.840163+0000","last_active":"2024-04-26T12:26:54.253542+0000","last_peered":"2024-04-26T12:26:54.253542+0000","last_clean":"2024-04-26T12:26:54.253542+0000","last_became_active":"2024-04-26T12:26:52.839246+0000","last_became_peered":"2024-04-26T12:26:52.839246+0000","last_unstale":"2024-04-26T12:26:54.253542+0000","last_undegraded":"2024-04-26T12:26:54.253542+0000","last_fullsized":"2024-04-26T12:26:54.253542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:44.809454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251997+0000","last_change":"2024-04-26T12:26:53.258963+0000","last_active":"2024-04-26T12:26:54.251997+0000","last_peered":"2024-04-26T12:26:54.251997+0000","last_clean":"2024-04-26T12:26:54.251997+0000","last_became_active":"2024-04-26T12:26:53.258171+0000","last_became_peered":"2024-04-26T12:26:53.258171+0000","last_unstale":"2024-04-26T12:26:54.251997+0000","last_undegraded":"2024-04-26T12:26:54.251997+0000","last_fullsized":"2024-04-26T12:26:54.251997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254770+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:26:54.254770+0000","last_peered":"2024-04-26T12:26:54.254770+0000","last_clean":"2024-04-26T12:26:54.254770+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:26:54.254770+0000","last_undegraded":"2024-04-26T12:26:54.254770+0000","last_fullsized":"2024-04-26T12:26:54.254770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251746+0000","last_change":"2024-04-26T12:26:53.259209+0000","last_active":"2024-04-26T12:26:54.251746+0000","last_peered":"2024-04-26T12:26:54.251746+0000","last_clean":"2024-04-26T12:26:54.251746+0000","last_became_active":"2024-04-26T12:26:53.258620+0000","last_became_peered":"2024-04-26T12:26:53.258620+0000","last_unstale":"2024-04-26T12:26:54.251746+0000","last_undegraded":"2024-04-26T12:26:54.251746+0000","last_fullsized":"2024-04-26T12:26:54.251746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253386+0000","last_change":"2024-04-26T12:26:52.841280+0000","last_active":"2024-04-26T12:26:54.253386+0000","last_peered":"2024-04-26T12:26:54.253386+0000","last_clean":"2024-04-26T12:26:54.253386+0000","last_became_active":"2024-04-26T12:26:52.839398+0000","last_became_peered":"2024-04-26T12:26:52.839398+0000","last_unstale":"2024-04-26T12:26:54.253386+0000","last_undegraded":"2024-04-26T12:26:54.253386+0000","last_fullsized":"2024-04-26T12:26:54.253386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:53.889623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253612+0000","last_change":"2024-04-26T12:26:53.260830+0000","last_active":"2024-04-26T12:26:54.253612+0000","last_peered":"2024-04-26T12:26:54.253612+0000","last_clean":"2024-04-26T12:26:54.253612+0000","last_became_active":"2024-04-26T12:26:53.259452+0000","last_became_peered":"2024-04-26T12:26:53.259452+0000","last_unstale":"2024-04-26T12:26:54.253612+0000","last_undegraded":"2024-04-26T12:26:54.253612+0000","last_fullsized":"2024-04-26T12:26:54.253612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253560+0000","last_change":"2024-04-26T12:26:52.840521+0000","last_active":"2024-04-26T12:26:54.253560+0000","last_peered":"2024-04-26T12:26:54.253560+0000","last_clean":"2024-04-26T12:26:54.253560+0000","last_became_active":"2024-04-26T12:26:52.839442+0000","last_became_peered":"2024-04-26T12:26:52.839442+0000","last_unstale":"2024-04-26T12:26:54.253560+0000","last_undegraded":"2024-04-26T12:26:54.253560+0000","last_fullsized":"2024-04-26T12:26:54.253560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:28.165579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254485+0000","last_change":"2024-04-26T12:26:53.254489+0000","last_active":"2024-04-26T12:26:54.254485+0000","last_peered":"2024-04-26T12:26:54.254485+0000","last_clean":"2024-04-26T12:26:54.254485+0000","last_became_active":"2024-04-26T12:26:53.254099+0000","last_became_peered":"2024-04-26T12:26:53.254099+0000","last_unstale":"2024-04-26T12:26:54.254485+0000","last_undegraded":"2024-04-26T12:26:54.254485+0000","last_fullsized":"2024-04-26T12:26:54.254485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251939+0000","last_change":"2024-04-26T12:26:52.837857+0000","last_active":"2024-04-26T12:26:54.251939+0000","last_peered":"2024-04-26T12:26:54.251939+0000","last_clean":"2024-04-26T12:26:54.251939+0000","last_became_active":"2024-04-26T12:26:52.837402+0000","last_became_peered":"2024-04-26T12:26:52.837402+0000","last_unstale":"2024-04-26T12:26:54.251939+0000","last_undegraded":"2024-04-26T12:26:54.251939+0000","last_fullsized":"2024-04-26T12:26:54.251939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:53.889623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254865+0000","last_change":"2024-04-26T12:26:53.255659+0000","last_active":"2024-04-26T12:26:54.254865+0000","last_peered":"2024-04-26T12:26:54.254865+0000","last_clean":"2024-04-26T12:26:54.254865+0000","last_became_active":"2024-04-26T12:26:53.255253+0000","last_became_peered":"2024-04-26T12:26:53.255253+0000","last_unstale":"2024-04-26T12:26:54.254865+0000","last_undegraded":"2024-04-26T12:26:54.254865+0000","last_fullsized":"2024-04-26T12:26:54.254865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.236196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254021+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:26:54.254021+0000","last_peered":"2024-04-26T12:26:54.254021+0000","last_clean":"2024-04-26T12:26:54.254021+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:26:54.254021+0000","last_undegraded":"2024-04-26T12:26:54.254021+0000","last_fullsized":"2024-04-26T12:26:54.254021+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252460+0000","last_change":"2024-04-26T12:26:53.261880+0000","last_active":"2024-04-26T12:26:54.252460+0000","last_peered":"2024-04-26T12:26:54.252460+0000","last_clean":"2024-04-26T12:26:54.252460+0000","last_became_active":"2024-04-26T12:26:53.261373+0000","last_became_peered":"2024-04-26T12:26:53.261373+0000","last_unstale":"2024-04-26T12:26:54.252460+0000","last_undegraded":"2024-04-26T12:26:54.252460+0000","last_fullsized":"2024-04-26T12:26:54.252460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253014+0000","last_change":"2024-04-26T12:26:52.840810+0000","last_active":"2024-04-26T12:26:54.253014+0000","last_peered":"2024-04-26T12:26:54.253014+0000","last_clean":"2024-04-26T12:26:54.253014+0000","last_became_active":"2024-04-26T12:26:52.840059+0000","last_became_peered":"2024-04-26T12:26:52.840059+0000","last_unstale":"2024-04-26T12:26:54.253014+0000","last_undegraded":"2024-04-26T12:26:54.253014+0000","last_fullsized":"2024-04-26T12:26:54.253014+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:17.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252819+0000","last_change":"2024-04-26T12:26:53.265200+0000","last_active":"2024-04-26T12:26:54.252819+0000","last_peered":"2024-04-26T12:26:54.252819+0000","last_clean":"2024-04-26T12:26:54.252819+0000","last_became_active":"2024-04-26T12:26:53.264830+0000","last_became_peered":"2024-04-26T12:26:53.264830+0000","last_unstale":"2024-04-26T12:26:54.252819+0000","last_undegraded":"2024-04-26T12:26:54.252819+0000","last_fullsized":"2024-04-26T12:26:54.252819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253700+0000","last_change":"2024-04-26T12:26:52.840684+0000","last_active":"2024-04-26T12:26:54.253700+0000","last_peered":"2024-04-26T12:26:54.253700+0000","last_clean":"2024-04-26T12:26:54.253700+0000","last_became_active":"2024-04-26T12:26:52.839414+0000","last_became_peered":"2024-04-26T12:26:52.839414+0000","last_unstale":"2024-04-26T12:26:54.253700+0000","last_undegraded":"2024-04-26T12:26:54.253700+0000","last_fullsized":"2024-04-26T12:26:54.253700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:12.837493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253759+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:26:54.253759+0000","last_peered":"2024-04-26T12:26:54.253759+0000","last_clean":"2024-04-26T12:26:54.253759+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:26:54.253759+0000","last_undegraded":"2024-04-26T12:26:54.253759+0000","last_fullsized":"2024-04-26T12:26:54.253759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254691+0000","last_change":"2024-04-26T12:26:52.839692+0000","last_active":"2024-04-26T12:26:54.254691+0000","last_peered":"2024-04-26T12:26:54.254691+0000","last_clean":"2024-04-26T12:26:54.254691+0000","last_became_active":"2024-04-26T12:26:52.839419+0000","last_became_peered":"2024-04-26T12:26:52.839419+0000","last_unstale":"2024-04-26T12:26:54.254691+0000","last_undegraded":"2024-04-26T12:26:54.254691+0000","last_fullsized":"2024-04-26T12:26:54.254691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:25.416851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254179+0000","last_change":"2024-04-26T12:26:53.254395+0000","last_active":"2024-04-26T12:26:54.254179+0000","last_peered":"2024-04-26T12:26:54.254179+0000","last_clean":"2024-04-26T12:26:54.254179+0000","last_became_active":"2024-04-26T12:26:53.253926+0000","last_became_peered":"2024-04-26T12:26:53.253926+0000","last_unstale":"2024-04-26T12:26:54.254179+0000","last_undegraded":"2024-04-26T12:26:54.254179+0000","last_fullsized":"2024-04-26T12:26:54.254179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:59.517606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253817+0000","last_change":"2024-04-26T12:26:52.842023+0000","last_active":"2024-04-26T12:26:54.253817+0000","last_peered":"2024-04-26T12:26:54.253817+0000","last_clean":"2024-04-26T12:26:54.253817+0000","last_became_active":"2024-04-26T12:26:52.840857+0000","last_became_peered":"2024-04-26T12:26:52.840857+0000","last_unstale":"2024-04-26T12:26:54.253817+0000","last_undegraded":"2024-04-26T12:26:54.253817+0000","last_fullsized":"2024-04-26T12:26:54.253817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:08.892977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253219+0000","last_change":"2024-04-26T12:26:53.263148+0000","last_active":"2024-04-26T12:26:54.253219+0000","last_peered":"2024-04-26T12:26:54.253219+0000","last_clean":"2024-04-26T12:26:54.253219+0000","last_became_active":"2024-04-26T12:26:53.261904+0000","last_became_peered":"2024-04-26T12:26:53.261904+0000","last_unstale":"2024-04-26T12:26:54.253219+0000","last_undegraded":"2024-04-26T12:26:54.253219+0000","last_fullsized":"2024-04-26T12:26:54.253219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253194+0000","last_change":"2024-04-26T12:26:52.841895+0000","last_active":"2024-04-26T12:26:54.253194+0000","last_peered":"2024-04-26T12:26:54.253194+0000","last_clean":"2024-04-26T12:26:54.253194+0000","last_became_active":"2024-04-26T12:26:52.840195+0000","last_became_peered":"2024-04-26T12:26:52.840195+0000","last_unstale":"2024-04-26T12:26:54.253194+0000","last_undegraded":"2024-04-26T12:26:54.253194+0000","last_fullsized":"2024-04-26T12:26:54.253194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:03.469888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252358+0000","last_change":"2024-04-26T12:26:53.265195+0000","last_active":"2024-04-26T12:26:54.252358+0000","last_peered":"2024-04-26T12:26:54.252358+0000","last_clean":"2024-04-26T12:26:54.252358+0000","last_became_active":"2024-04-26T12:26:53.264819+0000","last_became_peered":"2024-04-26T12:26:53.264819+0000","last_unstale":"2024-04-26T12:26:54.252358+0000","last_undegraded":"2024-04-26T12:26:54.252358+0000","last_fullsized":"2024-04-26T12:26:54.252358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252231+0000","last_change":"2024-04-26T12:26:52.837057+0000","last_active":"2024-04-26T12:26:54.252231+0000","last_peered":"2024-04-26T12:26:54.252231+0000","last_clean":"2024-04-26T12:26:54.252231+0000","last_became_active":"2024-04-26T12:26:52.836594+0000","last_became_peered":"2024-04-26T12:26:52.836594+0000","last_unstale":"2024-04-26T12:26:54.252231+0000","last_undegraded":"2024-04-26T12:26:54.252231+0000","last_fullsized":"2024-04-26T12:26:54.252231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:42.768206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253143+0000","last_change":"2024-04-26T12:26:53.263194+0000","last_active":"2024-04-26T12:26:54.253143+0000","last_peered":"2024-04-26T12:26:54.253143+0000","last_clean":"2024-04-26T12:26:54.253143+0000","last_became_active":"2024-04-26T12:26:53.262366+0000","last_became_peered":"2024-04-26T12:26:53.262366+0000","last_unstale":"2024-04-26T12:26:54.253143+0000","last_undegraded":"2024-04-26T12:26:54.253143+0000","last_fullsized":"2024-04-26T12:26:54.253143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253105+0000","last_change":"2024-04-26T12:26:52.842337+0000","last_active":"2024-04-26T12:26:54.253105+0000","last_peered":"2024-04-26T12:26:54.253105+0000","last_clean":"2024-04-26T12:26:54.253105+0000","last_became_active":"2024-04-26T12:26:52.842009+0000","last_became_peered":"2024-04-26T12:26:52.842009+0000","last_unstale":"2024-04-26T12:26:54.253105+0000","last_undegraded":"2024-04-26T12:26:54.253105+0000","last_fullsized":"2024-04-26T12:26:54.253105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253989+0000","last_change":"2024-04-26T12:26:53.266014+0000","last_active":"2024-04-26T12:26:54.253989+0000","last_peered":"2024-04-26T12:26:54.253989+0000","last_clean":"2024-04-26T12:26:54.253989+0000","last_became_active":"2024-04-26T12:26:53.264254+0000","last_became_peered":"2024-04-26T12:26:53.264254+0000","last_unstale":"2024-04-26T12:26:54.253989+0000","last_undegraded":"2024-04-26T12:26:54.253989+0000","last_fullsized":"2024-04-26T12:26:54.253989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:04.369827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253838+0000","last_change":"2024-04-26T12:26:52.839759+0000","last_active":"2024-04-26T12:26:54.253838+0000","last_peered":"2024-04-26T12:26:54.253838+0000","last_clean":"2024-04-26T12:26:54.253838+0000","last_became_active":"2024-04-26T12:26:52.839445+0000","last_became_peered":"2024-04-26T12:26:52.839445+0000","last_unstale":"2024-04-26T12:26:54.253838+0000","last_undegraded":"2024-04-26T12:26:54.253838+0000","last_fullsized":"2024-04-26T12:26:54.253838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:40.499263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253688+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:26:54.253688+0000","last_peered":"2024-04-26T12:26:54.253688+0000","last_clean":"2024-04-26T12:26:54.253688+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:26:54.253688+0000","last_undegraded":"2024-04-26T12:26:54.253688+0000","last_fullsized":"2024-04-26T12:26:54.253688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253924+0000","last_change":"2024-04-26T12:26:52.839211+0000","last_active":"2024-04-26T12:26:54.253924+0000","last_peered":"2024-04-26T12:26:54.253924+0000","last_clean":"2024-04-26T12:26:54.253924+0000","last_became_active":"2024-04-26T12:26:52.838988+0000","last_became_peered":"2024-04-26T12:26:52.838988+0000","last_unstale":"2024-04-26T12:26:54.253924+0000","last_undegraded":"2024-04-26T12:26:54.253924+0000","last_fullsized":"2024-04-26T12:26:54.253924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:04.569832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252653+0000","last_change":"2024-04-26T12:26:53.260098+0000","last_active":"2024-04-26T12:26:54.252653+0000","last_peered":"2024-04-26T12:26:54.252653+0000","last_clean":"2024-04-26T12:26:54.252653+0000","last_became_active":"2024-04-26T12:26:53.259188+0000","last_became_peered":"2024-04-26T12:26:53.259188+0000","last_unstale":"2024-04-26T12:26:54.252653+0000","last_undegraded":"2024-04-26T12:26:54.252653+0000","last_fullsized":"2024-04-26T12:26:54.252653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:34.496560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.248033+0000","last_change":"2024-04-26T12:26:47.810338+0000","last_active":"2024-04-26T12:26:53.248033+0000","last_peered":"2024-04-26T12:26:53.248033+0000","last_clean":"2024-04-26T12:26:53.248033+0000","last_became_active":"2024-04-26T12:26:47.810127+0000","last_became_peered":"2024-04-26T12:26:47.810127+0000","last_unstale":"2024-04-26T12:26:53.248033+0000","last_undegraded":"2024-04-26T12:26:53.248033+0000","last_fullsized":"2024-04-26T12:26:53.248033+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:11.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253912+0000","last_change":"2024-04-26T12:26:52.841192+0000","last_active":"2024-04-26T12:26:54.253912+0000","last_peered":"2024-04-26T12:26:54.253912+0000","last_clean":"2024-04-26T12:26:54.253912+0000","last_became_active":"2024-04-26T12:26:52.840137+0000","last_became_peered":"2024-04-26T12:26:52.840137+0000","last_unstale":"2024-04-26T12:26:54.253912+0000","last_undegraded":"2024-04-26T12:26:54.253912+0000","last_fullsized":"2024-04-26T12:26:54.253912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:20.488738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254278+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:26:54.254278+0000","last_peered":"2024-04-26T12:26:54.254278+0000","last_clean":"2024-04-26T12:26:54.254278+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:26:54.254278+0000","last_undegraded":"2024-04-26T12:26:54.254278+0000","last_fullsized":"2024-04-26T12:26:54.254278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.257442+0000","last_change":"2024-04-26T12:26:47.811997+0000","last_active":"2024-04-26T12:26:53.257442+0000","last_peered":"2024-04-26T12:26:53.257442+0000","last_clean":"2024-04-26T12:26:53.257442+0000","last_became_active":"2024-04-26T12:26:47.811819+0000","last_became_peered":"2024-04-26T12:26:47.811819+0000","last_unstale":"2024-04-26T12:26:53.257442+0000","last_undegraded":"2024-04-26T12:26:53.257442+0000","last_fullsized":"2024-04-26T12:26:53.257442+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:11.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253332+0000","last_change":"2024-04-26T12:26:52.841195+0000","last_active":"2024-04-26T12:26:54.253332+0000","last_peered":"2024-04-26T12:26:54.253332+0000","last_clean":"2024-04-26T12:26:54.253332+0000","last_became_active":"2024-04-26T12:26:52.839558+0000","last_became_peered":"2024-04-26T12:26:52.839558+0000","last_unstale":"2024-04-26T12:26:54.253332+0000","last_undegraded":"2024-04-26T12:26:54.253332+0000","last_fullsized":"2024-04-26T12:26:54.253332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:54.208845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252177+0000","last_change":"2024-04-26T12:26:53.259270+0000","last_active":"2024-04-26T12:26:54.252177+0000","last_peered":"2024-04-26T12:26:54.252177+0000","last_clean":"2024-04-26T12:26:54.252177+0000","last_became_active":"2024-04-26T12:26:53.258588+0000","last_became_peered":"2024-04-26T12:26:53.258588+0000","last_unstale":"2024-04-26T12:26:54.252177+0000","last_undegraded":"2024-04-26T12:26:54.252177+0000","last_fullsized":"2024-04-26T12:26:54.252177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:09.233018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.247515+0000","last_change":"2024-04-26T12:26:47.811787+0000","last_active":"2024-04-26T12:26:53.247515+0000","last_peered":"2024-04-26T12:26:53.247515+0000","last_clean":"2024-04-26T12:26:53.247515+0000","last_became_active":"2024-04-26T12:26:47.811512+0000","last_became_peered":"2024-04-26T12:26:47.811512+0000","last_unstale":"2024-04-26T12:26:53.247515+0000","last_undegraded":"2024-04-26T12:26:53.247515+0000","last_fullsized":"2024-04-26T12:26:53.247515+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:56.379533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253871+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:26:54.253871+0000","last_peered":"2024-04-26T12:26:54.253871+0000","last_clean":"2024-04-26T12:26:54.253871+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:26:54.253871+0000","last_undegraded":"2024-04-26T12:26:54.253871+0000","last_fullsized":"2024-04-26T12:26:54.253871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252748+0000","last_change":"2024-04-26T12:26:53.260244+0000","last_active":"2024-04-26T12:26:54.252748+0000","last_peered":"2024-04-26T12:26:54.252748+0000","last_clean":"2024-04-26T12:26:54.252748+0000","last_became_active":"2024-04-26T12:26:53.259917+0000","last_became_peered":"2024-04-26T12:26:53.259917+0000","last_unstale":"2024-04-26T12:26:54.252748+0000","last_undegraded":"2024-04-26T12:26:54.252748+0000","last_fullsized":"2024-04-26T12:26:54.252748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258160+0000","last_change":"2024-04-26T12:26:47.812045+0000","last_active":"2024-04-26T12:26:53.258160+0000","last_peered":"2024-04-26T12:26:53.258160+0000","last_clean":"2024-04-26T12:26:53.258160+0000","last_became_active":"2024-04-26T12:26:47.811787+0000","last_became_peered":"2024-04-26T12:26:47.811787+0000","last_unstale":"2024-04-26T12:26:53.258160+0000","last_undegraded":"2024-04-26T12:26:53.258160+0000","last_fullsized":"2024-04-26T12:26:53.258160+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:30.757169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":211,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258235+0000","last_change":"2024-04-26T12:26:46.810189+0000","last_active":"2024-04-26T12:26:53.258235+0000","last_peered":"2024-04-26T12:26:53.258235+0000","last_clean":"2024-04-26T12:26:53.258235+0000","last_became_active":"2024-04-26T12:26:46.809453+0000","last_became_peered":"2024-04-26T12:26:46.809453+0000","last_unstale":"2024-04-26T12:26:53.258235+0000","last_undegraded":"2024-04-26T12:26:53.258235+0000","last_fullsized":"2024-04-26T12:26:53.258235+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:18.618650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251680+0000","last_change":"2024-04-26T12:26:52.833869+0000","last_active":"2024-04-26T12:26:54.251680+0000","last_peered":"2024-04-26T12:26:54.251680+0000","last_clean":"2024-04-26T12:26:54.251680+0000","last_became_active":"2024-04-26T12:26:52.833257+0000","last_became_peered":"2024-04-26T12:26:52.833257+0000","last_unstale":"2024-04-26T12:26:54.251680+0000","last_undegraded":"2024-04-26T12:26:54.251680+0000","last_fullsized":"2024-04-26T12:26:54.251680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253947+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:26:54.253947+0000","last_peered":"2024-04-26T12:26:54.253947+0000","last_clean":"2024-04-26T12:26:54.253947+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:26:54.253947+0000","last_undegraded":"2024-04-26T12:26:54.253947+0000","last_fullsized":"2024-04-26T12:26:54.253947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258561+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:26:53.258561+0000","last_peered":"2024-04-26T12:26:53.258561+0000","last_clean":"2024-04-26T12:26:53.258561+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:26:53.258561+0000","last_undegraded":"2024-04-26T12:26:53.258561+0000","last_fullsized":"2024-04-26T12:26:53.258561+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251513+0000","last_change":"2024-04-26T12:26:52.836395+0000","last_active":"2024-04-26T12:26:54.251513+0000","last_peered":"2024-04-26T12:26:54.251513+0000","last_clean":"2024-04-26T12:26:54.251513+0000","last_became_active":"2024-04-26T12:26:52.836023+0000","last_became_peered":"2024-04-26T12:26:52.836023+0000","last_unstale":"2024-04-26T12:26:54.251513+0000","last_undegraded":"2024-04-26T12:26:54.251513+0000","last_fullsized":"2024-04-26T12:26:54.251513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:54.208845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254838+0000","last_change":"2024-04-26T12:26:53.260768+0000","last_active":"2024-04-26T12:26:54.254838+0000","last_peered":"2024-04-26T12:26:54.254838+0000","last_clean":"2024-04-26T12:26:54.254838+0000","last_became_active":"2024-04-26T12:26:53.259807+0000","last_became_peered":"2024-04-26T12:26:53.259807+0000","last_unstale":"2024-04-26T12:26:54.254838+0000","last_undegraded":"2024-04-26T12:26:54.254838+0000","last_fullsized":"2024-04-26T12:26:54.254838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.250666+0000","last_change":"2024-04-26T12:26:47.812595+0000","last_active":"2024-04-26T12:26:53.250666+0000","last_peered":"2024-04-26T12:26:53.250666+0000","last_clean":"2024-04-26T12:26:53.250666+0000","last_became_active":"2024-04-26T12:26:47.812366+0000","last_became_peered":"2024-04-26T12:26:47.812366+0000","last_unstale":"2024-04-26T12:26:53.250666+0000","last_undegraded":"2024-04-26T12:26:53.250666+0000","last_fullsized":"2024-04-26T12:26:53.250666+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:57.920665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252434+0000","last_change":"2024-04-26T12:26:52.833996+0000","last_active":"2024-04-26T12:26:54.252434+0000","last_peered":"2024-04-26T12:26:54.252434+0000","last_clean":"2024-04-26T12:26:54.252434+0000","last_became_active":"2024-04-26T12:26:52.833452+0000","last_became_peered":"2024-04-26T12:26:52.833452+0000","last_unstale":"2024-04-26T12:26:54.252434+0000","last_undegraded":"2024-04-26T12:26:54.252434+0000","last_fullsized":"2024-04-26T12:26:54.252434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254460+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:26:54.254460+0000","last_peered":"2024-04-26T12:26:54.254460+0000","last_clean":"2024-04-26T12:26:54.254460+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:26:54.254460+0000","last_undegraded":"2024-04-26T12:26:54.254460+0000","last_fullsized":"2024-04-26T12:26:54.254460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252570+0000","last_change":"2024-04-26T12:26:52.837167+0000","last_active":"2024-04-26T12:26:54.252570+0000","last_peered":"2024-04-26T12:26:54.252570+0000","last_clean":"2024-04-26T12:26:54.252570+0000","last_became_active":"2024-04-26T12:26:52.836534+0000","last_became_peered":"2024-04-26T12:26:52.836534+0000","last_unstale":"2024-04-26T12:26:54.252570+0000","last_undegraded":"2024-04-26T12:26:54.252570+0000","last_fullsized":"2024-04-26T12:26:54.252570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:17.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.248427+0000","last_change":"2024-04-26T12:26:47.811807+0000","last_active":"2024-04-26T12:26:53.248427+0000","last_peered":"2024-04-26T12:26:53.248427+0000","last_clean":"2024-04-26T12:26:53.248427+0000","last_became_active":"2024-04-26T12:26:47.811527+0000","last_became_peered":"2024-04-26T12:26:47.811527+0000","last_unstale":"2024-04-26T12:26:53.248427+0000","last_undegraded":"2024-04-26T12:26:53.248427+0000","last_fullsized":"2024-04-26T12:26:53.248427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:02.127354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251466+0000","last_change":"2024-04-26T12:26:53.265773+0000","last_active":"2024-04-26T12:26:54.251466+0000","last_peered":"2024-04-26T12:26:54.251466+0000","last_clean":"2024-04-26T12:26:54.251466+0000","last_became_active":"2024-04-26T12:26:53.265567+0000","last_became_peered":"2024-04-26T12:26:53.265567+0000","last_unstale":"2024-04-26T12:26:54.251466+0000","last_undegraded":"2024-04-26T12:26:54.251466+0000","last_fullsized":"2024-04-26T12:26:54.251466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258624+0000","last_change":"2024-04-26T12:26:47.811204+0000","last_active":"2024-04-26T12:26:53.258624+0000","last_peered":"2024-04-26T12:26:53.258624+0000","last_clean":"2024-04-26T12:26:53.258624+0000","last_became_active":"2024-04-26T12:26:47.810997+0000","last_became_peered":"2024-04-26T12:26:47.810997+0000","last_unstale":"2024-04-26T12:26:53.258624+0000","last_undegraded":"2024-04-26T12:26:53.258624+0000","last_fullsized":"2024-04-26T12:26:53.258624+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:24.967175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:55.294535+0000","last_change":"2024-04-26T12:26:52.837269+0000","last_active":"2024-04-26T12:26:55.294535+0000","last_peered":"2024-04-26T12:26:55.294535+0000","last_clean":"2024-04-26T12:26:55.294535+0000","last_became_active":"2024-04-26T12:26:52.836310+0000","last_became_peered":"2024-04-26T12:26:52.836310+0000","last_unstale":"2024-04-26T12:26:55.294535+0000","last_undegraded":"2024-04-26T12:26:55.294535+0000","last_fullsized":"2024-04-26T12:26:55.294535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:20.488738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254362+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:26:54.254362+0000","last_peered":"2024-04-26T12:26:54.254362+0000","last_clean":"2024-04-26T12:26:54.254362+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:26:54.254362+0000","last_undegraded":"2024-04-26T12:26:54.254362+0000","last_fullsized":"2024-04-26T12:26:54.254362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254162+0000","last_change":"2024-04-26T12:26:52.840797+0000","last_active":"2024-04-26T12:26:54.254162+0000","last_peered":"2024-04-26T12:26:54.254162+0000","last_clean":"2024-04-26T12:26:54.254162+0000","last_became_active":"2024-04-26T12:26:52.840409+0000","last_became_peered":"2024-04-26T12:26:52.840409+0000","last_unstale":"2024-04-26T12:26:54.254162+0000","last_undegraded":"2024-04-26T12:26:54.254162+0000","last_fullsized":"2024-04-26T12:26:54.254162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:57.898978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254682+0000","last_change":"2024-04-26T12:26:53.255044+0000","last_active":"2024-04-26T12:26:54.254682+0000","last_peered":"2024-04-26T12:26:54.254682+0000","last_clean":"2024-04-26T12:26:54.254682+0000","last_became_active":"2024-04-26T12:26:53.254164+0000","last_became_peered":"2024-04-26T12:26:53.254164+0000","last_unstale":"2024-04-26T12:26:54.254682+0000","last_undegraded":"2024-04-26T12:26:54.254682+0000","last_fullsized":"2024-04-26T12:26:54.254682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:07.899699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253335+0000","last_change":"2024-04-26T12:26:52.841338+0000","last_active":"2024-04-26T12:26:54.253335+0000","last_peered":"2024-04-26T12:26:54.253335+0000","last_clean":"2024-04-26T12:26:54.253335+0000","last_became_active":"2024-04-26T12:26:52.840770+0000","last_became_peered":"2024-04-26T12:26:52.840770+0000","last_unstale":"2024-04-26T12:26:54.253335+0000","last_undegraded":"2024-04-26T12:26:54.253335+0000","last_fullsized":"2024-04-26T12:26:54.253335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:33.466992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253384+0000","last_change":"2024-04-26T12:26:53.260953+0000","last_active":"2024-04-26T12:26:54.253384+0000","last_peered":"2024-04-26T12:26:54.253384+0000","last_clean":"2024-04-26T12:26:54.253384+0000","last_became_active":"2024-04-26T12:26:53.259228+0000","last_became_peered":"2024-04-26T12:26:53.259228+0000","last_unstale":"2024-04-26T12:26:54.253384+0000","last_undegraded":"2024-04-26T12:26:54.253384+0000","last_fullsized":"2024-04-26T12:26:54.253384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254744+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:26:54.254744+0000","last_peered":"2024-04-26T12:26:54.254744+0000","last_clean":"2024-04-26T12:26:54.254744+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:26:54.254744+0000","last_undegraded":"2024-04-26T12:26:54.254744+0000","last_fullsized":"2024-04-26T12:26:54.254744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253334+0000","last_change":"2024-04-26T12:26:53.262221+0000","last_active":"2024-04-26T12:26:54.253334+0000","last_peered":"2024-04-26T12:26:54.253334+0000","last_clean":"2024-04-26T12:26:54.253334+0000","last_became_active":"2024-04-26T12:26:53.261112+0000","last_became_peered":"2024-04-26T12:26:53.261112+0000","last_unstale":"2024-04-26T12:26:54.253334+0000","last_undegraded":"2024-04-26T12:26:54.253334+0000","last_fullsized":"2024-04-26T12:26:54.253334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252558+0000","last_change":"2024-04-26T12:26:52.837399+0000","last_active":"2024-04-26T12:26:54.252558+0000","last_peered":"2024-04-26T12:26:54.252558+0000","last_clean":"2024-04-26T12:26:54.252558+0000","last_became_active":"2024-04-26T12:26:52.835974+0000","last_became_peered":"2024-04-26T12:26:52.835974+0000","last_unstale":"2024-04-26T12:26:54.252558+0000","last_undegraded":"2024-04-26T12:26:54.252558+0000","last_fullsized":"2024-04-26T12:26:54.252558+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:03.469888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254323+0000","last_change":"2024-04-26T12:26:53.254495+0000","last_active":"2024-04-26T12:26:54.254323+0000","last_peered":"2024-04-26T12:26:54.254323+0000","last_clean":"2024-04-26T12:26:54.254323+0000","last_became_active":"2024-04-26T12:26:53.254149+0000","last_became_peered":"2024-04-26T12:26:53.254149+0000","last_unstale":"2024-04-26T12:26:54.254323+0000","last_undegraded":"2024-04-26T12:26:54.254323+0000","last_fullsized":"2024-04-26T12:26:54.254323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:37.907024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252663+0000","last_change":"2024-04-26T12:26:52.836279+0000","last_active":"2024-04-26T12:26:54.252663+0000","last_peered":"2024-04-26T12:26:54.252663+0000","last_clean":"2024-04-26T12:26:54.252663+0000","last_became_active":"2024-04-26T12:26:52.835916+0000","last_became_peered":"2024-04-26T12:26:52.835916+0000","last_unstale":"2024-04-26T12:26:54.252663+0000","last_undegraded":"2024-04-26T12:26:54.252663+0000","last_fullsized":"2024-04-26T12:26:54.252663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:33.466992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253090+0000","last_change":"2024-04-26T12:26:53.259112+0000","last_active":"2024-04-26T12:26:54.253090+0000","last_peered":"2024-04-26T12:26:54.253090+0000","last_clean":"2024-04-26T12:26:54.253090+0000","last_became_active":"2024-04-26T12:26:53.256762+0000","last_became_peered":"2024-04-26T12:26:53.256762+0000","last_unstale":"2024-04-26T12:26:54.253090+0000","last_undegraded":"2024-04-26T12:26:54.253090+0000","last_fullsized":"2024-04-26T12:26:54.253090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252967+0000","last_change":"2024-04-26T12:26:53.263131+0000","last_active":"2024-04-26T12:26:54.252967+0000","last_peered":"2024-04-26T12:26:54.252967+0000","last_clean":"2024-04-26T12:26:54.252967+0000","last_became_active":"2024-04-26T12:26:53.260489+0000","last_became_peered":"2024-04-26T12:26:53.260489+0000","last_unstale":"2024-04-26T12:26:54.252967+0000","last_undegraded":"2024-04-26T12:26:54.252967+0000","last_fullsized":"2024-04-26T12:26:54.252967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251606+0000","last_change":"2024-04-26T12:26:53.259832+0000","last_active":"2024-04-26T12:26:54.251606+0000","last_peered":"2024-04-26T12:26:54.251606+0000","last_clean":"2024-04-26T12:26:54.251606+0000","last_became_active":"2024-04-26T12:26:53.259028+0000","last_became_peered":"2024-04-26T12:26:53.259028+0000","last_unstale":"2024-04-26T12:26:54.251606+0000","last_undegraded":"2024-04-26T12:26:54.251606+0000","last_fullsized":"2024-04-26T12:26:54.251606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254286+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:26:54.254286+0000","last_peered":"2024-04-26T12:26:54.254286+0000","last_clean":"2024-04-26T12:26:54.254286+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:26:54.254286+0000","last_undegraded":"2024-04-26T12:26:54.254286+0000","last_fullsized":"2024-04-26T12:26:54.254286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252363+0000","last_change":"2024-04-26T12:26:53.259057+0000","last_active":"2024-04-26T12:26:54.252363+0000","last_peered":"2024-04-26T12:26:54.252363+0000","last_clean":"2024-04-26T12:26:54.252363+0000","last_became_active":"2024-04-26T12:26:53.257816+0000","last_became_peered":"2024-04-26T12:26:53.257816+0000","last_unstale":"2024-04-26T12:26:54.252363+0000","last_undegraded":"2024-04-26T12:26:54.252363+0000","last_fullsized":"2024-04-26T12:26:54.252363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:53.950315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254747+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:26:54.254747+0000","last_peered":"2024-04-26T12:26:54.254747+0000","last_clean":"2024-04-26T12:26:54.254747+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:26:54.254747+0000","last_undegraded":"2024-04-26T12:26:54.254747+0000","last_fullsized":"2024-04-26T12:26:54.254747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":641176,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":641792,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":147456,"data_stored":49678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:27:01.379 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:27:01.757 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:27:01.758 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:27:01.768 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-26T12:27:01.290622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81664,"kb_used_data":600,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033856,"statfs":{"total":289910292480,"available":289826668544,"internally_reserved":0,"allocated":614400,"data_stored":1332646,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.043204"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.255057+0000","last_change":"2024-04-26T12:26:53.255588+0000","last_active":"2024-04-26T12:26:54.255057+0000","last_peered":"2024-04-26T12:26:54.255057+0000","last_clean":"2024-04-26T12:26:54.255057+0000","last_became_active":"2024-04-26T12:26:53.255201+0000","last_became_peered":"2024-04-26T12:26:53.255201+0000","last_unstale":"2024-04-26T12:26:54.255057+0000","last_undegraded":"2024-04-26T12:26:54.255057+0000","last_fullsized":"2024-04-26T12:26:54.255057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:09.233018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254502+0000","last_change":"2024-04-26T12:26:53.256136+0000","last_active":"2024-04-26T12:26:54.254502+0000","last_peered":"2024-04-26T12:26:54.254502+0000","last_clean":"2024-04-26T12:26:54.254502+0000","last_became_active":"2024-04-26T12:26:53.255297+0000","last_became_peered":"2024-04-26T12:26:53.255297+0000","last_unstale":"2024-04-26T12:26:54.254502+0000","last_undegraded":"2024-04-26T12:26:54.254502+0000","last_fullsized":"2024-04-26T12:26:54.254502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253859+0000","last_change":"2024-04-26T12:26:53.265584+0000","last_active":"2024-04-26T12:26:54.253859+0000","last_peered":"2024-04-26T12:26:54.253859+0000","last_clean":"2024-04-26T12:26:54.253859+0000","last_became_active":"2024-04-26T12:26:53.264555+0000","last_became_peered":"2024-04-26T12:26:53.264555+0000","last_unstale":"2024-04-26T12:26:54.253859+0000","last_undegraded":"2024-04-26T12:26:54.253859+0000","last_fullsized":"2024-04-26T12:26:54.253859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:20:03.207903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253538+0000","last_change":"2024-04-26T12:26:53.263004+0000","last_active":"2024-04-26T12:26:54.253538+0000","last_peered":"2024-04-26T12:26:54.253538+0000","last_clean":"2024-04-26T12:26:54.253538+0000","last_became_active":"2024-04-26T12:26:53.261193+0000","last_became_peered":"2024-04-26T12:26:53.261193+0000","last_unstale":"2024-04-26T12:26:54.253538+0000","last_undegraded":"2024-04-26T12:26:54.253538+0000","last_fullsized":"2024-04-26T12:26:54.253538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254277+0000","last_change":"2024-04-26T12:26:53.255483+0000","last_active":"2024-04-26T12:26:54.254277+0000","last_peered":"2024-04-26T12:26:54.254277+0000","last_clean":"2024-04-26T12:26:54.254277+0000","last_became_active":"2024-04-26T12:26:53.255001+0000","last_became_peered":"2024-04-26T12:26:53.255001+0000","last_unstale":"2024-04-26T12:26:54.254277+0000","last_undegraded":"2024-04-26T12:26:54.254277+0000","last_fullsized":"2024-04-26T12:26:54.254277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:34.496560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252949+0000","last_change":"2024-04-26T12:26:53.264139+0000","last_active":"2024-04-26T12:26:54.252949+0000","last_peered":"2024-04-26T12:26:54.252949+0000","last_clean":"2024-04-26T12:26:54.252949+0000","last_became_active":"2024-04-26T12:26:53.262002+0000","last_became_peered":"2024-04-26T12:26:53.262002+0000","last_unstale":"2024-04-26T12:26:54.252949+0000","last_undegraded":"2024-04-26T12:26:54.252949+0000","last_fullsized":"2024-04-26T12:26:54.252949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253027+0000","last_change":"2024-04-26T12:26:53.262987+0000","last_active":"2024-04-26T12:26:54.253027+0000","last_peered":"2024-04-26T12:26:54.253027+0000","last_clean":"2024-04-26T12:26:54.253027+0000","last_became_active":"2024-04-26T12:26:53.262113+0000","last_became_peered":"2024-04-26T12:26:53.262113+0000","last_unstale":"2024-04-26T12:26:54.253027+0000","last_undegraded":"2024-04-26T12:26:54.253027+0000","last_fullsized":"2024-04-26T12:26:54.253027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252720+0000","last_change":"2024-04-26T12:26:53.264092+0000","last_active":"2024-04-26T12:26:54.252720+0000","last_peered":"2024-04-26T12:26:54.252720+0000","last_clean":"2024-04-26T12:26:54.252720+0000","last_became_active":"2024-04-26T12:26:53.260501+0000","last_became_peered":"2024-04-26T12:26:53.260501+0000","last_unstale":"2024-04-26T12:26:54.252720+0000","last_undegraded":"2024-04-26T12:26:54.252720+0000","last_fullsized":"2024-04-26T12:26:54.252720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252461+0000","last_change":"2024-04-26T12:26:53.259692+0000","last_active":"2024-04-26T12:26:54.252461+0000","last_peered":"2024-04-26T12:26:54.252461+0000","last_clean":"2024-04-26T12:26:54.252461+0000","last_became_active":"2024-04-26T12:26:53.258709+0000","last_became_peered":"2024-04-26T12:26:53.258709+0000","last_unstale":"2024-04-26T12:26:54.252461+0000","last_undegraded":"2024-04-26T12:26:54.252461+0000","last_fullsized":"2024-04-26T12:26:54.252461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254822+0000","last_change":"2024-04-26T12:26:53.256190+0000","last_active":"2024-04-26T12:26:54.254822+0000","last_peered":"2024-04-26T12:26:54.254822+0000","last_clean":"2024-04-26T12:26:54.254822+0000","last_became_active":"2024-04-26T12:26:53.255382+0000","last_became_peered":"2024-04-26T12:26:53.255382+0000","last_unstale":"2024-04-26T12:26:54.254822+0000","last_undegraded":"2024-04-26T12:26:54.254822+0000","last_fullsized":"2024-04-26T12:26:54.254822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:53.950315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253701+0000","last_change":"2024-04-26T12:26:53.262951+0000","last_active":"2024-04-26T12:26:54.253701+0000","last_peered":"2024-04-26T12:26:54.253701+0000","last_clean":"2024-04-26T12:26:54.253701+0000","last_became_active":"2024-04-26T12:26:53.261842+0000","last_became_peered":"2024-04-26T12:26:53.261842+0000","last_unstale":"2024-04-26T12:26:54.253701+0000","last_undegraded":"2024-04-26T12:26:54.253701+0000","last_fullsized":"2024-04-26T12:26:54.253701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:35.327049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254183+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:26:54.254183+0000","last_peered":"2024-04-26T12:26:54.254183+0000","last_clean":"2024-04-26T12:26:54.254183+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:26:54.254183+0000","last_undegraded":"2024-04-26T12:26:54.254183+0000","last_fullsized":"2024-04-26T12:26:54.254183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254377+0000","last_change":"2024-04-26T12:26:53.254930+0000","last_active":"2024-04-26T12:26:54.254377+0000","last_peered":"2024-04-26T12:26:54.254377+0000","last_clean":"2024-04-26T12:26:54.254377+0000","last_became_active":"2024-04-26T12:26:53.253988+0000","last_became_peered":"2024-04-26T12:26:53.253988+0000","last_unstale":"2024-04-26T12:26:54.254377+0000","last_undegraded":"2024-04-26T12:26:54.254377+0000","last_fullsized":"2024-04-26T12:26:54.254377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253678+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:26:54.253678+0000","last_peered":"2024-04-26T12:26:54.253678+0000","last_clean":"2024-04-26T12:26:54.253678+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:26:54.253678+0000","last_undegraded":"2024-04-26T12:26:54.253678+0000","last_fullsized":"2024-04-26T12:26:54.253678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252782+0000","last_change":"2024-04-26T12:26:53.266568+0000","last_active":"2024-04-26T12:26:54.252782+0000","last_peered":"2024-04-26T12:26:54.252782+0000","last_clean":"2024-04-26T12:26:54.252782+0000","last_became_active":"2024-04-26T12:26:53.265846+0000","last_became_peered":"2024-04-26T12:26:53.265846+0000","last_unstale":"2024-04-26T12:26:54.252782+0000","last_undegraded":"2024-04-26T12:26:54.252782+0000","last_fullsized":"2024-04-26T12:26:54.252782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:10.849502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252784+0000","last_change":"2024-04-26T12:26:53.265459+0000","last_active":"2024-04-26T12:26:54.252784+0000","last_peered":"2024-04-26T12:26:54.252784+0000","last_clean":"2024-04-26T12:26:54.252784+0000","last_became_active":"2024-04-26T12:26:53.262898+0000","last_became_peered":"2024-04-26T12:26:53.262898+0000","last_unstale":"2024-04-26T12:26:54.252784+0000","last_undegraded":"2024-04-26T12:26:54.252784+0000","last_fullsized":"2024-04-26T12:26:54.252784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252546+0000","last_change":"2024-04-26T12:26:53.259864+0000","last_active":"2024-04-26T12:26:54.252546+0000","last_peered":"2024-04-26T12:26:54.252546+0000","last_clean":"2024-04-26T12:26:54.252546+0000","last_became_active":"2024-04-26T12:26:53.259025+0000","last_became_peered":"2024-04-26T12:26:53.259025+0000","last_unstale":"2024-04-26T12:26:54.252546+0000","last_undegraded":"2024-04-26T12:26:54.252546+0000","last_fullsized":"2024-04-26T12:26:54.252546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254951+0000","last_change":"2024-04-26T12:26:53.261186+0000","last_active":"2024-04-26T12:26:54.254951+0000","last_peered":"2024-04-26T12:26:54.254951+0000","last_clean":"2024-04-26T12:26:54.254951+0000","last_became_active":"2024-04-26T12:26:53.260820+0000","last_became_peered":"2024-04-26T12:26:53.260820+0000","last_unstale":"2024-04-26T12:26:54.254951+0000","last_undegraded":"2024-04-26T12:26:54.254951+0000","last_fullsized":"2024-04-26T12:26:54.254951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:00.602708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252225+0000","last_change":"2024-04-26T12:26:53.259728+0000","last_active":"2024-04-26T12:26:54.252225+0000","last_peered":"2024-04-26T12:26:54.252225+0000","last_clean":"2024-04-26T12:26:54.252225+0000","last_became_active":"2024-04-26T12:26:53.258952+0000","last_became_peered":"2024-04-26T12:26:53.258952+0000","last_unstale":"2024-04-26T12:26:54.252225+0000","last_undegraded":"2024-04-26T12:26:54.252225+0000","last_fullsized":"2024-04-26T12:26:54.252225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253512+0000","last_change":"2024-04-26T12:26:53.257321+0000","last_active":"2024-04-26T12:26:54.253512+0000","last_peered":"2024-04-26T12:26:54.253512+0000","last_clean":"2024-04-26T12:26:54.253512+0000","last_became_active":"2024-04-26T12:26:53.256192+0000","last_became_peered":"2024-04-26T12:26:53.256192+0000","last_unstale":"2024-04-26T12:26:54.253512+0000","last_undegraded":"2024-04-26T12:26:54.253512+0000","last_fullsized":"2024-04-26T12:26:54.253512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253202+0000","last_change":"2024-04-26T12:26:53.261669+0000","last_active":"2024-04-26T12:26:54.253202+0000","last_peered":"2024-04-26T12:26:54.253202+0000","last_clean":"2024-04-26T12:26:54.253202+0000","last_became_active":"2024-04-26T12:26:53.259854+0000","last_became_peered":"2024-04-26T12:26:53.259854+0000","last_unstale":"2024-04-26T12:26:54.253202+0000","last_undegraded":"2024-04-26T12:26:54.253202+0000","last_fullsized":"2024-04-26T12:26:54.253202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254141+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:26:54.254141+0000","last_peered":"2024-04-26T12:26:54.254141+0000","last_clean":"2024-04-26T12:26:54.254141+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:26:54.254141+0000","last_undegraded":"2024-04-26T12:26:54.254141+0000","last_fullsized":"2024-04-26T12:26:54.254141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251798+0000","last_change":"2024-04-26T12:26:53.262898+0000","last_active":"2024-04-26T12:26:54.251798+0000","last_peered":"2024-04-26T12:26:54.251798+0000","last_clean":"2024-04-26T12:26:54.251798+0000","last_became_active":"2024-04-26T12:26:53.262603+0000","last_became_peered":"2024-04-26T12:26:53.262603+0000","last_unstale":"2024-04-26T12:26:54.251798+0000","last_undegraded":"2024-04-26T12:26:54.251798+0000","last_fullsized":"2024-04-26T12:26:54.251798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254215+0000","last_change":"2024-04-26T12:26:53.254395+0000","last_active":"2024-04-26T12:26:54.254215+0000","last_peered":"2024-04-26T12:26:54.254215+0000","last_clean":"2024-04-26T12:26:54.254215+0000","last_became_active":"2024-04-26T12:26:53.253946+0000","last_became_peered":"2024-04-26T12:26:53.253946+0000","last_unstale":"2024-04-26T12:26:54.254215+0000","last_undegraded":"2024-04-26T12:26:54.254215+0000","last_fullsized":"2024-04-26T12:26:54.254215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:41.501818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254992+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:26:54.254992+0000","last_peered":"2024-04-26T12:26:54.254992+0000","last_clean":"2024-04-26T12:26:54.254992+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:26:54.254992+0000","last_undegraded":"2024-04-26T12:26:54.254992+0000","last_fullsized":"2024-04-26T12:26:54.254992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252630+0000","last_change":"2024-04-26T12:26:53.261876+0000","last_active":"2024-04-26T12:26:54.252630+0000","last_peered":"2024-04-26T12:26:54.252630+0000","last_clean":"2024-04-26T12:26:54.252630+0000","last_became_active":"2024-04-26T12:26:53.261485+0000","last_became_peered":"2024-04-26T12:26:53.261485+0000","last_unstale":"2024-04-26T12:26:54.252630+0000","last_undegraded":"2024-04-26T12:26:54.252630+0000","last_fullsized":"2024-04-26T12:26:54.252630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253751+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:26:54.253751+0000","last_peered":"2024-04-26T12:26:54.253751+0000","last_clean":"2024-04-26T12:26:54.253751+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:26:54.253751+0000","last_undegraded":"2024-04-26T12:26:54.253751+0000","last_fullsized":"2024-04-26T12:26:54.253751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254119+0000","last_change":"2024-04-26T12:26:52.839543+0000","last_active":"2024-04-26T12:26:54.254119+0000","last_peered":"2024-04-26T12:26:54.254119+0000","last_clean":"2024-04-26T12:26:54.254119+0000","last_became_active":"2024-04-26T12:26:52.839080+0000","last_became_peered":"2024-04-26T12:26:52.839080+0000","last_unstale":"2024-04-26T12:26:54.254119+0000","last_undegraded":"2024-04-26T12:26:54.254119+0000","last_fullsized":"2024-04-26T12:26:54.254119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:18.329898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254904+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:26:54.254904+0000","last_peered":"2024-04-26T12:26:54.254904+0000","last_clean":"2024-04-26T12:26:54.254904+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:26:54.254904+0000","last_undegraded":"2024-04-26T12:26:54.254904+0000","last_fullsized":"2024-04-26T12:26:54.254904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251794+0000","last_change":"2024-04-26T12:26:52.838082+0000","last_active":"2024-04-26T12:26:54.251794+0000","last_peered":"2024-04-26T12:26:54.251794+0000","last_clean":"2024-04-26T12:26:54.251794+0000","last_became_active":"2024-04-26T12:26:52.837596+0000","last_became_peered":"2024-04-26T12:26:52.837596+0000","last_unstale":"2024-04-26T12:26:54.251794+0000","last_undegraded":"2024-04-26T12:26:54.251794+0000","last_fullsized":"2024-04-26T12:26:54.251794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:08.892977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252572+0000","last_change":"2024-04-26T12:26:53.262665+0000","last_active":"2024-04-26T12:26:54.252572+0000","last_peered":"2024-04-26T12:26:54.252572+0000","last_clean":"2024-04-26T12:26:54.252572+0000","last_became_active":"2024-04-26T12:26:53.262161+0000","last_became_peered":"2024-04-26T12:26:53.262161+0000","last_unstale":"2024-04-26T12:26:54.252572+0000","last_undegraded":"2024-04-26T12:26:54.252572+0000","last_fullsized":"2024-04-26T12:26:54.252572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251650+0000","last_change":"2024-04-26T12:26:52.833500+0000","last_active":"2024-04-26T12:26:54.251650+0000","last_peered":"2024-04-26T12:26:54.251650+0000","last_clean":"2024-04-26T12:26:54.251650+0000","last_became_active":"2024-04-26T12:26:52.833152+0000","last_became_peered":"2024-04-26T12:26:52.833152+0000","last_unstale":"2024-04-26T12:26:54.251650+0000","last_undegraded":"2024-04-26T12:26:54.251650+0000","last_fullsized":"2024-04-26T12:26:54.251650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:28.165579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.255028+0000","last_change":"2024-04-26T12:26:53.260764+0000","last_active":"2024-04-26T12:26:54.255028+0000","last_peered":"2024-04-26T12:26:54.255028+0000","last_clean":"2024-04-26T12:26:54.255028+0000","last_became_active":"2024-04-26T12:26:53.260388+0000","last_became_peered":"2024-04-26T12:26:53.260388+0000","last_unstale":"2024-04-26T12:26:54.255028+0000","last_undegraded":"2024-04-26T12:26:54.255028+0000","last_fullsized":"2024-04-26T12:26:54.255028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252735+0000","last_change":"2024-04-26T12:26:52.837792+0000","last_active":"2024-04-26T12:26:54.252735+0000","last_peered":"2024-04-26T12:26:54.252735+0000","last_clean":"2024-04-26T12:26:54.252735+0000","last_became_active":"2024-04-26T12:26:52.837272+0000","last_became_peered":"2024-04-26T12:26:52.837272+0000","last_unstale":"2024-04-26T12:26:54.252735+0000","last_undegraded":"2024-04-26T12:26:54.252735+0000","last_fullsized":"2024-04-26T12:26:54.252735+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:12.837493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251539+0000","last_change":"2024-04-26T12:26:53.255423+0000","last_active":"2024-04-26T12:26:54.251539+0000","last_peered":"2024-04-26T12:26:54.251539+0000","last_clean":"2024-04-26T12:26:54.251539+0000","last_became_active":"2024-04-26T12:26:53.253812+0000","last_became_peered":"2024-04-26T12:26:53.253812+0000","last_unstale":"2024-04-26T12:26:54.251539+0000","last_undegraded":"2024-04-26T12:26:54.251539+0000","last_fullsized":"2024-04-26T12:26:54.251539+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:37.907024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253542+0000","last_change":"2024-04-26T12:26:52.840163+0000","last_active":"2024-04-26T12:26:54.253542+0000","last_peered":"2024-04-26T12:26:54.253542+0000","last_clean":"2024-04-26T12:26:54.253542+0000","last_became_active":"2024-04-26T12:26:52.839246+0000","last_became_peered":"2024-04-26T12:26:52.839246+0000","last_unstale":"2024-04-26T12:26:54.253542+0000","last_undegraded":"2024-04-26T12:26:54.253542+0000","last_fullsized":"2024-04-26T12:26:54.253542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:44.809454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251997+0000","last_change":"2024-04-26T12:26:53.258963+0000","last_active":"2024-04-26T12:26:54.251997+0000","last_peered":"2024-04-26T12:26:54.251997+0000","last_clean":"2024-04-26T12:26:54.251997+0000","last_became_active":"2024-04-26T12:26:53.258171+0000","last_became_peered":"2024-04-26T12:26:53.258171+0000","last_unstale":"2024-04-26T12:26:54.251997+0000","last_undegraded":"2024-04-26T12:26:54.251997+0000","last_fullsized":"2024-04-26T12:26:54.251997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254770+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:26:54.254770+0000","last_peered":"2024-04-26T12:26:54.254770+0000","last_clean":"2024-04-26T12:26:54.254770+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:26:54.254770+0000","last_undegraded":"2024-04-26T12:26:54.254770+0000","last_fullsized":"2024-04-26T12:26:54.254770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251746+0000","last_change":"2024-04-26T12:26:53.259209+0000","last_active":"2024-04-26T12:26:54.251746+0000","last_peered":"2024-04-26T12:26:54.251746+0000","last_clean":"2024-04-26T12:26:54.251746+0000","last_became_active":"2024-04-26T12:26:53.258620+0000","last_became_peered":"2024-04-26T12:26:53.258620+0000","last_unstale":"2024-04-26T12:26:54.251746+0000","last_undegraded":"2024-04-26T12:26:54.251746+0000","last_fullsized":"2024-04-26T12:26:54.251746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253386+0000","last_change":"2024-04-26T12:26:52.841280+0000","last_active":"2024-04-26T12:26:54.253386+0000","last_peered":"2024-04-26T12:26:54.253386+0000","last_clean":"2024-04-26T12:26:54.253386+0000","last_became_active":"2024-04-26T12:26:52.839398+0000","last_became_peered":"2024-04-26T12:26:52.839398+0000","last_unstale":"2024-04-26T12:26:54.253386+0000","last_undegraded":"2024-04-26T12:26:54.253386+0000","last_fullsized":"2024-04-26T12:26:54.253386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:53.889623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253612+0000","last_change":"2024-04-26T12:26:53.260830+0000","last_active":"2024-04-26T12:26:54.253612+0000","last_peered":"2024-04-26T12:26:54.253612+0000","last_clean":"2024-04-26T12:26:54.253612+0000","last_became_active":"2024-04-26T12:26:53.259452+0000","last_became_peered":"2024-04-26T12:26:53.259452+0000","last_unstale":"2024-04-26T12:26:54.253612+0000","last_undegraded":"2024-04-26T12:26:54.253612+0000","last_fullsized":"2024-04-26T12:26:54.253612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253560+0000","last_change":"2024-04-26T12:26:52.840521+0000","last_active":"2024-04-26T12:26:54.253560+0000","last_peered":"2024-04-26T12:26:54.253560+0000","last_clean":"2024-04-26T12:26:54.253560+0000","last_became_active":"2024-04-26T12:26:52.839442+0000","last_became_peered":"2024-04-26T12:26:52.839442+0000","last_unstale":"2024-04-26T12:26:54.253560+0000","last_undegraded":"2024-04-26T12:26:54.253560+0000","last_fullsized":"2024-04-26T12:26:54.253560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:28.165579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254485+0000","last_change":"2024-04-26T12:26:53.254489+0000","last_active":"2024-04-26T12:26:54.254485+0000","last_peered":"2024-04-26T12:26:54.254485+0000","last_clean":"2024-04-26T12:26:54.254485+0000","last_became_active":"2024-04-26T12:26:53.254099+0000","last_became_peered":"2024-04-26T12:26:53.254099+0000","last_unstale":"2024-04-26T12:26:54.254485+0000","last_undegraded":"2024-04-26T12:26:54.254485+0000","last_fullsized":"2024-04-26T12:26:54.254485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251939+0000","last_change":"2024-04-26T12:26:52.837857+0000","last_active":"2024-04-26T12:26:54.251939+0000","last_peered":"2024-04-26T12:26:54.251939+0000","last_clean":"2024-04-26T12:26:54.251939+0000","last_became_active":"2024-04-26T12:26:52.837402+0000","last_became_peered":"2024-04-26T12:26:52.837402+0000","last_unstale":"2024-04-26T12:26:54.251939+0000","last_undegraded":"2024-04-26T12:26:54.251939+0000","last_fullsized":"2024-04-26T12:26:54.251939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:53.889623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254865+0000","last_change":"2024-04-26T12:26:53.255659+0000","last_active":"2024-04-26T12:26:54.254865+0000","last_peered":"2024-04-26T12:26:54.254865+0000","last_clean":"2024-04-26T12:26:54.254865+0000","last_became_active":"2024-04-26T12:26:53.255253+0000","last_became_peered":"2024-04-26T12:26:53.255253+0000","last_unstale":"2024-04-26T12:26:54.254865+0000","last_undegraded":"2024-04-26T12:26:54.254865+0000","last_fullsized":"2024-04-26T12:26:54.254865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.236196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254021+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:26:54.254021+0000","last_peered":"2024-04-26T12:26:54.254021+0000","last_clean":"2024-04-26T12:26:54.254021+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:26:54.254021+0000","last_undegraded":"2024-04-26T12:26:54.254021+0000","last_fullsized":"2024-04-26T12:26:54.254021+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252460+0000","last_change":"2024-04-26T12:26:53.261880+0000","last_active":"2024-04-26T12:26:54.252460+0000","last_peered":"2024-04-26T12:26:54.252460+0000","last_clean":"2024-04-26T12:26:54.252460+0000","last_became_active":"2024-04-26T12:26:53.261373+0000","last_became_peered":"2024-04-26T12:26:53.261373+0000","last_unstale":"2024-04-26T12:26:54.252460+0000","last_undegraded":"2024-04-26T12:26:54.252460+0000","last_fullsized":"2024-04-26T12:26:54.252460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253014+0000","last_change":"2024-04-26T12:26:52.840810+0000","last_active":"2024-04-26T12:26:54.253014+0000","last_peered":"2024-04-26T12:26:54.253014+0000","last_clean":"2024-04-26T12:26:54.253014+0000","last_became_active":"2024-04-26T12:26:52.840059+0000","last_became_peered":"2024-04-26T12:26:52.840059+0000","last_unstale":"2024-04-26T12:26:54.253014+0000","last_undegraded":"2024-04-26T12:26:54.253014+0000","last_fullsized":"2024-04-26T12:26:54.253014+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:17.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252819+0000","last_change":"2024-04-26T12:26:53.265200+0000","last_active":"2024-04-26T12:26:54.252819+0000","last_peered":"2024-04-26T12:26:54.252819+0000","last_clean":"2024-04-26T12:26:54.252819+0000","last_became_active":"2024-04-26T12:26:53.264830+0000","last_became_peered":"2024-04-26T12:26:53.264830+0000","last_unstale":"2024-04-26T12:26:54.252819+0000","last_undegraded":"2024-04-26T12:26:54.252819+0000","last_fullsized":"2024-04-26T12:26:54.252819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253700+0000","last_change":"2024-04-26T12:26:52.840684+0000","last_active":"2024-04-26T12:26:54.253700+0000","last_peered":"2024-04-26T12:26:54.253700+0000","last_clean":"2024-04-26T12:26:54.253700+0000","last_became_active":"2024-04-26T12:26:52.839414+0000","last_became_peered":"2024-04-26T12:26:52.839414+0000","last_unstale":"2024-04-26T12:26:54.253700+0000","last_undegraded":"2024-04-26T12:26:54.253700+0000","last_fullsized":"2024-04-26T12:26:54.253700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:12.837493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253759+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:26:54.253759+0000","last_peered":"2024-04-26T12:26:54.253759+0000","last_clean":"2024-04-26T12:26:54.253759+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:26:54.253759+0000","last_undegraded":"2024-04-26T12:26:54.253759+0000","last_fullsized":"2024-04-26T12:26:54.253759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254691+0000","last_change":"2024-04-26T12:26:52.839692+0000","last_active":"2024-04-26T12:26:54.254691+0000","last_peered":"2024-04-26T12:26:54.254691+0000","last_clean":"2024-04-26T12:26:54.254691+0000","last_became_active":"2024-04-26T12:26:52.839419+0000","last_became_peered":"2024-04-26T12:26:52.839419+0000","last_unstale":"2024-04-26T12:26:54.254691+0000","last_undegraded":"2024-04-26T12:26:54.254691+0000","last_fullsized":"2024-04-26T12:26:54.254691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:25.416851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254179+0000","last_change":"2024-04-26T12:26:53.254395+0000","last_active":"2024-04-26T12:26:54.254179+0000","last_peered":"2024-04-26T12:26:54.254179+0000","last_clean":"2024-04-26T12:26:54.254179+0000","last_became_active":"2024-04-26T12:26:53.253926+0000","last_became_peered":"2024-04-26T12:26:53.253926+0000","last_unstale":"2024-04-26T12:26:54.254179+0000","last_undegraded":"2024-04-26T12:26:54.254179+0000","last_fullsized":"2024-04-26T12:26:54.254179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:59.517606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253817+0000","last_change":"2024-04-26T12:26:52.842023+0000","last_active":"2024-04-26T12:26:54.253817+0000","last_peered":"2024-04-26T12:26:54.253817+0000","last_clean":"2024-04-26T12:26:54.253817+0000","last_became_active":"2024-04-26T12:26:52.840857+0000","last_became_peered":"2024-04-26T12:26:52.840857+0000","last_unstale":"2024-04-26T12:26:54.253817+0000","last_undegraded":"2024-04-26T12:26:54.253817+0000","last_fullsized":"2024-04-26T12:26:54.253817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:08.892977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253219+0000","last_change":"2024-04-26T12:26:53.263148+0000","last_active":"2024-04-26T12:26:54.253219+0000","last_peered":"2024-04-26T12:26:54.253219+0000","last_clean":"2024-04-26T12:26:54.253219+0000","last_became_active":"2024-04-26T12:26:53.261904+0000","last_became_peered":"2024-04-26T12:26:53.261904+0000","last_unstale":"2024-04-26T12:26:54.253219+0000","last_undegraded":"2024-04-26T12:26:54.253219+0000","last_fullsized":"2024-04-26T12:26:54.253219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253194+0000","last_change":"2024-04-26T12:26:52.841895+0000","last_active":"2024-04-26T12:26:54.253194+0000","last_peered":"2024-04-26T12:26:54.253194+0000","last_clean":"2024-04-26T12:26:54.253194+0000","last_became_active":"2024-04-26T12:26:52.840195+0000","last_became_peered":"2024-04-26T12:26:52.840195+0000","last_unstale":"2024-04-26T12:26:54.253194+0000","last_undegraded":"2024-04-26T12:26:54.253194+0000","last_fullsized":"2024-04-26T12:26:54.253194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:03.469888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252358+0000","last_change":"2024-04-26T12:26:53.265195+0000","last_active":"2024-04-26T12:26:54.252358+0000","last_peered":"2024-04-26T12:26:54.252358+0000","last_clean":"2024-04-26T12:26:54.252358+0000","last_became_active":"2024-04-26T12:26:53.264819+0000","last_became_peered":"2024-04-26T12:26:53.264819+0000","last_unstale":"2024-04-26T12:26:54.252358+0000","last_undegraded":"2024-04-26T12:26:54.252358+0000","last_fullsized":"2024-04-26T12:26:54.252358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252231+0000","last_change":"2024-04-26T12:26:52.837057+0000","last_active":"2024-04-26T12:26:54.252231+0000","last_peered":"2024-04-26T12:26:54.252231+0000","last_clean":"2024-04-26T12:26:54.252231+0000","last_became_active":"2024-04-26T12:26:52.836594+0000","last_became_peered":"2024-04-26T12:26:52.836594+0000","last_unstale":"2024-04-26T12:26:54.252231+0000","last_undegraded":"2024-04-26T12:26:54.252231+0000","last_fullsized":"2024-04-26T12:26:54.252231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:42.768206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253143+0000","last_change":"2024-04-26T12:26:53.263194+0000","last_active":"2024-04-26T12:26:54.253143+0000","last_peered":"2024-04-26T12:26:54.253143+0000","last_clean":"2024-04-26T12:26:54.253143+0000","last_became_active":"2024-04-26T12:26:53.262366+0000","last_became_peered":"2024-04-26T12:26:53.262366+0000","last_unstale":"2024-04-26T12:26:54.253143+0000","last_undegraded":"2024-04-26T12:26:54.253143+0000","last_fullsized":"2024-04-26T12:26:54.253143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253105+0000","last_change":"2024-04-26T12:26:52.842337+0000","last_active":"2024-04-26T12:26:54.253105+0000","last_peered":"2024-04-26T12:26:54.253105+0000","last_clean":"2024-04-26T12:26:54.253105+0000","last_became_active":"2024-04-26T12:26:52.842009+0000","last_became_peered":"2024-04-26T12:26:52.842009+0000","last_unstale":"2024-04-26T12:26:54.253105+0000","last_undegraded":"2024-04-26T12:26:54.253105+0000","last_fullsized":"2024-04-26T12:26:54.253105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253989+0000","last_change":"2024-04-26T12:26:53.266014+0000","last_active":"2024-04-26T12:26:54.253989+0000","last_peered":"2024-04-26T12:26:54.253989+0000","last_clean":"2024-04-26T12:26:54.253989+0000","last_became_active":"2024-04-26T12:26:53.264254+0000","last_became_peered":"2024-04-26T12:26:53.264254+0000","last_unstale":"2024-04-26T12:26:54.253989+0000","last_undegraded":"2024-04-26T12:26:54.253989+0000","last_fullsized":"2024-04-26T12:26:54.253989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:04.369827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253838+0000","last_change":"2024-04-26T12:26:52.839759+0000","last_active":"2024-04-26T12:26:54.253838+0000","last_peered":"2024-04-26T12:26:54.253838+0000","last_clean":"2024-04-26T12:26:54.253838+0000","last_became_active":"2024-04-26T12:26:52.839445+0000","last_became_peered":"2024-04-26T12:26:52.839445+0000","last_unstale":"2024-04-26T12:26:54.253838+0000","last_undegraded":"2024-04-26T12:26:54.253838+0000","last_fullsized":"2024-04-26T12:26:54.253838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:40.499263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253688+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:26:54.253688+0000","last_peered":"2024-04-26T12:26:54.253688+0000","last_clean":"2024-04-26T12:26:54.253688+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:26:54.253688+0000","last_undegraded":"2024-04-26T12:26:54.253688+0000","last_fullsized":"2024-04-26T12:26:54.253688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253924+0000","last_change":"2024-04-26T12:26:52.839211+0000","last_active":"2024-04-26T12:26:54.253924+0000","last_peered":"2024-04-26T12:26:54.253924+0000","last_clean":"2024-04-26T12:26:54.253924+0000","last_became_active":"2024-04-26T12:26:52.838988+0000","last_became_peered":"2024-04-26T12:26:52.838988+0000","last_unstale":"2024-04-26T12:26:54.253924+0000","last_undegraded":"2024-04-26T12:26:54.253924+0000","last_fullsized":"2024-04-26T12:26:54.253924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:04.569832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252653+0000","last_change":"2024-04-26T12:26:53.260098+0000","last_active":"2024-04-26T12:26:54.252653+0000","last_peered":"2024-04-26T12:26:54.252653+0000","last_clean":"2024-04-26T12:26:54.252653+0000","last_became_active":"2024-04-26T12:26:53.259188+0000","last_became_peered":"2024-04-26T12:26:53.259188+0000","last_unstale":"2024-04-26T12:26:54.252653+0000","last_undegraded":"2024-04-26T12:26:54.252653+0000","last_fullsized":"2024-04-26T12:26:54.252653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:34.496560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.248033+0000","last_change":"2024-04-26T12:26:47.810338+0000","last_active":"2024-04-26T12:26:53.248033+0000","last_peered":"2024-04-26T12:26:53.248033+0000","last_clean":"2024-04-26T12:26:53.248033+0000","last_became_active":"2024-04-26T12:26:47.810127+0000","last_became_peered":"2024-04-26T12:26:47.810127+0000","last_unstale":"2024-04-26T12:26:53.248033+0000","last_undegraded":"2024-04-26T12:26:53.248033+0000","last_fullsized":"2024-04-26T12:26:53.248033+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:11.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253912+0000","last_change":"2024-04-26T12:26:52.841192+0000","last_active":"2024-04-26T12:26:54.253912+0000","last_peered":"2024-04-26T12:26:54.253912+0000","last_clean":"2024-04-26T12:26:54.253912+0000","last_became_active":"2024-04-26T12:26:52.840137+0000","last_became_peered":"2024-04-26T12:26:52.840137+0000","last_unstale":"2024-04-26T12:26:54.253912+0000","last_undegraded":"2024-04-26T12:26:54.253912+0000","last_fullsized":"2024-04-26T12:26:54.253912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:20.488738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254278+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:26:54.254278+0000","last_peered":"2024-04-26T12:26:54.254278+0000","last_clean":"2024-04-26T12:26:54.254278+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:26:54.254278+0000","last_undegraded":"2024-04-26T12:26:54.254278+0000","last_fullsized":"2024-04-26T12:26:54.254278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.257442+0000","last_change":"2024-04-26T12:26:47.811997+0000","last_active":"2024-04-26T12:26:53.257442+0000","last_peered":"2024-04-26T12:26:53.257442+0000","last_clean":"2024-04-26T12:26:53.257442+0000","last_became_active":"2024-04-26T12:26:47.811819+0000","last_became_peered":"2024-04-26T12:26:47.811819+0000","last_unstale":"2024-04-26T12:26:53.257442+0000","last_undegraded":"2024-04-26T12:26:53.257442+0000","last_fullsized":"2024-04-26T12:26:53.257442+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:11.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253332+0000","last_change":"2024-04-26T12:26:52.841195+0000","last_active":"2024-04-26T12:26:54.253332+0000","last_peered":"2024-04-26T12:26:54.253332+0000","last_clean":"2024-04-26T12:26:54.253332+0000","last_became_active":"2024-04-26T12:26:52.839558+0000","last_became_peered":"2024-04-26T12:26:52.839558+0000","last_unstale":"2024-04-26T12:26:54.253332+0000","last_undegraded":"2024-04-26T12:26:54.253332+0000","last_fullsized":"2024-04-26T12:26:54.253332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:54.208845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252177+0000","last_change":"2024-04-26T12:26:53.259270+0000","last_active":"2024-04-26T12:26:54.252177+0000","last_peered":"2024-04-26T12:26:54.252177+0000","last_clean":"2024-04-26T12:26:54.252177+0000","last_became_active":"2024-04-26T12:26:53.258588+0000","last_became_peered":"2024-04-26T12:26:53.258588+0000","last_unstale":"2024-04-26T12:26:54.252177+0000","last_undegraded":"2024-04-26T12:26:54.252177+0000","last_fullsized":"2024-04-26T12:26:54.252177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:09.233018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.247515+0000","last_change":"2024-04-26T12:26:47.811787+0000","last_active":"2024-04-26T12:26:53.247515+0000","last_peered":"2024-04-26T12:26:53.247515+0000","last_clean":"2024-04-26T12:26:53.247515+0000","last_became_active":"2024-04-26T12:26:47.811512+0000","last_became_peered":"2024-04-26T12:26:47.811512+0000","last_unstale":"2024-04-26T12:26:53.247515+0000","last_undegraded":"2024-04-26T12:26:53.247515+0000","last_fullsized":"2024-04-26T12:26:53.247515+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:56.379533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253871+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:26:54.253871+0000","last_peered":"2024-04-26T12:26:54.253871+0000","last_clean":"2024-04-26T12:26:54.253871+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:26:54.253871+0000","last_undegraded":"2024-04-26T12:26:54.253871+0000","last_fullsized":"2024-04-26T12:26:54.253871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252748+0000","last_change":"2024-04-26T12:26:53.260244+0000","last_active":"2024-04-26T12:26:54.252748+0000","last_peered":"2024-04-26T12:26:54.252748+0000","last_clean":"2024-04-26T12:26:54.252748+0000","last_became_active":"2024-04-26T12:26:53.259917+0000","last_became_peered":"2024-04-26T12:26:53.259917+0000","last_unstale":"2024-04-26T12:26:54.252748+0000","last_undegraded":"2024-04-26T12:26:54.252748+0000","last_fullsized":"2024-04-26T12:26:54.252748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258160+0000","last_change":"2024-04-26T12:26:47.812045+0000","last_active":"2024-04-26T12:26:53.258160+0000","last_peered":"2024-04-26T12:26:53.258160+0000","last_clean":"2024-04-26T12:26:53.258160+0000","last_became_active":"2024-04-26T12:26:47.811787+0000","last_became_peered":"2024-04-26T12:26:47.811787+0000","last_unstale":"2024-04-26T12:26:53.258160+0000","last_undegraded":"2024-04-26T12:26:53.258160+0000","last_fullsized":"2024-04-26T12:26:53.258160+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:30.757169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":211,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258235+0000","last_change":"2024-04-26T12:26:46.810189+0000","last_active":"2024-04-26T12:26:53.258235+0000","last_peered":"2024-04-26T12:26:53.258235+0000","last_clean":"2024-04-26T12:26:53.258235+0000","last_became_active":"2024-04-26T12:26:46.809453+0000","last_became_peered":"2024-04-26T12:26:46.809453+0000","last_unstale":"2024-04-26T12:26:53.258235+0000","last_undegraded":"2024-04-26T12:26:53.258235+0000","last_fullsized":"2024-04-26T12:26:53.258235+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:18.618650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251680+0000","last_change":"2024-04-26T12:26:52.833869+0000","last_active":"2024-04-26T12:26:54.251680+0000","last_peered":"2024-04-26T12:26:54.251680+0000","last_clean":"2024-04-26T12:26:54.251680+0000","last_became_active":"2024-04-26T12:26:52.833257+0000","last_became_peered":"2024-04-26T12:26:52.833257+0000","last_unstale":"2024-04-26T12:26:54.251680+0000","last_undegraded":"2024-04-26T12:26:54.251680+0000","last_fullsized":"2024-04-26T12:26:54.251680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253947+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:26:54.253947+0000","last_peered":"2024-04-26T12:26:54.253947+0000","last_clean":"2024-04-26T12:26:54.253947+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:26:54.253947+0000","last_undegraded":"2024-04-26T12:26:54.253947+0000","last_fullsized":"2024-04-26T12:26:54.253947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258561+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:26:53.258561+0000","last_peered":"2024-04-26T12:26:53.258561+0000","last_clean":"2024-04-26T12:26:53.258561+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:26:53.258561+0000","last_undegraded":"2024-04-26T12:26:53.258561+0000","last_fullsized":"2024-04-26T12:26:53.258561+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251513+0000","last_change":"2024-04-26T12:26:52.836395+0000","last_active":"2024-04-26T12:26:54.251513+0000","last_peered":"2024-04-26T12:26:54.251513+0000","last_clean":"2024-04-26T12:26:54.251513+0000","last_became_active":"2024-04-26T12:26:52.836023+0000","last_became_peered":"2024-04-26T12:26:52.836023+0000","last_unstale":"2024-04-26T12:26:54.251513+0000","last_undegraded":"2024-04-26T12:26:54.251513+0000","last_fullsized":"2024-04-26T12:26:54.251513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:54.208845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254838+0000","last_change":"2024-04-26T12:26:53.260768+0000","last_active":"2024-04-26T12:26:54.254838+0000","last_peered":"2024-04-26T12:26:54.254838+0000","last_clean":"2024-04-26T12:26:54.254838+0000","last_became_active":"2024-04-26T12:26:53.259807+0000","last_became_peered":"2024-04-26T12:26:53.259807+0000","last_unstale":"2024-04-26T12:26:54.254838+0000","last_undegraded":"2024-04-26T12:26:54.254838+0000","last_fullsized":"2024-04-26T12:26:54.254838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.250666+0000","last_change":"2024-04-26T12:26:47.812595+0000","last_active":"2024-04-26T12:26:53.250666+0000","last_peered":"2024-04-26T12:26:53.250666+0000","last_clean":"2024-04-26T12:26:53.250666+0000","last_became_active":"2024-04-26T12:26:47.812366+0000","last_became_peered":"2024-04-26T12:26:47.812366+0000","last_unstale":"2024-04-26T12:26:53.250666+0000","last_undegraded":"2024-04-26T12:26:53.250666+0000","last_fullsized":"2024-04-26T12:26:53.250666+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:57.920665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252434+0000","last_change":"2024-04-26T12:26:52.833996+0000","last_active":"2024-04-26T12:26:54.252434+0000","last_peered":"2024-04-26T12:26:54.252434+0000","last_clean":"2024-04-26T12:26:54.252434+0000","last_became_active":"2024-04-26T12:26:52.833452+0000","last_became_peered":"2024-04-26T12:26:52.833452+0000","last_unstale":"2024-04-26T12:26:54.252434+0000","last_undegraded":"2024-04-26T12:26:54.252434+0000","last_fullsized":"2024-04-26T12:26:54.252434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254460+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:26:54.254460+0000","last_peered":"2024-04-26T12:26:54.254460+0000","last_clean":"2024-04-26T12:26:54.254460+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:26:54.254460+0000","last_undegraded":"2024-04-26T12:26:54.254460+0000","last_fullsized":"2024-04-26T12:26:54.254460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252570+0000","last_change":"2024-04-26T12:26:52.837167+0000","last_active":"2024-04-26T12:26:54.252570+0000","last_peered":"2024-04-26T12:26:54.252570+0000","last_clean":"2024-04-26T12:26:54.252570+0000","last_became_active":"2024-04-26T12:26:52.836534+0000","last_became_peered":"2024-04-26T12:26:52.836534+0000","last_unstale":"2024-04-26T12:26:54.252570+0000","last_undegraded":"2024-04-26T12:26:54.252570+0000","last_fullsized":"2024-04-26T12:26:54.252570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:17.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.248427+0000","last_change":"2024-04-26T12:26:47.811807+0000","last_active":"2024-04-26T12:26:53.248427+0000","last_peered":"2024-04-26T12:26:53.248427+0000","last_clean":"2024-04-26T12:26:53.248427+0000","last_became_active":"2024-04-26T12:26:47.811527+0000","last_became_peered":"2024-04-26T12:26:47.811527+0000","last_unstale":"2024-04-26T12:26:53.248427+0000","last_undegraded":"2024-04-26T12:26:53.248427+0000","last_fullsized":"2024-04-26T12:26:53.248427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:02.127354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251466+0000","last_change":"2024-04-26T12:26:53.265773+0000","last_active":"2024-04-26T12:26:54.251466+0000","last_peered":"2024-04-26T12:26:54.251466+0000","last_clean":"2024-04-26T12:26:54.251466+0000","last_became_active":"2024-04-26T12:26:53.265567+0000","last_became_peered":"2024-04-26T12:26:53.265567+0000","last_unstale":"2024-04-26T12:26:54.251466+0000","last_undegraded":"2024-04-26T12:26:54.251466+0000","last_fullsized":"2024-04-26T12:26:54.251466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258624+0000","last_change":"2024-04-26T12:26:47.811204+0000","last_active":"2024-04-26T12:26:53.258624+0000","last_peered":"2024-04-26T12:26:53.258624+0000","last_clean":"2024-04-26T12:26:53.258624+0000","last_became_active":"2024-04-26T12:26:47.810997+0000","last_became_peered":"2024-04-26T12:26:47.810997+0000","last_unstale":"2024-04-26T12:26:53.258624+0000","last_undegraded":"2024-04-26T12:26:53.258624+0000","last_fullsized":"2024-04-26T12:26:53.258624+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:24.967175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:55.294535+0000","last_change":"2024-04-26T12:26:52.837269+0000","last_active":"2024-04-26T12:26:55.294535+0000","last_peered":"2024-04-26T12:26:55.294535+0000","last_clean":"2024-04-26T12:26:55.294535+0000","last_became_active":"2024-04-26T12:26:52.836310+0000","last_became_peered":"2024-04-26T12:26:52.836310+0000","last_unstale":"2024-04-26T12:26:55.294535+0000","last_undegraded":"2024-04-26T12:26:55.294535+0000","last_fullsized":"2024-04-26T12:26:55.294535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:20.488738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254362+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:26:54.254362+0000","last_peered":"2024-04-26T12:26:54.254362+0000","last_clean":"2024-04-26T12:26:54.254362+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:26:54.254362+0000","last_undegraded":"2024-04-26T12:26:54.254362+0000","last_fullsized":"2024-04-26T12:26:54.254362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254162+0000","last_change":"2024-04-26T12:26:52.840797+0000","last_active":"2024-04-26T12:26:54.254162+0000","last_peered":"2024-04-26T12:26:54.254162+0000","last_clean":"2024-04-26T12:26:54.254162+0000","last_became_active":"2024-04-26T12:26:52.840409+0000","last_became_peered":"2024-04-26T12:26:52.840409+0000","last_unstale":"2024-04-26T12:26:54.254162+0000","last_undegraded":"2024-04-26T12:26:54.254162+0000","last_fullsized":"2024-04-26T12:26:54.254162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:57.898978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254682+0000","last_change":"2024-04-26T12:26:53.255044+0000","last_active":"2024-04-26T12:26:54.254682+0000","last_peered":"2024-04-26T12:26:54.254682+0000","last_clean":"2024-04-26T12:26:54.254682+0000","last_became_active":"2024-04-26T12:26:53.254164+0000","last_became_peered":"2024-04-26T12:26:53.254164+0000","last_unstale":"2024-04-26T12:26:54.254682+0000","last_undegraded":"2024-04-26T12:26:54.254682+0000","last_fullsized":"2024-04-26T12:26:54.254682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:07.899699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253335+0000","last_change":"2024-04-26T12:26:52.841338+0000","last_active":"2024-04-26T12:26:54.253335+0000","last_peered":"2024-04-26T12:26:54.253335+0000","last_clean":"2024-04-26T12:26:54.253335+0000","last_became_active":"2024-04-26T12:26:52.840770+0000","last_became_peered":"2024-04-26T12:26:52.840770+0000","last_unstale":"2024-04-26T12:26:54.253335+0000","last_undegraded":"2024-04-26T12:26:54.253335+0000","last_fullsized":"2024-04-26T12:26:54.253335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:33.466992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253384+0000","last_change":"2024-04-26T12:26:53.260953+0000","last_active":"2024-04-26T12:26:54.253384+0000","last_peered":"2024-04-26T12:26:54.253384+0000","last_clean":"2024-04-26T12:26:54.253384+0000","last_became_active":"2024-04-26T12:26:53.259228+0000","last_became_peered":"2024-04-26T12:26:53.259228+0000","last_unstale":"2024-04-26T12:26:54.253384+0000","last_undegraded":"2024-04-26T12:26:54.253384+0000","last_fullsized":"2024-04-26T12:26:54.253384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254744+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:26:54.254744+0000","last_peered":"2024-04-26T12:26:54.254744+0000","last_clean":"2024-04-26T12:26:54.254744+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:26:54.254744+0000","last_undegraded":"2024-04-26T12:26:54.254744+0000","last_fullsized":"2024-04-26T12:26:54.254744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253334+0000","last_change":"2024-04-26T12:26:53.262221+0000","last_active":"2024-04-26T12:26:54.253334+0000","last_peered":"2024-04-26T12:26:54.253334+0000","last_clean":"2024-04-26T12:26:54.253334+0000","last_became_active":"2024-04-26T12:26:53.261112+0000","last_became_peered":"2024-04-26T12:26:53.261112+0000","last_unstale":"2024-04-26T12:26:54.253334+0000","last_undegraded":"2024-04-26T12:26:54.253334+0000","last_fullsized":"2024-04-26T12:26:54.253334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252558+0000","last_change":"2024-04-26T12:26:52.837399+0000","last_active":"2024-04-26T12:26:54.252558+0000","last_peered":"2024-04-26T12:26:54.252558+0000","last_clean":"2024-04-26T12:26:54.252558+0000","last_became_active":"2024-04-26T12:26:52.835974+0000","last_became_peered":"2024-04-26T12:26:52.835974+0000","last_unstale":"2024-04-26T12:26:54.252558+0000","last_undegraded":"2024-04-26T12:26:54.252558+0000","last_fullsized":"2024-04-26T12:26:54.252558+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:03.469888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254323+0000","last_change":"2024-04-26T12:26:53.254495+0000","last_active":"2024-04-26T12:26:54.254323+0000","last_peered":"2024-04-26T12:26:54.254323+0000","last_clean":"2024-04-26T12:26:54.254323+0000","last_became_active":"2024-04-26T12:26:53.254149+0000","last_became_peered":"2024-04-26T12:26:53.254149+0000","last_unstale":"2024-04-26T12:26:54.254323+0000","last_undegraded":"2024-04-26T12:26:54.254323+0000","last_fullsized":"2024-04-26T12:26:54.254323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:37.907024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252663+0000","last_change":"2024-04-26T12:26:52.836279+0000","last_active":"2024-04-26T12:26:54.252663+0000","last_peered":"2024-04-26T12:26:54.252663+0000","last_clean":"2024-04-26T12:26:54.252663+0000","last_became_active":"2024-04-26T12:26:52.835916+0000","last_became_peered":"2024-04-26T12:26:52.835916+0000","last_unstale":"2024-04-26T12:26:54.252663+0000","last_undegraded":"2024-04-26T12:26:54.252663+0000","last_fullsized":"2024-04-26T12:26:54.252663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:33.466992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253090+0000","last_change":"2024-04-26T12:26:53.259112+0000","last_active":"2024-04-26T12:26:54.253090+0000","last_peered":"2024-04-26T12:26:54.253090+0000","last_clean":"2024-04-26T12:26:54.253090+0000","last_became_active":"2024-04-26T12:26:53.256762+0000","last_became_peered":"2024-04-26T12:26:53.256762+0000","last_unstale":"2024-04-26T12:26:54.253090+0000","last_undegraded":"2024-04-26T12:26:54.253090+0000","last_fullsized":"2024-04-26T12:26:54.253090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252967+0000","last_change":"2024-04-26T12:26:53.263131+0000","last_active":"2024-04-26T12:26:54.252967+0000","last_peered":"2024-04-26T12:26:54.252967+0000","last_clean":"2024-04-26T12:26:54.252967+0000","last_became_active":"2024-04-26T12:26:53.260489+0000","last_became_peered":"2024-04-26T12:26:53.260489+0000","last_unstale":"2024-04-26T12:26:54.252967+0000","last_undegraded":"2024-04-26T12:26:54.252967+0000","last_fullsized":"2024-04-26T12:26:54.252967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251606+0000","last_change":"2024-04-26T12:26:53.259832+0000","last_active":"2024-04-26T12:26:54.251606+0000","last_peered":"2024-04-26T12:26:54.251606+0000","last_clean":"2024-04-26T12:26:54.251606+0000","last_became_active":"2024-04-26T12:26:53.259028+0000","last_became_peered":"2024-04-26T12:26:53.259028+0000","last_unstale":"2024-04-26T12:26:54.251606+0000","last_undegraded":"2024-04-26T12:26:54.251606+0000","last_fullsized":"2024-04-26T12:26:54.251606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254286+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:26:54.254286+0000","last_peered":"2024-04-26T12:26:54.254286+0000","last_clean":"2024-04-26T12:26:54.254286+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:26:54.254286+0000","last_undegraded":"2024-04-26T12:26:54.254286+0000","last_fullsized":"2024-04-26T12:26:54.254286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252363+0000","last_change":"2024-04-26T12:26:53.259057+0000","last_active":"2024-04-26T12:26:54.252363+0000","last_peered":"2024-04-26T12:26:54.252363+0000","last_clean":"2024-04-26T12:26:54.252363+0000","last_became_active":"2024-04-26T12:26:53.257816+0000","last_became_peered":"2024-04-26T12:26:53.257816+0000","last_unstale":"2024-04-26T12:26:54.252363+0000","last_undegraded":"2024-04-26T12:26:54.252363+0000","last_fullsized":"2024-04-26T12:26:54.252363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:53.950315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254747+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:26:54.254747+0000","last_peered":"2024-04-26T12:26:54.254747+0000","last_clean":"2024-04-26T12:26:54.254747+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:26:54.254747+0000","last_undegraded":"2024-04-26T12:26:54.254747+0000","last_fullsized":"2024-04-26T12:26:54.254747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":641176,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":641792,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":147456,"data_stored":49678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:27:01.773 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:27:01.773 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T12:27:01.773 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T12:27:01.773 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T12:27:02.191 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:27:02.191 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T12:27:02.205 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T12:27:02.206 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:27:02.544 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:27:02.544 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":16,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:26:54.245547+0000","last_up_change":"2024-04-26T12:26:44.796790+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:26:51.091400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:26:52.222159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":41393},{"type":"v1","addr":"172.21.15.136:6801","nonce":41393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":41393},{"type":"v1","addr":"172.21.15.136:6803","nonce":41393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":41393},{"type":"v1","addr":"172.21.15.136:6807","nonce":41393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":41393},{"type":"v1","addr":"172.21.15.136:6805","nonce":41393}]},"public_addr":"172.21.15.136:6801/41393","cluster_addr":"172.21.15.136:6803/41393","heartbeat_back_addr":"172.21.15.136:6807/41393","heartbeat_front_addr":"172.21.15.136:6805/41393","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:27:02.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:26:45.341269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:26:45.839095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:26:51.091400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:26:52.222159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:27:02.558 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:27:02.897 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-04-26T12:27:02.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:27:03.250 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2024-04-26T12:27:03.265 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:27:03.605 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-04-26T12:27:03.619 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:27:03.956 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-04-26T12:27:03.970 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:27:04.354 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:27:04.354 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:26:53.244246+0000","modified":"2024-04-26T12:26:56.250552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14150":{"gid":14150,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6803/2009845799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2009845799},{"type":"v1","addr":"172.21.15.46:6803","nonce":2009845799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:27:04.357 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 6 2024-04-26T12:27:04.368 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:27:04.705 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:27:04.706 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":16,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:26:54.245547+0000","last_up_change":"2024-04-26T12:26:44.796790+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:26:51.091400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:26:52.222159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":41393},{"type":"v1","addr":"172.21.15.136:6801","nonce":41393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":41393},{"type":"v1","addr":"172.21.15.136:6803","nonce":41393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":41393},{"type":"v1","addr":"172.21.15.136:6807","nonce":41393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":41393},{"type":"v1","addr":"172.21.15.136:6805","nonce":41393}]},"public_addr":"172.21.15.136:6801/41393","cluster_addr":"172.21.15.136:6803/41393","heartbeat_back_addr":"172.21.15.136:6807/41393","heartbeat_front_addr":"172.21.15.136:6805/41393","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:27:04.720 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:26:45.341269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:26:45.839095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:26:51.091400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:26:52.222159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T12:27:04.720 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:27:05.058 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-04-26T12:27:05.072 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:27:05.414 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2024-04-26T12:27:05.429 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:27:05.769 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-04-26T12:27:05.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:27:06.121 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-04-26T12:27:06.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:27:06.519 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:27:06.519 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:26:53.244246+0000","modified":"2024-04-26T12:26:56.250552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14150":{"gid":14150,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6803/2009845799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2009845799},{"type":"v1","addr":"172.21.15.46:6803","nonce":2009845799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:27:06.522 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 6 2024-04-26T12:27:06.533 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:27:06.872 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:27:06.872 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":16,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:26:54.245547+0000","last_up_change":"2024-04-26T12:26:44.796790+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:26:51.091400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:26:52.222159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":41393},{"type":"v1","addr":"172.21.15.136:6801","nonce":41393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":41393},{"type":"v1","addr":"172.21.15.136:6803","nonce":41393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":41393},{"type":"v1","addr":"172.21.15.136:6807","nonce":41393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":41393},{"type":"v1","addr":"172.21.15.136:6805","nonce":41393}]},"public_addr":"172.21.15.136:6801/41393","cluster_addr":"172.21.15.136:6803/41393","heartbeat_back_addr":"172.21.15.136:6807/41393","heartbeat_front_addr":"172.21.15.136:6805/41393","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:27:06.887 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:27:07.270 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:27:07.270 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:26:53.244246+0000","modified":"2024-04-26T12:26:56.250552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14150":{"gid":14150,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6803/2009845799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2009845799},{"type":"v1","addr":"172.21.15.46:6803","nonce":2009845799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:27:07.273 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 6 2024-04-26T12:27:07.385 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T12:26:53.244246+0000', 'modified': '2024-04-26T12:26:56.250552+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14150}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14150': {'gid': 14150, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.46:6803/2009845799', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6802', 'nonce': 2009845799}, {'type': 'v1', 'addr': '172.21.15.46:6803', 'nonce': 2009845799}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-26T12:27:07.386 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T12:27:07.386 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T12:27:07.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-04-26T12:27:07.524+0000 7efde37fe700 0 client.14408 ms_handle_reset on v2:172.21.15.46:6802/2009845799 2024-04-26T12:27:07.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-04-26T12:27:07.546+0000 7efde37fe700 0 client.4605 ms_handle_reset on v2:172.21.15.46:6802/2009845799 2024-04-26T12:27:07.549 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-04-26T12:27:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "3dd84416-f290-4721-94ce-52b0ffaacf34", 2024-04-26T12:27:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-04-26T12:27:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 14150, 2024-04-26T12:27:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-04-26T12:27:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-04-26T12:27:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-04-26T12:27:07.549 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 14.301137275, 2024-04-26T12:27:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 6, 2024-04-26T12:27:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 16, 2024-04-26T12:27:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 16, 2024-04-26T12:27:07.550 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 19.638840444 2024-04-26T12:27:07.550 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-04-26T12:27:07.560 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-26T12:27:07.590 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-26T12:27:07.590 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}} 2024-04-26T12:27:07.590 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-26T12:27:07.591 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-26T12:27:07.591 DEBUG:teuthology.orchestra.run.smithi046:> sync 2024-04-26T12:27:07.740 DEBUG:teuthology.orchestra.run.smithi115:> sync 2024-04-26T12:27:07.925 DEBUG:teuthology.orchestra.run.smithi136:> sync 2024-04-26T12:27:07.996 DEBUG:teuthology.orchestra.run.smithi142:> sync 2024-04-26T12:27:08.102 DEBUG:tasks.thrashosds:checking console status of smithi046 2024-04-26T12:27:08.103 DEBUG:teuthology.orchestra.console.smithi046:Waiting for login prompt 2024-04-26T12:27:08.103 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi046 2024-04-26T12:27:08.273 DEBUG:teuthology.orchestra.console.smithi046:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:27:08.274 DEBUG:teuthology.orchestra.console.smithi046:expect after: smithi046 login: 2024-04-26T12:27:08.326 DEBUG:teuthology.orchestra.console.smithi046:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi046 login: [disconnect] 2024-04-26T12:27:08.427 DEBUG:tasks.thrashosds:checking console status of smithi115 2024-04-26T12:27:08.427 DEBUG:teuthology.orchestra.console.smithi115:Waiting for login prompt 2024-04-26T12:27:08.428 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi115 2024-04-26T12:27:08.526 DEBUG:teuthology.orchestra.console.smithi115:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:27:08.526 DEBUG:teuthology.orchestra.console.smithi115:expect after: smithi115 login: 2024-04-26T12:27:08.578 DEBUG:teuthology.orchestra.console.smithi115:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi115 login: [disconnect] 2024-04-26T12:27:08.679 DEBUG:tasks.thrashosds:checking console status of smithi136 2024-04-26T12:27:08.679 DEBUG:teuthology.orchestra.console.smithi136:Waiting for login prompt 2024-04-26T12:27:08.679 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi136 2024-04-26T12:27:08.786 DEBUG:teuthology.orchestra.console.smithi136:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:27:08.786 DEBUG:teuthology.orchestra.console.smithi136:expect after: smithi136 login: 2024-04-26T12:27:08.838 DEBUG:teuthology.orchestra.console.smithi136:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi136 login: [disconnect] 2024-04-26T12:27:08.940 DEBUG:tasks.thrashosds:checking console status of smithi142 2024-04-26T12:27:08.940 DEBUG:teuthology.orchestra.console.smithi142:Waiting for login prompt 2024-04-26T12:27:08.940 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi142 2024-04-26T12:27:09.049 DEBUG:teuthology.orchestra.console.smithi142:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:27:09.049 DEBUG:teuthology.orchestra.console.smithi142:expect after: smithi142 login: 2024-04-26T12:27:09.101 DEBUG:teuthology.orchestra.console.smithi142:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi142 login: [disconnect] 2024-04-26T12:27:09.203 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-26T12:27:09.580 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-26T12:27:09.581 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:27:09.581 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:27:09.925 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:27:09.927 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:27:09.936 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T12:27:09.292423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81664,"kb_used_data":600,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033856,"statfs":{"total":289910292480,"available":289826668544,"internally_reserved":0,"allocated":614400,"data_stored":1332646,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002623"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.255057+0000","last_change":"2024-04-26T12:26:53.255588+0000","last_active":"2024-04-26T12:26:54.255057+0000","last_peered":"2024-04-26T12:26:54.255057+0000","last_clean":"2024-04-26T12:26:54.255057+0000","last_became_active":"2024-04-26T12:26:53.255201+0000","last_became_peered":"2024-04-26T12:26:53.255201+0000","last_unstale":"2024-04-26T12:26:54.255057+0000","last_undegraded":"2024-04-26T12:26:54.255057+0000","last_fullsized":"2024-04-26T12:26:54.255057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:09.233018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254502+0000","last_change":"2024-04-26T12:26:53.256136+0000","last_active":"2024-04-26T12:26:54.254502+0000","last_peered":"2024-04-26T12:26:54.254502+0000","last_clean":"2024-04-26T12:26:54.254502+0000","last_became_active":"2024-04-26T12:26:53.255297+0000","last_became_peered":"2024-04-26T12:26:53.255297+0000","last_unstale":"2024-04-26T12:26:54.254502+0000","last_undegraded":"2024-04-26T12:26:54.254502+0000","last_fullsized":"2024-04-26T12:26:54.254502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253859+0000","last_change":"2024-04-26T12:26:53.265584+0000","last_active":"2024-04-26T12:26:54.253859+0000","last_peered":"2024-04-26T12:26:54.253859+0000","last_clean":"2024-04-26T12:26:54.253859+0000","last_became_active":"2024-04-26T12:26:53.264555+0000","last_became_peered":"2024-04-26T12:26:53.264555+0000","last_unstale":"2024-04-26T12:26:54.253859+0000","last_undegraded":"2024-04-26T12:26:54.253859+0000","last_fullsized":"2024-04-26T12:26:54.253859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:20:03.207903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253538+0000","last_change":"2024-04-26T12:26:53.263004+0000","last_active":"2024-04-26T12:26:54.253538+0000","last_peered":"2024-04-26T12:26:54.253538+0000","last_clean":"2024-04-26T12:26:54.253538+0000","last_became_active":"2024-04-26T12:26:53.261193+0000","last_became_peered":"2024-04-26T12:26:53.261193+0000","last_unstale":"2024-04-26T12:26:54.253538+0000","last_undegraded":"2024-04-26T12:26:54.253538+0000","last_fullsized":"2024-04-26T12:26:54.253538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254277+0000","last_change":"2024-04-26T12:26:53.255483+0000","last_active":"2024-04-26T12:26:54.254277+0000","last_peered":"2024-04-26T12:26:54.254277+0000","last_clean":"2024-04-26T12:26:54.254277+0000","last_became_active":"2024-04-26T12:26:53.255001+0000","last_became_peered":"2024-04-26T12:26:53.255001+0000","last_unstale":"2024-04-26T12:26:54.254277+0000","last_undegraded":"2024-04-26T12:26:54.254277+0000","last_fullsized":"2024-04-26T12:26:54.254277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:34.496560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252949+0000","last_change":"2024-04-26T12:26:53.264139+0000","last_active":"2024-04-26T12:26:54.252949+0000","last_peered":"2024-04-26T12:26:54.252949+0000","last_clean":"2024-04-26T12:26:54.252949+0000","last_became_active":"2024-04-26T12:26:53.262002+0000","last_became_peered":"2024-04-26T12:26:53.262002+0000","last_unstale":"2024-04-26T12:26:54.252949+0000","last_undegraded":"2024-04-26T12:26:54.252949+0000","last_fullsized":"2024-04-26T12:26:54.252949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253027+0000","last_change":"2024-04-26T12:26:53.262987+0000","last_active":"2024-04-26T12:26:54.253027+0000","last_peered":"2024-04-26T12:26:54.253027+0000","last_clean":"2024-04-26T12:26:54.253027+0000","last_became_active":"2024-04-26T12:26:53.262113+0000","last_became_peered":"2024-04-26T12:26:53.262113+0000","last_unstale":"2024-04-26T12:26:54.253027+0000","last_undegraded":"2024-04-26T12:26:54.253027+0000","last_fullsized":"2024-04-26T12:26:54.253027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252720+0000","last_change":"2024-04-26T12:26:53.264092+0000","last_active":"2024-04-26T12:26:54.252720+0000","last_peered":"2024-04-26T12:26:54.252720+0000","last_clean":"2024-04-26T12:26:54.252720+0000","last_became_active":"2024-04-26T12:26:53.260501+0000","last_became_peered":"2024-04-26T12:26:53.260501+0000","last_unstale":"2024-04-26T12:26:54.252720+0000","last_undegraded":"2024-04-26T12:26:54.252720+0000","last_fullsized":"2024-04-26T12:26:54.252720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252461+0000","last_change":"2024-04-26T12:26:53.259692+0000","last_active":"2024-04-26T12:26:54.252461+0000","last_peered":"2024-04-26T12:26:54.252461+0000","last_clean":"2024-04-26T12:26:54.252461+0000","last_became_active":"2024-04-26T12:26:53.258709+0000","last_became_peered":"2024-04-26T12:26:53.258709+0000","last_unstale":"2024-04-26T12:26:54.252461+0000","last_undegraded":"2024-04-26T12:26:54.252461+0000","last_fullsized":"2024-04-26T12:26:54.252461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254822+0000","last_change":"2024-04-26T12:26:53.256190+0000","last_active":"2024-04-26T12:26:54.254822+0000","last_peered":"2024-04-26T12:26:54.254822+0000","last_clean":"2024-04-26T12:26:54.254822+0000","last_became_active":"2024-04-26T12:26:53.255382+0000","last_became_peered":"2024-04-26T12:26:53.255382+0000","last_unstale":"2024-04-26T12:26:54.254822+0000","last_undegraded":"2024-04-26T12:26:54.254822+0000","last_fullsized":"2024-04-26T12:26:54.254822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:53.950315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253701+0000","last_change":"2024-04-26T12:26:53.262951+0000","last_active":"2024-04-26T12:26:54.253701+0000","last_peered":"2024-04-26T12:26:54.253701+0000","last_clean":"2024-04-26T12:26:54.253701+0000","last_became_active":"2024-04-26T12:26:53.261842+0000","last_became_peered":"2024-04-26T12:26:53.261842+0000","last_unstale":"2024-04-26T12:26:54.253701+0000","last_undegraded":"2024-04-26T12:26:54.253701+0000","last_fullsized":"2024-04-26T12:26:54.253701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:35.327049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254183+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:26:54.254183+0000","last_peered":"2024-04-26T12:26:54.254183+0000","last_clean":"2024-04-26T12:26:54.254183+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:26:54.254183+0000","last_undegraded":"2024-04-26T12:26:54.254183+0000","last_fullsized":"2024-04-26T12:26:54.254183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254377+0000","last_change":"2024-04-26T12:26:53.254930+0000","last_active":"2024-04-26T12:26:54.254377+0000","last_peered":"2024-04-26T12:26:54.254377+0000","last_clean":"2024-04-26T12:26:54.254377+0000","last_became_active":"2024-04-26T12:26:53.253988+0000","last_became_peered":"2024-04-26T12:26:53.253988+0000","last_unstale":"2024-04-26T12:26:54.254377+0000","last_undegraded":"2024-04-26T12:26:54.254377+0000","last_fullsized":"2024-04-26T12:26:54.254377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253678+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:26:54.253678+0000","last_peered":"2024-04-26T12:26:54.253678+0000","last_clean":"2024-04-26T12:26:54.253678+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:26:54.253678+0000","last_undegraded":"2024-04-26T12:26:54.253678+0000","last_fullsized":"2024-04-26T12:26:54.253678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252782+0000","last_change":"2024-04-26T12:26:53.266568+0000","last_active":"2024-04-26T12:26:54.252782+0000","last_peered":"2024-04-26T12:26:54.252782+0000","last_clean":"2024-04-26T12:26:54.252782+0000","last_became_active":"2024-04-26T12:26:53.265846+0000","last_became_peered":"2024-04-26T12:26:53.265846+0000","last_unstale":"2024-04-26T12:26:54.252782+0000","last_undegraded":"2024-04-26T12:26:54.252782+0000","last_fullsized":"2024-04-26T12:26:54.252782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:10.849502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252784+0000","last_change":"2024-04-26T12:26:53.265459+0000","last_active":"2024-04-26T12:26:54.252784+0000","last_peered":"2024-04-26T12:26:54.252784+0000","last_clean":"2024-04-26T12:26:54.252784+0000","last_became_active":"2024-04-26T12:26:53.262898+0000","last_became_peered":"2024-04-26T12:26:53.262898+0000","last_unstale":"2024-04-26T12:26:54.252784+0000","last_undegraded":"2024-04-26T12:26:54.252784+0000","last_fullsized":"2024-04-26T12:26:54.252784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252546+0000","last_change":"2024-04-26T12:26:53.259864+0000","last_active":"2024-04-26T12:26:54.252546+0000","last_peered":"2024-04-26T12:26:54.252546+0000","last_clean":"2024-04-26T12:26:54.252546+0000","last_became_active":"2024-04-26T12:26:53.259025+0000","last_became_peered":"2024-04-26T12:26:53.259025+0000","last_unstale":"2024-04-26T12:26:54.252546+0000","last_undegraded":"2024-04-26T12:26:54.252546+0000","last_fullsized":"2024-04-26T12:26:54.252546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254951+0000","last_change":"2024-04-26T12:26:53.261186+0000","last_active":"2024-04-26T12:26:54.254951+0000","last_peered":"2024-04-26T12:26:54.254951+0000","last_clean":"2024-04-26T12:26:54.254951+0000","last_became_active":"2024-04-26T12:26:53.260820+0000","last_became_peered":"2024-04-26T12:26:53.260820+0000","last_unstale":"2024-04-26T12:26:54.254951+0000","last_undegraded":"2024-04-26T12:26:54.254951+0000","last_fullsized":"2024-04-26T12:26:54.254951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:00.602708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252225+0000","last_change":"2024-04-26T12:26:53.259728+0000","last_active":"2024-04-26T12:26:54.252225+0000","last_peered":"2024-04-26T12:26:54.252225+0000","last_clean":"2024-04-26T12:26:54.252225+0000","last_became_active":"2024-04-26T12:26:53.258952+0000","last_became_peered":"2024-04-26T12:26:53.258952+0000","last_unstale":"2024-04-26T12:26:54.252225+0000","last_undegraded":"2024-04-26T12:26:54.252225+0000","last_fullsized":"2024-04-26T12:26:54.252225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253512+0000","last_change":"2024-04-26T12:26:53.257321+0000","last_active":"2024-04-26T12:26:54.253512+0000","last_peered":"2024-04-26T12:26:54.253512+0000","last_clean":"2024-04-26T12:26:54.253512+0000","last_became_active":"2024-04-26T12:26:53.256192+0000","last_became_peered":"2024-04-26T12:26:53.256192+0000","last_unstale":"2024-04-26T12:26:54.253512+0000","last_undegraded":"2024-04-26T12:26:54.253512+0000","last_fullsized":"2024-04-26T12:26:54.253512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253202+0000","last_change":"2024-04-26T12:26:53.261669+0000","last_active":"2024-04-26T12:26:54.253202+0000","last_peered":"2024-04-26T12:26:54.253202+0000","last_clean":"2024-04-26T12:26:54.253202+0000","last_became_active":"2024-04-26T12:26:53.259854+0000","last_became_peered":"2024-04-26T12:26:53.259854+0000","last_unstale":"2024-04-26T12:26:54.253202+0000","last_undegraded":"2024-04-26T12:26:54.253202+0000","last_fullsized":"2024-04-26T12:26:54.253202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254141+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:26:54.254141+0000","last_peered":"2024-04-26T12:26:54.254141+0000","last_clean":"2024-04-26T12:26:54.254141+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:26:54.254141+0000","last_undegraded":"2024-04-26T12:26:54.254141+0000","last_fullsized":"2024-04-26T12:26:54.254141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251798+0000","last_change":"2024-04-26T12:26:53.262898+0000","last_active":"2024-04-26T12:26:54.251798+0000","last_peered":"2024-04-26T12:26:54.251798+0000","last_clean":"2024-04-26T12:26:54.251798+0000","last_became_active":"2024-04-26T12:26:53.262603+0000","last_became_peered":"2024-04-26T12:26:53.262603+0000","last_unstale":"2024-04-26T12:26:54.251798+0000","last_undegraded":"2024-04-26T12:26:54.251798+0000","last_fullsized":"2024-04-26T12:26:54.251798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254215+0000","last_change":"2024-04-26T12:26:53.254395+0000","last_active":"2024-04-26T12:26:54.254215+0000","last_peered":"2024-04-26T12:26:54.254215+0000","last_clean":"2024-04-26T12:26:54.254215+0000","last_became_active":"2024-04-26T12:26:53.253946+0000","last_became_peered":"2024-04-26T12:26:53.253946+0000","last_unstale":"2024-04-26T12:26:54.254215+0000","last_undegraded":"2024-04-26T12:26:54.254215+0000","last_fullsized":"2024-04-26T12:26:54.254215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:41.501818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254992+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:26:54.254992+0000","last_peered":"2024-04-26T12:26:54.254992+0000","last_clean":"2024-04-26T12:26:54.254992+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:26:54.254992+0000","last_undegraded":"2024-04-26T12:26:54.254992+0000","last_fullsized":"2024-04-26T12:26:54.254992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252630+0000","last_change":"2024-04-26T12:26:53.261876+0000","last_active":"2024-04-26T12:26:54.252630+0000","last_peered":"2024-04-26T12:26:54.252630+0000","last_clean":"2024-04-26T12:26:54.252630+0000","last_became_active":"2024-04-26T12:26:53.261485+0000","last_became_peered":"2024-04-26T12:26:53.261485+0000","last_unstale":"2024-04-26T12:26:54.252630+0000","last_undegraded":"2024-04-26T12:26:54.252630+0000","last_fullsized":"2024-04-26T12:26:54.252630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253751+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:26:54.253751+0000","last_peered":"2024-04-26T12:26:54.253751+0000","last_clean":"2024-04-26T12:26:54.253751+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:26:54.253751+0000","last_undegraded":"2024-04-26T12:26:54.253751+0000","last_fullsized":"2024-04-26T12:26:54.253751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254119+0000","last_change":"2024-04-26T12:26:52.839543+0000","last_active":"2024-04-26T12:26:54.254119+0000","last_peered":"2024-04-26T12:26:54.254119+0000","last_clean":"2024-04-26T12:26:54.254119+0000","last_became_active":"2024-04-26T12:26:52.839080+0000","last_became_peered":"2024-04-26T12:26:52.839080+0000","last_unstale":"2024-04-26T12:26:54.254119+0000","last_undegraded":"2024-04-26T12:26:54.254119+0000","last_fullsized":"2024-04-26T12:26:54.254119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:18.329898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254904+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:26:54.254904+0000","last_peered":"2024-04-26T12:26:54.254904+0000","last_clean":"2024-04-26T12:26:54.254904+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:26:54.254904+0000","last_undegraded":"2024-04-26T12:26:54.254904+0000","last_fullsized":"2024-04-26T12:26:54.254904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251794+0000","last_change":"2024-04-26T12:26:52.838082+0000","last_active":"2024-04-26T12:26:54.251794+0000","last_peered":"2024-04-26T12:26:54.251794+0000","last_clean":"2024-04-26T12:26:54.251794+0000","last_became_active":"2024-04-26T12:26:52.837596+0000","last_became_peered":"2024-04-26T12:26:52.837596+0000","last_unstale":"2024-04-26T12:26:54.251794+0000","last_undegraded":"2024-04-26T12:26:54.251794+0000","last_fullsized":"2024-04-26T12:26:54.251794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:08.892977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252572+0000","last_change":"2024-04-26T12:26:53.262665+0000","last_active":"2024-04-26T12:26:54.252572+0000","last_peered":"2024-04-26T12:26:54.252572+0000","last_clean":"2024-04-26T12:26:54.252572+0000","last_became_active":"2024-04-26T12:26:53.262161+0000","last_became_peered":"2024-04-26T12:26:53.262161+0000","last_unstale":"2024-04-26T12:26:54.252572+0000","last_undegraded":"2024-04-26T12:26:54.252572+0000","last_fullsized":"2024-04-26T12:26:54.252572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251650+0000","last_change":"2024-04-26T12:26:52.833500+0000","last_active":"2024-04-26T12:26:54.251650+0000","last_peered":"2024-04-26T12:26:54.251650+0000","last_clean":"2024-04-26T12:26:54.251650+0000","last_became_active":"2024-04-26T12:26:52.833152+0000","last_became_peered":"2024-04-26T12:26:52.833152+0000","last_unstale":"2024-04-26T12:26:54.251650+0000","last_undegraded":"2024-04-26T12:26:54.251650+0000","last_fullsized":"2024-04-26T12:26:54.251650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:28.165579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.255028+0000","last_change":"2024-04-26T12:26:53.260764+0000","last_active":"2024-04-26T12:26:54.255028+0000","last_peered":"2024-04-26T12:26:54.255028+0000","last_clean":"2024-04-26T12:26:54.255028+0000","last_became_active":"2024-04-26T12:26:53.260388+0000","last_became_peered":"2024-04-26T12:26:53.260388+0000","last_unstale":"2024-04-26T12:26:54.255028+0000","last_undegraded":"2024-04-26T12:26:54.255028+0000","last_fullsized":"2024-04-26T12:26:54.255028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252735+0000","last_change":"2024-04-26T12:26:52.837792+0000","last_active":"2024-04-26T12:26:54.252735+0000","last_peered":"2024-04-26T12:26:54.252735+0000","last_clean":"2024-04-26T12:26:54.252735+0000","last_became_active":"2024-04-26T12:26:52.837272+0000","last_became_peered":"2024-04-26T12:26:52.837272+0000","last_unstale":"2024-04-26T12:26:54.252735+0000","last_undegraded":"2024-04-26T12:26:54.252735+0000","last_fullsized":"2024-04-26T12:26:54.252735+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:12.837493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251539+0000","last_change":"2024-04-26T12:26:53.255423+0000","last_active":"2024-04-26T12:26:54.251539+0000","last_peered":"2024-04-26T12:26:54.251539+0000","last_clean":"2024-04-26T12:26:54.251539+0000","last_became_active":"2024-04-26T12:26:53.253812+0000","last_became_peered":"2024-04-26T12:26:53.253812+0000","last_unstale":"2024-04-26T12:26:54.251539+0000","last_undegraded":"2024-04-26T12:26:54.251539+0000","last_fullsized":"2024-04-26T12:26:54.251539+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:37.907024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253542+0000","last_change":"2024-04-26T12:26:52.840163+0000","last_active":"2024-04-26T12:26:54.253542+0000","last_peered":"2024-04-26T12:26:54.253542+0000","last_clean":"2024-04-26T12:26:54.253542+0000","last_became_active":"2024-04-26T12:26:52.839246+0000","last_became_peered":"2024-04-26T12:26:52.839246+0000","last_unstale":"2024-04-26T12:26:54.253542+0000","last_undegraded":"2024-04-26T12:26:54.253542+0000","last_fullsized":"2024-04-26T12:26:54.253542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:44.809454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251997+0000","last_change":"2024-04-26T12:26:53.258963+0000","last_active":"2024-04-26T12:26:54.251997+0000","last_peered":"2024-04-26T12:26:54.251997+0000","last_clean":"2024-04-26T12:26:54.251997+0000","last_became_active":"2024-04-26T12:26:53.258171+0000","last_became_peered":"2024-04-26T12:26:53.258171+0000","last_unstale":"2024-04-26T12:26:54.251997+0000","last_undegraded":"2024-04-26T12:26:54.251997+0000","last_fullsized":"2024-04-26T12:26:54.251997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254770+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:26:54.254770+0000","last_peered":"2024-04-26T12:26:54.254770+0000","last_clean":"2024-04-26T12:26:54.254770+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:26:54.254770+0000","last_undegraded":"2024-04-26T12:26:54.254770+0000","last_fullsized":"2024-04-26T12:26:54.254770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251746+0000","last_change":"2024-04-26T12:26:53.259209+0000","last_active":"2024-04-26T12:26:54.251746+0000","last_peered":"2024-04-26T12:26:54.251746+0000","last_clean":"2024-04-26T12:26:54.251746+0000","last_became_active":"2024-04-26T12:26:53.258620+0000","last_became_peered":"2024-04-26T12:26:53.258620+0000","last_unstale":"2024-04-26T12:26:54.251746+0000","last_undegraded":"2024-04-26T12:26:54.251746+0000","last_fullsized":"2024-04-26T12:26:54.251746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253386+0000","last_change":"2024-04-26T12:26:52.841280+0000","last_active":"2024-04-26T12:26:54.253386+0000","last_peered":"2024-04-26T12:26:54.253386+0000","last_clean":"2024-04-26T12:26:54.253386+0000","last_became_active":"2024-04-26T12:26:52.839398+0000","last_became_peered":"2024-04-26T12:26:52.839398+0000","last_unstale":"2024-04-26T12:26:54.253386+0000","last_undegraded":"2024-04-26T12:26:54.253386+0000","last_fullsized":"2024-04-26T12:26:54.253386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:53.889623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253612+0000","last_change":"2024-04-26T12:26:53.260830+0000","last_active":"2024-04-26T12:26:54.253612+0000","last_peered":"2024-04-26T12:26:54.253612+0000","last_clean":"2024-04-26T12:26:54.253612+0000","last_became_active":"2024-04-26T12:26:53.259452+0000","last_became_peered":"2024-04-26T12:26:53.259452+0000","last_unstale":"2024-04-26T12:26:54.253612+0000","last_undegraded":"2024-04-26T12:26:54.253612+0000","last_fullsized":"2024-04-26T12:26:54.253612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253560+0000","last_change":"2024-04-26T12:26:52.840521+0000","last_active":"2024-04-26T12:26:54.253560+0000","last_peered":"2024-04-26T12:26:54.253560+0000","last_clean":"2024-04-26T12:26:54.253560+0000","last_became_active":"2024-04-26T12:26:52.839442+0000","last_became_peered":"2024-04-26T12:26:52.839442+0000","last_unstale":"2024-04-26T12:26:54.253560+0000","last_undegraded":"2024-04-26T12:26:54.253560+0000","last_fullsized":"2024-04-26T12:26:54.253560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:28.165579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254485+0000","last_change":"2024-04-26T12:26:53.254489+0000","last_active":"2024-04-26T12:26:54.254485+0000","last_peered":"2024-04-26T12:26:54.254485+0000","last_clean":"2024-04-26T12:26:54.254485+0000","last_became_active":"2024-04-26T12:26:53.254099+0000","last_became_peered":"2024-04-26T12:26:53.254099+0000","last_unstale":"2024-04-26T12:26:54.254485+0000","last_undegraded":"2024-04-26T12:26:54.254485+0000","last_fullsized":"2024-04-26T12:26:54.254485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251939+0000","last_change":"2024-04-26T12:26:52.837857+0000","last_active":"2024-04-26T12:26:54.251939+0000","last_peered":"2024-04-26T12:26:54.251939+0000","last_clean":"2024-04-26T12:26:54.251939+0000","last_became_active":"2024-04-26T12:26:52.837402+0000","last_became_peered":"2024-04-26T12:26:52.837402+0000","last_unstale":"2024-04-26T12:26:54.251939+0000","last_undegraded":"2024-04-26T12:26:54.251939+0000","last_fullsized":"2024-04-26T12:26:54.251939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:53.889623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254865+0000","last_change":"2024-04-26T12:26:53.255659+0000","last_active":"2024-04-26T12:26:54.254865+0000","last_peered":"2024-04-26T12:26:54.254865+0000","last_clean":"2024-04-26T12:26:54.254865+0000","last_became_active":"2024-04-26T12:26:53.255253+0000","last_became_peered":"2024-04-26T12:26:53.255253+0000","last_unstale":"2024-04-26T12:26:54.254865+0000","last_undegraded":"2024-04-26T12:26:54.254865+0000","last_fullsized":"2024-04-26T12:26:54.254865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.236196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254021+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:26:54.254021+0000","last_peered":"2024-04-26T12:26:54.254021+0000","last_clean":"2024-04-26T12:26:54.254021+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:26:54.254021+0000","last_undegraded":"2024-04-26T12:26:54.254021+0000","last_fullsized":"2024-04-26T12:26:54.254021+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252460+0000","last_change":"2024-04-26T12:26:53.261880+0000","last_active":"2024-04-26T12:26:54.252460+0000","last_peered":"2024-04-26T12:26:54.252460+0000","last_clean":"2024-04-26T12:26:54.252460+0000","last_became_active":"2024-04-26T12:26:53.261373+0000","last_became_peered":"2024-04-26T12:26:53.261373+0000","last_unstale":"2024-04-26T12:26:54.252460+0000","last_undegraded":"2024-04-26T12:26:54.252460+0000","last_fullsized":"2024-04-26T12:26:54.252460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253014+0000","last_change":"2024-04-26T12:26:52.840810+0000","last_active":"2024-04-26T12:26:54.253014+0000","last_peered":"2024-04-26T12:26:54.253014+0000","last_clean":"2024-04-26T12:26:54.253014+0000","last_became_active":"2024-04-26T12:26:52.840059+0000","last_became_peered":"2024-04-26T12:26:52.840059+0000","last_unstale":"2024-04-26T12:26:54.253014+0000","last_undegraded":"2024-04-26T12:26:54.253014+0000","last_fullsized":"2024-04-26T12:26:54.253014+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:17.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252819+0000","last_change":"2024-04-26T12:26:53.265200+0000","last_active":"2024-04-26T12:26:54.252819+0000","last_peered":"2024-04-26T12:26:54.252819+0000","last_clean":"2024-04-26T12:26:54.252819+0000","last_became_active":"2024-04-26T12:26:53.264830+0000","last_became_peered":"2024-04-26T12:26:53.264830+0000","last_unstale":"2024-04-26T12:26:54.252819+0000","last_undegraded":"2024-04-26T12:26:54.252819+0000","last_fullsized":"2024-04-26T12:26:54.252819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253700+0000","last_change":"2024-04-26T12:26:52.840684+0000","last_active":"2024-04-26T12:26:54.253700+0000","last_peered":"2024-04-26T12:26:54.253700+0000","last_clean":"2024-04-26T12:26:54.253700+0000","last_became_active":"2024-04-26T12:26:52.839414+0000","last_became_peered":"2024-04-26T12:26:52.839414+0000","last_unstale":"2024-04-26T12:26:54.253700+0000","last_undegraded":"2024-04-26T12:26:54.253700+0000","last_fullsized":"2024-04-26T12:26:54.253700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:12.837493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253759+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:26:54.253759+0000","last_peered":"2024-04-26T12:26:54.253759+0000","last_clean":"2024-04-26T12:26:54.253759+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:26:54.253759+0000","last_undegraded":"2024-04-26T12:26:54.253759+0000","last_fullsized":"2024-04-26T12:26:54.253759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254691+0000","last_change":"2024-04-26T12:26:52.839692+0000","last_active":"2024-04-26T12:26:54.254691+0000","last_peered":"2024-04-26T12:26:54.254691+0000","last_clean":"2024-04-26T12:26:54.254691+0000","last_became_active":"2024-04-26T12:26:52.839419+0000","last_became_peered":"2024-04-26T12:26:52.839419+0000","last_unstale":"2024-04-26T12:26:54.254691+0000","last_undegraded":"2024-04-26T12:26:54.254691+0000","last_fullsized":"2024-04-26T12:26:54.254691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:25.416851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254179+0000","last_change":"2024-04-26T12:26:53.254395+0000","last_active":"2024-04-26T12:26:54.254179+0000","last_peered":"2024-04-26T12:26:54.254179+0000","last_clean":"2024-04-26T12:26:54.254179+0000","last_became_active":"2024-04-26T12:26:53.253926+0000","last_became_peered":"2024-04-26T12:26:53.253926+0000","last_unstale":"2024-04-26T12:26:54.254179+0000","last_undegraded":"2024-04-26T12:26:54.254179+0000","last_fullsized":"2024-04-26T12:26:54.254179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:59.517606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253817+0000","last_change":"2024-04-26T12:26:52.842023+0000","last_active":"2024-04-26T12:26:54.253817+0000","last_peered":"2024-04-26T12:26:54.253817+0000","last_clean":"2024-04-26T12:26:54.253817+0000","last_became_active":"2024-04-26T12:26:52.840857+0000","last_became_peered":"2024-04-26T12:26:52.840857+0000","last_unstale":"2024-04-26T12:26:54.253817+0000","last_undegraded":"2024-04-26T12:26:54.253817+0000","last_fullsized":"2024-04-26T12:26:54.253817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:08.892977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253219+0000","last_change":"2024-04-26T12:26:53.263148+0000","last_active":"2024-04-26T12:26:54.253219+0000","last_peered":"2024-04-26T12:26:54.253219+0000","last_clean":"2024-04-26T12:26:54.253219+0000","last_became_active":"2024-04-26T12:26:53.261904+0000","last_became_peered":"2024-04-26T12:26:53.261904+0000","last_unstale":"2024-04-26T12:26:54.253219+0000","last_undegraded":"2024-04-26T12:26:54.253219+0000","last_fullsized":"2024-04-26T12:26:54.253219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253194+0000","last_change":"2024-04-26T12:26:52.841895+0000","last_active":"2024-04-26T12:26:54.253194+0000","last_peered":"2024-04-26T12:26:54.253194+0000","last_clean":"2024-04-26T12:26:54.253194+0000","last_became_active":"2024-04-26T12:26:52.840195+0000","last_became_peered":"2024-04-26T12:26:52.840195+0000","last_unstale":"2024-04-26T12:26:54.253194+0000","last_undegraded":"2024-04-26T12:26:54.253194+0000","last_fullsized":"2024-04-26T12:26:54.253194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:03.469888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252358+0000","last_change":"2024-04-26T12:26:53.265195+0000","last_active":"2024-04-26T12:26:54.252358+0000","last_peered":"2024-04-26T12:26:54.252358+0000","last_clean":"2024-04-26T12:26:54.252358+0000","last_became_active":"2024-04-26T12:26:53.264819+0000","last_became_peered":"2024-04-26T12:26:53.264819+0000","last_unstale":"2024-04-26T12:26:54.252358+0000","last_undegraded":"2024-04-26T12:26:54.252358+0000","last_fullsized":"2024-04-26T12:26:54.252358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252231+0000","last_change":"2024-04-26T12:26:52.837057+0000","last_active":"2024-04-26T12:26:54.252231+0000","last_peered":"2024-04-26T12:26:54.252231+0000","last_clean":"2024-04-26T12:26:54.252231+0000","last_became_active":"2024-04-26T12:26:52.836594+0000","last_became_peered":"2024-04-26T12:26:52.836594+0000","last_unstale":"2024-04-26T12:26:54.252231+0000","last_undegraded":"2024-04-26T12:26:54.252231+0000","last_fullsized":"2024-04-26T12:26:54.252231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:42.768206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253143+0000","last_change":"2024-04-26T12:26:53.263194+0000","last_active":"2024-04-26T12:26:54.253143+0000","last_peered":"2024-04-26T12:26:54.253143+0000","last_clean":"2024-04-26T12:26:54.253143+0000","last_became_active":"2024-04-26T12:26:53.262366+0000","last_became_peered":"2024-04-26T12:26:53.262366+0000","last_unstale":"2024-04-26T12:26:54.253143+0000","last_undegraded":"2024-04-26T12:26:54.253143+0000","last_fullsized":"2024-04-26T12:26:54.253143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253105+0000","last_change":"2024-04-26T12:26:52.842337+0000","last_active":"2024-04-26T12:26:54.253105+0000","last_peered":"2024-04-26T12:26:54.253105+0000","last_clean":"2024-04-26T12:26:54.253105+0000","last_became_active":"2024-04-26T12:26:52.842009+0000","last_became_peered":"2024-04-26T12:26:52.842009+0000","last_unstale":"2024-04-26T12:26:54.253105+0000","last_undegraded":"2024-04-26T12:26:54.253105+0000","last_fullsized":"2024-04-26T12:26:54.253105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253989+0000","last_change":"2024-04-26T12:26:53.266014+0000","last_active":"2024-04-26T12:26:54.253989+0000","last_peered":"2024-04-26T12:26:54.253989+0000","last_clean":"2024-04-26T12:26:54.253989+0000","last_became_active":"2024-04-26T12:26:53.264254+0000","last_became_peered":"2024-04-26T12:26:53.264254+0000","last_unstale":"2024-04-26T12:26:54.253989+0000","last_undegraded":"2024-04-26T12:26:54.253989+0000","last_fullsized":"2024-04-26T12:26:54.253989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:04.369827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253838+0000","last_change":"2024-04-26T12:26:52.839759+0000","last_active":"2024-04-26T12:26:54.253838+0000","last_peered":"2024-04-26T12:26:54.253838+0000","last_clean":"2024-04-26T12:26:54.253838+0000","last_became_active":"2024-04-26T12:26:52.839445+0000","last_became_peered":"2024-04-26T12:26:52.839445+0000","last_unstale":"2024-04-26T12:26:54.253838+0000","last_undegraded":"2024-04-26T12:26:54.253838+0000","last_fullsized":"2024-04-26T12:26:54.253838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:40.499263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253688+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:26:54.253688+0000","last_peered":"2024-04-26T12:26:54.253688+0000","last_clean":"2024-04-26T12:26:54.253688+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:26:54.253688+0000","last_undegraded":"2024-04-26T12:26:54.253688+0000","last_fullsized":"2024-04-26T12:26:54.253688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253924+0000","last_change":"2024-04-26T12:26:52.839211+0000","last_active":"2024-04-26T12:26:54.253924+0000","last_peered":"2024-04-26T12:26:54.253924+0000","last_clean":"2024-04-26T12:26:54.253924+0000","last_became_active":"2024-04-26T12:26:52.838988+0000","last_became_peered":"2024-04-26T12:26:52.838988+0000","last_unstale":"2024-04-26T12:26:54.253924+0000","last_undegraded":"2024-04-26T12:26:54.253924+0000","last_fullsized":"2024-04-26T12:26:54.253924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:04.569832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252653+0000","last_change":"2024-04-26T12:26:53.260098+0000","last_active":"2024-04-26T12:26:54.252653+0000","last_peered":"2024-04-26T12:26:54.252653+0000","last_clean":"2024-04-26T12:26:54.252653+0000","last_became_active":"2024-04-26T12:26:53.259188+0000","last_became_peered":"2024-04-26T12:26:53.259188+0000","last_unstale":"2024-04-26T12:26:54.252653+0000","last_undegraded":"2024-04-26T12:26:54.252653+0000","last_fullsized":"2024-04-26T12:26:54.252653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:34.496560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.248033+0000","last_change":"2024-04-26T12:26:47.810338+0000","last_active":"2024-04-26T12:26:53.248033+0000","last_peered":"2024-04-26T12:26:53.248033+0000","last_clean":"2024-04-26T12:26:53.248033+0000","last_became_active":"2024-04-26T12:26:47.810127+0000","last_became_peered":"2024-04-26T12:26:47.810127+0000","last_unstale":"2024-04-26T12:26:53.248033+0000","last_undegraded":"2024-04-26T12:26:53.248033+0000","last_fullsized":"2024-04-26T12:26:53.248033+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:11.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253912+0000","last_change":"2024-04-26T12:26:52.841192+0000","last_active":"2024-04-26T12:26:54.253912+0000","last_peered":"2024-04-26T12:26:54.253912+0000","last_clean":"2024-04-26T12:26:54.253912+0000","last_became_active":"2024-04-26T12:26:52.840137+0000","last_became_peered":"2024-04-26T12:26:52.840137+0000","last_unstale":"2024-04-26T12:26:54.253912+0000","last_undegraded":"2024-04-26T12:26:54.253912+0000","last_fullsized":"2024-04-26T12:26:54.253912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:20.488738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254278+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:26:54.254278+0000","last_peered":"2024-04-26T12:26:54.254278+0000","last_clean":"2024-04-26T12:26:54.254278+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:26:54.254278+0000","last_undegraded":"2024-04-26T12:26:54.254278+0000","last_fullsized":"2024-04-26T12:26:54.254278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.257442+0000","last_change":"2024-04-26T12:26:47.811997+0000","last_active":"2024-04-26T12:26:53.257442+0000","last_peered":"2024-04-26T12:26:53.257442+0000","last_clean":"2024-04-26T12:26:53.257442+0000","last_became_active":"2024-04-26T12:26:47.811819+0000","last_became_peered":"2024-04-26T12:26:47.811819+0000","last_unstale":"2024-04-26T12:26:53.257442+0000","last_undegraded":"2024-04-26T12:26:53.257442+0000","last_fullsized":"2024-04-26T12:26:53.257442+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:11.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253332+0000","last_change":"2024-04-26T12:26:52.841195+0000","last_active":"2024-04-26T12:26:54.253332+0000","last_peered":"2024-04-26T12:26:54.253332+0000","last_clean":"2024-04-26T12:26:54.253332+0000","last_became_active":"2024-04-26T12:26:52.839558+0000","last_became_peered":"2024-04-26T12:26:52.839558+0000","last_unstale":"2024-04-26T12:26:54.253332+0000","last_undegraded":"2024-04-26T12:26:54.253332+0000","last_fullsized":"2024-04-26T12:26:54.253332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:54.208845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252177+0000","last_change":"2024-04-26T12:26:53.259270+0000","last_active":"2024-04-26T12:26:54.252177+0000","last_peered":"2024-04-26T12:26:54.252177+0000","last_clean":"2024-04-26T12:26:54.252177+0000","last_became_active":"2024-04-26T12:26:53.258588+0000","last_became_peered":"2024-04-26T12:26:53.258588+0000","last_unstale":"2024-04-26T12:26:54.252177+0000","last_undegraded":"2024-04-26T12:26:54.252177+0000","last_fullsized":"2024-04-26T12:26:54.252177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:09.233018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.247515+0000","last_change":"2024-04-26T12:26:47.811787+0000","last_active":"2024-04-26T12:26:53.247515+0000","last_peered":"2024-04-26T12:26:53.247515+0000","last_clean":"2024-04-26T12:26:53.247515+0000","last_became_active":"2024-04-26T12:26:47.811512+0000","last_became_peered":"2024-04-26T12:26:47.811512+0000","last_unstale":"2024-04-26T12:26:53.247515+0000","last_undegraded":"2024-04-26T12:26:53.247515+0000","last_fullsized":"2024-04-26T12:26:53.247515+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:56.379533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253871+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:26:54.253871+0000","last_peered":"2024-04-26T12:26:54.253871+0000","last_clean":"2024-04-26T12:26:54.253871+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:26:54.253871+0000","last_undegraded":"2024-04-26T12:26:54.253871+0000","last_fullsized":"2024-04-26T12:26:54.253871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252748+0000","last_change":"2024-04-26T12:26:53.260244+0000","last_active":"2024-04-26T12:26:54.252748+0000","last_peered":"2024-04-26T12:26:54.252748+0000","last_clean":"2024-04-26T12:26:54.252748+0000","last_became_active":"2024-04-26T12:26:53.259917+0000","last_became_peered":"2024-04-26T12:26:53.259917+0000","last_unstale":"2024-04-26T12:26:54.252748+0000","last_undegraded":"2024-04-26T12:26:54.252748+0000","last_fullsized":"2024-04-26T12:26:54.252748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258160+0000","last_change":"2024-04-26T12:26:47.812045+0000","last_active":"2024-04-26T12:26:53.258160+0000","last_peered":"2024-04-26T12:26:53.258160+0000","last_clean":"2024-04-26T12:26:53.258160+0000","last_became_active":"2024-04-26T12:26:47.811787+0000","last_became_peered":"2024-04-26T12:26:47.811787+0000","last_unstale":"2024-04-26T12:26:53.258160+0000","last_undegraded":"2024-04-26T12:26:53.258160+0000","last_fullsized":"2024-04-26T12:26:53.258160+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:30.757169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":211,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258235+0000","last_change":"2024-04-26T12:26:46.810189+0000","last_active":"2024-04-26T12:26:53.258235+0000","last_peered":"2024-04-26T12:26:53.258235+0000","last_clean":"2024-04-26T12:26:53.258235+0000","last_became_active":"2024-04-26T12:26:46.809453+0000","last_became_peered":"2024-04-26T12:26:46.809453+0000","last_unstale":"2024-04-26T12:26:53.258235+0000","last_undegraded":"2024-04-26T12:26:53.258235+0000","last_fullsized":"2024-04-26T12:26:53.258235+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:18.618650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251680+0000","last_change":"2024-04-26T12:26:52.833869+0000","last_active":"2024-04-26T12:26:54.251680+0000","last_peered":"2024-04-26T12:26:54.251680+0000","last_clean":"2024-04-26T12:26:54.251680+0000","last_became_active":"2024-04-26T12:26:52.833257+0000","last_became_peered":"2024-04-26T12:26:52.833257+0000","last_unstale":"2024-04-26T12:26:54.251680+0000","last_undegraded":"2024-04-26T12:26:54.251680+0000","last_fullsized":"2024-04-26T12:26:54.251680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253947+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:26:54.253947+0000","last_peered":"2024-04-26T12:26:54.253947+0000","last_clean":"2024-04-26T12:26:54.253947+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:26:54.253947+0000","last_undegraded":"2024-04-26T12:26:54.253947+0000","last_fullsized":"2024-04-26T12:26:54.253947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258561+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:26:53.258561+0000","last_peered":"2024-04-26T12:26:53.258561+0000","last_clean":"2024-04-26T12:26:53.258561+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:26:53.258561+0000","last_undegraded":"2024-04-26T12:26:53.258561+0000","last_fullsized":"2024-04-26T12:26:53.258561+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251513+0000","last_change":"2024-04-26T12:26:52.836395+0000","last_active":"2024-04-26T12:26:54.251513+0000","last_peered":"2024-04-26T12:26:54.251513+0000","last_clean":"2024-04-26T12:26:54.251513+0000","last_became_active":"2024-04-26T12:26:52.836023+0000","last_became_peered":"2024-04-26T12:26:52.836023+0000","last_unstale":"2024-04-26T12:26:54.251513+0000","last_undegraded":"2024-04-26T12:26:54.251513+0000","last_fullsized":"2024-04-26T12:26:54.251513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:54.208845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254838+0000","last_change":"2024-04-26T12:26:53.260768+0000","last_active":"2024-04-26T12:26:54.254838+0000","last_peered":"2024-04-26T12:26:54.254838+0000","last_clean":"2024-04-26T12:26:54.254838+0000","last_became_active":"2024-04-26T12:26:53.259807+0000","last_became_peered":"2024-04-26T12:26:53.259807+0000","last_unstale":"2024-04-26T12:26:54.254838+0000","last_undegraded":"2024-04-26T12:26:54.254838+0000","last_fullsized":"2024-04-26T12:26:54.254838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.250666+0000","last_change":"2024-04-26T12:26:47.812595+0000","last_active":"2024-04-26T12:26:53.250666+0000","last_peered":"2024-04-26T12:26:53.250666+0000","last_clean":"2024-04-26T12:26:53.250666+0000","last_became_active":"2024-04-26T12:26:47.812366+0000","last_became_peered":"2024-04-26T12:26:47.812366+0000","last_unstale":"2024-04-26T12:26:53.250666+0000","last_undegraded":"2024-04-26T12:26:53.250666+0000","last_fullsized":"2024-04-26T12:26:53.250666+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:57.920665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252434+0000","last_change":"2024-04-26T12:26:52.833996+0000","last_active":"2024-04-26T12:26:54.252434+0000","last_peered":"2024-04-26T12:26:54.252434+0000","last_clean":"2024-04-26T12:26:54.252434+0000","last_became_active":"2024-04-26T12:26:52.833452+0000","last_became_peered":"2024-04-26T12:26:52.833452+0000","last_unstale":"2024-04-26T12:26:54.252434+0000","last_undegraded":"2024-04-26T12:26:54.252434+0000","last_fullsized":"2024-04-26T12:26:54.252434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254460+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:26:54.254460+0000","last_peered":"2024-04-26T12:26:54.254460+0000","last_clean":"2024-04-26T12:26:54.254460+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:26:54.254460+0000","last_undegraded":"2024-04-26T12:26:54.254460+0000","last_fullsized":"2024-04-26T12:26:54.254460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252570+0000","last_change":"2024-04-26T12:26:52.837167+0000","last_active":"2024-04-26T12:26:54.252570+0000","last_peered":"2024-04-26T12:26:54.252570+0000","last_clean":"2024-04-26T12:26:54.252570+0000","last_became_active":"2024-04-26T12:26:52.836534+0000","last_became_peered":"2024-04-26T12:26:52.836534+0000","last_unstale":"2024-04-26T12:26:54.252570+0000","last_undegraded":"2024-04-26T12:26:54.252570+0000","last_fullsized":"2024-04-26T12:26:54.252570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:17.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.248427+0000","last_change":"2024-04-26T12:26:47.811807+0000","last_active":"2024-04-26T12:26:53.248427+0000","last_peered":"2024-04-26T12:26:53.248427+0000","last_clean":"2024-04-26T12:26:53.248427+0000","last_became_active":"2024-04-26T12:26:47.811527+0000","last_became_peered":"2024-04-26T12:26:47.811527+0000","last_unstale":"2024-04-26T12:26:53.248427+0000","last_undegraded":"2024-04-26T12:26:53.248427+0000","last_fullsized":"2024-04-26T12:26:53.248427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:02.127354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251466+0000","last_change":"2024-04-26T12:26:53.265773+0000","last_active":"2024-04-26T12:26:54.251466+0000","last_peered":"2024-04-26T12:26:54.251466+0000","last_clean":"2024-04-26T12:26:54.251466+0000","last_became_active":"2024-04-26T12:26:53.265567+0000","last_became_peered":"2024-04-26T12:26:53.265567+0000","last_unstale":"2024-04-26T12:26:54.251466+0000","last_undegraded":"2024-04-26T12:26:54.251466+0000","last_fullsized":"2024-04-26T12:26:54.251466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258624+0000","last_change":"2024-04-26T12:26:47.811204+0000","last_active":"2024-04-26T12:26:53.258624+0000","last_peered":"2024-04-26T12:26:53.258624+0000","last_clean":"2024-04-26T12:26:53.258624+0000","last_became_active":"2024-04-26T12:26:47.810997+0000","last_became_peered":"2024-04-26T12:26:47.810997+0000","last_unstale":"2024-04-26T12:26:53.258624+0000","last_undegraded":"2024-04-26T12:26:53.258624+0000","last_fullsized":"2024-04-26T12:26:53.258624+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:24.967175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:55.294535+0000","last_change":"2024-04-26T12:26:52.837269+0000","last_active":"2024-04-26T12:26:55.294535+0000","last_peered":"2024-04-26T12:26:55.294535+0000","last_clean":"2024-04-26T12:26:55.294535+0000","last_became_active":"2024-04-26T12:26:52.836310+0000","last_became_peered":"2024-04-26T12:26:52.836310+0000","last_unstale":"2024-04-26T12:26:55.294535+0000","last_undegraded":"2024-04-26T12:26:55.294535+0000","last_fullsized":"2024-04-26T12:26:55.294535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:20.488738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254362+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:26:54.254362+0000","last_peered":"2024-04-26T12:26:54.254362+0000","last_clean":"2024-04-26T12:26:54.254362+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:26:54.254362+0000","last_undegraded":"2024-04-26T12:26:54.254362+0000","last_fullsized":"2024-04-26T12:26:54.254362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254162+0000","last_change":"2024-04-26T12:26:52.840797+0000","last_active":"2024-04-26T12:26:54.254162+0000","last_peered":"2024-04-26T12:26:54.254162+0000","last_clean":"2024-04-26T12:26:54.254162+0000","last_became_active":"2024-04-26T12:26:52.840409+0000","last_became_peered":"2024-04-26T12:26:52.840409+0000","last_unstale":"2024-04-26T12:26:54.254162+0000","last_undegraded":"2024-04-26T12:26:54.254162+0000","last_fullsized":"2024-04-26T12:26:54.254162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:57.898978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254682+0000","last_change":"2024-04-26T12:26:53.255044+0000","last_active":"2024-04-26T12:26:54.254682+0000","last_peered":"2024-04-26T12:26:54.254682+0000","last_clean":"2024-04-26T12:26:54.254682+0000","last_became_active":"2024-04-26T12:26:53.254164+0000","last_became_peered":"2024-04-26T12:26:53.254164+0000","last_unstale":"2024-04-26T12:26:54.254682+0000","last_undegraded":"2024-04-26T12:26:54.254682+0000","last_fullsized":"2024-04-26T12:26:54.254682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:07.899699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253335+0000","last_change":"2024-04-26T12:26:52.841338+0000","last_active":"2024-04-26T12:26:54.253335+0000","last_peered":"2024-04-26T12:26:54.253335+0000","last_clean":"2024-04-26T12:26:54.253335+0000","last_became_active":"2024-04-26T12:26:52.840770+0000","last_became_peered":"2024-04-26T12:26:52.840770+0000","last_unstale":"2024-04-26T12:26:54.253335+0000","last_undegraded":"2024-04-26T12:26:54.253335+0000","last_fullsized":"2024-04-26T12:26:54.253335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:33.466992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253384+0000","last_change":"2024-04-26T12:26:53.260953+0000","last_active":"2024-04-26T12:26:54.253384+0000","last_peered":"2024-04-26T12:26:54.253384+0000","last_clean":"2024-04-26T12:26:54.253384+0000","last_became_active":"2024-04-26T12:26:53.259228+0000","last_became_peered":"2024-04-26T12:26:53.259228+0000","last_unstale":"2024-04-26T12:26:54.253384+0000","last_undegraded":"2024-04-26T12:26:54.253384+0000","last_fullsized":"2024-04-26T12:26:54.253384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254744+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:26:54.254744+0000","last_peered":"2024-04-26T12:26:54.254744+0000","last_clean":"2024-04-26T12:26:54.254744+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:26:54.254744+0000","last_undegraded":"2024-04-26T12:26:54.254744+0000","last_fullsized":"2024-04-26T12:26:54.254744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253334+0000","last_change":"2024-04-26T12:26:53.262221+0000","last_active":"2024-04-26T12:26:54.253334+0000","last_peered":"2024-04-26T12:26:54.253334+0000","last_clean":"2024-04-26T12:26:54.253334+0000","last_became_active":"2024-04-26T12:26:53.261112+0000","last_became_peered":"2024-04-26T12:26:53.261112+0000","last_unstale":"2024-04-26T12:26:54.253334+0000","last_undegraded":"2024-04-26T12:26:54.253334+0000","last_fullsized":"2024-04-26T12:26:54.253334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252558+0000","last_change":"2024-04-26T12:26:52.837399+0000","last_active":"2024-04-26T12:26:54.252558+0000","last_peered":"2024-04-26T12:26:54.252558+0000","last_clean":"2024-04-26T12:26:54.252558+0000","last_became_active":"2024-04-26T12:26:52.835974+0000","last_became_peered":"2024-04-26T12:26:52.835974+0000","last_unstale":"2024-04-26T12:26:54.252558+0000","last_undegraded":"2024-04-26T12:26:54.252558+0000","last_fullsized":"2024-04-26T12:26:54.252558+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:03.469888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254323+0000","last_change":"2024-04-26T12:26:53.254495+0000","last_active":"2024-04-26T12:26:54.254323+0000","last_peered":"2024-04-26T12:26:54.254323+0000","last_clean":"2024-04-26T12:26:54.254323+0000","last_became_active":"2024-04-26T12:26:53.254149+0000","last_became_peered":"2024-04-26T12:26:53.254149+0000","last_unstale":"2024-04-26T12:26:54.254323+0000","last_undegraded":"2024-04-26T12:26:54.254323+0000","last_fullsized":"2024-04-26T12:26:54.254323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:37.907024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252663+0000","last_change":"2024-04-26T12:26:52.836279+0000","last_active":"2024-04-26T12:26:54.252663+0000","last_peered":"2024-04-26T12:26:54.252663+0000","last_clean":"2024-04-26T12:26:54.252663+0000","last_became_active":"2024-04-26T12:26:52.835916+0000","last_became_peered":"2024-04-26T12:26:52.835916+0000","last_unstale":"2024-04-26T12:26:54.252663+0000","last_undegraded":"2024-04-26T12:26:54.252663+0000","last_fullsized":"2024-04-26T12:26:54.252663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:33.466992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253090+0000","last_change":"2024-04-26T12:26:53.259112+0000","last_active":"2024-04-26T12:26:54.253090+0000","last_peered":"2024-04-26T12:26:54.253090+0000","last_clean":"2024-04-26T12:26:54.253090+0000","last_became_active":"2024-04-26T12:26:53.256762+0000","last_became_peered":"2024-04-26T12:26:53.256762+0000","last_unstale":"2024-04-26T12:26:54.253090+0000","last_undegraded":"2024-04-26T12:26:54.253090+0000","last_fullsized":"2024-04-26T12:26:54.253090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252967+0000","last_change":"2024-04-26T12:26:53.263131+0000","last_active":"2024-04-26T12:26:54.252967+0000","last_peered":"2024-04-26T12:26:54.252967+0000","last_clean":"2024-04-26T12:26:54.252967+0000","last_became_active":"2024-04-26T12:26:53.260489+0000","last_became_peered":"2024-04-26T12:26:53.260489+0000","last_unstale":"2024-04-26T12:26:54.252967+0000","last_undegraded":"2024-04-26T12:26:54.252967+0000","last_fullsized":"2024-04-26T12:26:54.252967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251606+0000","last_change":"2024-04-26T12:26:53.259832+0000","last_active":"2024-04-26T12:26:54.251606+0000","last_peered":"2024-04-26T12:26:54.251606+0000","last_clean":"2024-04-26T12:26:54.251606+0000","last_became_active":"2024-04-26T12:26:53.259028+0000","last_became_peered":"2024-04-26T12:26:53.259028+0000","last_unstale":"2024-04-26T12:26:54.251606+0000","last_undegraded":"2024-04-26T12:26:54.251606+0000","last_fullsized":"2024-04-26T12:26:54.251606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254286+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:26:54.254286+0000","last_peered":"2024-04-26T12:26:54.254286+0000","last_clean":"2024-04-26T12:26:54.254286+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:26:54.254286+0000","last_undegraded":"2024-04-26T12:26:54.254286+0000","last_fullsized":"2024-04-26T12:26:54.254286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252363+0000","last_change":"2024-04-26T12:26:53.259057+0000","last_active":"2024-04-26T12:26:54.252363+0000","last_peered":"2024-04-26T12:26:54.252363+0000","last_clean":"2024-04-26T12:26:54.252363+0000","last_became_active":"2024-04-26T12:26:53.257816+0000","last_became_peered":"2024-04-26T12:26:53.257816+0000","last_unstale":"2024-04-26T12:26:54.252363+0000","last_undegraded":"2024-04-26T12:26:54.252363+0000","last_fullsized":"2024-04-26T12:26:54.252363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:53.950315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254747+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:26:54.254747+0000","last_peered":"2024-04-26T12:26:54.254747+0000","last_clean":"2024-04-26T12:26:54.254747+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:26:54.254747+0000","last_undegraded":"2024-04-26T12:26:54.254747+0000","last_fullsized":"2024-04-26T12:26:54.254747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":641176,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":641792,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":147456,"data_stored":49678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:27:09.941 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:27:10.322 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:27:10.323 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:27:10.333 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T12:27:09.292423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81664,"kb_used_data":600,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033856,"statfs":{"total":289910292480,"available":289826668544,"internally_reserved":0,"allocated":614400,"data_stored":1332646,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002623"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.255057+0000","last_change":"2024-04-26T12:26:53.255588+0000","last_active":"2024-04-26T12:26:54.255057+0000","last_peered":"2024-04-26T12:26:54.255057+0000","last_clean":"2024-04-26T12:26:54.255057+0000","last_became_active":"2024-04-26T12:26:53.255201+0000","last_became_peered":"2024-04-26T12:26:53.255201+0000","last_unstale":"2024-04-26T12:26:54.255057+0000","last_undegraded":"2024-04-26T12:26:54.255057+0000","last_fullsized":"2024-04-26T12:26:54.255057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:09.233018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254502+0000","last_change":"2024-04-26T12:26:53.256136+0000","last_active":"2024-04-26T12:26:54.254502+0000","last_peered":"2024-04-26T12:26:54.254502+0000","last_clean":"2024-04-26T12:26:54.254502+0000","last_became_active":"2024-04-26T12:26:53.255297+0000","last_became_peered":"2024-04-26T12:26:53.255297+0000","last_unstale":"2024-04-26T12:26:54.254502+0000","last_undegraded":"2024-04-26T12:26:54.254502+0000","last_fullsized":"2024-04-26T12:26:54.254502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253859+0000","last_change":"2024-04-26T12:26:53.265584+0000","last_active":"2024-04-26T12:26:54.253859+0000","last_peered":"2024-04-26T12:26:54.253859+0000","last_clean":"2024-04-26T12:26:54.253859+0000","last_became_active":"2024-04-26T12:26:53.264555+0000","last_became_peered":"2024-04-26T12:26:53.264555+0000","last_unstale":"2024-04-26T12:26:54.253859+0000","last_undegraded":"2024-04-26T12:26:54.253859+0000","last_fullsized":"2024-04-26T12:26:54.253859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:20:03.207903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253538+0000","last_change":"2024-04-26T12:26:53.263004+0000","last_active":"2024-04-26T12:26:54.253538+0000","last_peered":"2024-04-26T12:26:54.253538+0000","last_clean":"2024-04-26T12:26:54.253538+0000","last_became_active":"2024-04-26T12:26:53.261193+0000","last_became_peered":"2024-04-26T12:26:53.261193+0000","last_unstale":"2024-04-26T12:26:54.253538+0000","last_undegraded":"2024-04-26T12:26:54.253538+0000","last_fullsized":"2024-04-26T12:26:54.253538+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254277+0000","last_change":"2024-04-26T12:26:53.255483+0000","last_active":"2024-04-26T12:26:54.254277+0000","last_peered":"2024-04-26T12:26:54.254277+0000","last_clean":"2024-04-26T12:26:54.254277+0000","last_became_active":"2024-04-26T12:26:53.255001+0000","last_became_peered":"2024-04-26T12:26:53.255001+0000","last_unstale":"2024-04-26T12:26:54.254277+0000","last_undegraded":"2024-04-26T12:26:54.254277+0000","last_fullsized":"2024-04-26T12:26:54.254277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:34.496560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252949+0000","last_change":"2024-04-26T12:26:53.264139+0000","last_active":"2024-04-26T12:26:54.252949+0000","last_peered":"2024-04-26T12:26:54.252949+0000","last_clean":"2024-04-26T12:26:54.252949+0000","last_became_active":"2024-04-26T12:26:53.262002+0000","last_became_peered":"2024-04-26T12:26:53.262002+0000","last_unstale":"2024-04-26T12:26:54.252949+0000","last_undegraded":"2024-04-26T12:26:54.252949+0000","last_fullsized":"2024-04-26T12:26:54.252949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253027+0000","last_change":"2024-04-26T12:26:53.262987+0000","last_active":"2024-04-26T12:26:54.253027+0000","last_peered":"2024-04-26T12:26:54.253027+0000","last_clean":"2024-04-26T12:26:54.253027+0000","last_became_active":"2024-04-26T12:26:53.262113+0000","last_became_peered":"2024-04-26T12:26:53.262113+0000","last_unstale":"2024-04-26T12:26:54.253027+0000","last_undegraded":"2024-04-26T12:26:54.253027+0000","last_fullsized":"2024-04-26T12:26:54.253027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252720+0000","last_change":"2024-04-26T12:26:53.264092+0000","last_active":"2024-04-26T12:26:54.252720+0000","last_peered":"2024-04-26T12:26:54.252720+0000","last_clean":"2024-04-26T12:26:54.252720+0000","last_became_active":"2024-04-26T12:26:53.260501+0000","last_became_peered":"2024-04-26T12:26:53.260501+0000","last_unstale":"2024-04-26T12:26:54.252720+0000","last_undegraded":"2024-04-26T12:26:54.252720+0000","last_fullsized":"2024-04-26T12:26:54.252720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252461+0000","last_change":"2024-04-26T12:26:53.259692+0000","last_active":"2024-04-26T12:26:54.252461+0000","last_peered":"2024-04-26T12:26:54.252461+0000","last_clean":"2024-04-26T12:26:54.252461+0000","last_became_active":"2024-04-26T12:26:53.258709+0000","last_became_peered":"2024-04-26T12:26:53.258709+0000","last_unstale":"2024-04-26T12:26:54.252461+0000","last_undegraded":"2024-04-26T12:26:54.252461+0000","last_fullsized":"2024-04-26T12:26:54.252461+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254822+0000","last_change":"2024-04-26T12:26:53.256190+0000","last_active":"2024-04-26T12:26:54.254822+0000","last_peered":"2024-04-26T12:26:54.254822+0000","last_clean":"2024-04-26T12:26:54.254822+0000","last_became_active":"2024-04-26T12:26:53.255382+0000","last_became_peered":"2024-04-26T12:26:53.255382+0000","last_unstale":"2024-04-26T12:26:54.254822+0000","last_undegraded":"2024-04-26T12:26:54.254822+0000","last_fullsized":"2024-04-26T12:26:54.254822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:53.950315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253701+0000","last_change":"2024-04-26T12:26:53.262951+0000","last_active":"2024-04-26T12:26:54.253701+0000","last_peered":"2024-04-26T12:26:54.253701+0000","last_clean":"2024-04-26T12:26:54.253701+0000","last_became_active":"2024-04-26T12:26:53.261842+0000","last_became_peered":"2024-04-26T12:26:53.261842+0000","last_unstale":"2024-04-26T12:26:54.253701+0000","last_undegraded":"2024-04-26T12:26:54.253701+0000","last_fullsized":"2024-04-26T12:26:54.253701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:35.327049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254183+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:26:54.254183+0000","last_peered":"2024-04-26T12:26:54.254183+0000","last_clean":"2024-04-26T12:26:54.254183+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:26:54.254183+0000","last_undegraded":"2024-04-26T12:26:54.254183+0000","last_fullsized":"2024-04-26T12:26:54.254183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254377+0000","last_change":"2024-04-26T12:26:53.254930+0000","last_active":"2024-04-26T12:26:54.254377+0000","last_peered":"2024-04-26T12:26:54.254377+0000","last_clean":"2024-04-26T12:26:54.254377+0000","last_became_active":"2024-04-26T12:26:53.253988+0000","last_became_peered":"2024-04-26T12:26:53.253988+0000","last_unstale":"2024-04-26T12:26:54.254377+0000","last_undegraded":"2024-04-26T12:26:54.254377+0000","last_fullsized":"2024-04-26T12:26:54.254377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253678+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:26:54.253678+0000","last_peered":"2024-04-26T12:26:54.253678+0000","last_clean":"2024-04-26T12:26:54.253678+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:26:54.253678+0000","last_undegraded":"2024-04-26T12:26:54.253678+0000","last_fullsized":"2024-04-26T12:26:54.253678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252782+0000","last_change":"2024-04-26T12:26:53.266568+0000","last_active":"2024-04-26T12:26:54.252782+0000","last_peered":"2024-04-26T12:26:54.252782+0000","last_clean":"2024-04-26T12:26:54.252782+0000","last_became_active":"2024-04-26T12:26:53.265846+0000","last_became_peered":"2024-04-26T12:26:53.265846+0000","last_unstale":"2024-04-26T12:26:54.252782+0000","last_undegraded":"2024-04-26T12:26:54.252782+0000","last_fullsized":"2024-04-26T12:26:54.252782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:10.849502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252784+0000","last_change":"2024-04-26T12:26:53.265459+0000","last_active":"2024-04-26T12:26:54.252784+0000","last_peered":"2024-04-26T12:26:54.252784+0000","last_clean":"2024-04-26T12:26:54.252784+0000","last_became_active":"2024-04-26T12:26:53.262898+0000","last_became_peered":"2024-04-26T12:26:53.262898+0000","last_unstale":"2024-04-26T12:26:54.252784+0000","last_undegraded":"2024-04-26T12:26:54.252784+0000","last_fullsized":"2024-04-26T12:26:54.252784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252546+0000","last_change":"2024-04-26T12:26:53.259864+0000","last_active":"2024-04-26T12:26:54.252546+0000","last_peered":"2024-04-26T12:26:54.252546+0000","last_clean":"2024-04-26T12:26:54.252546+0000","last_became_active":"2024-04-26T12:26:53.259025+0000","last_became_peered":"2024-04-26T12:26:53.259025+0000","last_unstale":"2024-04-26T12:26:54.252546+0000","last_undegraded":"2024-04-26T12:26:54.252546+0000","last_fullsized":"2024-04-26T12:26:54.252546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254951+0000","last_change":"2024-04-26T12:26:53.261186+0000","last_active":"2024-04-26T12:26:54.254951+0000","last_peered":"2024-04-26T12:26:54.254951+0000","last_clean":"2024-04-26T12:26:54.254951+0000","last_became_active":"2024-04-26T12:26:53.260820+0000","last_became_peered":"2024-04-26T12:26:53.260820+0000","last_unstale":"2024-04-26T12:26:54.254951+0000","last_undegraded":"2024-04-26T12:26:54.254951+0000","last_fullsized":"2024-04-26T12:26:54.254951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:00.602708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252225+0000","last_change":"2024-04-26T12:26:53.259728+0000","last_active":"2024-04-26T12:26:54.252225+0000","last_peered":"2024-04-26T12:26:54.252225+0000","last_clean":"2024-04-26T12:26:54.252225+0000","last_became_active":"2024-04-26T12:26:53.258952+0000","last_became_peered":"2024-04-26T12:26:53.258952+0000","last_unstale":"2024-04-26T12:26:54.252225+0000","last_undegraded":"2024-04-26T12:26:54.252225+0000","last_fullsized":"2024-04-26T12:26:54.252225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253512+0000","last_change":"2024-04-26T12:26:53.257321+0000","last_active":"2024-04-26T12:26:54.253512+0000","last_peered":"2024-04-26T12:26:54.253512+0000","last_clean":"2024-04-26T12:26:54.253512+0000","last_became_active":"2024-04-26T12:26:53.256192+0000","last_became_peered":"2024-04-26T12:26:53.256192+0000","last_unstale":"2024-04-26T12:26:54.253512+0000","last_undegraded":"2024-04-26T12:26:54.253512+0000","last_fullsized":"2024-04-26T12:26:54.253512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253202+0000","last_change":"2024-04-26T12:26:53.261669+0000","last_active":"2024-04-26T12:26:54.253202+0000","last_peered":"2024-04-26T12:26:54.253202+0000","last_clean":"2024-04-26T12:26:54.253202+0000","last_became_active":"2024-04-26T12:26:53.259854+0000","last_became_peered":"2024-04-26T12:26:53.259854+0000","last_unstale":"2024-04-26T12:26:54.253202+0000","last_undegraded":"2024-04-26T12:26:54.253202+0000","last_fullsized":"2024-04-26T12:26:54.253202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254141+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:26:54.254141+0000","last_peered":"2024-04-26T12:26:54.254141+0000","last_clean":"2024-04-26T12:26:54.254141+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:26:54.254141+0000","last_undegraded":"2024-04-26T12:26:54.254141+0000","last_fullsized":"2024-04-26T12:26:54.254141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251798+0000","last_change":"2024-04-26T12:26:53.262898+0000","last_active":"2024-04-26T12:26:54.251798+0000","last_peered":"2024-04-26T12:26:54.251798+0000","last_clean":"2024-04-26T12:26:54.251798+0000","last_became_active":"2024-04-26T12:26:53.262603+0000","last_became_peered":"2024-04-26T12:26:53.262603+0000","last_unstale":"2024-04-26T12:26:54.251798+0000","last_undegraded":"2024-04-26T12:26:54.251798+0000","last_fullsized":"2024-04-26T12:26:54.251798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254215+0000","last_change":"2024-04-26T12:26:53.254395+0000","last_active":"2024-04-26T12:26:54.254215+0000","last_peered":"2024-04-26T12:26:54.254215+0000","last_clean":"2024-04-26T12:26:54.254215+0000","last_became_active":"2024-04-26T12:26:53.253946+0000","last_became_peered":"2024-04-26T12:26:53.253946+0000","last_unstale":"2024-04-26T12:26:54.254215+0000","last_undegraded":"2024-04-26T12:26:54.254215+0000","last_fullsized":"2024-04-26T12:26:54.254215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:41.501818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254992+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:26:54.254992+0000","last_peered":"2024-04-26T12:26:54.254992+0000","last_clean":"2024-04-26T12:26:54.254992+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:26:54.254992+0000","last_undegraded":"2024-04-26T12:26:54.254992+0000","last_fullsized":"2024-04-26T12:26:54.254992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252630+0000","last_change":"2024-04-26T12:26:53.261876+0000","last_active":"2024-04-26T12:26:54.252630+0000","last_peered":"2024-04-26T12:26:54.252630+0000","last_clean":"2024-04-26T12:26:54.252630+0000","last_became_active":"2024-04-26T12:26:53.261485+0000","last_became_peered":"2024-04-26T12:26:53.261485+0000","last_unstale":"2024-04-26T12:26:54.252630+0000","last_undegraded":"2024-04-26T12:26:54.252630+0000","last_fullsized":"2024-04-26T12:26:54.252630+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253751+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:26:54.253751+0000","last_peered":"2024-04-26T12:26:54.253751+0000","last_clean":"2024-04-26T12:26:54.253751+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:26:54.253751+0000","last_undegraded":"2024-04-26T12:26:54.253751+0000","last_fullsized":"2024-04-26T12:26:54.253751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254119+0000","last_change":"2024-04-26T12:26:52.839543+0000","last_active":"2024-04-26T12:26:54.254119+0000","last_peered":"2024-04-26T12:26:54.254119+0000","last_clean":"2024-04-26T12:26:54.254119+0000","last_became_active":"2024-04-26T12:26:52.839080+0000","last_became_peered":"2024-04-26T12:26:52.839080+0000","last_unstale":"2024-04-26T12:26:54.254119+0000","last_undegraded":"2024-04-26T12:26:54.254119+0000","last_fullsized":"2024-04-26T12:26:54.254119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:18.329898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254904+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:26:54.254904+0000","last_peered":"2024-04-26T12:26:54.254904+0000","last_clean":"2024-04-26T12:26:54.254904+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:26:54.254904+0000","last_undegraded":"2024-04-26T12:26:54.254904+0000","last_fullsized":"2024-04-26T12:26:54.254904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251794+0000","last_change":"2024-04-26T12:26:52.838082+0000","last_active":"2024-04-26T12:26:54.251794+0000","last_peered":"2024-04-26T12:26:54.251794+0000","last_clean":"2024-04-26T12:26:54.251794+0000","last_became_active":"2024-04-26T12:26:52.837596+0000","last_became_peered":"2024-04-26T12:26:52.837596+0000","last_unstale":"2024-04-26T12:26:54.251794+0000","last_undegraded":"2024-04-26T12:26:54.251794+0000","last_fullsized":"2024-04-26T12:26:54.251794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:08.892977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252572+0000","last_change":"2024-04-26T12:26:53.262665+0000","last_active":"2024-04-26T12:26:54.252572+0000","last_peered":"2024-04-26T12:26:54.252572+0000","last_clean":"2024-04-26T12:26:54.252572+0000","last_became_active":"2024-04-26T12:26:53.262161+0000","last_became_peered":"2024-04-26T12:26:53.262161+0000","last_unstale":"2024-04-26T12:26:54.252572+0000","last_undegraded":"2024-04-26T12:26:54.252572+0000","last_fullsized":"2024-04-26T12:26:54.252572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251650+0000","last_change":"2024-04-26T12:26:52.833500+0000","last_active":"2024-04-26T12:26:54.251650+0000","last_peered":"2024-04-26T12:26:54.251650+0000","last_clean":"2024-04-26T12:26:54.251650+0000","last_became_active":"2024-04-26T12:26:52.833152+0000","last_became_peered":"2024-04-26T12:26:52.833152+0000","last_unstale":"2024-04-26T12:26:54.251650+0000","last_undegraded":"2024-04-26T12:26:54.251650+0000","last_fullsized":"2024-04-26T12:26:54.251650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:28.165579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.255028+0000","last_change":"2024-04-26T12:26:53.260764+0000","last_active":"2024-04-26T12:26:54.255028+0000","last_peered":"2024-04-26T12:26:54.255028+0000","last_clean":"2024-04-26T12:26:54.255028+0000","last_became_active":"2024-04-26T12:26:53.260388+0000","last_became_peered":"2024-04-26T12:26:53.260388+0000","last_unstale":"2024-04-26T12:26:54.255028+0000","last_undegraded":"2024-04-26T12:26:54.255028+0000","last_fullsized":"2024-04-26T12:26:54.255028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252735+0000","last_change":"2024-04-26T12:26:52.837792+0000","last_active":"2024-04-26T12:26:54.252735+0000","last_peered":"2024-04-26T12:26:54.252735+0000","last_clean":"2024-04-26T12:26:54.252735+0000","last_became_active":"2024-04-26T12:26:52.837272+0000","last_became_peered":"2024-04-26T12:26:52.837272+0000","last_unstale":"2024-04-26T12:26:54.252735+0000","last_undegraded":"2024-04-26T12:26:54.252735+0000","last_fullsized":"2024-04-26T12:26:54.252735+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:12.837493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251539+0000","last_change":"2024-04-26T12:26:53.255423+0000","last_active":"2024-04-26T12:26:54.251539+0000","last_peered":"2024-04-26T12:26:54.251539+0000","last_clean":"2024-04-26T12:26:54.251539+0000","last_became_active":"2024-04-26T12:26:53.253812+0000","last_became_peered":"2024-04-26T12:26:53.253812+0000","last_unstale":"2024-04-26T12:26:54.251539+0000","last_undegraded":"2024-04-26T12:26:54.251539+0000","last_fullsized":"2024-04-26T12:26:54.251539+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:37.907024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253542+0000","last_change":"2024-04-26T12:26:52.840163+0000","last_active":"2024-04-26T12:26:54.253542+0000","last_peered":"2024-04-26T12:26:54.253542+0000","last_clean":"2024-04-26T12:26:54.253542+0000","last_became_active":"2024-04-26T12:26:52.839246+0000","last_became_peered":"2024-04-26T12:26:52.839246+0000","last_unstale":"2024-04-26T12:26:54.253542+0000","last_undegraded":"2024-04-26T12:26:54.253542+0000","last_fullsized":"2024-04-26T12:26:54.253542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:44.809454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251997+0000","last_change":"2024-04-26T12:26:53.258963+0000","last_active":"2024-04-26T12:26:54.251997+0000","last_peered":"2024-04-26T12:26:54.251997+0000","last_clean":"2024-04-26T12:26:54.251997+0000","last_became_active":"2024-04-26T12:26:53.258171+0000","last_became_peered":"2024-04-26T12:26:53.258171+0000","last_unstale":"2024-04-26T12:26:54.251997+0000","last_undegraded":"2024-04-26T12:26:54.251997+0000","last_fullsized":"2024-04-26T12:26:54.251997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254770+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:26:54.254770+0000","last_peered":"2024-04-26T12:26:54.254770+0000","last_clean":"2024-04-26T12:26:54.254770+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:26:54.254770+0000","last_undegraded":"2024-04-26T12:26:54.254770+0000","last_fullsized":"2024-04-26T12:26:54.254770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251746+0000","last_change":"2024-04-26T12:26:53.259209+0000","last_active":"2024-04-26T12:26:54.251746+0000","last_peered":"2024-04-26T12:26:54.251746+0000","last_clean":"2024-04-26T12:26:54.251746+0000","last_became_active":"2024-04-26T12:26:53.258620+0000","last_became_peered":"2024-04-26T12:26:53.258620+0000","last_unstale":"2024-04-26T12:26:54.251746+0000","last_undegraded":"2024-04-26T12:26:54.251746+0000","last_fullsized":"2024-04-26T12:26:54.251746+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"15'6","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253386+0000","last_change":"2024-04-26T12:26:52.841280+0000","last_active":"2024-04-26T12:26:54.253386+0000","last_peered":"2024-04-26T12:26:54.253386+0000","last_clean":"2024-04-26T12:26:54.253386+0000","last_became_active":"2024-04-26T12:26:52.839398+0000","last_became_peered":"2024-04-26T12:26:52.839398+0000","last_unstale":"2024-04-26T12:26:54.253386+0000","last_undegraded":"2024-04-26T12:26:54.253386+0000","last_fullsized":"2024-04-26T12:26:54.253386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:53.889623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253612+0000","last_change":"2024-04-26T12:26:53.260830+0000","last_active":"2024-04-26T12:26:54.253612+0000","last_peered":"2024-04-26T12:26:54.253612+0000","last_clean":"2024-04-26T12:26:54.253612+0000","last_became_active":"2024-04-26T12:26:53.259452+0000","last_became_peered":"2024-04-26T12:26:53.259452+0000","last_unstale":"2024-04-26T12:26:54.253612+0000","last_undegraded":"2024-04-26T12:26:54.253612+0000","last_fullsized":"2024-04-26T12:26:54.253612+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253560+0000","last_change":"2024-04-26T12:26:52.840521+0000","last_active":"2024-04-26T12:26:54.253560+0000","last_peered":"2024-04-26T12:26:54.253560+0000","last_clean":"2024-04-26T12:26:54.253560+0000","last_became_active":"2024-04-26T12:26:52.839442+0000","last_became_peered":"2024-04-26T12:26:52.839442+0000","last_unstale":"2024-04-26T12:26:54.253560+0000","last_undegraded":"2024-04-26T12:26:54.253560+0000","last_fullsized":"2024-04-26T12:26:54.253560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:28.165579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254485+0000","last_change":"2024-04-26T12:26:53.254489+0000","last_active":"2024-04-26T12:26:54.254485+0000","last_peered":"2024-04-26T12:26:54.254485+0000","last_clean":"2024-04-26T12:26:54.254485+0000","last_became_active":"2024-04-26T12:26:53.254099+0000","last_became_peered":"2024-04-26T12:26:53.254099+0000","last_unstale":"2024-04-26T12:26:54.254485+0000","last_undegraded":"2024-04-26T12:26:54.254485+0000","last_fullsized":"2024-04-26T12:26:54.254485+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251939+0000","last_change":"2024-04-26T12:26:52.837857+0000","last_active":"2024-04-26T12:26:54.251939+0000","last_peered":"2024-04-26T12:26:54.251939+0000","last_clean":"2024-04-26T12:26:54.251939+0000","last_became_active":"2024-04-26T12:26:52.837402+0000","last_became_peered":"2024-04-26T12:26:52.837402+0000","last_unstale":"2024-04-26T12:26:54.251939+0000","last_undegraded":"2024-04-26T12:26:54.251939+0000","last_fullsized":"2024-04-26T12:26:54.251939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:53.889623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254865+0000","last_change":"2024-04-26T12:26:53.255659+0000","last_active":"2024-04-26T12:26:54.254865+0000","last_peered":"2024-04-26T12:26:54.254865+0000","last_clean":"2024-04-26T12:26:54.254865+0000","last_became_active":"2024-04-26T12:26:53.255253+0000","last_became_peered":"2024-04-26T12:26:53.255253+0000","last_unstale":"2024-04-26T12:26:54.254865+0000","last_undegraded":"2024-04-26T12:26:54.254865+0000","last_fullsized":"2024-04-26T12:26:54.254865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:06.236196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254021+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:26:54.254021+0000","last_peered":"2024-04-26T12:26:54.254021+0000","last_clean":"2024-04-26T12:26:54.254021+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:26:54.254021+0000","last_undegraded":"2024-04-26T12:26:54.254021+0000","last_fullsized":"2024-04-26T12:26:54.254021+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252460+0000","last_change":"2024-04-26T12:26:53.261880+0000","last_active":"2024-04-26T12:26:54.252460+0000","last_peered":"2024-04-26T12:26:54.252460+0000","last_clean":"2024-04-26T12:26:54.252460+0000","last_became_active":"2024-04-26T12:26:53.261373+0000","last_became_peered":"2024-04-26T12:26:53.261373+0000","last_unstale":"2024-04-26T12:26:54.252460+0000","last_undegraded":"2024-04-26T12:26:54.252460+0000","last_fullsized":"2024-04-26T12:26:54.252460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253014+0000","last_change":"2024-04-26T12:26:52.840810+0000","last_active":"2024-04-26T12:26:54.253014+0000","last_peered":"2024-04-26T12:26:54.253014+0000","last_clean":"2024-04-26T12:26:54.253014+0000","last_became_active":"2024-04-26T12:26:52.840059+0000","last_became_peered":"2024-04-26T12:26:52.840059+0000","last_unstale":"2024-04-26T12:26:54.253014+0000","last_undegraded":"2024-04-26T12:26:54.253014+0000","last_fullsized":"2024-04-26T12:26:54.253014+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:17.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252819+0000","last_change":"2024-04-26T12:26:53.265200+0000","last_active":"2024-04-26T12:26:54.252819+0000","last_peered":"2024-04-26T12:26:54.252819+0000","last_clean":"2024-04-26T12:26:54.252819+0000","last_became_active":"2024-04-26T12:26:53.264830+0000","last_became_peered":"2024-04-26T12:26:53.264830+0000","last_unstale":"2024-04-26T12:26:54.252819+0000","last_undegraded":"2024-04-26T12:26:54.252819+0000","last_fullsized":"2024-04-26T12:26:54.252819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253700+0000","last_change":"2024-04-26T12:26:52.840684+0000","last_active":"2024-04-26T12:26:54.253700+0000","last_peered":"2024-04-26T12:26:54.253700+0000","last_clean":"2024-04-26T12:26:54.253700+0000","last_became_active":"2024-04-26T12:26:52.839414+0000","last_became_peered":"2024-04-26T12:26:52.839414+0000","last_unstale":"2024-04-26T12:26:54.253700+0000","last_undegraded":"2024-04-26T12:26:54.253700+0000","last_fullsized":"2024-04-26T12:26:54.253700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:12.837493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253759+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:26:54.253759+0000","last_peered":"2024-04-26T12:26:54.253759+0000","last_clean":"2024-04-26T12:26:54.253759+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:26:54.253759+0000","last_undegraded":"2024-04-26T12:26:54.253759+0000","last_fullsized":"2024-04-26T12:26:54.253759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254691+0000","last_change":"2024-04-26T12:26:52.839692+0000","last_active":"2024-04-26T12:26:54.254691+0000","last_peered":"2024-04-26T12:26:54.254691+0000","last_clean":"2024-04-26T12:26:54.254691+0000","last_became_active":"2024-04-26T12:26:52.839419+0000","last_became_peered":"2024-04-26T12:26:52.839419+0000","last_unstale":"2024-04-26T12:26:54.254691+0000","last_undegraded":"2024-04-26T12:26:54.254691+0000","last_fullsized":"2024-04-26T12:26:54.254691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:25.416851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254179+0000","last_change":"2024-04-26T12:26:53.254395+0000","last_active":"2024-04-26T12:26:54.254179+0000","last_peered":"2024-04-26T12:26:54.254179+0000","last_clean":"2024-04-26T12:26:54.254179+0000","last_became_active":"2024-04-26T12:26:53.253926+0000","last_became_peered":"2024-04-26T12:26:53.253926+0000","last_unstale":"2024-04-26T12:26:54.254179+0000","last_undegraded":"2024-04-26T12:26:54.254179+0000","last_fullsized":"2024-04-26T12:26:54.254179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:59.517606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253817+0000","last_change":"2024-04-26T12:26:52.842023+0000","last_active":"2024-04-26T12:26:54.253817+0000","last_peered":"2024-04-26T12:26:54.253817+0000","last_clean":"2024-04-26T12:26:54.253817+0000","last_became_active":"2024-04-26T12:26:52.840857+0000","last_became_peered":"2024-04-26T12:26:52.840857+0000","last_unstale":"2024-04-26T12:26:54.253817+0000","last_undegraded":"2024-04-26T12:26:54.253817+0000","last_fullsized":"2024-04-26T12:26:54.253817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:08.892977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253219+0000","last_change":"2024-04-26T12:26:53.263148+0000","last_active":"2024-04-26T12:26:54.253219+0000","last_peered":"2024-04-26T12:26:54.253219+0000","last_clean":"2024-04-26T12:26:54.253219+0000","last_became_active":"2024-04-26T12:26:53.261904+0000","last_became_peered":"2024-04-26T12:26:53.261904+0000","last_unstale":"2024-04-26T12:26:54.253219+0000","last_undegraded":"2024-04-26T12:26:54.253219+0000","last_fullsized":"2024-04-26T12:26:54.253219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253194+0000","last_change":"2024-04-26T12:26:52.841895+0000","last_active":"2024-04-26T12:26:54.253194+0000","last_peered":"2024-04-26T12:26:54.253194+0000","last_clean":"2024-04-26T12:26:54.253194+0000","last_became_active":"2024-04-26T12:26:52.840195+0000","last_became_peered":"2024-04-26T12:26:52.840195+0000","last_unstale":"2024-04-26T12:26:54.253194+0000","last_undegraded":"2024-04-26T12:26:54.253194+0000","last_fullsized":"2024-04-26T12:26:54.253194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:03.469888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252358+0000","last_change":"2024-04-26T12:26:53.265195+0000","last_active":"2024-04-26T12:26:54.252358+0000","last_peered":"2024-04-26T12:26:54.252358+0000","last_clean":"2024-04-26T12:26:54.252358+0000","last_became_active":"2024-04-26T12:26:53.264819+0000","last_became_peered":"2024-04-26T12:26:53.264819+0000","last_unstale":"2024-04-26T12:26:54.252358+0000","last_undegraded":"2024-04-26T12:26:54.252358+0000","last_fullsized":"2024-04-26T12:26:54.252358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252231+0000","last_change":"2024-04-26T12:26:52.837057+0000","last_active":"2024-04-26T12:26:54.252231+0000","last_peered":"2024-04-26T12:26:54.252231+0000","last_clean":"2024-04-26T12:26:54.252231+0000","last_became_active":"2024-04-26T12:26:52.836594+0000","last_became_peered":"2024-04-26T12:26:52.836594+0000","last_unstale":"2024-04-26T12:26:54.252231+0000","last_undegraded":"2024-04-26T12:26:54.252231+0000","last_fullsized":"2024-04-26T12:26:54.252231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:42.768206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253143+0000","last_change":"2024-04-26T12:26:53.263194+0000","last_active":"2024-04-26T12:26:54.253143+0000","last_peered":"2024-04-26T12:26:54.253143+0000","last_clean":"2024-04-26T12:26:54.253143+0000","last_became_active":"2024-04-26T12:26:53.262366+0000","last_became_peered":"2024-04-26T12:26:53.262366+0000","last_unstale":"2024-04-26T12:26:54.253143+0000","last_undegraded":"2024-04-26T12:26:54.253143+0000","last_fullsized":"2024-04-26T12:26:54.253143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:58.929785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253105+0000","last_change":"2024-04-26T12:26:52.842337+0000","last_active":"2024-04-26T12:26:54.253105+0000","last_peered":"2024-04-26T12:26:54.253105+0000","last_clean":"2024-04-26T12:26:54.253105+0000","last_became_active":"2024-04-26T12:26:52.842009+0000","last_became_peered":"2024-04-26T12:26:52.842009+0000","last_unstale":"2024-04-26T12:26:54.253105+0000","last_undegraded":"2024-04-26T12:26:54.253105+0000","last_fullsized":"2024-04-26T12:26:54.253105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253989+0000","last_change":"2024-04-26T12:26:53.266014+0000","last_active":"2024-04-26T12:26:54.253989+0000","last_peered":"2024-04-26T12:26:54.253989+0000","last_clean":"2024-04-26T12:26:54.253989+0000","last_became_active":"2024-04-26T12:26:53.264254+0000","last_became_peered":"2024-04-26T12:26:53.264254+0000","last_unstale":"2024-04-26T12:26:54.253989+0000","last_undegraded":"2024-04-26T12:26:54.253989+0000","last_fullsized":"2024-04-26T12:26:54.253989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:04.369827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253838+0000","last_change":"2024-04-26T12:26:52.839759+0000","last_active":"2024-04-26T12:26:54.253838+0000","last_peered":"2024-04-26T12:26:54.253838+0000","last_clean":"2024-04-26T12:26:54.253838+0000","last_became_active":"2024-04-26T12:26:52.839445+0000","last_became_peered":"2024-04-26T12:26:52.839445+0000","last_unstale":"2024-04-26T12:26:54.253838+0000","last_undegraded":"2024-04-26T12:26:54.253838+0000","last_fullsized":"2024-04-26T12:26:54.253838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:40.499263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253688+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:26:54.253688+0000","last_peered":"2024-04-26T12:26:54.253688+0000","last_clean":"2024-04-26T12:26:54.253688+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:26:54.253688+0000","last_undegraded":"2024-04-26T12:26:54.253688+0000","last_fullsized":"2024-04-26T12:26:54.253688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253924+0000","last_change":"2024-04-26T12:26:52.839211+0000","last_active":"2024-04-26T12:26:54.253924+0000","last_peered":"2024-04-26T12:26:54.253924+0000","last_clean":"2024-04-26T12:26:54.253924+0000","last_became_active":"2024-04-26T12:26:52.838988+0000","last_became_peered":"2024-04-26T12:26:52.838988+0000","last_unstale":"2024-04-26T12:26:54.253924+0000","last_undegraded":"2024-04-26T12:26:54.253924+0000","last_fullsized":"2024-04-26T12:26:54.253924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:04.569832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252653+0000","last_change":"2024-04-26T12:26:53.260098+0000","last_active":"2024-04-26T12:26:54.252653+0000","last_peered":"2024-04-26T12:26:54.252653+0000","last_clean":"2024-04-26T12:26:54.252653+0000","last_became_active":"2024-04-26T12:26:53.259188+0000","last_became_peered":"2024-04-26T12:26:53.259188+0000","last_unstale":"2024-04-26T12:26:54.252653+0000","last_undegraded":"2024-04-26T12:26:54.252653+0000","last_fullsized":"2024-04-26T12:26:54.252653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:34.496560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.248033+0000","last_change":"2024-04-26T12:26:47.810338+0000","last_active":"2024-04-26T12:26:53.248033+0000","last_peered":"2024-04-26T12:26:53.248033+0000","last_clean":"2024-04-26T12:26:53.248033+0000","last_became_active":"2024-04-26T12:26:47.810127+0000","last_became_peered":"2024-04-26T12:26:47.810127+0000","last_unstale":"2024-04-26T12:26:53.248033+0000","last_undegraded":"2024-04-26T12:26:53.248033+0000","last_fullsized":"2024-04-26T12:26:53.248033+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:11.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253912+0000","last_change":"2024-04-26T12:26:52.841192+0000","last_active":"2024-04-26T12:26:54.253912+0000","last_peered":"2024-04-26T12:26:54.253912+0000","last_clean":"2024-04-26T12:26:54.253912+0000","last_became_active":"2024-04-26T12:26:52.840137+0000","last_became_peered":"2024-04-26T12:26:52.840137+0000","last_unstale":"2024-04-26T12:26:54.253912+0000","last_undegraded":"2024-04-26T12:26:54.253912+0000","last_fullsized":"2024-04-26T12:26:54.253912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:20.488738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254278+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:26:54.254278+0000","last_peered":"2024-04-26T12:26:54.254278+0000","last_clean":"2024-04-26T12:26:54.254278+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:26:54.254278+0000","last_undegraded":"2024-04-26T12:26:54.254278+0000","last_fullsized":"2024-04-26T12:26:54.254278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.257442+0000","last_change":"2024-04-26T12:26:47.811997+0000","last_active":"2024-04-26T12:26:53.257442+0000","last_peered":"2024-04-26T12:26:53.257442+0000","last_clean":"2024-04-26T12:26:53.257442+0000","last_became_active":"2024-04-26T12:26:47.811819+0000","last_became_peered":"2024-04-26T12:26:47.811819+0000","last_unstale":"2024-04-26T12:26:53.257442+0000","last_undegraded":"2024-04-26T12:26:53.257442+0000","last_fullsized":"2024-04-26T12:26:53.257442+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:11.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253332+0000","last_change":"2024-04-26T12:26:52.841195+0000","last_active":"2024-04-26T12:26:54.253332+0000","last_peered":"2024-04-26T12:26:54.253332+0000","last_clean":"2024-04-26T12:26:54.253332+0000","last_became_active":"2024-04-26T12:26:52.839558+0000","last_became_peered":"2024-04-26T12:26:52.839558+0000","last_unstale":"2024-04-26T12:26:54.253332+0000","last_undegraded":"2024-04-26T12:26:54.253332+0000","last_fullsized":"2024-04-26T12:26:54.253332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:54.208845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252177+0000","last_change":"2024-04-26T12:26:53.259270+0000","last_active":"2024-04-26T12:26:54.252177+0000","last_peered":"2024-04-26T12:26:54.252177+0000","last_clean":"2024-04-26T12:26:54.252177+0000","last_became_active":"2024-04-26T12:26:53.258588+0000","last_became_peered":"2024-04-26T12:26:53.258588+0000","last_unstale":"2024-04-26T12:26:54.252177+0000","last_undegraded":"2024-04-26T12:26:54.252177+0000","last_fullsized":"2024-04-26T12:26:54.252177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:00:09.233018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.247515+0000","last_change":"2024-04-26T12:26:47.811787+0000","last_active":"2024-04-26T12:26:53.247515+0000","last_peered":"2024-04-26T12:26:53.247515+0000","last_clean":"2024-04-26T12:26:53.247515+0000","last_became_active":"2024-04-26T12:26:47.811512+0000","last_became_peered":"2024-04-26T12:26:47.811512+0000","last_unstale":"2024-04-26T12:26:53.247515+0000","last_undegraded":"2024-04-26T12:26:53.247515+0000","last_fullsized":"2024-04-26T12:26:53.247515+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:56.379533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253871+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:26:54.253871+0000","last_peered":"2024-04-26T12:26:54.253871+0000","last_clean":"2024-04-26T12:26:54.253871+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:26:54.253871+0000","last_undegraded":"2024-04-26T12:26:54.253871+0000","last_fullsized":"2024-04-26T12:26:54.253871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252748+0000","last_change":"2024-04-26T12:26:53.260244+0000","last_active":"2024-04-26T12:26:54.252748+0000","last_peered":"2024-04-26T12:26:54.252748+0000","last_clean":"2024-04-26T12:26:54.252748+0000","last_became_active":"2024-04-26T12:26:53.259917+0000","last_became_peered":"2024-04-26T12:26:53.259917+0000","last_unstale":"2024-04-26T12:26:54.252748+0000","last_undegraded":"2024-04-26T12:26:54.252748+0000","last_fullsized":"2024-04-26T12:26:54.252748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258160+0000","last_change":"2024-04-26T12:26:47.812045+0000","last_active":"2024-04-26T12:26:53.258160+0000","last_peered":"2024-04-26T12:26:53.258160+0000","last_clean":"2024-04-26T12:26:53.258160+0000","last_became_active":"2024-04-26T12:26:47.811787+0000","last_became_peered":"2024-04-26T12:26:47.811787+0000","last_unstale":"2024-04-26T12:26:53.258160+0000","last_undegraded":"2024-04-26T12:26:53.258160+0000","last_fullsized":"2024-04-26T12:26:53.258160+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:30.757169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":211,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258235+0000","last_change":"2024-04-26T12:26:46.810189+0000","last_active":"2024-04-26T12:26:53.258235+0000","last_peered":"2024-04-26T12:26:53.258235+0000","last_clean":"2024-04-26T12:26:53.258235+0000","last_became_active":"2024-04-26T12:26:46.809453+0000","last_became_peered":"2024-04-26T12:26:46.809453+0000","last_unstale":"2024-04-26T12:26:53.258235+0000","last_undegraded":"2024-04-26T12:26:53.258235+0000","last_fullsized":"2024-04-26T12:26:53.258235+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:18.618650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251680+0000","last_change":"2024-04-26T12:26:52.833869+0000","last_active":"2024-04-26T12:26:54.251680+0000","last_peered":"2024-04-26T12:26:54.251680+0000","last_clean":"2024-04-26T12:26:54.251680+0000","last_became_active":"2024-04-26T12:26:52.833257+0000","last_became_peered":"2024-04-26T12:26:52.833257+0000","last_unstale":"2024-04-26T12:26:54.251680+0000","last_undegraded":"2024-04-26T12:26:54.251680+0000","last_fullsized":"2024-04-26T12:26:54.251680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253947+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:26:54.253947+0000","last_peered":"2024-04-26T12:26:54.253947+0000","last_clean":"2024-04-26T12:26:54.253947+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:26:54.253947+0000","last_undegraded":"2024-04-26T12:26:54.253947+0000","last_fullsized":"2024-04-26T12:26:54.253947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258561+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:26:53.258561+0000","last_peered":"2024-04-26T12:26:53.258561+0000","last_clean":"2024-04-26T12:26:53.258561+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:26:53.258561+0000","last_undegraded":"2024-04-26T12:26:53.258561+0000","last_fullsized":"2024-04-26T12:26:53.258561+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251513+0000","last_change":"2024-04-26T12:26:52.836395+0000","last_active":"2024-04-26T12:26:54.251513+0000","last_peered":"2024-04-26T12:26:54.251513+0000","last_clean":"2024-04-26T12:26:54.251513+0000","last_became_active":"2024-04-26T12:26:52.836023+0000","last_became_peered":"2024-04-26T12:26:52.836023+0000","last_unstale":"2024-04-26T12:26:54.251513+0000","last_undegraded":"2024-04-26T12:26:54.251513+0000","last_fullsized":"2024-04-26T12:26:54.251513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:54.208845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254838+0000","last_change":"2024-04-26T12:26:53.260768+0000","last_active":"2024-04-26T12:26:54.254838+0000","last_peered":"2024-04-26T12:26:54.254838+0000","last_clean":"2024-04-26T12:26:54.254838+0000","last_became_active":"2024-04-26T12:26:53.259807+0000","last_became_peered":"2024-04-26T12:26:53.259807+0000","last_unstale":"2024-04-26T12:26:54.254838+0000","last_undegraded":"2024-04-26T12:26:54.254838+0000","last_fullsized":"2024-04-26T12:26:54.254838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:02.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.250666+0000","last_change":"2024-04-26T12:26:47.812595+0000","last_active":"2024-04-26T12:26:53.250666+0000","last_peered":"2024-04-26T12:26:53.250666+0000","last_clean":"2024-04-26T12:26:53.250666+0000","last_became_active":"2024-04-26T12:26:47.812366+0000","last_became_peered":"2024-04-26T12:26:47.812366+0000","last_unstale":"2024-04-26T12:26:53.250666+0000","last_undegraded":"2024-04-26T12:26:53.250666+0000","last_fullsized":"2024-04-26T12:26:53.250666+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:57.920665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252434+0000","last_change":"2024-04-26T12:26:52.833996+0000","last_active":"2024-04-26T12:26:54.252434+0000","last_peered":"2024-04-26T12:26:54.252434+0000","last_clean":"2024-04-26T12:26:54.252434+0000","last_became_active":"2024-04-26T12:26:52.833452+0000","last_became_peered":"2024-04-26T12:26:52.833452+0000","last_unstale":"2024-04-26T12:26:54.252434+0000","last_undegraded":"2024-04-26T12:26:54.252434+0000","last_fullsized":"2024-04-26T12:26:54.252434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254460+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:26:54.254460+0000","last_peered":"2024-04-26T12:26:54.254460+0000","last_clean":"2024-04-26T12:26:54.254460+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:26:54.254460+0000","last_undegraded":"2024-04-26T12:26:54.254460+0000","last_fullsized":"2024-04-26T12:26:54.254460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252570+0000","last_change":"2024-04-26T12:26:52.837167+0000","last_active":"2024-04-26T12:26:54.252570+0000","last_peered":"2024-04-26T12:26:54.252570+0000","last_clean":"2024-04-26T12:26:54.252570+0000","last_became_active":"2024-04-26T12:26:52.836534+0000","last_became_peered":"2024-04-26T12:26:52.836534+0000","last_unstale":"2024-04-26T12:26:54.252570+0000","last_undegraded":"2024-04-26T12:26:54.252570+0000","last_fullsized":"2024-04-26T12:26:54.252570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:17.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.248427+0000","last_change":"2024-04-26T12:26:47.811807+0000","last_active":"2024-04-26T12:26:53.248427+0000","last_peered":"2024-04-26T12:26:53.248427+0000","last_clean":"2024-04-26T12:26:53.248427+0000","last_became_active":"2024-04-26T12:26:47.811527+0000","last_became_peered":"2024-04-26T12:26:47.811527+0000","last_unstale":"2024-04-26T12:26:53.248427+0000","last_undegraded":"2024-04-26T12:26:53.248427+0000","last_fullsized":"2024-04-26T12:26:53.248427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:02.127354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251466+0000","last_change":"2024-04-26T12:26:53.265773+0000","last_active":"2024-04-26T12:26:54.251466+0000","last_peered":"2024-04-26T12:26:54.251466+0000","last_clean":"2024-04-26T12:26:54.251466+0000","last_became_active":"2024-04-26T12:26:53.265567+0000","last_became_peered":"2024-04-26T12:26:53.265567+0000","last_unstale":"2024-04-26T12:26:54.251466+0000","last_undegraded":"2024-04-26T12:26:54.251466+0000","last_fullsized":"2024-04-26T12:26:54.251466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:26:53.258624+0000","last_change":"2024-04-26T12:26:47.811204+0000","last_active":"2024-04-26T12:26:53.258624+0000","last_peered":"2024-04-26T12:26:53.258624+0000","last_clean":"2024-04-26T12:26:53.258624+0000","last_became_active":"2024-04-26T12:26:47.810997+0000","last_became_peered":"2024-04-26T12:26:47.810997+0000","last_unstale":"2024-04-26T12:26:53.258624+0000","last_undegraded":"2024-04-26T12:26:53.258624+0000","last_fullsized":"2024-04-26T12:26:53.258624+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:24.967175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:55.294535+0000","last_change":"2024-04-26T12:26:52.837269+0000","last_active":"2024-04-26T12:26:55.294535+0000","last_peered":"2024-04-26T12:26:55.294535+0000","last_clean":"2024-04-26T12:26:55.294535+0000","last_became_active":"2024-04-26T12:26:52.836310+0000","last_became_peered":"2024-04-26T12:26:52.836310+0000","last_unstale":"2024-04-26T12:26:55.294535+0000","last_undegraded":"2024-04-26T12:26:55.294535+0000","last_fullsized":"2024-04-26T12:26:55.294535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:20.488738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254362+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:26:54.254362+0000","last_peered":"2024-04-26T12:26:54.254362+0000","last_clean":"2024-04-26T12:26:54.254362+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:26:54.254362+0000","last_undegraded":"2024-04-26T12:26:54.254362+0000","last_fullsized":"2024-04-26T12:26:54.254362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254162+0000","last_change":"2024-04-26T12:26:52.840797+0000","last_active":"2024-04-26T12:26:54.254162+0000","last_peered":"2024-04-26T12:26:54.254162+0000","last_clean":"2024-04-26T12:26:54.254162+0000","last_became_active":"2024-04-26T12:26:52.840409+0000","last_became_peered":"2024-04-26T12:26:52.840409+0000","last_unstale":"2024-04-26T12:26:54.254162+0000","last_undegraded":"2024-04-26T12:26:54.254162+0000","last_fullsized":"2024-04-26T12:26:54.254162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:57.898978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254682+0000","last_change":"2024-04-26T12:26:53.255044+0000","last_active":"2024-04-26T12:26:54.254682+0000","last_peered":"2024-04-26T12:26:54.254682+0000","last_clean":"2024-04-26T12:26:54.254682+0000","last_became_active":"2024-04-26T12:26:53.254164+0000","last_became_peered":"2024-04-26T12:26:53.254164+0000","last_unstale":"2024-04-26T12:26:54.254682+0000","last_undegraded":"2024-04-26T12:26:54.254682+0000","last_fullsized":"2024-04-26T12:26:54.254682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:07.899699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253335+0000","last_change":"2024-04-26T12:26:52.841338+0000","last_active":"2024-04-26T12:26:54.253335+0000","last_peered":"2024-04-26T12:26:54.253335+0000","last_clean":"2024-04-26T12:26:54.253335+0000","last_became_active":"2024-04-26T12:26:52.840770+0000","last_became_peered":"2024-04-26T12:26:52.840770+0000","last_unstale":"2024-04-26T12:26:54.253335+0000","last_undegraded":"2024-04-26T12:26:54.253335+0000","last_fullsized":"2024-04-26T12:26:54.253335+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:33.466992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253384+0000","last_change":"2024-04-26T12:26:53.260953+0000","last_active":"2024-04-26T12:26:54.253384+0000","last_peered":"2024-04-26T12:26:54.253384+0000","last_clean":"2024-04-26T12:26:54.253384+0000","last_became_active":"2024-04-26T12:26:53.259228+0000","last_became_peered":"2024-04-26T12:26:53.259228+0000","last_unstale":"2024-04-26T12:26:54.253384+0000","last_undegraded":"2024-04-26T12:26:54.253384+0000","last_fullsized":"2024-04-26T12:26:54.253384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254744+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:26:54.254744+0000","last_peered":"2024-04-26T12:26:54.254744+0000","last_clean":"2024-04-26T12:26:54.254744+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:26:54.254744+0000","last_undegraded":"2024-04-26T12:26:54.254744+0000","last_fullsized":"2024-04-26T12:26:54.254744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253334+0000","last_change":"2024-04-26T12:26:53.262221+0000","last_active":"2024-04-26T12:26:54.253334+0000","last_peered":"2024-04-26T12:26:54.253334+0000","last_clean":"2024-04-26T12:26:54.253334+0000","last_became_active":"2024-04-26T12:26:53.261112+0000","last_became_peered":"2024-04-26T12:26:53.261112+0000","last_unstale":"2024-04-26T12:26:54.253334+0000","last_undegraded":"2024-04-26T12:26:54.253334+0000","last_fullsized":"2024-04-26T12:26:54.253334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252558+0000","last_change":"2024-04-26T12:26:52.837399+0000","last_active":"2024-04-26T12:26:54.252558+0000","last_peered":"2024-04-26T12:26:54.252558+0000","last_clean":"2024-04-26T12:26:54.252558+0000","last_became_active":"2024-04-26T12:26:52.835974+0000","last_became_peered":"2024-04-26T12:26:52.835974+0000","last_unstale":"2024-04-26T12:26:54.252558+0000","last_undegraded":"2024-04-26T12:26:54.252558+0000","last_fullsized":"2024-04-26T12:26:54.252558+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:03.469888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254323+0000","last_change":"2024-04-26T12:26:53.254495+0000","last_active":"2024-04-26T12:26:54.254323+0000","last_peered":"2024-04-26T12:26:54.254323+0000","last_clean":"2024-04-26T12:26:54.254323+0000","last_became_active":"2024-04-26T12:26:53.254149+0000","last_became_peered":"2024-04-26T12:26:53.254149+0000","last_unstale":"2024-04-26T12:26:54.254323+0000","last_undegraded":"2024-04-26T12:26:54.254323+0000","last_fullsized":"2024-04-26T12:26:54.254323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:37.907024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252663+0000","last_change":"2024-04-26T12:26:52.836279+0000","last_active":"2024-04-26T12:26:54.252663+0000","last_peered":"2024-04-26T12:26:54.252663+0000","last_clean":"2024-04-26T12:26:54.252663+0000","last_became_active":"2024-04-26T12:26:52.835916+0000","last_became_peered":"2024-04-26T12:26:52.835916+0000","last_unstale":"2024-04-26T12:26:54.252663+0000","last_undegraded":"2024-04-26T12:26:54.252663+0000","last_fullsized":"2024-04-26T12:26:54.252663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:33.466992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.253090+0000","last_change":"2024-04-26T12:26:53.259112+0000","last_active":"2024-04-26T12:26:54.253090+0000","last_peered":"2024-04-26T12:26:54.253090+0000","last_clean":"2024-04-26T12:26:54.253090+0000","last_became_active":"2024-04-26T12:26:53.256762+0000","last_became_peered":"2024-04-26T12:26:53.256762+0000","last_unstale":"2024-04-26T12:26:54.253090+0000","last_undegraded":"2024-04-26T12:26:54.253090+0000","last_fullsized":"2024-04-26T12:26:54.253090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:00.311885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252967+0000","last_change":"2024-04-26T12:26:53.263131+0000","last_active":"2024-04-26T12:26:54.252967+0000","last_peered":"2024-04-26T12:26:54.252967+0000","last_clean":"2024-04-26T12:26:54.252967+0000","last_became_active":"2024-04-26T12:26:53.260489+0000","last_became_peered":"2024-04-26T12:26:53.260489+0000","last_unstale":"2024-04-26T12:26:54.252967+0000","last_undegraded":"2024-04-26T12:26:54.252967+0000","last_fullsized":"2024-04-26T12:26:54.252967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:56.025206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.251606+0000","last_change":"2024-04-26T12:26:53.259832+0000","last_active":"2024-04-26T12:26:54.251606+0000","last_peered":"2024-04-26T12:26:54.251606+0000","last_clean":"2024-04-26T12:26:54.251606+0000","last_became_active":"2024-04-26T12:26:53.259028+0000","last_became_peered":"2024-04-26T12:26:53.259028+0000","last_unstale":"2024-04-26T12:26:54.251606+0000","last_undegraded":"2024-04-26T12:26:54.251606+0000","last_fullsized":"2024-04-26T12:26:54.251606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254286+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:26:54.254286+0000","last_peered":"2024-04-26T12:26:54.254286+0000","last_clean":"2024-04-26T12:26:54.254286+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:26:54.254286+0000","last_undegraded":"2024-04-26T12:26:54.254286+0000","last_fullsized":"2024-04-26T12:26:54.254286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.252363+0000","last_change":"2024-04-26T12:26:53.259057+0000","last_active":"2024-04-26T12:26:54.252363+0000","last_peered":"2024-04-26T12:26:54.252363+0000","last_clean":"2024-04-26T12:26:54.252363+0000","last_became_active":"2024-04-26T12:26:53.257816+0000","last_became_peered":"2024-04-26T12:26:53.257816+0000","last_unstale":"2024-04-26T12:26:54.252363+0000","last_undegraded":"2024-04-26T12:26:54.252363+0000","last_fullsized":"2024-04-26T12:26:54.252363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:53.950315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:26:54.254747+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:26:54.254747+0000","last_peered":"2024-04-26T12:26:54.254747+0000","last_clean":"2024-04-26T12:26:54.254747+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:26:54.254747+0000","last_undegraded":"2024-04-26T12:26:54.254747+0000","last_fullsized":"2024-04-26T12:26:54.254747+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":641176,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":641792,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":147456,"data_stored":49678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:27:10.338 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:27:10.339 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-26T12:27:10.711 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 16 2024-04-26T12:27:10.712 INFO:teuthology.orchestra.run.smithi046.stdout:fsid 3dd84416-f290-4721-94ce-52b0ffaacf34 2024-04-26T12:27:10.712 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-04-26T12:26:36.091476+0000 2024-04-26T12:27:10.712 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-04-26T12:26:54.245547+0000 2024-04-26T12:27:10.712 INFO:teuthology.orchestra.run.smithi046.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T12:27:10.712 INFO:teuthology.orchestra.run.smithi046.stdout:crush_version 4 2024-04-26T12:27:10.712 INFO:teuthology.orchestra.run.smithi046.stdout:full_ratio 0.95 2024-04-26T12:27:10.712 INFO:teuthology.orchestra.run.smithi046.stdout:backfillfull_ratio 0.9 2024-04-26T12:27:10.712 INFO:teuthology.orchestra.run.smithi046.stdout:nearfull_ratio 0.85 2024-04-26T12:27:10.713 INFO:teuthology.orchestra.run.smithi046.stdout:require_min_compat_client luminous 2024-04-26T12:27:10.713 INFO:teuthology.orchestra.run.smithi046.stdout:min_compat_client jewel 2024-04-26T12:27:10.713 INFO:teuthology.orchestra.run.smithi046.stdout:require_osd_release reef 2024-04-26T12:27:10.713 INFO:teuthology.orchestra.run.smithi046.stdout:stretch_mode_enabled false 2024-04-26T12:27:10.713 INFO:teuthology.orchestra.run.smithi046.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-26T12:27:10.713 INFO:teuthology.orchestra.run.smithi046.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-26T12:27:10.713 INFO:teuthology.orchestra.run.smithi046.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-26T12:27:10.713 INFO:teuthology.orchestra.run.smithi046.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-26T12:27:10.713 INFO:teuthology.orchestra.run.smithi046.stdout:max_osd 3 2024-04-26T12:27:10.713 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6800/41431,v1:172.21.15.115:6801/41431] [v2:172.21.15.115:6802/41431,v1:172.21.15.115:6803/41431] exists,up 06efe013-b786-41a5-b434-e2198a85a028 2024-04-26T12:27:10.713 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6800/41393,v1:172.21.15.136:6801/41393] [v2:172.21.15.136:6802/41393,v1:172.21.15.136:6803/41393] exists,up 13cadead-33ea-4874-9a87-7419790ff37a 2024-04-26T12:27:10.714 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6800/41547,v1:172.21.15.142:6801/41547] [v2:172.21.15.142:6802/41547,v1:172.21.15.142:6803/41547] exists,up 4e4c8095-c2d1-42a3-8da1-e3b41ca2a870 2024-04-26T12:27:10.725 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6800/41431,v1:172.21.15.115:6801/41431] [v2:172.21.15.115:6802/41431,v1:172.21.15.115:6803/41431] exists,up 06efe013-b786-41a5-b434-e2198a85a028', 'osd.1 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6800/41393,v1:172.21.15.136:6801/41393] [v2:172.21.15.136:6802/41393,v1:172.21.15.136:6803/41393] exists,up 13cadead-33ea-4874-9a87-7419790ff37a', 'osd.2 up in weight 1 up_from 8 up_thru 14 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6800/41547,v1:172.21.15.142:6801/41547] [v2:172.21.15.142:6802/41547,v1:172.21.15.142:6803/41547] exists,up 4e4c8095-c2d1-42a3-8da1-e3b41ca2a870'] 2024-04-26T12:27:10.726 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-26T12:27:10.852 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-04-26T12:27:10.852 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mon.a", 2024-04-26T12:27:10.852 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster": "ceph", 2024-04-26T12:27:10.852 INFO:teuthology.orchestra.run.smithi046.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-26T12:27:10.852 INFO:teuthology.orchestra.run.smithi046.stdout: "admin_socket_mode": "", 2024-04-26T12:27:10.852 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-26T12:27:10.853 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_client_required": "cephx, none", 2024-04-26T12:27:10.853 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_cluster_required": "cephx", 2024-04-26T12:27:10.853 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_debug": "true", 2024-04-26T12:27:10.853 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-26T12:27:10.853 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-26T12:27:10.853 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_service_required": "cephx", 2024-04-26T12:27:10.853 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-26T12:27:10.853 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_supported": "cephx", 2024-04-26T12:27:10.853 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_aio": "true", 2024-04-26T12:27:10.853 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-26T12:27:10.853 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_aio_poll_ms": "250", 2024-04-26T12:27:10.853 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_aio_reap_max": "16", 2024-04-26T12:27:10.853 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_async_discard": "false", 2024-04-26T12:27:10.854 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_block_size": "4096", 2024-04-26T12:27:10.854 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_debug_aio": "false", 2024-04-26T12:27:10.854 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-26T12:27:10.854 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-26T12:27:10.854 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_debug_inflight_ios": "false", 2024-04-26T12:27:10.854 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_enable_discard": "false", 2024-04-26T12:27:10.854 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_flock_retry": "3", 2024-04-26T12:27:10.854 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-26T12:27:10.854 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_inject_crash": "0", 2024-04-26T12:27:10.854 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-26T12:27:10.854 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_ioring": "false", 2024-04-26T12:27:10.854 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_ioring_hipri": "false", 2024-04-26T12:27:10.854 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-26T12:27:10.854 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-26T12:27:10.855 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-26T12:27:10.855 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-26T12:27:10.855 INFO:teuthology.orchestra.run.smithi046.stdout: "bdev_type": "", 2024-04-26T12:27:10.855 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_alloc_size": "1048576", 2024-04-26T12:27:10.855 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_allocator": "hybrid", 2024-04-26T12:27:10.855 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_buffered_io": "true", 2024-04-26T12:27:10.855 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_check_for_zeros": "false", 2024-04-26T12:27:10.855 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-26T12:27:10.855 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-26T12:27:10.855 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_compact_log_sync": "false", 2024-04-26T12:27:10.855 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-26T12:27:10.855 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-26T12:27:10.855 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-26T12:27:10.855 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-26T12:27:10.856 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_max_log_runway": "4194304", 2024-04-26T12:27:10.856 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_max_prefetch": "1048576", 2024-04-26T12:27:10.856 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_min_flush_size": "524288", 2024-04-26T12:27:10.856 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_min_log_runway": "1048576", 2024-04-26T12:27:10.856 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_replay_recovery": "false", 2024-04-26T12:27:10.856 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-26T12:27:10.856 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-26T12:27:10.856 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_sync_write": "false", 2024-04-26T12:27:10.856 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-26T12:27:10.856 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-26T12:27:10.856 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-26T12:27:10.856 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_allocation_from_file": "true", 2024-04-26T12:27:10.856 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_allocator": "hybrid", 2024-04-26T12:27:10.857 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-26T12:27:10.857 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-26T12:27:10.857 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-26T12:27:10.857 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-26T12:27:10.857 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-26T12:27:10.857 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-26T12:27:10.857 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-26T12:27:10.857 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_create": "true", 2024-04-26T12:27:10.857 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_db_create": "false", 2024-04-26T12:27:10.857 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_db_path": "", 2024-04-26T12:27:10.857 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_db_size": "0", 2024-04-26T12:27:10.857 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_path": "", 2024-04-26T12:27:10.858 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_preallocate_file": "false", 2024-04-26T12:27:10.858 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_size": "107374182400", 2024-04-26T12:27:10.858 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_wal_create": "false", 2024-04-26T12:27:10.858 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_wal_path": "", 2024-04-26T12:27:10.858 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_block_wal_size": "100663296", 2024-04-26T12:27:10.858 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_bluefs": "true", 2024-04-26T12:27:10.858 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-26T12:27:10.858 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-26T12:27:10.858 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-26T12:27:10.858 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-26T12:27:10.858 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:27:10.858 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:27:10.858 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-26T12:27:10.859 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:27:10.859 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_autotune": "true", 2024-04-26T12:27:10.859 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-26T12:27:10.859 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-26T12:27:10.859 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-26T12:27:10.859 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-26T12:27:10.859 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_size": "0", 2024-04-26T12:27:10.859 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-26T12:27:10.859 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-26T12:27:10.859 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-26T12:27:10.859 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-26T12:27:10.859 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_type": "2q", 2024-04-26T12:27:10.859 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-26T12:27:10.859 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_clone_cow": "true", 2024-04-26T12:27:10.860 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-26T12:27:10.860 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-26T12:27:10.860 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-26T12:27:10.860 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-26T12:27:10.860 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-26T12:27:10.860 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-26T12:27:10.860 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-26T12:27:10.860 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_mode": "none", 2024-04-26T12:27:10.860 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-26T12:27:10.860 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_csum_type": "crc32c", 2024-04-26T12:27:10.860 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-26T12:27:10.860 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_freelist": "false", 2024-04-26T12:27:10.860 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-26T12:27:10.861 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-26T12:27:10.861 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-26T12:27:10.861 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-26T12:27:10.861 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-26T12:27:10.861 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-26T12:27:10.861 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-26T12:27:10.861 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-26T12:27:10.861 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-26T12:27:10.861 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-26T12:27:10.861 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-26T12:27:10.861 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-26T12:27:10.861 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-26T12:27:10.861 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-26T12:27:10.862 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_small_allocations": "0", 2024-04-26T12:27:10.862 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-26T12:27:10.862 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_default_buffered_read": "true", 2024-04-26T12:27:10.862 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_default_buffered_write": "false", 2024-04-26T12:27:10.862 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-26T12:27:10.862 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-26T12:27:10.862 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-26T12:27:10.862 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-26T12:27:10.862 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-26T12:27:10.862 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-26T12:27:10.862 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-26T12:27:10.862 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-26T12:27:10.862 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fail_eio": "false", 2024-04-26T12:27:10.862 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-26T12:27:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-26T12:27:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-26T12:27:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-26T12:27:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-26T12:27:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-26T12:27:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_on_mount": "false", 2024-04-26T12:27:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-26T12:27:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_on_umount": "false", 2024-04-26T12:27:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-26T12:27:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-26T12:27:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-26T12:27:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-26T12:27:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-26T12:27:10.863 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-26T12:27:10.864 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-26T12:27:10.864 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-26T12:27:10.864 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_ignore_data_csum": "false", 2024-04-26T12:27:10.864 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-26T12:27:10.864 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-26T12:27:10.864 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-26T12:27:10.864 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-26T12:27:10.864 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_log_op_age": "5.000000", 2024-04-26T12:27:10.864 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_max_alloc_size": "0", 2024-04-26T12:27:10.864 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_max_blob_size": "0", 2024-04-26T12:27:10.864 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-26T12:27:10.864 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-26T12:27:10.864 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-26T12:27:10.865 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_max_deferred_txc": "32", 2024-04-26T12:27:10.865 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_min_alloc_size": "0", 2024-04-26T12:27:10.865 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-26T12:27:10.865 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-26T12:27:10.865 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_nid_prealloc": "1024", 2024-04-26T12:27:10.865 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-26T12:27:10.865 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-26T12:27:10.865 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-26T12:27:10.865 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-26T12:27:10.865 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_retry_disk_reads": "3", 2024-04-26T12:27:10.865 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_rocksdb_cf": "true", 2024-04-26T12:27:10.865 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-26T12:27:10.865 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-26T12:27:10.866 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-26T12:27:10.866 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-26T12:27:10.866 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-26T12:27:10.866 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-26T12:27:10.866 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_spdk_mem": "512", 2024-04-26T12:27:10.866 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-26T12:27:10.866 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-26T12:27:10.866 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-26T12:27:10.866 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-26T12:27:10.866 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-26T12:27:10.866 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-26T12:27:10.866 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-26T12:27:10.866 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_tracing": "false", 2024-04-26T12:27:10.867 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-26T12:27:10.867 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-26T12:27:10.867 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-26T12:27:10.867 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-26T12:27:10.867 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-26T12:27:10.867 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-26T12:27:10.867 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-26T12:27:10.867 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-26T12:27:10.867 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-26T12:27:10.867 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_zero_block_detection": "false", 2024-04-26T12:27:10.867 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-26T12:27:10.867 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-26T12:27:10.867 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephx_cluster_require_signatures": "false", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephx_cluster_require_version": "2", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephx_require_signatures": "false", 2024-04-26T12:27:10.868 INFO:teuthology.orchestra.run.smithi046.stdout: "cephx_require_version": "2", 2024-04-26T12:27:10.869 INFO:teuthology.orchestra.run.smithi046.stdout: "cephx_service_require_signatures": "false", 2024-04-26T12:27:10.869 INFO:teuthology.orchestra.run.smithi046.stdout: "cephx_service_require_version": "2", 2024-04-26T12:27:10.869 INFO:teuthology.orchestra.run.smithi046.stdout: "cephx_sign_messages": "true", 2024-04-26T12:27:10.869 INFO:teuthology.orchestra.run.smithi046.stdout: "chdir": "", 2024-04-26T12:27:10.869 INFO:teuthology.orchestra.run.smithi046.stdout: "client_acl_type": "", 2024-04-26T12:27:10.869 INFO:teuthology.orchestra.run.smithi046.stdout: "client_asio_thread_count": "2", 2024-04-26T12:27:10.869 INFO:teuthology.orchestra.run.smithi046.stdout: "client_cache_mid": "0.750000", 2024-04-26T12:27:10.869 INFO:teuthology.orchestra.run.smithi046.stdout: "client_cache_size": "16384", 2024-04-26T12:27:10.869 INFO:teuthology.orchestra.run.smithi046.stdout: "client_caps_release_delay": "5", 2024-04-26T12:27:10.869 INFO:teuthology.orchestra.run.smithi046.stdout: "client_check_pool_perm": "true", 2024-04-26T12:27:10.869 INFO:teuthology.orchestra.run.smithi046.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-26T12:27:10.869 INFO:teuthology.orchestra.run.smithi046.stdout: "client_debug_force_sync_read": "false", 2024-04-26T12:27:10.869 INFO:teuthology.orchestra.run.smithi046.stdout: "client_debug_getattr_caps": "false", 2024-04-26T12:27:10.869 INFO:teuthology.orchestra.run.smithi046.stdout: "client_debug_inject_tick_delay": "0", 2024-04-26T12:27:10.870 INFO:teuthology.orchestra.run.smithi046.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-26T12:27:10.870 INFO:teuthology.orchestra.run.smithi046.stdout: "client_die_on_failed_remount": "false", 2024-04-26T12:27:10.870 INFO:teuthology.orchestra.run.smithi046.stdout: "client_dirsize_rbytes": "true", 2024-04-26T12:27:10.870 INFO:teuthology.orchestra.run.smithi046.stdout: "client_force_lazyio": "false", 2024-04-26T12:27:10.870 INFO:teuthology.orchestra.run.smithi046.stdout: "client_fs": "", 2024-04-26T12:27:10.870 INFO:teuthology.orchestra.run.smithi046.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-26T12:27:10.870 INFO:teuthology.orchestra.run.smithi046.stdout: "client_inject_release_failure": "false", 2024-04-26T12:27:10.870 INFO:teuthology.orchestra.run.smithi046.stdout: "client_max_inline_size": "4096", 2024-04-26T12:27:10.870 INFO:teuthology.orchestra.run.smithi046.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-26T12:27:10.870 INFO:teuthology.orchestra.run.smithi046.stdout: "client_mds_namespace": "", 2024-04-26T12:27:10.870 INFO:teuthology.orchestra.run.smithi046.stdout: "client_metadata": "", 2024-04-26T12:27:10.870 INFO:teuthology.orchestra.run.smithi046.stdout: "client_mount_gid": "-1", 2024-04-26T12:27:10.870 INFO:teuthology.orchestra.run.smithi046.stdout: "client_mount_timeout": "300", 2024-04-26T12:27:10.871 INFO:teuthology.orchestra.run.smithi046.stdout: "client_mount_uid": "-1", 2024-04-26T12:27:10.871 INFO:teuthology.orchestra.run.smithi046.stdout: "client_mountpoint": "/", 2024-04-26T12:27:10.871 INFO:teuthology.orchestra.run.smithi046.stdout: "client_notify_timeout": "10", 2024-04-26T12:27:10.871 INFO:teuthology.orchestra.run.smithi046.stdout: "client_oc": "true", 2024-04-26T12:27:10.871 INFO:teuthology.orchestra.run.smithi046.stdout: "client_oc_max_dirty": "104857600", 2024-04-26T12:27:10.871 INFO:teuthology.orchestra.run.smithi046.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-26T12:27:10.871 INFO:teuthology.orchestra.run.smithi046.stdout: "client_oc_max_objects": "1000", 2024-04-26T12:27:10.871 INFO:teuthology.orchestra.run.smithi046.stdout: "client_oc_size": "209715200", 2024-04-26T12:27:10.871 INFO:teuthology.orchestra.run.smithi046.stdout: "client_oc_target_dirty": "8388608", 2024-04-26T12:27:10.871 INFO:teuthology.orchestra.run.smithi046.stdout: "client_permissions": "true", 2024-04-26T12:27:10.871 INFO:teuthology.orchestra.run.smithi046.stdout: "client_quota": "true", 2024-04-26T12:27:10.871 INFO:teuthology.orchestra.run.smithi046.stdout: "client_quota_df": "true", 2024-04-26T12:27:10.871 INFO:teuthology.orchestra.run.smithi046.stdout: "client_readahead_max_bytes": "0", 2024-04-26T12:27:10.871 INFO:teuthology.orchestra.run.smithi046.stdout: "client_readahead_max_periods": "4", 2024-04-26T12:27:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: "client_readahead_min": "131072", 2024-04-26T12:27:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: "client_reconnect_stale": "false", 2024-04-26T12:27:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: "client_shutdown_timeout": "30", 2024-04-26T12:27:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: "client_snapdir": ".snap", 2024-04-26T12:27:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: "client_tick_interval": "1", 2024-04-26T12:27:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: "client_trace": "", 2024-04-26T12:27:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: "client_try_dentry_invalidate": "false", 2024-04-26T12:27:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: "client_use_faked_inos": "false", 2024-04-26T12:27:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: "client_use_random_mds": "false", 2024-04-26T12:27:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: "clog_to_graylog": "false", 2024-04-26T12:27:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-26T12:27:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: "clog_to_graylog_port": "12201", 2024-04-26T12:27:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: "clog_to_monitors": "default=true", 2024-04-26T12:27:10.872 INFO:teuthology.orchestra.run.smithi046.stdout: "clog_to_syslog": "false", 2024-04-26T12:27:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-26T12:27:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: "clog_to_syslog_level": "info", 2024-04-26T12:27:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addr": "-", 2024-04-26T12:27:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_network": "", 2024-04-26T12:27:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_network_interface": "", 2024-04-26T12:27:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: "compressor_zlib_isal": "false", 2024-04-26T12:27:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: "compressor_zlib_level": "5", 2024-04-26T12:27:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: "compressor_zlib_winsize": "-15", 2024-04-26T12:27:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: "compressor_zstd_level": "1", 2024-04-26T12:27:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-26T12:27:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-26T12:27:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: "crimson_alien_op_num_threads": "6", 2024-04-26T12:27:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-26T12:27:10.873 INFO:teuthology.orchestra.run.smithi046.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-26T12:27:10.874 INFO:teuthology.orchestra.run.smithi046.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-26T12:27:10.874 INFO:teuthology.orchestra.run.smithi046.stdout: "crimson_seastar_smp": "1", 2024-04-26T12:27:10.874 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_location": "", 2024-04-26T12:27:10.874 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_location_hook": "", 2024-04-26T12:27:10.874 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_location_hook_timeout": "10", 2024-04-26T12:27:10.874 INFO:teuthology.orchestra.run.smithi046.stdout: "daemonize": "false", 2024-04-26T12:27:10.874 INFO:teuthology.orchestra.run.smithi046.stdout: "daos_pool": "tank", 2024-04-26T12:27:10.874 INFO:teuthology.orchestra.run.smithi046.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-26T12:27:10.874 INFO:teuthology.orchestra.run.smithi046.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-26T12:27:10.874 INFO:teuthology.orchestra.run.smithi046.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-26T12:27:10.874 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_alienstore": "0/5", 2024-04-26T12:27:10.874 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_allow_any_pool_priority": "false", 2024-04-26T12:27:10.874 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_asok": "1/5", 2024-04-26T12:27:10.874 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_asok_assert_abort": "false", 2024-04-26T12:27:10.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_asserts_on_shutdown": "true", 2024-04-26T12:27:10.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_auth": "20/20", 2024-04-26T12:27:10.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_bdev": "1/3", 2024-04-26T12:27:10.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_bluefs": "1/5", 2024-04-26T12:27:10.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_bluestore": "1/5", 2024-04-26T12:27:10.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_buffer": "0/1", 2024-04-26T12:27:10.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_ceph_exporter": "1/5", 2024-04-26T12:27:10.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_cephfs_mirror": "0/5", 2024-04-26T12:27:10.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_cephsqlite": "0/5", 2024-04-26T12:27:10.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_client": "0/5", 2024-04-26T12:27:10.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_compressor": "1/5", 2024-04-26T12:27:10.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_context": "0/1", 2024-04-26T12:27:10.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_crush": "1/1", 2024-04-26T12:27:10.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_crypto": "1/5", 2024-04-26T12:27:10.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_cyanstore": "0/5", 2024-04-26T12:27:10.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_deliberately_leak_memory": "false", 2024-04-26T12:27:10.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_disable_randomized_ping": "false", 2024-04-26T12:27:10.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_dpdk": "1/5", 2024-04-26T12:27:10.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_eventtrace": "1/5", 2024-04-26T12:27:10.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_filer": "0/1", 2024-04-26T12:27:10.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_filestore": "1/3", 2024-04-26T12:27:10.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_finisher": "1/1", 2024-04-26T12:27:10.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_fuse": "1/5", 2024-04-26T12:27:10.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_heartbeat_testing_span": "0", 2024-04-26T12:27:10.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_heartbeatmap": "1/5", 2024-04-26T12:27:10.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-26T12:27:10.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_javaclient": "1/5", 2024-04-26T12:27:10.876 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_journal": "1/3", 2024-04-26T12:27:10.877 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_journaler": "0/5", 2024-04-26T12:27:10.877 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_kstore": "1/5", 2024-04-26T12:27:10.877 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_leveldb": "4/5", 2024-04-26T12:27:10.877 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_lockdep": "0/1", 2024-04-26T12:27:10.877 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mclock": "1/5", 2024-04-26T12:27:10.877 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mds": "1/5", 2024-04-26T12:27:10.877 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mds_balancer": "1/5", 2024-04-26T12:27:10.877 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mds_locker": "1/5", 2024-04-26T12:27:10.877 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mds_log": "1/5", 2024-04-26T12:27:10.877 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mds_log_expire": "1/5", 2024-04-26T12:27:10.877 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mds_migrator": "1/5", 2024-04-26T12:27:10.877 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_memstore": "1/5", 2024-04-26T12:27:10.877 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mgr": "2/5", 2024-04-26T12:27:10.878 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mgrc": "1/5", 2024-04-26T12:27:10.878 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_mon": "20/20", 2024-04-26T12:27:10.878 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_monc": "0/10", 2024-04-26T12:27:10.878 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_ms": "1/1", 2024-04-26T12:27:10.878 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_none": "0/5", 2024-04-26T12:27:10.878 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_objclass": "0/5", 2024-04-26T12:27:10.878 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_objectcacher": "0/5", 2024-04-26T12:27:10.878 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_objecter": "0/1", 2024-04-26T12:27:10.878 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_optracker": "0/5", 2024-04-26T12:27:10.878 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_osd": "1/5", 2024-04-26T12:27:10.878 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_paxos": "20/20", 2024-04-26T12:27:10.879 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_perfcounter": "1/5", 2024-04-26T12:27:10.879 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_prioritycache": "1/5", 2024-04-26T12:27:10.879 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rados": "0/5", 2024-04-26T12:27:10.879 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rbd": "0/5", 2024-04-26T12:27:10.879 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rbd_mirror": "0/5", 2024-04-26T12:27:10.879 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rbd_pwl": "0/5", 2024-04-26T12:27:10.879 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rbd_replay": "0/5", 2024-04-26T12:27:10.879 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_refs": "0/0", 2024-04-26T12:27:10.879 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_reserver": "1/1", 2024-04-26T12:27:10.879 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rgw": "1/5", 2024-04-26T12:27:10.879 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rgw_access": "1/5", 2024-04-26T12:27:10.879 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rgw_datacache": "1/5", 2024-04-26T12:27:10.879 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rgw_dbstore": "1/5", 2024-04-26T12:27:10.879 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rgw_flight": "1/5", 2024-04-26T12:27:10.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rgw_sync": "1/5", 2024-04-26T12:27:10.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_rocksdb": "4/5", 2024-04-26T12:27:10.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore": "0/5", 2024-04-26T12:27:10.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_backref": "0/5", 2024-04-26T12:27:10.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_cache": "0/5", 2024-04-26T12:27:10.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_cleaner": "0/5", 2024-04-26T12:27:10.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_device": "0/5", 2024-04-26T12:27:10.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_epm": "0/5", 2024-04-26T12:27:10.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-26T12:27:10.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_journal": "0/5", 2024-04-26T12:27:10.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_lba": "0/5", 2024-04-26T12:27:10.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_odata": "0/5", 2024-04-26T12:27:10.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_omap": "0/5", 2024-04-26T12:27:10.880 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_onode": "0/5", 2024-04-26T12:27:10.881 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_t": "0/5", 2024-04-26T12:27:10.881 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_seastore_tm": "0/5", 2024-04-26T12:27:10.881 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_striper": "0/1", 2024-04-26T12:27:10.881 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_test": "0/5", 2024-04-26T12:27:10.881 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_throttle": "1/1", 2024-04-26T12:27:10.881 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_timer": "0/1", 2024-04-26T12:27:10.881 INFO:teuthology.orchestra.run.smithi046.stdout: "debug_tp": "0/5", 2024-04-26T12:27:10.881 INFO:teuthology.orchestra.run.smithi046.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-26T12:27:10.881 INFO:teuthology.orchestra.run.smithi046.stdout: "device_failure_prediction_mode": "none", 2024-04-26T12:27:10.881 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-26T12:27:10.881 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-26T12:27:10.881 INFO:teuthology.orchestra.run.smithi046.stdout: "err_to_graylog": "false", 2024-04-26T12:27:10.881 INFO:teuthology.orchestra.run.smithi046.stdout: "err_to_journald": "false", 2024-04-26T12:27:10.881 INFO:teuthology.orchestra.run.smithi046.stdout: "err_to_stderr": "true", 2024-04-26T12:27:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: "err_to_syslog": "false", 2024-04-26T12:27:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: "event_tracing": "false", 2024-04-26T12:27:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: "exporter_addr": "0.0.0.0", 2024-04-26T12:27:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: "exporter_http_port": "9926", 2024-04-26T12:27:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: "exporter_prio_limit": "5", 2024-04-26T12:27:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-26T12:27:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: "exporter_sort_metrics": "true", 2024-04-26T12:27:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: "exporter_stats_period": "5", 2024-04-26T12:27:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: "fake_statfs_for_testing": "0", 2024-04-26T12:27:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: "fatal_signal_handlers": "true", 2024-04-26T12:27:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: "filer_max_purge_ops": "10", 2024-04-26T12:27:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: "filer_max_truncate_ops": "128", 2024-04-26T12:27:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_apply_finisher_threads": "1", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_blackhole": "false", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_btrfs_clone_range": "true", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_btrfs_snap": "true", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_caller_concurrency": "10", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_collect_device_partition_information": "true", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_commit_timeout": "600.000000", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_debug_inject_read_err": "false", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_debug_omap_check": "false", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_debug_verify_split": "false", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_dump_file": "", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_fadvise": "true", 2024-04-26T12:27:10.883 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_fail_eio": "true", 2024-04-26T12:27:10.884 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_fd_cache_shards": "16", 2024-04-26T12:27:10.884 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_fd_cache_size": "128", 2024-04-26T12:27:10.884 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_fiemap": "false", 2024-04-26T12:27:10.884 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_fiemap_threshold": "4096", 2024-04-26T12:27:10.884 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-26T12:27:10.884 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-26T12:27:10.884 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_inject_stall": "0", 2024-04-26T12:27:10.884 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_journal_parallel": "false", 2024-04-26T12:27:10.884 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_journal_trailing": "false", 2024-04-26T12:27:10.884 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_journal_writeahead": "false", 2024-04-26T12:27:10.884 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_kill_at": "0", 2024-04-26T12:27:10.884 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-26T12:27:10.884 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-26T12:27:10.884 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-26T12:27:10.885 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-26T12:27:10.885 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-26T12:27:10.885 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattrs": "0", 2024-04-26T12:27:10.885 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-26T12:27:10.885 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-26T12:27:10.885 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-26T12:27:10.885 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-26T12:27:10.885 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_xattr_value_size": "0", 2024-04-26T12:27:10.885 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-26T12:27:10.885 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-26T12:27:10.885 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-26T12:27:10.885 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_merge_threshold": "-10", 2024-04-26T12:27:10.885 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-26T12:27:10.885 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_odsync_write": "false", 2024-04-26T12:27:10.886 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_omap_backend": "rocksdb", 2024-04-26T12:27:10.886 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_omap_backend_path": "", 2024-04-26T12:27:10.886 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-26T12:27:10.886 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-26T12:27:10.886 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-26T12:27:10.886 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_op_thread_timeout": "60", 2024-04-26T12:27:10.886 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_op_threads": "2", 2024-04-26T12:27:10.886 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_punch_hole": "false", 2024-04-26T12:27:10.886 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-26T12:27:10.886 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-26T12:27:10.886 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-26T12:27:10.886 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-26T12:27:10.886 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-26T12:27:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-26T12:27:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-26T12:27:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-26T12:27:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-26T12:27:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_queue_max_ops": "50", 2024-04-26T12:27:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-26T12:27:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_seek_data_hole": "false", 2024-04-26T12:27:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_sloppy_crc": "false", 2024-04-26T12:27:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-26T12:27:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_splice": "false", 2024-04-26T12:27:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_split_multiple": "2", 2024-04-26T12:27:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_split_rand_factor": "20", 2024-04-26T12:27:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_update_to": "1000", 2024-04-26T12:27:10.887 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_enable": "true", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_xfs_extsize": "false", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "filestore_zfs_snap": "false", 2024-04-26T12:27:10.888 INFO:teuthology.orchestra.run.smithi046.stdout: "fio_dir": "/tmp/fio", 2024-04-26T12:27:10.889 INFO:teuthology.orchestra.run.smithi046.stdout: "fsid": "3dd84416-f290-4721-94ce-52b0ffaacf34", 2024-04-26T12:27:10.889 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_allow_other": "true", 2024-04-26T12:27:10.889 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_atomic_o_trunc": "true", 2024-04-26T12:27:10.889 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_big_writes": "true", 2024-04-26T12:27:10.889 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_debug": "false", 2024-04-26T12:27:10.889 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_default_permissions": "false", 2024-04-26T12:27:10.889 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_disable_pagecache": "false", 2024-04-26T12:27:10.889 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_max_write": "0", 2024-04-26T12:27:10.889 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_multithreaded": "true", 2024-04-26T12:27:10.889 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_require_active_mds": "true", 2024-04-26T12:27:10.889 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_set_user_groups": "true", 2024-04-26T12:27:10.889 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_splice_move": "true", 2024-04-26T12:27:10.889 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_splice_read": "true", 2024-04-26T12:27:10.889 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_splice_write": "true", 2024-04-26T12:27:10.890 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-26T12:27:10.890 INFO:teuthology.orchestra.run.smithi046.stdout: "fuse_use_invalidate_cb": "true", 2024-04-26T12:27:10.890 INFO:teuthology.orchestra.run.smithi046.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-26T12:27:10.890 INFO:teuthology.orchestra.run.smithi046.stdout: "gss_target_name": "ceph", 2024-04-26T12:27:10.890 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_file": "", 2024-04-26T12:27:10.890 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_inject_failure": "0", 2024-04-26T12:27:10.890 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_interval": "5", 2024-04-26T12:27:10.890 INFO:teuthology.orchestra.run.smithi046.stdout: "host": "smithi046", 2024-04-26T12:27:10.890 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-26T12:27:10.890 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-26T12:27:10.890 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-26T12:27:10.890 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-26T12:27:10.890 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-26T12:27:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-26T12:27:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-26T12:27:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-26T12:27:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-26T12:27:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-26T12:27:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-26T12:27:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-26T12:27:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-26T12:27:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: "inject_early_sigterm": "false", 2024-04-26T12:27:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: "jaeger_agent_port": "6799", 2024-04-26T12:27:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: "jaeger_tracing_enable": "false", 2024-04-26T12:27:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_aio": "true", 2024-04-26T12:27:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_align_min_size": "65536", 2024-04-26T12:27:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_block_align": "true", 2024-04-26T12:27:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_block_size": "4096", 2024-04-26T12:27:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_dio": "true", 2024-04-26T12:27:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_discard": "false", 2024-04-26T12:27:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_force_aio": "false", 2024-04-26T12:27:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_ignore_corruption": "false", 2024-04-26T12:27:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_max_write_bytes": "10485760", 2024-04-26T12:27:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_max_write_entries": "100", 2024-04-26T12:27:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_replay_from": "0", 2024-04-26T12:27:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-26T12:27:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-26T12:27:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-26T12:27:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-26T12:27:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_write_header_frequency": "0", 2024-04-26T12:27:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: "journal_zero_on_create": "false", 2024-04-26T12:27:10.893 INFO:teuthology.orchestra.run.smithi046.stdout: "journaler_prefetch_periods": "10", 2024-04-26T12:27:10.893 INFO:teuthology.orchestra.run.smithi046.stdout: "journaler_prezero_periods": "5", 2024-04-26T12:27:10.893 INFO:teuthology.orchestra.run.smithi046.stdout: "journaler_write_head_interval": "15", 2024-04-26T12:27:10.893 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "", 2024-04-26T12:27:10.893 INFO:teuthology.orchestra.run.smithi046.stdout: "keyfile": "", 2024-04-26T12:27:10.893 INFO:teuthology.orchestra.run.smithi046.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-26T12:27:10.893 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_backend": "rocksdb", 2024-04-26T12:27:10.893 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_default_stripe_size": "65536", 2024-04-26T12:27:10.893 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_fsck_on_mount": "false", 2024-04-26T12:27:10.893 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-26T12:27:10.893 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_max_bytes": "67108864", 2024-04-26T12:27:10.893 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_max_ops": "512", 2024-04-26T12:27:10.893 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_nid_prealloc": "1024", 2024-04-26T12:27:10.893 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_onode_map_size": "1024", 2024-04-26T12:27:10.894 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-26T12:27:10.894 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_sync_submit_transaction": "false", 2024-04-26T12:27:10.894 INFO:teuthology.orchestra.run.smithi046.stdout: "kstore_sync_transaction": "false", 2024-04-26T12:27:10.894 INFO:teuthology.orchestra.run.smithi046.stdout: "leveldb_block_size": "65536", 2024-04-26T12:27:10.894 INFO:teuthology.orchestra.run.smithi046.stdout: "leveldb_bloom_size": "0", 2024-04-26T12:27:10.894 INFO:teuthology.orchestra.run.smithi046.stdout: "leveldb_cache_size": "536870912", 2024-04-26T12:27:10.894 INFO:teuthology.orchestra.run.smithi046.stdout: "leveldb_compact_on_mount": "false", 2024-04-26T12:27:10.894 INFO:teuthology.orchestra.run.smithi046.stdout: "leveldb_compression": "false", 2024-04-26T12:27:10.894 INFO:teuthology.orchestra.run.smithi046.stdout: "leveldb_log": "", 2024-04-26T12:27:10.894 INFO:teuthology.orchestra.run.smithi046.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-26T12:27:10.894 INFO:teuthology.orchestra.run.smithi046.stdout: "leveldb_max_open_files": "0", 2024-04-26T12:27:10.894 INFO:teuthology.orchestra.run.smithi046.stdout: "leveldb_paranoid": "false", 2024-04-26T12:27:10.894 INFO:teuthology.orchestra.run.smithi046.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-26T12:27:10.894 INFO:teuthology.orchestra.run.smithi046.stdout: "librados_thread_count": "2", 2024-04-26T12:27:10.895 INFO:teuthology.orchestra.run.smithi046.stdout: "lockdep": "false", 2024-04-26T12:27:10.895 INFO:teuthology.orchestra.run.smithi046.stdout: "lockdep_force_backtrace": "false", 2024-04-26T12:27:10.895 INFO:teuthology.orchestra.run.smithi046.stdout: "log_coarse_timestamps": "true", 2024-04-26T12:27:10.895 INFO:teuthology.orchestra.run.smithi046.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-26T12:27:10.895 INFO:teuthology.orchestra.run.smithi046.stdout: "log_flush_on_exit": "false", 2024-04-26T12:27:10.895 INFO:teuthology.orchestra.run.smithi046.stdout: "log_graylog_host": "127.0.0.1", 2024-04-26T12:27:10.895 INFO:teuthology.orchestra.run.smithi046.stdout: "log_graylog_port": "12201", 2024-04-26T12:27:10.895 INFO:teuthology.orchestra.run.smithi046.stdout: "log_max_new": "1000", 2024-04-26T12:27:10.895 INFO:teuthology.orchestra.run.smithi046.stdout: "log_max_recent": "10000", 2024-04-26T12:27:10.895 INFO:teuthology.orchestra.run.smithi046.stdout: "log_stderr_prefix": "", 2024-04-26T12:27:10.895 INFO:teuthology.orchestra.run.smithi046.stdout: "log_stop_at_utilization": "0.970000", 2024-04-26T12:27:10.895 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": "true", 2024-04-26T12:27:10.895 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_graylog": "false", 2024-04-26T12:27:10.896 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_journald": "false", 2024-04-26T12:27:10.896 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_stderr": "false", 2024-04-26T12:27:10.896 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_syslog": "false", 2024-04-26T12:27:10.896 INFO:teuthology.orchestra.run.smithi046.stdout: "max_rotating_auth_attempts": "10", 2024-04-26T12:27:10.896 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-26T12:27:10.896 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_action_on_write_error": "1", 2024-04-26T12:27:10.896 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_alternate_name_max": "8192", 2024-04-26T12:27:10.896 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_asio_thread_count": "2", 2024-04-26T12:27:10.896 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_export_pin": "true", 2024-04-26T12:27:10.896 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_fragment_dirs": "true", 2024-04-26T12:27:10.896 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-26T12:27:10.896 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_fragment_interval": "5", 2024-04-26T12:27:10.896 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-26T12:27:10.896 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-26T12:27:10.897 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_interval": "10", 2024-04-26T12:27:10.897 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_max": "-1", 2024-04-26T12:27:10.897 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_max_until": "-1", 2024-04-26T12:27:10.897 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_merge_size": "50", 2024-04-26T12:27:10.897 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_midchunk": "0.300000", 2024-04-26T12:27:10.897 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-26T12:27:10.897 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_min_start": "0.200000", 2024-04-26T12:27:10.897 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_minchunk": "0.001000", 2024-04-26T12:27:10.897 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_mode": "0", 2024-04-26T12:27:10.897 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_need_max": "1.200000", 2024-04-26T12:27:10.897 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_need_min": "0.800000", 2024-04-26T12:27:10.897 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-26T12:27:10.898 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-26T12:27:10.898 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_split_bits": "3", 2024-04-26T12:27:10.898 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-26T12:27:10.898 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_split_size": "10000", 2024-04-26T12:27:10.898 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-26T12:27:10.898 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_target_decay": "10.000000", 2024-04-26T12:27:10.898 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-26T12:27:10.898 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_beacon_grace": "15.000000", 2024-04-26T12:27:10.898 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_beacon_interval": "4.000000", 2024-04-26T12:27:10.898 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-26T12:27:10.898 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-26T12:27:10.898 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache_mid": "0.700000", 2024-04-26T12:27:10.898 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache_release_free_interval": "10", 2024-04-26T12:27:10.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache_reservation": "0.050000", 2024-04-26T12:27:10.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-26T12:27:10.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache_trim_interval": "1", 2024-04-26T12:27:10.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache_trim_threshold": "262144", 2024-04-26T12:27:10.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-26T12:27:10.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-26T12:27:10.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-26T12:27:10.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_client_prealloc_inos": "1000", 2024-04-26T12:27:10.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-26T12:27:10.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_connect_bootstrapping": "false", 2024-04-26T12:27:10.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_damage_table_max_entries": "10000", 2024-04-26T12:27:10.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-26T12:27:10.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_debug_auth_pins": "false", 2024-04-26T12:27:10.899 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_debug_frag": "false", 2024-04-26T12:27:10.900 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_debug_scatterstat": "false", 2024-04-26T12:27:10.900 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_debug_subtrees": "false", 2024-04-26T12:27:10.900 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_decay_halflife": "5.000000", 2024-04-26T12:27:10.900 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_default_dir_hash": "2", 2024-04-26T12:27:10.900 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_defer_session_stale": "true", 2024-04-26T12:27:10.900 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_deny_all_reconnect": "false", 2024-04-26T12:27:10.900 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dir_keys_per_op": "16384", 2024-04-26T12:27:10.900 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dir_max_commit_size": "10", 2024-04-26T12:27:10.900 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dir_max_entries": "0", 2024-04-26T12:27:10.900 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dir_prefetch": "true", 2024-04-26T12:27:10.900 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-26T12:27:10.900 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-26T12:27:10.900 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dump_cache_on_map": "false", 2024-04-26T12:27:10.900 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-26T12:27:10.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-26T12:27:10.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_early_reply": "true", 2024-04-26T12:27:10.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_enable_op_tracker": "true", 2024-04-26T12:27:10.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_enforce_unique_name": "true", 2024-04-26T12:27:10.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-26T12:27:10.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-26T12:27:10.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_export_ephemeral_random": "true", 2024-04-26T12:27:10.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-26T12:27:10.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-26T12:27:10.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-26T12:27:10.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-26T12:27:10.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-26T12:27:10.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-26T12:27:10.901 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-26T12:27:10.902 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-26T12:27:10.902 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_health_summarize_threshold": "10", 2024-04-26T12:27:10.902 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-26T12:27:10.902 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-26T12:27:10.902 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_inject_health_dummy": "false", 2024-04-26T12:27:10.902 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-26T12:27:10.902 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_inject_migrator_session_race": "false", 2024-04-26T12:27:10.902 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-26T12:27:10.902 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-26T12:27:10.902 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-26T12:27:10.902 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_join_fs": "", 2024-04-26T12:27:10.902 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_journal_format": "1", 2024-04-26T12:27:10.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_create_at": "0", 2024-04-26T12:27:10.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_export_at": "0", 2024-04-26T12:27:10.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_import_at": "0", 2024-04-26T12:27:10.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_journal_at": "0", 2024-04-26T12:27:10.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_journal_expire_at": "0", 2024-04-26T12:27:10.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_journal_replay_at": "0", 2024-04-26T12:27:10.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_link_at": "0", 2024-04-26T12:27:10.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_mdstable_at": "0", 2024-04-26T12:27:10.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_openc_at": "0", 2024-04-26T12:27:10.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_rename_at": "0", 2024-04-26T12:27:10.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-26T12:27:10.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_events_per_segment": "1024", 2024-04-26T12:27:10.903 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_max_events": "-1", 2024-04-26T12:27:10.904 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_max_segments": "128", 2024-04-26T12:27:10.904 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_pause": "false", 2024-04-26T12:27:10.904 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_segment_size": "0", 2024-04-26T12:27:10.904 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-26T12:27:10.904 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log_warn_factor": "2.000000", 2024-04-26T12:27:10.904 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_caps_per_client": "1048576", 2024-04-26T12:27:10.904 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_completed_flushes": "100000", 2024-04-26T12:27:10.904 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_completed_requests": "100000", 2024-04-26T12:27:10.904 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_export_size": "20971520", 2024-04-26T12:27:10.904 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_file_recover": "32", 2024-04-26T12:27:10.904 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_purge_files": "64", 2024-04-26T12:27:10.904 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_purge_ops": "8192", 2024-04-26T12:27:10.904 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-26T12:27:10.905 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-26T12:27:10.905 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_max_snaps_per_dir": "100", 2024-04-26T12:27:10.905 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_metrics_update_interval": "2", 2024-04-26T12:27:10.905 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_min_caps_per_client": "100", 2024-04-26T12:27:10.905 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_min_caps_working_set": "10000", 2024-04-26T12:27:10.905 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-26T12:27:10.905 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_numa_node": "-1", 2024-04-26T12:27:10.905 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-26T12:27:10.905 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_op_complaint_time": "30.000000", 2024-04-26T12:27:10.905 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_op_history_duration": "600", 2024-04-26T12:27:10.905 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_op_history_size": "20", 2024-04-26T12:27:10.905 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_op_history_slow_op_size": "20", 2024-04-26T12:27:10.905 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-26T12:27:10.905 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_op_log_threshold": "5", 2024-04-26T12:27:10.906 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_ping_grace": "15", 2024-04-26T12:27:10.906 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_ping_interval": "5", 2024-04-26T12:27:10.906 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-26T12:27:10.906 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-26T12:27:10.906 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_recall_max_caps": "30000", 2024-04-26T12:27:10.906 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-26T12:27:10.906 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-26T12:27:10.906 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-26T12:27:10.906 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_recall_warning_threshold": "262144", 2024-04-26T12:27:10.906 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-26T12:27:10.906 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_replay_interval": "1.000000", 2024-04-26T12:27:10.906 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-26T12:27:10.906 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-26T12:27:10.906 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_root_ino_gid": "0", 2024-04-26T12:27:10.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_root_ino_uid": "0", 2024-04-26T12:27:10.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-26T12:27:10.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-26T12:27:10.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-26T12:27:10.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-26T12:27:10.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-26T12:27:10.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-26T12:27:10.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-26T12:27:10.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-26T12:27:10.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-26T12:27:10.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-26T12:27:10.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_shutdown_check": "0", 2024-04-26T12:27:10.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_skip_ino": "0", 2024-04-26T12:27:10.907 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-26T12:27:10.908 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_snap_max_uid": "4294967294", 2024-04-26T12:27:10.908 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_snap_min_uid": "0", 2024-04-26T12:27:10.908 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_snap_rstat": "false", 2024-04-26T12:27:10.908 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_standby_replay_damaged": "false", 2024-04-26T12:27:10.908 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_symlink_recovery": "true", 2024-04-26T12:27:10.908 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-26T12:27:10.908 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_thrash_exports": "0", 2024-04-26T12:27:10.908 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_thrash_fragments": "0", 2024-04-26T12:27:10.908 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_tick_interval": "5.000000", 2024-04-26T12:27:10.908 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_valgrind_exit": "false", 2024-04-26T12:27:10.908 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_verify_backtrace": "1", 2024-04-26T12:27:10.908 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_verify_scatter": "false", 2024-04-26T12:27:10.908 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-26T12:27:10.908 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_wipe_sessions": "false", 2024-04-26T12:27:10.909 INFO:teuthology.orchestra.run.smithi046.stdout: "mempool_debug": "false", 2024-04-26T12:27:10.909 INFO:teuthology.orchestra.run.smithi046.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-26T12:27:10.909 INFO:teuthology.orchestra.run.smithi046.stdout: "memstore_device_bytes": "1073741824", 2024-04-26T12:27:10.909 INFO:teuthology.orchestra.run.smithi046.stdout: "memstore_page_set": "false", 2024-04-26T12:27:10.909 INFO:teuthology.orchestra.run.smithi046.stdout: "memstore_page_size": "65536", 2024-04-26T12:27:10.909 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_client_bytes": "134217728", 2024-04-26T12:27:10.909 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_client_messages": "512", 2024-04-26T12:27:10.909 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-26T12:27:10.909 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-26T12:27:10.909 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-26T12:27:10.909 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-26T12:27:10.909 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_disabled_modules": "", 2024-04-26T12:27:10.909 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-26T12:27:10.910 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_max_pg_num_change": "128", 2024-04-26T12:27:10.910 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_mds_bytes": "134217728", 2024-04-26T12:27:10.910 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_mds_messages": "128", 2024-04-26T12:27:10.910 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-26T12:27:10.910 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_mon_bytes": "134217728", 2024-04-26T12:27:10.910 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_mon_messages": "128", 2024-04-26T12:27:10.910 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_osd_bytes": "536870912", 2024-04-26T12:27:10.910 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_osd_messages": "8192", 2024-04-26T12:27:10.910 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_pool": "true", 2024-04-26T12:27:10.910 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-26T12:27:10.910 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_standby_modules": "true", 2024-04-26T12:27:10.910 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_stats_period": "5", 2024-04-26T12:27:10.910 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_stats_threshold": "5", 2024-04-26T12:27:10.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_tick_period": "2", 2024-04-26T12:27:10.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-26T12:27:10.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-26T12:27:10.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_allow_pool_delete": "true", 2024-04-26T12:27:10.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_allow_pool_size_one": "true", 2024-04-26T12:27:10.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_auth_validate_all_caps": "true", 2024-04-26T12:27:10.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-26T12:27:10.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-26T12:27:10.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_bytes": "104857600", 2024-04-26T12:27:10.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_directed_command_retry": "2", 2024-04-26T12:27:10.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-26T12:27:10.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-26T12:27:10.911 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-26T12:27:10.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-26T12:27:10.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_hunt_parallel": "3", 2024-04-26T12:27:10.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_log_interval": "1.000000", 2024-04-26T12:27:10.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-26T12:27:10.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_ping_interval": "10.000000", 2024-04-26T12:27:10.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-26T12:27:10.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-26T12:27:10.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-26T12:27:10.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-26T12:27:10.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_file_level": "debug", 2024-04-26T12:27:10.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_file": "true", 2024-04-26T12:27:10.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-26T12:27:10.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-26T12:27:10.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-26T12:27:10.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_journald": "false", 2024-04-26T12:27:10.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-26T12:27:10.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-26T12:27:10.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-26T12:27:10.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-26T12:27:10.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_compact_on_bootstrap": "false", 2024-04-26T12:27:10.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_compact_on_start": "false", 2024-04-26T12:27:10.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_compact_on_trim": "true", 2024-04-26T12:27:10.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-26T12:27:10.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-26T12:27:10.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-26T12:27:10.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_cpu_threads": "4", 2024-04-26T12:27:10.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_crush_min_required_version": "hammer", 2024-04-26T12:27:10.913 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_daemon_bytes": "419430400", 2024-04-26T12:27:10.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-26T12:27:10.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_data_avail_crit": "5", 2024-04-26T12:27:10.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_data_avail_warn": "5", 2024-04-26T12:27:10.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_data_size_warn": "16106127360", 2024-04-26T12:27:10.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-26T12:27:10.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-26T12:27:10.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_dump_json": "false", 2024-04-26T12:27:10.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-26T12:27:10.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_dump_transactions": "false", 2024-04-26T12:27:10.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_extra_checks": "false", 2024-04-26T12:27:10.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-26T12:27:10.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-26T12:27:10.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_no_require_quincy": "false", 2024-04-26T12:27:10.914 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_no_require_reef": "false", 2024-04-26T12:27:10.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-26T12:27:10.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-26T12:27:10.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-26T12:27:10.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_down_mkfs_grace": "120", 2024-04-26T12:27:10.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_election_default_strategy": "1", 2024-04-26T12:27:10.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_election_timeout": "5.000000", 2024-04-26T12:27:10.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-26T12:27:10.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_elector_ping_divisor": "2", 2024-04-26T12:27:10.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-26T12:27:10.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_enable_op_tracker": "true", 2024-04-26T12:27:10.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_fake_pool_delete": "false", 2024-04-26T12:27:10.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_force_quorum_join": "false", 2024-04-26T12:27:10.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_globalid_prealloc": "10000", 2024-04-26T12:27:10.915 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_health_detail_to_clog": "false", 2024-04-26T12:27:10.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_health_log_update_period": "5", 2024-04-26T12:27:10.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_health_max_detail": "50", 2024-04-26T12:27:10.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_health_to_clog": "true", 2024-04-26T12:27:10.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_health_to_clog_interval": "600", 2024-04-26T12:27:10.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-26T12:27:10.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_host": "172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],[v2:172.21.15.46:3302,v1:172.21.15.46:6791]", 2024-04-26T12:27:10.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_host_override": "", 2024-04-26T12:27:10.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_initial_members": "", 2024-04-26T12:27:10.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-26T12:27:10.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-26T12:27:10.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-26T12:27:10.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-26T12:27:10.916 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-26T12:27:10.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_lease": "5.000000", 2024-04-26T12:27:10.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-26T12:27:10.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-26T12:27:10.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_log_full_interval": "50", 2024-04-26T12:27:10.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_log_max": "10000", 2024-04-26T12:27:10.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_log_max_summary": "50", 2024-04-26T12:27:10.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-26T12:27:10.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_log_epochs": "500", 2024-04-26T12:27:10.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-26T12:27:10.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-26T12:27:10.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_osd": "10000", 2024-04-26T12:27:10.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_pg_per_osd": "10000", 2024-04-26T12:27:10.917 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_pool_pg_num": "65536", 2024-04-26T12:27:10.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-26T12:27:10.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-26T12:27:10.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mds_force_trim_to": "0", 2024-04-26T12:27:10.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mds_skip_sanity": "false", 2024-04-26T12:27:10.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_memory_autotune": "true", 2024-04-26T12:27:10.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_memory_target": "2147483648", 2024-04-26T12:27:10.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mgr_beacon_grace": "30", 2024-04-26T12:27:10.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-26T12:27:10.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mgr_digest_period": "5", 2024-04-26T12:27:10.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mgr_inactive_grace": "60", 2024-04-26T12:27:10.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-26T12:27:10.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-26T12:27:10.918 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_min_osdmap_epochs": "500", 2024-04-26T12:27:10.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_op_complaint_time": "30", 2024-04-26T12:27:10.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_op_history_duration": "600", 2024-04-26T12:27:10.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_op_history_size": "20", 2024-04-26T12:27:10.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_op_history_slow_op_size": "20", 2024-04-26T12:27:10.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-26T12:27:10.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_op_log_threshold": "5", 2024-04-26T12:27:10.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-26T12:27:10.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-26T12:27:10.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-26T12:27:10.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_auto_mark_in": "false", 2024-04-26T12:27:10.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-26T12:27:10.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-26T12:27:10.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-26T12:27:10.919 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_cache_size": "500", 2024-04-26T12:27:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-26T12:27:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-26T12:27:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-26T12:27:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_down_out_interval": "600", 2024-04-26T12:27:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-26T12:27:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-26T12:27:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_force_trim_to": "0", 2024-04-26T12:27:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-26T12:27:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-26T12:27:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-26T12:27:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-26T12:27:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-26T12:27:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-26T12:27:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-26T12:27:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-26T12:27:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_min_down_reporters": "2", 2024-04-26T12:27:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-26T12:27:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-26T12:27:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-26T12:27:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-26T12:27:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-26T12:27:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-26T12:27:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_report_timeout": "900", 2024-04-26T12:27:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-26T12:27:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-26T12:27:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-26T12:27:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-26T12:27:10.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-26T12:27:10.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-26T12:27:10.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-26T12:27:10.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-26T12:27:10.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-26T12:27:10.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pg_stuck_threshold": "60", 2024-04-26T12:27:10.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-26T12:27:10.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-26T12:27:10.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-26T12:27:10.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-26T12:27:10.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-26T12:27:10.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-26T12:27:10.922 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_probe_timeout": "2.000000", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_reweight_max_change": "0.050000", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_reweight_max_osds": "4", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_scrub_interval": "86400", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_scrub_max_keys": "100", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_scrub_timeout": "300", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_session_timeout": "300", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_smart_report_timeout": "5", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_stat_smooth_intervals": "6", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-26T12:27:10.923 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_stretch_pool_min_size": "2", 2024-04-26T12:27:10.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_stretch_pool_size": "4", 2024-04-26T12:27:10.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-26T12:27:10.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-26T12:27:10.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_sync_debug": "false", 2024-04-26T12:27:10.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-26T12:27:10.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-26T12:27:10.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_sync_provider_kill_at": "0", 2024-04-26T12:27:10.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_sync_requester_kill_at": "0", 2024-04-26T12:27:10.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_sync_timeout": "60.000000", 2024-04-26T12:27:10.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_target_pg_per_osd": "100", 2024-04-26T12:27:10.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_tick_interval": "5", 2024-04-26T12:27:10.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_timecheck_interval": "300.000000", 2024-04-26T12:27:10.924 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-26T12:27:10.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_use_min_delay_socket": "false", 2024-04-26T12:27:10.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_older_version_delay": "604800", 2024-04-26T12:27:10.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-26T12:27:10.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-26T12:27:10.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-26T12:27:10.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-26T12:27:10.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-26T12:27:10.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-26T12:27:10.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-26T12:27:10.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_misplaced": "false", 2024-04-26T12:27:10.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-26T12:27:10.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_older_version": "true", 2024-04-26T12:27:10.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-26T12:27:10.925 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-26T12:27:10.926 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-26T12:27:10.926 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-26T12:27:10.926 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-26T12:27:10.926 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-26T12:27:10.926 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-26T12:27:10.926 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-26T12:27:10.926 INFO:teuthology.orchestra.run.smithi046.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-26T12:27:10.926 INFO:teuthology.orchestra.run.smithi046.stdout: "monmap": "", 2024-04-26T12:27:10.926 INFO:teuthology.orchestra.run.smithi046.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T12:27:10.926 INFO:teuthology.orchestra.run.smithi046.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-26T12:27:10.926 INFO:teuthology.orchestra.run.smithi046.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-26T12:27:10.926 INFO:teuthology.orchestra.run.smithi046.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T12:27:10.926 INFO:teuthology.orchestra.run.smithi046.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-26T12:27:10.927 INFO:teuthology.orchestra.run.smithi046.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-26T12:27:10.927 INFO:teuthology.orchestra.run.smithi046.stdout: "motr_tracing_enabled": "false", 2024-04-26T12:27:10.927 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_op_threads": "3", 2024-04-26T12:27:10.927 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-26T12:27:10.927 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_cm": "false", 2024-04-26T12:27:10.927 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_device_name": "", 2024-04-26T12:27:10.927 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_dscp": "96", 2024-04-26T12:27:10.927 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-26T12:27:10.927 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-26T12:27:10.927 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_local_gid": "", 2024-04-26T12:27:10.927 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-26T12:27:10.927 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_port_num": "1", 2024-04-26T12:27:10.927 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-26T12:27:10.927 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-26T12:27:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-26T12:27:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-26T12:27:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_sl": "3", 2024-04-26T12:27:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_support_srq": "true", 2024-04-26T12:27:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_rdma_type": "ib", 2024-04-26T12:27:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_async_reap_threshold": "5", 2024-04-26T12:27:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_before_connect": "false", 2024-04-26T12:27:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_ipv4": "true", 2024-04-26T12:27:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_ipv6": "false", 2024-04-26T12:27:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_msgr1": "true", 2024-04-26T12:27:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_msgr2": "true", 2024-04-26T12:27:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_port_max": "7568", 2024-04-26T12:27:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_port_min": "6800", 2024-04-26T12:27:10.928 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-26T12:27:10.929 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_retry_count": "3", 2024-04-26T12:27:10.929 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_bind_retry_delay": "5", 2024-04-26T12:27:10.929 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_blackhole_client": "false", 2024-04-26T12:27:10.929 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_blackhole_mds": "false", 2024-04-26T12:27:10.929 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_blackhole_mgr": "false", 2024-04-26T12:27:10.929 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_blackhole_mon": "false", 2024-04-26T12:27:10.929 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_blackhole_osd": "false", 2024-04-26T12:27:10.929 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_client_mode": "crc secure", 2024-04-26T12:27:10.929 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_cluster_mode": "crc secure", 2024-04-26T12:27:10.929 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_cluster_type": "", 2024-04-26T12:27:10.929 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_compress_secure": "false", 2024-04-26T12:27:10.929 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_connection_idle_timeout": "900", 2024-04-26T12:27:10.929 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_connection_ready_timeout": "10", 2024-04-26T12:27:10.930 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_crc_data": "true", 2024-04-26T12:27:10.930 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_crc_header": "true", 2024-04-26T12:27:10.930 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_die_on_bad_msg": "false", 2024-04-26T12:27:10.930 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_die_on_bug": "true", 2024-04-26T12:27:10.930 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_die_on_old_message": "true", 2024-04-26T12:27:10.930 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_die_on_skipped_message": "false", 2024-04-26T12:27:10.930 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-26T12:27:10.930 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-26T12:27:10.930 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_coremask": "0xF", 2024-04-26T12:27:10.930 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-26T12:27:10.930 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-26T12:27:10.930 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_enable_tso": "true", 2024-04-26T12:27:10.930 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-26T12:27:10.930 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-26T12:27:10.931 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_hugepages": "", 2024-04-26T12:27:10.931 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-26T12:27:10.931 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-26T12:27:10.931 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_lro": "true", 2024-04-26T12:27:10.931 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_memory_channel": "4", 2024-04-26T12:27:10.931 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-26T12:27:10.931 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_pmd": "", 2024-04-26T12:27:10.931 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_port_id": "0", 2024-04-26T12:27:10.931 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-26T12:27:10.931 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-26T12:27:10.931 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_dump_on_send": "false", 2024-04-26T12:27:10.931 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_initial_backoff": "0.200000", 2024-04-26T12:27:10.931 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_inject_delay_max": "1.000000", 2024-04-26T12:27:10.931 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-26T12:27:10.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_inject_delay_type": "", 2024-04-26T12:27:10.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-26T12:27:10.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_inject_network_congestion": "0", 2024-04-26T12:27:10.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_inject_socket_failures": "0", 2024-04-26T12:27:10.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_learn_addr_from_peer": "true", 2024-04-26T12:27:10.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_max_accept_failures": "4", 2024-04-26T12:27:10.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_max_backoff": "15.000000", 2024-04-26T12:27:10.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_mon_client_mode": "secure crc", 2024-04-26T12:27:10.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-26T12:27:10.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_mon_service_mode": "secure crc", 2024-04-26T12:27:10.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_osd_compress_min_size": "1024", 2024-04-26T12:27:10.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_osd_compress_mode": "none", 2024-04-26T12:27:10.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-26T12:27:10.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-26T12:27:10.933 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_pq_min_cost": "65536", 2024-04-26T12:27:10.933 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_public_type": "", 2024-04-26T12:27:10.933 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_service_mode": "crc secure", 2024-04-26T12:27:10.933 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_tcp_listen_backlog": "512", 2024-04-26T12:27:10.933 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_tcp_nodelay": "true", 2024-04-26T12:27:10.933 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-26T12:27:10.933 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_tcp_rcvbuf": "0", 2024-04-26T12:27:10.933 INFO:teuthology.orchestra.run.smithi046.stdout: "ms_type": "async+posix", 2024-04-26T12:27:10.933 INFO:teuthology.orchestra.run.smithi046.stdout: "no_config_file": "false", 2024-04-26T12:27:10.933 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_completion_locks_per_session": "32", 2024-04-26T12:27:10.933 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-26T12:27:10.933 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-26T12:27:10.933 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_inflight_ops": "1024", 2024-04-26T12:27:10.934 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-26T12:27:10.934 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-26T12:27:10.934 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_tick_interval": "5.000000", 2024-04-26T12:27:10.934 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter_timeout": "10.000000", 2024-04-26T12:27:10.934 INFO:teuthology.orchestra.run.smithi046.stdout: "objectstore_blackhole": "false", 2024-04-26T12:27:10.934 INFO:teuthology.orchestra.run.smithi046.stdout: "openssl_engine_opts": "", 2024-04-26T12:27:10.934 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_agent_delay_time": "5.000000", 2024-04-26T12:27:10.934 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_agent_hist_halflife": "1000", 2024-04-26T12:27:10.934 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_agent_max_low_ops": "2", 2024-04-26T12:27:10.934 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_agent_max_ops": "4", 2024-04-26T12:27:10.934 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-26T12:27:10.934 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-26T12:27:10.935 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_agent_slop": "0.020000", 2024-04-26T12:27:10.935 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-26T12:27:10.935 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-26T12:27:10.935 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_asio_thread_count": "2", 2024-04-26T12:27:10.935 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_async_recovery_min_cost": "100", 2024-04-26T12:27:10.935 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-26T12:27:10.935 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-26T12:27:10.935 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_backfill_scan_max": "512", 2024-04-26T12:27:10.935 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_backfill_scan_min": "64", 2024-04-26T12:27:10.935 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_backoff_on_degraded": "false", 2024-04-26T12:27:10.935 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_backoff_on_peering": "false", 2024-04-26T12:27:10.935 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_backoff_on_unfound": "true", 2024-04-26T12:27:10.935 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_beacon_report_interval": "300", 2024-04-26T12:27:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bench_duration": "30", 2024-04-26T12:27:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-26T12:27:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bench_max_block_size": "67108864", 2024-04-26T12:27:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-26T12:27:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_blkin_trace_all": "false", 2024-04-26T12:27:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-26T12:27:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-26T12:27:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-26T12:27:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-26T12:27:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_check_for_log_corruption": "false", 2024-04-26T12:27:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-26T12:27:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T12:27:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-26T12:27:10.937 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T12:27:10.937 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_class_update_on_start": "true", 2024-04-26T12:27:10.937 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_client_message_cap": "256", 2024-04-26T12:27:10.937 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_client_message_size_cap": "524288000", 2024-04-26T12:27:10.937 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_client_op_priority": "63", 2024-04-26T12:27:10.937 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_client_watch_timeout": "30", 2024-04-26T12:27:10.937 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_command_max_records": "256", 2024-04-26T12:27:10.937 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_compact_on_start": "false", 2024-04-26T12:27:10.937 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-26T12:27:10.937 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-26T12:27:10.937 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-26T12:27:10.937 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_crush_update_on_start": "true", 2024-04-26T12:27:10.937 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_crush_update_weight_set": "true", 2024-04-26T12:27:10.937 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-26T12:27:10.938 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-26T12:27:10.938 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-26T12:27:10.938 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-26T12:27:10.938 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-26T12:27:10.938 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_feed_pullee": "-1", 2024-04-26T12:27:10.938 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-26T12:27:10.938 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-26T12:27:10.938 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-26T12:27:10.938 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_misdirected_ops": "false", 2024-04-26T12:27:10.938 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_no_acting_change": "false", 2024-04-26T12:27:10.938 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_no_purge_strays": "false", 2024-04-26T12:27:10.938 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_op_order": "false", 2024-04-26T12:27:10.938 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-26T12:27:10.939 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-26T12:27:10.939 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-26T12:27:10.939 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-26T12:27:10.939 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_shutdown": "false", 2024-04-26T12:27:10.939 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-26T12:27:10.939 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-26T12:27:10.939 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-26T12:27:10.939 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-26T12:27:10.939 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_verify_snaps": "false", 2024-04-26T12:27:10.939 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-26T12:27:10.939 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-26T12:27:10.939 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_deep_scrub_keys": "1024", 2024-04-26T12:27:10.939 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-26T12:27:10.940 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-26T12:27:10.940 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-26T12:27:10.940 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_deep_scrub_stride": "524288", 2024-04-26T12:27:10.940 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-26T12:27:10.940 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-26T12:27:10.940 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_default_notify_timeout": "30", 2024-04-26T12:27:10.940 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_delete_sleep": "0.000000", 2024-04-26T12:27:10.940 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-26T12:27:10.940 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-26T12:27:10.940 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-26T12:27:10.940 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_discard_disconnected_ops": "true", 2024-04-26T12:27:10.940 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_enable_op_tracker": "true", 2024-04-26T12:27:10.940 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-26T12:27:10.941 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-26T12:27:10.941 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-26T12:27:10.941 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-26T12:27:10.941 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_fast_info": "true", 2024-04-26T12:27:10.941 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_fast_shutdown": "true", 2024-04-26T12:27:10.941 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-26T12:27:10.941 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-26T12:27:10.941 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-26T12:27:10.941 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-26T12:27:10.941 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-26T12:27:10.941 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_function_tracing": "false", 2024-04-26T12:27:10.941 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_heartbeat_grace": "20", 2024-04-26T12:27:10.941 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_heartbeat_interval": "6", 2024-04-26T12:27:10.941 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-26T12:27:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_heartbeat_min_peers": "10", 2024-04-26T12:27:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_heartbeat_min_size": "2000", 2024-04-26T12:27:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_heartbeat_stale": "600", 2024-04-26T12:27:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-26T12:27:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_hit_set_max_size": "100000", 2024-04-26T12:27:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_hit_set_min_size": "1000", 2024-04-26T12:27:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-26T12:27:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-26T12:27:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-26T12:27:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-26T12:27:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-26T12:27:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-26T12:27:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_journal_size": "5120", 2024-04-26T12:27:10.942 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_kill_backfill_at": "0", 2024-04-26T12:27:10.943 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-26T12:27:10.943 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_map_cache_size": "50", 2024-04-26T12:27:10.943 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_map_dedup": "true", 2024-04-26T12:27:10.943 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_map_message_max": "40", 2024-04-26T12:27:10.943 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-26T12:27:10.943 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_map_share_max_epochs": "40", 2024-04-26T12:27:10.943 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_attr_name_len": "100", 2024-04-26T12:27:10.943 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_attr_size": "0", 2024-04-26T12:27:10.943 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_backfills": "1", 2024-04-26T12:27:10.943 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_markdown_count": "5", 2024-04-26T12:27:10.943 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_markdown_period": "600", 2024-04-26T12:27:10.943 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_object_name_len": "2048", 2024-04-26T12:27:10.943 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_object_namespace_len": "256", 2024-04-26T12:27:10.944 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_object_size": "134217728", 2024-04-26T12:27:10.944 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-26T12:27:10.944 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-26T12:27:10.944 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_pg_blocked_by": "16", 2024-04-26T12:27:10.944 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_pg_log_entries": "10000", 2024-04-26T12:27:10.944 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-26T12:27:10.944 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_pgls": "1024", 2024-04-26T12:27:10.944 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_push_cost": "8388608", 2024-04-26T12:27:10.944 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_push_objects": "10", 2024-04-26T12:27:10.944 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_scrubs": "3", 2024-04-26T12:27:10.944 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-26T12:27:10.944 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_trimming_pgs": "2", 2024-04-26T12:27:10.944 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_write_op_reply_len": "64", 2024-04-26T12:27:10.944 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_max_write_size": "90", 2024-04-26T12:27:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-26T12:27:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-26T12:27:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-26T12:27:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-26T12:27:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-26T12:27:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-26T12:27:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-26T12:27:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-26T12:27:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_profile": "balanced", 2024-04-26T12:27:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-26T12:27:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-26T12:27:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-26T12:27:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-26T12:27:10.945 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-26T12:27:10.946 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-26T12:27:10.946 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-26T12:27:10.946 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-26T12:27:10.946 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-26T12:27:10.946 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-26T12:27:10.946 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-26T12:27:10.946 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_memory_base": "805306368", 2024-04-26T12:27:10.946 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_memory_cache_min": "134217728", 2024-04-26T12:27:10.946 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-26T12:27:10.946 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-26T12:27:10.946 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_memory_target": "4294967296", 2024-04-26T12:27:10.946 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_memory_target_autotune": "false", 2024-04-26T12:27:10.946 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-26T12:27:10.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_min_pg_log_entries": "250", 2024-04-26T12:27:10.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_min_recovery_priority": "0", 2024-04-26T12:27:10.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-26T12:27:10.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-26T12:27:10.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mon_report_interval": "5", 2024-04-26T12:27:10.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-26T12:27:10.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-26T12:27:10.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_num_cache_shards": "32", 2024-04-26T12:27:10.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_num_op_tracker_shard": "32", 2024-04-26T12:27:10.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_numa_auto_affinity": "true", 2024-04-26T12:27:10.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_numa_node": "-1", 2024-04-26T12:27:10.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_numa_prefer_iface": "true", 2024-04-26T12:27:10.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-26T12:27:10.947 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_objecter_finishers": "1", 2024-04-26T12:27:10.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_objectstore": "bluestore", 2024-04-26T12:27:10.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_objectstore_fuse": "false", 2024-04-26T12:27:10.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_objectstore_tracing": "false", 2024-04-26T12:27:10.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_complaint_time": "30.000000", 2024-04-26T12:27:10.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_history_duration": "600", 2024-04-26T12:27:10.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_history_size": "20", 2024-04-26T12:27:10.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_history_slow_op_size": "20", 2024-04-26T12:27:10.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-26T12:27:10.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_log_threshold": "5", 2024-04-26T12:27:10.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_num_shards": "0", 2024-04-26T12:27:10.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_num_shards_hdd": "5", 2024-04-26T12:27:10.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_num_shards_ssd": "8", 2024-04-26T12:27:10.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-26T12:27:10.948 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-26T12:27:10.949 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-26T12:27:10.949 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-26T12:27:10.949 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_pq_min_cost": "65536", 2024-04-26T12:27:10.949 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-26T12:27:10.949 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_queue_cut_off": "high", 2024-04-26T12:27:10.949 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-26T12:27:10.949 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_op_thread_timeout": "15", 2024-04-26T12:27:10.949 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_open_classes_on_start": "true", 2024-04-26T12:27:10.949 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_os_flags": "0", 2024-04-26T12:27:10.949 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_peering_op_priority": "255", 2024-04-26T12:27:10.949 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_delete_cost": "1048576", 2024-04-26T12:27:10.949 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_delete_priority": "5", 2024-04-26T12:27:10.949 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-26T12:27:10.950 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-26T12:27:10.950 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-26T12:27:10.950 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_log_trim_max": "10000", 2024-04-26T12:27:10.950 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_log_trim_min": "100", 2024-04-26T12:27:10.950 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-26T12:27:10.950 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-26T12:27:10.950 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-26T12:27:10.950 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-26T12:27:10.950 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-26T12:27:10.950 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-26T12:27:10.950 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-26T12:27:10.950 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-26T12:27:10.950 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-26T12:27:10.950 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_crimson": "false", 2024-04-26T12:27:10.951 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-26T12:27:10.951 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-26T12:27:10.951 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-26T12:27:10.951 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-26T12:27:10.951 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-26T12:27:10.951 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-26T12:27:10.951 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-26T12:27:10.951 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-26T12:27:10.951 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_flags": "0", 2024-04-26T12:27:10.951 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-26T12:27:10.951 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_min_size": "0", 2024-04-26T12:27:10.951 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-26T12:27:10.951 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_pg_num": "32", 2024-04-26T12:27:10.951 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_pgp_num": "0", 2024-04-26T12:27:10.952 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-26T12:27:10.952 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_size": "2", 2024-04-26T12:27:10.952 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_default_type": "replicated", 2024-04-26T12:27:10.952 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-26T12:27:10.952 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-26T12:27:10.952 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_push_per_object_cost": "1000", 2024-04-26T12:27:10.952 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-26T12:27:10.952 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recover_clone_overlap": "true", 2024-04-26T12:27:10.952 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-26T12:27:10.952 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_cost": "20971520", 2024-04-26T12:27:10.952 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-26T12:27:10.952 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_max_active": "0", 2024-04-26T12:27:10.952 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-26T12:27:10.953 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-26T12:27:10.953 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-26T12:27:10.953 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-26T12:27:10.953 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_max_single_start": "1", 2024-04-26T12:27:10.953 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_op_priority": "3", 2024-04-26T12:27:10.953 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-26T12:27:10.953 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_priority": "5", 2024-04-26T12:27:10.953 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-26T12:27:10.953 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_sleep": "0.000000", 2024-04-26T12:27:10.953 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-26T12:27:10.953 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-26T12:27:10.953 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-26T12:27:10.953 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_repair_during_recovery": "false", 2024-04-26T12:27:10.953 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_requested_scrub_priority": "120", 2024-04-26T12:27:10.954 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-26T12:27:10.954 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-26T12:27:10.954 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_auto_repair": "false", 2024-04-26T12:27:10.954 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-26T12:27:10.954 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-26T12:27:10.954 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_begin_hour": "0", 2024-04-26T12:27:10.954 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_begin_week_day": "0", 2024-04-26T12:27:10.954 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_chunk_max": "25", 2024-04-26T12:27:10.954 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_chunk_min": "5", 2024-04-26T12:27:10.954 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_cost": "52428800", 2024-04-26T12:27:10.954 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_during_recovery": "false", 2024-04-26T12:27:10.954 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_end_hour": "0", 2024-04-26T12:27:10.954 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_end_week_day": "0", 2024-04-26T12:27:10.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_event_cost": "4096", 2024-04-26T12:27:10.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-26T12:27:10.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-26T12:27:10.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_invalid_stats": "true", 2024-04-26T12:27:10.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-26T12:27:10.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-26T12:27:10.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_max_preemptions": "5", 2024-04-26T12:27:10.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-26T12:27:10.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_priority": "5", 2024-04-26T12:27:10.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-26T12:27:10.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_sleep": "0.000000", 2024-04-26T12:27:10.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-26T12:27:10.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-26T12:27:10.955 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-26T12:27:10.956 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-26T12:27:10.956 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_skip_data_digest": "false", 2024-04-26T12:27:10.956 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_smart_report_timeout": "5", 2024-04-26T12:27:10.956 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_snap_trim_cost": "1048576", 2024-04-26T12:27:10.956 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_snap_trim_priority": "5", 2024-04-26T12:27:10.956 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-26T12:27:10.956 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-26T12:27:10.956 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-26T12:27:10.956 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-26T12:27:10.956 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-26T12:27:10.956 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-26T12:27:10.956 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-26T12:27:10.956 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_target_transaction_size": "30", 2024-04-26T12:27:10.956 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-26T12:27:10.957 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-26T12:27:10.957 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-26T12:27:10.957 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-26T12:27:10.957 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-26T12:27:10.957 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-26T12:27:10.957 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-26T12:27:10.957 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-26T12:27:10.957 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-26T12:27:10.957 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-26T12:27:10.957 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_tracing": "false", 2024-04-26T12:27:10.957 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_use_stale_snap": "false", 2024-04-26T12:27:10.957 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-26T12:27:10.957 INFO:teuthology.orchestra.run.smithi046.stdout: "osdc_blkin_trace_all": "false", 2024-04-26T12:27:10.957 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_kill_at": "0", 2024-04-26T12:27:10.958 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_max_join_drift": "10", 2024-04-26T12:27:10.958 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_min": "500", 2024-04-26T12:27:10.958 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_min_wait": "0.050000", 2024-04-26T12:27:10.958 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_propose_interval": "1.000000", 2024-04-26T12:27:10.958 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_service_trim_max": "500", 2024-04-26T12:27:10.958 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-26T12:27:10.958 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_service_trim_min": "250", 2024-04-26T12:27:10.958 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_stash_full_interval": "25", 2024-04-26T12:27:10.958 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_trim_max": "500", 2024-04-26T12:27:10.958 INFO:teuthology.orchestra.run.smithi046.stdout: "paxos_trim_min": "250", 2024-04-26T12:27:10.958 INFO:teuthology.orchestra.run.smithi046.stdout: "perf": "true", 2024-04-26T12:27:10.958 INFO:teuthology.orchestra.run.smithi046.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-26T12:27:10.958 INFO:teuthology.orchestra.run.smithi046.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-26T12:27:10.958 INFO:teuthology.orchestra.run.smithi046.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-26T12:27:10.959 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addr": "-", 2024-04-26T12:27:10.959 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addrv": "", 2024-04-26T12:27:10.959 INFO:teuthology.orchestra.run.smithi046.stdout: "public_bind_addr": "-", 2024-04-26T12:27:10.959 INFO:teuthology.orchestra.run.smithi046.stdout: "public_network": "", 2024-04-26T12:27:10.959 INFO:teuthology.orchestra.run.smithi046.stdout: "public_network_interface": "", 2024-04-26T12:27:10.959 INFO:teuthology.orchestra.run.smithi046.stdout: "qat_compressor_enabled": "false", 2024-04-26T12:27:10.959 INFO:teuthology.orchestra.run.smithi046.stdout: "qat_compressor_session_max_number": "256", 2024-04-26T12:27:10.959 INFO:teuthology.orchestra.run.smithi046.stdout: "rados_mon_op_timeout": "0", 2024-04-26T12:27:10.959 INFO:teuthology.orchestra.run.smithi046.stdout: "rados_osd_op_timeout": "0", 2024-04-26T12:27:10.959 INFO:teuthology.orchestra.run.smithi046.stdout: "rados_tracing": "false", 2024-04-26T12:27:10.959 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_atime_update_interval": "60", 2024-04-26T12:27:10.959 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-26T12:27:10.959 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_balance_parent_reads": "false", 2024-04-26T12:27:10.959 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_balance_snap_reads": "false", 2024-04-26T12:27:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_blkin_trace_all": "false", 2024-04-26T12:27:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-26T12:27:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-26T12:27:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache": "true", 2024-04-26T12:27:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-26T12:27:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-26T12:27:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-26T12:27:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-26T12:27:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_policy": "writearound", 2024-04-26T12:27:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_size": "33554432", 2024-04-26T12:27:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-26T12:27:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-26T12:27:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_clone_copy_on_read": "false", 2024-04-26T12:27:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_compression_hint": "none", 2024-04-26T12:27:10.961 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_concurrent_management_ops": "10", 2024-04-26T12:27:10.961 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-26T12:27:10.961 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_clone_format": "auto", 2024-04-26T12:27:10.961 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_data_pool": "", 2024-04-26T12:27:10.961 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_features": "61", 2024-04-26T12:27:10.961 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_format": "2", 2024-04-26T12:27:10.961 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_map_options": "", 2024-04-26T12:27:10.961 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_order": "22", 2024-04-26T12:27:10.961 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_pool": "rbd", 2024-04-26T12:27:10.961 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-26T12:27:10.961 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_stripe_count": "0", 2024-04-26T12:27:10.961 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_default_stripe_unit": "0", 2024-04-26T12:27:10.961 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-26T12:27:10.961 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-26T12:27:10.962 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-26T12:27:10.962 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_enable_alloc_hint": "true", 2024-04-26T12:27:10.962 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-26T12:27:10.962 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_io_scheduler": "simple", 2024-04-26T12:27:10.962 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-26T12:27:10.962 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-26T12:27:10.962 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-26T12:27:10.962 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-26T12:27:10.962 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-26T12:27:10.962 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-26T12:27:10.962 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-26T12:27:10.962 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-26T12:27:10.962 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-26T12:27:10.962 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_order": "24", 2024-04-26T12:27:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_pool": "", 2024-04-26T12:27:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_journal_splay_width": "4", 2024-04-26T12:27:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_localize_parent_reads": "false", 2024-04-26T12:27:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_localize_snap_reads": "false", 2024-04-26T12:27:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-26T12:27:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-26T12:27:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-26T12:27:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-26T12:27:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-26T12:27:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-26T12:27:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-26T12:27:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-26T12:27:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-26T12:27:10.963 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-26T12:27:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-26T12:27:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-26T12:27:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-26T12:27:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-26T12:27:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-26T12:27:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-26T12:27:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-26T12:27:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-26T12:27:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-26T12:27:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-26T12:27:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-26T12:27:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-26T12:27:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-26T12:27:10.964 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-26T12:27:10.965 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-26T12:27:10.965 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-26T12:27:10.965 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-26T12:27:10.965 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-26T12:27:10.965 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-26T12:27:10.965 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-26T12:27:10.965 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-26T12:27:10.965 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_mtime_update_interval": "60", 2024-04-26T12:27:10.965 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_non_blocking_aio": "true", 2024-04-26T12:27:10.965 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_op_thread_timeout": "60", 2024-04-26T12:27:10.965 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_op_threads": "1", 2024-04-26T12:27:10.965 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_parent_cache_enabled": "false", 2024-04-26T12:27:10.965 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-26T12:27:10.965 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-26T12:27:10.966 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-26T12:27:10.966 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_plugins": "", 2024-04-26T12:27:10.966 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_bps_burst": "0", 2024-04-26T12:27:10.966 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-26T12:27:10.966 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_bps_limit": "0", 2024-04-26T12:27:10.966 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_exclude_ops": "0", 2024-04-26T12:27:10.966 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_iops_burst": "0", 2024-04-26T12:27:10.966 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-26T12:27:10.966 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_iops_limit": "0", 2024-04-26T12:27:10.966 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-26T12:27:10.966 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-26T12:27:10.966 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-26T12:27:10.966 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-26T12:27:10.966 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-26T12:27:10.967 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-26T12:27:10.967 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-26T12:27:10.967 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-26T12:27:10.967 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-26T12:27:10.967 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-26T12:27:10.967 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-26T12:27:10.967 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-26T12:27:10.967 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-26T12:27:10.967 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-26T12:27:10.967 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_read_from_replica_policy": "default", 2024-04-26T12:27:10.967 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-26T12:27:10.967 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-26T12:27:10.967 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-26T12:27:10.968 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-26T12:27:10.968 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_skip_partial_discard": "true", 2024-04-26T12:27:10.968 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-26T12:27:10.968 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_tracing": "false", 2024-04-26T12:27:10.968 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_validate_names": "true", 2024-04-26T12:27:10.968 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_validate_pool": "true", 2024-04-26T12:27:10.968 INFO:teuthology.orchestra.run.smithi046.stdout: "restapi_base_url": "", 2024-04-26T12:27:10.968 INFO:teuthology.orchestra.run.smithi046.stdout: "restapi_log_level": "", 2024-04-26T12:27:10.968 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_acl_grants_max_num": "100", 2024-04-26T12:27:10.968 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_admin_entry": "admin", 2024-04-26T12:27:10.968 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-26T12:27:10.968 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_backend_store": "rados", 2024-04-26T12:27:10.968 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_barbican_url": "", 2024-04-26T12:27:10.968 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_beast_enable_async": "true", 2024-04-26T12:27:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-26T12:27:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-26T12:27:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-26T12:27:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-26T12:27:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-26T12:27:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-26T12:27:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-26T12:27:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_cache_enabled": "true", 2024-04-26T12:27:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_cache_expiry_interval": "900", 2024-04-26T12:27:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_cache_lru_size": "10000", 2024-04-26T12:27:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_config_store": "rados", 2024-04-26T12:27:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_content_length_compat": "false", 2024-04-26T12:27:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_copy_obj_progress": "true", 2024-04-26T12:27:10.969 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-26T12:27:10.970 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_cors_rules_max_num": "100", 2024-04-26T12:27:10.970 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_cross_domain_policy": "", 2024-04-26T12:27:10.970 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-26T12:27:10.970 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_addr": "", 2024-04-26T12:27:10.970 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-26T12:27:10.970 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-26T12:27:10.970 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-26T12:27:10.970 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-26T12:27:10.970 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_password": "", 2024-04-26T12:27:10.970 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-26T12:27:10.970 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_kmip_username": "", 2024-04-26T12:27:10.970 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_require_ssl": "true", 2024-04-26T12:27:10.970 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-26T12:27:10.970 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-26T12:27:10.971 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-26T12:27:10.971 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-26T12:27:10.971 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-26T12:27:10.971 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-26T12:27:10.971 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-26T12:27:10.971 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-26T12:27:10.971 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-26T12:27:10.971 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-26T12:27:10.971 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-26T12:27:10.971 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-26T12:27:10.971 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-26T12:27:10.971 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-26T12:27:10.971 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-26T12:27:10.972 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_addr": "", 2024-04-26T12:27:10.972 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_auth": "token", 2024-04-26T12:27:10.972 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_namespace": "", 2024-04-26T12:27:10.972 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_prefix": "", 2024-04-26T12:27:10.972 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-26T12:27:10.972 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-26T12:27:10.972 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-26T12:27:10.972 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-26T12:27:10.972 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_token_file": "", 2024-04-26T12:27:10.972 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-26T12:27:10.972 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_curl_buffersize": "524288", 2024-04-26T12:27:10.972 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-26T12:27:10.972 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_curl_low_speed_time": "300", 2024-04-26T12:27:10.972 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-26T12:27:10.973 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-26T12:27:10.973 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-26T12:27:10.973 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-26T12:27:10.973 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-26T12:27:10.973 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-26T12:27:10.973 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-26T12:27:10.973 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-26T12:27:10.973 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-26T12:27:10.973 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-26T12:27:10.973 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-26T12:27:10.973 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data_log_changes_size": "1000", 2024-04-26T12:27:10.973 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data_log_num_shards": "128", 2024-04-26T12:27:10.973 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-26T12:27:10.973 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data_log_window": "30", 2024-04-26T12:27:10.974 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-26T12:27:10.974 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-26T12:27:10.974 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-26T12:27:10.974 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-26T12:27:10.974 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-26T12:27:10.974 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-26T12:27:10.974 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-26T12:27:10.974 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-26T12:27:10.974 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-26T12:27:10.974 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-26T12:27:10.974 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-26T12:27:10.974 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-26T12:27:10.975 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-26T12:27:10.975 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-26T12:27:10.975 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-26T12:27:10.975 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-26T12:27:10.975 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-26T12:27:10.975 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-26T12:27:10.975 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-26T12:27:10.975 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-26T12:27:10.975 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-26T12:27:10.975 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-26T12:27:10.975 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-26T12:27:10.975 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-26T12:27:10.975 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dns_name": "", 2024-04-26T12:27:10.975 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dns_s3website_name": "", 2024-04-26T12:27:10.976 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_dynamic_resharding": "true", 2024-04-26T12:27:10.976 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-26T12:27:10.976 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enable_gc_threads": "true", 2024-04-26T12:27:10.976 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enable_lc_threads": "true", 2024-04-26T12:27:10.976 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enable_ops_log": "false", 2024-04-26T12:27:10.976 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enable_quota_threads": "true", 2024-04-26T12:27:10.976 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enable_static_website": "false", 2024-04-26T12:27:10.976 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enable_usage_log": "false", 2024-04-26T12:27:10.976 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_enforce_swift_acls": "true", 2024-04-26T12:27:10.976 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_exit_timeout_secs": "120", 2024-04-26T12:27:10.976 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_expose_bucket": "false", 2024-04-26T12:27:10.976 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_extended_http_attrs": "", 2024-04-26T12:27:10.976 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_filter": "none", 2024-04-26T12:27:10.976 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-26T12:27:10.977 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_frontends": "beast port=7480", 2024-04-26T12:27:10.977 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-26T12:27:10.977 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_max_deferred": "50", 2024-04-26T12:27:10.977 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-26T12:27:10.977 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_max_objs": "32", 2024-04-26T12:27:10.977 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-26T12:27:10.977 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-26T12:27:10.977 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-26T12:27:10.977 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-26T12:27:10.977 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_gc_processor_period": "3600", 2024-04-26T12:27:10.977 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-26T12:27:10.977 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-26T12:27:10.977 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-26T12:27:10.977 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-26T12:27:10.978 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_init_timeout": "300", 2024-04-26T12:27:10.978 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-26T12:27:10.978 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-26T12:27:10.978 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-26T12:27:10.978 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-26T12:27:10.978 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_domain": "", 2024-04-26T12:27:10.978 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_password": "", 2024-04-26T12:27:10.978 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_password_path": "", 2024-04-26T12:27:10.978 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_project": "", 2024-04-26T12:27:10.978 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_tenant": "", 2024-04-26T12:27:10.978 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_token": "", 2024-04-26T12:27:10.978 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_token_path": "", 2024-04-26T12:27:10.978 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_admin_user": "", 2024-04-26T12:27:10.978 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_api_version": "2", 2024-04-26T12:27:10.979 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_barbican_domain": "", 2024-04-26T12:27:10.979 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_barbican_password": "", 2024-04-26T12:27:10.979 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_barbican_project": "", 2024-04-26T12:27:10.979 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-26T12:27:10.979 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_barbican_user": "", 2024-04-26T12:27:10.979 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-26T12:27:10.979 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-26T12:27:10.979 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-26T12:27:10.979 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-26T12:27:10.979 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-26T12:27:10.979 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_url": "", 2024-04-26T12:27:10.979 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-26T12:27:10.979 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lc_debug_interval": "-1", 2024-04-26T12:27:10.980 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lc_lock_max_time": "90", 2024-04-26T12:27:10.980 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lc_max_objs": "32", 2024-04-26T12:27:10.980 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lc_max_rules": "1000", 2024-04-26T12:27:10.980 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lc_max_worker": "3", 2024-04-26T12:27:10.980 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-26T12:27:10.980 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lc_thread_delay": "0", 2024-04-26T12:27:10.980 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-26T12:27:10.980 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ldap_dnattr": "uid", 2024-04-26T12:27:10.980 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-26T12:27:10.980 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ldap_searchfilter": "", 2024-04-26T12:27:10.980 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-26T12:27:10.980 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-26T12:27:10.980 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-26T12:27:10.980 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-26T12:27:10.981 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-26T12:27:10.981 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_log_http_headers": "", 2024-04-26T12:27:10.981 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-26T12:27:10.981 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-26T12:27:10.981 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_log_object_name_utc": "false", 2024-04-26T12:27:10.981 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-26T12:27:10.981 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_attr_name_len": "0", 2024-04-26T12:27:10.981 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_attr_size": "0", 2024-04-26T12:27:10.981 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-26T12:27:10.981 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_chunk_size": "4194304", 2024-04-26T12:27:10.981 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-26T12:27:10.981 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-26T12:27:10.981 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-26T12:27:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_listing_results": "1000", 2024-04-26T12:27:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_notify_retries": "10", 2024-04-26T12:27:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-26T12:27:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_put_param_size": "1048576", 2024-04-26T12:27:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_put_size": "5368709120", 2024-04-26T12:27:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_max_slo_entries": "1000", 2024-04-26T12:27:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_md_log_max_shards": "64", 2024-04-26T12:27:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-26T12:27:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-26T12:27:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-26T12:27:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-26T12:27:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_mp_lock_max_time": "600", 2024-04-26T12:27:10.982 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-26T12:27:10.983 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-26T12:27:10.983 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-26T12:27:10.983 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-26T12:27:10.983 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-26T12:27:10.983 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-26T12:27:10.983 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-26T12:27:10.983 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-26T12:27:10.983 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_max_gc": "300", 2024-04-26T12:27:10.983 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-26T12:27:10.983 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-26T12:27:10.983 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-26T12:27:10.983 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-26T12:27:10.983 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-26T12:27:10.984 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-26T12:27:10.984 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-26T12:27:10.984 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_num_async_rados_threads": "32", 2024-04-26T12:27:10.984 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_num_control_oids": "8", 2024-04-26T12:27:10.984 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_numa_node": "-1", 2024-04-26T12:27:10.984 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-26T12:27:10.984 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-26T12:27:10.984 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_objexp_chunk_size": "100", 2024-04-26T12:27:10.984 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_objexp_gc_interval": "600", 2024-04-26T12:27:10.984 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-26T12:27:10.984 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-26T12:27:10.984 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-26T12:27:10.984 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_op_thread_timeout": "600", 2024-04-26T12:27:10.984 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_op_tracing": "false", 2024-04-26T12:27:10.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_opa_token": "", 2024-04-26T12:27:10.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_opa_url": "", 2024-04-26T12:27:10.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_opa_verify_ssl": "true", 2024-04-26T12:27:10.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-26T12:27:10.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-26T12:27:10.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ops_log_rados": "false", 2024-04-26T12:27:10.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_ops_log_socket_path": "", 2024-04-26T12:27:10.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-26T12:27:10.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-26T12:27:10.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-26T12:27:10.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_period_push_interval": "2.000000", 2024-04-26T12:27:10.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-26T12:27:10.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-26T12:27:10.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-26T12:27:10.986 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_print_continue": "true", 2024-04-26T12:27:10.986 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-26T12:27:10.986 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-26T12:27:10.986 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-26T12:27:10.986 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-26T12:27:10.986 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-26T12:27:10.986 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_rados_tracing": "false", 2024-04-26T12:27:10.986 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_realm": "", 2024-04-26T12:27:10.986 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_realm_id": "", 2024-04-26T12:27:10.986 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-26T12:27:10.986 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_region": "", 2024-04-26T12:27:10.986 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-26T12:27:10.987 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-26T12:27:10.987 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-26T12:27:10.987 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-26T12:27:10.987 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_request_uri": "", 2024-04-26T12:27:10.987 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_reshard_batch_size": "64", 2024-04-26T12:27:10.987 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-26T12:27:10.987 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_reshard_max_aio": "128", 2024-04-26T12:27:10.987 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_reshard_num_logs": "16", 2024-04-26T12:27:10.987 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_reshard_thread_interval": "600", 2024-04-26T12:27:10.987 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_resolve_cname": "false", 2024-04-26T12:27:10.987 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-26T12:27:10.987 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_run_sync_thread": "true", 2024-04-26T12:27:10.987 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-26T12:27:10.987 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-26T12:27:10.988 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-26T12:27:10.988 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-26T12:27:10.988 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-26T12:27:10.988 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-26T12:27:10.988 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-26T12:27:10.988 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-26T12:27:10.988 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_scheduler_type": "throttler", 2024-04-26T12:27:10.988 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_script_uri": "", 2024-04-26T12:27:10.988 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_service_provider_name": "", 2024-04-26T12:27:10.988 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-26T12:27:10.988 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sts_client_id": "", 2024-04-26T12:27:10.988 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sts_client_secret": "", 2024-04-26T12:27:10.988 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sts_entry": "sts", 2024-04-26T12:27:10.989 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sts_key": "sts", 2024-04-26T12:27:10.989 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-26T12:27:10.989 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sts_min_session_duration": "900", 2024-04-26T12:27:10.989 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sts_token_introspection_url": "", 2024-04-26T12:27:10.989 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_account_in_url": "false", 2024-04-26T12:27:10.989 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_auth_entry": "auth", 2024-04-26T12:27:10.989 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_auth_url": "", 2024-04-26T12:27:10.989 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_custom_header": "", 2024-04-26T12:27:10.989 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-26T12:27:10.989 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_need_stats": "true", 2024-04-26T12:27:10.989 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_tenant_name": "", 2024-04-26T12:27:10.989 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_token_expiration": "86400", 2024-04-26T12:27:10.989 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_url": "", 2024-04-26T12:27:10.989 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_url_prefix": "swift", 2024-04-26T12:27:10.990 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-26T12:27:10.990 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-26T12:27:10.990 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-26T12:27:10.990 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_lease_period": "120", 2024-04-26T12:27:10.990 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-26T12:27:10.990 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-26T12:27:10.990 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-26T12:27:10.990 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-26T12:27:10.990 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-26T12:27:10.990 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-26T12:27:10.990 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-26T12:27:10.990 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-26T12:27:10.990 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-26T12:27:10.991 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_thread_pool_size": "512", 2024-04-26T12:27:10.991 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_comment": "", 2024-04-26T12:27:10.991 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_createby": "", 2024-04-26T12:27:10.991 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_encoding": "", 2024-04-26T12:27:10.991 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_flag": "false", 2024-04-26T12:27:10.991 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_origin": "", 2024-04-26T12:27:10.991 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-26T12:27:10.991 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_torrent_tracker": "", 2024-04-26T12:27:10.991 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_trust_forwarded_https": "false", 2024-04-26T12:27:10.991 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-26T12:27:10.991 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-26T12:27:10.991 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_usage_max_shards": "32", 2024-04-26T12:27:10.991 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_usage_max_user_shards": "1", 2024-04-26T12:27:10.991 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_use_opa_authz": "false", 2024-04-26T12:27:10.992 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-26T12:27:10.992 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-26T12:27:10.992 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_max_buckets": "1000", 2024-04-26T12:27:10.992 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_policies_max_num": "100", 2024-04-26T12:27:10.992 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-26T12:27:10.992 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-26T12:27:10.992 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-26T12:27:10.992 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-26T12:27:10.992 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_user_unique_email": "true", 2024-04-26T12:27:10.992 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_verify_ssl": "true", 2024-04-26T12:27:10.992 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-26T12:27:10.992 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_zone": "", 2024-04-26T12:27:10.992 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_zone_id": "", 2024-04-26T12:27:10.992 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-26T12:27:10.993 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_zonegroup": "", 2024-04-26T12:27:10.993 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_zonegroup_id": "", 2024-04-26T12:27:10.993 INFO:teuthology.orchestra.run.smithi046.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-26T12:27:10.993 INFO:teuthology.orchestra.run.smithi046.stdout: "rgwlc_auto_session_clear": "true", 2024-04-26T12:27:10.993 INFO:teuthology.orchestra.run.smithi046.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-26T12:27:10.993 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_block_size": "4096", 2024-04-26T12:27:10.993 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-26T12:27:10.993 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-26T12:27:10.993 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-26T12:27:10.993 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-26T12:27:10.993 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-26T12:27:10.993 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cache_size": "536870912", 2024-04-26T12:27:10.993 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-26T12:27:10.993 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-26T12:27:10.994 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-26T12:27:10.994 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-26T12:27:10.994 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-26T12:27:10.994 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-26T12:27:10.994 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-26T12:27:10.994 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-26T12:27:10.994 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_index_type": "binary_search", 2024-04-26T12:27:10.994 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-26T12:27:10.994 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-26T12:27:10.994 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_partition_filters": "false", 2024-04-26T12:27:10.994 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_perf": "false", 2024-04-26T12:27:10.994 INFO:teuthology.orchestra.run.smithi046.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-26T12:27:10.994 INFO:teuthology.orchestra.run.smithi046.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-26T12:27:10.994 INFO:teuthology.orchestra.run.smithi046.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-26T12:27:10.995 INFO:teuthology.orchestra.run.smithi046.stdout: "run_dir": "/var/run/ceph", 2024-04-26T12:27:10.995 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_block_create": "true", 2024-04-26T12:27:10.995 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_cache_lru_size": "67108864", 2024-04-26T12:27:10.995 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-26T12:27:10.995 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_default_max_object_size": "16777216", 2024-04-26T12:27:10.995 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-26T12:27:10.995 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_device_size": "53687091200", 2024-04-26T12:27:10.995 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_journal_batch_capacity": "16", 2024-04-26T12:27:10.995 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-26T12:27:10.995 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-26T12:27:10.995 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-26T12:27:10.995 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_main_device_type": "SSD", 2024-04-26T12:27:10.995 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-26T12:27:10.996 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-26T12:27:10.996 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-26T12:27:10.996 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-26T12:27:10.996 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-26T12:27:10.996 INFO:teuthology.orchestra.run.smithi046.stdout: "seastore_segment_size": "67108864", 2024-04-26T12:27:10.996 INFO:teuthology.orchestra.run.smithi046.stdout: "set_keepcaps": "false", 2024-04-26T12:27:10.996 INFO:teuthology.orchestra.run.smithi046.stdout: "setgroup": "", 2024-04-26T12:27:10.996 INFO:teuthology.orchestra.run.smithi046.stdout: "setuser": "", 2024-04-26T12:27:10.996 INFO:teuthology.orchestra.run.smithi046.stdout: "setuser_match_path": "", 2024-04-26T12:27:10.996 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-26T12:27:10.996 INFO:teuthology.orchestra.run.smithi046.stdout: "thp": "false", 2024-04-26T12:27:10.996 INFO:teuthology.orchestra.run.smithi046.stdout: "threadpool_default_timeout": "60", 2024-04-26T12:27:10.996 INFO:teuthology.orchestra.run.smithi046.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-26T12:27:10.996 INFO:teuthology.orchestra.run.smithi046.stdout: "throttler_perf_counter": "true" 2024-04-26T12:27:10.997 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-04-26T12:27:10.999 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-26T12:27:11.138 INFO:teuthology.orchestra.run.smithi046.stdout:mon.a: {} 2024-04-26T12:27:11.148 INFO:teuthology.orchestra.run.smithi046.stdout:mon.b: {} 2024-04-26T12:27:11.157 INFO:teuthology.orchestra.run.smithi046.stdout:mon.c: {} 2024-04-26T12:27:11.158 INFO:teuthology.orchestra.run.smithi046.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:27:11.158 INFO:teuthology.orchestra.run.smithi046.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:27:11.159 INFO:teuthology.orchestra.run.smithi046.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:27:11.170 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-26T12:27:11.170 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-26T12:27:11.195 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-26T12:27:11.195 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-26T12:27:11.196 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-26T12:27:11.196 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T12:27:11.196 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T12:27:11.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:11.196 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-04-26T12:27:11.197 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-26T12:27:11.197 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:27:11.197 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:27:11.197 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-26T12:27:11.197 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.560944 2024-04-26T12:27:11.197 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.5609436854358243 2024-04-26T12:27:11.198 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-26T12:27:11.198 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-26T12:27:11.198 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:27:11.198 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-26T12:27:11.199 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:11.199 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-26T12:27:11.199 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:27:11.201 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:11.198+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:11.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:11.222 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-04-26T12:27:11.294 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2024-04-26T12:27:11.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:27:11.297 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-26T12:27:11.297 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T12:27:11.300 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:11.298+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:11.339 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:11.339 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:11.339 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:11.339 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:11.349 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:11.386 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:11.400 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:11.399+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:11.423 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:11.458 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:11.460 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:11.460 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:11.460 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:11.476 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:11.476 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:11.486 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:11.529 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:11.529+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:11.602 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:11.601+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:11.613 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:11.613 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:11.623 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:11.702 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:11.702+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:11.739 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T12:27:11.754 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T12:27:11.754 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T12:27:11.754 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-04-26T12:27:11.754 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T12:27:11.754 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T12:27:11.754 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T12:27:11.754 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T12:27:11.754 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T12:27:11.755 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T12:27:11.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:11.755 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-04-26T12:27:11.762 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:11.763 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:11.774 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:11.774 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T12:27:11.774 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T12:27:11.774 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T12:27:11.775 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-04-26T12:27:11.775 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-04-26T12:27:11.775 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-04-26T12:27:11.775 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T12:27:11.775 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-04-26T12:27:11.775 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-04-26T12:27:11.775 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T12:27:11.775 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-04-26T12:27:11.775 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-04-26T12:27:11.775 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T12:27:11.775 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-04-26T12:27:11.775 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-04-26T12:27:11.775 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-26T12:27:11.776 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42593sec preferred_lft 42593sec 2024-04-26T12:27:11.776 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2024-04-26T12:27:11.776 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-04-26T12:27:11.776 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T12:27:11.776 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-04-26T12:27:11.776 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-04-26T12:27:11.776 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T12:27:11.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:11.777 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-04-26T12:27:11.777 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-04-26T12:27:11.777 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-04-26T12:27:11.777 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-04-26T12:27:11.777 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-04-26T12:27:11.777 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T12:27:11.777 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-04-26T12:27:11.803 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:11.803+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:11.902 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:11.903 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:11.904 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:11.902+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:11.912 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:11.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:11.954 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T12:27:11.990 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-04-26T12:27:11.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:11.991 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-04-26T12:27:12.005 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:12.004+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:12.079 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:12.079 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:12.083 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-04-26T12:27:12.083 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T12:27:12.084 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-26T12:27:12.084 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-26T12:27:12.084 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T12:27:12.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:12.084 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-04-26T12:27:12.084 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-04-26T12:27:12.084 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T12:27:12.085 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T12:27:12.085 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T12:27:12.085 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-04-26T12:27:12.089 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:12.105 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:12.103+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:12.206 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:12.205+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:12.229 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:12.230 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:12.240 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:12.306 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:12.305+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:12.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:12.315 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-04-26T12:27:12.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:12.333 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-04-26T12:27:12.367 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:12.367 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:12.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:12.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:12.392 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-04-26T12:27:12.392 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-04-26T12:27:12.392 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T12:27:12.392 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T12:27:12.392 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-04-26T12:27:12.420 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:12.420+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:12.488 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T12:27:12.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:12.488 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-04-26T12:27:12.488 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-04-26T12:27:12.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T12:27:12.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T12:27:12.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T12:27:12.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T12:27:12.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T12:27:12.489 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-04-26T12:27:12.504 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:12.504 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:12.508 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:12.506+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:12.514 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:12.577 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2024-04-26T12:27:12.577 INFO:teuthology.orchestra.run.smithi046.stderr:set osd.0 primary-affinity to 0.560944 (8367622) 2024-04-26T12:27:12.609 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:12.608+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:12.656 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:12.656 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:12.667 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:12.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:12.681 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-04-26T12:27:12.681 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-04-26T12:27:12.681 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-04-26T12:27:12.681 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T12:27:12.682 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-04-26T12:27:12.710 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:12.710+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:12.779 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T12:27:12.779 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T12:27:12.779 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T12:27:12.797 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T12:27:12.797 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T12:27:12.798 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T12:27:12.811 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:12.810+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:12.833 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:12.833 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:12.843 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:12.855 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-04-26T12:27:12.911 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:12.911+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:12.924 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T12:27:12.924 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T12:27:12.968 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:12.969 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:12.979 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:12.992 INFO:teuthology.orchestra.run.smithi046.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T12:27:12.993 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T12:27:12.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:12.994 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-04-26T12:27:13.012 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:13.012+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:13.052 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T12:27:13.052 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T12:27:13.094 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-04-26T12:27:13.108 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:13.108 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:13.113 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:13.113+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:13.118 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:13.122 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T12:27:13.122 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T12:27:13.182 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:2024-04-26T12:27:13.181+0000 7f1eadffb5c0 -1 init, newargv = 0x558c58f67db0 newargc=15 2024-04-26T12:27:13.182 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[45185]: starting ceph client 2024-04-26T12:27:13.186 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[45185]: starting fuse 2024-04-26T12:27:13.192 INFO:teuthology.orchestra.run.smithi046.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T12:27:13.192 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T12:27:13.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:13.193 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-04-26T12:27:13.214 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:13.213+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:13.245 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:13.245 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:13.250 INFO:teuthology.orchestra.run.smithi046.stdout:46 2024-04-26T12:27:13.250 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2024-04-26T12:27:13.251 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-26T12:27:13.251 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2024-04-26T12:27:13.251 DEBUG:teuthology.orchestra.run.smithi046:> import re 2024-04-26T12:27:13.251 DEBUG:teuthology.orchestra.run.smithi046:> import os 2024-04-26T12:27:13.251 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2024-04-26T12:27:13.251 DEBUG:teuthology.orchestra.run.smithi046:> 2024-04-26T12:27:13.251 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2024-04-26T12:27:13.251 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T12:27:13.251 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2024-04-26T12:27:13.251 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T12:27:13.251 DEBUG:teuthology.orchestra.run.smithi046:> 2024-04-26T12:27:13.251 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2024-04-26T12:27:13.251 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2024-04-26T12:27:13.252 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2024-04-26T12:27:13.252 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2024-04-26T12:27:13.252 DEBUG:teuthology.orchestra.run.smithi046:> 2024-04-26T12:27:13.252 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2024-04-26T12:27:13.252 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T12:27:13.252 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T12:27:13.252 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T12:27:13.252 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2024-04-26T12:27:13.252 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2024-04-26T12:27:13.252 DEBUG:teuthology.orchestra.run.smithi046:> return f 2024-04-26T12:27:13.252 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T12:27:13.252 DEBUG:teuthology.orchestra.run.smithi046:> 2024-04-26T12:27:13.252 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.0")) 2024-04-26T12:27:13.252 DEBUG:teuthology.orchestra.run.smithi046:> ' 2024-04-26T12:27:13.255 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:13.316 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:13.315+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:13.376 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.0.45185.asok 2024-04-26T12:27:13.417 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:13.416+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:13.421 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:13.421 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:13.432 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:13.474 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:27:13.518 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:13.516+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:13.557 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45185.asok 2024-04-26T12:27:13.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:13.558 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45185.asok status 2024-04-26T12:27:13.571 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:13.571 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:13.583 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:13.626 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:13.626+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:13.629 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:13.649 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:13.669 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:13.670 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:13.670 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:13.670 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:13.684 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-04-26T12:27:13.684 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2024-04-26T12:27:13.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "dc093b5e41f728edab6e0330295fdf9156d31664", 2024-04-26T12:27:13.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 18.2.2-1256-gdc093b5e (dc093b5e41f728edab6e0330295fdf9156d31664) reef (stable)", 2024-04-26T12:27:13.685 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "0", 2024-04-26T12:27:13.685 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2024-04-26T12:27:13.685 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T12:27:13.685 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "45185", 2024-04-26T12:27:13.685 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2024-04-26T12:27:13.685 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:13.685 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2024-04-26T12:27:13.685 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2024-04-26T12:27:13.685 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4519, 2024-04-26T12:27:13.685 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2024-04-26T12:27:13.685 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2024-04-26T12:27:13.685 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2024-04-26T12:27:13.685 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 4519 2024-04-26T12:27:13.686 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:13.686 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-04-26T12:27:13.686 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:27:13.686 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-04-26T12:27:13.686 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1390773553 2024-04-26T12:27:13.686 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:13.686 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:13.686 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-04-26T12:27:13.686 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:27:13.686 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-04-26T12:27:13.686 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1390773553 2024-04-26T12:27:13.687 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:13.687 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.4519 192.168.0.1:0/1390773553", 2024-04-26T12:27:13.687 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "192.168.0.1:0/1390773553", 2024-04-26T12:27:13.687 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2024-04-26T12:27:13.687 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 6, 2024-04-26T12:27:13.687 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 17, 2024-04-26T12:27:13.687 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2024-04-26T12:27:13.687 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2024-04-26T12:27:13.687 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2024-04-26T12:27:13.687 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-04-26T12:27:13.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:13.695 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2024-04-26T12:27:13.695 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T12:27:13.709 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:13.710 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:13.710 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:13.710 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:13.710 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:13.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:13.720 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:13.719+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:13.753 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2024-04-26T12:27:13.754 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T12:27:13.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:27:13.754 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T12:27:13.821 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:13.820+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:13.822 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T12:27:13.834 INFO:tasks.workunit:Pulling workunits from ref 7d2137f0a666c92a9411c1af5c33e4968be54da6 2024-04-26T12:27:13.835 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T12:27:13.835 INFO:tasks.workunit:timeout=3h 2024-04-26T12:27:13.835 INFO:tasks.workunit:cleanup=True 2024-04-26T12:27:13.835 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T12:27:13.880 INFO:teuthology.orchestra.run.smithi046.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T12:27:13.881 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-26T12:27:13.881 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 2eh/46d Inode: 1 Links: 2 2024-04-26T12:27:13.881 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:27:13.881 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-26T12:27:13.881 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T12:27:13.881 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-04-26 12:26:53.246597901 +0000 2024-04-26T12:27:13.881 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-04-26 12:27:13.820058270 +0000 2024-04-26T12:27:13.881 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2024-04-26T12:27:13.881 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T12:27:13.881 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T12:27:13.887 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.003517903999999, 2024-04-26T12:27:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.002878556999999, 2024-04-26T12:27:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.873176366999999, 2024-04-26T12:27:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.872681781000001, 2024-04-26T12:27:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.870679596999999, 2024-04-26T12:27:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.870273257000001, 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.869918432999999, 2024-04-26T12:27:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.767360019000002, 2024-04-26T12:27:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.766963490999998, 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.669953883000002, 2024-04-26T12:27:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:13.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.669260167000001, 2024-04-26T12:27:13.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:13.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.634521112000002, 2024-04-26T12:27:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:13.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:13.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:13.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:13.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.633700192999999, 2024-04-26T12:27:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:13.952 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:13.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:13.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:13.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:13.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:13.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:13.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.958 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.633670103, 2024-04-26T12:27:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:13.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:13.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:13.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.633616315000001, 2024-04-26T12:27:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.965 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:13.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:13.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.633563758000001, 2024-04-26T12:27:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:13.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:13.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:13.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.976 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.633523543999999, 2024-04-26T12:27:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:13.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:13.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.633495383, 2024-04-26T12:27:13.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:13.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.987 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.633464694000001, 2024-04-26T12:27:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:13.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:13.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.633438121000001, 2024-04-26T12:27:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:13.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:13.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:13.996 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:13.996 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:13.998 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:13.996+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:13.998 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:14.029 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7d2137f0a666c92a9411c1af5c33e4968be54da6 2024-04-26T12:27:14.088 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T12:27:14.098 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:14.098+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:14.140 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:14.140 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:14.140 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:14.140 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:14.150 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:14.199 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:14.197+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:14.300 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:14.299+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:14.316 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:14.317 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:14.317 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:14.317 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:14.317 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:14.326 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:14.401 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:14.401+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:14.456 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:14.456 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:14.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:14.457 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:14.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.457 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:14.457 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:14.457 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 27.123245914000002, 2024-04-26T12:27:14.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:14.457 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.457 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.457 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:14.457 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:14.457 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:14.457 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:14.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.458 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:14.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:14.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:14.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:14.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:14.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:14.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:14.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:14.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:14.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:14.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:14.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:14.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:14.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:14.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:14.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:14.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:14.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:14.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:14.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:14.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:14.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:14.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:14.462 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.463 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.463 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.463 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.463 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:14.463 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.204380091000001, 2024-04-26T12:27:14.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:14.463 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.463 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.463 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:14.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:14.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:14.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:14.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:14.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:14.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:14.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:14.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:14.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:14.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:14.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:14.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:14.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:14.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:14.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:14.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:14.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.204343879, 2024-04-26T12:27:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:14.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:14.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:14.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:14.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:14.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:14.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:14.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:14.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:14.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:14.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:14.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:14.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:14.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:14.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:14.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:14.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:14.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:14.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:14.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:14.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:14.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:14.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:14.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:14.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:14.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:14.475 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.475 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.475 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.204304905000001, 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:14.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:14.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:14.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:14.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:14.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:14.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:14.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:14.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:14.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:14.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:14.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:14.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:14.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:14.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:14.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:14.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:14.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:14.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:14.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:14.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:14.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:14.481 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.481 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.481 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.482 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.482 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:14.482 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.204281737999999, 2024-04-26T12:27:14.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:14.482 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.482 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.482 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:14.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:14.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:14.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:14.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:14.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:14.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:14.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:14.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:14.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:14.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:14.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:14.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:14.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:14.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:14.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:14.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:14.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:14.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:14.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:14.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:14.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:14.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:14.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:14.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.204266360999998, 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.488 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:14.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:14.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:14.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:14.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:14.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:14.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:14.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:14.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:14.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:14.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:14.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:14.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:14.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:14.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:14.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:14.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:14.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:14.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:14.494 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.494 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.494 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.494 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.494 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:14.494 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.204238171, 2024-04-26T12:27:14.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:14.494 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.494 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.495 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:14.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:14.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:14.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:14.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:14.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:14.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:14.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:14.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:14.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:14.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:14.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:14.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:14.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:14.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:14.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:14.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:14.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.204220173, 2024-04-26T12:27:14.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:14.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:14.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:14.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:14.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:14.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:14.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:14.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:14.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:14.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:14.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:14.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:14.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:14.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:14.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:14.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:14.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:14.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:14.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:14.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:14.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:14.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:14.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:14.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:14.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:14.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:14.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.506 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.507 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.507 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:14.507 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.204195582000001, 2024-04-26T12:27:14.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:14.507 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.507 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.507 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:14.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:14.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:14.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:14.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:14.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:14.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:14.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:14.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:14.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:14.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:14.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:14.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:14.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:14.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:14.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:14.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:14.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:14.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:14.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:14.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:14.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:14.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:14.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:14.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:14.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:14.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:14.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:14.513 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.513 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.513 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.513 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.513 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:14.513 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.204170633, 2024-04-26T12:27:14.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:14.513 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.513 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.513 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:14.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:14.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:14.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:14.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:14.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:14.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:14.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:14.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:14.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:14.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:14.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:14.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:14.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:14.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:14.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:14.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:14.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:14.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:14.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:14.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:14.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:14.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.519 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.519 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.519 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:14.519 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.204149708999999, 2024-04-26T12:27:14.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:14.521 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.521 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.521 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:14.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:14.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:14.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:14.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:14.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:14.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:14.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:14.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:14.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:14.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:14.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:14.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:14.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:14.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:14.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:14.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:14.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:14.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:14.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:14.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:14.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:14.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:14.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:14.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:14.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:14.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:14.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:14.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:14.527 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.527 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.527 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.527 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.527 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:14.527 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.204114860000001, 2024-04-26T12:27:14.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:14.527 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.527 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.528 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:14.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:14.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:14.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:14.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:14.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:14.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:14.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:14.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:14.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:14.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:14.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:14.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:14.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:14.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:14.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:14.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:14.533 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.533 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.533 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.533 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.533 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:14.534 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.204080909999998, 2024-04-26T12:27:14.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:14.534 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.534 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.534 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:14.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:14.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:14.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:14.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:14.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:14.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:14.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:14.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:14.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:14.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:14.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:14.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:14.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:14.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:14.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:14.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:14.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:14.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:14.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:14.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:14.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:14.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:14.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.539 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.204060612999999, 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:14.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:14.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:14.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:14.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:14.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:14.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:14.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:14.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:14.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:14.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:14.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:14.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:14.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:14.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:14.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.545 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.546 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.546 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:14.546 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.204025492, 2024-04-26T12:27:14.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:14.546 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.546 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.546 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:14.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:14.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:14.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:14.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:14.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:14.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:14.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:14.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:14.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:14.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:14.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:14.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:14.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:14.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:14.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:14.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:14.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:14.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:14.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:14.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:14.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:14.552 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.552 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.552 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.552 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.552 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:14.552 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.203990252000001, 2024-04-26T12:27:14.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:14.552 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.552 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.552 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:14.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:14.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:14.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:14.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:14.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:14.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:14.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:14.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:14.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:14.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:14.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:14.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:14.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:14.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:14.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:14.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:14.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:14.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:14.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:14.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:14.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:14.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:14.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:14.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:14.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:14.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:14.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:14.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:14.558 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.558 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.558 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.558 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.558 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:14.558 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.203848504, 2024-04-26T12:27:14.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:14.559 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.559 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.559 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:14.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:14.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:14.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:14.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:14.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:14.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:14.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:14.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:14.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:14.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:14.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:14.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:14.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:14.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:14.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:14.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:14.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:14.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:14.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:14.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:14.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:14.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:14.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:14.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.564 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.564 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.565 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:14.565 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.203824484999998, 2024-04-26T12:27:14.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:14.565 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.565 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.565 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:14.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:14.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:14.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:14.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:14.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:14.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:14.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:14.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:14.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:14.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:14.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:14.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:14.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:14.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:14.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:14.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:14.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:14.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:14.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:14.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:14.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:14.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:14.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:14.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:14.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:14.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:14.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:14.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:14.570 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.570 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.570 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.571 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.571 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:14.571 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.203800517000001, 2024-04-26T12:27:14.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:27:14.571 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.571 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:14.571 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:14.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:14.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:27:14.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:27:14.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:27:14.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:27:14.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:27:14.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:27:14.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:27:14.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:27:14.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:27:14.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:14.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:27:14.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:27:14.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:27:14.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:27:14.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:27:14.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:14.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:27:14.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:27:14.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:14.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:27:14.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:27:14.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:27:14.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:27:14.577 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.577 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.577 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.577 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:14.577 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:14.577 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.203767136, 2024-04-26T12:27:14.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:27:14.577 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:14.577 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:27:14.578 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:14.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:14.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:14.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:14.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:14.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:14.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:14.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:14.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:14.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:14.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:27:14.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:27:14.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:14.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:27:14.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:27:14.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:14.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:27:14.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:27:14.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:27:14.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:27:14.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:14.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:27:14.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:27:14.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:14.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:27:14.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:27:14.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:14.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:27:14.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:27:14.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:14.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:14.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:14.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:27:14.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:27:14.582 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.582 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.582 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.582 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:14.582 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:14.582 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:14.583 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:14.584 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:14.583+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:14.593 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:27:14.684 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:14.683+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:14.725 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T12:27:14.726 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:14.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:14.819 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:14.818+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:14.887 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:14.885+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:14.902 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:14.902 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:14.902 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T12:27:14.902 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T12:27:14.902 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:14.912 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:14.995 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:14.994+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:15.080 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:15.080 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T12:27:15.080 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T12:27:15.080 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T12:27:15.080 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.080 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 3 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:27:15.080 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:15.081 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.825107763999998, 2024-04-26T12:27:15.081 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0048986250000000002, 2024-04-26T12:27:15.081 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.081 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:15.081 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.081 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.081 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.081 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:15.081 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.081 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.081 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.081 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.081 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:15.082 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.082 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.082 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.082 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.082 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:15.082 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.082 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.082 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.082 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.082 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253094+0000", 2024-04-26T12:27:15.082 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0924000000000001e-05 2024-04-26T12:27:15.082 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.082 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.083 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.083 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253109+0000", 2024-04-26T12:27:15.083 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4982e-05 2024-04-26T12:27:15.083 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.083 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.083 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.083 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253127+0000", 2024-04-26T12:27:15.083 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8586000000000001e-05 2024-04-26T12:27:15.083 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.083 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.083 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.083 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253214+0000", 2024-04-26T12:27:15.083 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6234000000000001e-05 2024-04-26T12:27:15.083 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.084 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.084 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.084 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257982+0000", 2024-04-26T12:27:15.084 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0047682150000000001 2024-04-26T12:27:15.084 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.084 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.084 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.084 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.084 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.084 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.084 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:15.084 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.824664604999999, 2024-04-26T12:27:15.085 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010912543, 2024-04-26T12:27:15.085 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.085 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.085 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.085 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.085 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.085 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:15.085 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.085 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.085 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.086 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.086 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:15.086 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.086 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.086 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.086 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.086 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253521+0000", 2024-04-26T12:27:15.086 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999943 2024-04-26T12:27:15.086 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.086 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.086 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.086 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253542+0000", 2024-04-26T12:27:15.086 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1061999999999999e-05 2024-04-26T12:27:15.086 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.087 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.087 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.087 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253606+0000", 2024-04-26T12:27:15.087 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4012999999999999e-05 2024-04-26T12:27:15.087 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.087 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.087 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.087 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253619+0000", 2024-04-26T12:27:15.088 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3091999999999999e-05 2024-04-26T12:27:15.088 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.088 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.088 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.088 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:15.088 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013321599999999999 2024-04-26T12:27:15.088 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.088 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.088 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.088 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253923+0000", 2024-04-26T12:27:15.088 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017127900000000001 2024-04-26T12:27:15.088 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.088 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.089 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:15.089 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254085+0000", 2024-04-26T12:27:15.089 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000161566 2024-04-26T12:27:15.089 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.089 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.089 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:15.089 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257500+0000", 2024-04-26T12:27:15.089 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034156880000000001 2024-04-26T12:27:15.089 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.089 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.089 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:15.089 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264372+0000", 2024-04-26T12:27:15.089 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068719760000000001 2024-04-26T12:27:15.090 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.090 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.090 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:15.090 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264402+0000", 2024-04-26T12:27:15.090 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9128e-05 2024-04-26T12:27:15.090 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.090 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.090 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.090 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264439+0000", 2024-04-26T12:27:15.090 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7251e-05 2024-04-26T12:27:15.090 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.090 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.090 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.091 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.091 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.091 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.091 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:15.091 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.824555502999999, 2024-04-26T12:27:15.091 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010957691, 2024-04-26T12:27:15.091 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.091 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.091 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.091 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.091 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.091 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:15.091 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.091 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.092 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.092 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.092 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:15.092 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.092 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.092 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.092 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.092 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:15.092 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.092 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.092 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.092 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.092 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253639+0000", 2024-04-26T12:27:15.092 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:27:15.093 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.093 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.093 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.093 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253648+0000", 2024-04-26T12:27:15.093 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:27:15.093 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.093 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.093 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.093 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253655+0000", 2024-04-26T12:27:15.093 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8909999999999998e-06 2024-04-26T12:27:15.093 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.093 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.093 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.094 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254807+0000", 2024-04-26T12:27:15.094 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001151712 2024-04-26T12:27:15.094 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.094 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.094 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.094 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255417+0000", 2024-04-26T12:27:15.094 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00061023000000000002 2024-04-26T12:27:15.094 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.094 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.094 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:15.094 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255573+0000", 2024-04-26T12:27:15.094 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015571399999999999 2024-04-26T12:27:15.094 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.094 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.095 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:15.095 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260113+0000", 2024-04-26T12:27:15.095 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045405519999999998 2024-04-26T12:27:15.095 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.095 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.095 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:15.095 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264499+0000", 2024-04-26T12:27:15.095 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043857050000000002 2024-04-26T12:27:15.095 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.095 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.095 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:15.095 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264552+0000", 2024-04-26T12:27:15.096 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2602000000000002e-05 2024-04-26T12:27:15.096 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.096 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.096 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.096 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264593+0000", 2024-04-26T12:27:15.096 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1341000000000003e-05 2024-04-26T12:27:15.096 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.096 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.096 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.096 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.096 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.096 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.096 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:15.096 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.824530097, 2024-04-26T12:27:15.097 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091815760000000003, 2024-04-26T12:27:15.097 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.097 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.097 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.097 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.097 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.097 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:15.097 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.097 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.097 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.097 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.097 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:15.097 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.098 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.098 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.098 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.098 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253660+0000", 2024-04-26T12:27:15.098 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.098 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.098 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.098 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.098 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253664+0000", 2024-04-26T12:27:15.098 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:27:15.098 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.098 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.098 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.099 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253679+0000", 2024-04-26T12:27:15.099 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4208e-05 2024-04-26T12:27:15.099 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.099 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.099 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.099 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253685+0000", 2024-04-26T12:27:15.099 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:27:15.099 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.099 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.099 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.099 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254897+0000", 2024-04-26T12:27:15.099 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001211801 2024-04-26T12:27:15.099 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.099 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.100 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.100 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255009+0000", 2024-04-26T12:27:15.100 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011189 2024-04-26T12:27:15.100 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.100 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.100 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:15.100 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255142+0000", 2024-04-26T12:27:15.100 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013265799999999999 2024-04-26T12:27:15.100 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.100 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.100 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:15.100 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.259665+0000", 2024-04-26T12:27:15.100 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004523862 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262759+0000", 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003093391 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262805+0000", 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6399000000000001e-05 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262842+0000", 2024-04-26T12:27:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7184000000000002e-05 2024-04-26T12:27:15.102 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.102 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.102 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.102 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.102 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.102 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.102 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:15.102 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.824500187000002, 2024-04-26T12:27:15.102 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092939230000000008, 2024-04-26T12:27:15.102 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.102 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.102 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.102 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253690+0000", 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.103 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.104 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.104 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253695+0000", 2024-04-26T12:27:15.104 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6090000000000003e-06 2024-04-26T12:27:15.104 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.104 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.104 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.104 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253705+0000", 2024-04-26T12:27:15.104 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0326000000000001e-05 2024-04-26T12:27:15.104 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.104 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.104 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.104 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253714+0000", 2024-04-26T12:27:15.104 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:27:15.104 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.105 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.105 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.105 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256115+0000", 2024-04-26T12:27:15.105 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024015450000000002 2024-04-26T12:27:15.105 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.105 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.105 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.105 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256215+0000", 2024-04-26T12:27:15.105 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010016700000000001 2024-04-26T12:27:15.105 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.105 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.105 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:15.105 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256368+0000", 2024-04-26T12:27:15.105 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015244999999999999 2024-04-26T12:27:15.106 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.106 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.106 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:15.106 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260313+0000", 2024-04-26T12:27:15.106 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00394481 2024-04-26T12:27:15.106 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.106 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.106 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:15.106 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262895+0000", 2024-04-26T12:27:15.106 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0025824670000000002 2024-04-26T12:27:15.106 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.106 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.107 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:15.107 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262946+0000", 2024-04-26T12:27:15.107 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1072999999999997e-05 2024-04-26T12:27:15.107 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.107 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.107 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.107 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262985+0000", 2024-04-26T12:27:15.107 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8529000000000003e-05 2024-04-26T12:27:15.107 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.107 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.107 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.107 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.108 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.108 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.108 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:15.108 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.824470825999999, 2024-04-26T12:27:15.108 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011070178999999999, 2024-04-26T12:27:15.108 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.108 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.108 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.108 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.108 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.109 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:15.109 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.109 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.109 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.109 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.109 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:15.109 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.109 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.109 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.109 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.109 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:15.109 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.109 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.110 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.110 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.110 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253724+0000", 2024-04-26T12:27:15.110 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0890000000000002e-06 2024-04-26T12:27:15.110 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.110 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.110 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.110 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253736+0000", 2024-04-26T12:27:15.110 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2252999999999999e-05 2024-04-26T12:27:15.110 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.110 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.110 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.110 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253742+0000", 2024-04-26T12:27:15.111 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9499999999999998e-06 2024-04-26T12:27:15.111 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.111 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.111 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.111 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256230+0000", 2024-04-26T12:27:15.111 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002488114 2024-04-26T12:27:15.111 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.111 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.111 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.111 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256421+0000", 2024-04-26T12:27:15.111 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019087999999999999 2024-04-26T12:27:15.111 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.111 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.111 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:15.112 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256583+0000", 2024-04-26T12:27:15.112 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000162566 2024-04-26T12:27:15.112 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.112 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.112 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:15.112 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260316+0000", 2024-04-26T12:27:15.112 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037329239999999999 2024-04-26T12:27:15.112 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.112 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.112 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:15.112 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264713+0000", 2024-04-26T12:27:15.112 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043968380000000001 2024-04-26T12:27:15.112 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.112 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.113 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:15.113 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:15.113 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1124000000000001e-05 2024-04-26T12:27:15.113 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.113 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.113 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.113 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264790+0000", 2024-04-26T12:27:15.113 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5923999999999997e-05 2024-04-26T12:27:15.113 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.113 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.113 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.113 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.113 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.114 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.114 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:15.114 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.824439009999999, 2024-04-26T12:27:15.114 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0086059009999999991, 2024-04-26T12:27:15.114 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.114 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.114 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.114 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.114 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.114 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:15.114 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.114 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.114 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.114 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.115 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:15.115 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.115 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.115 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.115 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.115 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253751+0000", 2024-04-26T12:27:15.115 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.115 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.115 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.115 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.115 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253756+0000", 2024-04-26T12:27:15.115 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9740000000000001e-06 2024-04-26T12:27:15.115 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.115 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253762+0000", 2024-04-26T12:27:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9769999999999997e-06 2024-04-26T12:27:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253767+0000", 2024-04-26T12:27:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:27:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254160+0000", 2024-04-26T12:27:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039256700000000002 2024-04-26T12:27:15.116 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.117 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.117 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.117 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254292+0000", 2024-04-26T12:27:15.117 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013190399999999999 2024-04-26T12:27:15.117 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.117 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.117 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:15.117 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254453+0000", 2024-04-26T12:27:15.117 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000160982 2024-04-26T12:27:15.117 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.117 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.117 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:15.117 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257354+0000", 2024-04-26T12:27:15.117 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029008229999999999 2024-04-26T12:27:15.118 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.118 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.118 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:15.118 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262281+0000", 2024-04-26T12:27:15.118 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049274760000000001 2024-04-26T12:27:15.118 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.118 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.118 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:15.118 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262323+0000", 2024-04-26T12:27:15.118 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.189e-05 2024-04-26T12:27:15.118 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.118 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.118 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.118 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262358+0000", 2024-04-26T12:27:15.119 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4826000000000002e-05 2024-04-26T12:27:15.119 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.119 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.119 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.119 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.119 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.119 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:32 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.119 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:15.119 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.824082957999998, 2024-04-26T12:27:15.119 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083641310000000003, 2024-04-26T12:27:15.119 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.119 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:15.119 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.119 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.120 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.120 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:15.120 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.120 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.120 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.120 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.120 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:15.120 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.120 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.120 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.120 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.120 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254107+0000", 2024-04-26T12:27:15.120 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:15.120 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.121 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.121 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.121 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254113+0000", 2024-04-26T12:27:15.121 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:27:15.121 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.121 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.121 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.121 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254122+0000", 2024-04-26T12:27:15.121 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.149e-06 2024-04-26T12:27:15.121 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.121 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.122 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.122 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254131+0000", 2024-04-26T12:27:15.122 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5609999999999999e-06 2024-04-26T12:27:15.122 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.122 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.122 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.122 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255227+0000", 2024-04-26T12:27:15.122 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010961 2024-04-26T12:27:15.122 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.122 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.122 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.122 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255355+0000", 2024-04-26T12:27:15.122 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012883299999999999 2024-04-26T12:27:15.122 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.123 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.123 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.123 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262472+0000", 2024-04-26T12:27:15.123 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071165949999999999 2024-04-26T12:27:15.123 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.123 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.123 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.123 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.123 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.123 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:33 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.123 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:15.123 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.824054834000002, 2024-04-26T12:27:15.123 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012698262, 2024-04-26T12:27:15.123 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.124 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:15.124 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.124 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.124 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.124 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:15.124 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.124 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.124 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.124 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.124 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:15.124 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.124 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.124 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.124 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254138+0000", 2024-04-26T12:27:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2460000000000002e-06 2024-04-26T12:27:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254145+0000", 2024-04-26T12:27:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7070000000000003e-06 2024-04-26T12:27:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.126 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.126 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254164+0000", 2024-04-26T12:27:15.126 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9604999999999999e-05 2024-04-26T12:27:15.126 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.126 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.126 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.126 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257574+0000", 2024-04-26T12:27:15.126 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034098980000000002 2024-04-26T12:27:15.126 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.126 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.126 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.126 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257731+0000", 2024-04-26T12:27:15.126 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015735400000000001 2024-04-26T12:27:15.126 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266834+0000", 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091028099999999994 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.824019095000001, 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0087469690000000003, 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.127 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:15.128 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.128 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.128 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.128 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:15.128 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.128 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.128 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.128 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.128 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:15.128 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.128 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.128 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.128 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.128 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254171+0000", 2024-04-26T12:27:15.129 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.129 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.129 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.129 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.129 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254178+0000", 2024-04-26T12:27:15.129 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7710000000000001e-06 2024-04-26T12:27:15.129 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.129 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.129 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.129 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254185+0000", 2024-04-26T12:27:15.129 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6249999999999998e-06 2024-04-26T12:27:15.129 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.129 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.129 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.130 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254203+0000", 2024-04-26T12:27:15.130 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8003999999999999e-05 2024-04-26T12:27:15.130 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.130 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.130 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.130 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254408+0000", 2024-04-26T12:27:15.130 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020469100000000001 2024-04-26T12:27:15.130 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.130 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.130 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.130 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254525+0000", 2024-04-26T12:27:15.130 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000116319 2024-04-26T12:27:15.131 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.131 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.131 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.131 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262919+0000", 2024-04-26T12:27:15.131 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083942440000000004 2024-04-26T12:27:15.131 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.131 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.131 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.131 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.131 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.131 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:18 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:15.131 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:15.131 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.816809557999999, 2024-04-26T12:27:15.132 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016521190000000001, 2024-04-26T12:27:15.132 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.132 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.132 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.132 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.132 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.132 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:15.132 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.132 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.132 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.132 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.132 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:15.132 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.132 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.133 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.133 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.133 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:15.133 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.133 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.133 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.133 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.133 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261387+0000", 2024-04-26T12:27:15.133 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4880000000000004e-06 2024-04-26T12:27:15.133 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.133 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.133 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.133 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261396+0000", 2024-04-26T12:27:15.134 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2209999999999997e-06 2024-04-26T12:27:15.134 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.134 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.134 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.134 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261414+0000", 2024-04-26T12:27:15.134 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8386e-05 2024-04-26T12:27:15.134 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.134 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.134 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.134 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261460+0000", 2024-04-26T12:27:15.134 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6029999999999998e-05 2024-04-26T12:27:15.134 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.134 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.134 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.135 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261516+0000", 2024-04-26T12:27:15.135 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6418000000000001e-05 2024-04-26T12:27:15.135 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.135 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.135 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:15.135 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263008+0000", 2024-04-26T12:27:15.135 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0014912910000000001 2024-04-26T12:27:15.135 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.135 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.135 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.135 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263033+0000", 2024-04-26T12:27:15.135 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5763e-05 2024-04-26T12:27:15.135 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.136 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.136 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.136 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.136 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.136 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:28 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:15.136 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:15.136 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.816604860999998, 2024-04-26T12:27:15.136 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001530869, 2024-04-26T12:27:15.136 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.136 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.136 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.136 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.136 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.136 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.137 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261597+0000", 2024-04-26T12:27:15.138 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1344e-05 2024-04-26T12:27:15.138 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.138 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.138 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.138 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261605+0000", 2024-04-26T12:27:15.138 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9039999999999992e-06 2024-04-26T12:27:15.138 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.139 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.139 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.139 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261612+0000", 2024-04-26T12:27:15.139 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8580000000000002e-06 2024-04-26T12:27:15.139 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.139 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.139 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.139 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261886+0000", 2024-04-26T12:27:15.139 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027415399999999998 2024-04-26T12:27:15.139 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.139 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.139 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.139 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261905+0000", 2024-04-26T12:27:15.140 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8898000000000001e-05 2024-04-26T12:27:15.140 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.140 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.140 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:15.140 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263093+0000", 2024-04-26T12:27:15.140 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011877490000000001 2024-04-26T12:27:15.140 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.140 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.140 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.140 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263117+0000", 2024-04-26T12:27:15.140 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4338999999999999e-05 2024-04-26T12:27:15.140 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.140 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:23 3.b e15/13 ondisk, result = 0)", 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262185+0000", 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.816006002999998, 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017966600000000001, 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262185+0000", 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.141 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.142 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.142 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.142 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262185+0000", 2024-04-26T12:27:15.142 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.142 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.142 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.142 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.142 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262184+0000", 2024-04-26T12:27:15.142 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.142 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.142 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.142 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.143 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262189+0000", 2024-04-26T12:27:15.143 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7849999999999999e-06 2024-04-26T12:27:15.143 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.143 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.143 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.143 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262198+0000", 2024-04-26T12:27:15.143 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4229999999999994e-06 2024-04-26T12:27:15.143 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.143 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.143 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.143 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262207+0000", 2024-04-26T12:27:15.143 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2029999999999992e-06 2024-04-26T12:27:15.143 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.143 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.144 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.144 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262271+0000", 2024-04-26T12:27:15.144 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4655999999999999e-05 2024-04-26T12:27:15.144 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.144 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.144 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.144 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262277+0000", 2024-04-26T12:27:15.144 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0299999999999999e-06 2024-04-26T12:27:15.144 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.144 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.144 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.144 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262365+0000", 2024-04-26T12:27:15.144 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7201999999999996e-05 2024-04-26T12:27:15.145 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.145 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.145 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.145 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.145 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.145 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing_reply(3.b epoch 15/13 rep_tid 4 lcod 15'2)", 2024-04-26T12:27:15.145 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:15.145 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.815917926000001, 2024-04-26T12:27:15.145 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020538300000000001, 2024-04-26T12:27:15.145 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.145 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:15.145 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.145 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.146 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.146 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:15.146 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.146 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.146 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.146 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.146 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:15.146 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.146 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.146 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.146 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.146 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262272+0000", 2024-04-26T12:27:15.146 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:15.147 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.147 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.147 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.147 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262277+0000", 2024-04-26T12:27:15.147 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9169999999999997e-06 2024-04-26T12:27:15.147 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.147 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.147 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.147 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262287+0000", 2024-04-26T12:27:15.147 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0237e-05 2024-04-26T12:27:15.147 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.147 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.147 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.148 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262297+0000", 2024-04-26T12:27:15.148 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3219999999999999e-06 2024-04-26T12:27:15.148 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.148 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.148 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.148 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262382+0000", 2024-04-26T12:27:15.148 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4969999999999995e-05 2024-04-26T12:27:15.148 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.148 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.148 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.148 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262478+0000", 2024-04-26T12:27:15.148 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6704000000000001e-05 2024-04-26T12:27:15.148 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.148 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.149 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.149 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.149 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.149 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e15/13 ondisk, result = 0)", 2024-04-26T12:27:15.149 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:15.149 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.815473389000001, 2024-04-26T12:27:15.149 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027471, 2024-04-26T12:27:15.149 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.149 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:15.149 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.149 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.149 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.149 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:15.149 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.150 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.150 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.150 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.150 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:15.150 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.150 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.150 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.150 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.150 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:15.150 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.150 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.150 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.150 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.150 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262720+0000", 2024-04-26T12:27:15.151 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4509999999999999e-06 2024-04-26T12:27:15.151 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.151 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.151 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.151 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262726+0000", 2024-04-26T12:27:15.151 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8599999999999998e-06 2024-04-26T12:27:15.151 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.151 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.151 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.151 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262732+0000", 2024-04-26T12:27:15.151 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5889999999999999e-06 2024-04-26T12:27:15.151 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.151 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.151 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262882+0000", 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014968800000000001 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262890+0000", 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9279999999999993e-06 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262992+0000", 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010247300000000001 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.152 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.153 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.153 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.153 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:15.153 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:15.153 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.813800830000002, 2024-04-26T12:27:15.153 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021676200000000001, 2024-04-26T12:27:15.153 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.153 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:15.153 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.153 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.153 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.153 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:15.153 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.154 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.154 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.154 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.154 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:15.154 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.154 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.154 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.154 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.154 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:15.154 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.154 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.154 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.154 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.154 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264404+0000", 2024-04-26T12:27:15.155 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3998999999999999e-05 2024-04-26T12:27:15.155 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.155 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.155 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.155 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264411+0000", 2024-04-26T12:27:15.155 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:27:15.155 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.155 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.155 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.155 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264424+0000", 2024-04-26T12:27:15.155 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2843999999999999e-05 2024-04-26T12:27:15.155 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.155 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.155 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.156 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264485+0000", 2024-04-26T12:27:15.156 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0464000000000002e-05 2024-04-26T12:27:15.156 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.156 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.156 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.156 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264493+0000", 2024-04-26T12:27:15.156 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.507e-06 2024-04-26T12:27:15.156 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.156 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.156 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.156 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264607+0000", 2024-04-26T12:27:15.156 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000113591 2024-04-26T12:27:15.156 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.157 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.157 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.157 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.157 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.157 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:21 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:15.157 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:15.157 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.813761103000001, 2024-04-26T12:27:15.157 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00037041599999999999, 2024-04-26T12:27:15.157 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.157 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:15.157 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.157 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.157 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.157 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:15.158 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.158 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.158 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.158 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.158 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:15.158 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.158 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.158 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.158 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.158 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264429+0000", 2024-04-26T12:27:15.158 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.158 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.159 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.159 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.159 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264432+0000", 2024-04-26T12:27:15.159 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0770000000000002e-06 2024-04-26T12:27:15.159 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.159 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.159 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.159 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264435+0000", 2024-04-26T12:27:15.159 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8340000000000001e-06 2024-04-26T12:27:15.159 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.159 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.159 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.159 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264438+0000", 2024-04-26T12:27:15.160 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5280000000000002e-06 2024-04-26T12:27:15.160 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.160 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.160 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.160 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264703+0000", 2024-04-26T12:27:15.160 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026548400000000002 2024-04-26T12:27:15.160 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.160 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.160 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.160 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264709+0000", 2024-04-26T12:27:15.160 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8390000000000003e-06 2024-04-26T12:27:15.160 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.160 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.160 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.161 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264800+0000", 2024-04-26T12:27:15.161 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0931000000000001e-05 2024-04-26T12:27:15.161 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.161 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.161 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.161 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.161 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.161 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:15.161 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:15.161 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.812955202000001, 2024-04-26T12:27:15.161 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016589860000000001, 2024-04-26T12:27:15.161 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.161 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.162 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.162 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.162 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.162 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:15.162 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.162 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.162 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.162 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.162 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:15.162 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.162 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.162 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.162 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.162 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265235+0000", 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265252+0000", 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6307000000000002e-05 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265257+0000", 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8279999999999999e-06 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.163 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265263+0000", 2024-04-26T12:27:15.164 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9399999999999999e-06 2024-04-26T12:27:15.164 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.164 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.164 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.164 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265300+0000", 2024-04-26T12:27:15.164 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6315e-05 2024-04-26T12:27:15.164 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.164 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.164 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.164 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265312+0000", 2024-04-26T12:27:15.164 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2451e-05 2024-04-26T12:27:15.164 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.164 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.164 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:15.165 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266864+0000", 2024-04-26T12:27:15.165 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015521090000000001 2024-04-26T12:27:15.165 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.165 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.165 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.165 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266895+0000", 2024-04-26T12:27:15.165 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0426e-05 2024-04-26T12:27:15.165 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.165 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.165 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.165 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.165 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.165 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:22 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:15.165 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:15.166 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.812834462000001, 2024-04-26T12:27:15.166 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021988139999999999, 2024-04-26T12:27:15.166 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.166 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.166 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.166 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.166 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.166 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:15.166 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.166 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.166 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.166 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.166 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:15.167 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.167 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.167 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.167 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.167 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:15.167 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967296 2024-04-26T12:27:15.167 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.167 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.167 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.167 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265361+0000", 2024-04-26T12:27:15.167 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6979999999999997e-06 2024-04-26T12:27:15.167 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.167 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.167 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.168 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265366+0000", 2024-04-26T12:27:15.168 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6550000000000003e-06 2024-04-26T12:27:15.168 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.168 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.168 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.168 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265379+0000", 2024-04-26T12:27:15.168 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.358e-05 2024-04-26T12:27:15.168 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.168 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.168 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.168 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265535+0000", 2024-04-26T12:27:15.168 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015586800000000001 2024-04-26T12:27:15.168 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.168 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.169 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.169 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265556+0000", 2024-04-26T12:27:15.169 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1202000000000001e-05 2024-04-26T12:27:15.169 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.169 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.169 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:15.169 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267528+0000", 2024-04-26T12:27:15.169 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0019722099999999998 2024-04-26T12:27:15.169 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.169 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.169 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.169 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267555+0000", 2024-04-26T12:27:15.169 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6775999999999999e-05 2024-04-26T12:27:15.169 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.170 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.170 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.170 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.170 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.170 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-26T12:27:15.170 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:15.170 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 17.167816290000001, 2024-04-26T12:27:15.170 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020315099999999998, 2024-04-26T12:27:15.170 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:15.170 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.170 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:15.170 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.171 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:15.171 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:15.171 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.171 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.171 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.171 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:15.171 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:15.171 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:15.171 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.171 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.171 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:15.171 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910372+0000", 2024-04-26T12:27:15.171 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-26T12:27:15.171 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910387+0000", 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5252999999999999e-05 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910418+0000", 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0778999999999998e-05 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910437+0000", 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9619999999999998e-05 2024-04-26T12:27:15.172 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910587+0000", 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014922000000000001 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910837+0000", 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025089099999999999 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910973+0000", 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000135124 2024-04-26T12:27:15.173 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.174 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.174 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:15.174 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.911616+0000", 2024-04-26T12:27:15.174 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00064392799999999999 2024-04-26T12:27:15.174 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.174 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.174 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:15.174 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912341+0000", 2024-04-26T12:27:15.174 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00072415700000000001 2024-04-26T12:27:15.174 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.174 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.174 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:15.175 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912379+0000", 2024-04-26T12:27:15.175 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8724999999999999e-05 2024-04-26T12:27:15.175 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:15.175 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:15.175 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:15.175 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912406+0000", 2024-04-26T12:27:15.175 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6752999999999999e-05 2024-04-26T12:27:15.175 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.175 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.175 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.175 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:15.175 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:15.175 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:15.177 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:15.178 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:15.176+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:15.277 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:15.277+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:15.318 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:15.318 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:15.318 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:15.318 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:15.328 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:15.411 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:15.411+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:15.479 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:15.479+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:15.494 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:15.494 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:15.494 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:15.494 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:15.495 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:15.504 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:15.580 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:15.580+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:15.589 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2024-04-26T12:27:15.673 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:15.673 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:15.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:15.674 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:15.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.674 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:15.674 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:15.674 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.789328010999998, 2024-04-26T12:27:15.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:15.674 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.674 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.674 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:15.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:15.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:15.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:15.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:15.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:15.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:15.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:15.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:15.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:15.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:15.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:15.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:15.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:15.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:15.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:15.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:15.679 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.679 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.679 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.679 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:15.679 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:15.679 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.788688663999999, 2024-04-26T12:27:15.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:15.679 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.680 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.680 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:15.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:15.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:15.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:15.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:15.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:15.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:15.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:15.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:15.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:15.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:15.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:15.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:15.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:15.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:15.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:15.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:15.684 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.685 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.685 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.685 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:15.685 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:15.685 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.658986473999999, 2024-04-26T12:27:15.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:15.685 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.685 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.685 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:15.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:15.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:15.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:15.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:15.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:15.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:15.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:15.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:15.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:15.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:15.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:15.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:15.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:15.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:15.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:15.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:15.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:15.689 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.689 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.689 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.689 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:15.689 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:15.689 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.658491888, 2024-04-26T12:27:15.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:15.690 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.690 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.690 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:15.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:15.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:15.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:15.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:15.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:15.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:15.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:15.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:15.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:15.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:15.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.694 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.694 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:15.694 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:15.694 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.656489703999998, 2024-04-26T12:27:15.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:15.694 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.695 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.695 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:15.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:15.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:15.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:15.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:15.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:15.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:15.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:15.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:15.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:15.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:15.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:15.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:15.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:15.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:15.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:15.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:15.698 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.699 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.699 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.699 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:15.699 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:15.699 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.656083364000001, 2024-04-26T12:27:15.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:15.699 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.699 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.699 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:15.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:15.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:15.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:15.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:15.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:15.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:15.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:15.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:15.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:15.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:15.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:15.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:15.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:15.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:15.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:15.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:15.703 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.704 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.704 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.704 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:15.704 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:15.704 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.655728539999998, 2024-04-26T12:27:15.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:15.704 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.704 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.704 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:15.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:15.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:15.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:15.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:15.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:15.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:15.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:15.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:15.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:15.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:15.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:15.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:15.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:15.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:15.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:15.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:15.708 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.709 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.709 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.709 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:15.709 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:15.710 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.553170126000001, 2024-04-26T12:27:15.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:15.710 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.710 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.710 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:15.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:15.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:15.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:15.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:15.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:15.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:15.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:15.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:15.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:15.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:15.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:15.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:15.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:15.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:15.714 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.714 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.714 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.714 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:15.714 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:15.714 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.552773598000002, 2024-04-26T12:27:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:15.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:15.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:15.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:15.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:15.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:15.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:15.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:15.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:15.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:15.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:15.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:15.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:15.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:15.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:15.718 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.718 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.719 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.719 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:15.719 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:15.719 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.455763990000001, 2024-04-26T12:27:15.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:15.719 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.719 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.719 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:15.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:15.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:15.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:15.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:15.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:15.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:15.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:15.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:15.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:15.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:15.723 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.723 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.723 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.723 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:15.723 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:15.723 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.455070274000001, 2024-04-26T12:27:15.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:15.724 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.724 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.724 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:15.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:15.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:15.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:15.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:15.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:15.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:15.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:15.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:15.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:15.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:15.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:15.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:15.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:15.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:15.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:15.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:15.727 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.727 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.727 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.728 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.728 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:15.728 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.420331219000001, 2024-04-26T12:27:15.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:15.728 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.728 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.728 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:15.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:15.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:15.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:15.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:15.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:15.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:15.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:15.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:15.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:15.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:15.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:15.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:15.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:15.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:15.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:15.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:15.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:15.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:15.733 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.733 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.733 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.733 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.733 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:15.733 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.419510299999999, 2024-04-26T12:27:15.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:15.733 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.733 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.733 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:15.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:15.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:15.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:15.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:15.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:15.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:15.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:15.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:15.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:15.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:15.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:15.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:15.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:15.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:15.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:15.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:15.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:15.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:15.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:15.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:15.738 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.738 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.738 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.739 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.739 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:15.739 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.41948021, 2024-04-26T12:27:15.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:15.739 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.739 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.739 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:15.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:15.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:15.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:15.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:15.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:15.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:15.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:15.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:15.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:15.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:15.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:15.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:15.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:15.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:15.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:15.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:15.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:15.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:15.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:15.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:15.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:15.744 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.744 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.744 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.744 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.744 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:15.744 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.419426422000001, 2024-04-26T12:27:15.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:15.744 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.745 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.745 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:15.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:15.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:15.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:15.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:15.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:15.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:15.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:15.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:15.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:15.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:15.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:15.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:15.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:15.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:15.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:15.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:15.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:15.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:15.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:15.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:15.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:15.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:15.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:15.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:15.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:15.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:15.749 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.749 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.749 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.750 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.750 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:15.750 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.419373865000001, 2024-04-26T12:27:15.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:15.750 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.750 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.750 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:15.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:15.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:15.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:15.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:15.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:15.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:15.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:15.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:15.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:15.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:15.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:15.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:15.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:15.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:15.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:15.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:15.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:15.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:15.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:15.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:15.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:15.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:15.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:15.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:15.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:15.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:15.755 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.755 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.755 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.755 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.755 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:15.755 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.419333650999999, 2024-04-26T12:27:15.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:15.756 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.756 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.756 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:15.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:15.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:15.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:15.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:15.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:15.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:15.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:15.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:15.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:15.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:15.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:15.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:15.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:15.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:15.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:15.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:15.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:15.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:15.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:15.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:15.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:15.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:15.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:15.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:15.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:15.760 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.760 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.761 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.761 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.761 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:15.761 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.419305489999999, 2024-04-26T12:27:15.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:15.761 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.761 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:15.761 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:15.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:15.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:15.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:15.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:15.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:15.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:15.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:15.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:15.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:15.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:15.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:15.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:15.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:15.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:15.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:15.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:15.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:15.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:15.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:15.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:15.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:15.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:15.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:15.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:15.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:15.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:15.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:15.766 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.766 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.766 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.767 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.767 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:15.767 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.419274801, 2024-04-26T12:27:15.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:15.767 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.767 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:15.767 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:15.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:15.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:15.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:15.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:15.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:15.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:15.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:15.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:15.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:15.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:15.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:15.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:15.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:15.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:15.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:15.770 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.771 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.771 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.771 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:15.771 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:15.771 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.419248228000001, 2024-04-26T12:27:15.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:15.771 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:15.771 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:15.771 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:15.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:15.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:15.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:15.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:15.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:15.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:15.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:15.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:15.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:15.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:15.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:15.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:15.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:15.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:15.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:15.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:15.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:15.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:15.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:15.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:15.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:15.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:15.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:15.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:15.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:15.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:15.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:15.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:15.775 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.775 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.775 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.775 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:15.775 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:15.775 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:15.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:27:15.777 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:15.776+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:15.778 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:15.878 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:15.877+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:15.918 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:15.918 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:15.919 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:15.919 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:15.929 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:15.939 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:15.959 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:15.978 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:15.980 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:15.980 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:15.980 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:16.013 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:16.013+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:16.079 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:16.079+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:16.096 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:16.096 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:16.107 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:16.190 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:16.190+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:16.273 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:16.273 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:16.281 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:16.281+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:16.282 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:16.382 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:16.381+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:16.423 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:16.423 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:16.433 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:16.517 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:16.517+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:16.583 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:16.582+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:16.601 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:16.602 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:16.610 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:16.694 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:16.694+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:16.778 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:16.778 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:16.785 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:16.785+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:16.787 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:16.886 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:16.885+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:16.929 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:16.929 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:16.939 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:16.987 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:16.987+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:17.088 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:17.088+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:17.105 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:17.106 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:17.116 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:17.189 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:17.188+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:17.242 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:17.243 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:17.253 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:17.297 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:17.297+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:17.391 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:17.390+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:17.391 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:17.392 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:17.402 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:17.492 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:17.492+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:17.570 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:17.570 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:17.580 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:17.592 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:27:17.592 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:27:17.593 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T12:27:17.593 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:27:17.593 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:27:17.593 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T12:27:17.603 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:27:17.623 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:17.623+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:17.694 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:17.693+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:17.706 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:17.706 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:17.716 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:17.723 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:17.724 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T12:27:17.724 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:17.795 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:17.794+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:17.842 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:17.842 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:17.852 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:17.896 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:17.895+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:17.978 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:17.978 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:17.989 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:17.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:27:17.996 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:17.996+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:18.097 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:18.097+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:18.115 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:18.115 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:18.125 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:18.139 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:18.159 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:18.178 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:18.179 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:18.180 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:18.180 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:18.198 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:18.198+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:18.261 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:18.261 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:18.262 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:18.262 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:18.272 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:18.313 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:18.312+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:18.400 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:18.399+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:18.438 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:18.438 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:18.438 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:18.438 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:18.438 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:18.448 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:18.501 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:18.501+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:18.575 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:18.575 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.691697655999999, 2024-04-26T12:27:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:18.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:18.580 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.691058308999999, 2024-04-26T12:27:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:18.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.561356118999999, 2024-04-26T12:27:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.585 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:18.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.589 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.590 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:18.590 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:18.590 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.560861533000001, 2024-04-26T12:27:18.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:18.590 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.590 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.590 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.558859348999999, 2024-04-26T12:27:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:18.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.558453009000001, 2024-04-26T12:27:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.599 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:18.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.603 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.558098184999999, 2024-04-26T12:27:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:18.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.608 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.455539771000002, 2024-04-26T12:27:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:18.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:18.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.455143242999998, 2024-04-26T12:27:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:18.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:18.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:18.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:18.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:18.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.358133635000002, 2024-04-26T12:27:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.357439919000001, 2024-04-26T12:27:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.322700864000002, 2024-04-26T12:27:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:18.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.321879944999999, 2024-04-26T12:27:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.632 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:18.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:18.637 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.321849855, 2024-04-26T12:27:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:18.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:18.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:18.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.321796067000001, 2024-04-26T12:27:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:18.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:18.649 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.321743510000001, 2024-04-26T12:27:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:18.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:18.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.321703295999999, 2024-04-26T12:27:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.655 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:18.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:18.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:18.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:18.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:18.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:18.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:18.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:18.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:18.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:18.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:18.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:18.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:18.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:18.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:18.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:18.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:18.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:18.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:18.660 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.660 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.660 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.661 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:18.661 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:18.661 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.321675135, 2024-04-26T12:27:18.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:18.661 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.661 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:18.661 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:18.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:18.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:18.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:18.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:18.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:18.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:18.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:18.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:18.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:18.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:18.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:18.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:18.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:18.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:18.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:18.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:18.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:18.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:18.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:18.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:18.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:18.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:18.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.666 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.321644446000001, 2024-04-26T12:27:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.321617873000001, 2024-04-26T12:27:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:18.674 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:18.675 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:18.676 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:18.675+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:18.677 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2024-04-26T12:27:18.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:18.777 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:18.776+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:18.812 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:18.813 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:18.813 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:18.813 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:18.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:18.878 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:18.877+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:18.948 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:18.948 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:18.948 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:18.948 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:18.949 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:18.958 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:18.979 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:18.979+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:19.080 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:19.079+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:19.086 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:19.086 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:19.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:19.086 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:19.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.086 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:19.086 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:19.086 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 31.75302284, 2024-04-26T12:27:19.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:19.086 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.086 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.086 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:19.087 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:19.087 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:19.087 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:19.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.087 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:19.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:19.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:19.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:19.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:19.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:19.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:19.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:19.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:19.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:19.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:19.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:19.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:19.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:19.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:19.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:19.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:19.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:19.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:19.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:19.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:19.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:19.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:19.092 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.092 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.092 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.092 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.092 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:19.092 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.834157016999999, 2024-04-26T12:27:19.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:19.093 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.093 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.093 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:19.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:19.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:19.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:19.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:19.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:19.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:19.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:19.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:19.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:19.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:19.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:19.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:19.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:19.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:19.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:19.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:19.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:19.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:19.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:19.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:19.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:19.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:19.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:19.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:19.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:19.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:19.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:19.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:19.098 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.098 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.099 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.099 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.099 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:19.099 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.834120805000001, 2024-04-26T12:27:19.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:19.099 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.099 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.099 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:19.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:19.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:19.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:19.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:19.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:19.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:19.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:19.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:19.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:19.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:19.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:19.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:19.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:19.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:19.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:19.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:19.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:19.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:19.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:19.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:19.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:19.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:19.105 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.105 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.105 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.105 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.105 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:19.105 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.834081830999999, 2024-04-26T12:27:19.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:19.105 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.105 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.105 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:19.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:19.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:19.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:19.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:19.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:19.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:19.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:19.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:19.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:19.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:19.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:19.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:19.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:19.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:19.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:19.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:19.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:19.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:19.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:19.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:19.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:19.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:19.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:19.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:19.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:19.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:19.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:19.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:19.111 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.111 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.111 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.111 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.112 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:19.112 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.834058664000001, 2024-04-26T12:27:19.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:19.112 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.112 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.112 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:19.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:19.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:19.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:19.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:19.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:19.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:19.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:19.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:19.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:19.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:19.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:19.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:19.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:19.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:19.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:19.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:19.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:19.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:19.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:19.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:19.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:19.118 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.118 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.118 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.118 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.118 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:19.118 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.834043287, 2024-04-26T12:27:19.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:19.118 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.118 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.834015096999998, 2024-04-26T12:27:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.833997099000001, 2024-04-26T12:27:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.833972507999999, 2024-04-26T12:27:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.833947558999999, 2024-04-26T12:27:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.833926635000001, 2024-04-26T12:27:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.833891785999999, 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.833857836, 2024-04-26T12:27:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.833837539000001, 2024-04-26T12:27:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.833802418000001, 2024-04-26T12:27:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.833767177999999, 2024-04-26T12:27:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.833625430000001, 2024-04-26T12:27:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.833601411, 2024-04-26T12:27:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.833577442999999, 2024-04-26T12:27:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:27:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:27:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:27:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:27:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:27:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:27:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:27:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:27:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:27:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:27:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:27:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:27:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:27:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:27:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:27:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:27:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:27:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:27:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:27:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:27:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.833544062000001, 2024-04-26T12:27:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:27:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:27:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:27:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:27:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:27:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:27:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:27:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:27:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:27:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:27:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:27:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:27:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:27:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:27:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:19.212 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:19.213 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:19.212+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:19.214 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:19.314 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:19.313+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:19.353 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:19.354 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:19.354 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T12:27:19.354 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:19.364 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:19.414 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:19.414+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:19.490 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:19.490 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:19.490 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T12:27:19.490 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T12:27:19.490 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:19.499 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:19.515 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:19.514+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:19.616 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:19.615+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:19.627 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:19.627 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T12:27:19.628 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T12:27:19.628 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T12:27:19.628 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.628 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 3 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:27:19.628 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:19.628 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.372895822, 2024-04-26T12:27:19.628 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0048986250000000002, 2024-04-26T12:27:19.628 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.628 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:19.628 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.628 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.628 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.628 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:19.628 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.629 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.629 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:19.629 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.629 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.629 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:19.629 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.629 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.629 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253094+0000", 2024-04-26T12:27:19.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0924000000000001e-05 2024-04-26T12:27:19.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.630 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.630 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253109+0000", 2024-04-26T12:27:19.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4982e-05 2024-04-26T12:27:19.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.630 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.630 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253127+0000", 2024-04-26T12:27:19.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8586000000000001e-05 2024-04-26T12:27:19.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.631 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.631 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253214+0000", 2024-04-26T12:27:19.631 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6234000000000001e-05 2024-04-26T12:27:19.631 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.631 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.631 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.631 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257982+0000", 2024-04-26T12:27:19.631 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0047682150000000001 2024-04-26T12:27:19.631 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.631 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.632 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.632 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.632 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.632 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.632 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:19.632 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.372452663000001, 2024-04-26T12:27:19.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010912543, 2024-04-26T12:27:19.632 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.632 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.632 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.632 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.632 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.632 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:19.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.633 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.633 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.633 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.633 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:19.633 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253521+0000", 2024-04-26T12:27:19.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999943 2024-04-26T12:27:19.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.635 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253542+0000", 2024-04-26T12:27:19.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1061999999999999e-05 2024-04-26T12:27:19.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.635 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253606+0000", 2024-04-26T12:27:19.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4012999999999999e-05 2024-04-26T12:27:19.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.635 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253619+0000", 2024-04-26T12:27:19.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3091999999999999e-05 2024-04-26T12:27:19.636 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.637 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.637 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.638 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:19.638 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013321599999999999 2024-04-26T12:27:19.638 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.638 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.638 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.638 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253923+0000", 2024-04-26T12:27:19.638 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017127900000000001 2024-04-26T12:27:19.638 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.638 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.638 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:19.638 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254085+0000", 2024-04-26T12:27:19.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000161566 2024-04-26T12:27:19.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.639 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:19.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257500+0000", 2024-04-26T12:27:19.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034156880000000001 2024-04-26T12:27:19.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.639 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264372+0000", 2024-04-26T12:27:19.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068719760000000001 2024-04-26T12:27:19.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.640 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:19.640 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264402+0000", 2024-04-26T12:27:19.640 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9128e-05 2024-04-26T12:27:19.640 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.640 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.640 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.640 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264439+0000", 2024-04-26T12:27:19.640 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7251e-05 2024-04-26T12:27:19.640 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.640 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.640 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.640 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.640 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.640 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.641 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:19.641 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.372343561000001, 2024-04-26T12:27:19.641 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010957691, 2024-04-26T12:27:19.641 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.641 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.641 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.641 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.641 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.641 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:19.641 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.641 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.641 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.641 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.641 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:19.642 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.642 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.642 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.642 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.642 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:19.642 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.642 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.642 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.642 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.642 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253639+0000", 2024-04-26T12:27:19.642 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:27:19.642 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.642 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.643 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.643 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253648+0000", 2024-04-26T12:27:19.643 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:27:19.643 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.643 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.643 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.643 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253655+0000", 2024-04-26T12:27:19.643 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8909999999999998e-06 2024-04-26T12:27:19.643 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.643 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.643 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.643 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254807+0000", 2024-04-26T12:27:19.644 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001151712 2024-04-26T12:27:19.644 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.644 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.644 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.644 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255417+0000", 2024-04-26T12:27:19.644 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00061023000000000002 2024-04-26T12:27:19.644 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.644 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.644 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:19.644 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255573+0000", 2024-04-26T12:27:19.644 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015571399999999999 2024-04-26T12:27:19.644 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.644 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.644 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:19.645 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260113+0000", 2024-04-26T12:27:19.645 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045405519999999998 2024-04-26T12:27:19.645 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.645 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.645 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.645 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264499+0000", 2024-04-26T12:27:19.645 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043857050000000002 2024-04-26T12:27:19.645 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.645 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.645 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:19.645 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264552+0000", 2024-04-26T12:27:19.645 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2602000000000002e-05 2024-04-26T12:27:19.645 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.646 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.646 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.646 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264593+0000", 2024-04-26T12:27:19.646 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1341000000000003e-05 2024-04-26T12:27:19.646 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.646 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.646 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.646 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.646 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.646 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.646 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:19.647 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.372318154999999, 2024-04-26T12:27:19.647 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091815760000000003, 2024-04-26T12:27:19.647 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.647 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.647 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.647 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.647 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.647 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:19.647 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.647 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.647 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.647 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.647 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:19.648 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.648 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.648 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.648 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.648 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253660+0000", 2024-04-26T12:27:19.648 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.648 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.648 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.648 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.648 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253664+0000", 2024-04-26T12:27:19.648 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:27:19.648 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.648 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.648 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.649 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253679+0000", 2024-04-26T12:27:19.649 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4208e-05 2024-04-26T12:27:19.649 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.649 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.649 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.649 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253685+0000", 2024-04-26T12:27:19.649 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:27:19.649 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.649 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.650 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.650 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254897+0000", 2024-04-26T12:27:19.650 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001211801 2024-04-26T12:27:19.650 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.650 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.650 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.650 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255009+0000", 2024-04-26T12:27:19.650 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011189 2024-04-26T12:27:19.650 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.650 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.650 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.650 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255142+0000", 2024-04-26T12:27:19.650 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013265799999999999 2024-04-26T12:27:19.651 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.651 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.651 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:19.651 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.259665+0000", 2024-04-26T12:27:19.651 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004523862 2024-04-26T12:27:19.651 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.651 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.651 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.651 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262759+0000", 2024-04-26T12:27:19.651 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003093391 2024-04-26T12:27:19.651 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.651 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.651 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:19.652 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262805+0000", 2024-04-26T12:27:19.652 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6399000000000001e-05 2024-04-26T12:27:19.652 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.652 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.652 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.652 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262842+0000", 2024-04-26T12:27:19.652 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7184000000000002e-05 2024-04-26T12:27:19.652 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.652 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.652 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.652 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.652 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.652 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.652 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:19.653 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.372288245, 2024-04-26T12:27:19.653 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092939230000000008, 2024-04-26T12:27:19.653 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.653 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.653 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.653 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.653 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.653 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:19.653 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.653 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.653 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.653 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.653 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:19.653 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.654 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.654 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.654 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.654 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253690+0000", 2024-04-26T12:27:19.654 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.654 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.654 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.654 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.654 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253695+0000", 2024-04-26T12:27:19.654 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6090000000000003e-06 2024-04-26T12:27:19.654 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.654 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.654 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.655 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253705+0000", 2024-04-26T12:27:19.655 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0326000000000001e-05 2024-04-26T12:27:19.655 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.655 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.655 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.655 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253714+0000", 2024-04-26T12:27:19.655 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:27:19.655 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.655 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.655 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.655 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256115+0000", 2024-04-26T12:27:19.655 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024015450000000002 2024-04-26T12:27:19.655 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.656 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.656 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.656 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256215+0000", 2024-04-26T12:27:19.656 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010016700000000001 2024-04-26T12:27:19.656 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.656 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.656 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:19.656 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256368+0000", 2024-04-26T12:27:19.656 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015244999999999999 2024-04-26T12:27:19.656 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.656 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.656 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:19.656 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260313+0000", 2024-04-26T12:27:19.656 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00394481 2024-04-26T12:27:19.657 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.657 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.657 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.657 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262895+0000", 2024-04-26T12:27:19.657 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0025824670000000002 2024-04-26T12:27:19.657 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.657 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.657 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:19.657 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262946+0000", 2024-04-26T12:27:19.657 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1072999999999997e-05 2024-04-26T12:27:19.657 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.657 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.657 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.657 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262985+0000", 2024-04-26T12:27:19.658 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8529000000000003e-05 2024-04-26T12:27:19.658 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.658 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.658 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.658 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.658 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.658 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.658 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:19.658 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.372258884000001, 2024-04-26T12:27:19.658 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011070178999999999, 2024-04-26T12:27:19.658 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.658 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.658 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.658 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.659 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.659 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:19.659 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.659 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.659 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.659 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.659 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:19.659 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.659 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.659 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.659 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.659 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:19.660 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.660 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.660 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.660 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.660 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253724+0000", 2024-04-26T12:27:19.660 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0890000000000002e-06 2024-04-26T12:27:19.660 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.660 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.660 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.660 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253736+0000", 2024-04-26T12:27:19.660 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2252999999999999e-05 2024-04-26T12:27:19.660 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.660 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.661 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.661 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253742+0000", 2024-04-26T12:27:19.661 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9499999999999998e-06 2024-04-26T12:27:19.661 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.661 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.661 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.661 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256230+0000", 2024-04-26T12:27:19.661 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002488114 2024-04-26T12:27:19.661 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.661 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.661 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.661 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256421+0000", 2024-04-26T12:27:19.661 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019087999999999999 2024-04-26T12:27:19.661 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.662 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.662 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:19.662 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256583+0000", 2024-04-26T12:27:19.662 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000162566 2024-04-26T12:27:19.662 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.662 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.662 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:19.662 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260316+0000", 2024-04-26T12:27:19.662 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037329239999999999 2024-04-26T12:27:19.662 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.662 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.662 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.662 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264713+0000", 2024-04-26T12:27:19.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043968380000000001 2024-04-26T12:27:19.663 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.663 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.663 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:19.663 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:19.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1124000000000001e-05 2024-04-26T12:27:19.663 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.663 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.663 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.663 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264790+0000", 2024-04-26T12:27:19.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5923999999999997e-05 2024-04-26T12:27:19.663 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.663 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.663 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.664 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.664 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.664 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:19.664 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.372227068000001, 2024-04-26T12:27:19.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0086059009999999991, 2024-04-26T12:27:19.664 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.664 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.664 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.664 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.664 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:19.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:19.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253751+0000", 2024-04-26T12:27:19.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253756+0000", 2024-04-26T12:27:19.666 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9740000000000001e-06 2024-04-26T12:27:19.666 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.666 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.666 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253762+0000", 2024-04-26T12:27:19.666 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9769999999999997e-06 2024-04-26T12:27:19.666 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.666 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.666 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253767+0000", 2024-04-26T12:27:19.666 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:27:19.666 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.667 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.667 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254160+0000", 2024-04-26T12:27:19.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039256700000000002 2024-04-26T12:27:19.667 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.667 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.667 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254292+0000", 2024-04-26T12:27:19.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013190399999999999 2024-04-26T12:27:19.667 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.667 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:19.667 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254453+0000", 2024-04-26T12:27:19.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000160982 2024-04-26T12:27:19.668 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.668 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.668 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:19.668 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257354+0000", 2024-04-26T12:27:19.668 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029008229999999999 2024-04-26T12:27:19.668 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.668 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.668 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.668 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262281+0000", 2024-04-26T12:27:19.668 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049274760000000001 2024-04-26T12:27:19.668 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.668 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.668 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:19.669 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262323+0000", 2024-04-26T12:27:19.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.189e-05 2024-04-26T12:27:19.669 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.669 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.669 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262358+0000", 2024-04-26T12:27:19.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4826000000000002e-05 2024-04-26T12:27:19.669 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.669 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.669 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.669 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.670 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:32 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.670 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:19.670 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.371871016, 2024-04-26T12:27:19.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083641310000000003, 2024-04-26T12:27:19.670 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.670 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:19.670 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:19.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:19.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254107+0000", 2024-04-26T12:27:19.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:19.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254113+0000", 2024-04-26T12:27:19.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:27:19.672 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.672 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.672 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254122+0000", 2024-04-26T12:27:19.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.149e-06 2024-04-26T12:27:19.672 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.672 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.672 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254131+0000", 2024-04-26T12:27:19.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5609999999999999e-06 2024-04-26T12:27:19.672 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.672 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.672 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255227+0000", 2024-04-26T12:27:19.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010961 2024-04-26T12:27:19.673 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.673 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.673 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255355+0000", 2024-04-26T12:27:19.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012883299999999999 2024-04-26T12:27:19.673 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.673 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.673 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262472+0000", 2024-04-26T12:27:19.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071165949999999999 2024-04-26T12:27:19.673 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.673 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.673 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.674 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:33 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.674 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:19.674 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.371842892, 2024-04-26T12:27:19.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012698262, 2024-04-26T12:27:19.674 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.674 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:19.674 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:19.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:19.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:19.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254138+0000", 2024-04-26T12:27:19.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2460000000000002e-06 2024-04-26T12:27:19.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254145+0000", 2024-04-26T12:27:19.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7070000000000003e-06 2024-04-26T12:27:19.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254164+0000", 2024-04-26T12:27:19.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9604999999999999e-05 2024-04-26T12:27:19.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.677 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.677 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257574+0000", 2024-04-26T12:27:19.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034098980000000002 2024-04-26T12:27:19.677 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.677 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.677 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.678 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257731+0000", 2024-04-26T12:27:19.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015735400000000001 2024-04-26T12:27:19.678 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.678 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.678 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266834+0000", 2024-04-26T12:27:19.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091028099999999994 2024-04-26T12:27:19.678 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.678 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.678 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.678 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.679 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:19.679 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:19.679 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.371807152999999, 2024-04-26T12:27:19.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0087469690000000003, 2024-04-26T12:27:19.679 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.679 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:19.679 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:19.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.680 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:19.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.680 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254171+0000", 2024-04-26T12:27:19.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254178+0000", 2024-04-26T12:27:19.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7710000000000001e-06 2024-04-26T12:27:19.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254185+0000", 2024-04-26T12:27:19.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6249999999999998e-06 2024-04-26T12:27:19.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254203+0000", 2024-04-26T12:27:19.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8003999999999999e-05 2024-04-26T12:27:19.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254408+0000", 2024-04-26T12:27:19.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020469100000000001 2024-04-26T12:27:19.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254525+0000", 2024-04-26T12:27:19.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000116319 2024-04-26T12:27:19.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262919+0000", 2024-04-26T12:27:19.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083942440000000004 2024-04-26T12:27:19.683 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.683 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.683 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.683 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:18 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:19.683 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:19.683 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.364597616000001, 2024-04-26T12:27:19.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016521190000000001, 2024-04-26T12:27:19.683 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.683 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.683 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261387+0000", 2024-04-26T12:27:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4880000000000004e-06 2024-04-26T12:27:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261396+0000", 2024-04-26T12:27:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2209999999999997e-06 2024-04-26T12:27:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261414+0000", 2024-04-26T12:27:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8386e-05 2024-04-26T12:27:19.685 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261460+0000", 2024-04-26T12:27:19.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6029999999999998e-05 2024-04-26T12:27:19.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261516+0000", 2024-04-26T12:27:19.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6418000000000001e-05 2024-04-26T12:27:19.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:19.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263008+0000", 2024-04-26T12:27:19.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0014912910000000001 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263033+0000", 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5763e-05 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:28 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.364392919, 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001530869, 2024-04-26T12:27:19.687 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.688 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.688 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.688 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:19.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.688 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:19.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:19.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261597+0000", 2024-04-26T12:27:19.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1344e-05 2024-04-26T12:27:19.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261605+0000", 2024-04-26T12:27:19.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9039999999999992e-06 2024-04-26T12:27:19.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.690 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261612+0000", 2024-04-26T12:27:19.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8580000000000002e-06 2024-04-26T12:27:19.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.690 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261886+0000", 2024-04-26T12:27:19.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027415399999999998 2024-04-26T12:27:19.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261905+0000", 2024-04-26T12:27:19.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8898000000000001e-05 2024-04-26T12:27:19.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:19.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263093+0000", 2024-04-26T12:27:19.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011877490000000001 2024-04-26T12:27:19.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263117+0000", 2024-04-26T12:27:19.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4338999999999999e-05 2024-04-26T12:27:19.691 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.692 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.692 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.692 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:23 3.b e15/13 ondisk, result = 0)", 2024-04-26T12:27:19.692 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262185+0000", 2024-04-26T12:27:19.692 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.363794061, 2024-04-26T12:27:19.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017966600000000001, 2024-04-26T12:27:19.692 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.692 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:19.692 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.693 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262185+0000", 2024-04-26T12:27:19.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.693 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.693 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262185+0000", 2024-04-26T12:27:19.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.693 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.693 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262184+0000", 2024-04-26T12:27:19.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262189+0000", 2024-04-26T12:27:19.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7849999999999999e-06 2024-04-26T12:27:19.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262198+0000", 2024-04-26T12:27:19.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4229999999999994e-06 2024-04-26T12:27:19.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262207+0000", 2024-04-26T12:27:19.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2029999999999992e-06 2024-04-26T12:27:19.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262271+0000", 2024-04-26T12:27:19.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4655999999999999e-05 2024-04-26T12:27:19.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262277+0000", 2024-04-26T12:27:19.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0299999999999999e-06 2024-04-26T12:27:19.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262365+0000", 2024-04-26T12:27:19.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7201999999999996e-05 2024-04-26T12:27:19.696 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.696 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.696 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.696 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing_reply(3.b epoch 15/13 rep_tid 4 lcod 15'2)", 2024-04-26T12:27:19.696 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:19.696 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.363705983999999, 2024-04-26T12:27:19.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020538300000000001, 2024-04-26T12:27:19.696 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.696 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:19.696 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.697 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.697 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:19.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.697 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.697 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.697 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:19.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.697 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.697 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.697 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262272+0000", 2024-04-26T12:27:19.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:19.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262277+0000", 2024-04-26T12:27:19.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9169999999999997e-06 2024-04-26T12:27:19.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262287+0000", 2024-04-26T12:27:19.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0237e-05 2024-04-26T12:27:19.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262297+0000", 2024-04-26T12:27:19.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3219999999999999e-06 2024-04-26T12:27:19.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262382+0000", 2024-04-26T12:27:19.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4969999999999995e-05 2024-04-26T12:27:19.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262478+0000", 2024-04-26T12:27:19.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6704000000000001e-05 2024-04-26T12:27:19.699 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.699 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.699 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e15/13 ondisk, result = 0)", 2024-04-26T12:27:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.363261446999999, 2024-04-26T12:27:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027471, 2024-04-26T12:27:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.701 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.701 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:19.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.701 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.701 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:19.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.701 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.701 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262720+0000", 2024-04-26T12:27:19.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4509999999999999e-06 2024-04-26T12:27:19.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.702 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.702 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262726+0000", 2024-04-26T12:27:19.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8599999999999998e-06 2024-04-26T12:27:19.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.702 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.702 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262732+0000", 2024-04-26T12:27:19.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5889999999999999e-06 2024-04-26T12:27:19.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.702 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262882+0000", 2024-04-26T12:27:19.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014968800000000001 2024-04-26T12:27:19.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262890+0000", 2024-04-26T12:27:19.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9279999999999993e-06 2024-04-26T12:27:19.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262992+0000", 2024-04-26T12:27:19.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010247300000000001 2024-04-26T12:27:19.703 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.703 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.704 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.704 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:19.704 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:19.704 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.361588888, 2024-04-26T12:27:19.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021676200000000001, 2024-04-26T12:27:19.704 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.704 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:19.704 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:19.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:19.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:19.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.706 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264404+0000", 2024-04-26T12:27:19.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3998999999999999e-05 2024-04-26T12:27:19.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.706 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.706 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264411+0000", 2024-04-26T12:27:19.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:27:19.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.706 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.706 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264424+0000", 2024-04-26T12:27:19.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2843999999999999e-05 2024-04-26T12:27:19.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264485+0000", 2024-04-26T12:27:19.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0464000000000002e-05 2024-04-26T12:27:19.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264493+0000", 2024-04-26T12:27:19.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.507e-06 2024-04-26T12:27:19.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264607+0000", 2024-04-26T12:27:19.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000113591 2024-04-26T12:27:19.708 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.708 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.708 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.708 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:21 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:19.708 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:19.708 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.361549160999999, 2024-04-26T12:27:19.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00037041599999999999, 2024-04-26T12:27:19.708 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.708 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:19.708 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:19.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:19.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264429+0000", 2024-04-26T12:27:19.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264432+0000", 2024-04-26T12:27:19.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0770000000000002e-06 2024-04-26T12:27:19.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264435+0000", 2024-04-26T12:27:19.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8340000000000001e-06 2024-04-26T12:27:19.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264438+0000", 2024-04-26T12:27:19.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5280000000000002e-06 2024-04-26T12:27:19.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264703+0000", 2024-04-26T12:27:19.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026548400000000002 2024-04-26T12:27:19.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264709+0000", 2024-04-26T12:27:19.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8390000000000003e-06 2024-04-26T12:27:19.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264800+0000", 2024-04-26T12:27:19.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0931000000000001e-05 2024-04-26T12:27:19.712 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.712 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.712 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.712 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:19.712 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:19.712 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.36074326, 2024-04-26T12:27:19.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016589860000000001, 2024-04-26T12:27:19.712 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.712 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.712 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:19.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:19.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265235+0000", 2024-04-26T12:27:19.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:19.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265252+0000", 2024-04-26T12:27:19.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6307000000000002e-05 2024-04-26T12:27:19.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265257+0000", 2024-04-26T12:27:19.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8279999999999999e-06 2024-04-26T12:27:19.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265263+0000", 2024-04-26T12:27:19.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9399999999999999e-06 2024-04-26T12:27:19.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.715 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265300+0000", 2024-04-26T12:27:19.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6315e-05 2024-04-26T12:27:19.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.715 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265312+0000", 2024-04-26T12:27:19.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2451e-05 2024-04-26T12:27:19.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:19.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266864+0000", 2024-04-26T12:27:19.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015521090000000001 2024-04-26T12:27:19.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266895+0000", 2024-04-26T12:27:19.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0426e-05 2024-04-26T12:27:19.716 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.716 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.716 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.717 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:22 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:19.717 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:19.717 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.36062252, 2024-04-26T12:27:19.717 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021988139999999999, 2024-04-26T12:27:19.717 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.717 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.717 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.717 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.717 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.717 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:19.717 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.717 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.717 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.717 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:19.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.718 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:19.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967296 2024-04-26T12:27:19.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.718 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265361+0000", 2024-04-26T12:27:19.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6979999999999997e-06 2024-04-26T12:27:19.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265366+0000", 2024-04-26T12:27:19.719 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6550000000000003e-06 2024-04-26T12:27:19.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265379+0000", 2024-04-26T12:27:19.719 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.358e-05 2024-04-26T12:27:19.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265535+0000", 2024-04-26T12:27:19.719 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015586800000000001 2024-04-26T12:27:19.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.720 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265556+0000", 2024-04-26T12:27:19.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1202000000000001e-05 2024-04-26T12:27:19.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.720 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:19.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267528+0000", 2024-04-26T12:27:19.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0019722099999999998 2024-04-26T12:27:19.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.720 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267555+0000", 2024-04-26T12:27:19.721 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6775999999999999e-05 2024-04-26T12:27:19.721 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.721 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.721 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.721 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.721 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-26T12:27:19.721 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:19.721 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.715604347999999, 2024-04-26T12:27:19.721 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020315099999999998, 2024-04-26T12:27:19.721 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:19.721 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:19.721 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:19.722 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.722 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:19.722 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:19.722 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.722 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.722 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:19.722 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:19.722 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:19.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.722 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.722 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:19.722 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910372+0000", 2024-04-26T12:27:19.722 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-26T12:27:19.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.723 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.723 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:19.723 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910387+0000", 2024-04-26T12:27:19.723 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5252999999999999e-05 2024-04-26T12:27:19.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.723 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.723 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:19.723 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910418+0000", 2024-04-26T12:27:19.723 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0778999999999998e-05 2024-04-26T12:27:19.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.723 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.723 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:19.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910437+0000", 2024-04-26T12:27:19.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9619999999999998e-05 2024-04-26T12:27:19.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:19.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910587+0000", 2024-04-26T12:27:19.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014922000000000001 2024-04-26T12:27:19.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:19.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910837+0000", 2024-04-26T12:27:19.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025089099999999999 2024-04-26T12:27:19.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:19.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910973+0000", 2024-04-26T12:27:19.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000135124 2024-04-26T12:27:19.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.725 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:19.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.911616+0000", 2024-04-26T12:27:19.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00064392799999999999 2024-04-26T12:27:19.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.725 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:19.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912341+0000", 2024-04-26T12:27:19.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00072415700000000001 2024-04-26T12:27:19.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.726 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.726 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:19.726 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912379+0000", 2024-04-26T12:27:19.726 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8724999999999999e-05 2024-04-26T12:27:19.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:19.726 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:19.726 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:19.726 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912406+0000", 2024-04-26T12:27:19.726 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6752999999999999e-05 2024-04-26T12:27:19.726 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.726 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.726 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.726 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:19.726 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:19.727 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:19.728 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:19.727+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:19.728 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:19.828 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:19.828+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:19.869 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:19.869 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:19.869 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:19.869 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:19.879 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:19.929 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:19.928+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:20.004 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:20.004 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:20.014 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:20.057 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:20.057+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:20.131 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:20.130+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:20.143 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.259302241999997, 2024-04-26T12:27:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:20.143 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:20.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.258662895000001, 2024-04-26T12:27:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:20.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:20.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:20.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.128960704999997, 2024-04-26T12:27:20.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:20.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.128466119000002, 2024-04-26T12:27:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:20.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:20.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:20.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.126463934999997, 2024-04-26T12:27:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:20.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:20.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.126057594999999, 2024-04-26T12:27:20.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:20.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:20.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.125702771, 2024-04-26T12:27:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:20.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:20.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:20.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.023144357, 2024-04-26T12:27:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:20.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:20.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.178 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.022747828999996, 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:20.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:20.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 32.925738221000003, 2024-04-26T12:27:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:20.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:20.187 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 32.925044505000002, 2024-04-26T12:27:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:20.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:20.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.89030545, 2024-04-26T12:27:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:20.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:20.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:20.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.889484531000001, 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:20.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:20.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.889454441000002, 2024-04-26T12:27:20.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:20.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:20.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:20.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:20.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:20.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:20.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:20.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:20.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:20.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:20.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:20.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:20.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:20.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:20.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:20.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.207 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.889400652999999, 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:20.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:20.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:20.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:20.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:20.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:20.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:20.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:20.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:20.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:20.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:20.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:20.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:20.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:20.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:20.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:20.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:20.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:20.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:20.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:20.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:20.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:20.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:20.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:20.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:20.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.889348095999999, 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:20.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:20.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:20.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:20.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:20.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:20.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:20.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:20.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:20.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:20.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:20.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:20.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:20.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:20.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:20.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:20.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:20.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:20.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:20.218 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.218 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.218 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.218 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:20.218 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.889307882000001, 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:20.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:20.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:20.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:20.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:20.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:20.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:20.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:20.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:20.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:20.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:20.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:20.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:20.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:20.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:20.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:20.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:20.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:20.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:20.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:20.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:20.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:20.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:20.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:20.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:20.224 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.224 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.224 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.224 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:20.224 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:20.224 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.889279721000001, 2024-04-26T12:27:20.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:20.224 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.224 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:20.225 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:20.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:20.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:20.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:20.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:20.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:20.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:20.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:20.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:20.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:20.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:20.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:20.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:20.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:20.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:20.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:20.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:20.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:20.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:20.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:20.229 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.229 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.229 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.230 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:20.230 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:20.230 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.889249031999999, 2024-04-26T12:27:20.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:20.230 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.230 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:20.230 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:20.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:20.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:20.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:20.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:20.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:20.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:20.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:20.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:20.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:20.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:20.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:20.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:20.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:20.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:20.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:20.233 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.233 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.233 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.234 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:20.234 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:20.234 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.889222458999999, 2024-04-26T12:27:20.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:20.234 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:20.234 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:20.234 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:20.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:20.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:20.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:20.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:20.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:20.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:20.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:20.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:20.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:20.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:20.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:20.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:20.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:20.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:20.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:20.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:20.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:20.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:20.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:20.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:20.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:20.237 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.237 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.237 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.238 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:20.238 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:20.238 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:20.238 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:27:20.240 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:20.239+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:20.240 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:20.340 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:20.340+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:20.381 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:20.381 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:20.391 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:20.401 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:20.421 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:20.441 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:20.441 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:20.441+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:20.442 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:20.442 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:20.442 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:20.520 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:20.520 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:20.531 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:20.542 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:20.542+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:20.643 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:20.643+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:20.657 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:20.657 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:20.667 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:20.678 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:27:20.744 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:20.744+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:20.807 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:20.807 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:20.817 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:20.845 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:20.845+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:20.946 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:20.945+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:20.983 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:20.993 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:21.047 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:21.046+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:21.120 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:21.120 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:21.130 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:21.148 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:21.148+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:21.249 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:21.248+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:21.267 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:21.268 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:21.278 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:21.350 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:21.350+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:21.443 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:21.443 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:21.451 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:21.450+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:21.453 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:21.552 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:21.551+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:21.604 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2024-04-26T12:27:21.621 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:21.621 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:21.631 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:21.652 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:21.652+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:21.753 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:21.752+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:21.770 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:21.771 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:21.781 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:21.854 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:21.853+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:21.907 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:21.907 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:21.917 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:21.954 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:21.954+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:22.044 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:22.044 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:22.054 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:22.055 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:22.055+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:22.156 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:22.156+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:22.190 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:22.191 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:22.201 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:22.257 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:22.257+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:22.327 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:22.327 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:22.337 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:22.358 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:22.358+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:22.453 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:27:22.459 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:22.458+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:22.504 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:22.504 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:22.514 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:22.560 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:22.560+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:22.618 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:22.638 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:22.656 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:22.658 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:22.659 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:22.659 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:22.659 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:22.661 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:22.661+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:22.666 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:22.736 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:27:22.736 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:27:22.736 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-26T12:27:22.736 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:27:22.736 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:27:22.736 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-26T12:27:22.780 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:22.780+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:22.793 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:22.793 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:22.793 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:22.793 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:22.793 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:22.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:22.863 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:22.863+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:22.871 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:22.871 INFO:teuthology.orchestra.run.smithi115.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T12:27:22.871 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:22.931 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:22.932 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:22.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:22.932 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:22.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.932 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:22.932 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:22.932 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 36.047501209000004, 2024-04-26T12:27:22.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:22.932 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:22.932 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:22.932 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:22.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:22.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:22.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:22.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:22.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:22.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:22.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:22.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:22.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:22.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:22.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:22.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:22.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:22.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:22.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:22.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:22.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:22.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:22.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:22.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:22.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:22.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:22.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:22.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:22.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:22.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:22.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:22.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:22.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.936 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:22.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.937 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:22.937 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:22.937 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 36.046861862, 2024-04-26T12:27:22.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:22.937 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:22.937 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:22.937 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:22.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:22.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:22.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:22.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:22.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:22.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:22.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:22.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:22.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:22.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:22.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:22.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:22.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:22.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:22.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:22.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:22.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:22.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:22.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:22.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:22.941 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.941 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:22.941 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.941 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:22.941 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:22.941 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.917159671999997, 2024-04-26T12:27:22.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:22.942 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:22.942 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:22.942 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:22.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:22.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:22.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:22.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:22.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:22.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:22.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:22.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:22.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:22.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:22.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:22.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:22.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:22.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:22.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:22.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:22.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:22.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:22.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:22.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:22.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:22.946 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.946 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:22.946 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.946 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:22.946 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:22.946 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.916665086000002, 2024-04-26T12:27:22.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:22.946 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:22.946 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:22.947 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:22.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:22.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:22.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:22.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:22.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:22.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:22.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:22.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:22.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:22.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:22.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:22.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:22.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:22.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:22.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:22.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:22.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:22.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:22.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:22.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:22.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:22.950 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.950 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:22.951 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.951 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:22.951 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:22.951 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.914662902000003, 2024-04-26T12:27:22.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:22.951 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:22.951 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:22.951 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:22.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:22.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:22.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:22.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:22.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:22.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:22.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:22.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:22.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:22.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:22.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:22.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:22.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:22.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:22.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:22.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:22.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:22.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:22.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:22.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:22.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:22.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:22.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:22.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:22.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:22.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:22.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:22.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:22.955 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.955 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:22.956 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.956 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:22.956 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:22.956 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.914256561999998, 2024-04-26T12:27:22.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:22.956 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:22.957 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:22.957 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:22.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:22.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:22.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:22.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:22.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:22.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:22.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:22.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:22.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:22.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:22.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:22.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:22.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:22.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:22.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:22.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:22.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:22.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:22.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:22.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:22.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:22.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:22.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:22.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:22.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:22.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:22.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:22.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:22.961 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.961 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:22.961 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.961 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:22.961 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:22.961 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.913901738, 2024-04-26T12:27:22.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:22.961 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:22.961 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:22.961 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:22.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:22.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:22.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:22.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:22.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:22.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:22.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:22.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:22.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:22.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:22.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:22.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:22.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:22.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:22.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:22.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:22.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:22.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:22.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:22.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:22.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:22.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:22.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:22.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:22.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:22.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:22.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:22.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:22.965 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.965 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:22.965 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.966 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:22.966 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:22.966 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.811343323999999, 2024-04-26T12:27:22.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:22.966 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:22.966 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:22.966 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:22.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:22.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:22.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:22.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:22.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:22.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:22.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:22.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:22.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:22.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:22.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:22.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:22.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:22.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:22.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:22.970 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.970 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:22.970 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.970 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:22.970 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:22.970 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.810946796000003, 2024-04-26T12:27:22.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:22.971 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:22.971 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:22.971 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:22.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:22.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:22.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:22.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:22.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:22.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:22.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:22.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:22.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:22.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:22.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:22.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:22.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:22.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:22.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:22.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:22.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:22.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:22.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:22.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:22.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:22.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:22.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:22.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:22.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:22.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:22.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:22.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:22.975 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.975 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:22.975 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.975 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:22.975 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:22.975 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.713937188000003, 2024-04-26T12:27:22.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:22.975 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:22.975 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:22.976 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:22.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:22.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:22.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:22.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:22.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:22.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:22.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:22.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:22.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:22.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:22.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:22.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:22.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:22.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:22.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:22.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:22.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:22.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:22.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:22.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:22.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:22.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:22.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:22.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:22.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:22.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:22.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:22.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:22.979 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.979 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:22.980 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.980 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:22.980 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:22.980 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.713243472000002, 2024-04-26T12:27:22.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:22.980 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:22.980 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:22.980 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:22.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:22.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:22.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:22.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:22.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:22.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:22.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:22.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:22.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:22.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:22.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:22.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:22.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:22.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:22.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:22.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:22.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:22.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:22.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:22.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:22.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:22.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:22.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:22.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:22.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:22.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:22.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:22.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:22.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.984 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:22.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.984 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:22.985 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:22.985 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.678504416999999, 2024-04-26T12:27:22.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:22.985 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:22.985 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:22.985 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:22.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:22.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:22.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:22.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:22.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:22.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:22.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:22.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:22.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:22.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:22.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:22.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:22.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:22.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:22.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:22.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:22.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:22.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:22.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:22.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:22.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:22.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:22.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:22.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:22.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:22.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:22.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:22.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:22.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:22.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:22.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:22.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:22.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:22.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:22.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:22.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:22.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:22.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.990 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:22.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.990 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:22.990 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:22.990 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.677683498, 2024-04-26T12:27:22.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:22.990 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:22.990 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:22.990 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:22.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:22.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:22.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:22.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:22.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:22.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:22.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:22.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:22.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:22.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:22.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:22.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:22.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:22.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:22.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:22.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:22.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:22.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:22.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:22.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:22.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:22.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:22.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:22.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:22.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:22.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:22.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:22.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:22.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:22.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:22.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:22.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:22.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:22.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:22.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:22.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:22.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:22.995 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.995 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:22.996 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:22.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.996 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:22.996 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:22.996 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.677653408000001, 2024-04-26T12:27:22.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:22.996 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:22.996 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:22.996 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:22.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:22.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:22.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:22.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:22.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:22.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:22.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:22.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:22.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:22.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:22.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:22.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:22.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:22.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:22.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:22.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:22.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:22.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:22.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:22.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:22.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:22.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:22.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:22.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:22.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:22.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:22.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:22.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:22.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:23.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:23.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:23.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:23.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:23.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:23.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:23.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:23.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:23.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:23.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:23.001 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.001 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:23.001 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.001 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.001 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:23.001 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.677599619999999, 2024-04-26T12:27:23.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:23.002 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:23.002 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.002 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:23.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:23.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:23.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:23.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:23.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:23.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:23.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:23.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:23.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:23.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:23.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:23.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:23.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:23.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:23.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:23.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:23.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:23.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:23.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:23.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:23.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:23.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:23.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:23.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:23.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:23.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:23.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:23.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:23.006 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.677547062999999, 2024-04-26T12:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:23.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:23.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:23.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:23.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:23.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:23.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:23.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:23.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:23.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:23.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:23.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:23.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:23.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:23.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:23.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:23.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:23.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:23.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:23.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:23.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:23.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:23.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:23.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:23.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:23.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:23.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:23.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:23.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:23.012 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.012 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:23.012 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.012 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.012 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:23.013 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.677506849, 2024-04-26T12:27:23.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:23.013 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:23.013 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.013 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:23.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:23.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:23.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:23.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:23.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:23.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:23.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:23.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:23.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:23.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:23.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:23.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:23.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:23.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:23.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:23.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:23.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:23.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:23.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:23.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:23.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:23.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:23.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:23.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:23.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:23.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:23.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:23.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:23.018 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.018 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:23.018 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.018 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.018 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:23.018 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.677478688000001, 2024-04-26T12:27:23.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:23.019 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:23.019 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.019 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:23.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:23.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:23.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:23.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:23.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:23.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:23.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:23.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:23.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:23.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:23.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:23.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:23.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:23.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:23.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:23.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:23.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:23.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:23.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:23.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:23.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:23.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:23.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:23.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:23.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:23.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:23.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:23.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:23.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:23.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:23.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:23.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:23.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:23.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:23.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:23.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:23.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:23.024 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.024 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:23.024 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.024 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.024 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:23.024 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.677447999000002, 2024-04-26T12:27:23.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:23.024 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:23.024 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:23.025 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:23.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:23.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:23.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:23.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:23.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:23.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:23.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:23.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:23.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:23.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:23.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:23.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:23.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:23.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:23.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:23.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:23.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:23.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:23.028 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.028 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:23.028 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.028 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.028 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:23.028 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.677421425999999, 2024-04-26T12:27:23.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:23.029 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:23.029 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:23.029 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:23.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:23.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:23.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:23.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:23.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:23.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:23.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:23.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:23.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:23.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:23.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:23.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:23.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:23.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:23.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:23.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:23.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:23.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:23.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:23.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:23.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:23.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:23.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:23.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:23.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:23.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:23.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:23.033 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.033 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:23.033 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.033 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:23.033 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:23.033 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:23.034 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:23.034+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:23.035 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:23.135 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:23.134+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:23.162 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:23.162 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:23.162 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:23.162 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:23.172 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:23.235 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:23.235+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:23.298 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:23.298 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:23.298 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:23.298 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:23.298 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:23.307 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:23.351 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:23.351+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:23.436 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:23.436 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:23.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:23.436 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:23.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.436 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:23.436 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:23.437 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 36.103090823999999, 2024-04-26T12:27:23.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:23.437 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.437 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.437 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:23.437 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:23.437 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:23.437 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:23.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.437 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:23.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:23.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:23.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:23.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:23.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:23.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:23.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:23.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:23.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:23.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:23.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:23.442 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.442 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.442 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.442 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.442 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:23.442 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.184225001000001, 2024-04-26T12:27:23.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.184188789, 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.184149815000001, 2024-04-26T12:27:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.184126647999999, 2024-04-26T12:27:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.184111270999999, 2024-04-26T12:27:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.184083081000001, 2024-04-26T12:27:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.184065083, 2024-04-26T12:27:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.184040492000001, 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.184015543000001, 2024-04-26T12:27:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.183994619, 2024-04-26T12:27:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.183959770000001, 2024-04-26T12:27:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.183925819999999, 2024-04-26T12:27:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.183905523, 2024-04-26T12:27:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.183870402, 2024-04-26T12:27:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.183835162000001, 2024-04-26T12:27:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.183693414, 2024-04-26T12:27:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.183669394999999, 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:23.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:23.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:23.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:23.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:23.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:23.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:23.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.183645426999998, 2024-04-26T12:27:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:27:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:23.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:27:23.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:27:23.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:27:23.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:27:23.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:27:23.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:27:23.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:27:23.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:27:23.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:27:23.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:23.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:27:23.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:27:23.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:27:23.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:27:23.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:27:23.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:27:23.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:27:23.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:27:23.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:23.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:27:23.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:27:23.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.556 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.183612046, 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:23.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:23.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:23.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:23.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:23.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:23.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:27:23.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:27:23.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:23.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:27:23.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:27:23.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:23.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:27:23.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:27:23.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:23.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:27:23.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:27:23.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:23.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:23.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:23.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:27:23.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:27:23.561 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.561 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.561 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.561 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:23.561 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:23.561 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:23.563 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:23.562+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:23.563 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:23.618 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:27:23.663 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:23.662+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:23.702 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:23.702 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:23.702 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T12:27:23.702 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:23.713 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:23.764 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:23.764+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:23.839 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:23.839 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:23.839 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T12:27:23.839 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T12:27:23.839 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:23.849 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:23.865 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:23.865+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:23.966 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:23.965+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:23.976 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:23.976 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T12:27:23.976 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T12:27:23.976 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T12:27:23.976 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.976 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 3 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:27:23.976 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:23.976 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.721014654000001, 2024-04-26T12:27:23.976 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0048986250000000002, 2024-04-26T12:27:23.976 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:23.976 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:23.977 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:23.977 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.977 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:23.977 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:23.977 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:23.977 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.977 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.977 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:23.977 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:23.977 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:23.977 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.977 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.977 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:23.978 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:23.978 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.978 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.978 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.978 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:23.978 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253094+0000", 2024-04-26T12:27:23.978 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0924000000000001e-05 2024-04-26T12:27:23.978 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.978 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.978 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:23.978 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253109+0000", 2024-04-26T12:27:23.978 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4982e-05 2024-04-26T12:27:23.978 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.978 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253127+0000", 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8586000000000001e-05 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253214+0000", 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6234000000000001e-05 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257982+0000", 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0047682150000000001 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:23.979 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.720571495000002, 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010912543, 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:23.980 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.981 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.981 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:23.981 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:23.981 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:23.981 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.981 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.981 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:23.981 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253521+0000", 2024-04-26T12:27:23.981 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999943 2024-04-26T12:27:23.981 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.981 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.981 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:23.981 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253542+0000", 2024-04-26T12:27:23.981 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1061999999999999e-05 2024-04-26T12:27:23.982 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.982 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.982 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:23.982 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253606+0000", 2024-04-26T12:27:23.982 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4012999999999999e-05 2024-04-26T12:27:23.982 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.982 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.982 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.982 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253619+0000", 2024-04-26T12:27:23.982 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3091999999999999e-05 2024-04-26T12:27:23.982 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.982 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.982 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:23.982 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013321599999999999 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253923+0000", 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017127900000000001 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254085+0000", 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000161566 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:23.983 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257500+0000", 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034156880000000001 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264372+0000", 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068719760000000001 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264402+0000", 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9128e-05 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:23.984 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264439+0000", 2024-04-26T12:27:23.985 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7251e-05 2024-04-26T12:27:23.985 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:23.985 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:23.985 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:23.985 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.985 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.985 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.985 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:23.985 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.720462392999998, 2024-04-26T12:27:23.985 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010957691, 2024-04-26T12:27:23.985 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:23.985 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.985 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:23.985 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.986 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:23.986 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:23.986 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:23.986 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.986 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.986 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:23.986 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:23.986 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:23.986 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.986 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.986 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:23.986 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:23.986 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.986 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.987 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.987 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:23.987 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253639+0000", 2024-04-26T12:27:23.987 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:27:23.987 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.987 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.987 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:23.987 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253648+0000", 2024-04-26T12:27:23.987 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:27:23.987 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.987 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.987 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.987 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253655+0000", 2024-04-26T12:27:23.987 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8909999999999998e-06 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254807+0000", 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001151712 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255417+0000", 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00061023000000000002 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255573+0000", 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015571399999999999 2024-04-26T12:27:23.988 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.989 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.989 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:23.989 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260113+0000", 2024-04-26T12:27:23.989 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045405519999999998 2024-04-26T12:27:23.989 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.989 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.989 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.989 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264499+0000", 2024-04-26T12:27:23.989 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043857050000000002 2024-04-26T12:27:23.989 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.989 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.989 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:23.989 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264552+0000", 2024-04-26T12:27:23.990 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2602000000000002e-05 2024-04-26T12:27:23.990 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.990 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.990 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:23.990 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264593+0000", 2024-04-26T12:27:23.990 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1341000000000003e-05 2024-04-26T12:27:23.990 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:23.990 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:23.990 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:23.990 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.990 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.990 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.990 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:23.990 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.720436986999999, 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091815760000000003, 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.991 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253660+0000", 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253664+0000", 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253679+0000", 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4208e-05 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.992 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253685+0000", 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254897+0000", 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001211801 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255009+0000", 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011189 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.993 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.994 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.994 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255142+0000", 2024-04-26T12:27:23.994 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013265799999999999 2024-04-26T12:27:23.994 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.994 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.994 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:23.994 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.259665+0000", 2024-04-26T12:27:23.994 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004523862 2024-04-26T12:27:23.994 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.994 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.994 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:23.994 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262759+0000", 2024-04-26T12:27:23.994 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003093391 2024-04-26T12:27:23.994 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.995 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.995 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:23.995 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262805+0000", 2024-04-26T12:27:23.995 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6399000000000001e-05 2024-04-26T12:27:23.995 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.995 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.995 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:23.995 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262842+0000", 2024-04-26T12:27:23.995 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7184000000000002e-05 2024-04-26T12:27:23.995 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:23.995 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:23.995 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:23.995 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.995 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.720407077000001, 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092939230000000008, 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:23.996 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253690+0000", 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253695+0000", 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6090000000000003e-06 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253705+0000", 2024-04-26T12:27:23.997 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0326000000000001e-05 2024-04-26T12:27:23.998 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.998 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.998 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:23.998 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253714+0000", 2024-04-26T12:27:23.998 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:27:23.998 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.998 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.998 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:23.998 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256115+0000", 2024-04-26T12:27:23.998 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024015450000000002 2024-04-26T12:27:23.998 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.998 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.998 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:23.998 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256215+0000", 2024-04-26T12:27:23.999 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010016700000000001 2024-04-26T12:27:23.999 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.999 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.999 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:23.999 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256368+0000", 2024-04-26T12:27:23.999 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015244999999999999 2024-04-26T12:27:23.999 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.999 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.999 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:23.999 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260313+0000", 2024-04-26T12:27:23.999 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00394481 2024-04-26T12:27:23.999 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:23.999 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:23.999 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:24.000 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262895+0000", 2024-04-26T12:27:24.000 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0025824670000000002 2024-04-26T12:27:24.000 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.000 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.000 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:24.000 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262946+0000", 2024-04-26T12:27:24.000 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1072999999999997e-05 2024-04-26T12:27:24.000 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.000 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.000 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.000 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262985+0000", 2024-04-26T12:27:24.000 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8529000000000003e-05 2024-04-26T12:27:24.000 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.000 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.001 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.001 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.001 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.001 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:24.001 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:24.001 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.720377716000002, 2024-04-26T12:27:24.001 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011070178999999999, 2024-04-26T12:27:24.001 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.001 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.001 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.001 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.001 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.001 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:24.001 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.002 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.002 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.002 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.002 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:24.002 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.002 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.002 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.002 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.002 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:24.002 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.002 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.002 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.002 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253724+0000", 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0890000000000002e-06 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253736+0000", 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2252999999999999e-05 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253742+0000", 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9499999999999998e-06 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.003 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.004 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256230+0000", 2024-04-26T12:27:24.004 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002488114 2024-04-26T12:27:24.004 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.004 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.004 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:24.004 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256421+0000", 2024-04-26T12:27:24.004 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019087999999999999 2024-04-26T12:27:24.004 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.004 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.004 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:24.004 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256583+0000", 2024-04-26T12:27:24.004 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000162566 2024-04-26T12:27:24.004 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.004 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.005 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:24.005 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260316+0000", 2024-04-26T12:27:24.005 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037329239999999999 2024-04-26T12:27:24.005 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.005 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.005 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:24.005 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264713+0000", 2024-04-26T12:27:24.005 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043968380000000001 2024-04-26T12:27:24.005 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.005 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.005 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:24.005 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:24.005 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1124000000000001e-05 2024-04-26T12:27:24.005 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.006 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.006 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.006 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264790+0000", 2024-04-26T12:27:24.006 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5923999999999997e-05 2024-04-26T12:27:24.006 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.006 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.006 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.006 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.006 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.006 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:24.006 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:24.006 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.720345900000002, 2024-04-26T12:27:24.006 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0086059009999999991, 2024-04-26T12:27:24.006 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.007 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.007 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.007 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.007 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.007 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:24.007 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.007 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.007 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.007 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.007 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:24.007 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.007 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.007 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.008 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.008 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253751+0000", 2024-04-26T12:27:24.008 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.008 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.008 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.008 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.008 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253756+0000", 2024-04-26T12:27:24.008 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9740000000000001e-06 2024-04-26T12:27:24.008 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.008 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.008 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.008 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253762+0000", 2024-04-26T12:27:24.008 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9769999999999997e-06 2024-04-26T12:27:24.008 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.009 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.009 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.009 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253767+0000", 2024-04-26T12:27:24.009 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:27:24.009 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.009 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.009 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.009 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254160+0000", 2024-04-26T12:27:24.009 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039256700000000002 2024-04-26T12:27:24.009 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.009 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.009 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:24.009 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254292+0000", 2024-04-26T12:27:24.009 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013190399999999999 2024-04-26T12:27:24.010 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.010 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.010 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:24.010 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254453+0000", 2024-04-26T12:27:24.010 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000160982 2024-04-26T12:27:24.010 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.010 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.010 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:24.010 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257354+0000", 2024-04-26T12:27:24.010 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029008229999999999 2024-04-26T12:27:24.010 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.010 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.010 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:24.010 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262281+0000", 2024-04-26T12:27:24.011 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049274760000000001 2024-04-26T12:27:24.011 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.011 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.011 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:24.011 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262323+0000", 2024-04-26T12:27:24.011 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.189e-05 2024-04-26T12:27:24.011 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.011 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.011 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.011 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262358+0000", 2024-04-26T12:27:24.011 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4826000000000002e-05 2024-04-26T12:27:24.011 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.011 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.011 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.012 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.012 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.012 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:32 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:24.012 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:24.012 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.719989848000001, 2024-04-26T12:27:24.012 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083641310000000003, 2024-04-26T12:27:24.012 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.012 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:24.012 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.012 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.012 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.012 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:24.012 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.012 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.013 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.013 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.013 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:24.013 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.013 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.013 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.013 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.013 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254107+0000", 2024-04-26T12:27:24.013 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:24.013 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.013 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.013 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.013 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254113+0000", 2024-04-26T12:27:24.014 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:27:24.014 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.014 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.014 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.014 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254122+0000", 2024-04-26T12:27:24.014 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.149e-06 2024-04-26T12:27:24.014 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.014 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.014 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.014 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254131+0000", 2024-04-26T12:27:24.014 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5609999999999999e-06 2024-04-26T12:27:24.014 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.014 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.015 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.015 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255227+0000", 2024-04-26T12:27:24.015 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010961 2024-04-26T12:27:24.015 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.015 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.015 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:24.015 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255355+0000", 2024-04-26T12:27:24.015 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012883299999999999 2024-04-26T12:27:24.015 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.015 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.015 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.015 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262472+0000", 2024-04-26T12:27:24.015 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071165949999999999 2024-04-26T12:27:24.015 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.016 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.016 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.016 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.016 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.016 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:33 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:24.016 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:24.016 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.719961724000001, 2024-04-26T12:27:24.016 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012698262, 2024-04-26T12:27:24.016 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.016 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:24.016 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.016 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.016 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.016 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:24.017 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.017 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.017 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.017 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.017 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:24.017 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.017 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.017 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.017 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.017 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:24.017 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.017 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.017 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.017 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.018 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254138+0000", 2024-04-26T12:27:24.018 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2460000000000002e-06 2024-04-26T12:27:24.018 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.018 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.018 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.018 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254145+0000", 2024-04-26T12:27:24.018 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7070000000000003e-06 2024-04-26T12:27:24.018 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.018 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.018 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.018 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254164+0000", 2024-04-26T12:27:24.018 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9604999999999999e-05 2024-04-26T12:27:24.018 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.018 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.019 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.019 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257574+0000", 2024-04-26T12:27:24.019 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034098980000000002 2024-04-26T12:27:24.019 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.019 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.019 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:24.019 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257731+0000", 2024-04-26T12:27:24.019 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015735400000000001 2024-04-26T12:27:24.019 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.019 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.019 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.019 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266834+0000", 2024-04-26T12:27:24.019 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091028099999999994 2024-04-26T12:27:24.019 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.020 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.020 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.020 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.020 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.020 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:24.020 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:24.020 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.719925985, 2024-04-26T12:27:24.020 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0087469690000000003, 2024-04-26T12:27:24.020 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.020 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:24.020 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.020 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.020 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.020 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254171+0000", 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.021 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254178+0000", 2024-04-26T12:27:24.022 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7710000000000001e-06 2024-04-26T12:27:24.022 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.022 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.022 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.022 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254185+0000", 2024-04-26T12:27:24.022 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6249999999999998e-06 2024-04-26T12:27:24.022 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.022 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.022 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.022 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254203+0000", 2024-04-26T12:27:24.022 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8003999999999999e-05 2024-04-26T12:27:24.022 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.022 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.022 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.023 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254408+0000", 2024-04-26T12:27:24.023 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020469100000000001 2024-04-26T12:27:24.023 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.023 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.023 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:24.023 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254525+0000", 2024-04-26T12:27:24.023 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000116319 2024-04-26T12:27:24.023 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.023 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.023 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.023 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262919+0000", 2024-04-26T12:27:24.023 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083942440000000004 2024-04-26T12:27:24.023 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.023 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.024 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.024 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.024 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.024 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:18 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:24.024 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:24.024 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.712716447999998, 2024-04-26T12:27:24.024 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016521190000000001, 2024-04-26T12:27:24.024 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.024 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.024 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.024 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.024 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.024 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:24.024 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.025 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.025 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.025 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.025 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:24.025 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.025 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.025 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.025 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.025 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:24.025 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.025 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.025 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.025 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.025 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261387+0000", 2024-04-26T12:27:24.026 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4880000000000004e-06 2024-04-26T12:27:24.026 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.026 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.026 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.026 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261396+0000", 2024-04-26T12:27:24.026 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2209999999999997e-06 2024-04-26T12:27:24.026 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.026 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.026 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.026 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261414+0000", 2024-04-26T12:27:24.026 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8386e-05 2024-04-26T12:27:24.026 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.026 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.026 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261460+0000", 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6029999999999998e-05 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261516+0000", 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6418000000000001e-05 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263008+0000", 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0014912910000000001 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.027 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263033+0000", 2024-04-26T12:27:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5763e-05 2024-04-26T12:27:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:28 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.712511751000001, 2024-04-26T12:27:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001530869, 2024-04-26T12:27:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.029 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.030 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.030 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.030 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261597+0000", 2024-04-26T12:27:24.030 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1344e-05 2024-04-26T12:27:24.030 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.030 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.030 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.030 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261605+0000", 2024-04-26T12:27:24.030 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9039999999999992e-06 2024-04-26T12:27:24.030 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.030 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.030 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.030 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261612+0000", 2024-04-26T12:27:24.031 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8580000000000002e-06 2024-04-26T12:27:24.031 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.031 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.031 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.031 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261886+0000", 2024-04-26T12:27:24.031 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027415399999999998 2024-04-26T12:27:24.031 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.031 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.031 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:24.031 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261905+0000", 2024-04-26T12:27:24.031 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8898000000000001e-05 2024-04-26T12:27:24.031 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.031 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.031 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263093+0000", 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011877490000000001 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263117+0000", 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4338999999999999e-05 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing_reply(3.b epoch 15/13 rep_tid 4 lcod 15'2)", 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:24.032 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.711824816, 2024-04-26T12:27:24.033 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020538300000000001, 2024-04-26T12:27:24.033 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.033 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:24.033 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.033 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.033 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.033 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:24.033 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.033 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.033 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.033 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.033 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:24.033 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.033 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262272+0000", 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262277+0000", 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9169999999999997e-06 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262287+0000", 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0237e-05 2024-04-26T12:27:24.034 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.035 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.035 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.035 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262297+0000", 2024-04-26T12:27:24.035 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3219999999999999e-06 2024-04-26T12:27:24.035 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.035 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.035 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.035 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262382+0000", 2024-04-26T12:27:24.035 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4969999999999995e-05 2024-04-26T12:27:24.035 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.035 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.035 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.035 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262478+0000", 2024-04-26T12:27:24.035 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6704000000000001e-05 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e15/13 ondisk, result = 0)", 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.711380279, 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027471, 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.036 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:24.037 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.037 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.037 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.037 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.037 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:24.037 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.037 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.037 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.037 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.037 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:24.037 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.037 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.037 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262720+0000", 2024-04-26T12:27:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4509999999999999e-06 2024-04-26T12:27:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262726+0000", 2024-04-26T12:27:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8599999999999998e-06 2024-04-26T12:27:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262732+0000", 2024-04-26T12:27:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5889999999999999e-06 2024-04-26T12:27:24.038 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262882+0000", 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014968800000000001 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262890+0000", 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9279999999999993e-06 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262992+0000", 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010247300000000001 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.039 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.040 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.040 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.040 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.040 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:24.040 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:24.040 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.709707720000001, 2024-04-26T12:27:24.040 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021676200000000001, 2024-04-26T12:27:24.040 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.040 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:24.040 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.040 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.040 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.040 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.041 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264404+0000", 2024-04-26T12:27:24.042 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3998999999999999e-05 2024-04-26T12:27:24.042 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.042 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.042 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.042 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264411+0000", 2024-04-26T12:27:24.042 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:27:24.042 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.042 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.042 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.042 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264424+0000", 2024-04-26T12:27:24.042 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2843999999999999e-05 2024-04-26T12:27:24.042 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.042 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.042 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.043 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264485+0000", 2024-04-26T12:27:24.043 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0464000000000002e-05 2024-04-26T12:27:24.043 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.043 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.043 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:24.043 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264493+0000", 2024-04-26T12:27:24.043 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.507e-06 2024-04-26T12:27:24.043 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.043 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.043 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.043 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264607+0000", 2024-04-26T12:27:24.043 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000113591 2024-04-26T12:27:24.043 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.043 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:21 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.709667993, 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00037041599999999999, 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.044 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264429+0000", 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264432+0000", 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0770000000000002e-06 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.045 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.046 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.046 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264435+0000", 2024-04-26T12:27:24.046 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8340000000000001e-06 2024-04-26T12:27:24.046 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.046 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.046 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.046 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264438+0000", 2024-04-26T12:27:24.046 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5280000000000002e-06 2024-04-26T12:27:24.046 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.046 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.046 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.046 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264703+0000", 2024-04-26T12:27:24.046 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026548400000000002 2024-04-26T12:27:24.047 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.047 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.047 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:24.047 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264709+0000", 2024-04-26T12:27:24.047 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8390000000000003e-06 2024-04-26T12:27:24.047 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.047 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.047 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.047 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264800+0000", 2024-04-26T12:27:24.047 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0931000000000001e-05 2024-04-26T12:27:24.047 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.047 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.047 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.708862092, 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016589860000000001, 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.048 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265235+0000", 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265252+0000", 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6307000000000002e-05 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.049 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.050 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265257+0000", 2024-04-26T12:27:24.050 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8279999999999999e-06 2024-04-26T12:27:24.050 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.050 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.050 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.050 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265263+0000", 2024-04-26T12:27:24.050 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9399999999999999e-06 2024-04-26T12:27:24.050 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.050 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.050 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.050 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265300+0000", 2024-04-26T12:27:24.050 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6315e-05 2024-04-26T12:27:24.050 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.051 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.051 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:24.051 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265312+0000", 2024-04-26T12:27:24.051 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2451e-05 2024-04-26T12:27:24.051 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.051 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.051 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:24.051 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266864+0000", 2024-04-26T12:27:24.051 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015521090000000001 2024-04-26T12:27:24.051 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.051 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.051 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.051 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266895+0000", 2024-04-26T12:27:24.052 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0426e-05 2024-04-26T12:27:24.052 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.052 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.052 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.052 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.052 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.052 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:22 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:24.052 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:24.052 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.708741352000001, 2024-04-26T12:27:24.052 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021988139999999999, 2024-04-26T12:27:24.052 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.052 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.052 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.052 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.053 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.053 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:24.053 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.053 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.053 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.053 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.053 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:24.053 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.053 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.053 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.053 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.053 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:24.053 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967296 2024-04-26T12:27:24.053 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.054 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.054 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.054 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265361+0000", 2024-04-26T12:27:24.054 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6979999999999997e-06 2024-04-26T12:27:24.054 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.054 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.054 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.054 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265366+0000", 2024-04-26T12:27:24.054 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6550000000000003e-06 2024-04-26T12:27:24.054 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.054 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.054 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.054 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265379+0000", 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.358e-05 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265535+0000", 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015586800000000001 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265556+0000", 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1202000000000001e-05 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:24.055 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267528+0000", 2024-04-26T12:27:24.056 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0019722099999999998 2024-04-26T12:27:24.056 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.056 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.056 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.056 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267555+0000", 2024-04-26T12:27:24.056 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6775999999999999e-05 2024-04-26T12:27:24.056 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.056 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.056 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.056 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.056 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.056 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-26T12:27:24.056 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:24.056 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.06372318, 2024-04-26T12:27:24.057 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020315099999999998, 2024-04-26T12:27:24.057 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.057 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.057 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.057 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.057 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.057 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:24.057 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.057 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.057 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.057 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.057 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:24.057 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.057 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.058 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.058 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.058 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910372+0000", 2024-04-26T12:27:24.058 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-26T12:27:24.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.058 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.058 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.058 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910387+0000", 2024-04-26T12:27:24.058 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5252999999999999e-05 2024-04-26T12:27:24.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.058 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.058 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.058 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910418+0000", 2024-04-26T12:27:24.058 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0778999999999998e-05 2024-04-26T12:27:24.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.059 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.059 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.059 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910437+0000", 2024-04-26T12:27:24.059 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9619999999999998e-05 2024-04-26T12:27:24.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.059 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.059 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.059 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910587+0000", 2024-04-26T12:27:24.059 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014922000000000001 2024-04-26T12:27:24.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.059 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.059 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:24.059 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910837+0000", 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025089099999999999 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910973+0000", 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000135124 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.911616+0000", 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00064392799999999999 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:24.060 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912341+0000", 2024-04-26T12:27:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00072415700000000001 2024-04-26T12:27:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912379+0000", 2024-04-26T12:27:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8724999999999999e-05 2024-04-26T12:27:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912406+0000", 2024-04-26T12:27:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6752999999999999e-05 2024-04-26T12:27:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.061 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.062 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.062 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-26T12:27:24.062 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:24.062 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.0630549680000001, 2024-04-26T12:27:24.062 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0013630599999999999, 2024-04-26T12:27:24.062 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:24.062 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.062 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:24.062 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.062 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:24.062 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:24.062 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911041+0000", 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999976 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911057+0000", 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6549999999999999e-05 2024-04-26T12:27:24.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911088+0000", 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0753000000000002e-05 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911107+0000", 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9425000000000001e-05 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911258+0000", 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000150252 2024-04-26T12:27:24.064 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.065 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.065 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:24.065 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911379+0000", 2024-04-26T12:27:24.065 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012129900000000001 2024-04-26T12:27:24.065 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.065 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.065 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:24.065 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911529+0000", 2024-04-26T12:27:24.065 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015010699999999999 2024-04-26T12:27:24.065 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.065 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.065 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:24.065 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912214+0000", 2024-04-26T12:27:24.065 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00068528199999999995 2024-04-26T12:27:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912343+0000", 2024-04-26T12:27:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012858800000000001 2024-04-26T12:27:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912378+0000", 2024-04-26T12:27:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5420000000000003e-05 2024-04-26T12:27:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:24.066 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912406+0000", 2024-04-26T12:27:24.067 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7594e-05 2024-04-26T12:27:24.067 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.067 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.067 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.067 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:24.067 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:24.067 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:24.069 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:24.069 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:24.068+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:24.169 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:24.168+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:24.209 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:24.209 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:24.209 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:24.209 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:24.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:24.269 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:24.269+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:24.346 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:24.346 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:24.346 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:24.346 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:24.346 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:24.356 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:24.370 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:24.370+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:24.471 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:24.471+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:24.523 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 37.640076649999997, 2024-04-26T12:27:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.524 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:24.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.528 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 37.639437303000001, 2024-04-26T12:27:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:24.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:24.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:24.533 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 37.509735112999998, 2024-04-26T12:27:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:24.537 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 37.509240527000003, 2024-04-26T12:27:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:24.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:24.542 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 37.507238342999997, 2024-04-26T12:27:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:24.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:24.546 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 37.506832003, 2024-04-26T12:27:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:24.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 37.506477179000001, 2024-04-26T12:27:24.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:24.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.555 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 37.403918765, 2024-04-26T12:27:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:24.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:24.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 37.403522236999997, 2024-04-26T12:27:24.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:24.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.564 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 37.306512628999997, 2024-04-26T12:27:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:24.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:24.569 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 37.305818913000003, 2024-04-26T12:27:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:24.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:24.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.271079858, 2024-04-26T12:27:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:24.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:24.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.270258939000001, 2024-04-26T12:27:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:24.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:24.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:24.585 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.270228848999999, 2024-04-26T12:27:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:24.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:24.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:24.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.270175061, 2024-04-26T12:27:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:24.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:24.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:24.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:24.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:24.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:24.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:24.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:24.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:24.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:24.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:24.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:24.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:24.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:24.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.596 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.597 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.597 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:24.597 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:24.597 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.270122504, 2024-04-26T12:27:24.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:24.597 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.597 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.597 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:24.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:24.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:24.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:24.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:24.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:24.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.270082290000001, 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:24.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:24.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.270054128999998, 2024-04-26T12:27:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:24.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:24.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.270023439999999, 2024-04-26T12:27:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:24.617 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.269996867, 2024-04-26T12:27:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:24.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:24.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:24.622 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.622 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.622 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.622 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:24.622 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:24.622 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:24.624 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2024-04-26T12:27:24.624 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:24.623+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:24.625 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:24.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:27:24.724 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:24.724+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:24.764 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:24.764 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:24.775 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:24.821 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:24.825 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:24.825+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:24.841 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:24.860 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:24.862 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:24.862 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:24.862 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:24.902 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:24.903 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:24.912 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:24.953 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:24.953+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:25.027 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:25.027+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:25.079 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:25.080 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:25.089 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:25.128 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:25.128+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:25.229 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:25.229+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:25.229 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:25.230 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:25.239 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:25.330 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:25.330+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:25.366 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:25.367 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:25.377 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:25.431 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:25.431+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:25.532 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:25.531+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:25.543 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:25.543 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:25.553 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:25.633 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:25.632+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:25.687 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:25.687 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:25.698 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:25.741 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:25.741+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:25.824 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:25.824 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:25.834 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:25.875 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:25.874+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:25.936 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:25.936+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:25.999 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:25.999 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:26.009 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:26.037 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:26.036+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:26.137 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:26.137+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:26.149 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:26.149 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:26.159 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:26.243 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:26.243+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:26.326 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:26.326 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:26.336 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:26.340 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:26.339+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:26.441 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:26.441+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:26.504 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:26.504 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:26.513 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:26.557 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:26.557+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:26.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:27:26.642 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:26.642+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:26.654 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:26.654 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:26.664 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:26.743 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:26.743+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:26.831 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:26.832 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:26.841 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:26.844 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:26.843+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:26.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:27:26.945 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:26.945+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:26.996 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:26.996 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:26.997 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:27.020 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:27.040 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:27.046 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:27.045+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:27.060 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:27.061 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:27.062 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:27.062 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:27.137 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:27.137 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:27.137 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:27.137 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:27.146 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:27.145+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:27.147 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:27.247 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:27.246+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:27.315 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:27.315 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:27.315 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:27.315 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:27.315 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:27.325 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:27.367 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:27.366+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:27.450 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:27.449+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:27.494 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:27.494 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:27.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:27.494 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:27.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.495 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:27.495 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:27.495 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 40.610284532000001, 2024-04-26T12:27:27.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:27.495 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.495 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.495 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:27.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:27.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:27.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:27.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:27.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:27.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:27.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:27.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:27.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:27.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:27.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:27.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:27.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:27.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:27.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:27.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:27.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:27.500 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.500 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.500 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.500 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:27.500 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:27.500 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 40.609645184999998, 2024-04-26T12:27:27.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:27.500 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.501 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.501 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:27.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:27.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:27.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:27.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:27.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:27.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:27.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:27.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:27.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:27.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:27.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:27.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:27.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:27.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:27.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:27.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:27.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:27.505 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.505 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.505 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.506 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:27.506 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:27.506 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 40.479942995000002, 2024-04-26T12:27:27.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:27.506 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.506 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.506 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:27.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:27.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:27.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:27.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:27.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:27.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:27.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:27.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:27.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:27.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:27.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:27.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:27.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:27.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:27.511 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.511 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.511 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.511 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:27.511 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:27.511 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 40.479448409, 2024-04-26T12:27:27.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:27.511 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.511 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.511 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:27.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:27.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:27.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:27.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:27.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:27.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:27.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:27.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:27.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:27.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:27.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:27.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:27.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:27.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:27.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:27.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:27.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:27.515 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.515 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.515 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.516 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:27.516 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:27.516 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 40.477446225000001, 2024-04-26T12:27:27.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:27.516 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.516 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.516 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:27.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:27.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:27.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:27.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:27.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:27.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:27.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:27.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:27.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:27.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:27.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:27.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:27.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:27.520 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.520 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.520 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.520 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:27.520 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:27.520 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 40.477039885000003, 2024-04-26T12:27:27.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:27.520 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.521 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.521 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:27.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:27.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:27.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:27.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:27.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:27.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:27.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:27.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:27.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:27.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:27.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:27.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:27.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:27.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:27.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:27.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:27.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:27.524 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.524 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.524 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.525 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:27.525 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:27.525 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 40.476685060999998, 2024-04-26T12:27:27.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:27.525 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.525 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.525 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:27.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:27.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:27.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:27.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:27.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:27.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:27.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:27.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:27.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:27.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:27.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:27.529 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.529 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.529 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.529 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:27.530 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:27.530 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 40.374126646999997, 2024-04-26T12:27:27.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:27.531 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.531 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.531 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:27.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:27.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:27.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:27.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:27.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:27.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:27.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:27.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:27.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:27.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:27.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:27.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:27.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:27.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:27.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:27.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:27.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:27.535 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.535 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.535 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.535 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:27.536 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:27.536 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 40.373730119000001, 2024-04-26T12:27:27.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:27.536 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.536 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.536 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:27.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:27.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:27.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:27.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:27.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:27.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:27.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:27.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:27.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:27.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:27.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:27.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:27.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:27.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:27.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:27.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:27.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:27.541 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.541 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.541 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.542 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:27.542 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:27.542 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 40.276720511000001, 2024-04-26T12:27:27.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:27.542 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.542 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.542 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:27.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:27.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:27.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:27.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:27.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:27.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:27.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:27.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:27.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:27.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:27.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:27.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:27.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:27.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:27.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:27.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:27.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:27.546 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.546 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.546 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.546 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:27.546 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:27.546 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 40.276026795, 2024-04-26T12:27:27.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:27.546 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:27.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:27.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:27.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:27.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:27.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:27.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:27.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:27.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:27.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:27.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:27.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:27.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:27.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:27.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:27.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:27.550 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.550 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.550 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.550 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:27.551 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:27.551 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.241287739999997, 2024-04-26T12:27:27.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:27.551 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.551 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.551 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:27.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:27.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:27.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:27.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:27.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:27.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:27.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:27.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:27.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:27.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:27.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:27.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:27.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:27.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:27.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:27.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:27.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:27.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:27.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:27.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:27.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:27.555 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.556 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.556 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.556 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:27.556 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:27.556 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.240466820999998, 2024-04-26T12:27:27.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:27.556 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.556 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.556 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:27.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:27.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:27.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:27.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:27.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:27.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:27.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:27.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:27.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:27.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:27.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:27.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:27.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:27.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:27.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:27.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:27.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:27.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:27.561 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.561 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.561 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.562 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:27.562 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:27.562 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.240436731000003, 2024-04-26T12:27:27.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:27.562 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.562 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.562 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:27.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:27.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:27.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:27.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:27.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:27.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:27.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:27.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:27.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:27.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:27.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:27.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:27.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:27.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:27.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:27.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:27.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:27.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:27.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:27.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:27.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:27.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:27.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:27.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:27.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.240382943, 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:27.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:27.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:27.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:27.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:27.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:27.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:27.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:27.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:27.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:27.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:27.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:27.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:27.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:27.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:27.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:27.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:27.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:27.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:27.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:27.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:27.573 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.573 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.573 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.573 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:27.574 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:27.574 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.240330385999997, 2024-04-26T12:27:27.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:27.574 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.574 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.574 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:27.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:27.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:27.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:27.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:27.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:27.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:27.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:27.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:27.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:27.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:27.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:27.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:27.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:27.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:27.579 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.579 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.579 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.579 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:27.579 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:27.579 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.240290172000002, 2024-04-26T12:27:27.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:27.579 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.579 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.579 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:27.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:27.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:27.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:27.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:27.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:27.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:27.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:27.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:27.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:27.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:27.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:27.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:27.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:27.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.240262010999999, 2024-04-26T12:27:27.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:27.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:27.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:27.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:27.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:27.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:27.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:27.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:27.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:27.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:27.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:27.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:27.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:27.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:27.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:27.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:27.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:27.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:27.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:27.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:27.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:27.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:27.589 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.589 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.589 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.590 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:27.590 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:27.590 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.240231322, 2024-04-26T12:27:27.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:27.590 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.590 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:27.590 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:27.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:27.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:27.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:27.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:27.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:27.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:27.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:27.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:27.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:27.593 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.593 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.593 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.594 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:27.594 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:27.594 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.240204749, 2024-04-26T12:27:27.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:27.594 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:27.594 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:27.594 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:27.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:27.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:27.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:27.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:27.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:27.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:27.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:27.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:27.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:27.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.597 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.598 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:27.598 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:27.598 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:27.599 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:27.598+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:27.600 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:27.619 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2024-04-26T12:27:27.699 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:27.699+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:27.735 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:27.735 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:27.735 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:27.735 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:27.745 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:27.800 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:27.799+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:27.872 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:27.872 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:27.872 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:27.872 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:27.872 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:27.881 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:27:27.881 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:27:27.881 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T12:27:27.881 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:27:27.881 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:27:27.881 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T12:27:27.882 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:27.901 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:27.900+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:28.002 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:28.001+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:28.021 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:28.021 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "" 2024-04-26T12:27:28.021 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:28.054 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.721547106000003, 2024-04-26T12:27:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802681282999998, 2024-04-26T12:27:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802645071000001, 2024-04-26T12:27:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802606097000002, 2024-04-26T12:27:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.80258293, 2024-04-26T12:27:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802567553000003, 2024-04-26T12:27:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802539363000001, 2024-04-26T12:27:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:28.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:28.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:28.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:28.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:28.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:28.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802521364999997, 2024-04-26T12:27:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802496773999998, 2024-04-26T12:27:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802471824999998, 2024-04-26T12:27:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802450901, 2024-04-26T12:27:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802416051999998, 2024-04-26T12:27:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802382102000003, 2024-04-26T12:27:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:28.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:28.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:28.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:28.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:28.138 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.138 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.138 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.139 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.139 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:28.139 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802361804999997, 2024-04-26T12:27:28.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:28.139 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.139 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.139 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:28.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:28.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:28.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:28.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:28.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:28.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:28.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:28.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:28.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:28.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:28.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:28.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:28.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:28.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:28.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:28.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:28.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:28.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:28.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:28.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:28.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:28.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:28.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:28.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:28.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:28.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:28.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:28.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:28.145 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.145 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.145 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.145 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.145 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:28.145 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802326684000001, 2024-04-26T12:27:28.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:28.145 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.145 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.145 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:28.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:28.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:28.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:28.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:28.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:28.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:28.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:28.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:28.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:28.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:28.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:28.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:28.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:28.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:28.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:28.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:28.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:28.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:28.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:28.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:28.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:28.151 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.151 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.151 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.151 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.151 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:28.151 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802291443999998, 2024-04-26T12:27:28.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:28.151 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.151 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:28.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:28.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:28.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:28.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:28.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:28.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:28.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:28.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:28.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:28.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:28.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:28.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:28.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802149696000001, 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:28.157 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.158 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.158 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:28.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:28.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:28.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:28.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:28.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:28.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:28.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:28.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:28.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:28.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:28.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:28.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:28.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:28.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:28.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:28.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:28.163 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.163 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.163 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.163 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.163 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:28.163 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802125676999999, 2024-04-26T12:27:28.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:28.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:28.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:28.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:28.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:28.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:28.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:28.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:28.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:28.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:28.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:28.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:28.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:28.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:28.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:28.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:28.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:28.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:28.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:28.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:28.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:28.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:28.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:28.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:28.169 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802101708999999, 2024-04-26T12:27:28.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:27:28.170 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.170 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.170 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:28.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:28.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:27:28.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:27:28.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:27:28.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:27:28.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:27:28.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:28.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:27:28.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:27:28.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:27:28.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:27:28.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:27:28.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:27:28.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:27:28.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:27:28.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:28.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:27:28.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:27:28.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:27:28.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:27:28.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:28.175 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.802068327999997, 2024-04-26T12:27:28.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:27:28.176 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:28.176 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:27:28.176 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:28.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:28.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:28.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:28.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:28.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:28.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:28.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:28.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:28.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:27:28.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:27:28.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:28.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:27:28.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:27:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:27:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:27:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:27:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:27:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:28.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:28.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:27:28.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:27:28.180 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.180 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.180 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.180 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:28.180 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:28.180 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:28.181 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:28.181+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:28.182 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:28.282 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:28.282+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:28.309 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:28.309 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:28.309 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T12:27:28.309 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:28.319 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:28.402 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:28.402+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:28.484 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:28.484 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:28.484 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T12:27:28.484 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T12:27:28.484 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:28.485 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:28.483+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:28.494 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:28.585 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:28.585+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:28.661 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:28.661 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T12:27:28.661 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T12:27:28.662 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T12:27:28.662 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.662 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 3 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:27:28.662 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:28.662 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.406596565999997, 2024-04-26T12:27:28.662 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0048986250000000002, 2024-04-26T12:27:28.662 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.662 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:28.662 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.662 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.662 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.662 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:28.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.663 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.663 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.663 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.663 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:28.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.663 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.663 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.663 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.663 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:28.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.663 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.663 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.664 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.664 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253094+0000", 2024-04-26T12:27:28.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0924000000000001e-05 2024-04-26T12:27:28.664 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.664 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.664 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253109+0000", 2024-04-26T12:27:28.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4982e-05 2024-04-26T12:27:28.664 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.664 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.664 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253127+0000", 2024-04-26T12:27:28.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8586000000000001e-05 2024-04-26T12:27:28.664 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253214+0000", 2024-04-26T12:27:28.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6234000000000001e-05 2024-04-26T12:27:28.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257982+0000", 2024-04-26T12:27:28.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0047682150000000001 2024-04-26T12:27:28.665 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.665 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.665 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.666 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.666 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:28.666 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.406153406999998, 2024-04-26T12:27:28.666 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010912543, 2024-04-26T12:27:28.666 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.666 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.666 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.666 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.666 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:28.666 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.666 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.667 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.667 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:28.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.667 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.667 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.667 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253521+0000", 2024-04-26T12:27:28.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999943 2024-04-26T12:27:28.668 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.668 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.668 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.668 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253542+0000", 2024-04-26T12:27:28.668 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1061999999999999e-05 2024-04-26T12:27:28.668 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.668 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.668 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.668 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253606+0000", 2024-04-26T12:27:28.668 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4012999999999999e-05 2024-04-26T12:27:28.668 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.668 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.668 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.668 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253619+0000", 2024-04-26T12:27:28.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3091999999999999e-05 2024-04-26T12:27:28.669 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.669 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.669 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:28.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013321599999999999 2024-04-26T12:27:28.669 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.669 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.669 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253923+0000", 2024-04-26T12:27:28.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017127900000000001 2024-04-26T12:27:28.669 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.669 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:28.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254085+0000", 2024-04-26T12:27:28.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000161566 2024-04-26T12:27:28.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:28.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257500+0000", 2024-04-26T12:27:28.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034156880000000001 2024-04-26T12:27:28.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264372+0000", 2024-04-26T12:27:28.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068719760000000001 2024-04-26T12:27:28.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:28.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264402+0000", 2024-04-26T12:27:28.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9128e-05 2024-04-26T12:27:28.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264439+0000", 2024-04-26T12:27:28.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7251e-05 2024-04-26T12:27:28.671 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.671 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.671 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.672 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.672 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:28.672 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.406044305000002, 2024-04-26T12:27:28.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010957691, 2024-04-26T12:27:28.672 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.672 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.672 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.672 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.672 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:28.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.672 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253639+0000", 2024-04-26T12:27:28.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:27:28.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253648+0000", 2024-04-26T12:27:28.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:27:28.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253655+0000", 2024-04-26T12:27:28.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8909999999999998e-06 2024-04-26T12:27:28.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254807+0000", 2024-04-26T12:27:28.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001151712 2024-04-26T12:27:28.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255417+0000", 2024-04-26T12:27:28.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00061023000000000002 2024-04-26T12:27:28.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:28.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255573+0000", 2024-04-26T12:27:28.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015571399999999999 2024-04-26T12:27:28.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260113+0000", 2024-04-26T12:27:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045405519999999998 2024-04-26T12:27:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264499+0000", 2024-04-26T12:27:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043857050000000002 2024-04-26T12:27:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264552+0000", 2024-04-26T12:27:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2602000000000002e-05 2024-04-26T12:27:28.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.677 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.677 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.677 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264593+0000", 2024-04-26T12:27:28.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1341000000000003e-05 2024-04-26T12:27:28.677 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.677 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.677 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.677 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.677 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.677 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.677 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:28.677 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.406018899000003, 2024-04-26T12:27:28.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091815760000000003, 2024-04-26T12:27:28.678 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.678 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.678 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.678 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.678 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:28.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:28.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253660+0000", 2024-04-26T12:27:28.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.680 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253664+0000", 2024-04-26T12:27:28.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:27:28.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.680 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253679+0000", 2024-04-26T12:27:28.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4208e-05 2024-04-26T12:27:28.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253685+0000", 2024-04-26T12:27:28.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:27:28.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254897+0000", 2024-04-26T12:27:28.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001211801 2024-04-26T12:27:28.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255009+0000", 2024-04-26T12:27:28.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011189 2024-04-26T12:27:28.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255142+0000", 2024-04-26T12:27:28.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013265799999999999 2024-04-26T12:27:28.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:28.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.259665+0000", 2024-04-26T12:27:28.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004523862 2024-04-26T12:27:28.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.683 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262759+0000", 2024-04-26T12:27:28.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003093391 2024-04-26T12:27:28.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:28.683 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262805+0000", 2024-04-26T12:27:28.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6399000000000001e-05 2024-04-26T12:27:28.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262842+0000", 2024-04-26T12:27:28.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7184000000000002e-05 2024-04-26T12:27:28.684 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.684 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.684 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.684 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.685 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:28.685 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.405988989000001, 2024-04-26T12:27:28.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092939230000000008, 2024-04-26T12:27:28.685 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.685 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.685 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.685 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.685 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:28.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.685 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.685 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.685 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:28.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253690+0000", 2024-04-26T12:27:28.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253695+0000", 2024-04-26T12:27:28.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6090000000000003e-06 2024-04-26T12:27:28.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253705+0000", 2024-04-26T12:27:28.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0326000000000001e-05 2024-04-26T12:27:28.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253714+0000", 2024-04-26T12:27:28.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:27:28.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256115+0000", 2024-04-26T12:27:28.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024015450000000002 2024-04-26T12:27:28.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.688 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256215+0000", 2024-04-26T12:27:28.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010016700000000001 2024-04-26T12:27:28.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.688 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:28.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256368+0000", 2024-04-26T12:27:28.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015244999999999999 2024-04-26T12:27:28.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:28.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260313+0000", 2024-04-26T12:27:28.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00394481 2024-04-26T12:27:28.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262895+0000", 2024-04-26T12:27:28.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0025824670000000002 2024-04-26T12:27:28.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:28.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262946+0000", 2024-04-26T12:27:28.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1072999999999997e-05 2024-04-26T12:27:28.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.690 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262985+0000", 2024-04-26T12:27:28.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8529000000000003e-05 2024-04-26T12:27:28.690 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.690 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.690 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.405959627999998, 2024-04-26T12:27:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011070178999999999, 2024-04-26T12:27:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:28.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:28.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253724+0000", 2024-04-26T12:27:28.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0890000000000002e-06 2024-04-26T12:27:28.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.693 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.693 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253736+0000", 2024-04-26T12:27:28.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2252999999999999e-05 2024-04-26T12:27:28.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.693 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.693 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253742+0000", 2024-04-26T12:27:28.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9499999999999998e-06 2024-04-26T12:27:28.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.693 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.693 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256230+0000", 2024-04-26T12:27:28.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002488114 2024-04-26T12:27:28.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256421+0000", 2024-04-26T12:27:28.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019087999999999999 2024-04-26T12:27:28.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:28.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256583+0000", 2024-04-26T12:27:28.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000162566 2024-04-26T12:27:28.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:28.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260316+0000", 2024-04-26T12:27:28.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037329239999999999 2024-04-26T12:27:28.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264713+0000", 2024-04-26T12:27:28.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043968380000000001 2024-04-26T12:27:28.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:28.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:28.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1124000000000001e-05 2024-04-26T12:27:28.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.696 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.696 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264790+0000", 2024-04-26T12:27:28.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5923999999999997e-05 2024-04-26T12:27:28.696 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.696 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.696 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.696 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.696 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:28.696 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.405927812000002, 2024-04-26T12:27:28.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0086059009999999991, 2024-04-26T12:27:28.697 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.697 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.697 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.697 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.697 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:28.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.697 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.697 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.697 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:28.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253751+0000", 2024-04-26T12:27:28.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253756+0000", 2024-04-26T12:27:28.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9740000000000001e-06 2024-04-26T12:27:28.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253762+0000", 2024-04-26T12:27:28.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9769999999999997e-06 2024-04-26T12:27:28.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253767+0000", 2024-04-26T12:27:28.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:27:28.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254160+0000", 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039256700000000002 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254292+0000", 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013190399999999999 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254453+0000", 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000160982 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257354+0000", 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029008229999999999 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262281+0000", 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049274760000000001 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262323+0000", 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.189e-05 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.702 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262358+0000", 2024-04-26T12:27:28.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4826000000000002e-05 2024-04-26T12:27:28.702 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.702 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.702 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.702 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.702 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:32 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.702 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:28.702 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.405571760000001, 2024-04-26T12:27:28.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083641310000000003, 2024-04-26T12:27:28.702 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.703 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:28.703 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:28.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:28.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254107+0000", 2024-04-26T12:27:28.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:28.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254113+0000", 2024-04-26T12:27:28.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:27:28.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254122+0000", 2024-04-26T12:27:28.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.149e-06 2024-04-26T12:27:28.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254131+0000", 2024-04-26T12:27:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5609999999999999e-06 2024-04-26T12:27:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255227+0000", 2024-04-26T12:27:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010961 2024-04-26T12:27:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255355+0000", 2024-04-26T12:27:28.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012883299999999999 2024-04-26T12:27:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262472+0000", 2024-04-26T12:27:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071165949999999999 2024-04-26T12:27:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:33 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.706 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.405543635999997, 2024-04-26T12:27:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012698262, 2024-04-26T12:27:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254138+0000", 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2460000000000002e-06 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254145+0000", 2024-04-26T12:27:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7070000000000003e-06 2024-04-26T12:27:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254164+0000", 2024-04-26T12:27:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9604999999999999e-05 2024-04-26T12:27:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257574+0000", 2024-04-26T12:27:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034098980000000002 2024-04-26T12:27:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257731+0000", 2024-04-26T12:27:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015735400000000001 2024-04-26T12:27:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266834+0000", 2024-04-26T12:27:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091028099999999994 2024-04-26T12:27:28.710 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.405507897, 2024-04-26T12:27:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0087469690000000003, 2024-04-26T12:27:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254171+0000", 2024-04-26T12:27:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.712 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254178+0000", 2024-04-26T12:27:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7710000000000001e-06 2024-04-26T12:27:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254185+0000", 2024-04-26T12:27:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6249999999999998e-06 2024-04-26T12:27:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254203+0000", 2024-04-26T12:27:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8003999999999999e-05 2024-04-26T12:27:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254408+0000", 2024-04-26T12:27:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020469100000000001 2024-04-26T12:27:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254525+0000", 2024-04-26T12:27:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000116319 2024-04-26T12:27:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262919+0000", 2024-04-26T12:27:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083942440000000004 2024-04-26T12:27:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:18 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.398298359999998, 2024-04-26T12:27:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016521190000000001, 2024-04-26T12:27:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.715 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:28.717 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.717 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.717 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.717 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.717 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261387+0000", 2024-04-26T12:27:28.717 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4880000000000004e-06 2024-04-26T12:27:28.717 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.717 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.717 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.717 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261396+0000", 2024-04-26T12:27:28.717 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2209999999999997e-06 2024-04-26T12:27:28.717 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.717 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.718 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261414+0000", 2024-04-26T12:27:28.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8386e-05 2024-04-26T12:27:28.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.718 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261460+0000", 2024-04-26T12:27:28.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6029999999999998e-05 2024-04-26T12:27:28.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.718 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261516+0000", 2024-04-26T12:27:28.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6418000000000001e-05 2024-04-26T12:27:28.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:28.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263008+0000", 2024-04-26T12:27:28.719 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0014912910000000001 2024-04-26T12:27:28.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263033+0000", 2024-04-26T12:27:28.719 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5763e-05 2024-04-26T12:27:28.719 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.719 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.720 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.720 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:28 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:28.720 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:28.720 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.398093662999997, 2024-04-26T12:27:28.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001530869, 2024-04-26T12:27:28.720 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.720 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.720 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.720 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:28.721 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.721 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.721 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.721 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:28.721 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.721 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.721 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.721 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:28.721 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.721 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.721 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.722 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261597+0000", 2024-04-26T12:27:28.722 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1344e-05 2024-04-26T12:27:28.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.722 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.722 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.722 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261605+0000", 2024-04-26T12:27:28.722 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9039999999999992e-06 2024-04-26T12:27:28.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.722 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.722 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.722 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261612+0000", 2024-04-26T12:27:28.722 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8580000000000002e-06 2024-04-26T12:27:28.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261886+0000", 2024-04-26T12:27:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027415399999999998 2024-04-26T12:27:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261905+0000", 2024-04-26T12:27:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8898000000000001e-05 2024-04-26T12:27:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263093+0000", 2024-04-26T12:27:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011877490000000001 2024-04-26T12:27:28.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263117+0000", 2024-04-26T12:27:28.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4338999999999999e-05 2024-04-26T12:27:28.724 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.724 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.724 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.724 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing_reply(3.b epoch 15/13 rep_tid 4 lcod 15'2)", 2024-04-26T12:27:28.724 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:28.724 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.397406728, 2024-04-26T12:27:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020538300000000001, 2024-04-26T12:27:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.726 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.726 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.726 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262272+0000", 2024-04-26T12:27:28.726 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:28.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.726 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.726 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.726 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262277+0000", 2024-04-26T12:27:28.726 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9169999999999997e-06 2024-04-26T12:27:28.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.726 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.726 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.726 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262287+0000", 2024-04-26T12:27:28.726 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0237e-05 2024-04-26T12:27:28.727 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.727 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.727 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.727 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262297+0000", 2024-04-26T12:27:28.727 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3219999999999999e-06 2024-04-26T12:27:28.727 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.727 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.727 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.727 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262382+0000", 2024-04-26T12:27:28.727 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4969999999999995e-05 2024-04-26T12:27:28.727 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.727 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.727 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.727 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262478+0000", 2024-04-26T12:27:28.728 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6704000000000001e-05 2024-04-26T12:27:28.728 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.728 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.728 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.728 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.728 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.728 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e15/13 ondisk, result = 0)", 2024-04-26T12:27:28.728 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:28.728 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.396962191, 2024-04-26T12:27:28.728 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027471, 2024-04-26T12:27:28.728 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.728 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:28.728 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.728 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.729 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.729 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:28.729 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.729 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.729 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.729 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.729 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:28.729 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.729 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.729 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.729 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.729 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:28.729 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.729 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.730 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.730 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.730 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262720+0000", 2024-04-26T12:27:28.730 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4509999999999999e-06 2024-04-26T12:27:28.730 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.730 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.730 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.730 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262726+0000", 2024-04-26T12:27:28.730 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8599999999999998e-06 2024-04-26T12:27:28.730 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.731 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.731 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.731 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262732+0000", 2024-04-26T12:27:28.731 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5889999999999999e-06 2024-04-26T12:27:28.731 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.731 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.731 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.731 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262882+0000", 2024-04-26T12:27:28.731 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014968800000000001 2024-04-26T12:27:28.731 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.731 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.731 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.731 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262890+0000", 2024-04-26T12:27:28.731 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9279999999999993e-06 2024-04-26T12:27:28.732 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.732 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.732 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.732 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262992+0000", 2024-04-26T12:27:28.732 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010247300000000001 2024-04-26T12:27:28.732 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.732 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.732 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.732 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.732 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.732 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:28.732 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:28.732 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.395289632000001, 2024-04-26T12:27:28.732 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021676200000000001, 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.733 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264404+0000", 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3998999999999999e-05 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264411+0000", 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:27:28.734 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.735 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.735 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.735 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264424+0000", 2024-04-26T12:27:28.735 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2843999999999999e-05 2024-04-26T12:27:28.735 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.735 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.735 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.735 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264485+0000", 2024-04-26T12:27:28.735 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0464000000000002e-05 2024-04-26T12:27:28.735 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.735 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.736 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.736 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264493+0000", 2024-04-26T12:27:28.736 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.507e-06 2024-04-26T12:27:28.736 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.736 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.736 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.736 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264607+0000", 2024-04-26T12:27:28.736 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000113591 2024-04-26T12:27:28.736 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.736 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.736 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.736 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.736 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.737 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:21 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:28.737 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:28.737 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.395249905, 2024-04-26T12:27:28.737 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00037041599999999999, 2024-04-26T12:27:28.737 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.737 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:28.737 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.737 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.737 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.737 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:28.737 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.737 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.737 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.737 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.738 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:28.738 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.738 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.738 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.738 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.738 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264429+0000", 2024-04-26T12:27:28.738 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.738 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.738 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.738 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.738 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264432+0000", 2024-04-26T12:27:28.738 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0770000000000002e-06 2024-04-26T12:27:28.738 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264435+0000", 2024-04-26T12:27:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8340000000000001e-06 2024-04-26T12:27:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264438+0000", 2024-04-26T12:27:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5280000000000002e-06 2024-04-26T12:27:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264703+0000", 2024-04-26T12:27:28.739 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026548400000000002 2024-04-26T12:27:28.740 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.740 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.740 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.740 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264709+0000", 2024-04-26T12:27:28.740 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8390000000000003e-06 2024-04-26T12:27:28.740 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.740 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.740 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.740 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264800+0000", 2024-04-26T12:27:28.740 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0931000000000001e-05 2024-04-26T12:27:28.741 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.741 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.741 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.741 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.741 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.741 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:28.741 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:28.741 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.394444004, 2024-04-26T12:27:28.741 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016589860000000001, 2024-04-26T12:27:28.741 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.741 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.741 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.741 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.741 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.742 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:28.742 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.742 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.742 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.742 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.742 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:28.742 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.742 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.742 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.742 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.742 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265235+0000", 2024-04-26T12:27:28.743 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:28.743 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.743 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.743 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.743 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265252+0000", 2024-04-26T12:27:28.743 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6307000000000002e-05 2024-04-26T12:27:28.743 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.743 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.743 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.743 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265257+0000", 2024-04-26T12:27:28.743 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8279999999999999e-06 2024-04-26T12:27:28.743 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.743 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.744 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.744 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265263+0000", 2024-04-26T12:27:28.744 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9399999999999999e-06 2024-04-26T12:27:28.744 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.744 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.744 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.744 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265300+0000", 2024-04-26T12:27:28.744 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6315e-05 2024-04-26T12:27:28.744 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.744 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.744 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.744 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265312+0000", 2024-04-26T12:27:28.744 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2451e-05 2024-04-26T12:27:28.744 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266864+0000", 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015521090000000001 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266895+0000", 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0426e-05 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.745 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:22 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:28.746 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:28.746 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.394323264000001, 2024-04-26T12:27:28.746 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021988139999999999, 2024-04-26T12:27:28.746 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.746 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.746 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.746 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.746 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.746 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:28.746 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.746 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.746 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.746 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967296 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265361+0000", 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6979999999999997e-06 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.747 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.748 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265366+0000", 2024-04-26T12:27:28.748 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6550000000000003e-06 2024-04-26T12:27:28.748 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.748 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.748 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.748 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265379+0000", 2024-04-26T12:27:28.748 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.358e-05 2024-04-26T12:27:28.748 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.748 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.748 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.748 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265535+0000", 2024-04-26T12:27:28.748 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015586800000000001 2024-04-26T12:27:28.748 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.748 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.749 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.749 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265556+0000", 2024-04-26T12:27:28.749 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1202000000000001e-05 2024-04-26T12:27:28.749 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.749 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.749 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:28.749 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267528+0000", 2024-04-26T12:27:28.749 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0019722099999999998 2024-04-26T12:27:28.749 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.749 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.749 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.749 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267555+0000", 2024-04-26T12:27:28.749 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6775999999999999e-05 2024-04-26T12:27:28.749 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.750 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.750 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.750 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.750 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.750 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-26T12:27:28.750 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:28.750 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.749305092, 2024-04-26T12:27:28.750 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020315099999999998, 2024-04-26T12:27:28.750 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.750 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.750 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.750 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.751 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.751 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:28.751 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.751 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.751 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.751 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.751 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:28.751 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.751 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.751 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.751 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.751 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910372+0000", 2024-04-26T12:27:28.752 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-26T12:27:28.752 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.752 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.752 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.752 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910387+0000", 2024-04-26T12:27:28.752 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5252999999999999e-05 2024-04-26T12:27:28.752 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.752 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.752 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.752 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910418+0000", 2024-04-26T12:27:28.752 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0778999999999998e-05 2024-04-26T12:27:28.752 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.753 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.753 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.753 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910437+0000", 2024-04-26T12:27:28.753 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9619999999999998e-05 2024-04-26T12:27:28.753 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.753 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.753 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.753 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910587+0000", 2024-04-26T12:27:28.753 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014922000000000001 2024-04-26T12:27:28.753 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.753 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.753 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.753 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910837+0000", 2024-04-26T12:27:28.753 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025089099999999999 2024-04-26T12:27:28.754 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.754 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.754 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:28.754 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910973+0000", 2024-04-26T12:27:28.754 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000135124 2024-04-26T12:27:28.754 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.754 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.754 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:28.754 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.911616+0000", 2024-04-26T12:27:28.754 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00064392799999999999 2024-04-26T12:27:28.754 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.754 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.754 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.754 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912341+0000", 2024-04-26T12:27:28.755 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00072415700000000001 2024-04-26T12:27:28.755 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.755 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.755 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:28.755 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912379+0000", 2024-04-26T12:27:28.755 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8724999999999999e-05 2024-04-26T12:27:28.755 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.755 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.755 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.755 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912406+0000", 2024-04-26T12:27:28.755 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6752999999999999e-05 2024-04-26T12:27:28.755 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.755 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.755 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.756 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.756 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.756 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-26T12:27:28.756 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:28.756 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.7486368800000003, 2024-04-26T12:27:28.756 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0013630599999999999, 2024-04-26T12:27:28.756 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:28.756 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:28.756 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:28.756 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.756 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:28.756 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:28.756 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.756 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.757 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.757 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:28.757 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:28.757 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:28.757 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.757 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.757 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:28.757 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911041+0000", 2024-04-26T12:27:28.757 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999976 2024-04-26T12:27:28.757 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.757 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.757 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:28.757 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911057+0000", 2024-04-26T12:27:28.757 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6549999999999999e-05 2024-04-26T12:27:28.758 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.758 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.758 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:28.758 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911088+0000", 2024-04-26T12:27:28.758 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0753000000000002e-05 2024-04-26T12:27:28.758 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.758 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.758 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:28.758 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911107+0000", 2024-04-26T12:27:28.758 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9425000000000001e-05 2024-04-26T12:27:28.758 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.758 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.758 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:28.758 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911258+0000", 2024-04-26T12:27:28.759 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000150252 2024-04-26T12:27:28.759 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.759 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.759 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:28.759 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911379+0000", 2024-04-26T12:27:28.759 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012129900000000001 2024-04-26T12:27:28.759 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.759 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.759 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:28.759 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911529+0000", 2024-04-26T12:27:28.759 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015010699999999999 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912214+0000", 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00068528199999999995 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912343+0000", 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012858800000000001 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:28.760 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912378+0000", 2024-04-26T12:27:28.761 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5420000000000003e-05 2024-04-26T12:27:28.761 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:28.761 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:28.761 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:28.761 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912406+0000", 2024-04-26T12:27:28.761 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7594e-05 2024-04-26T12:27:28.761 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.761 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.762 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.762 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:28.762 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:28.762 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:28.763 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:28.764 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:28.762+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:28.864 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:28.863+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:28.903 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:28.903 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:28.913 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:28.964 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:28.964+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:29.039 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:29.039 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:29.039 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:29.039 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:29.039 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:29.049 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:29.066 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:29.065+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:29.073 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:27:29.166 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:29.165+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:29.220 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:29.220 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:29.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:29.220 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:29.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.336012922999998, 2024-04-26T12:27:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:29.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:29.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:29.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:29.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:29.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:29.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:29.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:29.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:29.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:29.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:29.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:29.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:29.225 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.225 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.225 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.225 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:29.225 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:29.225 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.335373576000002, 2024-04-26T12:27:29.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:29.225 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.225 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.225 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:29.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:29.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:29.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:29.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:29.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:29.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:29.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:29.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:29.229 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:29.230 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.205671385999999, 2024-04-26T12:27:29.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:29.230 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.230 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.230 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:29.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:29.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:29.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:29.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:29.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:29.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.233 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.205176799999997, 2024-04-26T12:27:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:29.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.203174615999998, 2024-04-26T12:27:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:29.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:29.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.202768276, 2024-04-26T12:27:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:29.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.202413452000002, 2024-04-26T12:27:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.247 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:29.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:29.251 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.099855038000001, 2024-04-26T12:27:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:29.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.255 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.099458509999998, 2024-04-26T12:27:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:29.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:29.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.002448901999998, 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:29.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:29.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.001755185999997, 2024-04-26T12:27:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:29.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:29.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.967016131000001, 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:29.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:29.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:29.274 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.966195212000002, 2024-04-26T12:27:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:29.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:29.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:29.279 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.280 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.280 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.280 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:29.280 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:29.280 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.966165122, 2024-04-26T12:27:29.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:29.280 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.280 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.280 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:29.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:29.285 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.966111333999997, 2024-04-26T12:27:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:29.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:29.290 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.966058777000001, 2024-04-26T12:27:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:29.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:29.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.966018562999999, 2024-04-26T12:27:29.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:29.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:29.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:29.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.965990402000003, 2024-04-26T12:27:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:29.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:29.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:29.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.965959712999997, 2024-04-26T12:27:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:29.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:29.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.965933139999997, 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:29.314 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.315 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.315 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.315 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:29.315 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:29.315 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:29.316 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:29.316+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:29.317 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:29.317 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:29.317 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:29.318 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:29.318 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:29.318 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:29.319 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:29.417 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:29.417+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:29.458 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:29.458 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:29.468 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:29.518 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:29.517+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:29.595 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:29.595 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:29.605 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:29.619 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:29.618+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:29.633 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:27:29.720 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:29.719+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:29.731 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:29.731 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:29.741 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:29.820 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:29.819+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:29.881 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:29.881 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:29.892 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:29.935 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:29.935+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:30.017 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:30.018 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:30.022 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:30.021+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:30.027 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:30.123 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:30.122+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:30.194 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:30.195 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:30.205 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:30.249 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:30.249+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:30.325 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:30.324+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:30.337 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:30.337 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:30.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:30.426 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:30.425+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:30.514 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:30.514 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:30.524 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:30.527 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:30.525+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:30.627 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:30.627+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:30.629 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2024-04-26T12:27:30.650 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:30.650 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:30.660 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:30.728 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:30.727+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:30.801 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:30.801 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:30.811 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:30.829 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:30.829+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:30.930 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:30.930+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:30.978 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:30.978 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:30.988 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:31.031 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:31.030+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:31.114 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:31.114 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:31.126 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:31.131 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:31.131+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:31.232 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:31.232+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:31.265 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:31.265 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:31.275 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:31.320 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:27:31.333 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:31.332+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:31.401 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:31.401 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:31.412 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:31.434 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:31.433+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:31.482 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:31.503 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:31.523 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:31.524 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:31.524 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:31.524 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:31.535 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:31.534+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:31.540 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:31.540 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T12:27:31.540 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T12:27:31.540 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T12:27:31.540 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.540 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 3 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:27:31.540 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:31.540 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.285107134, 2024-04-26T12:27:31.541 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0048986250000000002, 2024-04-26T12:27:31.541 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.541 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:31.541 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.541 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.541 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.541 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:31.541 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.541 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.541 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.541 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.541 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:31.541 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.542 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.542 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.542 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.542 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:31.542 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:31.542 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.542 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.542 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.542 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253094+0000", 2024-04-26T12:27:31.543 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0924000000000001e-05 2024-04-26T12:27:31.543 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.543 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.543 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.543 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253109+0000", 2024-04-26T12:27:31.543 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4982e-05 2024-04-26T12:27:31.543 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.543 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.543 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.543 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253127+0000", 2024-04-26T12:27:31.543 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8586000000000001e-05 2024-04-26T12:27:31.543 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.543 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.544 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.544 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253214+0000", 2024-04-26T12:27:31.544 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6234000000000001e-05 2024-04-26T12:27:31.544 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.544 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.544 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.544 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257982+0000", 2024-04-26T12:27:31.544 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0047682150000000001 2024-04-26T12:27:31.544 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.544 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.545 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.545 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.545 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.545 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:31.545 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:31.545 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.284663975000001, 2024-04-26T12:27:31.545 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010912543, 2024-04-26T12:27:31.545 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.545 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:31.545 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.545 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.546 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.546 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:31.546 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.546 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.546 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.546 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.546 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:31.546 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.546 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.546 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.546 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.547 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253521+0000", 2024-04-26T12:27:31.547 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999943 2024-04-26T12:27:31.547 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.547 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.547 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.547 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253542+0000", 2024-04-26T12:27:31.547 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1061999999999999e-05 2024-04-26T12:27:31.547 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.547 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.547 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.548 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253606+0000", 2024-04-26T12:27:31.548 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4012999999999999e-05 2024-04-26T12:27:31.548 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.548 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.548 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.548 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253619+0000", 2024-04-26T12:27:31.548 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3091999999999999e-05 2024-04-26T12:27:31.548 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.548 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.548 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.549 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:31.549 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013321599999999999 2024-04-26T12:27:31.549 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.549 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.549 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.549 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253923+0000", 2024-04-26T12:27:31.549 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017127900000000001 2024-04-26T12:27:31.549 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.550 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.550 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:31.550 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254085+0000", 2024-04-26T12:27:31.550 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000161566 2024-04-26T12:27:31.550 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.550 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.550 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:31.550 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257500+0000", 2024-04-26T12:27:31.550 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034156880000000001 2024-04-26T12:27:31.550 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264372+0000", 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068719760000000001 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264402+0000", 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9128e-05 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264439+0000", 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7251e-05 2024-04-26T12:27:31.551 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.284554872999998, 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010957691, 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:31.552 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253639+0000", 2024-04-26T12:27:31.553 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:27:31.554 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.554 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.554 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.554 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253648+0000", 2024-04-26T12:27:31.554 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:27:31.554 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.554 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.554 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.554 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253655+0000", 2024-04-26T12:27:31.554 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8909999999999998e-06 2024-04-26T12:27:31.554 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.554 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.554 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.555 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254807+0000", 2024-04-26T12:27:31.555 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001151712 2024-04-26T12:27:31.555 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.555 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.555 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.555 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255417+0000", 2024-04-26T12:27:31.555 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00061023000000000002 2024-04-26T12:27:31.555 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.555 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.555 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:31.555 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255573+0000", 2024-04-26T12:27:31.555 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015571399999999999 2024-04-26T12:27:31.555 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.555 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260113+0000", 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045405519999999998 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264499+0000", 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043857050000000002 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264552+0000", 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2602000000000002e-05 2024-04-26T12:27:31.556 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.557 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.557 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.557 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264593+0000", 2024-04-26T12:27:31.557 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1341000000000003e-05 2024-04-26T12:27:31.557 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.557 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.557 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.557 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.557 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.557 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:31.557 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:31.557 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.284529466999999, 2024-04-26T12:27:31.557 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091815760000000003, 2024-04-26T12:27:31.557 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.558 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:31.558 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.558 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.558 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.558 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:31.558 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.558 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.558 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.558 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.558 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:31.558 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.558 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.558 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.558 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253660+0000", 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253664+0000", 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253679+0000", 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4208e-05 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.559 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.560 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253685+0000", 2024-04-26T12:27:31.560 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:27:31.560 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.560 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.560 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.560 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254897+0000", 2024-04-26T12:27:31.560 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001211801 2024-04-26T12:27:31.560 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.560 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.560 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.560 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255009+0000", 2024-04-26T12:27:31.560 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011189 2024-04-26T12:27:31.560 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255142+0000", 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013265799999999999 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.259665+0000", 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004523862 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262759+0000", 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003093391 2024-04-26T12:27:31.561 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.562 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.562 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:31.562 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262805+0000", 2024-04-26T12:27:31.562 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6399000000000001e-05 2024-04-26T12:27:31.562 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.562 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.562 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.562 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262842+0000", 2024-04-26T12:27:31.562 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7184000000000002e-05 2024-04-26T12:27:31.562 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.562 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.562 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.562 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.562 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.563 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:31.563 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:31.563 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.284499556999997, 2024-04-26T12:27:31.563 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092939230000000008, 2024-04-26T12:27:31.563 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.563 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:31.563 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.563 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.563 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.563 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:31.563 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.563 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.563 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.564 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.564 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:31.564 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.564 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.564 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.564 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.564 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253690+0000", 2024-04-26T12:27:31.564 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:31.564 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.564 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.564 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.564 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253695+0000", 2024-04-26T12:27:31.565 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6090000000000003e-06 2024-04-26T12:27:31.565 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.565 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.565 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.565 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253705+0000", 2024-04-26T12:27:31.565 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0326000000000001e-05 2024-04-26T12:27:31.565 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.565 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.565 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.565 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253714+0000", 2024-04-26T12:27:31.565 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:27:31.565 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.565 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.565 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.566 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256115+0000", 2024-04-26T12:27:31.566 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024015450000000002 2024-04-26T12:27:31.566 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.566 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.566 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.566 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256215+0000", 2024-04-26T12:27:31.566 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010016700000000001 2024-04-26T12:27:31.566 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.566 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.566 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:31.566 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256368+0000", 2024-04-26T12:27:31.566 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015244999999999999 2024-04-26T12:27:31.566 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260313+0000", 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00394481 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262895+0000", 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0025824670000000002 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262946+0000", 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1072999999999997e-05 2024-04-26T12:27:31.567 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.568 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.568 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.568 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262985+0000", 2024-04-26T12:27:31.568 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8529000000000003e-05 2024-04-26T12:27:31.568 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.568 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.568 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.568 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.568 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.568 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:31.568 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:31.568 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.284470196000001, 2024-04-26T12:27:31.568 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011070178999999999, 2024-04-26T12:27:31.568 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.569 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:31.569 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.569 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.569 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.569 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:31.569 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.569 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.569 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.569 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.569 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:31.569 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.569 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.569 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.569 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253724+0000", 2024-04-26T12:27:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0890000000000002e-06 2024-04-26T12:27:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253736+0000", 2024-04-26T12:27:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2252999999999999e-05 2024-04-26T12:27:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.570 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253742+0000", 2024-04-26T12:27:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9499999999999998e-06 2024-04-26T12:27:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256230+0000", 2024-04-26T12:27:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002488114 2024-04-26T12:27:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256421+0000", 2024-04-26T12:27:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019087999999999999 2024-04-26T12:27:31.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256583+0000", 2024-04-26T12:27:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000162566 2024-04-26T12:27:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260316+0000", 2024-04-26T12:27:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037329239999999999 2024-04-26T12:27:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264713+0000", 2024-04-26T12:27:31.572 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043968380000000001 2024-04-26T12:27:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1124000000000001e-05 2024-04-26T12:27:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264790+0000", 2024-04-26T12:27:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5923999999999997e-05 2024-04-26T12:27:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.573 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.574 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.574 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:31.574 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:31.574 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.284438379999997, 2024-04-26T12:27:31.574 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0086059009999999991, 2024-04-26T12:27:31.574 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.574 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:31.574 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.574 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.574 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.574 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:31.574 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.575 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.575 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.575 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.575 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:31.575 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.575 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.575 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.575 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.575 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253751+0000", 2024-04-26T12:27:31.575 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:31.575 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.576 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.576 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.576 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253756+0000", 2024-04-26T12:27:31.576 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9740000000000001e-06 2024-04-26T12:27:31.576 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.576 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.576 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.576 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253762+0000", 2024-04-26T12:27:31.576 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9769999999999997e-06 2024-04-26T12:27:31.576 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.576 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.576 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.576 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253767+0000", 2024-04-26T12:27:31.576 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:27:31.577 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.577 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.577 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.577 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254160+0000", 2024-04-26T12:27:31.577 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039256700000000002 2024-04-26T12:27:31.577 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.577 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.577 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.577 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254292+0000", 2024-04-26T12:27:31.578 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013190399999999999 2024-04-26T12:27:31.578 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.578 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.578 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:31.578 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254453+0000", 2024-04-26T12:27:31.578 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000160982 2024-04-26T12:27:31.578 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.578 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.578 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:31.578 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257354+0000", 2024-04-26T12:27:31.578 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029008229999999999 2024-04-26T12:27:31.578 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.578 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.579 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:31.579 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262281+0000", 2024-04-26T12:27:31.579 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049274760000000001 2024-04-26T12:27:31.579 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.579 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.579 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:31.579 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262323+0000", 2024-04-26T12:27:31.579 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.189e-05 2024-04-26T12:27:31.579 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.580 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.580 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.580 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262358+0000", 2024-04-26T12:27:31.580 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4826000000000002e-05 2024-04-26T12:27:31.580 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.580 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.580 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.580 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.580 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.580 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:32 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:31.580 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:31.580 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.284082327999997, 2024-04-26T12:27:31.580 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083641310000000003, 2024-04-26T12:27:31.581 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.581 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:31.581 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.581 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.581 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.581 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:31.581 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.581 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.581 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.581 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.582 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:31.582 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.582 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.582 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.582 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.582 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254107+0000", 2024-04-26T12:27:31.582 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:31.582 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.582 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.582 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.583 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254113+0000", 2024-04-26T12:27:31.583 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:27:31.583 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.583 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.583 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.583 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254122+0000", 2024-04-26T12:27:31.583 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.149e-06 2024-04-26T12:27:31.583 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.583 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.584 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.584 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254131+0000", 2024-04-26T12:27:31.584 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5609999999999999e-06 2024-04-26T12:27:31.584 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.584 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.584 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.584 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255227+0000", 2024-04-26T12:27:31.584 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010961 2024-04-26T12:27:31.584 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.585 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.585 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.585 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255355+0000", 2024-04-26T12:27:31.585 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012883299999999999 2024-04-26T12:27:31.585 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.585 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.585 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.585 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262472+0000", 2024-04-26T12:27:31.585 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071165949999999999 2024-04-26T12:27:31.585 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.585 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.586 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.586 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.586 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.586 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:33 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:31.586 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:31.586 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.284054204, 2024-04-26T12:27:31.586 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012698262, 2024-04-26T12:27:31.586 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.586 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:31.586 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.586 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.586 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.586 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:31.587 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.587 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.587 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.587 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.587 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:31.587 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.587 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.587 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.587 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.587 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:31.587 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:31.587 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.587 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.588 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.588 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254138+0000", 2024-04-26T12:27:31.588 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2460000000000002e-06 2024-04-26T12:27:31.588 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.588 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.588 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.588 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254145+0000", 2024-04-26T12:27:31.588 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7070000000000003e-06 2024-04-26T12:27:31.588 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.588 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.588 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.588 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254164+0000", 2024-04-26T12:27:31.588 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9604999999999999e-05 2024-04-26T12:27:31.588 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.589 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.589 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.589 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257574+0000", 2024-04-26T12:27:31.589 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034098980000000002 2024-04-26T12:27:31.589 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.589 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.589 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.589 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257731+0000", 2024-04-26T12:27:31.589 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015735400000000001 2024-04-26T12:27:31.589 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.589 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.589 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.589 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266834+0000", 2024-04-26T12:27:31.589 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091028099999999994 2024-04-26T12:27:31.590 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.590 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.590 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.590 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.590 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.590 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:31.590 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:31.590 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.284018465000003, 2024-04-26T12:27:31.590 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0087469690000000003, 2024-04-26T12:27:31.590 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.590 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:31.590 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.590 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.590 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.591 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:31.591 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.591 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.591 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.591 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.591 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:31.591 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.591 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.591 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.591 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.591 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254171+0000", 2024-04-26T12:27:31.591 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:31.591 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.591 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.592 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.592 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254178+0000", 2024-04-26T12:27:31.592 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7710000000000001e-06 2024-04-26T12:27:31.592 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.592 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.592 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.592 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254185+0000", 2024-04-26T12:27:31.592 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6249999999999998e-06 2024-04-26T12:27:31.592 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.592 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.592 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.592 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254203+0000", 2024-04-26T12:27:31.592 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8003999999999999e-05 2024-04-26T12:27:31.592 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254408+0000", 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020469100000000001 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254525+0000", 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000116319 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262919+0000", 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083942440000000004 2024-04-26T12:27:31.593 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.594 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.594 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.594 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.594 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.594 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:18 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:31.594 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:31.594 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.276808928000001, 2024-04-26T12:27:31.594 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016521190000000001, 2024-04-26T12:27:31.594 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.594 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:31.594 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.594 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.594 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.595 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:31.595 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.595 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.595 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.595 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.595 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:31.595 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.595 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.595 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.595 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.595 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:31.595 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:31.595 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.595 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261387+0000", 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4880000000000004e-06 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261396+0000", 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2209999999999997e-06 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261414+0000", 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8386e-05 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.596 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.597 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.597 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261460+0000", 2024-04-26T12:27:31.597 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6029999999999998e-05 2024-04-26T12:27:31.597 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.597 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.597 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.597 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261516+0000", 2024-04-26T12:27:31.597 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6418000000000001e-05 2024-04-26T12:27:31.597 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.597 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.597 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:31.597 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263008+0000", 2024-04-26T12:27:31.597 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0014912910000000001 2024-04-26T12:27:31.597 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.598 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.598 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.598 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263033+0000", 2024-04-26T12:27:31.598 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5763e-05 2024-04-26T12:27:31.598 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.598 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.598 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.598 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.598 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.598 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:28 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:31.598 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:31.598 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.276604231, 2024-04-26T12:27:31.598 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001530869, 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.599 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.600 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:31.600 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:31.600 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.600 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.600 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.600 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261597+0000", 2024-04-26T12:27:31.600 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1344e-05 2024-04-26T12:27:31.600 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.600 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.600 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.600 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261605+0000", 2024-04-26T12:27:31.600 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9039999999999992e-06 2024-04-26T12:27:31.600 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.600 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.601 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.601 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261612+0000", 2024-04-26T12:27:31.601 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8580000000000002e-06 2024-04-26T12:27:31.601 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.601 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.601 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.601 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261886+0000", 2024-04-26T12:27:31.601 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027415399999999998 2024-04-26T12:27:31.601 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.601 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.601 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.601 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261905+0000", 2024-04-26T12:27:31.601 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8898000000000001e-05 2024-04-26T12:27:31.601 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263093+0000", 2024-04-26T12:27:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011877490000000001 2024-04-26T12:27:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263117+0000", 2024-04-26T12:27:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4338999999999999e-05 2024-04-26T12:27:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing_reply(3.b epoch 15/13 rep_tid 4 lcod 15'2)", 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.275917296000003, 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020538300000000001, 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.603 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:31.604 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.604 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.604 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.604 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.604 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262272+0000", 2024-04-26T12:27:31.604 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:31.604 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.604 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.604 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.604 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262277+0000", 2024-04-26T12:27:31.604 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9169999999999997e-06 2024-04-26T12:27:31.604 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.604 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.604 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262287+0000", 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0237e-05 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262297+0000", 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3219999999999999e-06 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262382+0000", 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4969999999999995e-05 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.605 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262478+0000", 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6704000000000001e-05 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e15/13 ondisk, result = 0)", 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.275472759000003, 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027471, 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.607 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.607 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.607 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:31.607 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.607 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.607 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.607 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.607 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:31.607 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.607 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.607 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.607 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.607 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:31.607 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262720+0000", 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4509999999999999e-06 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262726+0000", 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8599999999999998e-06 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262732+0000", 2024-04-26T12:27:31.608 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5889999999999999e-06 2024-04-26T12:27:31.609 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.609 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.609 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.609 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262882+0000", 2024-04-26T12:27:31.609 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014968800000000001 2024-04-26T12:27:31.609 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.609 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.609 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.609 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262890+0000", 2024-04-26T12:27:31.609 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9279999999999993e-06 2024-04-26T12:27:31.609 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.609 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.609 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.610 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262992+0000", 2024-04-26T12:27:31.610 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010247300000000001 2024-04-26T12:27:31.610 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.610 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.610 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.610 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.610 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.610 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:31.610 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:31.611 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.273800199999997, 2024-04-26T12:27:31.611 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021676200000000001, 2024-04-26T12:27:31.611 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.611 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:31.611 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.611 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.611 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.611 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:31.611 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.611 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.611 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.611 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.611 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:31.611 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.612 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.612 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.612 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.612 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:31.612 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:31.612 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.612 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.612 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.612 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264404+0000", 2024-04-26T12:27:31.612 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3998999999999999e-05 2024-04-26T12:27:31.612 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.612 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.613 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.613 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264411+0000", 2024-04-26T12:27:31.613 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:27:31.613 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.613 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.613 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.613 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264424+0000", 2024-04-26T12:27:31.613 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2843999999999999e-05 2024-04-26T12:27:31.613 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.613 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.613 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.614 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264485+0000", 2024-04-26T12:27:31.614 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0464000000000002e-05 2024-04-26T12:27:31.614 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.614 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.614 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.614 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264493+0000", 2024-04-26T12:27:31.614 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.507e-06 2024-04-26T12:27:31.614 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.614 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.614 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.614 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264607+0000", 2024-04-26T12:27:31.615 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000113591 2024-04-26T12:27:31.615 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.615 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.615 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.615 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.615 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.615 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:21 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:31.615 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:31.615 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.273760473000003, 2024-04-26T12:27:31.615 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00037041599999999999, 2024-04-26T12:27:31.616 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.616 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:31.616 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.616 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.616 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.616 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:31.616 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.616 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.616 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.616 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.617 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:31.617 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.617 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.617 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.617 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.617 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264429+0000", 2024-04-26T12:27:31.617 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:31.617 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.617 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.617 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.617 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264432+0000", 2024-04-26T12:27:31.617 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0770000000000002e-06 2024-04-26T12:27:31.618 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.618 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.618 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.618 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264435+0000", 2024-04-26T12:27:31.618 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8340000000000001e-06 2024-04-26T12:27:31.618 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.618 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.618 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.618 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264438+0000", 2024-04-26T12:27:31.618 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5280000000000002e-06 2024-04-26T12:27:31.619 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.619 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.619 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.619 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264703+0000", 2024-04-26T12:27:31.619 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026548400000000002 2024-04-26T12:27:31.619 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.619 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.619 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.619 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264709+0000", 2024-04-26T12:27:31.619 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8390000000000003e-06 2024-04-26T12:27:31.619 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.619 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.620 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.620 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264800+0000", 2024-04-26T12:27:31.620 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0931000000000001e-05 2024-04-26T12:27:31.620 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.620 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.620 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.620 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.620 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.620 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:31.620 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:31.620 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.272954572000003, 2024-04-26T12:27:31.621 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016589860000000001, 2024-04-26T12:27:31.621 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.621 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:31.621 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.621 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.621 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.621 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:31.621 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.621 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.621 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.622 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.622 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:31.622 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.622 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.622 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.622 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.622 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265235+0000", 2024-04-26T12:27:31.622 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:31.622 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.622 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.623 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.623 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265252+0000", 2024-04-26T12:27:31.623 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6307000000000002e-05 2024-04-26T12:27:31.623 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.623 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.623 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.623 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265257+0000", 2024-04-26T12:27:31.623 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8279999999999999e-06 2024-04-26T12:27:31.623 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.623 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.623 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.624 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265263+0000", 2024-04-26T12:27:31.624 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9399999999999999e-06 2024-04-26T12:27:31.624 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.624 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.624 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.624 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265300+0000", 2024-04-26T12:27:31.624 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6315e-05 2024-04-26T12:27:31.624 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.624 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.624 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.624 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265312+0000", 2024-04-26T12:27:31.624 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2451e-05 2024-04-26T12:27:31.624 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266864+0000", 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015521090000000001 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266895+0000", 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0426e-05 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.625 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:22 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:31.626 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:31.626 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.272833832000003, 2024-04-26T12:27:31.626 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021988139999999999, 2024-04-26T12:27:31.626 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.626 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:31.626 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.626 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.626 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.626 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:31.626 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.626 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.626 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.626 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.626 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:31.627 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.627 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.627 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.627 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.627 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:31.627 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967296 2024-04-26T12:27:31.627 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.627 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.627 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.627 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265361+0000", 2024-04-26T12:27:31.627 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6979999999999997e-06 2024-04-26T12:27:31.627 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.627 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.627 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.628 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265366+0000", 2024-04-26T12:27:31.628 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6550000000000003e-06 2024-04-26T12:27:31.628 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.628 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.628 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.628 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265379+0000", 2024-04-26T12:27:31.628 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.358e-05 2024-04-26T12:27:31.628 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.628 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.628 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.628 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265535+0000", 2024-04-26T12:27:31.628 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015586800000000001 2024-04-26T12:27:31.628 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265556+0000", 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1202000000000001e-05 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267528+0000", 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0019722099999999998 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267555+0000", 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6775999999999999e-05 2024-04-26T12:27:31.629 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.630 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.630 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.630 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-26T12:27:31.630 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:31.630 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 33.627815660000003, 2024-04-26T12:27:31.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020315099999999998, 2024-04-26T12:27:31.630 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.630 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:31.630 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.630 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.630 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910372+0000", 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.631 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910387+0000", 2024-04-26T12:27:31.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5252999999999999e-05 2024-04-26T12:27:31.632 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.632 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.632 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.632 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910418+0000", 2024-04-26T12:27:31.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0778999999999998e-05 2024-04-26T12:27:31.632 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.632 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.632 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.632 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910437+0000", 2024-04-26T12:27:31.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9619999999999998e-05 2024-04-26T12:27:31.632 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.632 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.632 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.633 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910587+0000", 2024-04-26T12:27:31.633 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014922000000000001 2024-04-26T12:27:31.633 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.633 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.633 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.633 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910837+0000", 2024-04-26T12:27:31.633 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025089099999999999 2024-04-26T12:27:31.633 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.633 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.633 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:31.633 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910973+0000", 2024-04-26T12:27:31.633 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000135124 2024-04-26T12:27:31.633 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.633 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.911616+0000", 2024-04-26T12:27:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00064392799999999999 2024-04-26T12:27:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912341+0000", 2024-04-26T12:27:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00072415700000000001 2024-04-26T12:27:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912379+0000", 2024-04-26T12:27:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8724999999999999e-05 2024-04-26T12:27:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912406+0000", 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6752999999999999e-05 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 8.6271474480000006, 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0013630599999999999, 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:31.635 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:31.636 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:31.636 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.636 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:31.636 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:31.636 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.636 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.636 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.636 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:31.636 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:31.636 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:31.636 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.636 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.636 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:31.636 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911041+0000", 2024-04-26T12:27:31.637 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999976 2024-04-26T12:27:31.637 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.637 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.637 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:31.637 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911057+0000", 2024-04-26T12:27:31.637 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6549999999999999e-05 2024-04-26T12:27:31.637 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.637 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.637 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:31.637 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911088+0000", 2024-04-26T12:27:31.637 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0753000000000002e-05 2024-04-26T12:27:31.637 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.637 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911107+0000", 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9425000000000001e-05 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911258+0000", 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000150252 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911379+0000", 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012129900000000001 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.638 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.639 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:31.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911529+0000", 2024-04-26T12:27:31.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015010699999999999 2024-04-26T12:27:31.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.639 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:31.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912214+0000", 2024-04-26T12:27:31.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00068528199999999995 2024-04-26T12:27:31.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.639 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:31.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912343+0000", 2024-04-26T12:27:31.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012858800000000001 2024-04-26T12:27:31.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.640 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.640 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:31.640 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912378+0000", 2024-04-26T12:27:31.640 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5420000000000003e-05 2024-04-26T12:27:31.640 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:31.640 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:31.640 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:31.640 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912406+0000", 2024-04-26T12:27:31.640 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7594e-05 2024-04-26T12:27:31.640 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.640 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.640 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.640 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:31.640 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:31.641 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:31.642 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:31.641+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:31.642 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:31.743 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:31.743+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:31.782 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:31.782 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:31.782 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:31.782 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:31.792 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:31.844 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:31.843+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:31.917 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:31.917 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:31.918 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:31.918 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:31.928 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:31.946 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:31.944+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:32.046 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:32.046+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:32.056 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.172199763999998, 2024-04-26T12:27:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.056 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:32.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:32.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:32.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:32.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:32.060 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.060 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.061 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.061 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:32.061 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:32.061 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.171560417000002, 2024-04-26T12:27:32.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:32.061 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.061 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.061 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:32.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:32.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:32.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:32.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.041858226999999, 2024-04-26T12:27:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:32.065 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:32.069 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.041363640999997, 2024-04-26T12:27:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:32.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.039361456999998, 2024-04-26T12:27:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:32.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.038955117, 2024-04-26T12:27:32.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:32.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.038600293000002, 2024-04-26T12:27:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:32.084 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:32.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:32.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.936041879000001, 2024-04-26T12:27:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:32.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:32.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.093 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.935645350999998, 2024-04-26T12:27:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:32.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.838635742999998, 2024-04-26T12:27:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:32.098 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:32.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.102 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.837942026999997, 2024-04-26T12:27:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:32.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:32.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.803202972000001, 2024-04-26T12:27:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:32.107 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:32.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:32.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:32.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.802382053000002, 2024-04-26T12:27:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:32.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:32.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.802351963, 2024-04-26T12:27:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:32.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:32.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.802298174999997, 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:32.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:32.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.802245618000001, 2024-04-26T12:27:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:32.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:32.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.802205403999999, 2024-04-26T12:27:32.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:32.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:32.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:32.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:32.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:32.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:32.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:32.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:32.140 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.140 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.140 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.141 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.141 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:32.141 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.802177243000003, 2024-04-26T12:27:32.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:32.141 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.141 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.141 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:32.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:32.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:32.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:32.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:32.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:32.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.146 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.802146553999997, 2024-04-26T12:27:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:32.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.150 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.802119980999997, 2024-04-26T12:27:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:32.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.154 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:32.155 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:32.155 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:32.156 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:32.155+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:32.157 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:32.256 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:32.255+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:32.296 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:32.296 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:32.296 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:32.296 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:32.306 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:32.390 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:32.389+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:32.458 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:32.458+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:32.473 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:32.473 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:32.473 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:32.473 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:32.473 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:32.483 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:32.560 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:32.559+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:32.644 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:27:32.651 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:32.651 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:32.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:32.651 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:32.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.652 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:32.652 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:32.652 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 45.318550395000003, 2024-04-26T12:27:32.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:32.652 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.652 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.652 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:32.652 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:32.652 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:32.652 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:32.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.652 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:32.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:32.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:32.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:32.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:32.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:32.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:32.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:32.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:32.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:32.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:32.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:32.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:32.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:32.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:32.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:32.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:32.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:32.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:32.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:32.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:32.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:32.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:32.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.658 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.658 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.658 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:32.658 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399684571999998, 2024-04-26T12:27:32.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:32.658 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.658 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.658 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:32.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:32.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:32.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:32.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:32.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:32.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:32.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:32.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:32.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:32.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:32.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:32.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:32.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:32.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:32.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:32.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:32.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:32.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:32.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:32.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:32.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:32.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:32.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:32.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:32.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:32.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:32.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:32.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:32.664 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.664 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.664 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.665 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.665 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:32.665 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.39964836, 2024-04-26T12:27:32.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:32.665 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.666 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.666 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:32.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:32.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:32.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:32.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:32.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:32.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:32.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:32.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:32.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:32.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:32.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:32.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:32.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:32.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:32.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:32.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:32.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:32.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:32.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:32.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:32.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:32.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:32.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:32.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:32.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:32.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:32.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:32.672 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.672 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.672 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.672 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.672 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:32.672 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399609386000002, 2024-04-26T12:27:32.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:32.672 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.672 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.672 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:32.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:32.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:32.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:32.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:32.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:32.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:32.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:32.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:32.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:32.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.676 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:32.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:32.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.676 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:32.676 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:32.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:32.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.676 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:32.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:32.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:32.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:32.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:32.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:32.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:32.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:32.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:32.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:32.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:32.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:32.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:32.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:32.679 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.679 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.679 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.680 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.680 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:32.680 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399586219, 2024-04-26T12:27:32.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:32.680 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.680 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.680 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:32.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:32.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:32.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:32.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:32.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:32.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:32.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:32.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:32.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:32.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:32.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:32.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:32.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:32.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:32.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:32.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:32.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:32.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:32.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:32.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:32.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:32.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:32.686 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.686 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.686 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.687 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.687 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:32.687 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399570842000003, 2024-04-26T12:27:32.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:32.687 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.687 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.687 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:32.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:32.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:32.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:32.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:32.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:32.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:32.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:32.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:32.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:32.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:32.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:32.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:32.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:32.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:32.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:32.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:32.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:32.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:32.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:32.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:32.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:32.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:32.694 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.694 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.694 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.694 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.694 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:32.694 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399542652000001, 2024-04-26T12:27:32.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:32.694 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.694 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.694 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:32.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:32.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:32.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:32.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:32.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:32.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:32.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:32.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:32.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:32.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:32.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:32.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:32.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:32.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:32.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:32.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:32.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:32.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:32.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:32.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:32.701 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.701 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.701 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.701 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.701 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:32.701 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399524653999997, 2024-04-26T12:27:32.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:32.701 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.701 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.701 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:32.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:32.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:32.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:32.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:32.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:32.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:32.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:32.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:32.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:32.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:32.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:32.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:32.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:32.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:32.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:32.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:32.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:32.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:32.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:32.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:32.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:32.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:32.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:32.707 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.707 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.707 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.707 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.707 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:32.707 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399500062999998, 2024-04-26T12:27:32.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:32.707 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:32.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:32.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:32.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:32.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:32.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:32.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:32.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:32.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:32.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:32.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:32.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:32.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:32.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:32.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:32.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:32.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:32.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:32.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:32.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:32.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:32.713 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.713 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.713 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.713 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.713 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:32.713 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399475113999998, 2024-04-26T12:27:32.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:32.714 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.714 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.714 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:32.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:32.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:32.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:32.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:32.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:32.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:32.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:32.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:32.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:32.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:32.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:32.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:32.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:32.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:32.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:32.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:32.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:32.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:32.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:32.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:32.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:32.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:32.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:32.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:32.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:32.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:32.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:32.719 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.719 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.39945419, 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:32.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:32.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:32.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:32.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:32.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:32.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:32.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:32.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:32.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:32.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:32.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:32.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:32.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:32.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:32.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:32.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:32.725 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.726 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.726 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.726 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.726 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:32.726 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399419340999998, 2024-04-26T12:27:32.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:32.726 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.726 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.726 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:32.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:32.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:32.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:32.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:32.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:32.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:32.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:32.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:32.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:32.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:32.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:32.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:32.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:32.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:32.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:32.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:32.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.732 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.732 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.732 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:32.732 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399385391000003, 2024-04-26T12:27:32.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:32.732 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.732 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.732 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:32.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:32.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:32.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:32.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:32.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:32.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:32.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:32.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:32.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:32.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:32.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:32.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:32.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:32.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:32.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:32.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:32.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:32.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:32.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:32.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:32.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:32.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:32.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.738 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.738 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.738 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:32.738 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399365093999997, 2024-04-26T12:27:32.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:32.738 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.738 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.738 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:32.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:32.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:32.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:32.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:32.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:32.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:32.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:32.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:32.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:32.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:32.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:32.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:32.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:32.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:32.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:32.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:32.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:32.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:32.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:32.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:32.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:32.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:32.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:32.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:32.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:32.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:32.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:32.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:32.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.744 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.744 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.744 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:32.744 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399329973, 2024-04-26T12:27:32.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:32.744 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.745 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.745 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:32.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:32.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:32.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:32.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:32.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:32.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:32.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:32.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:32.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:32.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:32.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:32.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:32.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:32.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:32.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:32.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399294732999998, 2024-04-26T12:27:32.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:32.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:32.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:32.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:32.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:32.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:32.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:32.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:32.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:32.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:32.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:32.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:32.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:32.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:32.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:32.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:32.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:32.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:32.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:32.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:32.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:32.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:32.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:32.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:32.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:32.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:32.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:32.756 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.756 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.756 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.756 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.757 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:32.757 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399152985000001, 2024-04-26T12:27:32.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:32.757 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.757 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.757 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:32.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:32.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:32.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:32.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:32.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:32.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:32.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:32.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:32.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:32.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:32.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:32.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:32.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:32.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:32.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:32.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:32.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:32.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:32.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:32.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:32.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:32.762 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.763 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.763 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.763 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.763 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:32.763 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399128965999999, 2024-04-26T12:27:32.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:32.763 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.763 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.763 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:32.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:32.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:32.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:32.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:32.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:32.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:32.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:32.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:32.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:32.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:32.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:32.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:32.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:32.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:32.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:32.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:32.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:32.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:32.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:32.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:32.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:32.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:32.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.769 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.769 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.769 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:32.769 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399104997999999, 2024-04-26T12:27:32.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:27:32.769 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.769 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:32.769 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:32.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:32.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:27:32.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:27:32.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:27:32.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:27:32.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:27:32.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:27:32.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:27:32.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:27:32.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:27:32.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:32.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:27:32.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:27:32.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:32.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:27:32.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:27:32.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:32.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:27:32.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:27:32.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:32.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:27:32.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:27:32.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:27:32.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:27:32.775 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.775 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.775 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.776 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:32.776 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:32.776 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.399071616999997, 2024-04-26T12:27:32.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:27:32.776 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:32.776 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:27:32.776 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:32.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:32.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:32.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:32.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:32.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:32.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:32.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:32.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:32.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:32.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:27:32.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:27:32.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:32.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:27:32.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:27:32.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:32.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:27:32.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:27:32.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:27:32.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:27:32.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:32.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:27:32.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:27:32.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:32.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:27:32.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:27:32.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:32.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:27:32.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:27:32.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:32.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:32.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:32.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:27:32.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:27:32.780 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.780 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.780 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.780 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:32.780 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:32.780 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:32.782 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:32.782 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:32.780+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:32.882 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:32.882+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:32.922 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:32.922 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:32.922 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T12:27:32.922 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:32.932 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:33.016 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:33.016+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:33.032 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:27:33.032 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:27:33.032 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-26T12:27:33.032 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 1.000000 2024-04-26T12:27:33.032 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T12:27:33.084 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:33.084+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:33.100 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:33.100 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:33.100 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T12:27:33.100 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T12:27:33.100 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:33.109 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:33.193 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:33.193+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:33.278 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:33.279 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T12:27:33.279 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T12:27:33.279 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T12:27:33.279 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.279 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 3 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:27:33.279 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:33.279 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.023646714999998, 2024-04-26T12:27:33.279 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0048986250000000002, 2024-04-26T12:27:33.279 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.279 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:33.279 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.279 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.280 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.280 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:33.280 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.280 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.280 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.280 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.280 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:33.280 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.280 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.280 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.280 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.280 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:33.280 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:33.280 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.281 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.281 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.281 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253094+0000", 2024-04-26T12:27:33.281 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0924000000000001e-05 2024-04-26T12:27:33.281 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.281 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.281 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.281 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253109+0000", 2024-04-26T12:27:33.281 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4982e-05 2024-04-26T12:27:33.281 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.281 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.282 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.282 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253127+0000", 2024-04-26T12:27:33.282 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8586000000000001e-05 2024-04-26T12:27:33.282 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.282 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.282 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.282 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253214+0000", 2024-04-26T12:27:33.282 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6234000000000001e-05 2024-04-26T12:27:33.282 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.282 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.283 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.283 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257982+0000", 2024-04-26T12:27:33.283 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0047682150000000001 2024-04-26T12:27:33.283 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.283 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.283 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.283 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.283 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.283 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:33.283 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:33.283 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.023203555999999, 2024-04-26T12:27:33.283 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010912543, 2024-04-26T12:27:33.283 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.283 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:33.284 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.284 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.284 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.284 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:33.284 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.284 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.284 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.284 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.284 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:33.284 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.284 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.284 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.284 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.284 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253521+0000", 2024-04-26T12:27:33.285 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999943 2024-04-26T12:27:33.285 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.285 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.285 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253542+0000", 2024-04-26T12:27:33.285 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1061999999999999e-05 2024-04-26T12:27:33.285 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.285 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.285 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253606+0000", 2024-04-26T12:27:33.285 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4012999999999999e-05 2024-04-26T12:27:33.285 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.285 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.286 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.286 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253619+0000", 2024-04-26T12:27:33.286 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3091999999999999e-05 2024-04-26T12:27:33.286 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.286 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.286 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.286 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:33.286 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013321599999999999 2024-04-26T12:27:33.286 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.286 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.286 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.286 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253923+0000", 2024-04-26T12:27:33.286 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017127900000000001 2024-04-26T12:27:33.287 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.287 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.287 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:33.287 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254085+0000", 2024-04-26T12:27:33.287 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000161566 2024-04-26T12:27:33.287 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.287 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.287 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:33.287 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257500+0000", 2024-04-26T12:27:33.287 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034156880000000001 2024-04-26T12:27:33.287 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.287 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.287 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:33.287 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264372+0000", 2024-04-26T12:27:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068719760000000001 2024-04-26T12:27:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264402+0000", 2024-04-26T12:27:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9128e-05 2024-04-26T12:27:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264439+0000", 2024-04-26T12:27:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7251e-05 2024-04-26T12:27:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.023094454000002, 2024-04-26T12:27:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010957691, 2024-04-26T12:27:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.289 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.290 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.290 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:33.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.290 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.290 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.290 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:33.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:33.290 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.290 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.290 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253639+0000", 2024-04-26T12:27:33.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253648+0000", 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253655+0000", 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8909999999999998e-06 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254807+0000", 2024-04-26T12:27:33.291 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001151712 2024-04-26T12:27:33.292 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.292 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.292 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.292 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255417+0000", 2024-04-26T12:27:33.292 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00061023000000000002 2024-04-26T12:27:33.292 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.292 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.292 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:33.292 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255573+0000", 2024-04-26T12:27:33.292 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015571399999999999 2024-04-26T12:27:33.292 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.292 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.292 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:33.292 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260113+0000", 2024-04-26T12:27:33.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045405519999999998 2024-04-26T12:27:33.293 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.293 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:33.293 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264499+0000", 2024-04-26T12:27:33.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043857050000000002 2024-04-26T12:27:33.293 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.293 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:33.293 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264552+0000", 2024-04-26T12:27:33.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2602000000000002e-05 2024-04-26T12:27:33.293 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264593+0000", 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1341000000000003e-05 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.023069048000004, 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091815760000000003, 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:33.294 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.295 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.295 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.295 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:33.295 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.295 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.295 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.295 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.295 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:33.295 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.295 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.295 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.295 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.295 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253660+0000", 2024-04-26T12:27:33.295 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253664+0000", 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253679+0000", 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4208e-05 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253685+0000", 2024-04-26T12:27:33.296 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254897+0000", 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001211801 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255009+0000", 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011189 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255142+0000", 2024-04-26T12:27:33.297 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013265799999999999 2024-04-26T12:27:33.298 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.298 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.298 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:33.298 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.259665+0000", 2024-04-26T12:27:33.298 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004523862 2024-04-26T12:27:33.298 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.298 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.298 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:33.298 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262759+0000", 2024-04-26T12:27:33.298 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003093391 2024-04-26T12:27:33.298 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.298 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.298 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:33.298 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262805+0000", 2024-04-26T12:27:33.299 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6399000000000001e-05 2024-04-26T12:27:33.299 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.299 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.299 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.299 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262842+0000", 2024-04-26T12:27:33.299 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7184000000000002e-05 2024-04-26T12:27:33.299 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.299 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.299 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.299 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.299 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.299 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:33.299 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:33.299 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.023039138000001, 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092939230000000008, 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.300 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253690+0000", 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253695+0000", 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6090000000000003e-06 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253705+0000", 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0326000000000001e-05 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.302 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.302 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253714+0000", 2024-04-26T12:27:33.302 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:27:33.302 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.302 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.302 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.302 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256115+0000", 2024-04-26T12:27:33.302 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024015450000000002 2024-04-26T12:27:33.302 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.302 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.302 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.302 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256215+0000", 2024-04-26T12:27:33.302 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010016700000000001 2024-04-26T12:27:33.302 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256368+0000", 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015244999999999999 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260313+0000", 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00394481 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262895+0000", 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0025824670000000002 2024-04-26T12:27:33.303 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.304 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.304 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:33.304 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262946+0000", 2024-04-26T12:27:33.304 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1072999999999997e-05 2024-04-26T12:27:33.304 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.304 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.304 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.304 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262985+0000", 2024-04-26T12:27:33.304 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8529000000000003e-05 2024-04-26T12:27:33.304 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.304 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.304 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.304 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.305 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.305 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:33.305 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:33.305 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.023009776999999, 2024-04-26T12:27:33.305 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011070178999999999, 2024-04-26T12:27:33.305 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.305 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:33.305 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.305 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.305 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.305 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:33.305 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.305 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.305 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.306 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.306 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:33.306 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.306 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.306 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.306 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.306 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:33.306 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:33.306 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.306 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.306 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.306 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253724+0000", 2024-04-26T12:27:33.307 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0890000000000002e-06 2024-04-26T12:27:33.307 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.307 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.307 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253736+0000", 2024-04-26T12:27:33.307 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2252999999999999e-05 2024-04-26T12:27:33.307 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.307 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.307 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253742+0000", 2024-04-26T12:27:33.307 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9499999999999998e-06 2024-04-26T12:27:33.307 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.307 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256230+0000", 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002488114 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256421+0000", 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019087999999999999 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256583+0000", 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000162566 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.308 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:33.309 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260316+0000", 2024-04-26T12:27:33.309 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037329239999999999 2024-04-26T12:27:33.309 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.309 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.309 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:33.309 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264713+0000", 2024-04-26T12:27:33.309 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043968380000000001 2024-04-26T12:27:33.309 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.309 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.309 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:33.309 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:33.309 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1124000000000001e-05 2024-04-26T12:27:33.309 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.309 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264790+0000", 2024-04-26T12:27:33.310 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5923999999999997e-05 2024-04-26T12:27:33.310 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.310 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.310 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.310 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.310 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.310 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:33.310 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:33.310 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.022977961000002, 2024-04-26T12:27:33.310 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0086059009999999991, 2024-04-26T12:27:33.310 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.311 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253751+0000", 2024-04-26T12:27:33.312 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:33.312 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.312 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.312 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.312 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253756+0000", 2024-04-26T12:27:33.312 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9740000000000001e-06 2024-04-26T12:27:33.312 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.312 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.312 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.312 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253762+0000", 2024-04-26T12:27:33.312 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9769999999999997e-06 2024-04-26T12:27:33.312 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.312 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.313 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.313 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253767+0000", 2024-04-26T12:27:33.313 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:27:33.313 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.313 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.313 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.313 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254160+0000", 2024-04-26T12:27:33.313 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039256700000000002 2024-04-26T12:27:33.313 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.313 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.313 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.313 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254292+0000", 2024-04-26T12:27:33.313 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013190399999999999 2024-04-26T12:27:33.313 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254453+0000", 2024-04-26T12:27:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000160982 2024-04-26T12:27:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257354+0000", 2024-04-26T12:27:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029008229999999999 2024-04-26T12:27:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262281+0000", 2024-04-26T12:27:33.314 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049274760000000001 2024-04-26T12:27:33.315 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.315 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.315 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:33.315 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262323+0000", 2024-04-26T12:27:33.315 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.189e-05 2024-04-26T12:27:33.315 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.315 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.315 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.315 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262358+0000", 2024-04-26T12:27:33.315 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4826000000000002e-05 2024-04-26T12:27:33.315 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.315 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.315 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.315 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.316 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.316 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:32 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:33.316 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:33.316 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.022621909000001, 2024-04-26T12:27:33.316 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083641310000000003, 2024-04-26T12:27:33.316 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.316 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:33.316 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.316 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.316 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.316 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:33.316 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.316 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254107+0000", 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254113+0000", 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:27:33.317 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.318 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.318 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.318 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254122+0000", 2024-04-26T12:27:33.318 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.149e-06 2024-04-26T12:27:33.318 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.318 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.318 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.318 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254131+0000", 2024-04-26T12:27:33.318 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5609999999999999e-06 2024-04-26T12:27:33.318 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.318 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.318 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.318 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255227+0000", 2024-04-26T12:27:33.318 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010961 2024-04-26T12:27:33.319 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.319 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.319 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.319 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255355+0000", 2024-04-26T12:27:33.319 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012883299999999999 2024-04-26T12:27:33.319 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.319 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.319 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.319 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262472+0000", 2024-04-26T12:27:33.319 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071165949999999999 2024-04-26T12:27:33.319 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.319 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.320 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.320 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.320 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.320 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:33 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:33.320 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:33.320 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.022593784999998, 2024-04-26T12:27:33.320 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012698262, 2024-04-26T12:27:33.320 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.320 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:33.320 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.320 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.320 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.320 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:33.320 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254138+0000", 2024-04-26T12:27:33.321 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2460000000000002e-06 2024-04-26T12:27:33.322 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.322 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.322 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.322 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254145+0000", 2024-04-26T12:27:33.322 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7070000000000003e-06 2024-04-26T12:27:33.322 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.322 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.322 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.322 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254164+0000", 2024-04-26T12:27:33.322 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9604999999999999e-05 2024-04-26T12:27:33.322 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.322 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.322 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257574+0000", 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034098980000000002 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257731+0000", 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015735400000000001 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266834+0000", 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091028099999999994 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.323 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.022558046, 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0087469690000000003, 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.324 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254171+0000", 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254178+0000", 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7710000000000001e-06 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.325 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.326 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.326 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254185+0000", 2024-04-26T12:27:33.326 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6249999999999998e-06 2024-04-26T12:27:33.326 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.326 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.326 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.326 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254203+0000", 2024-04-26T12:27:33.326 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8003999999999999e-05 2024-04-26T12:27:33.326 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.326 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.326 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.326 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254408+0000", 2024-04-26T12:27:33.326 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020469100000000001 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254525+0000", 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000116319 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262919+0000", 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083942440000000004 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.327 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.328 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:18 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:33.328 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:33.328 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.015348508999999, 2024-04-26T12:27:33.328 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016521190000000001, 2024-04-26T12:27:33.328 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.328 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:33.328 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.328 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.328 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.328 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:33.328 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.328 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.328 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.328 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261387+0000", 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4880000000000004e-06 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.329 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.330 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261396+0000", 2024-04-26T12:27:33.330 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2209999999999997e-06 2024-04-26T12:27:33.330 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.330 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.330 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.330 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261414+0000", 2024-04-26T12:27:33.330 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8386e-05 2024-04-26T12:27:33.330 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.330 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.330 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.330 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261460+0000", 2024-04-26T12:27:33.330 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6029999999999998e-05 2024-04-26T12:27:33.330 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261516+0000", 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6418000000000001e-05 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263008+0000", 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0014912910000000001 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263033+0000", 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5763e-05 2024-04-26T12:27:33.331 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.332 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.332 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.332 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.332 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.332 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:28 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:33.332 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:33.332 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.015143811999998, 2024-04-26T12:27:33.332 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001530869, 2024-04-26T12:27:33.332 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.332 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:33.332 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.332 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.332 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.332 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261597+0000", 2024-04-26T12:27:33.334 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1344e-05 2024-04-26T12:27:33.334 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.334 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.334 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.334 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261605+0000", 2024-04-26T12:27:33.334 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9039999999999992e-06 2024-04-26T12:27:33.334 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.334 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.334 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.334 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261612+0000", 2024-04-26T12:27:33.334 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8580000000000002e-06 2024-04-26T12:27:33.334 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.335 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.335 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.335 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261886+0000", 2024-04-26T12:27:33.335 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027415399999999998 2024-04-26T12:27:33.335 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.335 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.335 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.335 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261905+0000", 2024-04-26T12:27:33.335 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8898000000000001e-05 2024-04-26T12:27:33.335 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.335 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.335 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:33.335 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263093+0000", 2024-04-26T12:27:33.335 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011877490000000001 2024-04-26T12:27:33.336 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.336 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.336 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.336 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263117+0000", 2024-04-26T12:27:33.336 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4338999999999999e-05 2024-04-26T12:27:33.336 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.336 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.336 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.336 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.336 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.336 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing_reply(3.b epoch 15/13 rep_tid 4 lcod 15'2)", 2024-04-26T12:27:33.336 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:33.336 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.014456877000001, 2024-04-26T12:27:33.336 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020538300000000001, 2024-04-26T12:27:33.337 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.337 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:33.337 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.337 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.337 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.337 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:33.337 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.337 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.337 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.337 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.337 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:33.337 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.337 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.338 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.338 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.338 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262272+0000", 2024-04-26T12:27:33.338 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:33.338 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.338 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.338 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.338 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262277+0000", 2024-04-26T12:27:33.338 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9169999999999997e-06 2024-04-26T12:27:33.338 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.338 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.338 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.338 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262287+0000", 2024-04-26T12:27:33.338 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0237e-05 2024-04-26T12:27:33.339 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.339 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.339 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.339 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262297+0000", 2024-04-26T12:27:33.339 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3219999999999999e-06 2024-04-26T12:27:33.339 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.339 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.339 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.339 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262382+0000", 2024-04-26T12:27:33.339 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4969999999999995e-05 2024-04-26T12:27:33.339 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.339 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.339 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.339 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262478+0000", 2024-04-26T12:27:33.340 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6704000000000001e-05 2024-04-26T12:27:33.340 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.340 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.340 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.340 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.340 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.340 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e15/13 ondisk, result = 0)", 2024-04-26T12:27:33.340 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:33.340 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.014012340000001, 2024-04-26T12:27:33.340 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027471, 2024-04-26T12:27:33.340 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.340 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:33.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:33.342 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262720+0000", 2024-04-26T12:27:33.342 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4509999999999999e-06 2024-04-26T12:27:33.342 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262726+0000", 2024-04-26T12:27:33.342 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8599999999999998e-06 2024-04-26T12:27:33.342 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262732+0000", 2024-04-26T12:27:33.343 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5889999999999999e-06 2024-04-26T12:27:33.343 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.343 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.343 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.343 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262882+0000", 2024-04-26T12:27:33.343 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014968800000000001 2024-04-26T12:27:33.343 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.343 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.343 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.343 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262890+0000", 2024-04-26T12:27:33.343 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9279999999999993e-06 2024-04-26T12:27:33.343 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.343 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.343 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.344 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262992+0000", 2024-04-26T12:27:33.344 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010247300000000001 2024-04-26T12:27:33.344 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.344 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.344 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.344 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.344 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.344 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:33.344 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:33.344 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.012339781000001, 2024-04-26T12:27:33.344 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021676200000000001, 2024-04-26T12:27:33.344 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.344 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.345 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264404+0000", 2024-04-26T12:27:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3998999999999999e-05 2024-04-26T12:27:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264411+0000", 2024-04-26T12:27:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:27:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.346 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264424+0000", 2024-04-26T12:27:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2843999999999999e-05 2024-04-26T12:27:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264485+0000", 2024-04-26T12:27:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0464000000000002e-05 2024-04-26T12:27:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264493+0000", 2024-04-26T12:27:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.507e-06 2024-04-26T12:27:33.347 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264607+0000", 2024-04-26T12:27:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000113591 2024-04-26T12:27:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:21 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.012300054000001, 2024-04-26T12:27:33.348 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00037041599999999999, 2024-04-26T12:27:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264429+0000", 2024-04-26T12:27:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264432+0000", 2024-04-26T12:27:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0770000000000002e-06 2024-04-26T12:27:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.350 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264435+0000", 2024-04-26T12:27:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8340000000000001e-06 2024-04-26T12:27:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264438+0000", 2024-04-26T12:27:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5280000000000002e-06 2024-04-26T12:27:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264703+0000", 2024-04-26T12:27:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026548400000000002 2024-04-26T12:27:33.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264709+0000", 2024-04-26T12:27:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8390000000000003e-06 2024-04-26T12:27:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264800+0000", 2024-04-26T12:27:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0931000000000001e-05 2024-04-26T12:27:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.352 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.011494153000001, 2024-04-26T12:27:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016589860000000001, 2024-04-26T12:27:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:33.353 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.354 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.354 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.354 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.354 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:33.354 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.354 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.354 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.354 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.354 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265235+0000", 2024-04-26T12:27:33.354 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:33.354 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.354 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.354 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.354 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265252+0000", 2024-04-26T12:27:33.355 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6307000000000002e-05 2024-04-26T12:27:33.355 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.355 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.355 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.355 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265257+0000", 2024-04-26T12:27:33.355 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8279999999999999e-06 2024-04-26T12:27:33.355 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.355 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.355 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.355 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265263+0000", 2024-04-26T12:27:33.355 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9399999999999999e-06 2024-04-26T12:27:33.355 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.355 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.356 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.356 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265300+0000", 2024-04-26T12:27:33.356 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6315e-05 2024-04-26T12:27:33.356 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.356 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.356 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.356 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265312+0000", 2024-04-26T12:27:33.356 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2451e-05 2024-04-26T12:27:33.356 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.356 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.356 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:33.356 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266864+0000", 2024-04-26T12:27:33.356 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015521090000000001 2024-04-26T12:27:33.356 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.357 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.357 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.357 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266895+0000", 2024-04-26T12:27:33.357 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0426e-05 2024-04-26T12:27:33.357 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.357 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.357 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.357 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.357 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.357 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:22 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:33.357 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:33.357 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 40.011373413000001, 2024-04-26T12:27:33.357 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021988139999999999, 2024-04-26T12:27:33.357 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:33.359 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967296 2024-04-26T12:27:33.359 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.359 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.361 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.361 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265361+0000", 2024-04-26T12:27:33.361 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6979999999999997e-06 2024-04-26T12:27:33.361 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.362 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.362 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.362 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265366+0000", 2024-04-26T12:27:33.362 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6550000000000003e-06 2024-04-26T12:27:33.362 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.362 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.362 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.362 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265379+0000", 2024-04-26T12:27:33.363 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.358e-05 2024-04-26T12:27:33.363 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.363 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.363 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.363 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265535+0000", 2024-04-26T12:27:33.363 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015586800000000001 2024-04-26T12:27:33.364 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.364 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.364 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.364 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265556+0000", 2024-04-26T12:27:33.364 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1202000000000001e-05 2024-04-26T12:27:33.364 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.364 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.364 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:33.364 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267528+0000", 2024-04-26T12:27:33.364 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0019722099999999998 2024-04-26T12:27:33.364 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.364 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.365 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.365 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267555+0000", 2024-04-26T12:27:33.365 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6775999999999999e-05 2024-04-26T12:27:33.365 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.365 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.365 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.365 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.365 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.365 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-26T12:27:33.365 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:33.365 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.366355241000001, 2024-04-26T12:27:33.365 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020315099999999998, 2024-04-26T12:27:33.365 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.365 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:33.366 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.366 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.366 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.366 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:33.366 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.366 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.366 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.366 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.366 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:33.366 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.366 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.366 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.366 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.367 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910372+0000", 2024-04-26T12:27:33.367 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-26T12:27:33.367 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.367 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.367 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.367 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910387+0000", 2024-04-26T12:27:33.367 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5252999999999999e-05 2024-04-26T12:27:33.367 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.367 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.367 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.367 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910418+0000", 2024-04-26T12:27:33.367 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0778999999999998e-05 2024-04-26T12:27:33.367 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.367 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.368 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.368 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910437+0000", 2024-04-26T12:27:33.368 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9619999999999998e-05 2024-04-26T12:27:33.368 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.368 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.368 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.368 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910587+0000", 2024-04-26T12:27:33.368 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014922000000000001 2024-04-26T12:27:33.368 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.368 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.368 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.368 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910837+0000", 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025089099999999999 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910973+0000", 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000135124 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.911616+0000", 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00064392799999999999 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:33.369 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912341+0000", 2024-04-26T12:27:33.370 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00072415700000000001 2024-04-26T12:27:33.370 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.370 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.370 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:33.370 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912379+0000", 2024-04-26T12:27:33.370 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8724999999999999e-05 2024-04-26T12:27:33.370 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.370 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.370 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.370 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912406+0000", 2024-04-26T12:27:33.370 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6752999999999999e-05 2024-04-26T12:27:33.370 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.370 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.371 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.371 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.371 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.371 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-26T12:27:33.371 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:33.371 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.365687029, 2024-04-26T12:27:33.371 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0013630599999999999, 2024-04-26T12:27:33.371 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:33.371 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:33.371 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:33.371 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.371 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:33.371 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:33.371 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.372 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.372 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.372 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:33.372 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:33.372 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:33.372 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.372 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.372 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:33.372 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911041+0000", 2024-04-26T12:27:33.372 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999976 2024-04-26T12:27:33.372 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.372 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.372 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:33.373 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911057+0000", 2024-04-26T12:27:33.373 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6549999999999999e-05 2024-04-26T12:27:33.373 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.373 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.373 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:33.373 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911088+0000", 2024-04-26T12:27:33.373 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0753000000000002e-05 2024-04-26T12:27:33.373 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.373 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.373 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:33.373 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911107+0000", 2024-04-26T12:27:33.373 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9425000000000001e-05 2024-04-26T12:27:33.373 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.373 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.374 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:33.374 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911258+0000", 2024-04-26T12:27:33.374 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000150252 2024-04-26T12:27:33.374 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.374 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.374 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:33.374 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911379+0000", 2024-04-26T12:27:33.374 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012129900000000001 2024-04-26T12:27:33.374 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.374 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.374 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:33.374 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911529+0000", 2024-04-26T12:27:33.374 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015010699999999999 2024-04-26T12:27:33.374 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912214+0000", 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00068528199999999995 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912343+0000", 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012858800000000001 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912378+0000", 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5420000000000003e-05 2024-04-26T12:27:33.375 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:33.376 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:33.376 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:33.376 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912406+0000", 2024-04-26T12:27:33.376 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7594e-05 2024-04-26T12:27:33.376 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.376 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.376 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.376 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:33.376 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:33.376 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:33.378 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:33.378 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:33.377+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:33.479 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:33.478+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:33.518 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:33.518 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:33.518 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:33.518 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:33.528 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:33.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:27:33.579 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:33.578+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:33.635 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2024-04-26T12:27:33.636 INFO:teuthology.orchestra.run.smithi046.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T12:27:33.680 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:33.680+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:33.692 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:33.696 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:33.696 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:33.696 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:33.696 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:33.696 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:33.706 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:33.711 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:33.731 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:33.732 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:33.732 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:33.733 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:33.780 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:33.779+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:33.832 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:33.832 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:33.842 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:33.886 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:33.885+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:33.981 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:33.982 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:33.983 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:33.983+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:33.993 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:34.084 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:34.083+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:34.160 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:34.160 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:34.170 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:34.211 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:34.210+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:34.286 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:34.286+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:34.337 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:34.337 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:34.347 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:34.393 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:34.392+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:34.488 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:34.487+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:34.488 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:34.488 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:34.498 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:34.589 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:34.588+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:34.664 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:34.664 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:34.674 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:34.717 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:34.717+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:34.790 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:34.789+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:34.800 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:34.800 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:34.810 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:34.891 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:34.890+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:34.950 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:34.950 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:34.960 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:34.992 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:34.991+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:35.087 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:35.087 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:35.092 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:35.091+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:35.097 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:35.194 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:35.193+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:35.222 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:35.222 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:35.233 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:35.294 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:35.294+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:35.373 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:35.373 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:35.383 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:35.395 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:35.395+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:35.496 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:35.496+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:35.509 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:35.509 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:35.519 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:35.598 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:35.597+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:35.645 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:35.645 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:35.655 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:27:35.656 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:35.698 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:35.698+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:35.744 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:27:35.796 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:35.796 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:35.799 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:35.799+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:35.806 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:35.899 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:35.900 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:35.899+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:35.935 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:35.957 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:35.958 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:35.958 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:35.958 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:35.974 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:35.974 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:35.974 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T12:27:35.974 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T12:27:35.974 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:35.985 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:36.001 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:35.999+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:36.101 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:36.100+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:36.153 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:36.153 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T12:27:36.153 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T12:27:36.153 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T12:27:36.153 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.153 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 3 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:27:36.154 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:36.154 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.898317769999998, 2024-04-26T12:27:36.154 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0048986250000000002, 2024-04-26T12:27:36.154 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.154 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:36.154 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.154 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.154 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.154 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:36.154 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.154 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.154 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.154 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.154 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253094+0000", 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0924000000000001e-05 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.155 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253109+0000", 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4982e-05 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253127+0000", 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8586000000000001e-05 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253214+0000", 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6234000000000001e-05 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.156 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257982+0000", 2024-04-26T12:27:36.157 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0047682150000000001 2024-04-26T12:27:36.157 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.157 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.157 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.157 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.157 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.157 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.157 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:36.157 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.897874610999999, 2024-04-26T12:27:36.157 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010912543, 2024-04-26T12:27:36.157 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.157 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.157 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.157 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.158 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.158 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:36.158 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.158 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.158 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.158 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.158 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:36.158 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.158 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.158 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.158 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.158 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253521+0000", 2024-04-26T12:27:36.158 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999943 2024-04-26T12:27:36.159 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.159 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.159 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.159 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253542+0000", 2024-04-26T12:27:36.159 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1061999999999999e-05 2024-04-26T12:27:36.159 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.159 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.159 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.159 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253606+0000", 2024-04-26T12:27:36.159 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4012999999999999e-05 2024-04-26T12:27:36.159 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.159 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.159 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.160 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253619+0000", 2024-04-26T12:27:36.160 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3091999999999999e-05 2024-04-26T12:27:36.160 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.160 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.160 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.160 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:36.160 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013321599999999999 2024-04-26T12:27:36.160 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.160 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.160 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.160 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253923+0000", 2024-04-26T12:27:36.160 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017127900000000001 2024-04-26T12:27:36.160 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.161 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.161 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:36.161 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254085+0000", 2024-04-26T12:27:36.161 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000161566 2024-04-26T12:27:36.161 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.161 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.161 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:36.161 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257500+0000", 2024-04-26T12:27:36.161 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034156880000000001 2024-04-26T12:27:36.161 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.161 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.161 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.161 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264372+0000", 2024-04-26T12:27:36.161 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068719760000000001 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264402+0000", 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9128e-05 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264439+0000", 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7251e-05 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.897765509000003, 2024-04-26T12:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010957691, 2024-04-26T12:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.163 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253639+0000", 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.164 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.165 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253648+0000", 2024-04-26T12:27:36.165 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:27:36.165 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.165 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.165 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.165 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253655+0000", 2024-04-26T12:27:36.165 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8909999999999998e-06 2024-04-26T12:27:36.165 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.165 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.165 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.165 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254807+0000", 2024-04-26T12:27:36.165 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001151712 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255417+0000", 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00061023000000000002 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255573+0000", 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015571399999999999 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260113+0000", 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045405519999999998 2024-04-26T12:27:36.166 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.167 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.167 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.167 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264499+0000", 2024-04-26T12:27:36.167 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043857050000000002 2024-04-26T12:27:36.167 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.167 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.167 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:36.167 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264552+0000", 2024-04-26T12:27:36.167 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2602000000000002e-05 2024-04-26T12:27:36.167 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.167 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.167 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.167 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264593+0000", 2024-04-26T12:27:36.167 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1341000000000003e-05 2024-04-26T12:27:36.168 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.168 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.168 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.168 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.168 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.168 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.168 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:36.168 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.897740102999997, 2024-04-26T12:27:36.168 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091815760000000003, 2024-04-26T12:27:36.168 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.168 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.168 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.168 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.168 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253660+0000", 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.169 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253664+0000", 2024-04-26T12:27:36.170 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:27:36.170 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.170 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.170 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.170 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253679+0000", 2024-04-26T12:27:36.170 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4208e-05 2024-04-26T12:27:36.170 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.170 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.170 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.170 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253685+0000", 2024-04-26T12:27:36.170 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:27:36.170 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.170 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.170 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254897+0000", 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001211801 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255009+0000", 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011189 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255142+0000", 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013265799999999999 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:36.171 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.259665+0000", 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004523862 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262759+0000", 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003093391 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262805+0000", 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6399000000000001e-05 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262842+0000", 2024-04-26T12:27:36.172 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7184000000000002e-05 2024-04-26T12:27:36.173 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.173 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.173 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.173 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.173 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.173 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.173 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:36.173 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.897710193000002, 2024-04-26T12:27:36.173 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092939230000000008, 2024-04-26T12:27:36.173 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.173 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.173 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.173 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.174 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.174 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:36.174 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.174 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.174 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.174 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.174 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:36.174 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.174 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.174 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.174 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.174 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253690+0000", 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253695+0000", 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6090000000000003e-06 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253705+0000", 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0326000000000001e-05 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253714+0000", 2024-04-26T12:27:36.176 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:27:36.176 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.176 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.176 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.176 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256115+0000", 2024-04-26T12:27:36.176 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024015450000000002 2024-04-26T12:27:36.176 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.176 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.176 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.176 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256215+0000", 2024-04-26T12:27:36.176 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010016700000000001 2024-04-26T12:27:36.176 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.176 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.176 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:36.177 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256368+0000", 2024-04-26T12:27:36.177 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015244999999999999 2024-04-26T12:27:36.177 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.177 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.177 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:36.177 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260313+0000", 2024-04-26T12:27:36.177 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00394481 2024-04-26T12:27:36.177 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.177 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.177 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.177 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262895+0000", 2024-04-26T12:27:36.177 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0025824670000000002 2024-04-26T12:27:36.177 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.177 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262946+0000", 2024-04-26T12:27:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1072999999999997e-05 2024-04-26T12:27:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262985+0000", 2024-04-26T12:27:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8529000000000003e-05 2024-04-26T12:27:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.178 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.897680831999999, 2024-04-26T12:27:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011070178999999999, 2024-04-26T12:27:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.179 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:36.180 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.180 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.180 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.180 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.180 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:36.180 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.180 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.180 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.180 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.180 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253724+0000", 2024-04-26T12:27:36.180 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0890000000000002e-06 2024-04-26T12:27:36.180 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.180 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.181 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.181 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253736+0000", 2024-04-26T12:27:36.181 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2252999999999999e-05 2024-04-26T12:27:36.181 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.181 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.181 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.181 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253742+0000", 2024-04-26T12:27:36.181 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9499999999999998e-06 2024-04-26T12:27:36.181 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.181 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.181 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.182 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256230+0000", 2024-04-26T12:27:36.182 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002488114 2024-04-26T12:27:36.182 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.182 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.182 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.182 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256421+0000", 2024-04-26T12:27:36.182 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019087999999999999 2024-04-26T12:27:36.182 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.182 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.182 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:36.182 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256583+0000", 2024-04-26T12:27:36.182 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000162566 2024-04-26T12:27:36.182 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.182 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260316+0000", 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037329239999999999 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264713+0000", 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043968380000000001 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1124000000000001e-05 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.183 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.184 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264790+0000", 2024-04-26T12:27:36.184 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5923999999999997e-05 2024-04-26T12:27:36.184 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.184 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.184 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.184 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.184 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.184 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.184 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:36.184 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.897649016000003, 2024-04-26T12:27:36.184 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0086059009999999991, 2024-04-26T12:27:36.184 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.184 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.184 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.185 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.185 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.185 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:36.185 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.185 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.185 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.185 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.185 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:36.185 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.185 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.185 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.185 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.185 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253751+0000", 2024-04-26T12:27:36.185 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.186 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.186 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.186 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.186 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253756+0000", 2024-04-26T12:27:36.186 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9740000000000001e-06 2024-04-26T12:27:36.186 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.186 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.186 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.186 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253762+0000", 2024-04-26T12:27:36.186 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9769999999999997e-06 2024-04-26T12:27:36.186 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.186 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.186 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253767+0000", 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254160+0000", 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039256700000000002 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254292+0000", 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013190399999999999 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.187 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:36.188 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254453+0000", 2024-04-26T12:27:36.188 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000160982 2024-04-26T12:27:36.188 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.188 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.188 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:36.188 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257354+0000", 2024-04-26T12:27:36.188 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029008229999999999 2024-04-26T12:27:36.188 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.188 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.188 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.188 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262281+0000", 2024-04-26T12:27:36.188 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049274760000000001 2024-04-26T12:27:36.188 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.189 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.189 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:36.189 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262323+0000", 2024-04-26T12:27:36.189 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.189e-05 2024-04-26T12:27:36.189 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.189 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.189 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.189 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262358+0000", 2024-04-26T12:27:36.189 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4826000000000002e-05 2024-04-26T12:27:36.189 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.189 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.189 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.189 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.189 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.190 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:32 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.190 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:36.190 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.897292964000002, 2024-04-26T12:27:36.190 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083641310000000003, 2024-04-26T12:27:36.190 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.190 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:36.190 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.190 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.190 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.190 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:36.190 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.190 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.190 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.191 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.191 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:36.191 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.191 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.191 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.191 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.191 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254107+0000", 2024-04-26T12:27:36.191 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:36.191 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.191 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.191 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.191 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254113+0000", 2024-04-26T12:27:36.191 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:27:36.191 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254122+0000", 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.149e-06 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254131+0000", 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5609999999999999e-06 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255227+0000", 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010961 2024-04-26T12:27:36.192 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255355+0000", 2024-04-26T12:27:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012883299999999999 2024-04-26T12:27:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262472+0000", 2024-04-26T12:27:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071165949999999999 2024-04-26T12:27:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.193 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:33 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.897264839999998, 2024-04-26T12:27:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012698262, 2024-04-26T12:27:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.194 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.195 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.195 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.195 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:36.195 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.195 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.195 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.195 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.195 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:36.195 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.195 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.195 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.195 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.195 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254138+0000", 2024-04-26T12:27:36.195 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2460000000000002e-06 2024-04-26T12:27:36.196 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.196 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.196 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.196 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254145+0000", 2024-04-26T12:27:36.196 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7070000000000003e-06 2024-04-26T12:27:36.196 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.196 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.196 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.196 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254164+0000", 2024-04-26T12:27:36.196 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9604999999999999e-05 2024-04-26T12:27:36.196 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.196 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.196 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.196 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257574+0000", 2024-04-26T12:27:36.197 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034098980000000002 2024-04-26T12:27:36.197 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.197 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.197 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.197 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257731+0000", 2024-04-26T12:27:36.197 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015735400000000001 2024-04-26T12:27:36.197 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.197 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.197 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.197 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266834+0000", 2024-04-26T12:27:36.197 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091028099999999994 2024-04-26T12:27:36.197 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.197 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.198 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.198 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.198 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.198 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.198 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:36.198 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.897229101000001, 2024-04-26T12:27:36.198 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0087469690000000003, 2024-04-26T12:27:36.198 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.198 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:36.198 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.198 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.198 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.198 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:36.198 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.199 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.199 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.199 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.199 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:36.199 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.199 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.199 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.199 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.199 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254171+0000", 2024-04-26T12:27:36.199 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.199 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.199 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.200 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.200 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254178+0000", 2024-04-26T12:27:36.200 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7710000000000001e-06 2024-04-26T12:27:36.200 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.200 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.200 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.200 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254185+0000", 2024-04-26T12:27:36.200 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6249999999999998e-06 2024-04-26T12:27:36.200 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.200 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.200 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.200 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254203+0000", 2024-04-26T12:27:36.200 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8003999999999999e-05 2024-04-26T12:27:36.200 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254408+0000", 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020469100000000001 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254525+0000", 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000116319 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262919+0000", 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083942440000000004 2024-04-26T12:27:36.201 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.202 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.202 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.202 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.202 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.202 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:18 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:36.202 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:36.202 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.890019563999999, 2024-04-26T12:27:36.202 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016521190000000001, 2024-04-26T12:27:36.202 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.202 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.202 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.202 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.202 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.203 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:36.203 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.203 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.203 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.203 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.203 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:36.203 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.203 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.203 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.203 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.203 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:36.203 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.203 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.203 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.204 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.204 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261387+0000", 2024-04-26T12:27:36.204 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4880000000000004e-06 2024-04-26T12:27:36.204 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.204 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.204 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.204 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261396+0000", 2024-04-26T12:27:36.204 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2209999999999997e-06 2024-04-26T12:27:36.204 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.204 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.204 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.204 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261414+0000", 2024-04-26T12:27:36.204 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8386e-05 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261460+0000", 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6029999999999998e-05 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261516+0000", 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6418000000000001e-05 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263008+0000", 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0014912910000000001 2024-04-26T12:27:36.205 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263033+0000", 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5763e-05 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:28 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.889814866999998, 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001530869, 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.206 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:36.207 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.208 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.208 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.208 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.208 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261597+0000", 2024-04-26T12:27:36.208 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1344e-05 2024-04-26T12:27:36.208 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.208 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.208 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.208 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261605+0000", 2024-04-26T12:27:36.208 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9039999999999992e-06 2024-04-26T12:27:36.208 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.208 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.208 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.208 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261612+0000", 2024-04-26T12:27:36.209 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8580000000000002e-06 2024-04-26T12:27:36.209 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.209 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.209 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.209 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261886+0000", 2024-04-26T12:27:36.209 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027415399999999998 2024-04-26T12:27:36.209 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.209 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.209 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.209 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261905+0000", 2024-04-26T12:27:36.209 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8898000000000001e-05 2024-04-26T12:27:36.209 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.209 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263093+0000", 2024-04-26T12:27:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011877490000000001 2024-04-26T12:27:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263117+0000", 2024-04-26T12:27:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4338999999999999e-05 2024-04-26T12:27:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.210 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing_reply(3.b epoch 15/13 rep_tid 4 lcod 15'2)", 2024-04-26T12:27:36.211 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:36.211 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.889127932000001, 2024-04-26T12:27:36.211 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020538300000000001, 2024-04-26T12:27:36.211 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.211 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:36.211 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.211 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.211 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.211 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:36.211 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.211 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.211 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.211 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.211 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:36.212 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.212 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.212 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.212 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.212 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262272+0000", 2024-04-26T12:27:36.212 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:36.212 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.212 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.212 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.212 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262277+0000", 2024-04-26T12:27:36.212 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9169999999999997e-06 2024-04-26T12:27:36.212 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.212 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262287+0000", 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0237e-05 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262297+0000", 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3219999999999999e-06 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262382+0000", 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4969999999999995e-05 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.213 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.214 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.214 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262478+0000", 2024-04-26T12:27:36.214 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6704000000000001e-05 2024-04-26T12:27:36.214 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.214 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.214 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.214 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.214 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.214 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e15/13 ondisk, result = 0)", 2024-04-26T12:27:36.214 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:36.214 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.888683395000001, 2024-04-26T12:27:36.214 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027471, 2024-04-26T12:27:36.214 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.214 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:36.215 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.215 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.215 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.215 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:36.215 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.215 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.215 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.215 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.215 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:36.215 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.215 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.215 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.215 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.216 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:36.216 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.216 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.216 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.216 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.216 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262720+0000", 2024-04-26T12:27:36.216 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4509999999999999e-06 2024-04-26T12:27:36.216 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.216 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.216 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.216 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262726+0000", 2024-04-26T12:27:36.216 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8599999999999998e-06 2024-04-26T12:27:36.216 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.216 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262732+0000", 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5889999999999999e-06 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262882+0000", 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014968800000000001 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262890+0000", 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9279999999999993e-06 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.217 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.218 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.218 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262992+0000", 2024-04-26T12:27:36.218 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010247300000000001 2024-04-26T12:27:36.218 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.218 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.218 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.218 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.218 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.218 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:36.218 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:36.218 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.887010836000002, 2024-04-26T12:27:36.218 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021676200000000001, 2024-04-26T12:27:36.218 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.219 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:36.220 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.220 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.220 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.220 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.220 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264404+0000", 2024-04-26T12:27:36.220 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3998999999999999e-05 2024-04-26T12:27:36.220 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.220 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.220 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.220 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264411+0000", 2024-04-26T12:27:36.220 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:27:36.220 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.220 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.220 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264424+0000", 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2843999999999999e-05 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264485+0000", 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0464000000000002e-05 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264493+0000", 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.507e-06 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.221 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264607+0000", 2024-04-26T12:27:36.222 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000113591 2024-04-26T12:27:36.222 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.222 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.222 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.222 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.222 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.222 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:21 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:36.222 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:36.222 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.886971109000001, 2024-04-26T12:27:36.222 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00037041599999999999, 2024-04-26T12:27:36.222 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.222 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:36.222 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264429+0000", 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264432+0000", 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0770000000000002e-06 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264435+0000", 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8340000000000001e-06 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264438+0000", 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5280000000000002e-06 2024-04-26T12:27:36.224 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.225 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.225 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.225 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264703+0000", 2024-04-26T12:27:36.225 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026548400000000002 2024-04-26T12:27:36.225 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.225 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.225 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.225 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264709+0000", 2024-04-26T12:27:36.225 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8390000000000003e-06 2024-04-26T12:27:36.225 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.225 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.225 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.225 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264800+0000", 2024-04-26T12:27:36.225 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0931000000000001e-05 2024-04-26T12:27:36.226 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.226 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.226 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.226 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.226 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.226 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:36.226 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:36.226 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.886165208000001, 2024-04-26T12:27:36.226 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016589860000000001, 2024-04-26T12:27:36.226 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.226 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.226 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.226 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.230 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.230 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:36.230 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.230 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.230 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.230 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.230 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:36.230 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.230 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.230 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.230 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.231 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265235+0000", 2024-04-26T12:27:36.231 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.231 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.231 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.231 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.231 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265252+0000", 2024-04-26T12:27:36.231 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6307000000000002e-05 2024-04-26T12:27:36.231 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.231 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.231 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.231 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265257+0000", 2024-04-26T12:27:36.231 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8279999999999999e-06 2024-04-26T12:27:36.231 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.232 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.232 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.232 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265263+0000", 2024-04-26T12:27:36.232 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9399999999999999e-06 2024-04-26T12:27:36.232 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.232 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.232 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.232 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265300+0000", 2024-04-26T12:27:36.232 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6315e-05 2024-04-26T12:27:36.232 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.232 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.232 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.232 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265312+0000", 2024-04-26T12:27:36.233 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2451e-05 2024-04-26T12:27:36.233 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.233 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.233 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:36.233 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266864+0000", 2024-04-26T12:27:36.233 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015521090000000001 2024-04-26T12:27:36.233 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.233 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.233 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.233 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266895+0000", 2024-04-26T12:27:36.233 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0426e-05 2024-04-26T12:27:36.233 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.233 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.233 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.234 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.234 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.234 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:22 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:36.234 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:36.234 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.886044468000001, 2024-04-26T12:27:36.234 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021988139999999999, 2024-04-26T12:27:36.234 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.234 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.234 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.234 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.234 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.234 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:36.234 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.234 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.235 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.235 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.235 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:36.235 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.235 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.235 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.235 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.235 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:36.235 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967296 2024-04-26T12:27:36.235 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.235 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.235 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.235 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265361+0000", 2024-04-26T12:27:36.235 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6979999999999997e-06 2024-04-26T12:27:36.236 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.236 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.236 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.236 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265366+0000", 2024-04-26T12:27:36.236 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6550000000000003e-06 2024-04-26T12:27:36.236 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.236 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.236 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.236 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265379+0000", 2024-04-26T12:27:36.236 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.358e-05 2024-04-26T12:27:36.236 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.236 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.236 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.236 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265535+0000", 2024-04-26T12:27:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015586800000000001 2024-04-26T12:27:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265556+0000", 2024-04-26T12:27:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1202000000000001e-05 2024-04-26T12:27:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267528+0000", 2024-04-26T12:27:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0019722099999999998 2024-04-26T12:27:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.237 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.238 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267555+0000", 2024-04-26T12:27:36.238 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6775999999999999e-05 2024-04-26T12:27:36.238 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.238 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.238 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.238 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.238 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.238 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-26T12:27:36.238 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:36.238 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 38.241026296000001, 2024-04-26T12:27:36.238 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020315099999999998, 2024-04-26T12:27:36.238 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.238 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.238 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.239 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.239 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.239 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:36.239 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.239 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.239 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.239 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.239 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:36.239 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.239 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.239 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.239 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.239 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910372+0000", 2024-04-26T12:27:36.239 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-26T12:27:36.240 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.240 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.240 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.240 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910387+0000", 2024-04-26T12:27:36.240 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5252999999999999e-05 2024-04-26T12:27:36.240 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.240 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.240 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.240 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910418+0000", 2024-04-26T12:27:36.240 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0778999999999998e-05 2024-04-26T12:27:36.240 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.240 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.240 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.240 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910437+0000", 2024-04-26T12:27:36.241 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9619999999999998e-05 2024-04-26T12:27:36.241 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.241 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.241 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.241 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910587+0000", 2024-04-26T12:27:36.241 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014922000000000001 2024-04-26T12:27:36.241 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.241 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.241 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.241 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910837+0000", 2024-04-26T12:27:36.241 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025089099999999999 2024-04-26T12:27:36.241 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.241 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.241 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:36.242 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910973+0000", 2024-04-26T12:27:36.242 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000135124 2024-04-26T12:27:36.242 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.242 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.242 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:36.242 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.911616+0000", 2024-04-26T12:27:36.242 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00064392799999999999 2024-04-26T12:27:36.242 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.242 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.242 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.242 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912341+0000", 2024-04-26T12:27:36.242 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00072415700000000001 2024-04-26T12:27:36.242 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.242 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.243 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:36.243 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912379+0000", 2024-04-26T12:27:36.243 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8724999999999999e-05 2024-04-26T12:27:36.243 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.243 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.243 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.243 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912406+0000", 2024-04-26T12:27:36.243 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6752999999999999e-05 2024-04-26T12:27:36.243 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.243 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.243 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.243 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.243 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.243 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-26T12:27:36.244 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:36.244 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 13.240358084, 2024-04-26T12:27:36.244 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0013630599999999999, 2024-04-26T12:27:36.244 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:36.244 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.244 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:36.244 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.244 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:36.244 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:36.244 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.244 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.244 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.244 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:36.244 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:36.245 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:36.245 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.245 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.245 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:36.245 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911041+0000", 2024-04-26T12:27:36.245 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999976 2024-04-26T12:27:36.245 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.245 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.245 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:36.245 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911057+0000", 2024-04-26T12:27:36.245 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6549999999999999e-05 2024-04-26T12:27:36.245 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.245 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.245 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911088+0000", 2024-04-26T12:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0753000000000002e-05 2024-04-26T12:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911107+0000", 2024-04-26T12:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9425000000000001e-05 2024-04-26T12:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911258+0000", 2024-04-26T12:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000150252 2024-04-26T12:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.246 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.247 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:36.247 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911379+0000", 2024-04-26T12:27:36.247 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012129900000000001 2024-04-26T12:27:36.247 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.247 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.247 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:36.247 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911529+0000", 2024-04-26T12:27:36.247 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015010699999999999 2024-04-26T12:27:36.247 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.247 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.247 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:36.247 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912214+0000", 2024-04-26T12:27:36.247 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00068528199999999995 2024-04-26T12:27:36.247 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912343+0000", 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012858800000000001 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912378+0000", 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5420000000000003e-05 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912406+0000", 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7594e-05 2024-04-26T12:27:36.248 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.249 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.249 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.249 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:36.249 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:36.249 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:36.250 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:36.251 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:36.250+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:36.352 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:36.351+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:36.390 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:36.390 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:36.390 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:36.390 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:36.400 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:36.484 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:36.484+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:36.554 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:36.553+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:36.566 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:36.566 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:36.567 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:36.567 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:36.567 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:36.576 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:36.638 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2024-04-26T12:27:36.654 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:36.654+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:36.747 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:36.747 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:36.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:36.747 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:36.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.747 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:36.747 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:36.747 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 49.862971645999998, 2024-04-26T12:27:36.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:36.747 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.747 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.748 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:36.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:36.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:36.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:36.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:36.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:36.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:36.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:36.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:36.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:36.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:36.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:36.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:36.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:36.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:36.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:36.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:36.752 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.752 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.752 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.754 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:36.754 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:36.754 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 49.862332299000002, 2024-04-26T12:27:36.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:36.754 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.754 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.755 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:36.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:36.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:36.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:36.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:36.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:36.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:36.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:36.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:36.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:36.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:36.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:36.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:36.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:36.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:36.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:36.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:36.758 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.758 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.759 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.759 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:36.759 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:36.759 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 49.732630108999999, 2024-04-26T12:27:36.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:36.759 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.759 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.759 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:36.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:36.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:36.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:36.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:36.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:36.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:36.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:36.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:36.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:36.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:36.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:36.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:36.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:36.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:36.763 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.763 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.763 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.763 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:36.763 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:36.763 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 49.732135522999997, 2024-04-26T12:27:36.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:36.763 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.763 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.764 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:36.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:36.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:36.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:36.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:36.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:36.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:36.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:36.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:36.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:36.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:36.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:36.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:36.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:36.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:36.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:36.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:36.767 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.767 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.767 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.768 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:36.768 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:36.768 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 49.730133338999998, 2024-04-26T12:27:36.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:36.768 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.768 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.768 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:36.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:36.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:36.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:36.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:36.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:36.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:36.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:36.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:36.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:36.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:36.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:36.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:36.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:36.772 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.772 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.772 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.772 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:36.772 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:36.772 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 49.729726999, 2024-04-26T12:27:36.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:36.772 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.772 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.772 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:36.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:36.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:36.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:36.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:36.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:36.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:36.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:36.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:36.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:36.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:36.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:36.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:36.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:36.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:36.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:36.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:36.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.776 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.777 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:36.777 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:36.777 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 49.729372175000002, 2024-04-26T12:27:36.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:36.777 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.777 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.777 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:36.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:36.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:36.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:36.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:36.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:36.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:36.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:36.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:36.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:36.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:36.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:36.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:36.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:36.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:36.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:36.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:36.781 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.781 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.781 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.781 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:36.781 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:36.781 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 49.626813761000001, 2024-04-26T12:27:36.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:36.781 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.781 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.781 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:36.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:36.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:36.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:36.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:36.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:36.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:36.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:36.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:36.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:36.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:36.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:36.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:36.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:36.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:36.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:36.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:36.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:36.785 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.785 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.785 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.786 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:36.786 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:36.786 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 49.626417232999998, 2024-04-26T12:27:36.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:36.786 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.786 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.786 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:36.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:36.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:36.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:36.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:36.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:36.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:36.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:36.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:36.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:36.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:36.790 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.790 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.790 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.790 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:36.790 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:36.790 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 49.529407624999997, 2024-04-26T12:27:36.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:36.790 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.790 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.790 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:36.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:36.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:36.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:36.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:36.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:36.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:36.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:36.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:36.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:36.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:36.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:36.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:36.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:36.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:36.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:36.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:36.794 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.794 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.794 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.795 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:36.795 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:36.795 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 49.528713908999997, 2024-04-26T12:27:36.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:36.795 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.795 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.795 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:36.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:36.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:36.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:36.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:36.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:36.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:36.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:36.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:36.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:36.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:36.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:36.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:36.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:36.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:36.799 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.799 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.799 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.799 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.799 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:36.799 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.493974854000001, 2024-04-26T12:27:36.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:36.799 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.800 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.800 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:36.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:36.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:36.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:36.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:36.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:36.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:36.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:36.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:36.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:36.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:36.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:36.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:36.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:36.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:36.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:36.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:36.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:36.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:36.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:36.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.804 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.493153935000002, 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:36.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:36.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:36.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:36.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:36.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:36.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:36.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:36.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:36.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:36.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:36.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:36.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:36.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:36.810 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.810 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.810 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.810 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.810 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:36.810 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.493123845, 2024-04-26T12:27:36.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:36.810 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.810 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.810 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:36.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:36.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:36.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:36.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:36.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:36.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:36.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:36.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:36.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:36.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:36.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:36.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:36.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:36.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:36.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:36.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:36.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:36.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:36.815 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.815 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.815 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.815 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.816 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:36.816 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.493070056999997, 2024-04-26T12:27:36.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:36.816 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.816 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.816 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:36.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:36.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:36.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:36.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:36.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:36.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:36.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:36.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:36.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:36.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:36.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:36.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:36.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:36.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:36.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:36.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:36.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.493017500000001, 2024-04-26T12:27:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:36.821 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.822 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.822 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:36.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:36.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.826 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:36.827 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.492977285999999, 2024-04-26T12:27:36.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:36.827 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.827 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.827 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:36.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:36.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:36.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:36.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:36.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:36.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:36.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:36.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:36.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:36.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:36.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:36.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:36.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:36.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:36.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:36.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:36.831 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.831 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.831 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.832 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.832 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:36.832 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.492949125000003, 2024-04-26T12:27:36.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:36.832 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.832 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:36.832 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:36.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:36.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:36.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:36.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:36.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:36.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:36.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:36.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:36.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:36.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:36.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:36.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:36.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:36.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:36.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:36.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:36.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.492918435999997, 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:36.837 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:36.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:36.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:36.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:36.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:36.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:36.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:36.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:36.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.492891862999997, 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:36.841 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:36.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:36.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:36.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:36.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:36.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:36.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:36.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:36.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:36.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:36.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:36.845 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.845 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.845 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.845 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:36.845 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:36.845 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:36.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:36.847 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:36.845+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:36.948 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:36.946+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:36.986 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:36.986 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:36.986 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:36.986 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:36.997 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:37.049 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:37.047+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:37.124 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:37.125 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:37.125 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:37.125 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:37.125 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:37.134 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:37.175 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:37.174+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:37.251 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:37.250+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:37.303 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:37.303 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:37.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:37.303 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:37.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.303 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:37.303 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:37.303 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 49.969993701, 2024-04-26T12:27:37.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:37.303 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.303 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:37.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:37.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:37.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:37.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:37.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:37.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:37.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:37.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:37.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:37.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:37.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:37.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:37.309 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.309 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.309 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.309 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.309 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:37.309 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.051127878000003, 2024-04-26T12:27:37.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:37.309 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.309 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.309 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:37.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:37.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:37.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:37.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:37.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:37.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:37.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:37.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:37.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:37.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:37.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:37.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:37.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:37.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:37.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:37.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:37.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:37.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:37.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:37.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:37.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:37.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:37.315 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.315 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.315 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.315 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.315 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:37.316 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.051091665999998, 2024-04-26T12:27:37.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:37.316 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.316 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.316 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:37.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:37.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:37.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:37.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:37.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:37.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:37.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:37.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:37.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:37.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:37.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:37.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:37.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:37.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:37.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:37.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:37.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:37.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:37.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:37.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:37.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:37.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:37.321 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.321 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.322 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.322 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.322 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:37.322 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.051052691999999, 2024-04-26T12:27:37.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:37.322 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.322 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.322 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:37.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:37.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:37.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:37.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:37.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:37.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:37.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:37.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:37.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:37.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:37.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:37.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:37.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:37.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:37.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:37.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:37.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:37.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:37.328 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.328 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.328 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.328 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.328 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:37.328 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.051029524999997, 2024-04-26T12:27:37.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:37.328 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.328 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.328 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:37.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:37.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:37.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:37.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:37.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:37.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:37.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:37.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:37.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:37.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:37.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:37.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:37.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:37.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:37.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:37.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:37.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:37.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:37.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:37.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:37.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:37.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:37.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:37.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:37.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:37.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:37.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:37.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.334 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.334 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.334 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:37.335 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.051014148, 2024-04-26T12:27:37.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:37.335 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.335 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.335 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:37.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:37.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:37.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:37.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:37.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:37.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:37.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:37.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:37.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:37.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:37.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:37.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:37.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:37.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:37.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:37.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:37.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:37.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:37.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:37.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:37.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:37.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:37.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:37.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:37.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:37.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:37.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:37.340 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.340 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.341 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.341 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.341 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:37.341 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.050985957999998, 2024-04-26T12:27:37.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:37.341 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.341 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.341 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:37.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:37.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:37.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:37.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:37.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:37.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:37.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:37.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:37.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:37.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:37.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:37.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:37.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:37.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:37.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:37.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:37.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:37.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:37.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:37.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:37.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:37.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:37.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:37.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:37.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:37.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:37.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:37.347 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.347 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.347 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.347 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.347 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:37.347 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.050967960000001, 2024-04-26T12:27:37.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:37.347 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.348 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.348 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:37.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:37.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:37.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:37.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:37.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:37.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:37.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:37.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:37.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:37.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:37.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:37.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:37.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:37.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:37.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:37.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:37.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:37.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:37.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:37.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:37.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:37.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:37.353 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.353 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.354 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.354 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.354 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:37.354 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.050943369000002, 2024-04-26T12:27:37.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:37.354 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.354 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.354 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:37.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:37.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:37.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:37.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:37.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:37.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:37.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:37.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:37.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:37.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:37.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:37.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:37.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:37.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:37.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:37.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:37.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:37.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:37.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:37.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:37.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:37.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:37.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:37.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:37.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:37.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.050918420000002, 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.360 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:37.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:37.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:37.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:37.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:37.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:37.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:37.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:37.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:37.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:37.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:37.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:37.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:37.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:37.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:37.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:37.366 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.366 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.366 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.366 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.366 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:37.366 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.050897495999997, 2024-04-26T12:27:37.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:37.366 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.367 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.367 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:37.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:37.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:37.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:37.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:37.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:37.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:37.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:37.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:37.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:37.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:37.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:37.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:37.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:37.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:37.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:37.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:37.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:37.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:37.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:37.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:37.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:37.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:37.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:37.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:37.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:37.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:37.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:37.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:37.372 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.372 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.372 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.372 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.373 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:37.373 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.050862647000002, 2024-04-26T12:27:37.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:37.373 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.373 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.373 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:37.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:37.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:37.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:37.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:37.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:37.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:37.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:37.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:37.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:37.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:37.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:37.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:37.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:37.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:37.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:37.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:37.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:37.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:37.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:37.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:37.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:37.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:37.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:37.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:37.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:37.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:37.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:37.378 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.378 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.379 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.379 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.379 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:37.379 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.050828697, 2024-04-26T12:27:37.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:37.379 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.379 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.379 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:37.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:37.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:37.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:37.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:37.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:37.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:37.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:37.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:37.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:37.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:37.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:37.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:37.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:37.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:37.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:37.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:37.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:37.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:37.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:37.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:37.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:37.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:37.385 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.385 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.385 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.385 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.385 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:37.385 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.050808400000001, 2024-04-26T12:27:37.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:37.385 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.386 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.386 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:37.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:37.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:37.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:37.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:37.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:37.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:37.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:37.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:37.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:37.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:37.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:37.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:37.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:37.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:37.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:37.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:37.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:37.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:37.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:37.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:37.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:37.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:37.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:37.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:37.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:37.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:37.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:37.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:37.391 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.391 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.391 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.392 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.392 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:37.392 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.050773278999998, 2024-04-26T12:27:37.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:37.392 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.392 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.392 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:37.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:37.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:37.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:37.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:37.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:37.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:37.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:37.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:37.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:37.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:37.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:37.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:37.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:37.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:37.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:37.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:37.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:37.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:37.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:37.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:37.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:37.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:37.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:37.397 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.398 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.398 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.398 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.398 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:37.398 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.050738039000002, 2024-04-26T12:27:37.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:37.398 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.398 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.398 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:37.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:37.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:37.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:37.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:37.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:37.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:37.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:37.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:37.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:37.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:37.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:37.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:37.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:37.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:37.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:37.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:37.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:37.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:37.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:37.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:37.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:37.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:37.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.050596290999998, 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.404 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:37.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:37.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:37.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:37.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:37.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:37.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:37.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:37.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:37.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:37.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:37.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:37.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:37.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:37.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:37.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:37.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:37.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:37.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:37.410 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.410 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.410 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.410 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.410 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:37.410 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.050572271999997, 2024-04-26T12:27:37.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:37.410 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.410 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:37.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:37.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:37.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:37.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:37.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:37.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:37.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:37.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:37.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:37.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:37.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:37.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:37.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:37.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:37.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:37.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:37.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:37.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:37.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:37.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:37.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:37.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:37.416 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.416 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.416 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.416 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.416 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:37.416 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.050548304000003, 2024-04-26T12:27:37.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:27:37.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:27:37.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:27:37.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:27:37.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:27:37.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:27:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:27:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.050514923000001, 2024-04-26T12:27:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:27:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:27:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:37.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:37.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:37.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:37.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:37.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:37.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:37.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:37.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:27:37.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:27:37.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:37.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:27:37.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:27:37.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:27:37.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:27:37.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:27:37.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:27:37.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:37.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:27:37.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:27:37.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:37.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:27:37.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:27:37.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:37.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:27:37.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:27:37.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:37.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:37.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:37.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:27:37.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:27:37.427 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.427 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.427 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.427 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:37.427 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:37.427 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:37.428 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:37.429 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:37.427+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:37.529 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:37.527+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:37.568 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:37.568 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:37.568 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T12:27:37.568 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:37.578 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:37.629 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:37.628+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:37.730 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:37.729+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:37.744 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:37.744 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:37.744 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T12:27:37.744 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T12:27:37.744 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:37.754 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:37.830 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:37.830+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:37.881 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:37.881 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T12:27:37.882 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T12:27:37.882 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T12:27:37.882 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.882 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 3 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:27:37.882 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:37.882 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.626322967999997, 2024-04-26T12:27:37.882 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0048986250000000002, 2024-04-26T12:27:37.882 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.882 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:37.882 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.882 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.882 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.883 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:37.883 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.883 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.883 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.883 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.883 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:37.883 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.883 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.883 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.883 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.883 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:37.883 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.883 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.884 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.884 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.884 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253094+0000", 2024-04-26T12:27:37.884 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0924000000000001e-05 2024-04-26T12:27:37.884 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.884 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.884 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.884 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253109+0000", 2024-04-26T12:27:37.884 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4982e-05 2024-04-26T12:27:37.884 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.884 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.884 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.884 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253127+0000", 2024-04-26T12:27:37.884 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8586000000000001e-05 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253214+0000", 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6234000000000001e-05 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257982+0000", 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0047682150000000001 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.885 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.886 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.886 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:37.886 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.625879808999997, 2024-04-26T12:27:37.886 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010912543, 2024-04-26T12:27:37.886 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.886 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.886 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.886 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.886 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.886 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:37.886 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.886 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.886 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.887 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.887 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:37.887 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.887 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.887 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.887 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.887 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253521+0000", 2024-04-26T12:27:37.887 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999943 2024-04-26T12:27:37.887 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.887 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.887 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.887 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253542+0000", 2024-04-26T12:27:37.887 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1061999999999999e-05 2024-04-26T12:27:37.888 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.888 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.888 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.888 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253606+0000", 2024-04-26T12:27:37.888 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4012999999999999e-05 2024-04-26T12:27:37.888 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.888 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.888 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.888 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253619+0000", 2024-04-26T12:27:37.888 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3091999999999999e-05 2024-04-26T12:27:37.888 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.888 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.888 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.888 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:37.889 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013321599999999999 2024-04-26T12:27:37.889 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.889 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.889 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.889 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253923+0000", 2024-04-26T12:27:37.889 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017127900000000001 2024-04-26T12:27:37.889 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.889 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.889 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:37.889 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254085+0000", 2024-04-26T12:27:37.889 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000161566 2024-04-26T12:27:37.889 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.889 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.889 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:37.890 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257500+0000", 2024-04-26T12:27:37.890 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034156880000000001 2024-04-26T12:27:37.890 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.890 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.890 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.890 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264372+0000", 2024-04-26T12:27:37.890 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068719760000000001 2024-04-26T12:27:37.890 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.890 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.890 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:37.890 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264402+0000", 2024-04-26T12:27:37.890 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9128e-05 2024-04-26T12:27:37.891 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.891 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.891 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.891 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264439+0000", 2024-04-26T12:27:37.891 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7251e-05 2024-04-26T12:27:37.891 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.891 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.891 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.891 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.891 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.891 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.891 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:37.891 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.625770707000001, 2024-04-26T12:27:37.891 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010957691, 2024-04-26T12:27:37.892 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.892 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.892 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.892 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.892 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.892 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:37.892 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.892 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.892 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.892 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.892 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:37.892 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.892 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.892 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.893 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.893 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:37.893 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.893 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.893 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.893 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.893 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253639+0000", 2024-04-26T12:27:37.893 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:27:37.893 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.893 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.893 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.893 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253648+0000", 2024-04-26T12:27:37.893 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:27:37.893 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.894 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.894 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.894 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253655+0000", 2024-04-26T12:27:37.894 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8909999999999998e-06 2024-04-26T12:27:37.894 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.894 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.894 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.894 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254807+0000", 2024-04-26T12:27:37.894 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001151712 2024-04-26T12:27:37.894 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.894 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.894 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.894 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255417+0000", 2024-04-26T12:27:37.895 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00061023000000000002 2024-04-26T12:27:37.895 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.895 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.895 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:37.895 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255573+0000", 2024-04-26T12:27:37.895 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015571399999999999 2024-04-26T12:27:37.895 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.895 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.895 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:37.895 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260113+0000", 2024-04-26T12:27:37.895 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045405519999999998 2024-04-26T12:27:37.895 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.896 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.896 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.896 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264499+0000", 2024-04-26T12:27:37.896 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043857050000000002 2024-04-26T12:27:37.896 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.896 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.896 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:37.896 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264552+0000", 2024-04-26T12:27:37.896 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2602000000000002e-05 2024-04-26T12:27:37.896 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.896 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.896 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.896 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264593+0000", 2024-04-26T12:27:37.896 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1341000000000003e-05 2024-04-26T12:27:37.897 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.897 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.897 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.897 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.897 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.897 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.897 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:37.897 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.625745301000002, 2024-04-26T12:27:37.897 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091815760000000003, 2024-04-26T12:27:37.897 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.897 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.897 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.898 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.898 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.898 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:37.898 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.898 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.898 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.898 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.898 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:37.898 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.898 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.898 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.898 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.898 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253660+0000", 2024-04-26T12:27:37.899 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.899 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.899 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.899 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.899 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253664+0000", 2024-04-26T12:27:37.899 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:27:37.899 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.899 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.899 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.899 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253679+0000", 2024-04-26T12:27:37.899 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4208e-05 2024-04-26T12:27:37.899 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.899 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.899 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.900 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253685+0000", 2024-04-26T12:27:37.900 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:27:37.900 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.900 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.900 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.900 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254897+0000", 2024-04-26T12:27:37.900 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001211801 2024-04-26T12:27:37.900 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.900 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.900 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.900 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255009+0000", 2024-04-26T12:27:37.900 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011189 2024-04-26T12:27:37.900 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.901 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.901 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.901 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255142+0000", 2024-04-26T12:27:37.901 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013265799999999999 2024-04-26T12:27:37.901 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.901 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.901 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:37.901 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.259665+0000", 2024-04-26T12:27:37.901 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004523862 2024-04-26T12:27:37.901 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.901 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.901 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.901 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262759+0000", 2024-04-26T12:27:37.901 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003093391 2024-04-26T12:27:37.902 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.902 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.902 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:37.902 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262805+0000", 2024-04-26T12:27:37.902 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6399000000000001e-05 2024-04-26T12:27:37.902 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.902 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.902 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.902 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262842+0000", 2024-04-26T12:27:37.902 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7184000000000002e-05 2024-04-26T12:27:37.902 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.902 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.902 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.902 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.903 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.903 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.903 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:37.903 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.625715391, 2024-04-26T12:27:37.903 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092939230000000008, 2024-04-26T12:27:37.903 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.903 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.903 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.903 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.903 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.903 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:37.903 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.903 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253690+0000", 2024-04-26T12:27:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253695+0000", 2024-04-26T12:27:37.904 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6090000000000003e-06 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253705+0000", 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0326000000000001e-05 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253714+0000", 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256115+0000", 2024-04-26T12:27:37.905 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024015450000000002 2024-04-26T12:27:37.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.906 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.906 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.906 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256215+0000", 2024-04-26T12:27:37.906 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010016700000000001 2024-04-26T12:27:37.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.906 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.906 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:37.906 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256368+0000", 2024-04-26T12:27:37.906 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015244999999999999 2024-04-26T12:27:37.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.906 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.906 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:37.907 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260313+0000", 2024-04-26T12:27:37.907 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00394481 2024-04-26T12:27:37.907 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.907 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.907 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.907 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262895+0000", 2024-04-26T12:27:37.907 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0025824670000000002 2024-04-26T12:27:37.907 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.907 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.907 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:37.907 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262946+0000", 2024-04-26T12:27:37.907 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1072999999999997e-05 2024-04-26T12:27:37.907 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.907 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.908 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.908 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262985+0000", 2024-04-26T12:27:37.908 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8529000000000003e-05 2024-04-26T12:27:37.908 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.908 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.908 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.908 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.908 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.908 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.908 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:37.908 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.625686029999997, 2024-04-26T12:27:37.908 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011070178999999999, 2024-04-26T12:27:37.908 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.908 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.909 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.909 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.909 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.909 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:37.909 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.909 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.909 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.909 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.909 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:37.909 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.909 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.909 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.909 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.910 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:37.910 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.910 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.910 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.910 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.910 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253724+0000", 2024-04-26T12:27:37.910 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0890000000000002e-06 2024-04-26T12:27:37.910 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.910 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.910 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.910 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253736+0000", 2024-04-26T12:27:37.910 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2252999999999999e-05 2024-04-26T12:27:37.910 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.910 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.911 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.911 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253742+0000", 2024-04-26T12:27:37.911 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9499999999999998e-06 2024-04-26T12:27:37.911 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.911 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.911 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.911 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256230+0000", 2024-04-26T12:27:37.911 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002488114 2024-04-26T12:27:37.911 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.911 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.911 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.911 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256421+0000", 2024-04-26T12:27:37.911 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019087999999999999 2024-04-26T12:27:37.912 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.912 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.912 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:37.912 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256583+0000", 2024-04-26T12:27:37.912 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000162566 2024-04-26T12:27:37.912 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.912 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.912 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:37.912 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260316+0000", 2024-04-26T12:27:37.912 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037329239999999999 2024-04-26T12:27:37.912 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.912 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.912 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.912 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264713+0000", 2024-04-26T12:27:37.913 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043968380000000001 2024-04-26T12:27:37.913 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.913 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.913 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:37.913 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:37.913 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1124000000000001e-05 2024-04-26T12:27:37.913 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.913 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.913 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.913 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264790+0000", 2024-04-26T12:27:37.913 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5923999999999997e-05 2024-04-26T12:27:37.913 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.913 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.913 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.914 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.914 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.914 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.914 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:37.914 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.625654214000001, 2024-04-26T12:27:37.914 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0086059009999999991, 2024-04-26T12:27:37.914 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.914 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.914 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.914 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.914 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.914 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:37.914 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.914 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.915 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.915 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.915 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:37.915 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.915 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.915 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.915 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.915 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253751+0000", 2024-04-26T12:27:37.915 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.915 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.915 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.915 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.915 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253756+0000", 2024-04-26T12:27:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9740000000000001e-06 2024-04-26T12:27:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253762+0000", 2024-04-26T12:27:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9769999999999997e-06 2024-04-26T12:27:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253767+0000", 2024-04-26T12:27:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:27:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.917 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254160+0000", 2024-04-26T12:27:37.917 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039256700000000002 2024-04-26T12:27:37.917 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.917 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.917 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.917 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254292+0000", 2024-04-26T12:27:37.917 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013190399999999999 2024-04-26T12:27:37.917 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.917 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.917 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:37.917 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254453+0000", 2024-04-26T12:27:37.917 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000160982 2024-04-26T12:27:37.917 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.917 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.918 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:37.918 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257354+0000", 2024-04-26T12:27:37.918 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029008229999999999 2024-04-26T12:27:37.918 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.918 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.918 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.918 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262281+0000", 2024-04-26T12:27:37.918 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049274760000000001 2024-04-26T12:27:37.918 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.918 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.918 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:37.918 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262323+0000", 2024-04-26T12:27:37.918 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.189e-05 2024-04-26T12:27:37.918 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.919 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.919 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.919 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262358+0000", 2024-04-26T12:27:37.919 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4826000000000002e-05 2024-04-26T12:27:37.919 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.919 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.919 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.919 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.919 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.919 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:32 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.919 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:37.919 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.625298162, 2024-04-26T12:27:37.919 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083641310000000003, 2024-04-26T12:27:37.920 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.920 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:37.920 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.920 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.920 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.920 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:37.920 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.920 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.920 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.920 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.920 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:37.920 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.920 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.920 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.921 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.921 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254107+0000", 2024-04-26T12:27:37.921 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:37.921 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.921 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.921 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.921 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254113+0000", 2024-04-26T12:27:37.921 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:27:37.921 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.921 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.921 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.921 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254122+0000", 2024-04-26T12:27:37.921 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.149e-06 2024-04-26T12:27:37.921 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.922 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.922 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.922 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254131+0000", 2024-04-26T12:27:37.922 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5609999999999999e-06 2024-04-26T12:27:37.922 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.922 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.922 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.922 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255227+0000", 2024-04-26T12:27:37.922 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010961 2024-04-26T12:27:37.922 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.922 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.922 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.922 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255355+0000", 2024-04-26T12:27:37.922 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012883299999999999 2024-04-26T12:27:37.923 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.923 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.923 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.923 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262472+0000", 2024-04-26T12:27:37.923 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071165949999999999 2024-04-26T12:27:37.923 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.923 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.923 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.923 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.923 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.923 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:33 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.924 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:37.924 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.625270037999996, 2024-04-26T12:27:37.924 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012698262, 2024-04-26T12:27:37.924 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.924 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:37.924 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.924 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.924 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.924 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:37.924 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.925 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.925 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.925 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.925 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:37.925 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.925 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.925 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.925 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.925 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:37.925 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.925 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.925 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.925 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.926 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254138+0000", 2024-04-26T12:27:37.926 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2460000000000002e-06 2024-04-26T12:27:37.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.926 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.926 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.926 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254145+0000", 2024-04-26T12:27:37.926 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7070000000000003e-06 2024-04-26T12:27:37.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.926 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.926 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.926 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254164+0000", 2024-04-26T12:27:37.926 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9604999999999999e-05 2024-04-26T12:27:37.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.927 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.927 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.927 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257574+0000", 2024-04-26T12:27:37.927 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034098980000000002 2024-04-26T12:27:37.927 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.927 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.927 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.927 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257731+0000", 2024-04-26T12:27:37.927 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015735400000000001 2024-04-26T12:27:37.927 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.927 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.927 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.927 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266834+0000", 2024-04-26T12:27:37.927 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091028099999999994 2024-04-26T12:27:37.928 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.928 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.928 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.928 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.928 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.928 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:37.928 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:37.928 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.625234298999999, 2024-04-26T12:27:37.928 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0087469690000000003, 2024-04-26T12:27:37.928 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.928 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:37.928 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.928 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.929 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.929 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:37.929 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.929 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.929 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.929 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.929 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:37.929 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.929 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.929 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.929 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.929 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254171+0000", 2024-04-26T12:27:37.929 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.930 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.930 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.930 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.930 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254178+0000", 2024-04-26T12:27:37.930 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7710000000000001e-06 2024-04-26T12:27:37.930 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.930 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.930 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.930 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254185+0000", 2024-04-26T12:27:37.930 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6249999999999998e-06 2024-04-26T12:27:37.930 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.930 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.930 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.931 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254203+0000", 2024-04-26T12:27:37.931 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8003999999999999e-05 2024-04-26T12:27:37.931 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.931 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.931 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.931 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254408+0000", 2024-04-26T12:27:37.931 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020469100000000001 2024-04-26T12:27:37.931 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.931 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.931 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.931 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254525+0000", 2024-04-26T12:27:37.931 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000116319 2024-04-26T12:27:37.931 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.931 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.932 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.932 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262919+0000", 2024-04-26T12:27:37.932 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083942440000000004 2024-04-26T12:27:37.932 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.932 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.932 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.932 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.932 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.932 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:18 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:37.932 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:37.932 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.618024761999997, 2024-04-26T12:27:37.932 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016521190000000001, 2024-04-26T12:27:37.932 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.933 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.933 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.933 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.933 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.933 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:37.933 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.933 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.933 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.933 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.933 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:37.933 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.933 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.933 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.933 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.934 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:37.934 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.934 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.934 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.934 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.934 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261387+0000", 2024-04-26T12:27:37.934 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4880000000000004e-06 2024-04-26T12:27:37.934 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.934 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.934 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.934 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261396+0000", 2024-04-26T12:27:37.934 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2209999999999997e-06 2024-04-26T12:27:37.935 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.935 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.935 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.935 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261414+0000", 2024-04-26T12:27:37.935 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8386e-05 2024-04-26T12:27:37.935 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.935 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.935 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.935 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261460+0000", 2024-04-26T12:27:37.935 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6029999999999998e-05 2024-04-26T12:27:37.935 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.935 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.935 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.936 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261516+0000", 2024-04-26T12:27:37.936 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6418000000000001e-05 2024-04-26T12:27:37.936 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.936 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.936 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:37.936 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263008+0000", 2024-04-26T12:27:37.936 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0014912910000000001 2024-04-26T12:27:37.936 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.936 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.936 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.936 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263033+0000", 2024-04-26T12:27:37.936 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5763e-05 2024-04-26T12:27:37.936 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.936 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.937 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.937 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.937 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.937 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:28 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:37.937 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:37.937 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.617820064999997, 2024-04-26T12:27:37.937 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001530869, 2024-04-26T12:27:37.937 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.937 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.937 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.937 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.937 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.937 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:37.937 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.938 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.938 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.938 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.938 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:37.938 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.938 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.938 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.938 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.938 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:37.938 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.938 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.938 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.938 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.938 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261597+0000", 2024-04-26T12:27:37.939 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1344e-05 2024-04-26T12:27:37.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.939 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.939 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.939 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261605+0000", 2024-04-26T12:27:37.939 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9039999999999992e-06 2024-04-26T12:27:37.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.939 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.939 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.939 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261612+0000", 2024-04-26T12:27:37.939 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8580000000000002e-06 2024-04-26T12:27:37.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.939 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.939 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.940 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261886+0000", 2024-04-26T12:27:37.940 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027415399999999998 2024-04-26T12:27:37.940 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.940 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.940 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.940 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261905+0000", 2024-04-26T12:27:37.940 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8898000000000001e-05 2024-04-26T12:27:37.940 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.940 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.940 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:37.940 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263093+0000", 2024-04-26T12:27:37.940 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011877490000000001 2024-04-26T12:27:37.940 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.941 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.941 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.941 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263117+0000", 2024-04-26T12:27:37.941 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4338999999999999e-05 2024-04-26T12:27:37.941 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.941 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.941 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.941 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.941 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.941 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing_reply(3.b epoch 15/13 rep_tid 4 lcod 15'2)", 2024-04-26T12:27:37.941 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:37.941 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.617133129999999, 2024-04-26T12:27:37.941 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020538300000000001, 2024-04-26T12:27:37.941 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.942 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:37.942 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.942 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.942 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.942 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:37.942 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.942 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.942 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.942 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.942 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:37.942 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.942 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.942 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.943 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.943 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262272+0000", 2024-04-26T12:27:37.943 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:37.943 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.943 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.943 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.943 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262277+0000", 2024-04-26T12:27:37.943 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9169999999999997e-06 2024-04-26T12:27:37.943 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.943 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.943 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.943 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262287+0000", 2024-04-26T12:27:37.943 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0237e-05 2024-04-26T12:27:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262297+0000", 2024-04-26T12:27:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3219999999999999e-06 2024-04-26T12:27:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262382+0000", 2024-04-26T12:27:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4969999999999995e-05 2024-04-26T12:27:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262478+0000", 2024-04-26T12:27:37.945 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6704000000000001e-05 2024-04-26T12:27:37.945 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.945 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.945 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.945 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.945 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.945 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e15/13 ondisk, result = 0)", 2024-04-26T12:27:37.945 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:37.945 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.616688592999999, 2024-04-26T12:27:37.945 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027471, 2024-04-26T12:27:37.945 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.945 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:37.945 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.946 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.946 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.946 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:37.946 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.946 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.946 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.946 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.946 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:37.946 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.946 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.946 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.946 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.946 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:37.947 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.947 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.947 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.947 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.947 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262720+0000", 2024-04-26T12:27:37.947 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4509999999999999e-06 2024-04-26T12:27:37.947 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.947 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.947 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.947 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262726+0000", 2024-04-26T12:27:37.947 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8599999999999998e-06 2024-04-26T12:27:37.947 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.947 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.947 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.948 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262732+0000", 2024-04-26T12:27:37.948 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5889999999999999e-06 2024-04-26T12:27:37.948 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.948 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.948 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.948 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262882+0000", 2024-04-26T12:27:37.948 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014968800000000001 2024-04-26T12:27:37.948 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.948 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.948 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.948 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262890+0000", 2024-04-26T12:27:37.948 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9279999999999993e-06 2024-04-26T12:27:37.948 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.948 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.949 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.949 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262992+0000", 2024-04-26T12:27:37.949 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010247300000000001 2024-04-26T12:27:37.949 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.949 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.949 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.949 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.949 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.949 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:37.949 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:37.949 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.615016034, 2024-04-26T12:27:37.949 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021676200000000001, 2024-04-26T12:27:37.949 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.949 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:37.950 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.950 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.950 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.950 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:37.950 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.950 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.950 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.950 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.950 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:37.950 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.950 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.950 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.951 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.951 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:37.951 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.951 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.951 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.951 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.951 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264404+0000", 2024-04-26T12:27:37.951 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3998999999999999e-05 2024-04-26T12:27:37.951 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.951 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.951 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.951 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264411+0000", 2024-04-26T12:27:37.951 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:27:37.951 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.952 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.952 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.952 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264424+0000", 2024-04-26T12:27:37.952 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2843999999999999e-05 2024-04-26T12:27:37.952 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.952 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.952 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.952 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264485+0000", 2024-04-26T12:27:37.952 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0464000000000002e-05 2024-04-26T12:27:37.952 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.952 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.952 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.952 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264493+0000", 2024-04-26T12:27:37.952 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.507e-06 2024-04-26T12:27:37.953 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.953 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.953 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.953 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264607+0000", 2024-04-26T12:27:37.953 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000113591 2024-04-26T12:27:37.953 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.953 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.953 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.953 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.953 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.953 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:21 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:37.953 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:37.953 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.614976306999999, 2024-04-26T12:27:37.953 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00037041599999999999, 2024-04-26T12:27:37.954 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.954 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:37.954 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.954 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.954 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.954 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:37.954 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.954 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.954 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.954 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.954 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:37.954 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.954 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.955 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.955 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.955 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264429+0000", 2024-04-26T12:27:37.955 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.955 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.955 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.955 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.955 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264432+0000", 2024-04-26T12:27:37.955 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0770000000000002e-06 2024-04-26T12:27:37.955 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.955 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.955 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.955 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264435+0000", 2024-04-26T12:27:37.955 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8340000000000001e-06 2024-04-26T12:27:37.956 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.956 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.956 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.956 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264438+0000", 2024-04-26T12:27:37.956 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5280000000000002e-06 2024-04-26T12:27:37.956 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.956 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.956 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.956 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264703+0000", 2024-04-26T12:27:37.956 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026548400000000002 2024-04-26T12:27:37.956 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.956 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.956 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.956 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264709+0000", 2024-04-26T12:27:37.957 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8390000000000003e-06 2024-04-26T12:27:37.957 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.957 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.957 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.957 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264800+0000", 2024-04-26T12:27:37.957 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0931000000000001e-05 2024-04-26T12:27:37.957 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.957 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.957 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.957 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.957 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.957 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:37.957 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:37.957 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.614170406, 2024-04-26T12:27:37.958 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016589860000000001, 2024-04-26T12:27:37.958 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.958 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.958 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.958 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.958 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.958 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:37.958 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.958 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.958 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.958 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.958 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:37.958 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.959 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.959 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.959 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.959 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265235+0000", 2024-04-26T12:27:37.959 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:37.959 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.959 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.959 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.959 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265252+0000", 2024-04-26T12:27:37.959 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6307000000000002e-05 2024-04-26T12:27:37.959 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.959 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.959 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265257+0000", 2024-04-26T12:27:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8279999999999999e-06 2024-04-26T12:27:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265263+0000", 2024-04-26T12:27:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9399999999999999e-06 2024-04-26T12:27:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265300+0000", 2024-04-26T12:27:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6315e-05 2024-04-26T12:27:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.960 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.961 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.961 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265312+0000", 2024-04-26T12:27:37.961 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2451e-05 2024-04-26T12:27:37.961 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.961 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.961 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:37.961 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266864+0000", 2024-04-26T12:27:37.961 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015521090000000001 2024-04-26T12:27:37.961 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.961 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.961 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.961 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266895+0000", 2024-04-26T12:27:37.961 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0426e-05 2024-04-26T12:27:37.961 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.962 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.962 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.962 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.962 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.962 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:22 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:37.962 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:37.962 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.614049666, 2024-04-26T12:27:37.962 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021988139999999999, 2024-04-26T12:27:37.962 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.962 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.962 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.962 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.962 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.962 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:37.963 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.963 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.963 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.963 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.963 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:37.963 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.963 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.963 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.963 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.963 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:37.963 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967296 2024-04-26T12:27:37.963 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.963 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.964 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.964 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265361+0000", 2024-04-26T12:27:37.964 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6979999999999997e-06 2024-04-26T12:27:37.964 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.964 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.964 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.964 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265366+0000", 2024-04-26T12:27:37.964 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6550000000000003e-06 2024-04-26T12:27:37.964 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.964 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.964 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.964 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265379+0000", 2024-04-26T12:27:37.964 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.358e-05 2024-04-26T12:27:37.964 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.965 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.965 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.965 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265535+0000", 2024-04-26T12:27:37.965 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015586800000000001 2024-04-26T12:27:37.965 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.965 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.965 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.965 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265556+0000", 2024-04-26T12:27:37.965 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1202000000000001e-05 2024-04-26T12:27:37.965 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.965 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.965 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:37.965 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267528+0000", 2024-04-26T12:27:37.965 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0019722099999999998 2024-04-26T12:27:37.966 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.966 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.966 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.966 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267555+0000", 2024-04-26T12:27:37.966 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6775999999999999e-05 2024-04-26T12:27:37.966 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.966 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.966 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.966 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.966 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.966 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-26T12:27:37.966 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:37.966 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 39.969031493999999, 2024-04-26T12:27:37.967 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020315099999999998, 2024-04-26T12:27:37.967 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.967 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.967 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.967 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.967 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.967 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:37.967 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.967 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.967 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.967 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.967 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:37.967 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.968 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.968 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.968 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.968 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910372+0000", 2024-04-26T12:27:37.968 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-26T12:27:37.968 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.968 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.968 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.968 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910387+0000", 2024-04-26T12:27:37.968 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5252999999999999e-05 2024-04-26T12:27:37.968 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.968 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.968 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.969 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910418+0000", 2024-04-26T12:27:37.969 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0778999999999998e-05 2024-04-26T12:27:37.969 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.969 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.969 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.969 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910437+0000", 2024-04-26T12:27:37.969 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9619999999999998e-05 2024-04-26T12:27:37.969 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.969 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.969 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.969 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910587+0000", 2024-04-26T12:27:37.969 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014922000000000001 2024-04-26T12:27:37.969 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.969 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.970 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.970 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910837+0000", 2024-04-26T12:27:37.970 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025089099999999999 2024-04-26T12:27:37.970 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.970 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.970 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:37.970 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910973+0000", 2024-04-26T12:27:37.970 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000135124 2024-04-26T12:27:37.970 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.970 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.970 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:37.970 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.911616+0000", 2024-04-26T12:27:37.971 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00064392799999999999 2024-04-26T12:27:37.971 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.971 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.971 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.971 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912341+0000", 2024-04-26T12:27:37.971 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00072415700000000001 2024-04-26T12:27:37.971 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.971 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.971 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:37.971 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912379+0000", 2024-04-26T12:27:37.971 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8724999999999999e-05 2024-04-26T12:27:37.971 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.971 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.972 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.972 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912406+0000", 2024-04-26T12:27:37.972 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6752999999999999e-05 2024-04-26T12:27:37.972 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.972 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.972 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.972 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.972 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.972 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-26T12:27:37.972 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:37.972 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.968363282, 2024-04-26T12:27:37.972 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0013630599999999999, 2024-04-26T12:27:37.972 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:37.972 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:37.973 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:37.973 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.973 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:37.973 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:37.973 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.973 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.973 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.973 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:37.973 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:37.973 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:37.973 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.973 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.973 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:37.974 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911041+0000", 2024-04-26T12:27:37.974 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999976 2024-04-26T12:27:37.974 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.974 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.974 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:37.974 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911057+0000", 2024-04-26T12:27:37.974 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6549999999999999e-05 2024-04-26T12:27:37.974 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.974 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.974 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:37.974 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911088+0000", 2024-04-26T12:27:37.974 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0753000000000002e-05 2024-04-26T12:27:37.974 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.975 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.975 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:37.975 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911107+0000", 2024-04-26T12:27:37.975 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9425000000000001e-05 2024-04-26T12:27:37.975 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.975 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.975 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:37.975 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911258+0000", 2024-04-26T12:27:37.975 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000150252 2024-04-26T12:27:37.975 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.975 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.975 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:37.975 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911379+0000", 2024-04-26T12:27:37.975 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012129900000000001 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911529+0000", 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015010699999999999 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912214+0000", 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00068528199999999995 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912343+0000", 2024-04-26T12:27:37.976 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012858800000000001 2024-04-26T12:27:37.977 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.977 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.977 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:37.977 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912378+0000", 2024-04-26T12:27:37.977 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5420000000000003e-05 2024-04-26T12:27:37.977 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:37.977 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:37.977 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:37.977 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912406+0000", 2024-04-26T12:27:37.977 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7594e-05 2024-04-26T12:27:37.977 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.977 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.977 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.977 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:37.978 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:37.978 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:37.978 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:27:37.980 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:37.978+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:37.980 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:38.080 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:38.079+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:38.119 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:38.120 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:38.120 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:38.120 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:38.131 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:38.143 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:38.163 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:38.182 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:38.180+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:38.182 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:38.184 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:38.184 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:38.184 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:38.258 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:38.258 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:38.268 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:38.282 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:38.281+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:38.383 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:38.382+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:38.393 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:38.393 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:38.403 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:38.484 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:38.483+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:38.543 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:38.543 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:38.553 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:38.594 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:38.593+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:38.652 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:27:38.653 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:27:38.653 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:27:38.654 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-26T12:27:38.654 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:27:38.654 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:27:38.654 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-26T12:27:38.686 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:38.685+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:38.719 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:38.720 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:38.730 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:38.780 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:38.780 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T12:27:38.780 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:38.788 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:38.786+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:38.856 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:38.856 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:38.866 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:38.888 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:38.887+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:38.989 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:38.989+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:39.008 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:39.008 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:39.018 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:39.090 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:39.089+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:39.145 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:39.146 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:39.155 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:39.191 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:39.191+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:39.291 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:39.291+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:39.322 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:39.322 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:39.333 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:39.392 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:39.391+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:39.462 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:39.462 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:39.472 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:39.494 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:39.492+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:39.595 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:39.594+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:39.597 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:39.597 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:39.607 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:39.650 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2024-04-26T12:27:39.696 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:39.695+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:39.735 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:39.735 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:39.745 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:39.797 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:39.796+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:39.882 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:39.883 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:39.893 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:39.898 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:39.896+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:39.998 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:39.996+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:40.020 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:40.020 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:40.030 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:40.099 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:40.098+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:40.195 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:27:40.196 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:40.197 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:40.199 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:40.198+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:40.206 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:40.300 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:40.299+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:40.347 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:40.347 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:40.357 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:40.359 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:40.379 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:40.398 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:40.400 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:40.401 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:40.400+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:40.485 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:40.485 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:40.485 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T12:27:40.485 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T12:27:40.485 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:40.495 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:40.539 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:40.538+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:40.603 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:40.603+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:40.623 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:40.623 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T12:27:40.623 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T12:27:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T12:27:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 3 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:27:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.368616863, 2024-04-26T12:27:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0048986250000000002, 2024-04-26T12:27:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.625 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.625 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.625 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:40.625 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.625 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.625 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.625 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.625 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:40.625 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:40.625 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.625 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.625 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.625 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253094+0000", 2024-04-26T12:27:40.626 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0924000000000001e-05 2024-04-26T12:27:40.626 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.626 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.626 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.626 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253109+0000", 2024-04-26T12:27:40.626 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4982e-05 2024-04-26T12:27:40.626 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.626 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.626 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.626 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253127+0000", 2024-04-26T12:27:40.626 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8586000000000001e-05 2024-04-26T12:27:40.626 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.626 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.626 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.627 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253214+0000", 2024-04-26T12:27:40.627 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6234000000000001e-05 2024-04-26T12:27:40.627 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.627 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.627 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.627 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257982+0000", 2024-04-26T12:27:40.627 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0047682150000000001 2024-04-26T12:27:40.627 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.627 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.627 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.627 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.627 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.627 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:40.627 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:40.628 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.368173704, 2024-04-26T12:27:40.628 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010912543, 2024-04-26T12:27:40.628 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.628 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:40.628 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.628 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.628 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.628 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:40.628 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.628 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.628 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.628 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.628 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:40.628 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253521+0000", 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999943 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253542+0000", 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1061999999999999e-05 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253606+0000", 2024-04-26T12:27:40.629 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4012999999999999e-05 2024-04-26T12:27:40.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.630 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.630 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253619+0000", 2024-04-26T12:27:40.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3091999999999999e-05 2024-04-26T12:27:40.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.630 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.630 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:40.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013321599999999999 2024-04-26T12:27:40.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.630 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.630 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253923+0000", 2024-04-26T12:27:40.631 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017127900000000001 2024-04-26T12:27:40.631 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.631 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.631 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:40.631 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254085+0000", 2024-04-26T12:27:40.631 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000161566 2024-04-26T12:27:40.631 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.631 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.631 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:40.631 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257500+0000", 2024-04-26T12:27:40.631 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034156880000000001 2024-04-26T12:27:40.631 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.631 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.632 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:40.632 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264372+0000", 2024-04-26T12:27:40.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068719760000000001 2024-04-26T12:27:40.632 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.632 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.632 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:40.632 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264402+0000", 2024-04-26T12:27:40.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9128e-05 2024-04-26T12:27:40.632 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.632 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.632 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.632 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264439+0000", 2024-04-26T12:27:40.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7251e-05 2024-04-26T12:27:40.632 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.368064601999997, 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010957691, 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:40.633 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:40.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:40.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:40.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253639+0000", 2024-04-26T12:27:40.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:27:40.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.635 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253648+0000", 2024-04-26T12:27:40.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:27:40.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.635 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253655+0000", 2024-04-26T12:27:40.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8909999999999998e-06 2024-04-26T12:27:40.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.636 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254807+0000", 2024-04-26T12:27:40.636 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001151712 2024-04-26T12:27:40.636 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.636 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.636 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.636 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255417+0000", 2024-04-26T12:27:40.636 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00061023000000000002 2024-04-26T12:27:40.636 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.636 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.636 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:40.636 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255573+0000", 2024-04-26T12:27:40.636 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015571399999999999 2024-04-26T12:27:40.636 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.636 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.637 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:40.637 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260113+0000", 2024-04-26T12:27:40.637 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045405519999999998 2024-04-26T12:27:40.637 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.637 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.637 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:40.637 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264499+0000", 2024-04-26T12:27:40.637 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043857050000000002 2024-04-26T12:27:40.637 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.637 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.637 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:40.637 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264552+0000", 2024-04-26T12:27:40.637 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2602000000000002e-05 2024-04-26T12:27:40.638 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.638 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.638 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.638 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264593+0000", 2024-04-26T12:27:40.638 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1341000000000003e-05 2024-04-26T12:27:40.638 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.638 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.638 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.638 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.638 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.638 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:40.638 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:40.638 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.368039195999998, 2024-04-26T12:27:40.638 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091815760000000003, 2024-04-26T12:27:40.639 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.639 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:40.639 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.639 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:40.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.639 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:40.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.640 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.640 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253660+0000", 2024-04-26T12:27:40.640 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:40.640 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.640 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.640 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.640 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253664+0000", 2024-04-26T12:27:40.640 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:27:40.640 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.640 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.640 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.640 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253679+0000", 2024-04-26T12:27:40.640 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4208e-05 2024-04-26T12:27:40.640 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253685+0000", 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254897+0000", 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001211801 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255009+0000", 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011189 2024-04-26T12:27:40.641 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.642 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.642 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:40.642 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255142+0000", 2024-04-26T12:27:40.642 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013265799999999999 2024-04-26T12:27:40.642 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.642 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.642 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:40.642 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.259665+0000", 2024-04-26T12:27:40.642 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004523862 2024-04-26T12:27:40.642 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.642 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.642 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:40.642 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262759+0000", 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003093391 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262805+0000", 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6399000000000001e-05 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262842+0000", 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7184000000000002e-05 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.643 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.368009286000003, 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092939230000000008, 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.644 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.645 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:40.645 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.645 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.645 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.645 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.645 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253690+0000", 2024-04-26T12:27:40.645 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:40.645 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.645 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.645 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.645 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253695+0000", 2024-04-26T12:27:40.645 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6090000000000003e-06 2024-04-26T12:27:40.645 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.645 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.646 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.646 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253705+0000", 2024-04-26T12:27:40.646 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0326000000000001e-05 2024-04-26T12:27:40.646 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.646 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.646 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.646 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253714+0000", 2024-04-26T12:27:40.646 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:27:40.646 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.646 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.646 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.646 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256115+0000", 2024-04-26T12:27:40.646 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024015450000000002 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256215+0000", 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010016700000000001 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256368+0000", 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015244999999999999 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260313+0000", 2024-04-26T12:27:40.647 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00394481 2024-04-26T12:27:40.648 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.648 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.648 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:40.648 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262895+0000", 2024-04-26T12:27:40.648 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0025824670000000002 2024-04-26T12:27:40.648 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.648 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.648 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:40.648 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262946+0000", 2024-04-26T12:27:40.648 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1072999999999997e-05 2024-04-26T12:27:40.649 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.649 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.649 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.649 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262985+0000", 2024-04-26T12:27:40.649 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8529000000000003e-05 2024-04-26T12:27:40.649 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.649 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.649 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.649 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.649 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.649 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:40.649 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:40.649 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.367979925, 2024-04-26T12:27:40.649 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011070178999999999, 2024-04-26T12:27:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.650 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.651 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.651 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:40.651 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:40.651 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.651 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.651 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.651 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253724+0000", 2024-04-26T12:27:40.651 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0890000000000002e-06 2024-04-26T12:27:40.651 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.651 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.651 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.651 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253736+0000", 2024-04-26T12:27:40.652 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2252999999999999e-05 2024-04-26T12:27:40.652 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.652 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.652 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.652 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253742+0000", 2024-04-26T12:27:40.652 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9499999999999998e-06 2024-04-26T12:27:40.652 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.652 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.652 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.652 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256230+0000", 2024-04-26T12:27:40.652 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002488114 2024-04-26T12:27:40.652 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.652 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.652 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.653 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256421+0000", 2024-04-26T12:27:40.653 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019087999999999999 2024-04-26T12:27:40.653 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.653 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.653 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:40.653 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256583+0000", 2024-04-26T12:27:40.653 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000162566 2024-04-26T12:27:40.653 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.653 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.653 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:40.653 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260316+0000", 2024-04-26T12:27:40.653 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037329239999999999 2024-04-26T12:27:40.653 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.653 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.654 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:40.654 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264713+0000", 2024-04-26T12:27:40.654 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043968380000000001 2024-04-26T12:27:40.654 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.654 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.654 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:40.654 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:40.654 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1124000000000001e-05 2024-04-26T12:27:40.654 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.654 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.654 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.654 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264790+0000", 2024-04-26T12:27:40.654 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5923999999999997e-05 2024-04-26T12:27:40.655 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.655 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.655 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.655 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.655 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.655 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:40.655 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:40.655 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.367948108999997, 2024-04-26T12:27:40.655 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0086059009999999991, 2024-04-26T12:27:40.655 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.655 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:40.655 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.655 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.655 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.656 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:40.656 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.656 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.656 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.656 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.656 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:40.656 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.656 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.656 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.656 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.656 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253751+0000", 2024-04-26T12:27:40.656 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:40.656 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.656 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.657 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.657 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253756+0000", 2024-04-26T12:27:40.657 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9740000000000001e-06 2024-04-26T12:27:40.657 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.657 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.657 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.657 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253762+0000", 2024-04-26T12:27:40.657 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9769999999999997e-06 2024-04-26T12:27:40.657 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.657 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.657 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.657 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253767+0000", 2024-04-26T12:27:40.657 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:27:40.657 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.658 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.658 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.658 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254160+0000", 2024-04-26T12:27:40.658 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039256700000000002 2024-04-26T12:27:40.658 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.658 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.658 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.658 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254292+0000", 2024-04-26T12:27:40.658 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013190399999999999 2024-04-26T12:27:40.658 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.658 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.658 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:40.658 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254453+0000", 2024-04-26T12:27:40.658 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000160982 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257354+0000", 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029008229999999999 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262281+0000", 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049274760000000001 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262323+0000", 2024-04-26T12:27:40.659 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.189e-05 2024-04-26T12:27:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262358+0000", 2024-04-26T12:27:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4826000000000002e-05 2024-04-26T12:27:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:32 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.367592057000003, 2024-04-26T12:27:40.660 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083641310000000003, 2024-04-26T12:27:40.661 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.661 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:40.661 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.661 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.661 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.661 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:40.661 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.661 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.661 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.661 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.661 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:40.661 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.661 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.661 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.662 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.662 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254107+0000", 2024-04-26T12:27:40.662 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:40.662 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.662 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.662 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.662 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254113+0000", 2024-04-26T12:27:40.662 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:27:40.662 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.662 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.662 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.662 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254122+0000", 2024-04-26T12:27:40.662 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.149e-06 2024-04-26T12:27:40.662 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.663 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.663 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.663 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254131+0000", 2024-04-26T12:27:40.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5609999999999999e-06 2024-04-26T12:27:40.663 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.663 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.663 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.663 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255227+0000", 2024-04-26T12:27:40.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010961 2024-04-26T12:27:40.663 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.663 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.663 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.663 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255355+0000", 2024-04-26T12:27:40.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012883299999999999 2024-04-26T12:27:40.664 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.664 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.664 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262472+0000", 2024-04-26T12:27:40.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071165949999999999 2024-04-26T12:27:40.664 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.664 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.664 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.664 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.664 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:33 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:40.664 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:40.664 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.367563933, 2024-04-26T12:27:40.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012698262, 2024-04-26T12:27:40.665 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.665 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:40.665 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:40.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:40.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.666 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.666 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:40.666 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:40.666 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.666 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.666 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254138+0000", 2024-04-26T12:27:40.666 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2460000000000002e-06 2024-04-26T12:27:40.666 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.666 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.666 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254145+0000", 2024-04-26T12:27:40.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7070000000000003e-06 2024-04-26T12:27:40.667 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.667 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.667 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254164+0000", 2024-04-26T12:27:40.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9604999999999999e-05 2024-04-26T12:27:40.667 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.667 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.667 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257574+0000", 2024-04-26T12:27:40.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034098980000000002 2024-04-26T12:27:40.668 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.668 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.668 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.668 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257731+0000", 2024-04-26T12:27:40.668 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015735400000000001 2024-04-26T12:27:40.668 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.668 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.668 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.668 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266834+0000", 2024-04-26T12:27:40.668 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091028099999999994 2024-04-26T12:27:40.668 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.668 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.668 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.668 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.669 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:40.669 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:40.669 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.367528194000002, 2024-04-26T12:27:40.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0087469690000000003, 2024-04-26T12:27:40.669 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.669 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:40.669 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.669 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.669 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:40.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254171+0000", 2024-04-26T12:27:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254178+0000", 2024-04-26T12:27:40.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7710000000000001e-06 2024-04-26T12:27:40.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254185+0000", 2024-04-26T12:27:40.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6249999999999998e-06 2024-04-26T12:27:40.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254203+0000", 2024-04-26T12:27:40.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8003999999999999e-05 2024-04-26T12:27:40.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254408+0000", 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020469100000000001 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254525+0000", 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000116319 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262919+0000", 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083942440000000004 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.672 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:18 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.360318657000001, 2024-04-26T12:27:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016521190000000001, 2024-04-26T12:27:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:40.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:40.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:40.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261387+0000", 2024-04-26T12:27:40.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4880000000000004e-06 2024-04-26T12:27:40.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261396+0000", 2024-04-26T12:27:40.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2209999999999997e-06 2024-04-26T12:27:40.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261414+0000", 2024-04-26T12:27:40.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8386e-05 2024-04-26T12:27:40.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261460+0000", 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6029999999999998e-05 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261516+0000", 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6418000000000001e-05 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263008+0000", 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0014912910000000001 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263033+0000", 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5763e-05 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:28 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.36011396, 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001530869, 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.677 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.678 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.678 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:40.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.678 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.678 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.678 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:40.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.678 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.678 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.678 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:40.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:40.678 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261597+0000", 2024-04-26T12:27:40.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1344e-05 2024-04-26T12:27:40.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261605+0000", 2024-04-26T12:27:40.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9039999999999992e-06 2024-04-26T12:27:40.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261612+0000", 2024-04-26T12:27:40.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8580000000000002e-06 2024-04-26T12:27:40.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.680 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261886+0000", 2024-04-26T12:27:40.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027415399999999998 2024-04-26T12:27:40.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.680 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261905+0000", 2024-04-26T12:27:40.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8898000000000001e-05 2024-04-26T12:27:40.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263093+0000", 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011877490000000001 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263117+0000", 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4338999999999999e-05 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing_reply(3.b epoch 15/13 rep_tid 4 lcod 15'2)", 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:40.681 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.359427025000002, 2024-04-26T12:27:40.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020538300000000001, 2024-04-26T12:27:40.682 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.682 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:40.682 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:40.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:40.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262272+0000", 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262277+0000", 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9169999999999997e-06 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262287+0000", 2024-04-26T12:27:40.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0237e-05 2024-04-26T12:27:40.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262297+0000", 2024-04-26T12:27:40.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3219999999999999e-06 2024-04-26T12:27:40.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262382+0000", 2024-04-26T12:27:40.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4969999999999995e-05 2024-04-26T12:27:40.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262478+0000", 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6704000000000001e-05 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e15/13 ondisk, result = 0)", 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.358982488000002, 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027471, 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:40.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:40.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:40.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:40.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262720+0000", 2024-04-26T12:27:40.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4509999999999999e-06 2024-04-26T12:27:40.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262726+0000", 2024-04-26T12:27:40.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8599999999999998e-06 2024-04-26T12:27:40.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262732+0000", 2024-04-26T12:27:40.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5889999999999999e-06 2024-04-26T12:27:40.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.688 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262882+0000", 2024-04-26T12:27:40.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014968800000000001 2024-04-26T12:27:40.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.688 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262890+0000", 2024-04-26T12:27:40.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9279999999999993e-06 2024-04-26T12:27:40.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262992+0000", 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010247300000000001 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.357309929000003, 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021676200000000001, 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:40.689 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.690 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:40.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.690 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:40.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.690 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264404+0000", 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3998999999999999e-05 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264411+0000", 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264424+0000", 2024-04-26T12:27:40.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2843999999999999e-05 2024-04-26T12:27:40.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264485+0000", 2024-04-26T12:27:40.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0464000000000002e-05 2024-04-26T12:27:40.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264493+0000", 2024-04-26T12:27:40.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.507e-06 2024-04-26T12:27:40.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.693 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264607+0000", 2024-04-26T12:27:40.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000113591 2024-04-26T12:27:40.693 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.693 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.693 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.693 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:21 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:40.693 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:40.693 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.357270202000002, 2024-04-26T12:27:40.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00037041599999999999, 2024-04-26T12:27:40.693 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.693 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:40.693 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:40.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:40.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264429+0000", 2024-04-26T12:27:40.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:40.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264432+0000", 2024-04-26T12:27:40.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0770000000000002e-06 2024-04-26T12:27:40.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264435+0000", 2024-04-26T12:27:40.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8340000000000001e-06 2024-04-26T12:27:40.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.696 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264438+0000", 2024-04-26T12:27:40.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5280000000000002e-06 2024-04-26T12:27:40.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.696 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.696 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264703+0000", 2024-04-26T12:27:40.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026548400000000002 2024-04-26T12:27:40.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.696 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.696 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264709+0000", 2024-04-26T12:27:40.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8390000000000003e-06 2024-04-26T12:27:40.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.697 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.697 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264800+0000", 2024-04-26T12:27:40.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0931000000000001e-05 2024-04-26T12:27:40.697 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.697 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.697 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.697 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.697 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:40.697 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:40.697 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.356464301000003, 2024-04-26T12:27:40.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016589860000000001, 2024-04-26T12:27:40.697 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.697 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:40.698 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:40.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:40.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265235+0000", 2024-04-26T12:27:40.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:40.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265252+0000", 2024-04-26T12:27:40.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6307000000000002e-05 2024-04-26T12:27:40.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265257+0000", 2024-04-26T12:27:40.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8279999999999999e-06 2024-04-26T12:27:40.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265263+0000", 2024-04-26T12:27:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9399999999999999e-06 2024-04-26T12:27:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265300+0000", 2024-04-26T12:27:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6315e-05 2024-04-26T12:27:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265312+0000", 2024-04-26T12:27:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2451e-05 2024-04-26T12:27:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.701 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:40.701 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266864+0000", 2024-04-26T12:27:40.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015521090000000001 2024-04-26T12:27:40.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.701 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.701 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266895+0000", 2024-04-26T12:27:40.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0426e-05 2024-04-26T12:27:40.701 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.701 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.701 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.702 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:22 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:40.702 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:40.702 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 47.356343561000003, 2024-04-26T12:27:40.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021988139999999999, 2024-04-26T12:27:40.702 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.702 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:40.702 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.702 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.702 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:40.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.702 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:40.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:40.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967296 2024-04-26T12:27:40.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265361+0000", 2024-04-26T12:27:40.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6979999999999997e-06 2024-04-26T12:27:40.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265366+0000", 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6550000000000003e-06 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265379+0000", 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.358e-05 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265535+0000", 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015586800000000001 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265556+0000", 2024-04-26T12:27:40.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1202000000000001e-05 2024-04-26T12:27:40.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:40.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267528+0000", 2024-04-26T12:27:40.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0019722099999999998 2024-04-26T12:27:40.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267555+0000", 2024-04-26T12:27:40.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6775999999999999e-05 2024-04-26T12:27:40.705 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.706 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.706 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.706 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-26T12:27:40.706 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:40.706 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.711325389000002, 2024-04-26T12:27:40.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020315099999999998, 2024-04-26T12:27:40.706 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.706 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:40.706 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910372+0000", 2024-04-26T12:27:40.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-26T12:27:40.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.708 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910387+0000", 2024-04-26T12:27:40.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5252999999999999e-05 2024-04-26T12:27:40.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.708 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910418+0000", 2024-04-26T12:27:40.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0778999999999998e-05 2024-04-26T12:27:40.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.708 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910437+0000", 2024-04-26T12:27:40.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9619999999999998e-05 2024-04-26T12:27:40.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910587+0000", 2024-04-26T12:27:40.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014922000000000001 2024-04-26T12:27:40.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910837+0000", 2024-04-26T12:27:40.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025089099999999999 2024-04-26T12:27:40.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910973+0000", 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000135124 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.911616+0000", 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00064392799999999999 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912341+0000", 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00072415700000000001 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912379+0000", 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8724999999999999e-05 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912406+0000", 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6752999999999999e-05 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-26T12:27:40.711 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:40.712 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 17.710657177000002, 2024-04-26T12:27:40.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0013630599999999999, 2024-04-26T12:27:40.712 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:40.712 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:40.712 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:40.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.712 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:40.712 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:40.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.712 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:40.712 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:40.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:40.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:40.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911041+0000", 2024-04-26T12:27:40.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999976 2024-04-26T12:27:40.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:40.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911057+0000", 2024-04-26T12:27:40.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6549999999999999e-05 2024-04-26T12:27:40.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:40.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911088+0000", 2024-04-26T12:27:40.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0753000000000002e-05 2024-04-26T12:27:40.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:40.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911107+0000", 2024-04-26T12:27:40.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9425000000000001e-05 2024-04-26T12:27:40.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:40.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911258+0000", 2024-04-26T12:27:40.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000150252 2024-04-26T12:27:40.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:40.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911379+0000", 2024-04-26T12:27:40.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012129900000000001 2024-04-26T12:27:40.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.715 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:40.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911529+0000", 2024-04-26T12:27:40.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015010699999999999 2024-04-26T12:27:40.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.715 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:40.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912214+0000", 2024-04-26T12:27:40.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00068528199999999995 2024-04-26T12:27:40.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912343+0000", 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012858800000000001 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912378+0000", 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5420000000000003e-05 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912406+0000", 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7594e-05 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.716 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.717 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.717 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:40.717 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:40.717 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:40.718 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:40.719 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:40.717+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:40.819 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:40.818+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:40.859 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:40.859 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:40.859 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:40.859 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:40.869 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:40.920 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:40.919+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:41.021 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:41.020+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:41.036 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:41.036 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:41.036 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:41.036 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:41.037 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:41.046 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:41.122 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:41.121+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:41.174 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:41.174 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:41.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.290454429999997, 2024-04-26T12:27:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:41.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:41.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:41.179 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.289815083000001, 2024-04-26T12:27:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:41.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.160112892999997, 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:41.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.188 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.159618307000002, 2024-04-26T12:27:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:41.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:41.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.157616122999997, 2024-04-26T12:27:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:41.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:41.197 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.157209782999999, 2024-04-26T12:27:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:41.201 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.156854959, 2024-04-26T12:27:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:41.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:41.206 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.054296545, 2024-04-26T12:27:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:41.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:41.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 54.053900016999997, 2024-04-26T12:27:41.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:41.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.215 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.956890409000003, 2024-04-26T12:27:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:41.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:41.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:41.220 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.956196693000003, 2024-04-26T12:27:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:41.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:41.224 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.921457638, 2024-04-26T12:27:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:41.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:41.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.920636719000001, 2024-04-26T12:27:41.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:41.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:41.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.235 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.920606628999998, 2024-04-26T12:27:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:41.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:41.241 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.920552841000003, 2024-04-26T12:27:41.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:41.242 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.242 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.242 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:41.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:41.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:41.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:41.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:41.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:41.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:41.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:41.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:41.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:41.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:41.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:41.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:41.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:41.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:41.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:41.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:41.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:41.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:41.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:41.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:41.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:41.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:41.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:41.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:41.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.920500283999999, 2024-04-26T12:27:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:41.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:41.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:41.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:41.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:41.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:41.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:41.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:41.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:41.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:41.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:41.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:41.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:41.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:41.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:41.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:41.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:41.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:41.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:41.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:41.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:41.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:41.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:41.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:41.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:41.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:41.252 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.252 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.252 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.252 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.253 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:41.253 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.920460069999997, 2024-04-26T12:27:41.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:41.253 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.253 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.253 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:41.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:41.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:41.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:41.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:41.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:41.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:41.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:41.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:41.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:41.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:41.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:41.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:41.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:41.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:41.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:41.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:41.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:41.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:41.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:41.258 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.258 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.258 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.258 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.258 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:41.259 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.920431909000001, 2024-04-26T12:27:41.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:41.259 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.259 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.259 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:41.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:41.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:41.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:41.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:41.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:41.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:41.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:41.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:41.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:41.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:41.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:41.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:41.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:41.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:41.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:41.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:41.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:41.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:41.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:41.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:41.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:41.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:41.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:41.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:41.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:41.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:41.264 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.265 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.265 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.265 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.265 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:41.265 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.920401220000002, 2024-04-26T12:27:41.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:41.265 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.265 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:41.265 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:41.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:41.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:41.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:41.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:41.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:41.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:41.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:41.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:41.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:41.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:41.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:41.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:41.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:41.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:41.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:41.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.269 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.269 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.269 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:41.270 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.920374647000003, 2024-04-26T12:27:41.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:41.270 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:41.270 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:41.270 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:41.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:41.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:41.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:41.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:41.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:41.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:41.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:41.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:41.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:41.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:41.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:41.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:41.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:41.273 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.273 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.273 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.273 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:41.273 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:41.274 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:41.275 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:41.274+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:41.275 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:41.375 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:41.374+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:41.416 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:41.416 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:41.416 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:41.416 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:41.426 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:41.476 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:41.475+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:41.577 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:41.575+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:41.593 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:41.594 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:41.594 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:41.594 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:41.594 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:41.604 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:41.664 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:27:41.678 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:41.676+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:41.733 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:41.733 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:41.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:41.733 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:41.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.734 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:41.734 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:41.734 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 54.399508621999999, 2024-04-26T12:27:41.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:41.734 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.735 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.735 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:41.735 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:41.735 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:41.735 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:41.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.736 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:41.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:41.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:41.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:41.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:41.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:41.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:41.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:41.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:41.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:41.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:41.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:41.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:41.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:41.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:41.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:41.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:41.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:41.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:41.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:41.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:41.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:41.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:41.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.744 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.745 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.745 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:41.745 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480642799000002, 2024-04-26T12:27:41.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:41.745 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.745 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.745 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:41.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:41.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:41.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:41.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:41.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:41.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:41.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:41.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:41.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:41.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:41.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:41.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:41.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:41.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:41.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:41.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:41.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:41.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:41.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:41.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:41.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:41.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:41.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:41.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:41.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:41.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:41.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:41.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:41.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.752 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.752 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.752 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:41.752 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480606586999997, 2024-04-26T12:27:41.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:41.753 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.753 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.753 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:41.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:41.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:41.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:41.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:41.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:41.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:41.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:41.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:41.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:41.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:41.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:41.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:41.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:41.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:41.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:41.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:41.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:41.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:41.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:41.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:41.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:41.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:41.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:41.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:41.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:41.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:41.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:41.762 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.762 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.762 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.762 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.762 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:41.762 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480567612999998, 2024-04-26T12:27:41.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:41.763 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.763 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.763 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:41.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:41.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:41.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:41.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:41.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:41.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:41.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:41.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:41.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:41.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:41.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:41.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:41.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:41.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:41.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:41.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:41.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:41.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:41.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:41.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:41.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:41.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:41.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:41.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:41.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:41.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:41.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:41.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:41.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.769 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.770 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.770 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:41.770 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480544446000003, 2024-04-26T12:27:41.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:41.770 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.770 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.770 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:41.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:41.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:41.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:41.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:41.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:41.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:41.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:41.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:41.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:41.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:41.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:41.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:41.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:41.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:41.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:41.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:41.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:41.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:41.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:41.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:41.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:41.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:41.776 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.776 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.776 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.776 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.776 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:41.776 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480529068999999, 2024-04-26T12:27:41.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:41.776 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:41.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:41.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:41.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:41.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:41.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:41.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:41.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:41.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:41.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:41.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:41.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:41.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:41.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:41.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:41.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:41.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:41.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:41.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:41.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:41.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:41.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:41.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:41.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:41.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:41.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:41.782 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.782 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.782 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480500878999997, 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:41.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:41.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:41.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:41.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:41.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:41.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:41.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:41.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:41.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:41.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:41.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:41.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:41.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:41.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:41.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:41.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:41.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:41.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:41.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:41.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:41.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:41.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:41.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:41.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:41.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:41.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:41.788 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.788 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.789 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.789 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.789 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:41.789 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480482881, 2024-04-26T12:27:41.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:41.789 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.789 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.789 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:41.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:41.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:41.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:41.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:41.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:41.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:41.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:41.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:41.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:41.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:41.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:41.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:41.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:41.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:41.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:41.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:41.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:41.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:41.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:41.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:41.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:41.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:41.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.795 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.795 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.795 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:41.795 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480458290000001, 2024-04-26T12:27:41.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:41.796 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.796 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.796 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:41.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:41.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:41.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:41.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:41.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:41.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:41.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:41.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:41.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:41.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:41.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:41.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:41.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:41.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:41.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:41.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:41.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:41.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:41.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:41.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:41.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:41.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:41.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:41.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:41.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:41.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:41.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:41.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.801 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.802 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.802 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.802 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:41.802 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480433341000001, 2024-04-26T12:27:41.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:41.802 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.802 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.802 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:41.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:41.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:41.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:41.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:41.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:41.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:41.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:41.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:41.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:41.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:41.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:41.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:41.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:41.808 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.808 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.808 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.808 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.808 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:41.808 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480412416999997, 2024-04-26T12:27:41.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:41.808 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:41.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:41.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:41.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:41.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:41.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:41.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:41.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:41.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:41.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:41.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:41.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:41.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:41.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:41.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:41.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:41.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:41.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:41.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:41.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:41.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:41.815 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.815 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.815 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.815 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.815 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:41.815 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480377568000002, 2024-04-26T12:27:41.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:41.815 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.815 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.815 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:41.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:41.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:41.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:41.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:41.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:41.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:41.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:41.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:41.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:41.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:41.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:41.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:41.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:41.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:41.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:41.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:41.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:41.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:41.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:41.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:41.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:41.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:41.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:41.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:41.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:41.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:41.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:41.821 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.821 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.821 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.821 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.821 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:41.821 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480343617999999, 2024-04-26T12:27:41.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:41.821 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.822 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.822 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:41.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:41.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:41.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:41.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:41.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:41.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:41.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:41.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:41.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:41.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:41.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:41.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:41.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:41.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:41.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:41.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:41.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:41.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:41.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480323321, 2024-04-26T12:27:41.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:41.828 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.828 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.828 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:41.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:41.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:41.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:41.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:41.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:41.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:41.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:41.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:41.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:41.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:41.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:41.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:41.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:41.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480288199999997, 2024-04-26T12:27:41.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:41.834 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.834 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.834 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:41.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:41.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:41.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:41.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:41.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:41.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:41.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:41.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:41.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:41.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:41.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:41.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:41.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:41.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:41.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:41.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:41.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:41.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:41.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:41.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:41.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:41.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:41.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:41.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:41.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:41.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:41.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:41.839 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.839 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.839 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.839 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.840 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:41.840 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480252960000001, 2024-04-26T12:27:41.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:41.840 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.840 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.840 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:41.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:41.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:41.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:41.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:41.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:41.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:41.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:41.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:41.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:41.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:41.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:41.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:41.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:41.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:41.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:41.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:41.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:41.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:41.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:41.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:41.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:41.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:41.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:41.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:41.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:41.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:41.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:41.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:41.845 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.845 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.845 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.846 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.846 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:41.846 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480111211999997, 2024-04-26T12:27:41.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:41.846 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.846 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.846 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:41.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:41.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:41.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:41.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:41.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:41.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:41.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:41.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:41.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:41.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:41.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:41.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:41.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:41.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:41.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:41.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:41.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:41.851 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480087193000003, 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:41.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:41.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:41.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:41.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:41.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:41.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:41.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:41.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:41.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:41.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:41.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:41.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:41.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:41.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:41.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:41.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:41.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:41.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:41.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:41.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:41.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:41.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:41.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:41.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:41.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:41.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:41.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:41.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:41.858 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.858 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.858 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.858 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.858 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:41.858 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480063225000002, 2024-04-26T12:27:41.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:27:41.858 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.858 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:41.858 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:41.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:41.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:27:41.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:27:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:27:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:27:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:27:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:27:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:27:41.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:27:41.863 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.864 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.864 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.864 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:41.864 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:41.864 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.480029844000001, 2024-04-26T12:27:41.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:27:41.864 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:41.864 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:27:41.864 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:41.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:41.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:41.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:27:41.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:27:41.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:41.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:27:41.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:27:41.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:41.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:27:41.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:27:41.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:41.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:27:41.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:27:41.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:41.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:41.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:41.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:27:41.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:27:41.868 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.868 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.868 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.868 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:41.868 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:41.868 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:41.870 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:41.870 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:41.869+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:41.971 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:41.969+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:42.010 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:42.011 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:42.011 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T12:27:42.011 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:42.020 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:42.072 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:42.071+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:42.172 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:42.171+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:42.187 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:42.187 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:27:42.187 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T12:27:42.187 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T12:27:42.188 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:42.197 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:42.273 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:42.272+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:42.366 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:27:42.366 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T12:27:42.366 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T12:27:42.367 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T12:27:42.367 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.367 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing(3.1a epoch 15/13 rep_tid 3 entries 15'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:34 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T12:27:42.367 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:42.367 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.111324023999998, 2024-04-26T12:27:42.367 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0048986250000000002, 2024-04-26T12:27:42.367 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.367 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:42.367 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.367 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.367 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.368 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:42.368 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.368 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.368 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.368 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.368 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:42.368 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.368 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.368 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.368 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.368 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253083+0000", 2024-04-26T12:27:42.369 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:42.369 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.369 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.369 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.369 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253094+0000", 2024-04-26T12:27:42.369 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0924000000000001e-05 2024-04-26T12:27:42.369 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.369 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.369 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.369 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253109+0000", 2024-04-26T12:27:42.369 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4982e-05 2024-04-26T12:27:42.369 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.369 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.370 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.370 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253127+0000", 2024-04-26T12:27:42.370 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8586000000000001e-05 2024-04-26T12:27:42.370 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.370 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.370 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.370 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253214+0000", 2024-04-26T12:27:42.370 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6234000000000001e-05 2024-04-26T12:27:42.373 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.373 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.374 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.374 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257982+0000", 2024-04-26T12:27:42.374 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0047682150000000001 2024-04-26T12:27:42.374 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.374 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.374 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.374 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.374 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.374 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:42.374 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:42.374 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.110880864999999, 2024-04-26T12:27:42.374 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010912543, 2024-04-26T12:27:42.375 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.375 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:42.375 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.375 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.375 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.375 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:42.375 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.375 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.375 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.375 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.375 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253526+0000", 2024-04-26T12:27:42.376 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.376 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.376 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.376 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.376 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253521+0000", 2024-04-26T12:27:42.376 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999943 2024-04-26T12:27:42.376 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.376 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.376 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.376 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253542+0000", 2024-04-26T12:27:42.376 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1061999999999999e-05 2024-04-26T12:27:42.376 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.376 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.376 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.377 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253606+0000", 2024-04-26T12:27:42.377 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4012999999999999e-05 2024-04-26T12:27:42.377 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.377 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.377 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.377 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253619+0000", 2024-04-26T12:27:42.377 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3091999999999999e-05 2024-04-26T12:27:42.377 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.377 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.377 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.377 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:42.377 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013321599999999999 2024-04-26T12:27:42.378 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.378 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.378 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.378 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253923+0000", 2024-04-26T12:27:42.378 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017127900000000001 2024-04-26T12:27:42.378 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.378 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.378 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:42.378 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254085+0000", 2024-04-26T12:27:42.378 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000161566 2024-04-26T12:27:42.378 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.378 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.378 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:42.379 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257500+0000", 2024-04-26T12:27:42.379 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034156880000000001 2024-04-26T12:27:42.379 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.379 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.379 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:42.379 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264372+0000", 2024-04-26T12:27:42.379 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068719760000000001 2024-04-26T12:27:42.379 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.379 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.379 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:42.379 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264402+0000", 2024-04-26T12:27:42.379 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9128e-05 2024-04-26T12:27:42.379 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.379 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.380 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.380 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264439+0000", 2024-04-26T12:27:42.380 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7251e-05 2024-04-26T12:27:42.380 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.380 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.380 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.380 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.380 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.380 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:42.380 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:42.380 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.110771763000002, 2024-04-26T12:27:42.380 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010957691, 2024-04-26T12:27:42.381 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.381 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:42.381 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.381 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.381 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.381 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:42.381 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.381 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.381 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.381 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.381 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:42.381 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.381 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.381 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.382 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.382 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253635+0000", 2024-04-26T12:27:42.382 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:42.382 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.382 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.382 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.382 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253639+0000", 2024-04-26T12:27:42.382 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1200000000000004e-06 2024-04-26T12:27:42.382 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.382 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.382 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.382 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253648+0000", 2024-04-26T12:27:42.382 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3400000000000004e-06 2024-04-26T12:27:42.382 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.383 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.383 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.383 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253655+0000", 2024-04-26T12:27:42.383 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8909999999999998e-06 2024-04-26T12:27:42.383 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.383 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.383 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.383 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254807+0000", 2024-04-26T12:27:42.383 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001151712 2024-04-26T12:27:42.383 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.383 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.383 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.383 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255417+0000", 2024-04-26T12:27:42.383 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00061023000000000002 2024-04-26T12:27:42.384 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.384 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.384 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:42.384 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255573+0000", 2024-04-26T12:27:42.384 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015571399999999999 2024-04-26T12:27:42.384 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.384 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.384 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:42.384 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260113+0000", 2024-04-26T12:27:42.384 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045405519999999998 2024-04-26T12:27:42.384 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.384 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.384 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:42.384 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264499+0000", 2024-04-26T12:27:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043857050000000002 2024-04-26T12:27:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264552+0000", 2024-04-26T12:27:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2602000000000002e-05 2024-04-26T12:27:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264593+0000", 2024-04-26T12:27:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1341000000000003e-05 2024-04-26T12:27:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.386 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.386 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.386 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:20 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:42.386 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:42.386 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.110746356999996, 2024-04-26T12:27:42.386 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091815760000000003, 2024-04-26T12:27:42.386 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.386 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:42.386 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.387 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.387 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.387 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:42.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.387 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.387 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.387 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.387 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253661+0000", 2024-04-26T12:27:42.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.387 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.387 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.387 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.387 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253660+0000", 2024-04-26T12:27:42.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253664+0000", 2024-04-26T12:27:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:27:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253679+0000", 2024-04-26T12:27:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4208e-05 2024-04-26T12:27:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.388 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253685+0000", 2024-04-26T12:27:42.389 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5880000000000003e-06 2024-04-26T12:27:42.389 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.389 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.389 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.389 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254897+0000", 2024-04-26T12:27:42.389 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001211801 2024-04-26T12:27:42.389 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.389 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.389 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.389 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255009+0000", 2024-04-26T12:27:42.389 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011189 2024-04-26T12:27:42.389 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.389 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.389 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:42.390 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255142+0000", 2024-04-26T12:27:42.390 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013265799999999999 2024-04-26T12:27:42.390 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.390 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.390 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:42.390 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.259665+0000", 2024-04-26T12:27:42.390 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004523862 2024-04-26T12:27:42.390 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.390 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.390 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:42.390 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262759+0000", 2024-04-26T12:27:42.390 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003093391 2024-04-26T12:27:42.390 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.391 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.391 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:42.391 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262805+0000", 2024-04-26T12:27:42.391 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6399000000000001e-05 2024-04-26T12:27:42.391 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.391 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.391 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.391 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262842+0000", 2024-04-26T12:27:42.391 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7184000000000002e-05 2024-04-26T12:27:42.391 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.391 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.391 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.391 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.391 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.110716447000001, 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092939230000000008, 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.392 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253691+0000", 2024-04-26T12:27:42.393 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.393 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.393 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.393 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.393 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253690+0000", 2024-04-26T12:27:42.393 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:42.393 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.393 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.393 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.393 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253695+0000", 2024-04-26T12:27:42.393 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6090000000000003e-06 2024-04-26T12:27:42.393 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.393 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.393 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.394 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253705+0000", 2024-04-26T12:27:42.394 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0326000000000001e-05 2024-04-26T12:27:42.394 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.394 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.394 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.394 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253714+0000", 2024-04-26T12:27:42.394 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4349999999999997e-06 2024-04-26T12:27:42.394 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.394 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.395 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.395 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256115+0000", 2024-04-26T12:27:42.395 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024015450000000002 2024-04-26T12:27:42.395 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.395 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.395 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.395 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256215+0000", 2024-04-26T12:27:42.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010016700000000001 2024-04-26T12:27:42.396 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.396 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.396 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:42.396 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256368+0000", 2024-04-26T12:27:42.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015244999999999999 2024-04-26T12:27:42.396 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.396 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.396 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:42.396 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260313+0000", 2024-04-26T12:27:42.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00394481 2024-04-26T12:27:42.397 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.397 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.397 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:42.397 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262895+0000", 2024-04-26T12:27:42.397 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0025824670000000002 2024-04-26T12:27:42.397 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.397 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.397 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:42.397 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262946+0000", 2024-04-26T12:27:42.397 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1072999999999997e-05 2024-04-26T12:27:42.397 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.397 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.397 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.397 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262985+0000", 2024-04-26T12:27:42.398 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8529000000000003e-05 2024-04-26T12:27:42.398 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.398 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.398 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.398 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.398 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.398 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:21 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:42.398 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:42.399 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.110687085999999, 2024-04-26T12:27:42.399 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011070178999999999, 2024-04-26T12:27:42.399 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.399 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:42.399 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.399 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.399 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.399 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:42.399 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.399 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.399 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.400 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.400 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:42.400 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.401 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.401 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.401 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253720+0000", 2024-04-26T12:27:42.401 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:42.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.401 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.401 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.401 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253724+0000", 2024-04-26T12:27:42.401 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0890000000000002e-06 2024-04-26T12:27:42.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.401 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.401 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.402 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253736+0000", 2024-04-26T12:27:42.402 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2252999999999999e-05 2024-04-26T12:27:42.402 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.402 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.402 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.402 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253742+0000", 2024-04-26T12:27:42.402 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9499999999999998e-06 2024-04-26T12:27:42.402 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.402 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.402 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.402 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256230+0000", 2024-04-26T12:27:42.402 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002488114 2024-04-26T12:27:42.402 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.402 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256421+0000", 2024-04-26T12:27:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019087999999999999 2024-04-26T12:27:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.256583+0000", 2024-04-26T12:27:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000162566 2024-04-26T12:27:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.260316+0000", 2024-04-26T12:27:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037329239999999999 2024-04-26T12:27:42.403 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.404 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.404 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:42.404 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264713+0000", 2024-04-26T12:27:42.404 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043968380000000001 2024-04-26T12:27:42.404 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.404 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.404 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:42.404 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:42.404 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1124000000000001e-05 2024-04-26T12:27:42.404 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.404 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.404 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.404 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264790+0000", 2024-04-26T12:27:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5923999999999997e-05 2024-04-26T12:27:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:23 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.110655270000002, 2024-04-26T12:27:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0086059009999999991, 2024-04-26T12:27:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.405 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.406 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.406 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:42.406 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.406 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.406 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.406 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.406 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253752+0000", 2024-04-26T12:27:42.406 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.406 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.406 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.406 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.406 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253751+0000", 2024-04-26T12:27:42.406 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:42.406 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.407 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.407 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.407 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253756+0000", 2024-04-26T12:27:42.407 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9740000000000001e-06 2024-04-26T12:27:42.407 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.407 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.407 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.407 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253762+0000", 2024-04-26T12:27:42.407 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9769999999999997e-06 2024-04-26T12:27:42.407 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.407 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.407 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.407 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.253767+0000", 2024-04-26T12:27:42.407 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0429999999999998e-06 2024-04-26T12:27:42.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.408 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.408 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.408 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254160+0000", 2024-04-26T12:27:42.408 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039256700000000002 2024-04-26T12:27:42.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.408 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.408 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.408 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254292+0000", 2024-04-26T12:27:42.408 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013190399999999999 2024-04-26T12:27:42.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.409 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.409 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:42.409 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254453+0000", 2024-04-26T12:27:42.409 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000160982 2024-04-26T12:27:42.409 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.409 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.409 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:42.409 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257354+0000", 2024-04-26T12:27:42.409 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029008229999999999 2024-04-26T12:27:42.409 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.409 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.409 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:42.409 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262281+0000", 2024-04-26T12:27:42.409 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049274760000000001 2024-04-26T12:27:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262323+0000", 2024-04-26T12:27:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.189e-05 2024-04-26T12:27:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262358+0000", 2024-04-26T12:27:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4826000000000002e-05 2024-04-26T12:27:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.411 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.411 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:32 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:42.411 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:42.411 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.110299218000002, 2024-04-26T12:27:42.411 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083641310000000003, 2024-04-26T12:27:42.411 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.411 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:42.411 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.411 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.411 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.411 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:42.411 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.411 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.411 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254108+0000", 2024-04-26T12:27:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254107+0000", 2024-04-26T12:27:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254113+0000", 2024-04-26T12:27:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7869999999999998e-06 2024-04-26T12:27:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254122+0000", 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.149e-06 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254131+0000", 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5609999999999999e-06 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255227+0000", 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010961 2024-04-26T12:27:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.414 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.414 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.414 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.255355+0000", 2024-04-26T12:27:42.414 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012883299999999999 2024-04-26T12:27:42.414 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.414 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.414 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.414 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262472+0000", 2024-04-26T12:27:42.414 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071165949999999999 2024-04-26T12:27:42.414 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.414 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.414 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.414 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.415 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.415 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:33 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:42.415 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:42.415 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.110271093999998, 2024-04-26T12:27:42.415 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012698262, 2024-04-26T12:27:42.415 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.415 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:42.415 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.415 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.415 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.415 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:42.415 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.416 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.416 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.416 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:42.416 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.416 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.416 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.416 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254136+0000", 2024-04-26T12:27:42.417 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:42.417 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.417 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.417 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.417 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254138+0000", 2024-04-26T12:27:42.417 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2460000000000002e-06 2024-04-26T12:27:42.417 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.417 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.417 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.417 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254145+0000", 2024-04-26T12:27:42.418 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7070000000000003e-06 2024-04-26T12:27:42.418 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.418 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.418 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.418 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254164+0000", 2024-04-26T12:27:42.418 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9604999999999999e-05 2024-04-26T12:27:42.418 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.418 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.418 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.418 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257574+0000", 2024-04-26T12:27:42.418 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034098980000000002 2024-04-26T12:27:42.418 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.418 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.419 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.419 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.257731+0000", 2024-04-26T12:27:42.419 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015735400000000001 2024-04-26T12:27:42.419 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.419 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.419 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.419 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266834+0000", 2024-04-26T12:27:42.419 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091028099999999994 2024-04-26T12:27:42.419 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.419 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.419 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.419 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.419 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.419 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:35 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:42.420 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:42.420 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.110235355, 2024-04-26T12:27:42.420 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0087469690000000003, 2024-04-26T12:27:42.420 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.420 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:42.420 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.420 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.420 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.420 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:42.420 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.420 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.420 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.420 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.421 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254172+0000", 2024-04-26T12:27:42.421 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.421 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.421 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.421 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.421 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254171+0000", 2024-04-26T12:27:42.421 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:42.421 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.421 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.422 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.422 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254178+0000", 2024-04-26T12:27:42.422 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7710000000000001e-06 2024-04-26T12:27:42.422 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.422 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.422 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.422 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254185+0000", 2024-04-26T12:27:42.422 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6249999999999998e-06 2024-04-26T12:27:42.422 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.422 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.422 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.422 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254203+0000", 2024-04-26T12:27:42.422 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8003999999999999e-05 2024-04-26T12:27:42.422 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.423 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.423 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.423 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254408+0000", 2024-04-26T12:27:42.423 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020469100000000001 2024-04-26T12:27:42.423 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.423 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.423 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.423 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.254525+0000", 2024-04-26T12:27:42.423 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000116319 2024-04-26T12:27:42.423 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.423 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.423 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.423 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262919+0000", 2024-04-26T12:27:42.423 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083942440000000004 2024-04-26T12:27:42.424 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.424 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.424 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.424 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.424 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.424 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:18 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:42.424 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:42.424 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.103025817999999, 2024-04-26T12:27:42.424 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016521190000000001, 2024-04-26T12:27:42.424 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.424 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:42.424 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.425 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.425 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.425 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:42.425 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.425 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.425 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.425 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.425 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:42.425 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.425 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.425 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.425 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.425 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261381+0000", 2024-04-26T12:27:42.426 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:42.426 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.426 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.426 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.426 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261387+0000", 2024-04-26T12:27:42.426 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4880000000000004e-06 2024-04-26T12:27:42.426 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.426 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.426 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.426 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261396+0000", 2024-04-26T12:27:42.426 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2209999999999997e-06 2024-04-26T12:27:42.426 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.426 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261414+0000", 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8386e-05 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261460+0000", 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6029999999999998e-05 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261516+0000", 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6418000000000001e-05 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.427 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.428 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:42.428 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263008+0000", 2024-04-26T12:27:42.428 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0014912910000000001 2024-04-26T12:27:42.428 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.428 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.428 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.428 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263033+0000", 2024-04-26T12:27:42.428 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5763e-05 2024-04-26T12:27:42.428 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.428 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.428 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.428 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.428 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.428 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:28 3.1c e15/13 3:3ed09add:::607.00000000:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.102821120999998, 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001530869, 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:42.429 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.430 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.430 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.430 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.430 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261586+0000", 2024-04-26T12:27:42.430 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:42.430 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.430 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.430 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.430 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261597+0000", 2024-04-26T12:27:42.430 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1344e-05 2024-04-26T12:27:42.430 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.430 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.430 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.430 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261605+0000", 2024-04-26T12:27:42.431 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9039999999999992e-06 2024-04-26T12:27:42.431 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.431 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.431 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.431 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261612+0000", 2024-04-26T12:27:42.431 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8580000000000002e-06 2024-04-26T12:27:42.431 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.431 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.431 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.431 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261886+0000", 2024-04-26T12:27:42.431 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027415399999999998 2024-04-26T12:27:42.431 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.431 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.431 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.261905+0000", 2024-04-26T12:27:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8898000000000001e-05 2024-04-26T12:27:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263093+0000", 2024-04-26T12:27:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011877490000000001 2024-04-26T12:27:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.263117+0000", 2024-04-26T12:27:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4338999999999999e-05 2024-04-26T12:27:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.432 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.433 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.433 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.433 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.433 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "pg_update_log_missing_reply(3.b epoch 15/13 rep_tid 4 lcod 15'2)", 2024-04-26T12:27:42.433 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:42.433 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.102134186000001, 2024-04-26T12:27:42.433 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020538300000000001, 2024-04-26T12:27:42.433 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.433 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T12:27:42.433 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.433 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.433 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.433 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:42.433 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262273+0000", 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262272+0000", 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.999999 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262277+0000", 2024-04-26T12:27:42.434 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9169999999999997e-06 2024-04-26T12:27:42.435 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.435 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.435 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.435 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262287+0000", 2024-04-26T12:27:42.435 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0237e-05 2024-04-26T12:27:42.435 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.435 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.435 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.435 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262297+0000", 2024-04-26T12:27:42.435 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3219999999999999e-06 2024-04-26T12:27:42.435 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.435 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.435 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.435 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262382+0000", 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4969999999999995e-05 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262478+0000", 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6704000000000001e-05 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:36 3.7 e15/13 ondisk, result = 0)", 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.101689649000001, 2024-04-26T12:27:42.436 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027471, 2024-04-26T12:27:42.437 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.437 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:42.437 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.437 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.437 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.437 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:42.437 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.437 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.437 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.437 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.437 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:42.437 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.437 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.437 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262717+0000", 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262720+0000", 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4509999999999999e-06 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262726+0000", 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8599999999999998e-06 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.438 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262732+0000", 2024-04-26T12:27:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5889999999999999e-06 2024-04-26T12:27:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262882+0000", 2024-04-26T12:27:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014968800000000001 2024-04-26T12:27:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262890+0000", 2024-04-26T12:27:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9279999999999993e-06 2024-04-26T12:27:42.439 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.440 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.440 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.440 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.262992+0000", 2024-04-26T12:27:42.440 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010247300000000001 2024-04-26T12:27:42.440 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.440 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.440 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.440 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.440 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.440 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:42.440 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:42.440 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.100017090000001, 2024-04-26T12:27:42.440 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021676200000000001, 2024-04-26T12:27:42.441 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.441 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:42.441 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.441 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.441 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.441 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:42.441 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.441 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.441 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.441 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.441 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:42.441 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.442 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.442 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.442 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.442 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264390+0000", 2024-04-26T12:27:42.442 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:42.442 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.442 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.442 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.442 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264404+0000", 2024-04-26T12:27:42.442 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3998999999999999e-05 2024-04-26T12:27:42.442 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.442 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.442 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264411+0000", 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264424+0000", 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2843999999999999e-05 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264485+0000", 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0464000000000002e-05 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.443 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.444 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264493+0000", 2024-04-26T12:27:42.444 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.507e-06 2024-04-26T12:27:42.444 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.444 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.444 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.444 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264607+0000", 2024-04-26T12:27:42.444 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000113591 2024-04-26T12:27:42.444 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.444 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.444 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.444 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.444 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.444 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop_reply(mds.0.3:21 3.1f e15/13 ondisk, result = 0)", 2024-04-26T12:27:42.444 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.099977363000001, 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00037041599999999999, 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264430+0000", 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.445 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.446 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.446 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.446 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264429+0000", 2024-04-26T12:27:42.446 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:42.446 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.446 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.446 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.446 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264432+0000", 2024-04-26T12:27:42.446 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0770000000000002e-06 2024-04-26T12:27:42.446 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.446 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.446 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.446 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264435+0000", 2024-04-26T12:27:42.446 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8340000000000001e-06 2024-04-26T12:27:42.447 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.447 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.447 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.447 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264438+0000", 2024-04-26T12:27:42.447 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5280000000000002e-06 2024-04-26T12:27:42.447 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.447 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.447 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.447 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264703+0000", 2024-04-26T12:27:42.447 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026548400000000002 2024-04-26T12:27:42.447 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.447 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.447 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.447 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264709+0000", 2024-04-26T12:27:42.448 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8390000000000003e-06 2024-04-26T12:27:42.448 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.448 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.448 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.448 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.264800+0000", 2024-04-26T12:27:42.448 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0931000000000001e-05 2024-04-26T12:27:42.448 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.448 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.448 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.448 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.448 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.448 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:37 3.13 e15/13 3:cd5a64a3:::100.00000000:head v 15'1, mlcod=0'0)", 2024-04-26T12:27:42.448 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:42.448 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.099171462000001, 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016589860000000001, 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265236+0000", 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.449 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.450 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.450 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265235+0000", 2024-04-26T12:27:42.450 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:42.450 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.450 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.450 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.450 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265252+0000", 2024-04-26T12:27:42.450 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6307000000000002e-05 2024-04-26T12:27:42.450 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.450 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.450 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.450 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265257+0000", 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8279999999999999e-06 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265263+0000", 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9399999999999999e-06 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265300+0000", 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6315e-05 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.451 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265312+0000", 2024-04-26T12:27:42.452 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2451e-05 2024-04-26T12:27:42.452 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.452 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.452 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:42.452 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266864+0000", 2024-04-26T12:27:42.452 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015521090000000001 2024-04-26T12:27:42.452 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.452 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.452 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.452 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.266895+0000", 2024-04-26T12:27:42.452 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0426e-05 2024-04-26T12:27:42.452 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.452 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(mds.0.3:22 3.13 e15/13 3:c91d4a1d:::mds0_inotable:head v 15'2, mlcod=0'0)", 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 49.099050722000001, 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021988139999999999, 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.453 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967296 2024-04-26T12:27:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265361+0000", 2024-04-26T12:27:42.454 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6979999999999997e-06 2024-04-26T12:27:42.455 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.455 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.455 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.455 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265366+0000", 2024-04-26T12:27:42.455 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6550000000000003e-06 2024-04-26T12:27:42.455 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.455 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.455 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.455 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265379+0000", 2024-04-26T12:27:42.455 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.358e-05 2024-04-26T12:27:42.455 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.456 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.456 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.456 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265535+0000", 2024-04-26T12:27:42.456 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015586800000000001 2024-04-26T12:27:42.456 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.456 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.456 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.456 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.265556+0000", 2024-04-26T12:27:42.456 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1202000000000001e-05 2024-04-26T12:27:42.456 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.456 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.456 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:42.456 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267528+0000", 2024-04-26T12:27:42.456 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0019722099999999998 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:53.267555+0000", 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6775999999999999e-05 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.454032550000001, 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020315099999999998, 2024-04-26T12:27:42.457 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.458 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:42.458 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.458 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.458 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.458 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:42.458 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.458 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.458 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.458 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.458 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910375+0000", 2024-04-26T12:27:42.458 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.458 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.458 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.458 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.459 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910372+0000", 2024-04-26T12:27:42.459 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999971 2024-04-26T12:27:42.459 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.459 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.459 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.459 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910387+0000", 2024-04-26T12:27:42.459 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5252999999999999e-05 2024-04-26T12:27:42.459 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.459 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.459 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.459 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910418+0000", 2024-04-26T12:27:42.459 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0778999999999998e-05 2024-04-26T12:27:42.459 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.459 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.460 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.460 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910437+0000", 2024-04-26T12:27:42.460 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9619999999999998e-05 2024-04-26T12:27:42.460 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.460 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.460 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.460 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910587+0000", 2024-04-26T12:27:42.460 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014922000000000001 2024-04-26T12:27:42.460 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.460 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.460 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.461 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910837+0000", 2024-04-26T12:27:42.461 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025089099999999999 2024-04-26T12:27:42.461 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.461 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.461 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:42.461 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.910973+0000", 2024-04-26T12:27:42.461 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000135124 2024-04-26T12:27:42.461 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.461 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.461 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:42.461 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.911616+0000", 2024-04-26T12:27:42.461 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00064392799999999999 2024-04-26T12:27:42.461 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.461 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.462 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:42.462 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912341+0000", 2024-04-26T12:27:42.462 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00072415700000000001 2024-04-26T12:27:42.462 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.462 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.462 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:42.462 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912379+0000", 2024-04-26T12:27:42.462 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8724999999999999e-05 2024-04-26T12:27:42.462 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.462 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.462 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.462 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:26:57.912406+0000", 2024-04-26T12:27:42.462 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6752999999999999e-05 2024-04-26T12:27:42.462 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.463 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.463 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.463 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.463 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.463 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(mds.0.3:45 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-26T12:27:42.463 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:42.463 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 19.453364338, 2024-04-26T12:27:42.463 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0013630599999999999, 2024-04-26T12:27:42.463 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T12:27:42.463 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:42.463 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T12:27:42.463 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.463 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T12:27:42.463 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911043+0000", 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911041+0000", 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.9999976 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T12:27:42.464 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911057+0000", 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6549999999999999e-05 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911088+0000", 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0753000000000002e-05 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911107+0000", 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9425000000000001e-05 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T12:27:42.465 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911258+0000", 2024-04-26T12:27:42.466 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000150252 2024-04-26T12:27:42.466 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.466 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.466 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T12:27:42.466 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911379+0000", 2024-04-26T12:27:42.466 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012129900000000001 2024-04-26T12:27:42.466 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.466 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.466 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:42.466 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.911529+0000", 2024-04-26T12:27:42.466 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015010699999999999 2024-04-26T12:27:42.466 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.466 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912214+0000", 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00068528199999999995 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912343+0000", 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012858800000000001 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912378+0000", 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5420000000000003e-05 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T12:27:42.467 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T12:27:42.468 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T12:27:42.468 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T12:27:22.912406+0000", 2024-04-26T12:27:42.468 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7594e-05 2024-04-26T12:27:42.468 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.468 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.468 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.468 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T12:27:42.468 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T12:27:42.468 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:27:42.469 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:27:42.470 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:42.471 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:42.470+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:42.570 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:42.569+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:42.616 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:42.616 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:42.616 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:42.616 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:42.626 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:42.629 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:42.651 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:42.655 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2024-04-26T12:27:42.672 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:42.672 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:42.670+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:42.673 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:42.673 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:42.673 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:42.773 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:42.771+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:42.793 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:42.794 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:42.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:42.874 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:42.872+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:42.972 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:42.972 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:42.976 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:42.975+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:42.982 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:43.075 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:43.073+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:43.123 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:43.123 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:43.134 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:43.177 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:43.176+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:43.277 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:43.276+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:43.303 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:43.304 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:43.313 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:43.378 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:43.377+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:43.442 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:43.442 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:43.452 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:27:43.497 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:43.496+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:43.581 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:43.577+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:43.595 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:43.595 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:43.605 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:27:43.679 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:27:43.678+0000 7f5593219700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41391) UID: 0 2024-04-26T12:27:43.734 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:43.734 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:43.744 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:27:43.781 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:43.780+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:43.791 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T12:27:43.791 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:27:43.791 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2024-04-26T12:27:43.791 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T12:27:43.791 INFO:teuthology.orchestra.console.smithi136:Power off 2024-04-26T12:27:43.792 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T12:27:43.823 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2024-04-26T12:27:43.823 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:27:43.856 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-26T12:27:43.883 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:43.881+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:43.912 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:43.912 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:43.922 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:43.983 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:43.982+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:44.052 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:44.052 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:44.062 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:44.084 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:44.082+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:44.185 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:44.184+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:44.189 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:44.189 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:44.199 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:44.286 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:44.285+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:44.325 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:44.325 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:44.335 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:44.387 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:44.386+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:44.476 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:44.476 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:44.486 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:44.487 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:44.487+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:44.588 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:44.587+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:44.612 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:44.613 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:44.623 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:44.667 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:27:44.685 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:27:44.688 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:44.687+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:44.749 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:44.749 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:44.759 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:44.802 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:44.801+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:44.868 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:44.886 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:44.886 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:44.886 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:44.886 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:44.888 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:44.891 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:44.889+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:44.896 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:44.908 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:44.909 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:44.909 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:44.909 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:44.992 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:44.991+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:45.062 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:45.062 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:45.062 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:45.072 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:45.093 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:45.091+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:45.194 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:45.192+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:45.201 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.868182664000003, 2024-04-26T12:27:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.949316840999998, 2024-04-26T12:27:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.949280629, 2024-04-26T12:27:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.949241655000002, 2024-04-26T12:27:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.949218488, 2024-04-26T12:27:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.949203111000003, 2024-04-26T12:27:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.949174921000001, 2024-04-26T12:27:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.949156922999997, 2024-04-26T12:27:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.949132331999998, 2024-04-26T12:27:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.949107382999998, 2024-04-26T12:27:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.949086459, 2024-04-26T12:27:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.949051609999998, 2024-04-26T12:27:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.949017660000003, 2024-04-26T12:27:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.948997362999997, 2024-04-26T12:27:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:45.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:45.296 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.296 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.296 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.296 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.296 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:45.296 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.948962242, 2024-04-26T12:27:45.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:45.296 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.296 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.296 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:45.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:45.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:45.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:45.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:45.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:45.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:45.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:45.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:45.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:45.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:45.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:45.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:45.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:45.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:45.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:45.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:45.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:45.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:45.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:45.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:45.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:45.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:45.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:45.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:45.302 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.302 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.302 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.302 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.302 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:45.302 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.948927001999998, 2024-04-26T12:27:45.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:45.303 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.303 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.303 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:45.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:45.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:45.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:45.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:45.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:45.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:45.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:45.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:45.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:45.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:45.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:45.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:45.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:45.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:45.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:45.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:45.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:45.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:45.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:45.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:45.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:45.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:45.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:45.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:45.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:45.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:45.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:45.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:45.309 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.309 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.309 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.309 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.309 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:45.309 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.948785254000001, 2024-04-26T12:27:45.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:45.309 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.309 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.309 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:45.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:45.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:45.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:45.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:45.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:45.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:45.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:45.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:45.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:45.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:45.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:45.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:45.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:45.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:45.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:45.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:45.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:45.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:45.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:45.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:45.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:45.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:45.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:45.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:45.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:45.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:45.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:45.315 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.315 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.315 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.316 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.316 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:45.316 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.948761234999999, 2024-04-26T12:27:45.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:45.316 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.316 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.316 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:45.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:45.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:45.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:45.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:45.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:45.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:45.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:45.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:45.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:45.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:45.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:45.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:45.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:45.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:45.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:45.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:45.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:45.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:45.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:45.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:45.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:45.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:45.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:45.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:45.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:45.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:45.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:45.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:45.322 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.322 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.322 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.322 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.322 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:45.322 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.948737266999998, 2024-04-26T12:27:45.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:27:45.322 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.322 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.322 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:45.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:45.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:27:45.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:27:45.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:27:45.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:27:45.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:27:45.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:27:45.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:27:45.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:27:45.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:27:45.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:45.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:27:45.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:27:45.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:27:45.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:27:45.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:27:45.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:27:45.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:45.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:27:45.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:27:45.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:45.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:27:45.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:27:45.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:27:45.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:27:45.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:45.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:27:45.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:27:45.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:27:45.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:27:45.328 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.328 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.328 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.329 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.329 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:45.329 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.948703885999997, 2024-04-26T12:27:45.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:27:45.329 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:45.329 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:27:45.329 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:45.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:45.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:45.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:45.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:45.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:45.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:45.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:45.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:45.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:27:45.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:27:45.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:45.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:27:45.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:27:45.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:27:45.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:27:45.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:27:45.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:27:45.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:45.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:27:45.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:27:45.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:45.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:27:45.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:27:45.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:45.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:27:45.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:27:45.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:45.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:45.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:45.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:27:45.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:27:45.333 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.333 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.333 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.333 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:45.333 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:45.333 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:45.335 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:45.336 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:45.333+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:45.436 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:45.435+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:45.464 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:45.464 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:45.464 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:45.465 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:45.474 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:45.537 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:45.535+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:45.600 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:45.601 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:45.601 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:45.611 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:45.638 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:45.637+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:45.662 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2024-04-26T12:27:45.739 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:45.738+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:45.781 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.897963357999998, 2024-04-26T12:27:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:45.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.786 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.897324011000002, 2024-04-26T12:27:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:45.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:45.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:45.791 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.767621820999999, 2024-04-26T12:27:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:45.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:45.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:45.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:45.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:45.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:45.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:45.795 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.767127234999997, 2024-04-26T12:27:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:45.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:45.800 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.765125050999998, 2024-04-26T12:27:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:45.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:45.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:45.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:45.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:45.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:45.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:45.804 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.805 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.805 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.805 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:45.805 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:45.805 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.764718711, 2024-04-26T12:27:45.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:45.805 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.805 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.805 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:45.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:45.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:45.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:45.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:45.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:45.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:45.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:45.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:45.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:45.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:45.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:45.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:45.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:45.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:45.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:45.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:45.809 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.809 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.809 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.809 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:45.809 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:45.809 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.764363887000002, 2024-04-26T12:27:45.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:45.810 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.810 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.810 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:45.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:45.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:45.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:45.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:45.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:45.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:45.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:45.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:45.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:45.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:45.813 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.813 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.814 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.814 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:45.814 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:45.814 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.661805473000001, 2024-04-26T12:27:45.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:45.814 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.814 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.814 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:45.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:45.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:45.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:45.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:45.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:45.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:45.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:45.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:45.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:45.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:45.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:45.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:45.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:45.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:45.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:45.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:45.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:45.818 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.818 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.818 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.818 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:45.818 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:45.818 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.661408944999998, 2024-04-26T12:27:45.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:45.819 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.819 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.819 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:45.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:45.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:45.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:45.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:45.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:45.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:45.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:45.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:45.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:45.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:45.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:45.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:45.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:45.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:45.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:45.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:45.822 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.822 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.823 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.823 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:45.823 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:45.823 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.564399336999998, 2024-04-26T12:27:45.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:45.823 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.823 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.823 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:45.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:45.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:45.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:45.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:45.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:45.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:45.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:45.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:45.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:45.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:45.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:45.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:45.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:45.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:45.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:45.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:45.827 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.827 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.827 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.828 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:45.828 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:45.828 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 58.563705620999997, 2024-04-26T12:27:45.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:45.828 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.828 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.828 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:45.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:45.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:45.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:45.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:45.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:45.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:45.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:45.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:45.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:45.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:45.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:45.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:45.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:45.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:45.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:45.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:45.832 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.832 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.832 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.832 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.832 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:45.832 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.528966566000001, 2024-04-26T12:27:45.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:45.832 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.832 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.832 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:45.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:45.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:45.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:45.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:45.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:45.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:45.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:45.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:45.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:45.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:45.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:45.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:45.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:45.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:45.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:45.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:45.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:45.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:45.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:45.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:45.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:45.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:45.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:45.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:45.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:45.837 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.837 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.837 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.837 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.838 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:45.838 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.528145647000002, 2024-04-26T12:27:45.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:45.838 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.838 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.838 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:45.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:45.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:45.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:45.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:45.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:45.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:45.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:45.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:45.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:45.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:45.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:45.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:45.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:45.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:45.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:45.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.528115557, 2024-04-26T12:27:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:45.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:45.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:45.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:45.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:45.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.528061768999997, 2024-04-26T12:27:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:45.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:45.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:45.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:45.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:45.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:45.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.528009212000001, 2024-04-26T12:27:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:45.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:45.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:45.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:45.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:45.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:45.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:45.866 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.866 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.866 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.866 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.866 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:45.866 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.527968997999999, 2024-04-26T12:27:45.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:45.866 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.866 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.866 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:45.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:45.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:45.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:45.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:45.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:45.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:45.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:45.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:45.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:45.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:45.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:45.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:45.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:45.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:45.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:45.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:45.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:45.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:45.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:45.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:45.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:45.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:45.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:45.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:45.871 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.871 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.872 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.872 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.872 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:45.872 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.527940837000003, 2024-04-26T12:27:45.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:45.872 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.872 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:45.872 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:45.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:45.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:45.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:45.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:45.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:45.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:45.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:45.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:45.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.877 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.527910147999997, 2024-04-26T12:27:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:45.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:45.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:45.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:45.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:45.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:45.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:45.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:45.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:45.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:45.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:45.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:45.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:45.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:45.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:45.882 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.882 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.882 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.882 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:45.882 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:45.882 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.527883574999997, 2024-04-26T12:27:45.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:45.882 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:45.882 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:45.882 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:45.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:45.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:45.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:45.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:45.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:45.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:45.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:45.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:45.886 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:45.886 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:45.888 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:45.886+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:45.888 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:45.988 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:45.987+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:46.021 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:46.021 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:46.021 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:46.021 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:46.031 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:46.116 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:46.115+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:46.191 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:46.189+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:46.198 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:46.198 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:46.198 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:46.198 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:46.198 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:46.209 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:46.293 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:46.292+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:46.378 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:46.378 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:46.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:46.379 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:46.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.379 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:46.379 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:46.379 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.045352657999999, 2024-04-26T12:27:46.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:46.379 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.379 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.379 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:46.379 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:46.379 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:46.379 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:46.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.380 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:46.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:46.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:46.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:46.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:46.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:46.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:46.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:46.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:46.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:46.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:46.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:46.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:46.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:46.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:46.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:46.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:46.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:46.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:46.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:46.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:46.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:46.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:46.385 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.385 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.385 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.386 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.386 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:46.386 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126486835000001, 2024-04-26T12:27:46.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:46.386 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.386 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.386 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:46.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:46.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:46.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:46.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:46.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:46.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:46.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:46.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:46.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:46.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:46.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:46.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:46.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:46.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:46.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:46.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:46.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:46.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:46.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:46.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:46.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:46.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:46.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:46.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:46.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:46.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:46.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:46.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:46.393 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.393 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.393 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.393 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.393 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:46.393 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126450622999997, 2024-04-26T12:27:46.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:46.393 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.394 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.394 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:46.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:46.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:46.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:46.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:46.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:46.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:46.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:46.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:46.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:46.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:46.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:46.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:46.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:46.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:46.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:46.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:46.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:46.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:46.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:46.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:46.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:46.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:46.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:46.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:46.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:46.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:46.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:46.400 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.400 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.400 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.401 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.401 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:46.401 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126411648999998, 2024-04-26T12:27:46.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:46.401 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.401 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.401 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:46.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:46.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:46.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:46.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:46.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:46.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:46.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:46.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:46.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:46.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:46.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:46.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:46.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:46.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:46.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:46.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:46.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:46.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:46.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:46.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:46.408 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.408 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.408 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.408 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.408 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:46.408 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126388482000003, 2024-04-26T12:27:46.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:46.409 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.409 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.409 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:46.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:46.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:46.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:46.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:46.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:46.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:46.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:46.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:46.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:46.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:46.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:46.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:46.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:46.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:46.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:46.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:46.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:46.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:46.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:46.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:46.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:46.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:46.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:46.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:46.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:46.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:46.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:46.415 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.415 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.415 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.416 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.416 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:46.416 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126373104999999, 2024-04-26T12:27:46.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:46.416 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.416 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.416 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:46.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:46.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:46.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:46.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:46.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:46.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:46.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:46.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:46.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:46.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:46.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:46.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:46.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:46.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:46.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:46.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:46.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:46.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:46.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:46.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:46.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:46.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:46.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:46.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:46.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:46.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:46.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:46.422 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.422 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.422 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.423 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.423 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:46.423 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126344914999997, 2024-04-26T12:27:46.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:46.423 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.423 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.423 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:46.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:46.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:46.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:46.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:46.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:46.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:46.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:46.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:46.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:46.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:46.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:46.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:46.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:46.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:46.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:46.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:46.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:46.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:46.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:46.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:46.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:46.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:46.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:46.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:46.430 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.430 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.430 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.430 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.430 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:46.430 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126326917, 2024-04-26T12:27:46.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:46.430 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.430 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.431 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:46.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:46.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:46.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:46.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:46.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:46.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:46.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:46.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:46.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:46.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:46.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:46.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:46.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:46.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:46.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:46.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:46.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:46.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:46.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:46.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:46.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:46.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:46.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:46.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:46.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:46.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:46.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:46.437 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.438 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.438 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.438 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.438 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:46.438 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126302326000001, 2024-04-26T12:27:46.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:46.438 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.438 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.438 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:46.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:46.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:46.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:46.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:46.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:46.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:46.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:46.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:46.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:46.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:46.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:46.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:46.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:46.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:46.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:46.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:46.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:46.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:46.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:46.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:46.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:46.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:46.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:46.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:46.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:46.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:46.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:46.445 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.445 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.445 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.446 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.446 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:46.446 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126277377000001, 2024-04-26T12:27:46.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:46.446 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.446 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.446 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:46.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:46.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:46.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:46.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:46.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:46.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:46.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:46.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:46.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:46.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:46.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:46.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:46.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:46.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:46.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:46.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:46.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:46.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:46.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:46.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:46.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:46.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:46.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:46.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:46.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:46.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:46.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:46.452 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.452 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.453 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.453 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.453 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:46.453 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126256453000003, 2024-04-26T12:27:46.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:46.453 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.453 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.453 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:46.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:46.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:46.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:46.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:46.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:46.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:46.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:46.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:46.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:46.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:46.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:46.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:46.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:46.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:46.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:46.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:46.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:46.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:46.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:46.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:46.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:46.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:46.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:46.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:46.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:46.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:46.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:46.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:46.460 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.460 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.460 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.460 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.460 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:46.460 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126221604000001, 2024-04-26T12:27:46.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:46.460 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.460 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.461 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:46.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:46.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:46.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:46.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:46.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:46.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:46.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:46.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:46.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:46.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:46.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:46.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:46.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:46.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:46.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:46.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:46.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:46.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:46.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:46.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:46.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:46.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:46.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:46.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:46.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:46.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:46.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:46.469 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.469 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.469 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.470 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.470 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:46.470 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126187653999999, 2024-04-26T12:27:46.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:46.470 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.470 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.470 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:46.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:46.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:46.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:46.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:46.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:46.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:46.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:46.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:46.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:46.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:46.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:46.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:46.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:46.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:46.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:46.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:46.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:46.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:46.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:46.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:46.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:46.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:46.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:46.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:46.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:46.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:46.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:46.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:46.477 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.477 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.477 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.477 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.477 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:46.477 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126167357, 2024-04-26T12:27:46.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:46.477 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.478 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.478 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:46.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:46.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:46.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:46.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:46.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:46.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:46.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:46.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:46.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:46.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:46.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:46.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:46.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:46.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:46.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:46.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:46.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:46.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:46.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:46.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:46.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:46.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:46.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:46.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:46.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:46.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:46.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:46.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:46.485 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.485 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.485 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.485 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.485 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:46.485 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126132235999997, 2024-04-26T12:27:46.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:46.485 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.485 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.485 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:46.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:46.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:46.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:46.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:46.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:46.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:46.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:46.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:46.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:46.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:46.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:46.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:46.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:46.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:46.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:46.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:46.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:46.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:46.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:46.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:46.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:46.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:46.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:46.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:46.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:46.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:46.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:46.492 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.492 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.492 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.492 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.492 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:46.492 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.126096996000001, 2024-04-26T12:27:46.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:46.493 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.493 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.493 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:46.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:46.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:46.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:46.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:46.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:46.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:46.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:46.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:46.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:46.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:46.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:46.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:46.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:46.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:46.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:46.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:46.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:46.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:46.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:46.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:46.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:46.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:46.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:46.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:46.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:46.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:46.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:46.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:46.499 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.499 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.499 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.499 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.500 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:46.500 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.125955247999997, 2024-04-26T12:27:46.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:46.500 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.500 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.500 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:46.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:46.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:46.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:46.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:46.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:46.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:46.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:46.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:46.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:46.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:46.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:46.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:46.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:46.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:46.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:46.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:46.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:46.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:46.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:46.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:46.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:46.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:46.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:46.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:46.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:46.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:46.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:46.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.506 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.507 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.507 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.507 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:46.507 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.125931229000003, 2024-04-26T12:27:46.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:46.507 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.507 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.507 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:46.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:46.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:46.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:46.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:46.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:46.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:46.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:46.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:46.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:46.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:46.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:46.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:46.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:46.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:46.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:46.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:46.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:46.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:46.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:46.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:46.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:46.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:46.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:46.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:46.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:46.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:46.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:46.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:46.514 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.514 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.514 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.514 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.514 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:46.514 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.125907261000002, 2024-04-26T12:27:46.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:27:46.514 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.515 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.515 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:46.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:46.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:27:46.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:27:46.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:27:46.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:27:46.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:27:46.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:27:46.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:27:46.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:27:46.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:27:46.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:46.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:27:46.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:27:46.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:27:46.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:27:46.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:27:46.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:27:46.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:46.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:27:46.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:27:46.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:46.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:27:46.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:27:46.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:46.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:27:46.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:27:46.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:46.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:27:46.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:27:46.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:27:46.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:27:46.521 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.521 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.521 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.522 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:46.522 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:46.522 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.12587388, 2024-04-26T12:27:46.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:27:46.522 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:46.522 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:27:46.522 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:46.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:46.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:46.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:46.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:46.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:46.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:46.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:46.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:46.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:27:46.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:27:46.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:46.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:27:46.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:27:46.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:27:46.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:27:46.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:27:46.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:27:46.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:46.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:27:46.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:27:46.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:46.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:27:46.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:27:46.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:46.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:27:46.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:27:46.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:46.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:46.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:46.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:27:46.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:27:46.527 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.527 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.527 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.527 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:46.527 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:46.527 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:46.529 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:46.527+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:46.529 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:46.629 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:46.628+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:46.668 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:46.668 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:46.668 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:46.668 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:46.678 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:46.730 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:46.728+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:46.805 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:46.805 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:46.805 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:46.805 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:46.805 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:46.816 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:46.857 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:46.855+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:46.921 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:27:46.932 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:46.930+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:46.985 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:46.986 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:46.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:46.986 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:46.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.986 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:46.986 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:46.986 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.101451910000002, 2024-04-26T12:27:46.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:46.986 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:46.987 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.987 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:46.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:46.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:46.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:46.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:46.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:46.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:46.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:46.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:46.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:46.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:46.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:46.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:46.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:46.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:46.991 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:46.991 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:46.991 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:46.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.991 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:46.991 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:46.992 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.100812562999998, 2024-04-26T12:27:46.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:46.992 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:46.992 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.992 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:46.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:46.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:46.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:46.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:46.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:46.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:46.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:46.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:46.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:46.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:46.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:46.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:46.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:46.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:46.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:46.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:46.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:46.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:46.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:46.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:46.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:46.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:46.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:46.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:46.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:46.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:46.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:46.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:46.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:46.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:46.997 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:46.997 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:46.997 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:46.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.997 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:46.997 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:46.997 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.971110373000002, 2024-04-26T12:27:46.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:46.997 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:46.997 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:46.997 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:46.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:46.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:46.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:46.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:46.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:46.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:46.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:46.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:47.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:47.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:47.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:47.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:47.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:47.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:47.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:47.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:47.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:47.001 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.001 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.001 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.002 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:47.002 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:47.002 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.970615787, 2024-04-26T12:27:47.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:47.002 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.002 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.002 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:47.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:47.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:47.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:47.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:47.007 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.007 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.007 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.007 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:47.007 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:47.007 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.968613603000001, 2024-04-26T12:27:47.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:47.007 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.007 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.007 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:47.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:47.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:47.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:47.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:47.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:47.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:47.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:47.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:47.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:47.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:47.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:47.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:47.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:47.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:47.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:47.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.968207262999996, 2024-04-26T12:27:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:47.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:47.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:47.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:47.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:47.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:47.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:47.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:47.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:47.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:47.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:47.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:47.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:47.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:47.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:47.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:47.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:47.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:47.016 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.016 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.016 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.017 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:47.017 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:47.017 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.967852438999998, 2024-04-26T12:27:47.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:47.017 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.017 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.017 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:47.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:47.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:47.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:47.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:47.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:47.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:47.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:47.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:47.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:47.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:47.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:47.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:47.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:47.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:47.021 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:47.022 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.865294024999997, 2024-04-26T12:27:47.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:47.022 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.022 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.022 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:47.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:47.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:47.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:47.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:47.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:47.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:47.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:47.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:47.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:47.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:47.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:47.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:47.026 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.026 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.026 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.026 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:47.026 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:47.026 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.864897497000001, 2024-04-26T12:27:47.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:47.026 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.026 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.027 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:47.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:47.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:47.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:47.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:47.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:47.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:47.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:47.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:47.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:47.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:47.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:47.031 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.031 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.031 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.031 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:47.031 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:47.031 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.767887889000001, 2024-04-26T12:27:47.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:47.031 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.031 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.031 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:47.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:47.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:47.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:47.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:47.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:47.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:47.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:47.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:47.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:47.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:47.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:47.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:47.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.036 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:47.036 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:47.036 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.767194173, 2024-04-26T12:27:47.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:47.036 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.036 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.036 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:47.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:47.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.040 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.732455117999997, 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:47.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:47.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.046 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.731634198999998, 2024-04-26T12:27:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:47.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:47.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:47.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:47.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:47.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:47.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:47.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:47.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:47.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:47.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:47.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:47.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:47.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:47.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:47.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:47.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:47.052 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.052 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.052 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.053 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:47.053 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:47.053 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.731604109000003, 2024-04-26T12:27:47.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:47.053 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.053 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.053 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:47.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:47.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:47.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:47.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:47.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:47.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:47.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:47.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:47.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:47.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:47.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:47.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:47.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:47.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:47.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:47.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:47.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:47.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:47.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:47.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:47.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:47.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:47.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:47.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:47.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:47.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:47.059 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.059 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.059 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.059 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:47.059 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:47.059 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.731550321, 2024-04-26T12:27:47.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:47.060 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.060 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.060 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:47.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:47.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:47.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:47.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:47.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:47.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:47.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:47.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:47.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:47.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:47.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:47.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:47.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:47.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:47.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:47.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:47.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:47.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:47.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:47.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:47.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:47.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:47.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:47.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:47.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:47.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:47.064 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.065 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.065 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.065 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:47.065 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:47.065 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.731497763999997, 2024-04-26T12:27:47.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:47.065 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.065 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.065 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:47.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:47.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:47.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:47.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:47.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:47.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:47.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:47.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:47.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:47.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:47.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:47.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:47.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:47.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:47.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:47.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:47.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:47.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:47.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:47.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:47.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:47.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:47.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:47.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:47.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:47.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:47.071 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.071 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.071 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.071 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.731457550000002, 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:47.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:47.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:47.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:47.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:47.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:47.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:47.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:47.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:47.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:47.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:47.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:47.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:47.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:47.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:47.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:47.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:47.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:47.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:47.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:47.076 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.077 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.077 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.077 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:47.077 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:47.077 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.731429388999999, 2024-04-26T12:27:47.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:47.077 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.077 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:47.077 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:47.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:47.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:47.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:47.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:47.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:47.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:47.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:47.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:47.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:47.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:47.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:47.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:47.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:47.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:47.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:47.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:47.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:47.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:47.085 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.085 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.085 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.085 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:47.086 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:47.086 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.7313987, 2024-04-26T12:27:47.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:47.086 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.086 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:47.086 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:47.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:47.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:47.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:47.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:47.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:47.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:47.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:47.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:47.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:47.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.089 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.090 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:47.090 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:47.090 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.731372127, 2024-04-26T12:27:47.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:47.090 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:47.090 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:47.090 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:47.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:47.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:47.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:47.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:47.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:47.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:47.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:47.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:47.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:47.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:47.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:47.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:47.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:47.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:47.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:47.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:47.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:47.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:47.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:47.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:47.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:47.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:47.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:47.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:47.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:47.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:47.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:47.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:47.094 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.094 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.094 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.094 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:47.094 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:47.095 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:47.096 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:47.096 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1: {} 2024-04-26T12:27:47.097 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:47.094+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:47.097 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:47.118 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:47.119 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:47.120 INFO:teuthology.orchestra.run.smithi046.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:27:47.120 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:47.196 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:47.195+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:47.229 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:47.230 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:47.240 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:47.297 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:47.295+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:47.398 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:47.396+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:47.406 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:47.406 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:47.416 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:47.499 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:47.497+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:47.584 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:47.584 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:47.594 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:47.600 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:47.599+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:47.678 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:27:47.701 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:47.700+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:47.731 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:47.731 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:47.741 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:47.802 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:47.800+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:47.857 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:27:47.867 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:47.868 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:47.876 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:47.902 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:47.901+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:47.968 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-26T12:27:48.003 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:48.003 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:48.003 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:48.002+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:48.013 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:48.104 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:48.103+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:48.142 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:48.142 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:48.152 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:48.205 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:48.204+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:48.278 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:48.278 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:48.288 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:48.305 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:48.304+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:48.406 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:48.405+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:48.413 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:48.414 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:48.423 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:48.507 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:48.506+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:48.554 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:48.555 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:48.564 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:48.608 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:48.607+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:48.669 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2024-04-26T12:27:48.708 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:48.707+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:48.735 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:48.735 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:48.745 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:48.829 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:48.828+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:48.910 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:48.909+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:48.912 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:48.912 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:48.923 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:49.011 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:49.009+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:49.051 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:49.051 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:49.061 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:49.111 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:49.110+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:49.135 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:27:49.187 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:49.187 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:49.197 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:49.240 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:49.239+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:49.294 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:49.313 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:49.312+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:49.315 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:49.315 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:49.315 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:27:49.315 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:49.317 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:27:49.318 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:27:49.327 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:49.327 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:49.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:49.327 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:49.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.327 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:49.328 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:49.328 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.994393633000001, 2024-04-26T12:27:49.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:49.328 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.328 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.328 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:49.328 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:49.328 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:49.328 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:49.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.328 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:49.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:49.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:49.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:49.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:49.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:49.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:49.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:49.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:49.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:49.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:49.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:49.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:49.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:49.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:49.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:49.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.334 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.334 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:49.334 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.075527809999997, 2024-04-26T12:27:49.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:49.334 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.334 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.334 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:49.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:49.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:49.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:49.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:49.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:49.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:49.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:49.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:49.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:49.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:49.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:49.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:49.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:49.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:49.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:49.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:49.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:49.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:49.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:49.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:49.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:49.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:49.340 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.340 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.340 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.340 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.340 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:49.340 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.075491597999999, 2024-04-26T12:27:49.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:49.340 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.341 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.341 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:49.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:49.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:49.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:49.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:49.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:49.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:49.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:49.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:49.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:49.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:49.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:49.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:49.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:49.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:49.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:49.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:49.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:49.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:49.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:49.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:49.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:49.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:49.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:49.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:49.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:49.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:49.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:49.346 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.346 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.347 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.347 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.347 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:49.347 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.075452624, 2024-04-26T12:27:49.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:49.347 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.347 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.347 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:49.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:49.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:49.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:49.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:49.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:49.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:49.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:49.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:49.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:49.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:49.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:49.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:49.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:49.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:49.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:49.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:49.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:49.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:49.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:49.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:49.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:49.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:49.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:49.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:49.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:49.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:49.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:49.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:49.353 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.353 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.353 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.353 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.353 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:49.353 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.075429456999998, 2024-04-26T12:27:49.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:49.353 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.353 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.353 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:49.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:49.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:49.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:49.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:49.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:49.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:49.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:49.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:49.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:49.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:49.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:49.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:49.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:49.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:49.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:49.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:49.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:49.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:49.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:49.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:49.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:49.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:49.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:49.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:49.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:49.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:49.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:49.359 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.360 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.360 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.360 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.360 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:49.360 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.075414080000002, 2024-04-26T12:27:49.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:49.360 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.360 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.360 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:49.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:49.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:49.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:49.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:49.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:49.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:49.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:49.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:49.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:49.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:49.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:49.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:49.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:49.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:49.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:49.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:49.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:49.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:49.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:49.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:49.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:49.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:49.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:49.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:49.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:49.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:49.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:49.366 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.366 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.366 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.366 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.366 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:49.366 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.07538589, 2024-04-26T12:27:49.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:49.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:49.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:49.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:49.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:49.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:49.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:49.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:49.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:49.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:49.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:49.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:49.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:49.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:49.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:49.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:49.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:49.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:49.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:49.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:49.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:49.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:49.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:49.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:49.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:49.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:49.373 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.373 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.373 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.373 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.373 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:49.373 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.075367892000003, 2024-04-26T12:27:49.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:49.374 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.374 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.374 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:49.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:49.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:49.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:49.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:49.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:49.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:49.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:49.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:49.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:49.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:49.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:49.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:49.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:49.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:49.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:49.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:49.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:49.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:49.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:49.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:49.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:49.379 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.380 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.380 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.380 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.380 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:49.380 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.075343300999997, 2024-04-26T12:27:49.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:49.380 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.380 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.380 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:49.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:49.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:49.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:49.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:49.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:49.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:49.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:49.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:49.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:49.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:49.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:49.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:49.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:49.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:49.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:49.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:49.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:49.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:49.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:49.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:49.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:49.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:49.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:49.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:49.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:49.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:49.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:49.386 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.386 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.387 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.387 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.387 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:49.387 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.075318351999996, 2024-04-26T12:27:49.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:49.387 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.387 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.387 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:49.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:49.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:49.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:49.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:49.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:49.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:49.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:49.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:49.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:49.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:49.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:49.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:49.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:49.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:49.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:49.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:49.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:49.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:49.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:49.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:49.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:49.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:49.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:49.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:49.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:49.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:49.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:49.393 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.393 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.394 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.394 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.394 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:49.394 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.075297427999999, 2024-04-26T12:27:49.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:49.394 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.394 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.394 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:49.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:49.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:49.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:49.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:49.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:49.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:49.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:49.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:49.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:49.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:49.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:49.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:49.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:49.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:49.399 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.399 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.399 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.400 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.400 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:49.400 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.075262578999997, 2024-04-26T12:27:49.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:49.400 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.400 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.400 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:49.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:49.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:49.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:49.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:49.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:49.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:49.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:49.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:49.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:49.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:49.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:49.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:49.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:49.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.075228629000001, 2024-04-26T12:27:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.406 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:49.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:49.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:49.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:49.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:49.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:49.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:49.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:49.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:49.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:49.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:49.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:49.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:49.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:49.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:49.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:49.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:49.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:49.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:49.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:49.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:49.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:49.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:49.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:49.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:49.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:49.413 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.413 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.413 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.413 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.413 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:49.413 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.075208332000003, 2024-04-26T12:27:49.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:49.413 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.413 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.414 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:49.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:49.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:49.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:49.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:49.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:49.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:49.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:49.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:49.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:49.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:49.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:49.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:49.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:49.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:49.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:49.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:49.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:49.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:49.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:49.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:49.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:49.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:49.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:49.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:49.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:49.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:49.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:49.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:49.420 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.420 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.420 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.420 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.420 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:49.420 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.075173210999999, 2024-04-26T12:27:49.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:49.420 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.420 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.420 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:49.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:49.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:49.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:49.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:49.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:49.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:49.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:49.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:49.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:49.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:49.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:49.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:49.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:49.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:49.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:49.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:49.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:49.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:49.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:49.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:49.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:49.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:49.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:49.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:49.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:49.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:49.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:49.426 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.426 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.426 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.426 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.426 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:49.426 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.075137970999997, 2024-04-26T12:27:49.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:49.427 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.427 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.427 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:49.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:49.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:49.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:49.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:49.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:49.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:49.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:49.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:49.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:49.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:49.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:49.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:49.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:49.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:49.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:49.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:49.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:49.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:49.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:49.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:49.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:49.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:49.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:49.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:49.433 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.433 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.433 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.433 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.433 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:49.434 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.074996222999999, 2024-04-26T12:27:49.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:49.434 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.434 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.434 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:49.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:49.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:49.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:49.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:49.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:49.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:49.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:49.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:49.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:49.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:49.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:49.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:49.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:49.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:49.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:49.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:49.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:49.439 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.439 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.439 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.439 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.440 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:49.440 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.074972203999998, 2024-04-26T12:27:49.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:49.440 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.440 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.440 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:49.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:49.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:49.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:49.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:49.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:49.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:49.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:49.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:49.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:49.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:49.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:49.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:49.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:49.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:49.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:49.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:49.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:49.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:49.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:49.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:49.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:49.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:49.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:49.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:49.446 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.446 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.446 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.446 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.446 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:49.446 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.074948235999997, 2024-04-26T12:27:49.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:27:49.447 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.447 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.447 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:49.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:49.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:27:49.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:27:49.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:27:49.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:27:49.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:27:49.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:27:49.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:27:49.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:27:49.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:27:49.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:49.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:27:49.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:27:49.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:27:49.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:27:49.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:27:49.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:27:49.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:49.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:27:49.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:27:49.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:49.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:27:49.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:27:49.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:27:49.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:27:49.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:49.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:27:49.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:27:49.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:27:49.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:27:49.452 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.452 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.453 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.453 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.453 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:49.453 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.074914855000003, 2024-04-26T12:27:49.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:27:49.453 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:49.453 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:27:49.453 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:49.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:49.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:49.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:49.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:49.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:49.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:49.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:49.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:49.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:27:49.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:27:49.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:49.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:27:49.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:27:49.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:27:49.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:27:49.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:27:49.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:27:49.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:49.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:27:49.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:27:49.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:49.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:27:49.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:27:49.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:49.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:27:49.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:27:49.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:49.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:49.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:49.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:27:49.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:27:49.457 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.457 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.458 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.458 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:49.458 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:49.458 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:49.460 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:49.460 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:49.458+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:49.560 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:49.559+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:49.590 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:49.590 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:49.590 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:49.590 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:49.600 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:49.661 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:49.660+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:49.726 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:49.726 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:49.726 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:49.726 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:49.726 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:49.736 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:49.762 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:49.761+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:49.863 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:49.862+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:49.904 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:49.904 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:49.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:49.904 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:49.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.905 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:49.905 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:49.905 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 63.020156272999998, 2024-04-26T12:27:49.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:49.905 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.905 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.905 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:49.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:49.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:49.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:49.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:49.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:49.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:49.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:49.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:49.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:49.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:49.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:49.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:49.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:49.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:49.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:49.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:49.911 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.911 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.912 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.912 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:49.912 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:49.912 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 63.019516926000001, 2024-04-26T12:27:49.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:49.913 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.913 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.913 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:49.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:49.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:49.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:49.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:49.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:49.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:49.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:49.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:49.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:49.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:49.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:49.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:49.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:49.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:49.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:49.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 62.889814735999998, 2024-04-26T12:27:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:49.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:49.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:49.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:49.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:49.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:49.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:49.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:49.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:49.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:49.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:49.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:49.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:49.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:49.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:49.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:49.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:49.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:49.922 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.922 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.922 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.922 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:49.922 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:49.923 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 62.889320150000003, 2024-04-26T12:27:49.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:49.923 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.923 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.923 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:49.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:49.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:49.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:49.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:49.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:49.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:49.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:49.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:49.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:49.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:49.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:49.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:49.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:49.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:49.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:49.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:49.927 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.927 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.927 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.927 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:49.928 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:49.928 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 62.887317965999998, 2024-04-26T12:27:49.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:49.928 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.928 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.928 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:49.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:49.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:49.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:49.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:49.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:49.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:49.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:49.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:49.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:49.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:49.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:49.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:49.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:49.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:49.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 62.886911626, 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.932 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.933 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:49.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:49.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:49.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:49.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:49.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:49.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:49.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:49.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:49.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:49.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:49.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:49.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:49.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:49.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:49.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:49.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:49.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.937 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.937 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:49.937 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:49.937 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 62.886556802000001, 2024-04-26T12:27:49.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:49.937 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:49.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:49.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:49.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:49.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:49.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:49.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.942 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:49.942 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:49.942 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 62.783998388000001, 2024-04-26T12:27:49.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:49.942 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.942 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.942 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:49.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:49.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:49.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:49.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:49.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:49.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:49.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:49.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:49.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:49.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:49.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:49.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:49.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:49.946 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.946 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.946 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.947 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:49.947 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:49.947 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 62.783601859999997, 2024-04-26T12:27:49.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:49.947 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.947 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.947 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:49.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:49.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:49.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:49.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:49.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:49.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:49.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:49.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:49.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:49.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:49.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:49.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:49.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:49.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:49.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:49.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:49.953 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.953 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.953 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.954 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:49.954 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:49.954 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 62.686592251999997, 2024-04-26T12:27:49.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:49.954 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.954 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.954 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:49.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:49.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:49.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:49.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:49.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:49.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:49.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:49.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:49.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:49.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:49.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:49.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:49.959 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.959 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.959 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.959 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:49.959 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:49.959 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 62.685898536000003, 2024-04-26T12:27:49.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:49.959 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.959 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.959 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:49.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:49.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:49.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:49.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:49.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:49.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:49.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:49.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:49.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:49.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:49.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:49.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:49.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:49.963 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.963 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.963 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.964 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.964 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:49.964 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.651159481000001, 2024-04-26T12:27:49.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:49.964 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.964 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.964 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:49.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:49.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:49.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:49.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:49.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:49.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:49.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:49.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:49.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:49.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:49.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:49.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:49.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:49.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:49.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:49.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:49.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:49.969 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.969 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.970 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.970 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.970 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:49.970 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.650338562000002, 2024-04-26T12:27:49.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:49.970 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.970 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.970 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:49.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:49.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:49.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:49.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.976 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.976 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:49.976 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.650308471999999, 2024-04-26T12:27:49.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:49.976 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.976 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:49.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:49.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:49.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:49.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:49.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:49.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:49.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:49.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:49.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:49.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:49.982 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.982 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.982 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.983 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.983 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:49.983 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.650254683999997, 2024-04-26T12:27:49.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:49.983 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.983 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.983 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:49.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:49.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:49.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.650202127, 2024-04-26T12:27:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:49.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:49.994 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.650161912999998, 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:49.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:49.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:49.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:49.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:49.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:49.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:49.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:49.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:50.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.650133752000002, 2024-04-26T12:27:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:50.001 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:50.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:50.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:50.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:50.006 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:50.007 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:50.007 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:50.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.007 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.007 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:50.007 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.650103063000003, 2024-04-26T12:27:50.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:50.007 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:50.007 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:50.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:50.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:50.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:50.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:50.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:50.011 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 56.650076490000004, 2024-04-26T12:27:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:50.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:50.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:50.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:50.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:50.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:50.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:50.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:50.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:50.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:50.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:50.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:50.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:50.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:50.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:50.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:50.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:50.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:50.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:50.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:50.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:50.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:50.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:50.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:50.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:50.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:50.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:50.018 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:50.018 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:50.018 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:50.018 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:50.018 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:50.018 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:50.020 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:50.021 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:50.019+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:50.121 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:50.120+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:50.154 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:50.154 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:50.154 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:50.154 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:50.164 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:50.222 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:50.221+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:50.290 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:50.290 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:50.290 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:50.290 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:50.291 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:50.300 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:50.322 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:50.321+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:50.423 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:50.422+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:50.429 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:50.429 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:50.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:50.430 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:50.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.430 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:50.430 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:50.430 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 63.096539032999999, 2024-04-26T12:27:50.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:50.430 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.430 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.430 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:50.430 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:50.431 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:50.431 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:50.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.431 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:50.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:50.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:50.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:50.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:50.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:50.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:50.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:50.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:50.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:50.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:50.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:50.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:50.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:50.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:50.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:50.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:50.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:50.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:50.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:50.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:50.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:50.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:50.435 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.435 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177673210000002, 2024-04-26T12:27:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:50.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:50.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:50.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:50.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:50.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:50.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:50.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:50.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:50.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:50.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:50.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:50.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:50.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:50.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:50.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:50.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:50.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:50.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:50.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:50.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:50.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:50.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:50.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:50.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:50.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:50.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:50.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:50.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:50.443 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.443 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.443 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.444 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.444 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:50.444 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177636997999997, 2024-04-26T12:27:50.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:50.444 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.444 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.444 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:50.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:50.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:50.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:50.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:50.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:50.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:50.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:50.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:50.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:50.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:50.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:50.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:50.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:50.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:50.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:50.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:50.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:50.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:50.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:50.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:50.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:50.450 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.450 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.451 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.451 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.451 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:50.451 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177598023999998, 2024-04-26T12:27:50.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:50.451 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.451 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.451 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:50.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:50.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:50.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:50.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:50.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:50.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:50.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:50.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:50.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:50.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:50.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:50.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:50.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:50.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:50.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:50.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:50.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:50.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:50.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:50.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:50.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:50.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:50.457 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.457 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.457 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.458 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.458 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:50.458 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177574857000003, 2024-04-26T12:27:50.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:50.458 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.458 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.458 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:50.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:50.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:50.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:50.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:50.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:50.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:50.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:50.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:50.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:50.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:50.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:50.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:50.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:50.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:50.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:50.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:50.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:50.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:50.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:50.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:50.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:50.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:50.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:50.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:50.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:50.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:50.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:50.465 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.465 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.465 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.465 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.466 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:50.466 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177559479999999, 2024-04-26T12:27:50.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:50.466 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.466 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.466 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:50.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:50.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:50.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:50.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:50.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:50.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:50.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:50.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:50.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:50.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:50.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:50.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:50.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:50.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:50.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:50.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:50.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:50.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:50.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:50.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:50.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:50.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:50.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:50.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:50.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:50.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:50.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:50.478 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.479 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.479 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.479 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.479 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:50.480 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177531289999997, 2024-04-26T12:27:50.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:50.480 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.480 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.480 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:50.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:50.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:50.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:50.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:50.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:50.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:50.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:50.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:50.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:50.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:50.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:50.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:50.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:50.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:50.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:50.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:50.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:50.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:50.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:50.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:50.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:50.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:50.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:50.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:50.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:50.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:50.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:50.492 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.492 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.492 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.492 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.492 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:50.492 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177513292, 2024-04-26T12:27:50.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:50.493 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.493 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.493 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:50.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:50.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:50.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:50.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:50.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:50.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:50.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:50.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:50.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:50.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:50.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:50.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:50.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:50.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:50.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:50.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:50.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:50.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:50.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:50.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:50.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:50.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:50.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:50.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:50.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:50.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:50.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:50.499 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.499 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.499 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.499 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.499 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:50.499 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177488701000001, 2024-04-26T12:27:50.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:50.499 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.499 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.499 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:50.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:50.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:50.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:50.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:50.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:50.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:50.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:50.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:50.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:50.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:50.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:50.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:50.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:50.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:50.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:50.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:50.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:50.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:50.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:50.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:50.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:50.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:50.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:50.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:50.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:50.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:50.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:50.505 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.505 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.505 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.506 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.506 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:50.506 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177463752000001, 2024-04-26T12:27:50.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:50.506 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.506 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.506 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:50.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:50.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:50.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:50.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:50.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:50.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:50.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:50.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:50.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:50.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:50.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:50.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:50.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:50.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:50.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:50.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:50.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:50.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:50.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:50.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:50.512 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.512 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.512 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.512 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.512 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:50.512 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177442827999997, 2024-04-26T12:27:50.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:50.512 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.513 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.513 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:50.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:50.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:50.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:50.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:50.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:50.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:50.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:50.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:50.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:50.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:50.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:50.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:50.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:50.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:50.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:50.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:50.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:50.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:50.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:50.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:50.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:50.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:50.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:50.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:50.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:50.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:50.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:50.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:50.518 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.518 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.518 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.519 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.519 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:50.519 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177407979000002, 2024-04-26T12:27:50.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:50.519 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.519 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.519 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:50.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:50.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:50.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:50.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:50.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:50.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:50.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:50.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:50.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:50.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:50.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:50.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:50.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:50.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:50.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:50.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:50.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:50.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:50.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:50.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:50.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:50.525 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.525 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.525 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.525 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.525 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:50.525 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177374028999999, 2024-04-26T12:27:50.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:50.525 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:50.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:50.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:50.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:50.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:50.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:50.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:50.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:50.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:50.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:50.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:50.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:50.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:50.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:50.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:50.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:50.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:50.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:50.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:50.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:50.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:50.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:50.531 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.531 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.531 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.531 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.531 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:50.532 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177353732, 2024-04-26T12:27:50.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:50.532 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.532 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.532 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:50.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:50.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:50.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:50.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:50.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:50.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:50.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:50.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:50.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:50.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:50.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:50.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:50.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:50.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:50.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:50.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:50.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:50.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:50.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:50.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:50.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:50.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:50.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:50.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:50.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:50.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:50.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:50.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:50.537 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.537 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.537 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.538 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.538 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:50.538 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177318610999997, 2024-04-26T12:27:50.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:50.538 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.538 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.538 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:50.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:50.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:50.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:50.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:50.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:50.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:50.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:50.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:50.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:50.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:50.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:50.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:50.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:50.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:50.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:50.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:50.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:50.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:50.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:50.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:50.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:50.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:50.543 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.543 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.543 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.544 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.544 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:50.544 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177283371000001, 2024-04-26T12:27:50.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:50.544 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.544 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.544 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:50.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:50.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:50.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:50.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:50.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:50.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:50.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:50.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:50.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:50.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:50.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:50.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:50.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:50.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:50.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:50.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:50.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:50.549 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.550 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.550 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.550 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.550 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:50.550 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177141622999997, 2024-04-26T12:27:50.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:50.550 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.550 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.550 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:50.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:50.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:50.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:50.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:50.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:50.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:50.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:50.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:50.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:50.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:50.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:50.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:50.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:50.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:50.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:50.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:50.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:50.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:50.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:50.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:50.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:50.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:50.557 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.557 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.557 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.557 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.557 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:50.557 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177117604000003, 2024-04-26T12:27:50.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:50.557 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.557 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.557 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:50.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:50.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:50.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:50.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:50.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:50.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:50.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:50.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:50.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:50.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:50.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:50.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:50.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:50.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:50.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:50.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:50.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:50.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:50.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:50.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:50.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:50.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:50.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:50.567 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.567 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.567 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.567 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.567 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:50.567 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177093636000002, 2024-04-26T12:27:50.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:27:50.568 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.568 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:50.568 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:50.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:50.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:27:50.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:27:50.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:27:50.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:27:50.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:27:50.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:27:50.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:27:50.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:27:50.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:27:50.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:50.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:27:50.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:27:50.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:27:50.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:27:50.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:27:50.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:27:50.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:50.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:27:50.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:27:50.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:27:50.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:27:50.573 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.573 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.573 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.573 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:50.573 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:50.574 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177060255000001, 2024-04-26T12:27:50.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:27:50.574 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:50.574 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:27:50.574 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:50.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:50.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:50.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:50.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:50.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:50.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:50.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:50.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:50.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:50.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:27:50.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:27:50.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:50.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:50.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:27:50.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:27:50.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:50.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:27:50.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:27:50.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:50.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:27:50.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:27:50.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:50.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:50.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:50.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:27:50.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:27:50.578 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.578 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.578 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.578 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:50.578 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:50.578 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:50.579 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:50.580 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:50.578+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:50.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:27:50.681 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:50.679+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:50.718 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:50.718 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:50.719 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:50.719 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:50.728 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:50.782 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:50.780+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:50.855 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:50.855 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:50.855 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:50.855 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:50.856 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:50.865 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:50.882 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:50.881+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:50.983 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:50.982+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:51.035 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:51.035 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:51.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:51.035 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:51.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.035 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:51.035 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:51.035 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.150588463999995, 2024-04-26T12:27:51.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:51.035 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.035 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:51.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.039 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.149949117000006, 2024-04-26T12:27:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:51.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.020246927000002, 2024-04-26T12:27:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.044 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:51.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.019752341, 2024-04-26T12:27:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:51.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.017750156999995, 2024-04-26T12:27:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.053 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:51.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.017343816999997, 2024-04-26T12:27:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:51.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:51.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.016988992999998, 2024-04-26T12:27:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.062 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:51.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 63.914430578999998, 2024-04-26T12:27:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:51.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 63.914034051000002, 2024-04-26T12:27:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.071 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:51.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.075 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:51.076 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:51.076 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 63.817024443000001, 2024-04-26T12:27:51.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:51.076 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.076 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.076 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:51.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:51.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:51.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:51.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:51.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:51.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:51.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 63.816330727, 2024-04-26T12:27:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.080 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:51.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:51.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 57.781591671999998, 2024-04-26T12:27:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:51.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:51.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 57.780770752999999, 2024-04-26T12:27:51.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:51.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:51.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 57.780740663000003, 2024-04-26T12:27:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:51.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:51.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 57.780686875000001, 2024-04-26T12:27:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:51.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:51.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:51.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:51.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:51.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:51.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:51.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:51.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:51.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:51.108 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 57.780634317999997, 2024-04-26T12:27:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:51.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:51.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:51.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:51.114 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 57.780594104000002, 2024-04-26T12:27:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:51.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:51.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:51.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:51.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:51.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:51.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:51.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:51.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:51.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:51.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.121 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 57.780565942999999, 2024-04-26T12:27:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:51.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:51.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:51.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:51.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:51.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:51.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:51.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:51.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:51.128 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 57.780535254, 2024-04-26T12:27:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:51.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 57.780508681000001, 2024-04-26T12:27:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:51.133 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:51.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:51.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.137 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.138 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.138 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:51.138 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:51.138 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:51.140 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:51.140 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:51.138+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:51.240 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:51.238+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:51.269 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:51.269 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:51.269 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:51.269 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:51.279 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:51.319 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:27:51.341 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:51.340+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:51.441 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:51.440+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:51.446 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:51.446 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:51.446 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:51.446 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:51.446 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:51.456 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:51.470 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:51.490 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:51.490 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:51.490 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:27:51.490 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:51.493 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:27:51.493 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:27:51.542 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:51.541+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:51.622 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:51.623 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:51.632 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:51.643 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:51.642+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2024-04-26T12:27:51.744 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:51.743+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:51.771 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:51.771 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:51.782 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:51.845 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:51.845+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:51.909 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:51.919 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:51.946 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:51.945+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:51.970 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:27:51.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-26T12:27:52.045 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:52.046 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:52.047 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:52.045+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:52.055 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:52.081 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-26T12:27:52.148 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:52.147+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:52.183 INFO:teuthology.orchestra.console.smithi136:Power off completed 2024-04-26T12:27:52.184 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:52.184 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:52.194 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:52.249 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:52.248+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:52.350 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:52.349+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:52.361 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:52.361 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:52.371 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:52.451 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:52.450+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:52.538 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:52.538 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:52.548 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:52.551 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:52.550+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:52.652 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:52.650+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:52.678 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:52.678 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:52.688 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:52.752 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:52.752+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:52.853 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:52.853+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:52.857 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:52.857 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:52.868 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:52.954 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:52.953+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:52.995 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:52.995 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:53.005 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:53.056 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:53.054+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:53.135 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:53.136 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:53.146 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:53.190 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:53.189+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:53.258 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:53.257+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:53.273 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:53.273 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:53.282 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:53.359 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:53.358+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:53.449 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:53.449 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:53.459 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:53.460 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:53.459+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:53.494 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:27:53.561 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:53.560+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:53.591 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:53.592 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:53.602 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:53.650 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:53.676 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:53.676 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:53.676 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:27:53.676 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:53.680 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:27:53.681 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:27:53.685 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:53.684+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:53.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:27:53.764 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:53.762+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:53.768 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:53.768 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:53.768 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:53.768 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:53.769 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:53.779 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:53.864 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:53.864+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:53.947 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:53.947 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:53.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:53.948 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:53.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.948 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:53.948 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:53.948 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 67.063647532000005, 2024-04-26T12:27:53.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:53.948 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:53.948 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:53.948 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:53.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:53.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:53.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:53.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:53.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:53.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:53.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:53.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:53.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:53.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:53.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:53.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:53.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:53.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:53.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:53.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:53.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:53.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:53.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:53.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:53.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:53.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:53.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:53.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:53.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:53.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:53.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:53.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:53.952 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.952 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:53.952 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.952 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:53.953 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:53.953 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 67.063008185000001, 2024-04-26T12:27:53.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:53.953 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:53.953 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:53.953 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:53.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:53.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:53.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:53.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:53.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:53.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:53.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:53.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:53.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:53.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:53.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:53.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:53.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:53.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:53.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:53.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:53.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:53.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:53.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:53.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:53.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:53.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:53.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:53.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:53.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:53.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.933305994999998, 2024-04-26T12:27:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:53.957 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:53.958 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:53.958 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:53.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:53.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:53.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:53.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:53.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:53.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:53.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:53.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:53.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:53.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:53.961 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.961 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:53.961 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.961 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:53.961 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:53.962 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.932811408999996, 2024-04-26T12:27:53.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:53.962 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:53.962 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:53.962 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:53.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:53.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:53.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:53.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:53.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:53.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:53.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:53.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:53.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:53.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:53.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:53.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:53.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:53.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:53.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:53.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:53.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:53.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:53.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:53.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:53.965 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.965 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:53.966 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.966 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:53.966 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:53.966 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.930809225000004, 2024-04-26T12:27:53.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:53.966 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:53.966 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:53.966 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:53.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:53.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:53.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:53.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:53.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:53.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:53.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:53.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:53.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:53.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:53.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:53.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:53.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:53.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:53.970 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.970 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:53.970 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.970 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.930402885000007, 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:53.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:53.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:53.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:53.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:53.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:53.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:53.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:53.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:53.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:53.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:53.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:53.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:53.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:53.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:53.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:53.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:53.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:53.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:53.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:53.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:53.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:53.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:53.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:53.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:53.974 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.975 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:53.975 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.975 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:53.975 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:53.975 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.930048060999994, 2024-04-26T12:27:53.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:53.975 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:53.976 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:53.976 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:53.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:53.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:53.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:53.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:53.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:53.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:53.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:53.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:53.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:53.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:53.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:53.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:53.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:53.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:53.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:53.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:53.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:53.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:53.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:53.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:53.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:53.980 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.980 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:53.980 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.980 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:53.980 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:53.980 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.827489646999993, 2024-04-26T12:27:53.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:53.980 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:53.980 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:53.980 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:53.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:53.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:53.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:53.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:53.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:53.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:53.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:53.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:53.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:53.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:53.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:53.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:53.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:53.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:53.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:53.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:53.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:53.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:53.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:53.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:53.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.984 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:53.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.984 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:53.984 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:53.984 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.827093118999997, 2024-04-26T12:27:53.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:53.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:53.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:53.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:53.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:53.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:53.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:53.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:53.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:53.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:53.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:53.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:53.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:53.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:53.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:53.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:53.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.988 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:53.989 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.989 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:53.989 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:53.989 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.730083511000004, 2024-04-26T12:27:53.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:53.989 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:53.989 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:53.989 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:53.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:53.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:53.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:53.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:53.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:53.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:53.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:53.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:53.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:53.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:53.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:53.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:53.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:53.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:53.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:53.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:53.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:53.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:53.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:53.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:53.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:53.993 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.993 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:53.993 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.993 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:53.993 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:53.993 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.729389795000003, 2024-04-26T12:27:53.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:53.994 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:53.994 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:53.994 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:53.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:53.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:53.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:53.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:53.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:53.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:53.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:53.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:53.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:53.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:53.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:53.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:53.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:53.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:53.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:53.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:53.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:53.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:53.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:53.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:53.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:53.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:53.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:53.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:53.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:53.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:53.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:53.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:53.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:53.998 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.998 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:53.998 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:53.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:53.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.998 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:53.999 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:53.999 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.69465074, 2024-04-26T12:27:53.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:53.999 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:53.999 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:53.999 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:53.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:53.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:53.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:54.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:54.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:54.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:54.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:54.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:54.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:54.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:54.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:54.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:54.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:54.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:54.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:54.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:54.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:54.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:54.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:54.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:54.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:54.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:54.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:54.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:54.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:54.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:54.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:54.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:54.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:54.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:54.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:54.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:54.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:54.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:54.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:54.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:54.005 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.005 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:54.005 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.006 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.006 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:54.006 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.693829821000001, 2024-04-26T12:27:54.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:54.006 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:54.006 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.006 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:54.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:54.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:54.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:54.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:54.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:54.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:54.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:54.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:54.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:54.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:54.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:54.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:54.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:54.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:54.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:54.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:54.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:54.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:54.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:54.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:54.011 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.011 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:54.011 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.011 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.693799730999999, 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:54.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:54.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:54.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:54.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:54.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:54.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:54.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:54.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:54.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:54.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:54.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:54.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:54.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:54.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:54.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:54.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:54.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:54.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:54.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:54.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:54.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:54.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:54.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.693745943000003, 2024-04-26T12:27:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:54.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:54.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:54.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:54.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:54.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:54.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:54.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:54.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:54.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:54.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:54.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:54.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:54.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:54.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:54.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:54.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:54.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:54.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:54.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:54.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:54.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:54.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:54.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:54.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:54.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:54.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:54.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:54.022 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.022 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:54.022 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.022 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.023 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:54.023 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.693693386, 2024-04-26T12:27:54.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:54.023 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:54.023 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.023 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:54.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:54.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:54.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:54.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:54.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:54.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:54.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:54.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:54.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:54.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:54.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:54.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:54.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:54.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:54.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:54.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:54.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:54.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:54.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:54.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:54.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:54.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:54.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:54.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:54.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:54.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:54.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:54.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:54.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:54.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:54.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:54.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:54.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:54.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:54.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:54.028 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.028 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:54.028 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.028 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.028 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:54.029 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.693653171999998, 2024-04-26T12:27:54.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:54.029 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:54.029 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.029 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:54.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:54.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:54.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:54.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:54.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:54.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:54.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:54.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:54.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:54.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.033 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:54.034 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.034 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.034 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:54.034 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.693625011000002, 2024-04-26T12:27:54.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:54.034 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:54.034 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.034 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:54.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:54.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:54.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:54.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:54.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:54.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:54.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:54.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:54.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:54.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:54.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:54.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:54.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:54.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:54.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:54.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:54.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:54.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:54.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:54.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:54.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:54.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:54.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:54.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:54.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:54.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:54.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:54.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:54.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:54.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:54.039 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.693594322000003, 2024-04-26T12:27:54.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:54.040 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:54.040 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:54.040 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:54.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:54.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:54.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:54.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:54.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:54.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:54.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:54.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:54.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:54.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:54.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:54.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:54.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:54.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:54.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:54.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:54.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:54.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:54.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:54.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.693567749000003, 2024-04-26T12:27:54.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:54.044 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:54.044 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:54.044 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:54.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:54.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:54.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:54.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:54.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:54.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:54.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:54.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:54.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:54.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:54.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:54.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:54.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:54.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:54.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:54.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:54.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:54.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:54.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:54.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:54.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:54.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:54.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:54.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:54.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:54.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:54.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.047 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:54.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:54.048 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:54.048 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:54.049 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:54.048+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:54.049 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:54.150 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:54.149+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:54.179 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:54.180 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:54.180 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:54.180 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:54.190 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:54.250 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:54.249+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:54.351 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:54.350+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:54.355 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:54.357 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:54.366 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:54.453 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:54.452+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:54.495 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:54.495 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:54.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:54.495 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:54.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.495 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:54.495 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:54.495 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 67.161918892000003, 2024-04-26T12:27:54.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:54.495 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.496 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.496 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:54.496 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:54.496 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:54.496 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:54.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.497 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:54.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:54.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:54.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:54.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:54.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:54.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:54.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:54.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:54.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:54.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:54.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:54.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:54.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:54.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:54.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:54.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:54.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:54.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:54.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:54.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:54.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:54.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:54.502 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.502 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.503 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.503 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.503 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:54.503 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.243053068999998, 2024-04-26T12:27:54.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:54.503 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.503 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.503 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:54.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:54.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:54.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:54.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:54.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:54.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:54.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:54.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:54.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:54.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:54.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.506 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:54.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:54.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:54.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:54.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:54.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:54.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:54.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:54.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:54.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:54.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:54.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:54.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:54.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:54.509 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.509 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.509 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.510 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.510 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:54.510 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.243016857000001, 2024-04-26T12:27:54.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:54.511 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.511 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.511 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:54.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:54.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:54.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:54.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:54.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:54.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:54.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:54.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:54.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:54.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:54.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:54.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:54.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:54.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:54.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:54.516 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.516 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.516 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.517 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.517 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:54.517 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242977883000002, 2024-04-26T12:27:54.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:54.517 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.517 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.517 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:54.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:54.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:54.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:54.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:54.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:54.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:54.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:54.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:54.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:54.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:54.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:54.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:54.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:54.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:54.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:54.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:54.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:54.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:54.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:54.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:54.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:54.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:54.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:54.522 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.523 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.523 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.523 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.523 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:54.523 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242954716, 2024-04-26T12:27:54.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:54.523 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.523 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.523 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:54.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:54.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:54.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:54.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:54.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:54.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:54.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:54.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:54.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:54.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:54.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:54.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:54.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:54.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:54.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:54.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.529 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.530 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.530 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:54.530 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242939339000003, 2024-04-26T12:27:54.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:54.530 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.530 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.530 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:54.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:54.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:54.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:54.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:54.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:54.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:54.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:54.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:54.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:54.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:54.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:54.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:54.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:54.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:54.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:54.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:54.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:54.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:54.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:54.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:54.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:54.535 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.536 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.536 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.536 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.536 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:54.536 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242911149000001, 2024-04-26T12:27:54.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:54.536 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.536 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.536 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:54.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:54.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:54.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:54.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:54.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:54.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:54.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:54.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:54.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:54.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:54.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:54.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:54.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:54.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:54.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:54.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:54.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242893150999997, 2024-04-26T12:27:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:54.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:54.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:54.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:54.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:54.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:54.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:54.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:54.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:54.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:54.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:54.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:54.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:54.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:54.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:54.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:54.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:54.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:54.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:54.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:54.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:54.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:54.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:54.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:54.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:54.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:54.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:54.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:54.548 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.548 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.548 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.548 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.548 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:54.549 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242868559999998, 2024-04-26T12:27:54.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:54.549 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.549 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.549 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:54.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:54.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:54.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:54.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:54.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:54.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:54.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:54.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:54.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:54.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:54.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:54.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:54.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:54.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:54.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:54.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:54.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:54.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:54.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:54.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:54.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:54.554 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.554 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.554 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.555 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.555 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:54.555 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242843610999998, 2024-04-26T12:27:54.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:54.555 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.555 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.555 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:54.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:54.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:54.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:54.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:54.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:54.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:54.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:54.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:54.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:54.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:54.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:54.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:54.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:54.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:54.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:54.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:54.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:54.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:54.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:54.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:54.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:54.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:54.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:54.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:54.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:54.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:54.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:54.561 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.561 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.561 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.561 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.561 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:54.562 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242822687, 2024-04-26T12:27:54.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:54.562 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.562 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.562 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:54.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:54.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:54.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:54.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:54.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:54.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:54.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:54.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:54.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:54.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:54.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:54.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:54.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:54.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:54.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:54.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:54.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:54.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:54.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:54.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:54.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:54.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:54.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:54.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:54.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:54.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:54.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:54.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:54.567 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.568 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.568 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.568 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.568 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:54.568 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242787837999998, 2024-04-26T12:27:54.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:54.568 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.568 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.568 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:54.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:54.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:54.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:54.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:54.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:54.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:54.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:54.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:54.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:54.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:54.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:54.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:54.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:54.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:54.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:54.574 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.574 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.574 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.574 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.574 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:54.574 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242753888000003, 2024-04-26T12:27:54.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:54.574 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.574 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.574 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:54.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:54.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:54.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:54.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:54.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:54.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:54.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:54.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:54.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:54.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:54.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:54.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:54.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:54.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:54.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:54.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:54.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:54.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:54.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:54.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:54.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:54.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:54.580 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.580 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.580 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.580 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.580 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:54.581 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242733590999997, 2024-04-26T12:27:54.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:54.581 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.581 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.581 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:54.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:54.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:54.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:54.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:54.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:54.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:54.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:54.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:54.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:54.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:54.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:54.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:54.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:54.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:54.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:54.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:54.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:54.586 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.586 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.586 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242698470000001, 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:54.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:54.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:54.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:54.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:54.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:54.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:54.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:54.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:54.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:54.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:54.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:54.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:54.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:54.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:54.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:54.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:54.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:54.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:54.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:54.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:54.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:54.593 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.593 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.593 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.593 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.593 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:54.593 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242663229999998, 2024-04-26T12:27:54.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:54.593 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.593 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.593 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:54.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:54.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:54.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:54.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:54.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:54.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:54.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:54.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:54.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:54.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:54.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:54.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:54.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:54.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:54.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:54.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:54.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:54.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:54.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:54.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:54.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:54.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:54.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:54.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:54.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:54.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:54.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:54.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:54.599 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.599 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.599 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242521482000001, 2024-04-26T12:27:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:54.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:54.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:54.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:54.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:54.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:54.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:54.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:54.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:54.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:54.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:54.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:54.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:54.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:54.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:54.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:54.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:54.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.606 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.606 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.606 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.606 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:54.606 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242497462999999, 2024-04-26T12:27:54.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:54.606 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.606 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.606 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:54.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:54.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:54.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:54.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:54.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:54.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:54.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:54.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:54.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:54.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:54.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:54.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:54.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:54.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:54.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:54.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:54.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:54.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:54.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:54.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:54.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242473494999999, 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:54.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:54.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:27:54.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:27:54.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:27:54.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:27:54.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:27:54.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:27:54.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:27:54.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:27:54.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:27:54.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:54.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:27:54.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:27:54.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:27:54.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:27:54.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:27:54.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:27:54.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:54.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:27:54.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:27:54.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:54.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:27:54.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:27:54.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:54.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:27:54.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:27:54.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:54.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:27:54.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:27:54.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:27:54.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:27:54.619 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.619 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.619 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.619 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:54.619 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:54.619 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.242440113999997, 2024-04-26T12:27:54.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:27:54.620 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:54.620 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:27:54.620 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:54.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:54.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:54.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:54.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:54.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:54.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:27:54.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:54.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:27:54.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:27:54.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:27:54.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:27:54.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:54.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:27:54.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:27:54.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:54.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:27:54.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:27:54.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:54.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:27:54.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:27:54.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:54.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:54.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:54.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:27:54.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:27:54.624 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.624 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.624 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.624 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:54.624 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:54.624 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:54.625 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:54.626 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:54.624+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:54.688 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2024-04-26T12:27:54.726 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:54.725+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:54.762 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:54.762 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:54.762 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:54.762 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:54.772 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:54.827 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:54.826+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:54.928 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:54.926+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:54.937 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:54.937 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:54.937 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:54.937 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:54.937 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:54.947 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:55.029 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:55.028+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:55.115 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.232124037000006, 2024-04-26T12:27:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:55.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.120 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.231484690000002, 2024-04-26T12:27:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:55.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.101782499999999, 2024-04-26T12:27:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.125 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.126 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:55.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:55.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:55.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:55.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:55.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:55.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:55.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:55.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:55.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:55.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:55.132 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.101287913999997, 2024-04-26T12:27:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:55.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:55.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.099285730000005, 2024-04-26T12:27:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:55.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.098879389999993, 2024-04-26T12:27:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:55.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:55.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:55.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:55.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:55.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:55.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:55.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:55.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:55.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:55.148 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.098524565999995, 2024-04-26T12:27:55.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:55.149 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.149 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.149 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:55.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.154 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:55.154 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:55.154 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 67.995966151999994, 2024-04-26T12:27:55.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:55.154 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.154 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.154 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:55.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:55.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:55.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:55.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:55.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:55.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:55.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:55.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 67.995569623999998, 2024-04-26T12:27:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.165 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 67.898560016000005, 2024-04-26T12:27:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:55.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.170 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 67.897866300000004, 2024-04-26T12:27:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:55.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.175 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.863127245000001, 2024-04-26T12:27:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:55.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:55.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.182 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.182 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:55.182 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.862306326000002, 2024-04-26T12:27:55.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:55.182 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.182 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.182 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:55.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:55.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:55.187 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.862276236, 2024-04-26T12:27:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:55.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.193 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.862222447999997, 2024-04-26T12:27:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:55.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:55.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:55.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:55.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:55.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.199 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.862169891000001, 2024-04-26T12:27:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:55.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:55.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:55.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:55.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:55.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.862129676999999, 2024-04-26T12:27:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.206 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:55.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:55.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.862101516000003, 2024-04-26T12:27:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:55.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.217 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.862070826999997, 2024-04-26T12:27:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:55.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.862044253999997, 2024-04-26T12:27:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:55.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:55.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.225 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.226 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:55.226 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:55.226 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:55.227 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:55.228 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:55.226+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:55.328 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:55.327+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:55.362 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:55.363 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:55.363 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:55.363 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:55.373 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:55.457 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:55.456+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:55.530 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:55.529+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:55.539 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:55.539 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:55.539 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:55.539 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:55.539 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:55.549 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:55.633 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:55.632+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:55.682 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:27:55.719 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:55.720 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:55.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:55.720 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:55.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.720 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:55.720 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:55.721 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.385811481000005, 2024-04-26T12:27:55.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:55.721 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.721 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.721 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:55.721 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:55.722 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:55.722 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:55.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.722 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:55.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:55.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:55.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:55.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:55.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:55.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:55.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:55.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:55.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:55.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:55.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:55.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:55.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:55.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:55.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:55.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:55.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:55.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:55.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:55.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:55.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:55.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:55.731 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.731 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.731 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.732 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.732 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:55.732 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466945658, 2024-04-26T12:27:55.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:55.732 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.732 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.732 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:55.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:55.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:55.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:55.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:55.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:55.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:55.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:55.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:55.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:55.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:55.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:55.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:55.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:55.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:55.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:55.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:55.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.738 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.739 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.739 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.739 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:55.739 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466909446000003, 2024-04-26T12:27:55.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:55.739 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.739 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.739 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:55.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:55.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:55.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:55.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:55.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:55.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:55.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:55.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:55.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:55.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:55.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:55.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:55.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:55.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:55.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:55.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:55.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:55.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:55.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:55.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:55.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:55.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:55.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:55.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:55.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:55.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:55.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:55.745 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.745 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.745 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.745 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.745 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:55.745 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466870471999997, 2024-04-26T12:27:55.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:55.746 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.746 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.746 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:55.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:55.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:55.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:55.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:55.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:55.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:55.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:55.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:55.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:55.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:55.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:55.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:55.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:55.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:55.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:55.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:55.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:55.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:55.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:55.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:55.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:55.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:55.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:55.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:55.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:55.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:55.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466847305000002, 2024-04-26T12:27:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:55.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:55.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:55.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:55.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:55.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:55.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:55.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:55.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:55.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:55.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:55.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:55.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:55.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:55.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:55.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:55.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:55.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:55.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:55.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:55.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:55.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:55.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:55.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:55.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:55.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:55.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:55.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:55.758 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.758 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.758 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.758 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.758 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:55.758 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466831927999998, 2024-04-26T12:27:55.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:55.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:55.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:55.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:55.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:55.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:55.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:55.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:55.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:55.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:55.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:55.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:55.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:55.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:55.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:55.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:55.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:55.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:55.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:55.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:55.764 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.764 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.764 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.764 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.764 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:55.765 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466803738000003, 2024-04-26T12:27:55.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:55.765 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.765 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.765 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:55.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:55.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:55.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:55.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:55.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:55.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:55.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:55.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:55.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:55.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:55.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:55.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:55.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:55.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:55.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:55.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:55.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:55.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:55.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:55.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:55.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:55.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:55.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:55.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:55.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:55.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:55.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:55.770 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.770 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.770 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.771 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.771 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:55.771 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466785739999999, 2024-04-26T12:27:55.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:55.771 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.771 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.771 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:55.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:55.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:55.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:55.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:55.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:55.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:55.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:55.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:55.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:55.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:55.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:55.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:55.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:55.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:55.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:55.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:55.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:55.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:55.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:55.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:55.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:55.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:55.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:55.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:55.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:55.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:55.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:55.777 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.777 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.777 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.777 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.777 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:55.777 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466761149, 2024-04-26T12:27:55.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:55.777 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.778 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.778 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:55.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:55.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:55.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:55.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:55.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:55.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:55.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:55.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:55.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:55.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:55.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:55.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:55.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:55.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:55.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:55.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:55.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:55.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:55.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:55.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:55.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:55.783 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.783 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.783 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.784 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.784 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:55.784 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.4667362, 2024-04-26T12:27:55.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:55.784 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.784 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.784 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:55.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:55.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:55.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:55.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:55.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:55.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:55.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:55.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:55.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:55.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:55.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:55.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:55.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:55.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:55.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:55.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:55.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:55.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:55.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:55.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:55.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:55.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:55.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:55.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:55.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:55.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:55.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:55.790 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.790 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.790 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.790 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.790 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:55.790 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466715276000002, 2024-04-26T12:27:55.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:55.790 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.790 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.790 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:55.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:55.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:55.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:55.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:55.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:55.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:55.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:55.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:55.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:55.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:55.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:55.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:55.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:55.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:55.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:55.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:55.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:55.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:55.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:55.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:55.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:55.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:55.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:55.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:55.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:55.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:55.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:55.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:55.796 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.796 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.796 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.796 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.796 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:55.796 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466680427, 2024-04-26T12:27:55.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:55.796 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.797 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.797 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:55.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:55.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:55.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:55.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:55.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:55.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:55.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:55.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:55.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:55.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:55.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:55.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:55.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:55.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:55.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:55.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:55.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:55.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:55.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:55.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:55.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:55.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:55.802 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.802 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.802 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.802 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.802 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:55.803 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466646476999998, 2024-04-26T12:27:55.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:55.803 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.803 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.803 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:55.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:55.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:55.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:55.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:55.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:55.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:55.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:55.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:55.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:55.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:55.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:55.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:55.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:55.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:55.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:55.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:55.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:55.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:55.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:55.808 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.808 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.808 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.809 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.809 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:55.809 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466626179999999, 2024-04-26T12:27:55.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:55.809 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.809 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.809 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:55.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:55.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:55.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:55.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:55.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:55.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:55.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:55.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:55.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:55.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:55.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:55.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:55.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:55.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:55.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:55.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:55.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:55.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:55.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:55.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:55.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:55.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:55.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:55.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:55.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:55.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:55.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:55.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:55.815 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.815 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.815 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.815 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.815 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:55.815 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466591059000002, 2024-04-26T12:27:55.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:55.815 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.815 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.815 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:55.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:55.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:55.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:55.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:55.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:55.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:55.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:55.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:55.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:55.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:55.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:55.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:55.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:55.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:55.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:55.821 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.821 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.821 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.821 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.821 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:55.821 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466555819, 2024-04-26T12:27:55.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:55.821 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.821 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.822 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:55.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:55.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:55.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:55.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:55.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:55.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:55.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:55.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:55.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:55.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:55.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:55.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:55.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:55.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:55.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:55.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:55.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:55.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:55.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:55.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:55.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:55.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:55.827 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.827 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.827 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.827 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.828 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:55.828 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466414071000003, 2024-04-26T12:27:55.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:55.828 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.828 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.828 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:55.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:55.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:55.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:55.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:55.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:55.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:55.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:55.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:55.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:55.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:55.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:55.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:55.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:55.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:55.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:55.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:55.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:55.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:55.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:55.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:55.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:55.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:55.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:55.833 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.833 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.833 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.834 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.834 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:55.834 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466390052000001, 2024-04-26T12:27:55.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:55.834 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.834 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.834 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:55.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:55.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:55.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:55.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:55.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:55.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:55.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:55.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:55.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:55.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:55.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:55.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:55.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:55.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:55.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:55.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:55.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:55.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:55.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:55.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:55.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:55.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:55.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:55.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:55.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:55.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:55.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:55.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:55.840 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.840 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.840 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.840 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.840 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:55.840 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466366084000001, 2024-04-26T12:27:55.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:27:55.840 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.840 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:55.840 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:55.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:55.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:27:55.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:27:55.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:27:55.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:27:55.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:27:55.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:27:55.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:27:55.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:27:55.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:27:55.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:55.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:27:55.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:27:55.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:27:55.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:27:55.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:27:55.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:27:55.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:55.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:27:55.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:27:55.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:27:55.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:27:55.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:27:55.846 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.846 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.846 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.846 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:55.846 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:55.846 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 62.466332702999999, 2024-04-26T12:27:55.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:55.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:55.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:55.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:55.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:27:55.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:27:55.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:55.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:27:55.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:27:55.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:55.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:27:55.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:27:55.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:27:55.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:27:55.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:55.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:27:55.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:27:55.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:55.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:27:55.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:27:55.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:55.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:27:55.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:27:55.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:55.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:55.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:55.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:27:55.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:27:55.851 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.851 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.851 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.851 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:55.851 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:55.851 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:55.852 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:55.853 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:55.853 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:55.851+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:55.857 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:27:55.857 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:55.860 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:27:55.860 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:27:55.953 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:55.953+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:55.992 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:55.993 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:56.003 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:56.054 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:56.053+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:56.129 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:56.129 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:56.138 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:56.180 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:56.178+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:56.256 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:56.255+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:56.304 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:56.304 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:56.314 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:56.357 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:56.356+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:56.443 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:56.443 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:56.453 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:56.496 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:56.495+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:56.558 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:56.558+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:56.579 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:56.580 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:56.589 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:56.660 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:56.658+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:56.701 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:27:56.755 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:56.756 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:56.761 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:56.760+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:56.765 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:56.862 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:56.861+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:56.894 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:56.894 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:56.904 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:56.963 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:56.962+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:57.029 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:57.029 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:57.039 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:57.082 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:57.081+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:57.165 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:57.165 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:57.166 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:57.164+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:57.175 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:57.266 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:57.265+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:57.284 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T12:27:57.284 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:27:57.284 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-26T12:27:57.285 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T12:27:57.304 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:57.304 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:57.314 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:57.368 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:57.366+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:57.441 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:57.441 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:57.451 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:57.492 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:57.491+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:57.569 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:57.568+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:57.617 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:57.618 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:57.627 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:57.647 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:27:57.647 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-04-26T12:27:57.647 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 33, 2024-04-26T12:27:57.647 INFO:teuthology.orchestra.run.smithi046.stdout: "fsid": "3dd84416-f290-4721-94ce-52b0ffaacf34", 2024-04-26T12:27:57.647 INFO:teuthology.orchestra.run.smithi046.stdout: "created": "2024-04-26T12:26:36.091476+0000", 2024-04-26T12:27:57.647 INFO:teuthology.orchestra.run.smithi046.stdout: "modified": "2024-04-26T12:27:54.679858+0000", 2024-04-26T12:27:57.647 INFO:teuthology.orchestra.run.smithi046.stdout: "last_up_change": "2024-04-26T12:27:47.657403+0000", 2024-04-26T12:27:57.647 INFO:teuthology.orchestra.run.smithi046.stdout: "last_in_change": "2024-04-26T12:26:37.993949+0000", 2024-04-26T12:27:57.647 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T12:27:57.647 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_num": 5804032, 2024-04-26T12:27:57.647 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_set": [ 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: "nodeep-scrub", 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: "pglog_hardlimit", 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: "purged_snapdirs", 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_deletes", 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: "sortbitwise" 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_version": 4, 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_snapshot": "", 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_max": 4, 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: "max_osd": 3, 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: "require_min_compat_client": "luminous", 2024-04-26T12:27:57.648 INFO:teuthology.orchestra.run.smithi046.stdout: "min_compat_client": "jewel", 2024-04-26T12:27:57.649 INFO:teuthology.orchestra.run.smithi046.stdout: "require_osd_release": "reef", 2024-04-26T12:27:57.649 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_crimson": false, 2024-04-26T12:27:57.649 INFO:teuthology.orchestra.run.smithi046.stdout: "pools": [ 2024-04-26T12:27:57.649 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.649 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 1, 2024-04-26T12:27:57.649 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": ".mgr", 2024-04-26T12:27:57.649 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2024-04-26T12:26:45.341269+0000", 2024-04-26T12:27:57.649 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-04-26T12:27:57.649 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2024-04-26T12:27:57.649 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2024-04-26T12:27:57.649 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2024-04-26T12:27:57.649 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2024-04-26T12:27:57.649 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2024-04-26T12:27:57.650 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:27:57.650 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:27:57.650 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:27:57.650 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:27:57.650 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2024-04-26T12:27:57.650 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:27:57.650 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 1, 2024-04-26T12:27:57.650 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 1, 2024-04-26T12:27:57.650 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 1, 2024-04-26T12:27:57.650 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 1, 2024-04-26T12:27:57.650 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 1, 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "11", 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:27:57.651 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2024-04-26T12:27:57.652 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2024-04-26T12:27:57.652 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2024-04-26T12:27:57.652 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2024-04-26T12:27:57.652 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2024-04-26T12:27:57.652 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2024-04-26T12:27:57.652 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2024-04-26T12:27:57.652 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2024-04-26T12:27:57.652 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2024-04-26T12:27:57.652 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2024-04-26T12:27:57.652 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2024-04-26T12:27:57.652 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2024-04-26T12:27:57.652 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2024-04-26T12:27:57.652 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:27:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:27:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:27:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2024-04-26T12:27:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2024-04-26T12:27:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2024-04-26T12:27:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2024-04-26T12:27:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2024-04-26T12:27:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2024-04-26T12:27:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2024-04-26T12:27:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2024-04-26T12:27:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:27:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:27:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:27:57.654 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:27:57.654 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2024-04-26T12:27:57.654 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2024-04-26T12:27:57.654 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2024-04-26T12:27:57.654 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2024-04-26T12:27:57.654 INFO:teuthology.orchestra.run.smithi046.stdout: "options": { 2024-04-26T12:27:57.654 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_max": 32, 2024-04-26T12:27:57.654 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_min": 1 2024-04-26T12:27:57.654 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.654 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2024-04-26T12:27:57.654 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": {} 2024-04-26T12:27:57.654 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.654 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2024-04-26T12:27:57.654 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 2.9900000095367432, 2024-04-26T12:27:57.655 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 2.9900000095367432, 2024-04-26T12:27:57.655 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:27:57.655 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 2, 2024-04-26T12:27:57.655 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 2, 2024-04-26T12:27:57.655 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 0.85364794731140137, 2024-04-26T12:27:57.655 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 0.85000002384185791, 2024-04-26T12:27:57.655 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-04-26T12:27:57.655 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.655 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.655 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.655 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 2, 2024-04-26T12:27:57.655 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": "rbd", 2024-04-26T12:27:57.655 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2024-04-26T12:26:45.839095+0000", 2024-04-26T12:27:57.655 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-04-26T12:27:57.656 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2024-04-26T12:27:57.656 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2024-04-26T12:27:57.656 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2024-04-26T12:27:57.656 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2024-04-26T12:27:57.656 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2024-04-26T12:27:57.656 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:27:57.656 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:27:57.656 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:27:57.656 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:27:57.656 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2024-04-26T12:27:57.656 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:27:57.656 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 8, 2024-04-26T12:27:57.656 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 8, 2024-04-26T12:27:57.656 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 8, 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 8, 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 8, 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "12", 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:27:57.657 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2024-04-26T12:27:57.658 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:27:57.658 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2024-04-26T12:27:57.658 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2024-04-26T12:27:57.658 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2024-04-26T12:27:57.658 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2024-04-26T12:27:57.658 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2024-04-26T12:27:57.658 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2024-04-26T12:27:57.658 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2024-04-26T12:27:57.658 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2024-04-26T12:27:57.658 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2024-04-26T12:27:57.658 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2024-04-26T12:27:57.658 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2024-04-26T12:27:57.658 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2024-04-26T12:27:57.659 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2024-04-26T12:27:57.659 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:27:57.659 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:27:57.659 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:27:57.659 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2024-04-26T12:27:57.659 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2024-04-26T12:27:57.659 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2024-04-26T12:27:57.659 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2024-04-26T12:27:57.659 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2024-04-26T12:27:57.659 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.659 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2024-04-26T12:27:57.659 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2024-04-26T12:27:57.659 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2024-04-26T12:27:57.659 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: "options": {}, 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd": {} 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 1.4900000095367432, 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 1.4900000095367432, 2024-04-26T12:27:57.660 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:27:57.661 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 1, 2024-04-26T12:27:57.661 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 1, 2024-04-26T12:27:57.661 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 0.85364794731140137, 2024-04-26T12:27:57.661 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 0.85000002384185791, 2024-04-26T12:27:57.661 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-04-26T12:27:57.661 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.661 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.661 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.661 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 3, 2024-04-26T12:27:57.661 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": "cephfs_metadata", 2024-04-26T12:27:57.661 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2024-04-26T12:26:51.091400+0000", 2024-04-26T12:27:57.661 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-04-26T12:27:57.661 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2024-04-26T12:27:57.661 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2024-04-26T12:27:57.662 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2024-04-26T12:27:57.662 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2024-04-26T12:27:57.662 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2024-04-26T12:27:57.662 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:27:57.662 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:27:57.662 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:27:57.662 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:27:57.662 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2024-04-26T12:27:57.662 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:27:57.662 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 32, 2024-04-26T12:27:57.662 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 32, 2024-04-26T12:27:57.662 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 32, 2024-04-26T12:27:57.662 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 32, 2024-04-26T12:27:57.663 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 32, 2024-04-26T12:27:57.663 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2024-04-26T12:27:57.663 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2024-04-26T12:27:57.663 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2024-04-26T12:27:57.663 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2024-04-26T12:27:57.663 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2024-04-26T12:27:57.663 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2024-04-26T12:27:57.663 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2024-04-26T12:27:57.663 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.663 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "15", 2024-04-26T12:27:57.663 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2024-04-26T12:27:57.663 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:27:57.663 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:27:57.664 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2024-04-26T12:27:57.664 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:27:57.664 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2024-04-26T12:27:57.664 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2024-04-26T12:27:57.664 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2024-04-26T12:27:57.664 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2024-04-26T12:27:57.664 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2024-04-26T12:27:57.664 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2024-04-26T12:27:57.664 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2024-04-26T12:27:57.664 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2024-04-26T12:27:57.664 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2024-04-26T12:27:57.664 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2024-04-26T12:27:57.664 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2024-04-26T12:27:57.664 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:27:57.665 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:27:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:27:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:27:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2024-04-26T12:27:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2024-04-26T12:27:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2024-04-26T12:27:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2024-04-26T12:27:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: "options": { 2024-04-26T12:27:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_bias": 4, 2024-04-26T12:27:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_min": 16, 2024-04-26T12:27:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_priority": 5 2024-04-26T12:27:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2024-04-26T12:27:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs": { 2024-04-26T12:27:57.667 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": "cephfs" 2024-04-26T12:27:57.667 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.667 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2024-04-26T12:27:57.667 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 1.5800000429153442, 2024-04-26T12:27:57.667 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 1.5800000429153442, 2024-04-26T12:27:57.667 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:27:57.667 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 1.059999942779541, 2024-04-26T12:27:57.667 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 1.059999942779541, 2024-04-26T12:27:57.667 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 0.85364794731140137, 2024-04-26T12:27:57.667 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 0.85000002384185791, 2024-04-26T12:27:57.667 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-04-26T12:27:57.667 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 4, 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": "cephfs_data", 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2024-04-26T12:26:52.222159+0000", 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:27:57.668 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2024-04-26T12:27:57.669 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:27:57.669 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 64, 2024-04-26T12:27:57.669 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 64, 2024-04-26T12:27:57.669 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 64, 2024-04-26T12:27:57.669 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 64, 2024-04-26T12:27:57.669 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 64, 2024-04-26T12:27:57.669 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2024-04-26T12:27:57.669 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2024-04-26T12:27:57.669 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2024-04-26T12:27:57.669 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2024-04-26T12:27:57.669 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2024-04-26T12:27:57.669 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2024-04-26T12:27:57.669 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2024-04-26T12:27:57.669 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.670 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "16", 2024-04-26T12:27:57.670 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2024-04-26T12:27:57.670 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:27:57.670 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:27:57.670 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2024-04-26T12:27:57.670 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:27:57.670 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2024-04-26T12:27:57.670 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2024-04-26T12:27:57.670 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2024-04-26T12:27:57.670 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2024-04-26T12:27:57.670 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2024-04-26T12:27:57.670 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2024-04-26T12:27:57.670 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2024-04-26T12:27:57.671 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2024-04-26T12:27:57.671 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2024-04-26T12:27:57.671 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2024-04-26T12:27:57.671 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2024-04-26T12:27:57.671 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2024-04-26T12:27:57.671 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2024-04-26T12:27:57.671 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:27:57.671 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:27:57.671 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:27:57.671 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2024-04-26T12:27:57.671 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2024-04-26T12:27:57.671 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2024-04-26T12:27:57.671 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2024-04-26T12:27:57.671 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2024-04-26T12:27:57.672 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.672 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2024-04-26T12:27:57.672 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2024-04-26T12:27:57.672 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2024-04-26T12:27:57.672 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:27:57.672 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:27:57.672 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:27:57.672 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:27:57.672 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2024-04-26T12:27:57.672 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2024-04-26T12:27:57.672 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2024-04-26T12:27:57.672 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2024-04-26T12:27:57.672 INFO:teuthology.orchestra.run.smithi046.stdout: "options": { 2024-04-26T12:27:57.672 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_min": 64, 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs": { 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: "data": "cephfs" 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 1.6299999952316284, 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 1.6299999952316284, 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 1.0900000333786011, 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 1.0900000333786011, 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 0.85364794731140137, 2024-04-26T12:27:57.673 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 0.85000002384185791, 2024-04-26T12:27:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-04-26T12:27:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-04-26T12:27:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: "osds": [ 2024-04-26T12:27:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 0, 2024-04-26T12:27:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: "uuid": "06efe013-b786-41a5-b434-e2198a85a028", 2024-04-26T12:27:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: "up": 1, 2024-04-26T12:27:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: "in": 1, 2024-04-26T12:27:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: "weight": 1, 2024-04-26T12:27:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity": 0.560943603515625, 2024-04-26T12:27:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_begin": 0, 2024-04-26T12:27:57.674 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_end": 0, 2024-04-26T12:27:57.675 INFO:teuthology.orchestra.run.smithi046.stdout: "up_from": 8, 2024-04-26T12:27:57.675 INFO:teuthology.orchestra.run.smithi046.stdout: "up_thru": 30, 2024-04-26T12:27:57.675 INFO:teuthology.orchestra.run.smithi046.stdout: "down_at": 0, 2024-04-26T12:27:57.675 INFO:teuthology.orchestra.run.smithi046.stdout: "lost_at": 0, 2024-04-26T12:27:57.675 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addrs": { 2024-04-26T12:27:57.675 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:27:57.675 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.675 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:27:57.675 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6800", 2024-04-26T12:27:57.675 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:27:57.675 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.675 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.675 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:27:57.675 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6801", 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addrs": { 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6802", 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6803", 2024-04-26T12:27:57.676 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:27:57.677 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.677 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.677 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.677 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addrs": { 2024-04-26T12:27:57.677 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:27:57.677 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.677 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:27:57.677 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6806", 2024-04-26T12:27:57.677 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:27:57.677 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.677 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.677 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:27:57.677 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6807", 2024-04-26T12:27:57.677 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:27:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addrs": { 2024-04-26T12:27:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:27:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:27:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6804", 2024-04-26T12:27:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:27:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:27:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6805", 2024-04-26T12:27:57.678 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addr": "172.21.15.115:6801/41431", 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addr": "172.21.15.115:6803/41431", 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addr": "172.21.15.115:6807/41431", 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addr": "172.21.15.115:6805/41431", 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: "state": [ 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: "exists", 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: "up" 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 1, 2024-04-26T12:27:57.679 INFO:teuthology.orchestra.run.smithi046.stdout: "uuid": "13cadead-33ea-4874-9a87-7419790ff37a", 2024-04-26T12:27:57.680 INFO:teuthology.orchestra.run.smithi046.stdout: "up": 0, 2024-04-26T12:27:57.680 INFO:teuthology.orchestra.run.smithi046.stdout: "in": 1, 2024-04-26T12:27:57.680 INFO:teuthology.orchestra.run.smithi046.stdout: "weight": 1, 2024-04-26T12:27:57.680 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity": 1, 2024-04-26T12:27:57.680 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_begin": 0, 2024-04-26T12:27:57.680 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_end": 0, 2024-04-26T12:27:57.680 INFO:teuthology.orchestra.run.smithi046.stdout: "up_from": 8, 2024-04-26T12:27:57.680 INFO:teuthology.orchestra.run.smithi046.stdout: "up_thru": 17, 2024-04-26T12:27:57.680 INFO:teuthology.orchestra.run.smithi046.stdout: "down_at": 30, 2024-04-26T12:27:57.680 INFO:teuthology.orchestra.run.smithi046.stdout: "lost_at": 0, 2024-04-26T12:27:57.680 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addrs": { 2024-04-26T12:27:57.680 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:27:57.680 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.680 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:27:57.681 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6800", 2024-04-26T12:27:57.681 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:27:57.681 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.681 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.681 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:27:57.681 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6801", 2024-04-26T12:27:57.681 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:27:57.681 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.681 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.681 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.681 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addrs": { 2024-04-26T12:27:57.681 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:27:57.681 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.681 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:27:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6802", 2024-04-26T12:27:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:27:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:27:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6803", 2024-04-26T12:27:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:27:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addrs": { 2024-04-26T12:27:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:27:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.682 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:27:57.683 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6806", 2024-04-26T12:27:57.683 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:27:57.683 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.683 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.683 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:27:57.683 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6807", 2024-04-26T12:27:57.683 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:27:57.683 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.683 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.683 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.683 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addrs": { 2024-04-26T12:27:57.683 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:27:57.683 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.683 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:27:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6804", 2024-04-26T12:27:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:27:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:27:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6805", 2024-04-26T12:27:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:27:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addr": "172.21.15.136:6801/41393", 2024-04-26T12:27:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addr": "172.21.15.136:6803/41393", 2024-04-26T12:27:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addr": "172.21.15.136:6807/41393", 2024-04-26T12:27:57.684 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addr": "172.21.15.136:6805/41393", 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: "state": [ 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: "exists" 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 2, 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: "uuid": "4e4c8095-c2d1-42a3-8da1-e3b41ca2a870", 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: "up": 1, 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: "in": 1, 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: "weight": 1, 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity": 1, 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_begin": 0, 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_end": 0, 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: "up_from": 8, 2024-04-26T12:27:57.685 INFO:teuthology.orchestra.run.smithi046.stdout: "up_thru": 30, 2024-04-26T12:27:57.686 INFO:teuthology.orchestra.run.smithi046.stdout: "down_at": 0, 2024-04-26T12:27:57.686 INFO:teuthology.orchestra.run.smithi046.stdout: "lost_at": 0, 2024-04-26T12:27:57.686 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addrs": { 2024-04-26T12:27:57.686 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:27:57.686 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.686 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:27:57.686 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6800", 2024-04-26T12:27:57.686 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:27:57.686 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.686 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.686 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:27:57.686 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6801", 2024-04-26T12:27:57.686 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addrs": { 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6802", 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6803", 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:27:57.687 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addrs": { 2024-04-26T12:27:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:27:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:27:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6806", 2024-04-26T12:27:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:27:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:27:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6807", 2024-04-26T12:27:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:27:57.688 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addrs": { 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6804", 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6805", 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.689 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.690 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.690 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addr": "172.21.15.142:6801/41547", 2024-04-26T12:27:57.690 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addr": "172.21.15.142:6803/41547", 2024-04-26T12:27:57.690 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addr": "172.21.15.142:6807/41547", 2024-04-26T12:27:57.690 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addr": "172.21.15.142:6805/41547", 2024-04-26T12:27:57.690 INFO:teuthology.orchestra.run.smithi046.stdout: "state": [ 2024-04-26T12:27:57.690 INFO:teuthology.orchestra.run.smithi046.stdout: "exists", 2024-04-26T12:27:57.690 INFO:teuthology.orchestra.run.smithi046.stdout: "up" 2024-04-26T12:27:57.690 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:27:57.690 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.690 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-04-26T12:27:57.690 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_xinfo": [ 2024-04-26T12:27:57.690 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 0, 2024-04-26T12:27:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: "down_stamp": "0.000000", 2024-04-26T12:27:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_probability": 0, 2024-04-26T12:27:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_interval": 0, 2024-04-26T12:27:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: "features": 4540138322906710015, 2024-04-26T12:27:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: "old_weight": 0, 2024-04-26T12:27:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: "last_purged_snaps_scrub": "2024-04-26T12:26:43.065520+0000", 2024-04-26T12:27:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: "dead_epoch": 0 2024-04-26T12:27:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 1, 2024-04-26T12:27:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: "down_stamp": "0.000000", 2024-04-26T12:27:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_probability": 0, 2024-04-26T12:27:57.691 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_interval": 0, 2024-04-26T12:27:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: "features": 4540138322906710015, 2024-04-26T12:27:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: "old_weight": 0, 2024-04-26T12:27:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: "last_purged_snaps_scrub": "2024-04-26T12:26:43.774900+0000", 2024-04-26T12:27:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: "dead_epoch": 29 2024-04-26T12:27:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:27:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 2, 2024-04-26T12:27:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: "down_stamp": "0.000000", 2024-04-26T12:27:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_probability": 0, 2024-04-26T12:27:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_interval": 0, 2024-04-26T12:27:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: "features": 4540138322906710015, 2024-04-26T12:27:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: "old_weight": 0, 2024-04-26T12:27:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: "last_purged_snaps_scrub": "2024-04-26T12:26:43.024152+0000", 2024-04-26T12:27:57.692 INFO:teuthology.orchestra.run.smithi046.stdout: "dead_epoch": 0 2024-04-26T12:27:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-04-26T12:27:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_upmap": [], 2024-04-26T12:27:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_upmap_items": [], 2024-04-26T12:27:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_upmap_primaries": [], 2024-04-26T12:27:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_temp": [], 2024-04-26T12:27:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_temp": [], 2024-04-26T12:27:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklist": {}, 2024-04-26T12:27:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: "range_blocklist": {}, 2024-04-26T12:27:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profiles": { 2024-04-26T12:27:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: "default": { 2024-04-26T12:27:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: "crush-failure-domain": "osd", 2024-04-26T12:27:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: "k": "2", 2024-04-26T12:27:57.693 INFO:teuthology.orchestra.run.smithi046.stdout: "m": "1", 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: "plugin": "jerasure", 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: "technique": "reed_sol_van" 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps_queue": [], 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: "new_removed_snaps": [], 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: "new_purged_snaps": [], 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_node_flags": {}, 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: "device_class_flags": {}, 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_mode": { 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_mode_enabled": false, 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_bucket_count": 0, 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: "degraded_stretch_mode": 0, 2024-04-26T12:27:57.694 INFO:teuthology.orchestra.run.smithi046.stdout: "recovering_stretch_mode": 0, 2024-04-26T12:27:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_mode_bucket": 0 2024-04-26T12:27:57.695 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:27:57.695 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-04-26T12:27:57.696 INFO:tasks.thrashosds.thrasher:j is {'epoch': 33, 'fsid': '3dd84416-f290-4721-94ce-52b0ffaacf34', 'created': '2024-04-26T12:26:36.091476+0000', 'modified': '2024-04-26T12:27:54.679858+0000', 'last_up_change': '2024-04-26T12:27:47.657403+0000', 'last_in_change': '2024-04-26T12:26:37.993949+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:26:45.341269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:26:45.839095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:26:51.091400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:26:52.222159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.090000033378601, 'raw_score_stable': 1.090000033378601, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}], 'osds': [{'osd': 0, 'uuid': '06efe013-b786-41a5-b434-e2198a85a028', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.560943603515625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6800', 'nonce': 41431}, {'type': 'v1', 'addr': '172.21.15.115:6801', 'nonce': 41431}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6802', 'nonce': 41431}, {'type': 'v1', 'addr': '172.21.15.115:6803', 'nonce': 41431}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6806', 'nonce': 41431}, {'type': 'v1', 'addr': '172.21.15.115:6807', 'nonce': 41431}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6804', 'nonce': 41431}, {'type': 'v1', 'addr': '172.21.15.115:6805', 'nonce': 41431}]}, 'public_addr': '172.21.15.115:6801/41431', 'cluster_addr': '172.21.15.115:6803/41431', 'heartbeat_back_addr': '172.21.15.115:6807/41431', 'heartbeat_front_addr': '172.21.15.115:6805/41431', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '13cadead-33ea-4874-9a87-7419790ff37a', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 30, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6800', 'nonce': 41393}, {'type': 'v1', 'addr': '172.21.15.136:6801', 'nonce': 41393}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6802', 'nonce': 41393}, {'type': 'v1', 'addr': '172.21.15.136:6803', 'nonce': 41393}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6806', 'nonce': 41393}, {'type': 'v1', 'addr': '172.21.15.136:6807', 'nonce': 41393}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6804', 'nonce': 41393}, {'type': 'v1', 'addr': '172.21.15.136:6805', 'nonce': 41393}]}, 'public_addr': '172.21.15.136:6801/41393', 'cluster_addr': '172.21.15.136:6803/41393', 'heartbeat_back_addr': '172.21.15.136:6807/41393', 'heartbeat_front_addr': '172.21.15.136:6805/41393', 'state': ['exists']}, {'osd': 2, 'uuid': '4e4c8095-c2d1-42a3-8da1-e3b41ca2a870', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6800', 'nonce': 41547}, {'type': 'v1', 'addr': '172.21.15.142:6801', 'nonce': 41547}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6802', 'nonce': 41547}, {'type': 'v1', 'addr': '172.21.15.142:6803', 'nonce': 41547}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6806', 'nonce': 41547}, {'type': 'v1', 'addr': '172.21.15.142:6807', 'nonce': 41547}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6804', 'nonce': 41547}, {'type': 'v1', 'addr': '172.21.15.142:6805', 'nonce': 41547}]}, 'public_addr': '172.21.15.142:6801/41547', 'cluster_addr': '172.21.15.142:6803/41547', 'heartbeat_back_addr': '172.21.15.142:6807/41547', 'heartbeat_front_addr': '172.21.15.142:6805/41547', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:26:43.065520+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:26:43.774900+0000', 'dead_epoch': 29}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:26:43.024152+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T12:27:57.697 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:27:57.697 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:57.694+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:57.699 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2024-04-26T12:27:57.757 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:57.758 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:57.767 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:57.797 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:57.796+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:57.801 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2024-04-26T12:27:57.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:27:57.898 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:57.898+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:57.933 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:27:57.934 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:27:57.944 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:58.000 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:57.999+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:58.038 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:27:58.058 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:27:58.059 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:27:58.059 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:27:58.059 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:27:58.062 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:27:58.062 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:27:58.072 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.187860431999994, 2024-04-26T12:27:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.187221085000004, 2024-04-26T12:27:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.057518895000001, 2024-04-26T12:27:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.057024308999999, 2024-04-26T12:27:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.055022124999994, 2024-04-26T12:27:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.054615784999996, 2024-04-26T12:27:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.054260960999997, 2024-04-26T12:27:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.951702546999996, 2024-04-26T12:27:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.951306019, 2024-04-26T12:27:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:58.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:58.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:58.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:58.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:58.189 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.190 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.190 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.190 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:58.190 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:58.190 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.854296411000007, 2024-04-26T12:27:58.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:58.190 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.190 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.190 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:58.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:58.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:58.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:58.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:58.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:58.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:58.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:58.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:58.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:58.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:58.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:58.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:58.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:58.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:58.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:58.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:58.194 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.194 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.194 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.195 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:58.195 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:58.195 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 70.853602695000006, 2024-04-26T12:27:58.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:58.195 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.195 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.195 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:58.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:58.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:58.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:58.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:58.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:58.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:58.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:58.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:58.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:58.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:58.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:58.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:58.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:58.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:58.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:58.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:58.199 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.199 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.199 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.199 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.199 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:58.199 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.818863640000004, 2024-04-26T12:27:58.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:58.199 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.199 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.200 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:58.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:58.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:58.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:58.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:58.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:58.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:58.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:58.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:58.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.818042720999998, 2024-04-26T12:27:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:58.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:58.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:58.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:58.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:58.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.210 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.210 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.210 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:58.210 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.818012631000002, 2024-04-26T12:27:58.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:58.210 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.211 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.211 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:58.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:58.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:58.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:58.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:58.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:58.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:58.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:58.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.215 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.817958843, 2024-04-26T12:27:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:58.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:58.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:58.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:58.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:58.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:58.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:58.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:58.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.817906285999996, 2024-04-26T12:27:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.221 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:58.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:58.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:58.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:58.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:58.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:58.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:58.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:58.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:58.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:58.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:58.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:58.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:58.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:58.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:58.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:58.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:58.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:58.226 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.226 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.226 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.817866072000001, 2024-04-26T12:27:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:58.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:58.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:58.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:58.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:58.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:58.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:58.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:58.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:58.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:58.232 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.232 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.232 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.232 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.232 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:58.232 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.817837910999998, 2024-04-26T12:27:58.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:58.232 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.232 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.232 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:58.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:58.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:58.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:58.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:58.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:58.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:58.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:58.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:58.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:58.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:58.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:58.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:58.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:58.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:58.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:58.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:58.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:58.237 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.237 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.238 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.238 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.238 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:58.238 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.817807221999999, 2024-04-26T12:27:58.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:58.238 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.238 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:58.238 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:58.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:58.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:58.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:58.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:58.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:58.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:58.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:58.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:58.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:58.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:58.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:58.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:58.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:58.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:58.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:58.243 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.243 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.243 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.243 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.817780648999999, 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:58.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:58.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:58.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:58.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:58.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:58.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:58.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:58.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:58.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:58.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:58.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:58.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:58.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:58.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:58.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:58.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:58.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:58.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:58.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:58.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:58.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:58.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:58.247 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.247 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.247 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.247 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:58.247 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:58.247 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:58.249 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:58.248+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:58.252 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:58.254 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:27:58.257 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:27:58.258 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-04-26T12:27:57.694223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597673,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":138,"acting":138,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82036,"kb_used_data":976,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033484,"statfs":{"total":289910292480,"available":289826287616,"internally_reserved":0,"allocated":999424,"data_stored":1540104,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.392999"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678763+0000","last_change":"2024-04-26T12:27:48.671300+0000","last_active":"2024-04-26T12:27:51.678763+0000","last_peered":"2024-04-26T12:27:51.678763+0000","last_clean":"2024-04-26T12:27:45.659014+0000","last_became_active":"2024-04-26T12:27:48.671300+0000","last_became_peered":"2024-04-26T12:27:48.671300+0000","last_unstale":"2024-04-26T12:27:51.678763+0000","last_undegraded":"2024-04-26T12:27:51.678763+0000","last_fullsized":"2024-04-26T12:27:48.666994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:07.791859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678438+0000","last_change":"2024-04-26T12:27:48.668281+0000","last_active":"2024-04-26T12:27:51.678438+0000","last_peered":"2024-04-26T12:27:51.678438+0000","last_clean":"2024-04-26T12:27:45.658708+0000","last_became_active":"2024-04-26T12:27:48.668281+0000","last_became_peered":"2024-04-26T12:27:48.668281+0000","last_unstale":"2024-04-26T12:27:51.678438+0000","last_undegraded":"2024-04-26T12:27:51.678438+0000","last_fullsized":"2024-04-26T12:27:48.664487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:00.734619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677765+0000","last_change":"2024-04-26T12:27:13.578104+0000","last_active":"2024-04-26T12:27:51.677765+0000","last_peered":"2024-04-26T12:27:51.677765+0000","last_clean":"2024-04-26T12:27:51.677765+0000","last_became_active":"2024-04-26T12:27:13.577849+0000","last_became_peered":"2024-04-26T12:27:13.577849+0000","last_unstale":"2024-04-26T12:27:51.677765+0000","last_undegraded":"2024-04-26T12:27:51.677765+0000","last_fullsized":"2024-04-26T12:27:51.677765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:48.407310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678129+0000","last_change":"2024-04-26T12:27:48.670655+0000","last_active":"2024-04-26T12:27:51.678129+0000","last_peered":"2024-04-26T12:27:51.678129+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.670655+0000","last_became_peered":"2024-04-26T12:27:48.670655+0000","last_unstale":"2024-04-26T12:27:51.678129+0000","last_undegraded":"2024-04-26T12:27:51.678129+0000","last_fullsized":"2024-04-26T12:27:48.665967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:35.730477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677741+0000","last_change":"2024-04-26T12:27:48.668508+0000","last_active":"2024-04-26T12:27:51.677741+0000","last_peered":"2024-04-26T12:27:51.677741+0000","last_clean":"2024-04-26T12:27:45.658341+0000","last_became_active":"2024-04-26T12:27:48.668508+0000","last_became_peered":"2024-04-26T12:27:48.668508+0000","last_unstale":"2024-04-26T12:27:51.677741+0000","last_undegraded":"2024-04-26T12:27:51.677741+0000","last_fullsized":"2024-04-26T12:27:48.665002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:48.840592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677336+0000","last_change":"2024-04-26T12:27:48.667621+0000","last_active":"2024-04-26T12:27:51.677336+0000","last_peered":"2024-04-26T12:27:51.677336+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.667621+0000","last_became_peered":"2024-04-26T12:27:48.667621+0000","last_unstale":"2024-04-26T12:27:51.677336+0000","last_undegraded":"2024-04-26T12:27:51.677336+0000","last_fullsized":"2024-04-26T12:27:48.664721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:56.099034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677577+0000","last_change":"2024-04-26T12:27:48.669018+0000","last_active":"2024-04-26T12:27:51.677577+0000","last_peered":"2024-04-26T12:27:51.677577+0000","last_clean":"2024-04-26T12:27:45.658807+0000","last_became_active":"2024-04-26T12:27:48.669018+0000","last_became_peered":"2024-04-26T12:27:48.669018+0000","last_unstale":"2024-04-26T12:27:51.677577+0000","last_undegraded":"2024-04-26T12:27:51.677577+0000","last_fullsized":"2024-04-26T12:27:48.665042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:07.544092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677160+0000","last_change":"2024-04-26T12:27:48.666997+0000","last_active":"2024-04-26T12:27:51.677160+0000","last_peered":"2024-04-26T12:27:51.677160+0000","last_clean":"2024-04-26T12:27:45.658575+0000","last_became_active":"2024-04-26T12:27:48.666997+0000","last_became_peered":"2024-04-26T12:27:48.666997+0000","last_unstale":"2024-04-26T12:27:51.677160+0000","last_undegraded":"2024-04-26T12:27:51.677160+0000","last_fullsized":"2024-04-26T12:27:48.664525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:17.742404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678536+0000","last_change":"2024-04-26T12:27:48.671241+0000","last_active":"2024-04-26T12:27:51.678536+0000","last_peered":"2024-04-26T12:27:51.678536+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.671241+0000","last_became_peered":"2024-04-26T12:27:48.671241+0000","last_unstale":"2024-04-26T12:27:51.678536+0000","last_undegraded":"2024-04-26T12:27:51.678536+0000","last_fullsized":"2024-04-26T12:27:48.665995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:24.316546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678675+0000","last_change":"2024-04-26T12:27:48.671204+0000","last_active":"2024-04-26T12:27:51.678675+0000","last_peered":"2024-04-26T12:27:51.678675+0000","last_clean":"2024-04-26T12:27:45.658876+0000","last_became_active":"2024-04-26T12:27:48.671204+0000","last_became_peered":"2024-04-26T12:27:48.671204+0000","last_unstale":"2024-04-26T12:27:51.678675+0000","last_undegraded":"2024-04-26T12:27:51.678675+0000","last_fullsized":"2024-04-26T12:27:48.665046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:53.476133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677650+0000","last_change":"2024-04-26T12:27:48.667839+0000","last_active":"2024-04-26T12:27:51.677650+0000","last_peered":"2024-04-26T12:27:51.677650+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.667839+0000","last_became_peered":"2024-04-26T12:27:48.667839+0000","last_unstale":"2024-04-26T12:27:51.677650+0000","last_undegraded":"2024-04-26T12:27:51.677650+0000","last_fullsized":"2024-04-26T12:27:48.665442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:15.607076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677659+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:27:51.677659+0000","last_peered":"2024-04-26T12:27:51.677659+0000","last_clean":"2024-04-26T12:27:51.677659+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:27:51.677659+0000","last_undegraded":"2024-04-26T12:27:51.677659+0000","last_fullsized":"2024-04-26T12:27:51.677659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677421+0000","last_change":"2024-04-26T12:27:48.669697+0000","last_active":"2024-04-26T12:27:51.677421+0000","last_peered":"2024-04-26T12:27:51.677421+0000","last_clean":"2024-04-26T12:27:45.658259+0000","last_became_active":"2024-04-26T12:27:48.669697+0000","last_became_peered":"2024-04-26T12:27:48.669697+0000","last_unstale":"2024-04-26T12:27:51.677421+0000","last_undegraded":"2024-04-26T12:27:51.677421+0000","last_fullsized":"2024-04-26T12:27:48.664817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:26.492322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677727+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:27:51.677727+0000","last_peered":"2024-04-26T12:27:51.677727+0000","last_clean":"2024-04-26T12:27:51.677727+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:27:51.677727+0000","last_undegraded":"2024-04-26T12:27:51.677727+0000","last_fullsized":"2024-04-26T12:27:51.677727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677257+0000","last_change":"2024-04-26T12:26:53.266568+0000","last_active":"2024-04-26T12:27:51.677257+0000","last_peered":"2024-04-26T12:27:51.677257+0000","last_clean":"2024-04-26T12:27:51.677257+0000","last_became_active":"2024-04-26T12:26:53.265846+0000","last_became_peered":"2024-04-26T12:26:53.265846+0000","last_unstale":"2024-04-26T12:27:51.677257+0000","last_undegraded":"2024-04-26T12:27:51.677257+0000","last_fullsized":"2024-04-26T12:27:51.677257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:10.849502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677293+0000","last_change":"2024-04-26T12:27:48.667769+0000","last_active":"2024-04-26T12:27:51.677293+0000","last_peered":"2024-04-26T12:27:51.677293+0000","last_clean":"2024-04-26T12:27:45.658577+0000","last_became_active":"2024-04-26T12:27:48.667769+0000","last_became_peered":"2024-04-26T12:27:48.667769+0000","last_unstale":"2024-04-26T12:27:51.677293+0000","last_undegraded":"2024-04-26T12:27:51.677293+0000","last_fullsized":"2024-04-26T12:27:48.665111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:24.316546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678532+0000","last_change":"2024-04-26T12:27:48.670091+0000","last_active":"2024-04-26T12:27:51.678532+0000","last_peered":"2024-04-26T12:27:51.678532+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.670091+0000","last_became_peered":"2024-04-26T12:27:48.670091+0000","last_unstale":"2024-04-26T12:27:51.678532+0000","last_undegraded":"2024-04-26T12:27:51.678532+0000","last_fullsized":"2024-04-26T12:27:48.665783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:53.719035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678800+0000","last_change":"2024-04-26T12:27:48.669637+0000","last_active":"2024-04-26T12:27:51.678800+0000","last_peered":"2024-04-26T12:27:51.678800+0000","last_clean":"2024-04-26T12:27:45.658959+0000","last_became_active":"2024-04-26T12:27:48.669637+0000","last_became_peered":"2024-04-26T12:27:48.669637+0000","last_unstale":"2024-04-26T12:27:51.678800+0000","last_undegraded":"2024-04-26T12:27:51.678800+0000","last_fullsized":"2024-04-26T12:27:48.665757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:32.786103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678409+0000","last_change":"2024-04-26T12:27:48.671206+0000","last_active":"2024-04-26T12:27:51.678409+0000","last_peered":"2024-04-26T12:27:51.678409+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.671206+0000","last_became_peered":"2024-04-26T12:27:48.671206+0000","last_unstale":"2024-04-26T12:27:51.678409+0000","last_undegraded":"2024-04-26T12:27:51.678409+0000","last_fullsized":"2024-04-26T12:27:48.666076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:00.831876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678019+0000","last_change":"2024-04-26T12:27:48.669858+0000","last_active":"2024-04-26T12:27:51.678019+0000","last_peered":"2024-04-26T12:27:51.678019+0000","last_clean":"2024-04-26T12:27:45.659063+0000","last_became_active":"2024-04-26T12:27:48.669858+0000","last_became_peered":"2024-04-26T12:27:48.669858+0000","last_unstale":"2024-04-26T12:27:51.678019+0000","last_undegraded":"2024-04-26T12:27:51.678019+0000","last_fullsized":"2024-04-26T12:27:48.665938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:48.591802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677708+0000","last_change":"2024-04-26T12:27:48.668558+0000","last_active":"2024-04-26T12:27:51.677708+0000","last_peered":"2024-04-26T12:27:51.677708+0000","last_clean":"2024-04-26T12:27:45.658882+0000","last_became_active":"2024-04-26T12:27:48.668558+0000","last_became_peered":"2024-04-26T12:27:48.668558+0000","last_unstale":"2024-04-26T12:27:51.677708+0000","last_undegraded":"2024-04-26T12:27:51.677708+0000","last_fullsized":"2024-04-26T12:27:48.665108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:22.546632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677697+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:27:51.677697+0000","last_peered":"2024-04-26T12:27:51.677697+0000","last_clean":"2024-04-26T12:27:51.677697+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:27:51.677697+0000","last_undegraded":"2024-04-26T12:27:51.677697+0000","last_fullsized":"2024-04-26T12:27:51.677697+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677192+0000","last_change":"2024-04-26T12:27:48.667575+0000","last_active":"2024-04-26T12:27:51.677192+0000","last_peered":"2024-04-26T12:27:51.677192+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.667575+0000","last_became_peered":"2024-04-26T12:27:48.667575+0000","last_unstale":"2024-04-26T12:27:51.677192+0000","last_undegraded":"2024-04-26T12:27:51.677192+0000","last_fullsized":"2024-04-26T12:27:48.664563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:03.604566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677404+0000","last_change":"2024-04-26T12:27:48.668268+0000","last_active":"2024-04-26T12:27:51.677404+0000","last_peered":"2024-04-26T12:27:51.677404+0000","last_clean":"2024-04-26T12:27:45.658199+0000","last_became_active":"2024-04-26T12:27:48.668268+0000","last_became_peered":"2024-04-26T12:27:48.668268+0000","last_unstale":"2024-04-26T12:27:51.677404+0000","last_undegraded":"2024-04-26T12:27:51.677404+0000","last_fullsized":"2024-04-26T12:27:48.664879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:48.125904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.678716+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:27:51.678716+0000","last_peered":"2024-04-26T12:27:51.678716+0000","last_clean":"2024-04-26T12:27:51.678716+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:27:51.678716+0000","last_undegraded":"2024-04-26T12:27:51.678716+0000","last_fullsized":"2024-04-26T12:27:51.678716+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678740+0000","last_change":"2024-04-26T12:27:48.669843+0000","last_active":"2024-04-26T12:27:51.678740+0000","last_peered":"2024-04-26T12:27:51.678740+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.669843+0000","last_became_peered":"2024-04-26T12:27:48.669843+0000","last_unstale":"2024-04-26T12:27:51.678740+0000","last_undegraded":"2024-04-26T12:27:51.678740+0000","last_fullsized":"2024-04-26T12:27:48.666772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:22.807739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677756+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:27:51.677756+0000","last_peered":"2024-04-26T12:27:51.677756+0000","last_clean":"2024-04-26T12:27:51.677756+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:27:51.677756+0000","last_undegraded":"2024-04-26T12:27:51.677756+0000","last_fullsized":"2024-04-26T12:27:51.677756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":34,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677480+0000","last_change":"2024-04-26T12:27:48.668365+0000","last_active":"2024-04-26T12:27:51.677480+0000","last_peered":"2024-04-26T12:27:51.677480+0000","last_clean":"2024-04-26T12:27:45.658326+0000","last_became_active":"2024-04-26T12:27:48.668365+0000","last_became_peered":"2024-04-26T12:27:48.668365+0000","last_unstale":"2024-04-26T12:27:51.677480+0000","last_undegraded":"2024-04-26T12:27:51.677480+0000","last_fullsized":"2024-04-26T12:27:48.664578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:49.177447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.678109+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:27:51.678109+0000","last_peered":"2024-04-26T12:27:51.678109+0000","last_clean":"2024-04-26T12:27:51.678109+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:27:51.678109+0000","last_undegraded":"2024-04-26T12:27:51.678109+0000","last_fullsized":"2024-04-26T12:27:51.678109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677386+0000","last_change":"2024-04-26T12:27:48.669601+0000","last_active":"2024-04-26T12:27:51.677386+0000","last_peered":"2024-04-26T12:27:51.677386+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.669601+0000","last_became_peered":"2024-04-26T12:27:48.669601+0000","last_unstale":"2024-04-26T12:27:51.677386+0000","last_undegraded":"2024-04-26T12:27:51.677386+0000","last_fullsized":"2024-04-26T12:27:48.664823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:24.502487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678139+0000","last_change":"2024-04-26T12:27:48.668612+0000","last_active":"2024-04-26T12:27:51.678139+0000","last_peered":"2024-04-26T12:27:51.678139+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.668612+0000","last_became_peered":"2024-04-26T12:27:48.668612+0000","last_unstale":"2024-04-26T12:27:51.678139+0000","last_undegraded":"2024-04-26T12:27:51.678139+0000","last_fullsized":"2024-04-26T12:27:48.666094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:40.211117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677545+0000","last_change":"2024-04-26T12:27:48.669519+0000","last_active":"2024-04-26T12:27:51.677545+0000","last_peered":"2024-04-26T12:27:51.677545+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.669519+0000","last_became_peered":"2024-04-26T12:27:48.669519+0000","last_unstale":"2024-04-26T12:27:51.677545+0000","last_undegraded":"2024-04-26T12:27:51.677545+0000","last_fullsized":"2024-04-26T12:27:48.665185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:22.121772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.678664+0000","last_change":"2024-04-26T12:26:53.260764+0000","last_active":"2024-04-26T12:27:51.678664+0000","last_peered":"2024-04-26T12:27:51.678664+0000","last_clean":"2024-04-26T12:27:51.678664+0000","last_became_active":"2024-04-26T12:26:53.260388+0000","last_became_peered":"2024-04-26T12:26:53.260388+0000","last_unstale":"2024-04-26T12:27:51.678664+0000","last_undegraded":"2024-04-26T12:27:51.678664+0000","last_fullsized":"2024-04-26T12:27:51.678664+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678891+0000","last_change":"2024-04-26T12:27:48.668792+0000","last_active":"2024-04-26T12:27:51.678891+0000","last_peered":"2024-04-26T12:27:51.678891+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.668792+0000","last_became_peered":"2024-04-26T12:27:48.668792+0000","last_unstale":"2024-04-26T12:27:51.678891+0000","last_undegraded":"2024-04-26T12:27:51.678891+0000","last_fullsized":"2024-04-26T12:27:48.666210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:14.927599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677113+0000","last_change":"2024-04-26T12:27:48.666833+0000","last_active":"2024-04-26T12:27:51.677113+0000","last_peered":"2024-04-26T12:27:51.677113+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.666833+0000","last_became_peered":"2024-04-26T12:27:48.666833+0000","last_unstale":"2024-04-26T12:27:51.677113+0000","last_undegraded":"2024-04-26T12:27:51.677113+0000","last_fullsized":"2024-04-26T12:27:48.664098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:07.963594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677922+0000","last_change":"2024-04-26T12:27:48.667986+0000","last_active":"2024-04-26T12:27:51.677922+0000","last_peered":"2024-04-26T12:27:51.677922+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.667986+0000","last_became_peered":"2024-04-26T12:27:48.667986+0000","last_unstale":"2024-04-26T12:27:51.677922+0000","last_undegraded":"2024-04-26T12:27:51.677922+0000","last_fullsized":"2024-04-26T12:27:48.665842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:08.343408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677717+0000","last_change":"2024-04-26T12:27:48.669699+0000","last_active":"2024-04-26T12:27:51.677717+0000","last_peered":"2024-04-26T12:27:51.677717+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.669699+0000","last_became_peered":"2024-04-26T12:27:48.669699+0000","last_unstale":"2024-04-26T12:27:51.677717+0000","last_undegraded":"2024-04-26T12:27:51.677717+0000","last_fullsized":"2024-04-26T12:27:48.665274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:09.673236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677907+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:27:51.677907+0000","last_peered":"2024-04-26T12:27:51.677907+0000","last_clean":"2024-04-26T12:27:51.677907+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:27:51.677907+0000","last_undegraded":"2024-04-26T12:27:51.677907+0000","last_fullsized":"2024-04-26T12:27:51.677907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677273+0000","last_change":"2024-04-26T12:27:48.666951+0000","last_active":"2024-04-26T12:27:51.677273+0000","last_peered":"2024-04-26T12:27:51.677273+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.666951+0000","last_became_peered":"2024-04-26T12:27:48.666951+0000","last_unstale":"2024-04-26T12:27:51.677273+0000","last_undegraded":"2024-04-26T12:27:51.677273+0000","last_fullsized":"2024-04-26T12:27:48.664103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:03.878576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677885+0000","last_change":"2024-04-26T12:26:52.841280+0000","last_active":"2024-04-26T12:27:51.677885+0000","last_peered":"2024-04-26T12:27:51.677885+0000","last_clean":"2024-04-26T12:27:51.677885+0000","last_became_active":"2024-04-26T12:26:52.839398+0000","last_became_peered":"2024-04-26T12:26:52.839398+0000","last_unstale":"2024-04-26T12:27:51.677885+0000","last_undegraded":"2024-04-26T12:27:51.677885+0000","last_fullsized":"2024-04-26T12:27:51.677885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:53.889623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.678736+0000","last_change":"2024-04-26T12:26:53.260830+0000","last_active":"2024-04-26T12:27:51.678736+0000","last_peered":"2024-04-26T12:27:51.678736+0000","last_clean":"2024-04-26T12:27:51.678736+0000","last_became_active":"2024-04-26T12:26:53.259452+0000","last_became_peered":"2024-04-26T12:26:53.259452+0000","last_unstale":"2024-04-26T12:27:51.678736+0000","last_undegraded":"2024-04-26T12:27:51.678736+0000","last_fullsized":"2024-04-26T12:27:51.678736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":35,"reported_epoch":32,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:27:51.678748+0000","last_change":"2024-04-26T12:27:48.670849+0000","last_active":"2024-04-26T12:27:51.678748+0000","last_peered":"2024-04-26T12:27:51.678748+0000","last_clean":"2024-04-26T12:27:45.659179+0000","last_became_active":"2024-04-26T12:27:48.670849+0000","last_became_peered":"2024-04-26T12:27:48.670849+0000","last_unstale":"2024-04-26T12:27:51.678748+0000","last_undegraded":"2024-04-26T12:27:48.666998+0000","last_fullsized":"2024-04-26T12:27:48.666936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:31.781004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677808+0000","last_change":"2024-04-26T12:27:48.669835+0000","last_active":"2024-04-26T12:27:51.677808+0000","last_peered":"2024-04-26T12:27:51.677808+0000","last_clean":"2024-04-26T12:27:45.658491+0000","last_became_active":"2024-04-26T12:27:48.669835+0000","last_became_peered":"2024-04-26T12:27:48.669835+0000","last_unstale":"2024-04-26T12:27:51.677808+0000","last_undegraded":"2024-04-26T12:27:51.677808+0000","last_fullsized":"2024-04-26T12:27:48.664951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:50.107601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677611+0000","last_change":"2024-04-26T12:27:48.668832+0000","last_active":"2024-04-26T12:27:51.677611+0000","last_peered":"2024-04-26T12:27:51.677611+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.668832+0000","last_became_peered":"2024-04-26T12:27:48.668832+0000","last_unstale":"2024-04-26T12:27:51.677611+0000","last_undegraded":"2024-04-26T12:27:51.677611+0000","last_fullsized":"2024-04-26T12:27:48.665308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:04.128359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678311+0000","last_change":"2024-04-26T12:27:48.668718+0000","last_active":"2024-04-26T12:27:51.678311+0000","last_peered":"2024-04-26T12:27:51.678311+0000","last_clean":"2024-04-26T12:27:45.658777+0000","last_became_active":"2024-04-26T12:27:48.668718+0000","last_became_peered":"2024-04-26T12:27:48.668718+0000","last_unstale":"2024-04-26T12:27:51.678311+0000","last_undegraded":"2024-04-26T12:27:51.678311+0000","last_fullsized":"2024-04-26T12:27:48.665822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.866079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677304+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:27:51.677304+0000","last_peered":"2024-04-26T12:27:51.677304+0000","last_clean":"2024-04-26T12:27:51.677304+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:27:51.677304+0000","last_undegraded":"2024-04-26T12:27:51.677304+0000","last_fullsized":"2024-04-26T12:27:51.677304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678757+0000","last_change":"2024-04-26T12:27:48.670898+0000","last_active":"2024-04-26T12:27:51.678757+0000","last_peered":"2024-04-26T12:27:51.678757+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.670898+0000","last_became_peered":"2024-04-26T12:27:48.670898+0000","last_unstale":"2024-04-26T12:27:51.678757+0000","last_undegraded":"2024-04-26T12:27:51.678757+0000","last_fullsized":"2024-04-26T12:27:48.666259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:46.263682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677614+0000","last_change":"2024-04-26T12:26:52.840810+0000","last_active":"2024-04-26T12:27:51.677614+0000","last_peered":"2024-04-26T12:27:51.677614+0000","last_clean":"2024-04-26T12:27:51.677614+0000","last_became_active":"2024-04-26T12:26:52.840059+0000","last_became_peered":"2024-04-26T12:26:52.840059+0000","last_unstale":"2024-04-26T12:27:51.677614+0000","last_undegraded":"2024-04-26T12:27:51.677614+0000","last_fullsized":"2024-04-26T12:27:51.677614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:17.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678755+0000","last_change":"2024-04-26T12:27:48.668069+0000","last_active":"2024-04-26T12:27:51.678755+0000","last_peered":"2024-04-26T12:27:51.678755+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.668069+0000","last_became_peered":"2024-04-26T12:27:48.668069+0000","last_unstale":"2024-04-26T12:27:51.678755+0000","last_undegraded":"2024-04-26T12:27:51.678755+0000","last_fullsized":"2024-04-26T12:27:48.665961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:26.492322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.678200+0000","last_change":"2024-04-26T12:26:52.840684+0000","last_active":"2024-04-26T12:27:51.678200+0000","last_peered":"2024-04-26T12:27:51.678200+0000","last_clean":"2024-04-26T12:27:51.678200+0000","last_became_active":"2024-04-26T12:26:52.839414+0000","last_became_peered":"2024-04-26T12:26:52.839414+0000","last_unstale":"2024-04-26T12:27:51.678200+0000","last_undegraded":"2024-04-26T12:27:51.678200+0000","last_fullsized":"2024-04-26T12:27:51.678200+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:12.837493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.676995+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:27:51.676995+0000","last_peered":"2024-04-26T12:27:51.676995+0000","last_clean":"2024-04-26T12:27:51.676995+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:27:51.676995+0000","last_undegraded":"2024-04-26T12:27:51.676995+0000","last_fullsized":"2024-04-26T12:27:51.676995+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.678574+0000","last_change":"2024-04-26T12:26:52.839692+0000","last_active":"2024-04-26T12:27:51.678574+0000","last_peered":"2024-04-26T12:27:51.678574+0000","last_clean":"2024-04-26T12:27:51.678574+0000","last_became_active":"2024-04-26T12:26:52.839419+0000","last_became_peered":"2024-04-26T12:26:52.839419+0000","last_unstale":"2024-04-26T12:27:51.678574+0000","last_undegraded":"2024-04-26T12:27:51.678574+0000","last_fullsized":"2024-04-26T12:27:51.678574+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:25.416851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677470+0000","last_change":"2024-04-26T12:27:48.667396+0000","last_active":"2024-04-26T12:27:51.677470+0000","last_peered":"2024-04-26T12:27:51.677470+0000","last_clean":"2024-04-26T12:27:45.658276+0000","last_became_active":"2024-04-26T12:27:48.667396+0000","last_became_peered":"2024-04-26T12:27:48.667396+0000","last_unstale":"2024-04-26T12:27:51.677470+0000","last_undegraded":"2024-04-26T12:27:51.677470+0000","last_fullsized":"2024-04-26T12:27:48.664451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:15.838679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677900+0000","last_change":"2024-04-26T12:27:13.578220+0000","last_active":"2024-04-26T12:27:51.677900+0000","last_peered":"2024-04-26T12:27:51.677900+0000","last_clean":"2024-04-26T12:27:51.677900+0000","last_became_active":"2024-04-26T12:27:13.577940+0000","last_became_peered":"2024-04-26T12:27:13.577940+0000","last_unstale":"2024-04-26T12:27:51.677900+0000","last_undegraded":"2024-04-26T12:27:51.677900+0000","last_fullsized":"2024-04-26T12:27:51.677900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:56.100347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677490+0000","last_change":"2024-04-26T12:27:48.668258+0000","last_active":"2024-04-26T12:27:51.677490+0000","last_peered":"2024-04-26T12:27:51.677490+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.668258+0000","last_became_peered":"2024-04-26T12:27:48.668258+0000","last_unstale":"2024-04-26T12:27:51.677490+0000","last_undegraded":"2024-04-26T12:27:51.677490+0000","last_fullsized":"2024-04-26T12:27:48.665023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:50.182546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677621+0000","last_change":"2024-04-26T12:27:48.667826+0000","last_active":"2024-04-26T12:27:51.677621+0000","last_peered":"2024-04-26T12:27:51.677621+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.667826+0000","last_became_peered":"2024-04-26T12:27:48.667826+0000","last_unstale":"2024-04-26T12:27:51.677621+0000","last_undegraded":"2024-04-26T12:27:51.677621+0000","last_fullsized":"2024-04-26T12:27:48.665185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:14.177258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677411+0000","last_change":"2024-04-26T12:27:48.667634+0000","last_active":"2024-04-26T12:27:51.677411+0000","last_peered":"2024-04-26T12:27:51.677411+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.667634+0000","last_became_peered":"2024-04-26T12:27:48.667634+0000","last_unstale":"2024-04-26T12:27:51.677411+0000","last_undegraded":"2024-04-26T12:27:51.677411+0000","last_fullsized":"2024-04-26T12:27:48.664767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:49.881979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":18,"reported_epoch":32,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:27:51.678154+0000","last_change":"2024-04-26T12:27:48.670627+0000","last_active":"2024-04-26T12:27:51.678154+0000","last_peered":"2024-04-26T12:27:51.678154+0000","last_clean":"2024-04-26T12:26:53.247810+0000","last_became_active":"2024-04-26T12:27:48.670627+0000","last_became_peered":"2024-04-26T12:27:48.670627+0000","last_unstale":"2024-04-26T12:27:51.678154+0000","last_undegraded":"2024-04-26T12:27:48.666723+0000","last_fullsized":"2024-04-26T12:27:48.666210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:08.752822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677562+0000","last_change":"2024-04-26T12:27:48.669607+0000","last_active":"2024-04-26T12:27:51.677562+0000","last_peered":"2024-04-26T12:27:51.677562+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.669607+0000","last_became_peered":"2024-04-26T12:27:48.669607+0000","last_unstale":"2024-04-26T12:27:51.677562+0000","last_undegraded":"2024-04-26T12:27:51.677562+0000","last_fullsized":"2024-04-26T12:27:48.665480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:27.215092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677375+0000","last_change":"2024-04-26T12:27:48.668015+0000","last_active":"2024-04-26T12:27:51.677375+0000","last_peered":"2024-04-26T12:27:51.677375+0000","last_clean":"2024-04-26T12:27:45.658906+0000","last_became_active":"2024-04-26T12:27:48.668015+0000","last_became_peered":"2024-04-26T12:27:48.668015+0000","last_unstale":"2024-04-26T12:27:51.677375+0000","last_undegraded":"2024-04-26T12:27:51.677375+0000","last_fullsized":"2024-04-26T12:27:48.664776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:53.936963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.678011+0000","last_change":"2024-04-26T12:26:53.266014+0000","last_active":"2024-04-26T12:27:51.678011+0000","last_peered":"2024-04-26T12:27:51.678011+0000","last_clean":"2024-04-26T12:27:51.678011+0000","last_became_active":"2024-04-26T12:26:53.264254+0000","last_became_peered":"2024-04-26T12:26:53.264254+0000","last_unstale":"2024-04-26T12:27:51.678011+0000","last_undegraded":"2024-04-26T12:27:51.678011+0000","last_fullsized":"2024-04-26T12:27:51.678011+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:04.369827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677111+0000","last_change":"2024-04-26T12:26:52.839759+0000","last_active":"2024-04-26T12:27:51.677111+0000","last_peered":"2024-04-26T12:27:51.677111+0000","last_clean":"2024-04-26T12:27:51.677111+0000","last_became_active":"2024-04-26T12:26:52.839445+0000","last_became_peered":"2024-04-26T12:26:52.839445+0000","last_unstale":"2024-04-26T12:27:51.677111+0000","last_undegraded":"2024-04-26T12:27:51.677111+0000","last_fullsized":"2024-04-26T12:27:51.677111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:40.499263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.678185+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:27:51.678185+0000","last_peered":"2024-04-26T12:27:51.678185+0000","last_clean":"2024-04-26T12:27:51.678185+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:27:51.678185+0000","last_undegraded":"2024-04-26T12:27:51.678185+0000","last_fullsized":"2024-04-26T12:27:51.678185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677213+0000","last_change":"2024-04-26T12:27:48.668268+0000","last_active":"2024-04-26T12:27:51.677213+0000","last_peered":"2024-04-26T12:27:51.677213+0000","last_clean":"2024-04-26T12:27:45.658104+0000","last_became_active":"2024-04-26T12:27:48.668268+0000","last_became_peered":"2024-04-26T12:27:48.668268+0000","last_unstale":"2024-04-26T12:27:51.677213+0000","last_undegraded":"2024-04-26T12:27:51.677213+0000","last_fullsized":"2024-04-26T12:27:48.664179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:23.206979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678091+0000","last_change":"2024-04-26T12:27:48.670050+0000","last_active":"2024-04-26T12:27:51.678091+0000","last_peered":"2024-04-26T12:27:51.678091+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.670050+0000","last_became_peered":"2024-04-26T12:27:48.670050+0000","last_unstale":"2024-04-26T12:27:51.678091+0000","last_undegraded":"2024-04-26T12:27:51.678091+0000","last_fullsized":"2024-04-26T12:27:48.665739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:55.100055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678040+0000","last_change":"2024-04-26T12:27:48.668575+0000","last_active":"2024-04-26T12:27:51.678040+0000","last_peered":"2024-04-26T12:27:51.678040+0000","last_clean":"2024-04-26T12:26:46.799248+0000","last_became_active":"2024-04-26T12:27:48.668575+0000","last_became_peered":"2024-04-26T12:27:48.668575+0000","last_unstale":"2024-04-26T12:27:51.678040+0000","last_undegraded":"2024-04-26T12:27:51.678040+0000","last_fullsized":"2024-04-26T12:27:48.665159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:22.199253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678000+0000","last_change":"2024-04-26T12:27:48.669802+0000","last_active":"2024-04-26T12:27:51.678000+0000","last_peered":"2024-04-26T12:27:51.678000+0000","last_clean":"2024-04-26T12:27:45.659254+0000","last_became_active":"2024-04-26T12:27:48.669802+0000","last_became_peered":"2024-04-26T12:27:48.669802+0000","last_unstale":"2024-04-26T12:27:51.678000+0000","last_undegraded":"2024-04-26T12:27:51.678000+0000","last_fullsized":"2024-04-26T12:27:48.666715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:54.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677900+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:27:51.677900+0000","last_peered":"2024-04-26T12:27:51.677900+0000","last_clean":"2024-04-26T12:27:51.677900+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:27:51.677900+0000","last_undegraded":"2024-04-26T12:27:51.677900+0000","last_fullsized":"2024-04-26T12:27:51.677900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677617+0000","last_change":"2024-04-26T12:27:48.668671+0000","last_active":"2024-04-26T12:27:51.677617+0000","last_peered":"2024-04-26T12:27:51.677617+0000","last_clean":"2024-04-26T12:27:45.659071+0000","last_became_active":"2024-04-26T12:27:48.668671+0000","last_became_peered":"2024-04-26T12:27:48.668671+0000","last_unstale":"2024-04-26T12:27:51.677617+0000","last_undegraded":"2024-04-26T12:27:51.677617+0000","last_fullsized":"2024-04-26T12:27:48.665219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:12.771783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677891+0000","last_change":"2024-04-26T12:27:48.668565+0000","last_active":"2024-04-26T12:27:51.677891+0000","last_peered":"2024-04-26T12:27:51.677891+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.668565+0000","last_became_peered":"2024-04-26T12:27:48.668565+0000","last_unstale":"2024-04-26T12:27:51.677891+0000","last_undegraded":"2024-04-26T12:27:51.677891+0000","last_fullsized":"2024-04-26T12:27:48.665406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:49.102502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677591+0000","last_change":"2024-04-26T12:27:48.668236+0000","last_active":"2024-04-26T12:27:51.677591+0000","last_peered":"2024-04-26T12:27:51.677591+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.668236+0000","last_became_peered":"2024-04-26T12:27:48.668236+0000","last_unstale":"2024-04-26T12:27:51.677591+0000","last_undegraded":"2024-04-26T12:27:51.677591+0000","last_fullsized":"2024-04-26T12:27:48.664413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:13.595357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677225+0000","last_change":"2024-04-26T12:27:48.666868+0000","last_active":"2024-04-26T12:27:51.677225+0000","last_peered":"2024-04-26T12:27:51.677225+0000","last_clean":"2024-04-26T12:26:46.799248+0000","last_became_active":"2024-04-26T12:27:48.666868+0000","last_became_peered":"2024-04-26T12:27:48.666868+0000","last_unstale":"2024-04-26T12:27:51.677225+0000","last_undegraded":"2024-04-26T12:27:51.677225+0000","last_fullsized":"2024-04-26T12:27:48.664153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:07.383100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677111+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:27:51.677111+0000","last_peered":"2024-04-26T12:27:51.677111+0000","last_clean":"2024-04-26T12:27:51.677111+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:27:51.677111+0000","last_undegraded":"2024-04-26T12:27:51.677111+0000","last_fullsized":"2024-04-26T12:27:51.677111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678418+0000","last_change":"2024-04-26T12:27:48.669503+0000","last_active":"2024-04-26T12:27:51.678418+0000","last_peered":"2024-04-26T12:27:51.678418+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.669503+0000","last_became_peered":"2024-04-26T12:27:48.669503+0000","last_unstale":"2024-04-26T12:27:51.678418+0000","last_undegraded":"2024-04-26T12:27:51.678418+0000","last_fullsized":"2024-04-26T12:27:48.665538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:57.602196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678021+0000","last_change":"2024-04-26T12:27:48.670062+0000","last_active":"2024-04-26T12:27:51.678021+0000","last_peered":"2024-04-26T12:27:51.678021+0000","last_clean":"2024-04-26T12:27:45.659028+0000","last_became_active":"2024-04-26T12:27:48.670062+0000","last_became_peered":"2024-04-26T12:27:48.670062+0000","last_unstale":"2024-04-26T12:27:51.678021+0000","last_undegraded":"2024-04-26T12:27:51.678021+0000","last_fullsized":"2024-04-26T12:27:48.665975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:54.638284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":228,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677298+0000","last_change":"2024-04-26T12:26:46.810189+0000","last_active":"2024-04-26T12:27:51.677298+0000","last_peered":"2024-04-26T12:27:51.677298+0000","last_clean":"2024-04-26T12:27:51.677298+0000","last_became_active":"2024-04-26T12:26:46.809453+0000","last_became_peered":"2024-04-26T12:26:46.809453+0000","last_unstale":"2024-04-26T12:27:51.677298+0000","last_undegraded":"2024-04-26T12:27:51.677298+0000","last_fullsized":"2024-04-26T12:27:51.677298+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:18.618650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677264+0000","last_change":"2024-04-26T12:27:48.667062+0000","last_active":"2024-04-26T12:27:51.677264+0000","last_peered":"2024-04-26T12:27:51.677264+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.667062+0000","last_became_peered":"2024-04-26T12:27:48.667062+0000","last_unstale":"2024-04-26T12:27:51.677264+0000","last_undegraded":"2024-04-26T12:27:51.677264+0000","last_fullsized":"2024-04-26T12:27:48.664383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:46.137368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677921+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:27:51.677921+0000","last_peered":"2024-04-26T12:27:51.677921+0000","last_clean":"2024-04-26T12:27:51.677921+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:27:51.677921+0000","last_undegraded":"2024-04-26T12:27:51.677921+0000","last_fullsized":"2024-04-26T12:27:51.677921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677381+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:27:51.677381+0000","last_peered":"2024-04-26T12:27:51.677381+0000","last_clean":"2024-04-26T12:27:51.677381+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:27:51.677381+0000","last_undegraded":"2024-04-26T12:27:51.677381+0000","last_fullsized":"2024-04-26T12:27:51.677381+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677323+0000","last_change":"2024-04-26T12:27:48.668810+0000","last_active":"2024-04-26T12:27:51.677323+0000","last_peered":"2024-04-26T12:27:51.677323+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.668810+0000","last_became_peered":"2024-04-26T12:27:48.668810+0000","last_unstale":"2024-04-26T12:27:51.677323+0000","last_undegraded":"2024-04-26T12:27:51.677323+0000","last_fullsized":"2024-04-26T12:27:48.664798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:00.771299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678719+0000","last_change":"2024-04-26T12:27:48.669740+0000","last_active":"2024-04-26T12:27:51.678719+0000","last_peered":"2024-04-26T12:27:51.678719+0000","last_clean":"2024-04-26T12:27:45.658919+0000","last_became_active":"2024-04-26T12:27:48.669740+0000","last_became_peered":"2024-04-26T12:27:48.669740+0000","last_unstale":"2024-04-26T12:27:51.678719+0000","last_undegraded":"2024-04-26T12:27:51.678719+0000","last_fullsized":"2024-04-26T12:27:48.665507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:09.757922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678416+0000","last_change":"2024-04-26T12:27:48.671446+0000","last_active":"2024-04-26T12:27:51.678416+0000","last_peered":"2024-04-26T12:27:51.678416+0000","last_clean":"2024-04-26T12:27:45.658894+0000","last_became_active":"2024-04-26T12:27:48.671446+0000","last_became_peered":"2024-04-26T12:27:48.671446+0000","last_unstale":"2024-04-26T12:27:51.678416+0000","last_undegraded":"2024-04-26T12:27:51.678416+0000","last_fullsized":"2024-04-26T12:27:48.666106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:09.912135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678054+0000","last_change":"2024-04-26T12:27:48.668790+0000","last_active":"2024-04-26T12:27:51.678054+0000","last_peered":"2024-04-26T12:27:51.678054+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.668790+0000","last_became_peered":"2024-04-26T12:27:48.668790+0000","last_unstale":"2024-04-26T12:27:51.678054+0000","last_undegraded":"2024-04-26T12:27:51.678054+0000","last_fullsized":"2024-04-26T12:27:48.665576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:47.646378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677754+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:27:51.677754+0000","last_peered":"2024-04-26T12:27:51.677754+0000","last_clean":"2024-04-26T12:27:51.677754+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:27:51.677754+0000","last_undegraded":"2024-04-26T12:27:51.677754+0000","last_fullsized":"2024-04-26T12:27:51.677754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":18,"reported_epoch":32,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:27:51.678818+0000","last_change":"2024-04-26T12:27:48.671526+0000","last_active":"2024-04-26T12:27:51.678818+0000","last_peered":"2024-04-26T12:27:51.678818+0000","last_clean":"2024-04-26T12:26:53.249212+0000","last_became_active":"2024-04-26T12:27:48.671526+0000","last_became_peered":"2024-04-26T12:27:48.671526+0000","last_unstale":"2024-04-26T12:27:51.678818+0000","last_undegraded":"2024-04-26T12:27:48.667114+0000","last_fullsized":"2024-04-26T12:27:48.667045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:12.431613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678608+0000","last_change":"2024-04-26T12:27:48.668705+0000","last_active":"2024-04-26T12:27:51.678608+0000","last_peered":"2024-04-26T12:27:51.678608+0000","last_clean":"2024-04-26T12:26:46.799248+0000","last_became_active":"2024-04-26T12:27:48.668705+0000","last_became_peered":"2024-04-26T12:27:48.668705+0000","last_unstale":"2024-04-26T12:27:51.678608+0000","last_undegraded":"2024-04-26T12:27:51.678608+0000","last_fullsized":"2024-04-26T12:27:48.664952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:26.753235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677150+0000","last_change":"2024-04-26T12:27:48.666997+0000","last_active":"2024-04-26T12:27:51.677150+0000","last_peered":"2024-04-26T12:27:51.677150+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.666997+0000","last_became_peered":"2024-04-26T12:27:48.666997+0000","last_unstale":"2024-04-26T12:27:51.677150+0000","last_undegraded":"2024-04-26T12:27:51.677150+0000","last_fullsized":"2024-04-26T12:27:48.664524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:35.445817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.678680+0000","last_change":"2024-04-26T12:26:47.811204+0000","last_active":"2024-04-26T12:27:51.678680+0000","last_peered":"2024-04-26T12:27:51.678680+0000","last_clean":"2024-04-26T12:27:51.678680+0000","last_became_active":"2024-04-26T12:26:47.810997+0000","last_became_peered":"2024-04-26T12:26:47.810997+0000","last_unstale":"2024-04-26T12:27:51.678680+0000","last_undegraded":"2024-04-26T12:27:51.678680+0000","last_fullsized":"2024-04-26T12:27:51.678680+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:24.967175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":27,"reported_epoch":32,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:27:51.678053+0000","last_change":"2024-04-26T12:27:48.668216+0000","last_active":"2024-04-26T12:27:51.678053+0000","last_peered":"2024-04-26T12:27:51.678053+0000","last_clean":"2024-04-26T12:27:21.599360+0000","last_became_active":"2024-04-26T12:27:48.668216+0000","last_became_peered":"2024-04-26T12:27:48.668216+0000","last_unstale":"2024-04-26T12:27:51.678053+0000","last_undegraded":"2024-04-26T12:27:48.665969+0000","last_fullsized":"2024-04-26T12:27:48.665887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:27.522039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677400+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:27:51.677400+0000","last_peered":"2024-04-26T12:27:51.677400+0000","last_clean":"2024-04-26T12:27:51.677400+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:27:51.677400+0000","last_undegraded":"2024-04-26T12:27:51.677400+0000","last_fullsized":"2024-04-26T12:27:51.677400+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677585+0000","last_change":"2024-04-26T12:26:52.840797+0000","last_active":"2024-04-26T12:27:51.677585+0000","last_peered":"2024-04-26T12:27:51.677585+0000","last_clean":"2024-04-26T12:27:51.677585+0000","last_became_active":"2024-04-26T12:26:52.840409+0000","last_became_peered":"2024-04-26T12:26:52.840409+0000","last_unstale":"2024-04-26T12:27:51.677585+0000","last_undegraded":"2024-04-26T12:27:51.677585+0000","last_fullsized":"2024-04-26T12:27:51.677585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:57.898978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678345+0000","last_change":"2024-04-26T12:27:48.669598+0000","last_active":"2024-04-26T12:27:51.678345+0000","last_peered":"2024-04-26T12:27:51.678345+0000","last_clean":"2024-04-26T12:27:45.658753+0000","last_became_active":"2024-04-26T12:27:48.669598+0000","last_became_peered":"2024-04-26T12:27:48.669598+0000","last_unstale":"2024-04-26T12:27:51.678345+0000","last_undegraded":"2024-04-26T12:27:51.678345+0000","last_fullsized":"2024-04-26T12:27:48.665738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:07.518579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":21,"reported_epoch":32,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:27:51.677877+0000","last_change":"2024-04-26T12:27:48.669676+0000","last_active":"2024-04-26T12:27:51.677877+0000","last_peered":"2024-04-26T12:27:51.677877+0000","last_clean":"2024-04-26T12:26:55.295915+0000","last_became_active":"2024-04-26T12:27:48.669676+0000","last_became_peered":"2024-04-26T12:27:48.669676+0000","last_unstale":"2024-04-26T12:27:51.677877+0000","last_undegraded":"2024-04-26T12:27:48.665783+0000","last_fullsized":"2024-04-26T12:27:48.665708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:06.786760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677898+0000","last_change":"2024-04-26T12:27:48.668784+0000","last_active":"2024-04-26T12:27:51.677898+0000","last_peered":"2024-04-26T12:27:51.677898+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.668784+0000","last_became_peered":"2024-04-26T12:27:48.668784+0000","last_unstale":"2024-04-26T12:27:51.677898+0000","last_undegraded":"2024-04-26T12:27:51.677898+0000","last_fullsized":"2024-04-26T12:27:48.665101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:14.294850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.678009+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:27:51.678009+0000","last_peered":"2024-04-26T12:27:51.678009+0000","last_clean":"2024-04-26T12:27:51.678009+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:27:51.678009+0000","last_undegraded":"2024-04-26T12:27:51.678009+0000","last_fullsized":"2024-04-26T12:27:51.678009+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677477+0000","last_change":"2024-04-26T12:27:48.668102+0000","last_active":"2024-04-26T12:27:51.677477+0000","last_peered":"2024-04-26T12:27:51.677477+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.668102+0000","last_became_peered":"2024-04-26T12:27:48.668102+0000","last_unstale":"2024-04-26T12:27:51.677477+0000","last_undegraded":"2024-04-26T12:27:51.677477+0000","last_fullsized":"2024-04-26T12:27:48.664978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:28.219817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.678079+0000","last_change":"2024-04-26T12:27:48.668509+0000","last_active":"2024-04-26T12:27:51.678079+0000","last_peered":"2024-04-26T12:27:51.678079+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.668509+0000","last_became_peered":"2024-04-26T12:27:48.668509+0000","last_unstale":"2024-04-26T12:27:51.678079+0000","last_undegraded":"2024-04-26T12:27:51.678079+0000","last_fullsized":"2024-04-26T12:27:48.664656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:21.541532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677505+0000","last_change":"2024-04-26T12:27:48.668437+0000","last_active":"2024-04-26T12:27:51.677505+0000","last_peered":"2024-04-26T12:27:51.677505+0000","last_clean":"2024-04-26T12:27:45.658304+0000","last_became_active":"2024-04-26T12:27:48.668437+0000","last_became_peered":"2024-04-26T12:27:48.668437+0000","last_unstale":"2024-04-26T12:27:51.677505+0000","last_undegraded":"2024-04-26T12:27:51.677505+0000","last_fullsized":"2024-04-26T12:27:48.664530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:30.124057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":18,"reported_epoch":32,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:27:51.678769+0000","last_change":"2024-04-26T12:27:48.668882+0000","last_active":"2024-04-26T12:27:51.678769+0000","last_peered":"2024-04-26T12:27:51.678769+0000","last_clean":"2024-04-26T12:26:53.249466+0000","last_became_active":"2024-04-26T12:27:48.668882+0000","last_became_peered":"2024-04-26T12:27:48.668882+0000","last_unstale":"2024-04-26T12:27:51.678769+0000","last_undegraded":"2024-04-26T12:27:48.666190+0000","last_fullsized":"2024-04-26T12:27:48.666104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:59.729519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677930+0000","last_change":"2024-04-26T12:27:48.668041+0000","last_active":"2024-04-26T12:27:51.677930+0000","last_peered":"2024-04-26T12:27:51.677930+0000","last_clean":"2024-04-26T12:27:45.658980+0000","last_became_active":"2024-04-26T12:27:48.668041+0000","last_became_peered":"2024-04-26T12:27:48.668041+0000","last_unstale":"2024-04-26T12:27:51.677930+0000","last_undegraded":"2024-04-26T12:27:51.677930+0000","last_fullsized":"2024-04-26T12:27:48.665471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:25.403127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677478+0000","last_change":"2024-04-26T12:27:48.669908+0000","last_active":"2024-04-26T12:27:51.677478+0000","last_peered":"2024-04-26T12:27:51.677478+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.669908+0000","last_became_peered":"2024-04-26T12:27:48.669908+0000","last_unstale":"2024-04-26T12:27:51.677478+0000","last_undegraded":"2024-04-26T12:27:51.677478+0000","last_fullsized":"2024-04-26T12:27:48.664986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:44.773012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677174+0000","last_change":"2024-04-26T12:27:48.666218+0000","last_active":"2024-04-26T12:27:51.677174+0000","last_peered":"2024-04-26T12:27:51.677174+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.666218+0000","last_became_peered":"2024-04-26T12:27:48.666218+0000","last_unstale":"2024-04-26T12:27:51.677174+0000","last_undegraded":"2024-04-26T12:27:51.677174+0000","last_fullsized":"2024-04-26T12:27:48.664092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:17.742404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.677989+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:27:51.677989+0000","last_peered":"2024-04-26T12:27:51.677989+0000","last_clean":"2024-04-26T12:27:51.677989+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:27:51.677989+0000","last_undegraded":"2024-04-26T12:27:51.677989+0000","last_fullsized":"2024-04-26T12:27:51.677989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-26T12:27:51.677490+0000","last_change":"2024-04-26T12:27:48.667318+0000","last_active":"2024-04-26T12:27:51.677490+0000","last_peered":"2024-04-26T12:27:51.677490+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.667318+0000","last_became_peered":"2024-04-26T12:27:48.667318+0000","last_unstale":"2024-04-26T12:27:51.677490+0000","last_undegraded":"2024-04-26T12:27:51.677490+0000","last_fullsized":"2024-04-26T12:27:48.664546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:35.445817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T12:27:51.678371+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:27:51.678371+0000","last_peered":"2024-04-26T12:27:51.678371+0000","last_clean":"2024-04-26T12:27:51.678371+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:27:51.678371+0000","last_undegraded":"2024-04-26T12:27:51.678371+0000","last_fullsized":"2024-04-26T12:27:51.678371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":83,"acting":83,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7305,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":43,"acting":43,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738385,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":719545,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.372}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.35899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":720161,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.35699999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738382,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":100398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:27:58.263 INFO:tasks.thrashosds.thrasher:Setting 4.19 to [0, 2] 2024-04-26T12:27:58.263 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.19', '0', '2'] 2024-04-26T12:27:58.263 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.19 0 2 2024-04-26T12:27:58.349 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:58.349+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:58.386 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:58.386 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:58.386 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:58.386 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:58.396 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:58.450 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:58.449+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:58.522 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:58.522 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:58.522 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:58.522 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:58.522 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:58.532 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:58.572 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:58.571+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:58.652 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:58.651+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:58.702 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 71.368385038, 2024-04-26T12:27:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449519214999995, 2024-04-26T12:27:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449483002999997, 2024-04-26T12:27:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449444029000006, 2024-04-26T12:27:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449420861999997, 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449405485, 2024-04-26T12:27:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449377295000005, 2024-04-26T12:27:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449359297000001, 2024-04-26T12:27:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449334706000002, 2024-04-26T12:27:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449309756999995, 2024-04-26T12:27:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:58.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:58.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:58.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:58.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:58.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:58.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:58.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:58.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:58.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:58.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:58.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:58.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:58.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:58.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:58.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:58.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:58.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:58.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:58.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:58.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:58.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:58.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:58.785 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.785 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.785 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.786 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.786 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:58.786 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449288832999997, 2024-04-26T12:27:58.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:58.786 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.786 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.786 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:58.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:58.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:58.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:58.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:58.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:58.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:58.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:58.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:58.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:58.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:58.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:58.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:58.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:58.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:58.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:58.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:58.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:58.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:58.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:58.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:58.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:58.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:58.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:58.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:58.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:58.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:58.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:58.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:58.792 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.792 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.792 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.792 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.792 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:58.792 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449253983999995, 2024-04-26T12:27:58.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:58.792 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.793 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.793 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:58.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:58.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:58.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:58.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:58.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:58.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:58.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:58.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:58.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:58.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:58.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:58.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:58.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:58.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:58.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:58.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:58.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:58.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:58.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:58.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:58.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:58.798 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.798 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.798 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.798 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.798 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:58.799 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449220034000007, 2024-04-26T12:27:58.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:58.799 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.799 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.799 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:58.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:58.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:58.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:58.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:58.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:58.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:58.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:58.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:58.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:58.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:58.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:58.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:58.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:58.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:58.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:58.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:58.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:58.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:58.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:58.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:58.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:58.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:58.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:58.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:58.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:58.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:58.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:58.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:58.804 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.804 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.805 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.805 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:58.805 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449199737000001, 2024-04-26T12:27:58.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:58.805 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.805 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.805 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:58.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:58.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:58.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:58.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:58.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:58.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:58.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:58.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:58.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:58.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:58.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:58.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:58.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:58.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:58.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:58.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:58.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:58.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:58.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:58.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:58.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:58.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:58.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:58.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:58.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:58.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:58.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449164616000004, 2024-04-26T12:27:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:58.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:58.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:58.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:58.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:58.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:58.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:58.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:58.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:58.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:58.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:58.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:58.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:58.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:58.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:58.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:58.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:58.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:58.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:58.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:58.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:58.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:58.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:58.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:58.817 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.817 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.817 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.817 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.817 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:58.817 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.449129376000002, 2024-04-26T12:27:58.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:58.818 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.818 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.818 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:58.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:58.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:58.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:58.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:58.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:58.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:58.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:58.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:58.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:58.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:58.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:58.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:58.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:58.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:58.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:58.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:58.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:58.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:58.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:58.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:58.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:58.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:58.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:58.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:58.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:58.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:58.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:58.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:58.823 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.823 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.823 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.448987627999998, 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:58.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:58.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:58.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:58.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:58.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:58.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:58.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:58.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:58.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:58.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:58.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:58.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:58.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:58.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:58.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:58.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:58.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:58.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:58.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:58.829 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.830 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.830 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.830 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.830 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:58.830 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.448963609000003, 2024-04-26T12:27:58.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:58.830 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.830 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.830 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:58.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:58.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:58.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:58.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:58.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:58.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:58.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:58.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:58.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:58.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:58.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:58.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:58.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:58.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:58.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:58.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:58.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:58.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:58.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:58.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:58.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:58.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:58.836 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.836 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.836 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.836 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.836 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:58.836 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.448939640999996, 2024-04-26T12:27:58.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:27:58.836 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.836 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:58.836 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:27:58.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:27:58.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:27:58.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:27:58.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:27:58.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:27:58.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:27:58.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:27:58.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:58.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:27:58.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:27:58.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:27:58.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:27:58.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:27:58.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:27:58.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:58.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:27:58.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:27:58.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:58.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:27:58.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:27:58.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:58.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:27:58.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:27:58.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:58.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:27:58.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:27:58.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:27:58.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:27:58.842 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.842 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.842 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.842 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:58.842 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:58.842 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.448906260000001, 2024-04-26T12:27:58.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:27:58.843 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:58.843 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:27:58.843 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:58.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:58.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:58.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:58.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:58.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:58.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:58.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:27:58.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:27:58.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:27:58.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:27:58.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:58.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:27:58.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:27:58.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:58.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:27:58.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:27:58.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:58.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:27:58.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:27:58.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:58.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:58.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:58.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:27:58.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:27:58.847 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.847 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.847 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.847 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:58.847 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:58.847 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:58.848 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:58.847+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:58.849 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:27:58.949 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:58.948+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:58.983 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:58.983 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:58.983 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:27:58.983 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:58.993 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:27:59.077 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:59.075+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:59.151 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:59.150+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:59.159 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:59.159 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:27:59.159 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:27:59.160 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:27:59.160 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:59.169 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:27:59.254 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:59.252+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:59.338 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:27:59.338 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:27:59.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:27:59.338 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:27:59.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.339 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:27:59.339 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:59.339 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.454684865999994, 2024-04-26T12:27:59.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:27:59.339 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.339 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.339 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:59.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:59.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:27:59.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:27:59.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:27:59.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:27:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:27:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:27:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:27:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:27:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:27:59.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:27:59.343 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.343 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.343 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.343 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:27:59.343 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:59.343 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.454045519000005, 2024-04-26T12:27:59.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:27:59.343 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.343 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.343 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:27:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:27:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:27:59.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:27:59.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:27:59.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:27:59.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:27:59.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:27:59.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:27:59.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:27:59.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:27:59.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.347 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.347 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:27:59.347 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:59.347 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.324343329000001, 2024-04-26T12:27:59.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:27:59.348 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.348 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.348 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:59.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:27:59.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:27:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:27:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:27:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:27:59.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:27:59.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:27:59.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:27:59.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:27:59.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:27:59.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:27:59.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:27:59.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:27:59.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:27:59.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:27:59.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:27:59.351 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.351 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.352 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.352 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:27:59.352 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:59.352 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.323848742999999, 2024-04-26T12:27:59.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:27:59.352 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.352 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.352 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:59.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:59.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:27:59.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:27:59.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:27:59.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:27:59.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:27:59.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:27:59.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:27:59.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:27:59.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:27:59.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:27:59.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:27:59.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:27:59.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:27:59.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:27:59.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:27:59.357 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.357 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.357 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.358 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:27:59.358 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:59.358 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.321846558999994, 2024-04-26T12:27:59.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:27:59.358 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.358 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.358 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:59.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:27:59.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:27:59.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:27:59.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:27:59.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:27:59.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:27:59.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:27:59.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:59.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:27:59.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:27:59.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:27:59.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:27:59.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:27:59.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:27:59.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:27:59.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:27:59.362 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.362 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.362 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.362 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:27:59.362 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:59.362 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.321440218999996, 2024-04-26T12:27:59.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:27:59.362 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.362 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.362 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:59.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:27:59.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:27:59.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:27:59.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:27:59.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:27:59.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:27:59.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:27:59.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:27:59.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:27:59.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:27:59.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:27:59.366 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.366 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.366 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.366 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:27:59.366 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:59.366 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.321085394999997, 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:27:59.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:27:59.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:27:59.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:27:59.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:27:59.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:27:59.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:27:59.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:27:59.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:27:59.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:27:59.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:27:59.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:27:59.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:27:59.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:27:59.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:27:59.370 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.370 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.370 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.218526980999997, 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:27:59.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:27:59.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:27:59.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:27:59.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:27:59.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:27:59.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:27:59.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:27:59.375 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.375 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.375 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.375 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:27:59.375 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:59.375 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.218130453000001, 2024-04-26T12:27:59.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:27:59.375 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.375 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.375 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:27:59.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:27:59.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:27:59.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:27:59.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:27:59.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:27:59.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:27:59.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:27:59.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:27:59.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:27:59.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:27:59.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.121120844999993, 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:27:59.379 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.380 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.380 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:59.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:59.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:27:59.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:27:59.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:27:59.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:27:59.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:27:59.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:27:59.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:27:59.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:27:59.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:27:59.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:27:59.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:27:59.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:27:59.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:27:59.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:27:59.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:27:59.383 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.383 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.383 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 72.120427129000007, 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:27:59.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:27:59.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:27:59.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:27:59.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:27:59.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:27:59.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:27:59.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:27:59.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:27:59.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:27:59.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:27:59.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:27:59.387 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.388 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.388 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.388 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.388 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:59.388 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.085688074000004, 2024-04-26T12:27:59.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:27:59.388 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.388 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.388 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:59.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:27:59.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:27:59.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:59.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:27:59.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:27:59.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:27:59.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:27:59.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:27:59.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:27:59.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:27:59.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:27:59.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:27:59.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:27:59.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:59.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:27:59.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:27:59.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:59.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:27:59.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:27:59.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:27:59.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:27:59.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:27:59.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:27:59.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:27:59.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:27:59.393 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.393 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.393 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.393 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.393 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:59.393 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.084867154999998, 2024-04-26T12:27:59.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:27:59.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:59.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:27:59.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:27:59.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:27:59.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:27:59.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:27:59.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:59.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:59.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:27:59.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:59.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:27:59.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:27:59.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:27:59.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:27:59.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:27:59.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:27:59.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:27:59.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:27:59.398 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.398 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.398 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.084837065000002, 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:59.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:27:59.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:27:59.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:27:59.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:27:59.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:27:59.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:27:59.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:27:59.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:27:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:27:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:27:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:27:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:27:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:27:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:27:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:27:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:27:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:27:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:27:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:27:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:27:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:27:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.084783277, 2024-04-26T12:27:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:27:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.404 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:27:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:27:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:27:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:27:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:27:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:27:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:27:59.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:27:59.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:27:59.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:27:59.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:27:59.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:27:59.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:59.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:27:59.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:27:59.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:59.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:27:59.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:27:59.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:27:59.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:27:59.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:27:59.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:27:59.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:27:59.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:27:59.409 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.409 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.409 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.410 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.410 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:59.410 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.084730719999996, 2024-04-26T12:27:59.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:27:59.410 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.410 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.410 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:59.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:59.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:27:59.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:59.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:27:59.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:27:59.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:27:59.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:27:59.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:27:59.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:27:59.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:27:59.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:27:59.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.084690506000001, 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:59.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:27:59.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:27:59.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:27:59.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:27:59.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:27:59.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:27:59.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:27:59.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:27:59.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:27:59.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:27:59.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:27:59.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:27:59.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:59.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:27:59.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:27:59.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:59.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:27:59.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:27:59.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:27:59.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:27:59.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:27:59.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:27:59.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:27:59.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:27:59.420 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.420 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.420 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.420 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.420 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.084662344999998, 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:27:59.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:59.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:27:59.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:27:59.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:27:59.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:27:59.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:27:59.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.426 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:59.426 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.084631655999999, 2024-04-26T12:27:59.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:27:59.426 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.426 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:59.426 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:59.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:27:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:27:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:27:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:27:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:27:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:27:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:27:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:27:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:27:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:27:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.430 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:59.430 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.084605083, 2024-04-26T12:27:59.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:27:59.430 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:27:59.430 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:27:59.430 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:27:59.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:27:59.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:59.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:27:59.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:59.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:27:59.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:27:59.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:27:59.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:27:59.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:27:59.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:27:59.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:27:59.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:27:59.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:27:59.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:27:59.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:27:59.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:27:59.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:27:59.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:27:59.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:27:59.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:27:59.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:27:59.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:27:59.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:27:59.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:27:59.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:27:59.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:27:59.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.433 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:27:59.433 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:27:59.433 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:27:59.435 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:59.433+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:59.435 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:27:59.536 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:59.535+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:59.570 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:59.571 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:59.571 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:27:59.571 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:59.580 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:27:59.637 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:59.635+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:59.703 INFO:teuthology.orchestra.run.smithi046.stderr:set 4.19 pg_upmap mapping to [0,2] 2024-04-26T12:27:59.710 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:59.710 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:27:59.710 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:27:59.710 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:27:59.710 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:27:59.717 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:27:59.720 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:27:59.737 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:27:59.737+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:27:59.838 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:27:59.837+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:27:59.889 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:27:59.890 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:27:59.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:27:59.890 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:27:59.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.890 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:27:59.890 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:59.890 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 72.556891398000005, 2024-04-26T12:27:59.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:27:59.890 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.890 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.890 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:27:59.890 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:27:59.891 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:27:59.891 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:27:59.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.891 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:59.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:59.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:27:59.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:27:59.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:27:59.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:27:59.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:27:59.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:27:59.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:27:59.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:59.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:27:59.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:27:59.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:27:59.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:27:59.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:27:59.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:27:59.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:27:59.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:27:59.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:27:59.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:27:59.895 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.895 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.638025575, 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:27:59.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:27:59.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:27:59.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:27:59.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:27:59.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:27:59.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:27:59.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:27:59.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:27:59.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:27:59.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:27:59.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:59.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:27:59.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:27:59.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:27:59.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:27:59.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:27:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:27:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:27:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:27:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:27:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:27:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.902 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.902 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.902 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:59.902 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637989363000003, 2024-04-26T12:27:59.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:27:59.902 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.902 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.902 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:59.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:59.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:27:59.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:27:59.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:27:59.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:27:59.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:27:59.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:27:59.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:27:59.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:27:59.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:27:59.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:59.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:27:59.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:27:59.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:27:59.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:27:59.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:27:59.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:27:59.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:27:59.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:27:59.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:27:59.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637950388999997, 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:59.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:59.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:27:59.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:27:59.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:27:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:27:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:27:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:27:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:27:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:27:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:27:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:27:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:27:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:27:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:27:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:27:59.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:27:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:27:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:27:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:27:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:27:59.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:27:59.914 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.914 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.914 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.914 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.914 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:59.914 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637927222000002, 2024-04-26T12:27:59.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:27:59.914 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.914 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.914 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:27:59.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:27:59.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:27:59.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:27:59.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:27:59.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:27:59.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:27:59.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:27:59.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:59.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:27:59.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:27:59.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:27:59.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:27:59.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:27:59.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:27:59.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:59.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:27:59.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:27:59.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:27:59.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:27:59.920 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.920 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.920 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.920 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.920 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:59.920 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637911845000005, 2024-04-26T12:27:59.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:27:59.920 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.920 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:27:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:27:59.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:27:59.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:27:59.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:27:59.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:27:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:27:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:27:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:27:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:27:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:27:59.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:27:59.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:27:59.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:27:59.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:27:59.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:27:59.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:27:59.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:27:59.926 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.926 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.926 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.926 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.926 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:59.926 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637883654999996, 2024-04-26T12:27:59.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:27:59.926 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.927 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.927 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:59.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:59.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:27:59.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:27:59.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:27:59.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:27:59.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:59.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:27:59.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:27:59.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:27:59.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637865657000006, 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.932 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.933 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:59.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:59.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:27:59.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:27:59.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:27:59.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:27:59.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:59.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:27:59.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:27:59.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:27:59.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:27:59.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:27:59.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:27:59.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:59.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:27:59.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:27:59.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:27:59.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:27:59.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:27:59.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:27:59.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:27:59.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:27:59.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:27:59.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:27:59.938 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.938 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.938 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.938 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.938 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:59.938 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637841065999993, 2024-04-26T12:27:59.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:27:59.938 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:27:59.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:27:59.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:27:59.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:27:59.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:27:59.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:27:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:27:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:27:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:27:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:27:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:27:59.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:27:59.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:27:59.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:27:59.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:27:59.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:59.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:27:59.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:27:59.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:27:59.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:27:59.944 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.944 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.944 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.944 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.944 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:59.945 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637816117, 2024-04-26T12:27:59.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:27:59.945 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.945 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.945 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:59.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:27:59.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:27:59.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:27:59.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:27:59.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:27:59.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:27:59.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:27:59.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:27:59.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:27:59.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:27:59.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:59.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:27:59.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:27:59.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:27:59.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:27:59.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:27:59.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:27:59.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:59.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:27:59.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:27:59.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:27:59.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:27:59.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:27:59.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:27:59.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:27:59.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:27:59.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:27:59.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:27:59.950 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.950 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.950 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.951 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.951 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:59.951 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637795193000002, 2024-04-26T12:27:59.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:27:59.951 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.951 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.951 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:59.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:27:59.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:27:59.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:27:59.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:27:59.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:27:59.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:27:59.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:59.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:27:59.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:27:59.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:27:59.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:27:59.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:27:59.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.957 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.957 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:59.957 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637760344, 2024-04-26T12:27:59.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:27:59.957 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.957 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.957 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:59.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:59.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:27:59.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:27:59.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:27:59.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:27:59.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:27:59.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:27:59.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:27:59.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:27:59.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:27:59.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:59.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:27:59.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:27:59.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:27:59.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:27:59.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:27:59.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:27:59.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:27:59.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:27:59.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:27:59.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:27:59.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:27:59.962 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.962 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.962 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637726393999998, 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:27:59.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:27:59.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:27:59.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:27:59.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:27:59.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:27:59.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:59.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:27:59.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:27:59.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:27:59.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:27:59.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:27:59.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:27:59.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:27:59.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:27:59.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:27:59.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:27:59.968 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.968 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637706097000006, 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:27:59.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:27:59.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:27:59.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:27:59.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:59.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:27:59.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:27:59.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:27:59.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:27:59.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:27:59.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:27:59.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:59.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:27:59.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:27:59.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:27:59.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:27:59.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:27:59.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:27:59.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:27:59.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:27:59.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637670975999995, 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.975 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:59.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:27:59.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:27:59.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:27:59.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:27:59.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:27:59.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:27:59.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:27:59.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:27:59.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:27:59.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:27:59.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:59.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:27:59.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:27:59.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:27:59.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:27:59.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:27:59.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:27:59.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:59.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:27:59.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:27:59.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:27:59.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:27:59.981 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.981 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.981 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.981 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.981 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:59.981 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637635735999993, 2024-04-26T12:27:59.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:27:59.981 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.981 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.982 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:59.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:27:59.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:27:59.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:27:59.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:27:59.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:27:59.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:27:59.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:27:59.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:27:59.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:27:59.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:27:59.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:27:59.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:27:59.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:27:59.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:27:59.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:27:59.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:27:59.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:27:59.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:27:59.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:59.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:27:59.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:27:59.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:27:59.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:27:59.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:27:59.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:27:59.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:27:59.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:27:59.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:27:59.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:27:59.987 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.987 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.987 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.987 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.987 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:59.987 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637493988000003, 2024-04-26T12:27:59.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:27:59.988 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.988 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.988 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:59.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:27:59.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:27:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:27:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:27:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:27:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:27:59.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:27:59.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:27:59.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:27:59.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:27:59.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:27:59.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:27:59.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:27:59.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:27:59.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:27:59.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:27:59.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:27:59.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:27:59.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:27:59.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:27:59.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:27:59.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:27:59.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:27:59.993 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.993 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.993 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.993 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.993 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:59.994 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637469968999994, 2024-04-26T12:27:59.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:27:59.994 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:27:59.994 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:27:59.994 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:27:59.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:27:59.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:59.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:27:59.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:27:59.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:27:59.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:27:59.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:27:59.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:27:59.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:27:59.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:27:59.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:27:59.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:27:59.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:27:59.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:27:59.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:27:59.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:27:59.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:27:59.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:27:59.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:27:59.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:27:59.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:27:59.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:27:59.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:27:59.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:27:59.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:27:59.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:27:59.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:27:59.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:27:59.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:27:59.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:27:59.999 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:00.000 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637446001000001, 2024-04-26T12:28:00.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:00.000 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:00.000 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:00.000 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:00.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:00.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:00.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:00.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:00.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:00.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:00.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:00.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:00.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:00.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:00.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:00.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:00.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:00.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:00.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:00.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:00.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:00.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:00.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:00.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:00.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:00.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:00.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:00.005 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:00.006 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 66.637412620000006, 2024-04-26T12:28:00.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:00.006 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:00.006 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:00.006 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:00.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:00.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:00.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:00.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:00.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:00.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:00.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:00.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:00.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:00.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:00.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:00.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:00.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:00.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:00.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:00.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:00.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:00.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:00.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:00.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:00.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:00.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:00.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:00.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:00.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:00.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:00.010 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:00.010 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:00.010 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:00.010 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:00.010 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:00.010 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:00.012 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:00.012 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:00.011+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:00.064 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:28:00.112 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:00.111+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:00.142 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:00.142 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:00.142 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:00.143 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:00.152 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:00.213 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:00.213+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:00.243 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:00.265 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:00.269 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:00.269 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:00.314 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:00.312+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:00.319 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:00.320 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:00.330 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:00.415 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:00.414+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:00.497 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:00.498 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:00.508 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:00.552 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:00.551+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:00.617 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:00.616+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:00.644 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:00.644 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:00.654 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:00.710 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2024-04-26T12:28:00.718 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:00.717+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:00.819 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:00.818+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:00.821 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:00.821 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:00.830 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:00.920 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:00.919+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:00.957 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:00.957 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:00.967 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:01.021 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:01.020+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:01.098 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:01.098 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:01.107 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:01.122 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:01.121+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:01.223 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:01.222+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:01.233 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:01.233 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:01.244 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:01.323 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:01.323+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:01.369 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:01.369 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:01.380 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:01.424 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:01.423+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:01.508 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:01.508 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:01.518 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:01.559 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:01.558+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:01.626 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:01.626+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:01.684 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:01.684 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:01.694 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:01.727 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:01.726+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:01.820 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:01.820 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:01.828 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:01.827+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:01.830 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:01.929 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:01.929+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:01.958 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:01.958 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:01.969 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:02.030 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:02.029+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:02.095 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:02.095 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:02.106 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:02.149 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:02.148+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:02.232 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:02.232 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:02.232 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:02.230+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:02.242 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:02.270 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:28:02.333 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:02.332+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:02.369 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:02.370 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:02.379 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:02.432 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:02.432 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:02.432+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:02.460 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:02.460 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:02.460 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:02.460 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:02.462 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:02.463 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:02.505 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:02.505 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:02.505 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:02.505 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:02.505 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:02.515 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:02.534 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:02.533+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:02.635 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:02.634+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:02.644 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:28:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.311203520999996, 2024-04-26T12:28:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:28:02.644 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:28:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:28:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:28:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:28:02.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:28:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:28:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:28:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:28:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:28:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:28:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:28:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:28:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:28:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:28:02.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:28:02.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:28:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:28:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:28:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.650 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.392337698000006, 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:02.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:02.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:02.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:02.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:02.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:02.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:02.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:02.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:02.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:02.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:02.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:02.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:02.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:02.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:02.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:02.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:02.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:02.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:02.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:02.656 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.656 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.656 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.656 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.392301485999994, 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:02.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:02.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:02.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:02.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:02.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:02.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:02.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:02.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:02.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:02.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:02.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:02.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:02.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:02.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:02.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:02.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:02.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:02.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:02.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:02.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:02.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:02.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:02.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:02.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:02.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:02.663 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.663 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.664 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.664 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.664 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:02.664 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.392262512000002, 2024-04-26T12:28:02.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:02.664 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.664 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.664 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:02.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:02.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:02.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:02.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:02.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:02.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:02.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:02.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:02.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:02.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:02.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:02.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:02.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:02.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:02.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:02.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:02.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:02.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:02.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:02.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:02.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:02.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:02.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:02.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:02.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:02.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:02.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:02.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:02.670 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.670 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.670 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.392239344999993, 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:02.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:02.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:02.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:02.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.676 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.392223967999996, 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:02.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:02.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:02.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:02.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:02.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:02.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:02.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:02.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:02.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:02.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:02.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:02.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:02.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:02.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:02.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:02.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:02.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:02.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:02.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:02.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:02.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:02.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.684 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.684 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.684 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.684 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:02.684 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.392195778000001, 2024-04-26T12:28:02.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:02.684 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.684 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.684 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:02.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:02.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:02.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:02.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:02.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:02.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:02.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:02.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:02.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:02.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:02.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:02.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:02.690 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.690 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.690 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.690 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.690 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:02.690 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.392177779999997, 2024-04-26T12:28:02.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:02.691 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.691 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.691 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:02.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:02.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:02.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:02.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:02.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:02.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:02.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:02.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:02.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:02.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:02.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:02.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:02.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:02.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:02.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:02.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:02.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:02.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:02.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:02.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.696 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:02.697 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.392153188999998, 2024-04-26T12:28:02.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:02.697 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.697 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.697 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:02.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:02.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:02.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:02.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:02.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:02.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:02.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:02.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:02.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:02.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:02.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:02.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:02.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:02.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:02.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:02.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:02.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:02.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:02.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:02.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:02.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:02.702 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.702 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.702 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.703 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.703 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:02.703 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.392128240000005, 2024-04-26T12:28:02.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:02.703 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.703 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.703 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:02.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:02.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:02.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:02.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:02.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:02.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:02.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:02.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:02.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:02.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:02.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:02.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:02.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:02.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:02.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:02.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:02.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:02.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:02.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:02.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:02.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:02.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:02.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:02.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:02.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:02.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:02.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:02.709 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.709 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.709 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.709 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.709 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:02.709 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.392107315999993, 2024-04-26T12:28:02.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:02.709 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.709 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.709 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:02.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:02.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:02.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:02.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:02.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:02.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:02.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:02.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:02.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:02.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:02.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:02.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:02.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:02.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:02.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:02.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:02.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:02.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:02.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:02.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:02.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:02.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:02.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:02.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:02.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:02.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:02.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:02.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:02.715 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.715 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.715 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.715 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.715 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:02.715 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.392072467000006, 2024-04-26T12:28:02.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:02.715 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.715 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.715 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:02.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:02.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:02.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:02.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:02.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:02.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:02.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:02.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:02.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:02.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:02.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:02.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:02.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:02.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:02.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:02.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:02.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:02.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:02.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:02.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:02.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:02.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:02.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:02.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:02.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:02.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:02.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:02.721 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.721 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.721 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.721 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.721 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:02.721 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.392038517000003, 2024-04-26T12:28:02.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:02.721 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.722 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.722 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:02.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:02.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:02.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:02.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:02.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:02.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:02.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:02.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:02.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:02.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:02.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:02.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:02.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:02.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:02.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:02.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:02.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:02.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:02.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:02.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:02.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:02.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:02.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:02.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:02.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:02.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:02.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:02.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:02.727 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.727 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.727 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.728 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.728 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:02.728 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.392018219999997, 2024-04-26T12:28:02.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:02.728 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.728 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.728 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:02.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:02.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:02.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:02.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:02.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:02.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:02.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:02.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:02.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:02.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:02.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:02.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:02.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:02.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:02.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:02.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:02.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:02.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:02.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:02.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:02.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:02.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:02.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:02.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:02.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:02.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:02.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:02.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:02.734 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.734 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.734 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.734 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.734 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:02.734 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.391983099000001, 2024-04-26T12:28:02.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:02.735 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.735 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.735 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:02.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:02.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:02.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:02.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:02.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:02.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:02.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:02.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:02.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:02.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:02.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:02.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:02.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:02.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:02.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:02.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:02.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:02.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:02.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:02.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:02.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:02.740 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.740 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.740 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.740 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.740 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:02.741 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.391947858999998, 2024-04-26T12:28:02.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:02.741 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.741 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.741 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:02.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:02.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:02.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:02.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:02.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:02.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:02.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:02.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:02.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:02.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:02.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:02.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:02.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:02.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:02.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:02.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:02.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:02.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:02.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:02.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:02.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:02.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:02.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:02.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:02.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:02.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:02.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:02.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:02.746 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.746 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.746 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.747 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.747 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:02.747 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.391806110999994, 2024-04-26T12:28:02.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:02.747 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.747 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.747 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:02.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:02.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:02.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:02.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:02.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:02.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:02.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:02.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:02.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:02.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:02.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:02.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:02.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:02.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:02.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:02.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:02.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:02.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:02.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:02.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:02.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:02.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:02.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:02.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:02.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.752 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.391782092, 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:02.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:02.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:02.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:02.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:02.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:02.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:02.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:02.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:02.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:02.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:02.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:02.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:02.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:02.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:02.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:02.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:02.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:02.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:02.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:02.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:02.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:02.758 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.759 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.759 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.759 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.759 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:02.759 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.391758124000006, 2024-04-26T12:28:02.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:02.759 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.759 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:02.759 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:02.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:02.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:02.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:02.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:02.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:02.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:02.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:02.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:02.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:02.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:02.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:02.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:02.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:02.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:02.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:02.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:02.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:02.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:02.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:02.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:02.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:02.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:02.765 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.765 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.765 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.765 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:02.765 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:02.765 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.391724742999997, 2024-04-26T12:28:02.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:02.765 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:02.765 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:02.766 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:02.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:02.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:02.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:02.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:02.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:02.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:02.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:02.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:02.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:02.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:02.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:02.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:02.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:02.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:02.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:02.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:02.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:02.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:02.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:02.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:02.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:02.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:02.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:02.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:02.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:02.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:02.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:02.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:02.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:02.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:02.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:02.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:02.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:02.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.770 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.770 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.770 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:02.770 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:02.770 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:02.770 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:28:02.772 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:02.772 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:02.770+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:02.872 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:02.871+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:02.902 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:02.903 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:02.903 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:02.903 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:02.914 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:02.973 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:02.973+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:03.042 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:03.042 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:03.042 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:03.042 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:03.042 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:03.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:03.094 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:03.094+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:03.175 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:03.174+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:03.179 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:03.179 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:03.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:03.179 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:03.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.180 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:28:03.180 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:03.180 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.295855709999998, 2024-04-26T12:28:03.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:28:03.180 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.180 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.180 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:03.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:03.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:03.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:28:03.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:28:03.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:28:03.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:28:03.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:28:03.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:28:03.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:28:03.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:28:03.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:28:03.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:28:03.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:28:03.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:28:03.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:28:03.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.295216362999994, 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:03.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:03.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:28:03.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:28:03.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:28:03.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:28:03.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:28:03.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:28:03.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:28:03.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:28:03.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:28:03.188 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.188 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.188 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.188 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:28:03.188 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:03.188 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.165514173000005, 2024-04-26T12:28:03.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:28:03.188 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.188 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:28:03.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:03.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:28:03.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:28:03.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:28:03.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:28:03.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:28:03.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:28:03.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:28:03.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:28:03.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:28:03.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:28:03.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:03.192 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.165019587000003, 2024-04-26T12:28:03.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:28:03.193 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.193 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.193 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:03.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:03.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:03.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:28:03.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:28:03.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:28:03.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:28:03.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:28:03.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:28:03.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:28:03.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:28:03.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:28:03.196 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.196 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.196 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.163017402999998, 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:03.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:28:03.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:28:03.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:28:03.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:28:03.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:28:03.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:28:03.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:28:03.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:28:03.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:28:03.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.162611063, 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:03.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:03.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:28:03.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:28:03.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:28:03.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:28:03.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:28:03.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:28:03.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:28:03.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:28:03.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:28:03.205 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.205 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.205 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.205 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:28:03.205 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:03.205 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.162256239000001, 2024-04-26T12:28:03.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:28:03.205 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.205 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.205 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:03.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:03.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:28:03.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:28:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:28:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:28:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:28:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:28:03.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:03.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:28:03.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:28:03.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:28:03.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:28:03.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:03.209 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.059697825000001, 2024-04-26T12:28:03.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:28:03.210 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.210 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.210 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:03.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:03.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:28:03.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:28:03.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:03.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:28:03.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:28:03.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:28:03.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.214 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:28:03.214 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:03.214 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.059301297000005, 2024-04-26T12:28:03.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:28:03.214 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.214 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.214 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:03.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:28:03.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:28:03.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:28:03.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:28:03.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:28:03.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:28:03.217 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.217 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.218 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.218 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:28:03.218 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:03.218 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.962291688999997, 2024-04-26T12:28:03.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:28:03.218 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.218 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.218 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:28:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:28:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:28:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:28:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:28:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:28:03.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:28:03.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:28:03.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:28:03.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:28:03.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:28:03.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:28:03.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:28:03.222 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.222 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.222 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.222 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:28:03.222 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:03.222 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.961597972999996, 2024-04-26T12:28:03.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:28:03.222 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.222 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.223 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:03.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:03.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:28:03.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:28:03.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:28:03.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:28:03.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:28:03.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:28:03.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:28:03.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:28:03.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:28:03.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:28:03.226 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.226 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.226 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.226 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.227 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:03.227 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.926858917999994, 2024-04-26T12:28:03.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:03.227 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.227 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.227 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:03.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:03.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:03.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:03.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:03.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:03.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:03.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:03.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:03.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:03.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:03.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:03.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:03.231 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.232 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.232 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.232 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.232 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:03.232 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.926037999000002, 2024-04-26T12:28:03.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:03.233 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.233 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.233 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:03.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:03.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:03.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:03.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:03.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:03.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:03.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:03.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:03.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:03.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:03.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:03.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:03.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:03.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:03.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:03.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:03.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:03.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:03.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:03.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:03.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:03.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:03.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:03.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:03.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:03.238 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.238 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.239 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.239 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.239 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:03.239 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.926007909000006, 2024-04-26T12:28:03.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:03.239 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.239 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.239 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:03.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:03.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:03.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:03.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:03.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:03.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:03.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:03.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:03.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:03.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:03.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:03.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:03.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:03.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:03.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:03.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:03.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:03.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:03.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:03.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:03.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:03.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:03.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:03.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:03.245 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.245 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.245 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.245 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.245 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:03.245 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.925954121000004, 2024-04-26T12:28:03.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:03.246 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.246 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.246 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:03.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:03.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:03.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:03.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:03.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:03.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:03.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:03.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:03.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:03.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:03.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:03.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:03.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:03.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:03.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:03.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:03.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:03.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:03.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:03.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:03.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:03.252 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.252 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.252 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.252 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.252 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:03.252 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.925901564, 2024-04-26T12:28:03.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:03.252 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.252 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.252 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:03.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:03.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:03.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:03.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:03.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:03.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:03.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:03.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:03.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:03.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:03.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:03.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:03.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:03.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:03.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:03.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:03.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:03.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:03.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:03.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:03.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:03.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:03.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:03.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:03.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:03.257 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.257 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.257 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.258 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.258 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:03.258 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.925861350000005, 2024-04-26T12:28:03.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:03.258 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.258 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.258 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:03.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:03.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:03.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:03.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:03.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:03.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:03.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:03.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:03.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:03.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:03.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:03.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:03.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:03.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:03.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:03.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:03.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:03.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:03.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:03.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:03.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:03.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:03.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:03.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:03.263 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.263 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.263 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.264 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.264 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:03.264 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.925833189000002, 2024-04-26T12:28:03.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:03.264 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.264 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.264 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:03.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:03.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:03.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:03.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:03.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:03.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:03.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:03.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:03.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:03.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:03.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:03.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:03.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:03.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:03.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:03.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:03.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:03.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:03.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:03.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:03.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:03.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:03.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:03.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:03.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:03.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:03.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.269 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.269 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.269 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:03.270 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.925802500000003, 2024-04-26T12:28:03.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:03.270 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.270 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:03.270 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:03.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:03.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:03.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:03.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:03.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:03.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:03.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:03.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:03.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:03.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:03.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:03.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:03.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:03.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:03.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:03.273 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.273 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.273 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.274 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.274 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:03.274 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.925775927000004, 2024-04-26T12:28:03.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:03.274 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:03.274 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:03.274 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:03.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:03.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:03.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:03.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:03.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:03.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:03.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:03.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:03.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:03.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:03.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:03.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:03.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:03.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:03.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:03.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:03.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:03.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:03.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:03.277 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.277 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.278 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.278 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:03.278 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:03.278 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:03.279 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:03.278+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:03.280 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:03.380 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:03.380+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:03.417 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:03.417 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:03.417 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:03.417 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:03.428 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:03.482 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:03.480+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:03.554 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:03.554 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:03.554 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:03.554 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:03.554 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:03.563 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:03.582 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:03.582+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:03.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2024-04-26T12:28:03.684 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:03.683+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:03.714 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2024-04-26T12:28:03.734 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:03.734 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:28:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 76.401515732000007, 2024-04-26T12:28:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:28:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:28:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:28:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:28:03.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:03.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:28:03.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:28:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:28:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:28:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:28:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:28:03.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:28:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:28:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:28:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:28:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:28:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:28:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:28:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:28:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:28:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:03.740 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482649909000003, 2024-04-26T12:28:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:03.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:03.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482613697000005, 2024-04-26T12:28:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.747 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:03.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:03.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:03.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482574722999999, 2024-04-26T12:28:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:03.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482551556000004, 2024-04-26T12:28:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.760 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:03.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:03.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.766 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482536178999993, 2024-04-26T12:28:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:03.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:03.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:03.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:03.773 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482507988999998, 2024-04-26T12:28:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:03.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:03.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:03.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:03.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:03.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482489990999994, 2024-04-26T12:28:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:03.780 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:03.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:03.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.786 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482465399999995, 2024-04-26T12:28:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:03.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:03.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:03.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:03.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:03.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:03.792 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.793 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.793 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.793 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.793 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:03.793 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482440451000002, 2024-04-26T12:28:03.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:03.793 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.793 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.793 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:03.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:03.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:03.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:03.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:03.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:03.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:03.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:03.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:03.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:03.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:03.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:03.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:03.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:03.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:03.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:03.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:03.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:03.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:03.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:03.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:03.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:03.799 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.799 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.799 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.799 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.799 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:03.799 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482419527000005, 2024-04-26T12:28:03.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:03.799 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.800 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.800 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:03.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:03.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:03.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:03.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:03.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:03.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:03.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:03.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:03.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:03.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:03.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:03.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:03.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:03.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:03.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:03.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:03.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:03.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:03.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:03.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:03.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:03.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:03.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:03.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:03.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:03.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:03.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:03.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:03.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.806 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.806 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.806 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.806 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:03.806 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482384678000003, 2024-04-26T12:28:03.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:03.806 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.806 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.806 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:03.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:03.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:03.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:03.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:03.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:03.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:03.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:03.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:03.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:03.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:03.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:03.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:03.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:03.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:03.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:03.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:03.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:03.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:03.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:03.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:03.812 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.812 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.812 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.812 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.812 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:03.812 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482350728, 2024-04-26T12:28:03.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:03.812 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.812 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.812 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:03.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:03.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:03.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:03.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:03.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:03.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:03.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:03.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:03.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:03.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:03.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:03.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:03.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:03.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:03.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:03.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:03.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:03.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:03.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:03.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:03.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:03.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:03.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:03.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:03.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.819 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.819 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:03.819 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482330430999994, 2024-04-26T12:28:03.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:03.819 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.819 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.819 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:03.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:03.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:03.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:03.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:03.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:03.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:03.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:03.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:03.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:03.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:03.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:03.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:03.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:03.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:03.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:03.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:03.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:03.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:03.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:03.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:03.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:03.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:03.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:03.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:03.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:03.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:03.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:03.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:03.824 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482295309999998, 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:03.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:03.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:03.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:03.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:03.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:03.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:03.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:03.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:03.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:03.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:03.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:03.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:03.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:03.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:03.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:03.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:03.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:03.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:03.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:03.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:03.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:03.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:03.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:03.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:03.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:03.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:03.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:03.831 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.831 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.831 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.831 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.831 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:03.831 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482260069999995, 2024-04-26T12:28:03.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:03.831 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.831 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.832 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:03.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:03.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:03.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:03.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:03.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:03.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:03.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:03.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:03.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:03.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:03.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:03.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:03.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:03.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:03.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:03.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:03.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:03.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:03.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:03.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:03.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:03.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:03.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:03.837 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.837 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.837 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.837 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.837 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:03.837 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482118322000005, 2024-04-26T12:28:03.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:03.837 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.838 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.838 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:03.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:03.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:03.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:03.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:03.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:03.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:03.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:03.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:03.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:03.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:03.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:03.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:03.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:03.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:03.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:03.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:03.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:03.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:03.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:03.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:03.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:03.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:03.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:03.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:03.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:03.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:03.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:03.844 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.844 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.844 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.844 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.844 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:03.844 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482094302999997, 2024-04-26T12:28:03.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:03.845 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.845 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.845 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:03.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:03.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:03.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:03.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:03.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:03.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:03.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:03.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:03.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:03.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:03.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:03.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:03.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:03.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:03.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:03.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:03.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:03.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:03.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:03.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:03.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:03.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:03.850 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.850 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.850 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.850 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.850 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:03.850 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482070335000003, 2024-04-26T12:28:03.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:03.851 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.851 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:03.851 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:03.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:03.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:03.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:03.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:03.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:03.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:03.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:03.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:03.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:03.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:03.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:03.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:03.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:03.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:03.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:03.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:03.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:03.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:03.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:03.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:03.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:03.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:03.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:03.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:03.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:03.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:03.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:03.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:03.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:03.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:03.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:03.856 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.856 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.856 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.857 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:03.857 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:03.857 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.482036953999994, 2024-04-26T12:28:03.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:03.857 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:03.857 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:03.857 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:03.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:03.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:03.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:03.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:03.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:03.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:03.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:03.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:03.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:03.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:03.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:03.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:03.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:03.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:03.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:03.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:03.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:03.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:03.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:03.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:03.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:03.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:03.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:03.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:03.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:03.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:03.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:03.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:03.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:03.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:03.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:03.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:03.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:03.861 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.861 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.861 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.861 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:03.861 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:03.861 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:03.863 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:03.863 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:03.862+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:03.964 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:03.963+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:04.003 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:04.003 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:04.003 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:04.003 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:04.013 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:04.065 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:04.064+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:04.140 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:04.140 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:04.140 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:04.140 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:04.140 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:04.150 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:04.191 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:04.190+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:04.267 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:04.267+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:04.318 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:04.318 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:28:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.434453715000004, 2024-04-26T12:28:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:28:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:28:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:28:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:28:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:28:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:28:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:28:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:28:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:28:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:28:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:28:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:28:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:28:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:28:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:28:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.433814368, 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:28:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:28:04.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:28:04.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:28:04.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:28:04.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:28:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:28:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:28:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:28:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:28:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:28:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:28:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:28:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:28:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:28:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:28:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.304112177999997, 2024-04-26T12:28:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:28:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:28:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:04.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:28:04.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:28:04.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:28:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:28:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:28:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:28:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:28:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:28:04.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:28:04.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:28:04.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:28:04.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:28:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:28:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:28:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:28:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.303617591999995, 2024-04-26T12:28:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:28:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:28:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:28:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:28:04.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:28:04.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:28:04.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:28:04.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:28:04.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:28:04.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:28:04.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:28:04.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:28:04.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:28:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:28:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:28:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:28:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.301615408000004, 2024-04-26T12:28:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:28:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:28:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:28:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:28:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:28:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:28:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:28:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:28:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:28:04.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:28:04.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:28:04.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:28:04.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:28:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:28:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:28:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:28:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.301209068000006, 2024-04-26T12:28:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:28:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:04.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:28:04.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:04.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:28:04.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:28:04.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:28:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:28:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:28:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:28:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:28:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:28:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:28:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:28:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:28:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:28:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:28:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:28:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:28:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.300854244000007, 2024-04-26T12:28:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:28:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:28:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:28:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:28:04.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:28:04.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:28:04.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:28:04.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:04.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:28:04.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:28:04.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:28:04.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:28:04.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:28:04.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:28:04.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:28:04.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:28:04.356 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.356 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.356 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:28:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.198295830000006, 2024-04-26T12:28:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:28:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:28:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:28:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:28:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:28:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:28:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:28:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:28:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:28:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:28:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:28:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.197899301999996, 2024-04-26T12:28:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:28:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.362 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:04.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:04.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:28:04.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:04.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:28:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:28:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:28:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:28:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:28:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:28:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:28:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:28:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:28:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:28:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:28:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:28:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:28:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:28:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:28:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.100889694000003, 2024-04-26T12:28:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:28:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:28:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:28:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:28:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:28:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:28:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:28:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:28:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:28:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:28:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:28:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:28:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:28:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:28:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:28:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.100195978000002, 2024-04-26T12:28:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:28:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:28:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:28:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:28:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:28:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:28:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:28:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:28:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:28:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:28:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:28:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.065456922999999, 2024-04-26T12:28:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.064636003999993, 2024-04-26T12:28:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.064605913999998, 2024-04-26T12:28:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:04.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:04.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:04.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:04.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:04.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:04.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:04.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:04.397 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.397 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.397 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.398 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:04.398 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:04.398 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.064552125999995, 2024-04-26T12:28:04.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:04.399 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.399 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.399 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:04.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:04.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.064499569000006, 2024-04-26T12:28:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.064459354999997, 2024-04-26T12:28:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.064431193999994, 2024-04-26T12:28:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.064400504999995, 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 71.064373931999995, 2024-04-26T12:28:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:04.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:04.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:04.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.433 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:04.433 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:04.433 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:04.435 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:04.434+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:04.435 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:04.464 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:28:04.536 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:04.535+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:04.570 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:04.571 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:04.571 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:04.571 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:04.580 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:04.633 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:04.637 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:04.636+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:04.668 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:04.668 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:04.668 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:04.668 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:04.671 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:04.671 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:04.708 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:04.708 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:04.717 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T12:28:04.717 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:28:04.717 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T12:28:04.717 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T12:28:04.719 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:04.738 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:04.737+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:04.839 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:04.838+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:04.845 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:04.845 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:04.855 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:04.940 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:04.939+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:04.984 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:04.985 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:04.994 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:05.041 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:05.040+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:05.120 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:05.120 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:05.131 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:05.142 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:05.141+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:05.243 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:05.242+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:05.257 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:05.258 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:05.268 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:05.336 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:28:05.337 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-04-26T12:28:05.337 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 37, 2024-04-26T12:28:05.337 INFO:teuthology.orchestra.run.smithi046.stdout: "fsid": "3dd84416-f290-4721-94ce-52b0ffaacf34", 2024-04-26T12:28:05.337 INFO:teuthology.orchestra.run.smithi046.stdout: "created": "2024-04-26T12:26:36.091476+0000", 2024-04-26T12:28:05.337 INFO:teuthology.orchestra.run.smithi046.stdout: "modified": "2024-04-26T12:28:03.703042+0000", 2024-04-26T12:28:05.337 INFO:teuthology.orchestra.run.smithi046.stdout: "last_up_change": "2024-04-26T12:27:47.657403+0000", 2024-04-26T12:28:05.337 INFO:teuthology.orchestra.run.smithi046.stdout: "last_in_change": "2024-04-26T12:26:37.993949+0000", 2024-04-26T12:28:05.337 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T12:28:05.337 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_num": 5806080, 2024-04-26T12:28:05.337 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_set": [ 2024-04-26T12:28:05.337 INFO:teuthology.orchestra.run.smithi046.stdout: "nodeep-scrub", 2024-04-26T12:28:05.337 INFO:teuthology.orchestra.run.smithi046.stdout: "noscrub", 2024-04-26T12:28:05.338 INFO:teuthology.orchestra.run.smithi046.stdout: "pglog_hardlimit", 2024-04-26T12:28:05.338 INFO:teuthology.orchestra.run.smithi046.stdout: "purged_snapdirs", 2024-04-26T12:28:05.338 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_deletes", 2024-04-26T12:28:05.338 INFO:teuthology.orchestra.run.smithi046.stdout: "sortbitwise" 2024-04-26T12:28:05.338 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-04-26T12:28:05.338 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_version": 4, 2024-04-26T12:28:05.338 INFO:teuthology.orchestra.run.smithi046.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T12:28:05.338 INFO:teuthology.orchestra.run.smithi046.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T12:28:05.338 INFO:teuthology.orchestra.run.smithi046.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T12:28:05.338 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_snapshot": "", 2024-04-26T12:28:05.338 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_max": 4, 2024-04-26T12:28:05.338 INFO:teuthology.orchestra.run.smithi046.stdout: "max_osd": 3, 2024-04-26T12:28:05.338 INFO:teuthology.orchestra.run.smithi046.stdout: "require_min_compat_client": "luminous", 2024-04-26T12:28:05.339 INFO:teuthology.orchestra.run.smithi046.stdout: "min_compat_client": "luminous", 2024-04-26T12:28:05.339 INFO:teuthology.orchestra.run.smithi046.stdout: "require_osd_release": "reef", 2024-04-26T12:28:05.339 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_crimson": false, 2024-04-26T12:28:05.339 INFO:teuthology.orchestra.run.smithi046.stdout: "pools": [ 2024-04-26T12:28:05.339 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.339 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 1, 2024-04-26T12:28:05.339 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": ".mgr", 2024-04-26T12:28:05.339 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2024-04-26T12:26:45.341269+0000", 2024-04-26T12:28:05.339 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-04-26T12:28:05.340 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2024-04-26T12:28:05.340 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2024-04-26T12:28:05.340 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2024-04-26T12:28:05.340 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2024-04-26T12:28:05.340 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2024-04-26T12:28:05.340 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:28:05.340 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:28:05.340 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:28:05.340 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:28:05.340 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2024-04-26T12:28:05.340 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:28:05.340 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 1, 2024-04-26T12:28:05.340 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 1, 2024-04-26T12:28:05.340 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 1, 2024-04-26T12:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 1, 2024-04-26T12:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 1, 2024-04-26T12:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2024-04-26T12:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2024-04-26T12:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2024-04-26T12:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2024-04-26T12:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2024-04-26T12:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2024-04-26T12:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2024-04-26T12:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "11", 2024-04-26T12:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2024-04-26T12:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:28:05.341 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:28:05.342 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2024-04-26T12:28:05.342 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:28:05.342 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2024-04-26T12:28:05.342 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2024-04-26T12:28:05.342 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2024-04-26T12:28:05.342 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2024-04-26T12:28:05.342 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2024-04-26T12:28:05.342 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2024-04-26T12:28:05.342 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2024-04-26T12:28:05.342 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2024-04-26T12:28:05.342 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2024-04-26T12:28:05.342 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2024-04-26T12:28:05.342 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2024-04-26T12:28:05.343 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2024-04-26T12:28:05.343 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2024-04-26T12:28:05.343 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:28:05.343 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:28:05.343 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:28:05.343 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2024-04-26T12:28:05.343 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2024-04-26T12:28:05.343 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2024-04-26T12:28:05.343 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2024-04-26T12:28:05.343 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2024-04-26T12:28:05.343 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.343 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2024-04-26T12:28:05.343 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2024-04-26T12:28:05.343 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2024-04-26T12:28:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:28:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:28:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:28:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:28:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2024-04-26T12:28:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2024-04-26T12:28:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2024-04-26T12:28:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2024-04-26T12:28:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: "options": { 2024-04-26T12:28:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_max": 32, 2024-04-26T12:28:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_min": 1 2024-04-26T12:28:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2024-04-26T12:28:05.344 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": {} 2024-04-26T12:28:05.345 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.345 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2024-04-26T12:28:05.345 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 2.9900000095367432, 2024-04-26T12:28:05.345 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 2.9900000095367432, 2024-04-26T12:28:05.345 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:28:05.345 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 2, 2024-04-26T12:28:05.345 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 2, 2024-04-26T12:28:05.345 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 0.85364794731140137, 2024-04-26T12:28:05.345 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 0.85000002384185791, 2024-04-26T12:28:05.345 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-04-26T12:28:05.345 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.345 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.345 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.346 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 2, 2024-04-26T12:28:05.346 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": "rbd", 2024-04-26T12:28:05.346 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2024-04-26T12:26:45.839095+0000", 2024-04-26T12:28:05.346 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-04-26T12:28:05.346 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2024-04-26T12:28:05.346 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2024-04-26T12:28:05.346 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2024-04-26T12:28:05.346 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2024-04-26T12:28:05.346 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2024-04-26T12:28:05.346 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:28:05.346 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:28:05.346 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:28:05.346 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:28:05.346 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2024-04-26T12:28:05.347 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:28:05.347 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 8, 2024-04-26T12:28:05.347 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 8, 2024-04-26T12:28:05.347 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 8, 2024-04-26T12:28:05.347 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 8, 2024-04-26T12:28:05.347 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 8, 2024-04-26T12:28:05.347 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2024-04-26T12:28:05.347 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2024-04-26T12:28:05.347 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2024-04-26T12:28:05.347 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2024-04-26T12:28:05.347 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2024-04-26T12:28:05.347 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2024-04-26T12:28:05.347 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2024-04-26T12:28:05.347 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.348 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "12", 2024-04-26T12:28:05.348 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2024-04-26T12:28:05.348 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:28:05.348 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:28:05.348 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2024-04-26T12:28:05.348 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:28:05.348 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2024-04-26T12:28:05.348 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2024-04-26T12:28:05.348 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2024-04-26T12:28:05.348 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2024-04-26T12:28:05.348 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2024-04-26T12:28:05.348 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2024-04-26T12:28:05.349 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2024-04-26T12:28:05.349 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2024-04-26T12:28:05.349 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2024-04-26T12:28:05.349 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2024-04-26T12:28:05.349 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2024-04-26T12:28:05.349 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2024-04-26T12:28:05.349 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2024-04-26T12:28:05.349 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:28:05.349 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:28:05.350 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:28:05.350 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2024-04-26T12:28:05.350 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2024-04-26T12:28:05.350 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2024-04-26T12:28:05.350 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2024-04-26T12:28:05.350 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2024-04-26T12:28:05.350 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.350 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2024-04-26T12:28:05.350 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2024-04-26T12:28:05.350 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2024-04-26T12:28:05.350 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:28:05.350 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:28:05.350 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:28:05.351 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:28:05.351 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2024-04-26T12:28:05.351 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2024-04-26T12:28:05.351 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2024-04-26T12:28:05.351 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2024-04-26T12:28:05.351 INFO:teuthology.orchestra.run.smithi046.stdout: "options": {}, 2024-04-26T12:28:05.351 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2024-04-26T12:28:05.351 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd": {} 2024-04-26T12:28:05.351 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.351 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2024-04-26T12:28:05.352 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 1.4900000095367432, 2024-04-26T12:28:05.352 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 1.4900000095367432, 2024-04-26T12:28:05.352 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:28:05.352 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 1, 2024-04-26T12:28:05.352 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 1, 2024-04-26T12:28:05.353 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 0.85364794731140137, 2024-04-26T12:28:05.353 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 0.85000002384185791, 2024-04-26T12:28:05.353 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-04-26T12:28:05.353 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.353 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.353 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.353 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 3, 2024-04-26T12:28:05.353 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": "cephfs_metadata", 2024-04-26T12:28:05.353 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2024-04-26T12:26:51.091400+0000", 2024-04-26T12:28:05.353 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-04-26T12:28:05.353 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2024-04-26T12:28:05.354 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2024-04-26T12:28:05.354 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2024-04-26T12:28:05.354 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2024-04-26T12:28:05.354 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2024-04-26T12:28:05.354 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:28:05.354 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:28:05.354 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:28:05.354 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:28:05.354 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2024-04-26T12:28:05.354 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:28:05.354 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 32, 2024-04-26T12:28:05.354 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 32, 2024-04-26T12:28:05.354 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 32, 2024-04-26T12:28:05.354 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 32, 2024-04-26T12:28:05.355 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 32, 2024-04-26T12:28:05.355 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2024-04-26T12:28:05.355 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2024-04-26T12:28:05.355 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2024-04-26T12:28:05.355 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2024-04-26T12:28:05.355 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2024-04-26T12:28:05.355 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2024-04-26T12:28:05.355 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2024-04-26T12:28:05.355 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.355 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "15", 2024-04-26T12:28:05.355 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2024-04-26T12:28:05.355 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:28:05.355 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:28:05.356 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2024-04-26T12:28:05.356 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:28:05.356 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2024-04-26T12:28:05.356 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2024-04-26T12:28:05.356 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2024-04-26T12:28:05.356 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2024-04-26T12:28:05.356 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2024-04-26T12:28:05.356 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2024-04-26T12:28:05.357 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2024-04-26T12:28:05.357 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2024-04-26T12:28:05.357 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2024-04-26T12:28:05.357 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2024-04-26T12:28:05.357 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2024-04-26T12:28:05.357 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2024-04-26T12:28:05.357 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2024-04-26T12:28:05.358 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:28:05.358 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:28:05.358 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:28:05.358 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2024-04-26T12:28:05.358 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2024-04-26T12:28:05.358 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2024-04-26T12:28:05.358 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2024-04-26T12:28:05.358 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2024-04-26T12:28:05.358 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.358 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2024-04-26T12:28:05.358 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2024-04-26T12:28:05.358 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2024-04-26T12:28:05.359 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:28:05.359 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:28:05.359 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:28:05.359 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:28:05.359 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2024-04-26T12:28:05.359 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2024-04-26T12:28:05.359 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2024-04-26T12:28:05.359 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2024-04-26T12:28:05.359 INFO:teuthology.orchestra.run.smithi046.stdout: "options": { 2024-04-26T12:28:05.359 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_bias": 4, 2024-04-26T12:28:05.359 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_min": 16, 2024-04-26T12:28:05.359 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_priority": 5 2024-04-26T12:28:05.360 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.360 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2024-04-26T12:28:05.360 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs": { 2024-04-26T12:28:05.360 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": "cephfs" 2024-04-26T12:28:05.360 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.360 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.360 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2024-04-26T12:28:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 1.5800000429153442, 2024-04-26T12:28:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 1.5800000429153442, 2024-04-26T12:28:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:28:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 1.059999942779541, 2024-04-26T12:28:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 1.059999942779541, 2024-04-26T12:28:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 0.85364794731140137, 2024-04-26T12:28:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 0.85000002384185791, 2024-04-26T12:28:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-04-26T12:28:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: "pool": 4, 2024-04-26T12:28:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": "cephfs_data", 2024-04-26T12:28:05.361 INFO:teuthology.orchestra.run.smithi046.stdout: "create_time": "2024-04-26T12:26:52.222159+0000", 2024-04-26T12:28:05.362 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-04-26T12:28:05.362 INFO:teuthology.orchestra.run.smithi046.stdout: "flags_names": "hashpspool", 2024-04-26T12:28:05.362 INFO:teuthology.orchestra.run.smithi046.stdout: "type": 1, 2024-04-26T12:28:05.362 INFO:teuthology.orchestra.run.smithi046.stdout: "size": 2, 2024-04-26T12:28:05.362 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": 1, 2024-04-26T12:28:05.362 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_rule": 0, 2024-04-26T12:28:05.362 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_count": 0, 2024-04-26T12:28:05.362 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_target": 0, 2024-04-26T12:28:05.363 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T12:28:05.363 INFO:teuthology.orchestra.run.smithi046.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T12:28:05.363 INFO:teuthology.orchestra.run.smithi046.stdout: "object_hash": 2, 2024-04-26T12:28:05.363 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscale_mode": "off", 2024-04-26T12:28:05.363 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": 64, 2024-04-26T12:28:05.363 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num": 64, 2024-04-26T12:28:05.363 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_placement_num_target": 64, 2024-04-26T12:28:05.363 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_target": 64, 2024-04-26T12:28:05.363 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_pending": 64, 2024-04-26T12:28:05.363 INFO:teuthology.orchestra.run.smithi046.stdout: "last_pg_merge_meta": { 2024-04-26T12:28:05.363 INFO:teuthology.orchestra.run.smithi046.stdout: "source_pgid": "0.0", 2024-04-26T12:28:05.363 INFO:teuthology.orchestra.run.smithi046.stdout: "ready_epoch": 0, 2024-04-26T12:28:05.363 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_started": 0, 2024-04-26T12:28:05.364 INFO:teuthology.orchestra.run.smithi046.stdout: "last_epoch_clean": 0, 2024-04-26T12:28:05.364 INFO:teuthology.orchestra.run.smithi046.stdout: "source_version": "0'0", 2024-04-26T12:28:05.364 INFO:teuthology.orchestra.run.smithi046.stdout: "target_version": "0'0" 2024-04-26T12:28:05.364 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.364 INFO:teuthology.orchestra.run.smithi046.stdout: "last_change": "16", 2024-04-26T12:28:05.364 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend": "0", 2024-04-26T12:28:05.364 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T12:28:05.364 INFO:teuthology.orchestra.run.smithi046.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T12:28:05.364 INFO:teuthology.orchestra.run.smithi046.stdout: "auid": 0, 2024-04-26T12:28:05.364 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_mode": "selfmanaged", 2024-04-26T12:28:05.365 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_seq": 0, 2024-04-26T12:28:05.365 INFO:teuthology.orchestra.run.smithi046.stdout: "snap_epoch": 0, 2024-04-26T12:28:05.365 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_snaps": [], 2024-04-26T12:28:05.365 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps": "[]", 2024-04-26T12:28:05.365 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_bytes": 0, 2024-04-26T12:28:05.365 INFO:teuthology.orchestra.run.smithi046.stdout: "quota_max_objects": 0, 2024-04-26T12:28:05.365 INFO:teuthology.orchestra.run.smithi046.stdout: "tiers": [], 2024-04-26T12:28:05.365 INFO:teuthology.orchestra.run.smithi046.stdout: "tier_of": -1, 2024-04-26T12:28:05.365 INFO:teuthology.orchestra.run.smithi046.stdout: "read_tier": -1, 2024-04-26T12:28:05.365 INFO:teuthology.orchestra.run.smithi046.stdout: "write_tier": -1, 2024-04-26T12:28:05.365 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_mode": "none", 2024-04-26T12:28:05.366 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_bytes": 0, 2024-04-26T12:28:05.366 INFO:teuthology.orchestra.run.smithi046.stdout: "target_max_objects": 0, 2024-04-26T12:28:05.366 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T12:28:05.366 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T12:28:05.366 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T12:28:05.366 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_flush_age": 0, 2024-04-26T12:28:05.366 INFO:teuthology.orchestra.run.smithi046.stdout: "cache_min_evict_age": 0, 2024-04-26T12:28:05.366 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profile": "", 2024-04-26T12:28:05.366 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_params": { 2024-04-26T12:28:05.367 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "none" 2024-04-26T12:28:05.367 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.367 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_period": 0, 2024-04-26T12:28:05.367 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_count": 0, 2024-04-26T12:28:05.367 INFO:teuthology.orchestra.run.smithi046.stdout: "use_gmt_hitset": true, 2024-04-26T12:28:05.367 INFO:teuthology.orchestra.run.smithi046.stdout: "min_read_recency_for_promote": 0, 2024-04-26T12:28:05.368 INFO:teuthology.orchestra.run.smithi046.stdout: "min_write_recency_for_promote": 0, 2024-04-26T12:28:05.368 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T12:28:05.368 INFO:teuthology.orchestra.run.smithi046.stdout: "hit_set_search_last_n": 0, 2024-04-26T12:28:05.369 INFO:teuthology.orchestra.run.smithi046.stdout: "grade_table": [], 2024-04-26T12:28:05.369 INFO:teuthology.orchestra.run.smithi046.stdout: "stripe_width": 0, 2024-04-26T12:28:05.369 INFO:teuthology.orchestra.run.smithi046.stdout: "expected_num_objects": 0, 2024-04-26T12:28:05.369 INFO:teuthology.orchestra.run.smithi046.stdout: "fast_read": false, 2024-04-26T12:28:05.369 INFO:teuthology.orchestra.run.smithi046.stdout: "options": { 2024-04-26T12:28:05.369 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num_min": 64, 2024-04-26T12:28:05.369 INFO:teuthology.orchestra.run.smithi046.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T12:28:05.369 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.369 INFO:teuthology.orchestra.run.smithi046.stdout: "application_metadata": { 2024-04-26T12:28:05.369 INFO:teuthology.orchestra.run.smithi046.stdout: "cephfs": { 2024-04-26T12:28:05.369 INFO:teuthology.orchestra.run.smithi046.stdout: "data": "cephfs" 2024-04-26T12:28:05.369 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.369 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.369 INFO:teuthology.orchestra.run.smithi046.stdout: "read_balance": { 2024-04-26T12:28:05.370 INFO:teuthology.orchestra.run.smithi046.stdout: "score_acting": 1.5800000429153442, 2024-04-26T12:28:05.370 INFO:teuthology.orchestra.run.smithi046.stdout: "score_stable": 1.5800000429153442, 2024-04-26T12:28:05.370 INFO:teuthology.orchestra.run.smithi046.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T12:28:05.370 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_acting": 1.059999942779541, 2024-04-26T12:28:05.370 INFO:teuthology.orchestra.run.smithi046.stdout: "raw_score_stable": 1.059999942779541, 2024-04-26T12:28:05.370 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity_weighted": 0.85364794731140137, 2024-04-26T12:28:05.370 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity": 0.85000002384185791, 2024-04-26T12:28:05.370 INFO:teuthology.orchestra.run.smithi046.stdout: "average_primary_affinity_weighted": 0.85000002384185791 2024-04-26T12:28:05.370 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.370 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.370 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-04-26T12:28:05.370 INFO:teuthology.orchestra.run.smithi046.stdout: "osds": [ 2024-04-26T12:28:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 0, 2024-04-26T12:28:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: "uuid": "06efe013-b786-41a5-b434-e2198a85a028", 2024-04-26T12:28:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: "up": 1, 2024-04-26T12:28:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: "in": 1, 2024-04-26T12:28:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: "weight": 1, 2024-04-26T12:28:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity": 0.560943603515625, 2024-04-26T12:28:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_begin": 0, 2024-04-26T12:28:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_end": 0, 2024-04-26T12:28:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: "up_from": 8, 2024-04-26T12:28:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: "up_thru": 35, 2024-04-26T12:28:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: "down_at": 0, 2024-04-26T12:28:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: "lost_at": 0, 2024-04-26T12:28:05.371 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addrs": { 2024-04-26T12:28:05.372 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:28:05.372 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.372 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:28:05.372 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6800", 2024-04-26T12:28:05.372 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:28:05.372 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.372 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.372 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:28:05.372 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6801", 2024-04-26T12:28:05.372 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:28:05.372 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.372 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.372 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.373 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addrs": { 2024-04-26T12:28:05.373 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:28:05.373 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.373 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:28:05.373 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6802", 2024-04-26T12:28:05.373 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:28:05.373 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.373 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.373 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:28:05.373 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6803", 2024-04-26T12:28:05.373 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:28:05.373 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.373 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.373 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.374 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addrs": { 2024-04-26T12:28:05.374 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:28:05.374 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.374 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:28:05.374 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6806", 2024-04-26T12:28:05.374 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:28:05.374 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.374 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.374 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:28:05.374 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6807", 2024-04-26T12:28:05.374 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:28:05.374 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.374 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.374 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.375 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addrs": { 2024-04-26T12:28:05.375 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:28:05.375 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.375 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:28:05.375 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6804", 2024-04-26T12:28:05.375 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:28:05.375 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.375 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.375 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:28:05.375 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.115:6805", 2024-04-26T12:28:05.375 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41431 2024-04-26T12:28:05.375 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.375 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.375 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.376 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addr": "172.21.15.115:6801/41431", 2024-04-26T12:28:05.376 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addr": "172.21.15.115:6803/41431", 2024-04-26T12:28:05.376 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addr": "172.21.15.115:6807/41431", 2024-04-26T12:28:05.376 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addr": "172.21.15.115:6805/41431", 2024-04-26T12:28:05.376 INFO:teuthology.orchestra.run.smithi046.stdout: "state": [ 2024-04-26T12:28:05.376 INFO:teuthology.orchestra.run.smithi046.stdout: "exists", 2024-04-26T12:28:05.376 INFO:teuthology.orchestra.run.smithi046.stdout: "up" 2024-04-26T12:28:05.376 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.376 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.376 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.376 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 1, 2024-04-26T12:28:05.376 INFO:teuthology.orchestra.run.smithi046.stdout: "uuid": "13cadead-33ea-4874-9a87-7419790ff37a", 2024-04-26T12:28:05.376 INFO:teuthology.orchestra.run.smithi046.stdout: "up": 0, 2024-04-26T12:28:05.376 INFO:teuthology.orchestra.run.smithi046.stdout: "in": 1, 2024-04-26T12:28:05.377 INFO:teuthology.orchestra.run.smithi046.stdout: "weight": 1, 2024-04-26T12:28:05.377 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity": 1, 2024-04-26T12:28:05.377 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_begin": 0, 2024-04-26T12:28:05.377 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_end": 0, 2024-04-26T12:28:05.377 INFO:teuthology.orchestra.run.smithi046.stdout: "up_from": 8, 2024-04-26T12:28:05.377 INFO:teuthology.orchestra.run.smithi046.stdout: "up_thru": 17, 2024-04-26T12:28:05.377 INFO:teuthology.orchestra.run.smithi046.stdout: "down_at": 30, 2024-04-26T12:28:05.377 INFO:teuthology.orchestra.run.smithi046.stdout: "lost_at": 0, 2024-04-26T12:28:05.377 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addrs": { 2024-04-26T12:28:05.377 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:28:05.377 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.377 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:28:05.377 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6800", 2024-04-26T12:28:05.377 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:28:05.378 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.378 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.378 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:28:05.378 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6801", 2024-04-26T12:28:05.378 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:28:05.378 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.378 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.378 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.378 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addrs": { 2024-04-26T12:28:05.378 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:28:05.378 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.378 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:28:05.378 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6802", 2024-04-26T12:28:05.378 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:28:05.379 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.379 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.379 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:28:05.379 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6803", 2024-04-26T12:28:05.379 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:28:05.379 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.379 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.379 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.379 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addrs": { 2024-04-26T12:28:05.379 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:28:05.379 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.379 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:28:05.379 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6806", 2024-04-26T12:28:05.379 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:28:05.380 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.380 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.380 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:28:05.380 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6807", 2024-04-26T12:28:05.380 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:28:05.380 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.380 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.380 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.380 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addrs": { 2024-04-26T12:28:05.380 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:28:05.380 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.380 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:28:05.380 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6804", 2024-04-26T12:28:05.380 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:28:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:28:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.136:6805", 2024-04-26T12:28:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41393 2024-04-26T12:28:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addr": "172.21.15.136:6801/41393", 2024-04-26T12:28:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addr": "172.21.15.136:6803/41393", 2024-04-26T12:28:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addr": "172.21.15.136:6807/41393", 2024-04-26T12:28:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addr": "172.21.15.136:6805/41393", 2024-04-26T12:28:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: "state": [ 2024-04-26T12:28:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: "exists" 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 2, 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi046.stdout: "uuid": "4e4c8095-c2d1-42a3-8da1-e3b41ca2a870", 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi046.stdout: "up": 1, 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi046.stdout: "in": 1, 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi046.stdout: "weight": 1, 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_affinity": 1, 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_begin": 0, 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi046.stdout: "last_clean_end": 0, 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi046.stdout: "up_from": 8, 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi046.stdout: "up_thru": 30, 2024-04-26T12:28:05.382 INFO:teuthology.orchestra.run.smithi046.stdout: "down_at": 0, 2024-04-26T12:28:05.383 INFO:teuthology.orchestra.run.smithi046.stdout: "lost_at": 0, 2024-04-26T12:28:05.383 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addrs": { 2024-04-26T12:28:05.383 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:28:05.383 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.383 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:28:05.383 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6800", 2024-04-26T12:28:05.383 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:28:05.383 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.383 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.383 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:28:05.383 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6801", 2024-04-26T12:28:05.383 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:28:05.383 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.383 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.384 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.384 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addrs": { 2024-04-26T12:28:05.384 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:28:05.384 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.384 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:28:05.384 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6802", 2024-04-26T12:28:05.384 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:28:05.384 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.384 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.384 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:28:05.384 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6803", 2024-04-26T12:28:05.384 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:28:05.384 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.384 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.385 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.385 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addrs": { 2024-04-26T12:28:05.385 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:28:05.385 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.385 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:28:05.385 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6806", 2024-04-26T12:28:05.385 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:28:05.386 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.386 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.386 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:28:05.386 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6807", 2024-04-26T12:28:05.386 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:28:05.386 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.386 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.386 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.386 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addrs": { 2024-04-26T12:28:05.386 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-04-26T12:28:05.386 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.386 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-04-26T12:28:05.386 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6804", 2024-04-26T12:28:05.387 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:28:05.387 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.387 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.387 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-04-26T12:28:05.387 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.142:6805", 2024-04-26T12:28:05.387 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 41547 2024-04-26T12:28:05.387 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.387 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.387 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.387 INFO:teuthology.orchestra.run.smithi046.stdout: "public_addr": "172.21.15.142:6801/41547", 2024-04-26T12:28:05.387 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_addr": "172.21.15.142:6803/41547", 2024-04-26T12:28:05.387 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_back_addr": "172.21.15.142:6807/41547", 2024-04-26T12:28:05.387 INFO:teuthology.orchestra.run.smithi046.stdout: "heartbeat_front_addr": "172.21.15.142:6805/41547", 2024-04-26T12:28:05.387 INFO:teuthology.orchestra.run.smithi046.stdout: "state": [ 2024-04-26T12:28:05.388 INFO:teuthology.orchestra.run.smithi046.stdout: "exists", 2024-04-26T12:28:05.388 INFO:teuthology.orchestra.run.smithi046.stdout: "up" 2024-04-26T12:28:05.388 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.388 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.388 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-04-26T12:28:05.388 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_xinfo": [ 2024-04-26T12:28:05.388 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.388 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 0, 2024-04-26T12:28:05.388 INFO:teuthology.orchestra.run.smithi046.stdout: "down_stamp": "0.000000", 2024-04-26T12:28:05.388 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_probability": 0, 2024-04-26T12:28:05.388 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_interval": 0, 2024-04-26T12:28:05.388 INFO:teuthology.orchestra.run.smithi046.stdout: "features": 4540138322906710015, 2024-04-26T12:28:05.388 INFO:teuthology.orchestra.run.smithi046.stdout: "old_weight": 0, 2024-04-26T12:28:05.388 INFO:teuthology.orchestra.run.smithi046.stdout: "last_purged_snaps_scrub": "2024-04-26T12:26:43.065520+0000", 2024-04-26T12:28:05.389 INFO:teuthology.orchestra.run.smithi046.stdout: "dead_epoch": 0 2024-04-26T12:28:05.389 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.389 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.389 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 1, 2024-04-26T12:28:05.389 INFO:teuthology.orchestra.run.smithi046.stdout: "down_stamp": "0.000000", 2024-04-26T12:28:05.389 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_probability": 0, 2024-04-26T12:28:05.389 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_interval": 0, 2024-04-26T12:28:05.389 INFO:teuthology.orchestra.run.smithi046.stdout: "features": 4540138322906710015, 2024-04-26T12:28:05.389 INFO:teuthology.orchestra.run.smithi046.stdout: "old_weight": 0, 2024-04-26T12:28:05.389 INFO:teuthology.orchestra.run.smithi046.stdout: "last_purged_snaps_scrub": "2024-04-26T12:26:43.774900+0000", 2024-04-26T12:28:05.389 INFO:teuthology.orchestra.run.smithi046.stdout: "dead_epoch": 29 2024-04-26T12:28:05.389 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.389 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.389 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": 2, 2024-04-26T12:28:05.390 INFO:teuthology.orchestra.run.smithi046.stdout: "down_stamp": "0.000000", 2024-04-26T12:28:05.390 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_probability": 0, 2024-04-26T12:28:05.390 INFO:teuthology.orchestra.run.smithi046.stdout: "laggy_interval": 0, 2024-04-26T12:28:05.390 INFO:teuthology.orchestra.run.smithi046.stdout: "features": 4540138322906710015, 2024-04-26T12:28:05.390 INFO:teuthology.orchestra.run.smithi046.stdout: "old_weight": 0, 2024-04-26T12:28:05.390 INFO:teuthology.orchestra.run.smithi046.stdout: "last_purged_snaps_scrub": "2024-04-26T12:26:43.024152+0000", 2024-04-26T12:28:05.390 INFO:teuthology.orchestra.run.smithi046.stdout: "dead_epoch": 0 2024-04-26T12:28:05.390 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.390 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-04-26T12:28:05.390 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_upmap": [ 2024-04-26T12:28:05.390 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-04-26T12:28:05.391 INFO:teuthology.orchestra.run.smithi046.stdout: "pgid": "4.19", 2024-04-26T12:28:05.391 INFO:teuthology.orchestra.run.smithi046.stdout: "osds": [ 2024-04-26T12:28:05.391 INFO:teuthology.orchestra.run.smithi046.stdout: 0, 2024-04-26T12:28:05.391 INFO:teuthology.orchestra.run.smithi046.stdout: 2 2024-04-26T12:28:05.391 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-04-26T12:28:05.391 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.391 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-04-26T12:28:05.391 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_upmap_items": [], 2024-04-26T12:28:05.391 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_upmap_primaries": [], 2024-04-26T12:28:05.391 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_temp": [], 2024-04-26T12:28:05.391 INFO:teuthology.orchestra.run.smithi046.stdout: "primary_temp": [], 2024-04-26T12:28:05.391 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklist": {}, 2024-04-26T12:28:05.391 INFO:teuthology.orchestra.run.smithi046.stdout: "range_blocklist": {}, 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: "erasure_code_profiles": { 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: "default": { 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: "crush-failure-domain": "osd", 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: "k": "2", 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: "m": "1", 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: "plugin": "jerasure", 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: "technique": "reed_sol_van" 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: "removed_snaps_queue": [], 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: "new_removed_snaps": [], 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: "new_purged_snaps": [], 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_node_flags": {}, 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: "device_class_flags": {}, 2024-04-26T12:28:05.392 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_mode": { 2024-04-26T12:28:05.393 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_mode_enabled": false, 2024-04-26T12:28:05.393 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_bucket_count": 0, 2024-04-26T12:28:05.393 INFO:teuthology.orchestra.run.smithi046.stdout: "degraded_stretch_mode": 0, 2024-04-26T12:28:05.393 INFO:teuthology.orchestra.run.smithi046.stdout: "recovering_stretch_mode": 0, 2024-04-26T12:28:05.394 INFO:teuthology.orchestra.run.smithi046.stdout: "stretch_mode_bucket": 0 2024-04-26T12:28:05.394 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-04-26T12:28:05.394 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-04-26T12:28:05.395 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:05.394+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:05.396 INFO:tasks.thrashosds.thrasher:j is {'epoch': 37, 'fsid': '3dd84416-f290-4721-94ce-52b0ffaacf34', 'created': '2024-04-26T12:26:36.091476+0000', 'modified': '2024-04-26T12:28:03.703042+0000', 'last_up_change': '2024-04-26T12:27:47.657403+0000', 'last_in_change': '2024-04-26T12:26:37.993949+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:26:45.341269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:26:45.839095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:26:51.091400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:26:52.222159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}], 'osds': [{'osd': 0, 'uuid': '06efe013-b786-41a5-b434-e2198a85a028', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.560943603515625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6800', 'nonce': 41431}, {'type': 'v1', 'addr': '172.21.15.115:6801', 'nonce': 41431}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6802', 'nonce': 41431}, {'type': 'v1', 'addr': '172.21.15.115:6803', 'nonce': 41431}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6806', 'nonce': 41431}, {'type': 'v1', 'addr': '172.21.15.115:6807', 'nonce': 41431}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6804', 'nonce': 41431}, {'type': 'v1', 'addr': '172.21.15.115:6805', 'nonce': 41431}]}, 'public_addr': '172.21.15.115:6801/41431', 'cluster_addr': '172.21.15.115:6803/41431', 'heartbeat_back_addr': '172.21.15.115:6807/41431', 'heartbeat_front_addr': '172.21.15.115:6805/41431', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '13cadead-33ea-4874-9a87-7419790ff37a', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 30, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6800', 'nonce': 41393}, {'type': 'v1', 'addr': '172.21.15.136:6801', 'nonce': 41393}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6802', 'nonce': 41393}, {'type': 'v1', 'addr': '172.21.15.136:6803', 'nonce': 41393}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6806', 'nonce': 41393}, {'type': 'v1', 'addr': '172.21.15.136:6807', 'nonce': 41393}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6804', 'nonce': 41393}, {'type': 'v1', 'addr': '172.21.15.136:6805', 'nonce': 41393}]}, 'public_addr': '172.21.15.136:6801/41393', 'cluster_addr': '172.21.15.136:6803/41393', 'heartbeat_back_addr': '172.21.15.136:6807/41393', 'heartbeat_front_addr': '172.21.15.136:6805/41393', 'state': ['exists']}, {'osd': 2, 'uuid': '4e4c8095-c2d1-42a3-8da1-e3b41ca2a870', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6800', 'nonce': 41547}, {'type': 'v1', 'addr': '172.21.15.142:6801', 'nonce': 41547}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6802', 'nonce': 41547}, {'type': 'v1', 'addr': '172.21.15.142:6803', 'nonce': 41547}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6806', 'nonce': 41547}, {'type': 'v1', 'addr': '172.21.15.142:6807', 'nonce': 41547}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6804', 'nonce': 41547}, {'type': 'v1', 'addr': '172.21.15.142:6805', 'nonce': 41547}]}, 'public_addr': '172.21.15.142:6801/41547', 'cluster_addr': '172.21.15.142:6803/41547', 'heartbeat_back_addr': '172.21.15.142:6807/41547', 'heartbeat_front_addr': '172.21.15.142:6805/41547', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:26:43.065520+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:26:43.774900+0000', 'dead_epoch': 29}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T12:26:43.024152+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.19', 'osds': [0, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T12:28:05.396 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:28:05.397 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:05.397 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:05.406 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:05.497 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:05.496+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:05.573 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:05.573 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:05.583 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:05.626 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:05.626+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:05.700 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:05.698+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:05.710 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:05.710 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:05.720 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:05.726 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:28:05.801 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:05.801+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:05.852 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:05.853 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:05.863 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:05.906 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:05.905+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:06.003 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:06.002+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:06.021 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:28:06.023 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:28:06.031 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:06.031 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:06.037 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-26T12:28:05.304013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597673,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":139,"acting":139,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82076,"kb_used_data":1008,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033444,"statfs":{"total":289910292480,"available":289826246656,"internally_reserved":0,"allocated":1032192,"data_stored":1557116,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001096"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.697059+0000","last_change":"2024-04-26T12:27:48.671300+0000","last_active":"2024-04-26T12:27:57.697059+0000","last_peered":"2024-04-26T12:27:57.697059+0000","last_clean":"2024-04-26T12:27:45.659014+0000","last_became_active":"2024-04-26T12:27:48.671300+0000","last_became_peered":"2024-04-26T12:27:48.671300+0000","last_unstale":"2024-04-26T12:27:57.697059+0000","last_undegraded":"2024-04-26T12:27:57.697059+0000","last_fullsized":"2024-04-26T12:27:48.666994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:07.791859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696558+0000","last_change":"2024-04-26T12:27:48.668281+0000","last_active":"2024-04-26T12:27:57.696558+0000","last_peered":"2024-04-26T12:27:57.696558+0000","last_clean":"2024-04-26T12:27:45.658708+0000","last_became_active":"2024-04-26T12:27:48.668281+0000","last_became_peered":"2024-04-26T12:27:48.668281+0000","last_unstale":"2024-04-26T12:27:57.696558+0000","last_undegraded":"2024-04-26T12:27:57.696558+0000","last_fullsized":"2024-04-26T12:27:48.664487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:00.734619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696266+0000","last_change":"2024-04-26T12:27:13.578104+0000","last_active":"2024-04-26T12:27:57.696266+0000","last_peered":"2024-04-26T12:27:57.696266+0000","last_clean":"2024-04-26T12:27:57.696266+0000","last_became_active":"2024-04-26T12:27:13.577849+0000","last_became_peered":"2024-04-26T12:27:13.577849+0000","last_unstale":"2024-04-26T12:27:57.696266+0000","last_undegraded":"2024-04-26T12:27:57.696266+0000","last_fullsized":"2024-04-26T12:27:57.696266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:48.407310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696939+0000","last_change":"2024-04-26T12:27:48.670655+0000","last_active":"2024-04-26T12:27:57.696939+0000","last_peered":"2024-04-26T12:27:57.696939+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.670655+0000","last_became_peered":"2024-04-26T12:27:48.670655+0000","last_unstale":"2024-04-26T12:27:57.696939+0000","last_undegraded":"2024-04-26T12:27:57.696939+0000","last_fullsized":"2024-04-26T12:27:48.665967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:35.730477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696018+0000","last_change":"2024-04-26T12:27:48.668508+0000","last_active":"2024-04-26T12:27:57.696018+0000","last_peered":"2024-04-26T12:27:57.696018+0000","last_clean":"2024-04-26T12:27:45.658341+0000","last_became_active":"2024-04-26T12:27:48.668508+0000","last_became_peered":"2024-04-26T12:27:48.668508+0000","last_unstale":"2024-04-26T12:27:57.696018+0000","last_undegraded":"2024-04-26T12:27:57.696018+0000","last_fullsized":"2024-04-26T12:27:48.665002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:48.840592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695937+0000","last_change":"2024-04-26T12:27:48.667621+0000","last_active":"2024-04-26T12:27:57.695937+0000","last_peered":"2024-04-26T12:27:57.695937+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.667621+0000","last_became_peered":"2024-04-26T12:27:48.667621+0000","last_unstale":"2024-04-26T12:27:57.695937+0000","last_undegraded":"2024-04-26T12:27:57.695937+0000","last_fullsized":"2024-04-26T12:27:48.664721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:56.099034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696179+0000","last_change":"2024-04-26T12:27:48.669018+0000","last_active":"2024-04-26T12:27:57.696179+0000","last_peered":"2024-04-26T12:27:57.696179+0000","last_clean":"2024-04-26T12:27:45.658807+0000","last_became_active":"2024-04-26T12:27:48.669018+0000","last_became_peered":"2024-04-26T12:27:48.669018+0000","last_unstale":"2024-04-26T12:27:57.696179+0000","last_undegraded":"2024-04-26T12:27:57.696179+0000","last_fullsized":"2024-04-26T12:27:48.665042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:07.544092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695778+0000","last_change":"2024-04-26T12:27:48.666997+0000","last_active":"2024-04-26T12:27:57.695778+0000","last_peered":"2024-04-26T12:27:57.695778+0000","last_clean":"2024-04-26T12:27:45.658575+0000","last_became_active":"2024-04-26T12:27:48.666997+0000","last_became_peered":"2024-04-26T12:27:48.666997+0000","last_unstale":"2024-04-26T12:27:57.695778+0000","last_undegraded":"2024-04-26T12:27:57.695778+0000","last_fullsized":"2024-04-26T12:27:48.664525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:17.742404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696763+0000","last_change":"2024-04-26T12:27:48.671241+0000","last_active":"2024-04-26T12:27:57.696763+0000","last_peered":"2024-04-26T12:27:57.696763+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.671241+0000","last_became_peered":"2024-04-26T12:27:48.671241+0000","last_unstale":"2024-04-26T12:27:57.696763+0000","last_undegraded":"2024-04-26T12:27:57.696763+0000","last_fullsized":"2024-04-26T12:27:48.665995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:24.316546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696675+0000","last_change":"2024-04-26T12:27:48.671204+0000","last_active":"2024-04-26T12:27:57.696675+0000","last_peered":"2024-04-26T12:27:57.696675+0000","last_clean":"2024-04-26T12:27:45.658876+0000","last_became_active":"2024-04-26T12:27:48.671204+0000","last_became_peered":"2024-04-26T12:27:48.671204+0000","last_unstale":"2024-04-26T12:27:57.696675+0000","last_undegraded":"2024-04-26T12:27:57.696675+0000","last_fullsized":"2024-04-26T12:27:48.665046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:53.476133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696845+0000","last_change":"2024-04-26T12:27:48.667839+0000","last_active":"2024-04-26T12:27:57.696845+0000","last_peered":"2024-04-26T12:27:57.696845+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.667839+0000","last_became_peered":"2024-04-26T12:27:48.667839+0000","last_unstale":"2024-04-26T12:27:57.696845+0000","last_undegraded":"2024-04-26T12:27:57.696845+0000","last_fullsized":"2024-04-26T12:27:48.665442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:15.607076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696169+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:27:57.696169+0000","last_peered":"2024-04-26T12:27:57.696169+0000","last_clean":"2024-04-26T12:27:57.696169+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:27:57.696169+0000","last_undegraded":"2024-04-26T12:27:57.696169+0000","last_fullsized":"2024-04-26T12:27:57.696169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695864+0000","last_change":"2024-04-26T12:27:48.669697+0000","last_active":"2024-04-26T12:27:57.695864+0000","last_peered":"2024-04-26T12:27:57.695864+0000","last_clean":"2024-04-26T12:27:45.658259+0000","last_became_active":"2024-04-26T12:27:48.669697+0000","last_became_peered":"2024-04-26T12:27:48.669697+0000","last_unstale":"2024-04-26T12:27:57.695864+0000","last_undegraded":"2024-04-26T12:27:57.695864+0000","last_fullsized":"2024-04-26T12:27:48.664817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:26.492322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696439+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:27:57.696439+0000","last_peered":"2024-04-26T12:27:57.696439+0000","last_clean":"2024-04-26T12:27:57.696439+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:27:57.696439+0000","last_undegraded":"2024-04-26T12:27:57.696439+0000","last_fullsized":"2024-04-26T12:27:57.696439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.695792+0000","last_change":"2024-04-26T12:26:53.266568+0000","last_active":"2024-04-26T12:27:57.695792+0000","last_peered":"2024-04-26T12:27:57.695792+0000","last_clean":"2024-04-26T12:27:57.695792+0000","last_became_active":"2024-04-26T12:26:53.265846+0000","last_became_peered":"2024-04-26T12:26:53.265846+0000","last_unstale":"2024-04-26T12:27:57.695792+0000","last_undegraded":"2024-04-26T12:27:57.695792+0000","last_fullsized":"2024-04-26T12:27:57.695792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:10.849502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695896+0000","last_change":"2024-04-26T12:27:48.667769+0000","last_active":"2024-04-26T12:27:57.695896+0000","last_peered":"2024-04-26T12:27:57.695896+0000","last_clean":"2024-04-26T12:27:45.658577+0000","last_became_active":"2024-04-26T12:27:48.667769+0000","last_became_peered":"2024-04-26T12:27:48.667769+0000","last_unstale":"2024-04-26T12:27:57.695896+0000","last_undegraded":"2024-04-26T12:27:57.695896+0000","last_fullsized":"2024-04-26T12:27:48.665111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:24.316546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696627+0000","last_change":"2024-04-26T12:27:48.670091+0000","last_active":"2024-04-26T12:27:57.696627+0000","last_peered":"2024-04-26T12:27:57.696627+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.670091+0000","last_became_peered":"2024-04-26T12:27:48.670091+0000","last_unstale":"2024-04-26T12:27:57.696627+0000","last_undegraded":"2024-04-26T12:27:57.696627+0000","last_fullsized":"2024-04-26T12:27:48.665783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:53.719035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696778+0000","last_change":"2024-04-26T12:27:48.669637+0000","last_active":"2024-04-26T12:27:57.696778+0000","last_peered":"2024-04-26T12:27:57.696778+0000","last_clean":"2024-04-26T12:27:45.658959+0000","last_became_active":"2024-04-26T12:27:48.669637+0000","last_became_peered":"2024-04-26T12:27:48.669637+0000","last_unstale":"2024-04-26T12:27:57.696778+0000","last_undegraded":"2024-04-26T12:27:57.696778+0000","last_fullsized":"2024-04-26T12:27:48.665757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:32.786103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696772+0000","last_change":"2024-04-26T12:27:48.671206+0000","last_active":"2024-04-26T12:27:57.696772+0000","last_peered":"2024-04-26T12:27:57.696772+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.671206+0000","last_became_peered":"2024-04-26T12:27:48.671206+0000","last_unstale":"2024-04-26T12:27:57.696772+0000","last_undegraded":"2024-04-26T12:27:57.696772+0000","last_fullsized":"2024-04-26T12:27:48.666076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:00.831876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696806+0000","last_change":"2024-04-26T12:27:48.669858+0000","last_active":"2024-04-26T12:27:57.696806+0000","last_peered":"2024-04-26T12:27:57.696806+0000","last_clean":"2024-04-26T12:27:45.659063+0000","last_became_active":"2024-04-26T12:27:48.669858+0000","last_became_peered":"2024-04-26T12:27:48.669858+0000","last_unstale":"2024-04-26T12:27:57.696806+0000","last_undegraded":"2024-04-26T12:27:57.696806+0000","last_fullsized":"2024-04-26T12:27:48.665938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:48.591802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696158+0000","last_change":"2024-04-26T12:27:48.668558+0000","last_active":"2024-04-26T12:27:57.696158+0000","last_peered":"2024-04-26T12:27:57.696158+0000","last_clean":"2024-04-26T12:27:45.658882+0000","last_became_active":"2024-04-26T12:27:48.668558+0000","last_became_peered":"2024-04-26T12:27:48.668558+0000","last_unstale":"2024-04-26T12:27:57.696158+0000","last_undegraded":"2024-04-26T12:27:57.696158+0000","last_fullsized":"2024-04-26T12:27:48.665108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:22.546632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.695978+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:27:57.695978+0000","last_peered":"2024-04-26T12:27:57.695978+0000","last_clean":"2024-04-26T12:27:57.695978+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:27:57.695978+0000","last_undegraded":"2024-04-26T12:27:57.695978+0000","last_fullsized":"2024-04-26T12:27:57.695978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695769+0000","last_change":"2024-04-26T12:27:48.667575+0000","last_active":"2024-04-26T12:27:57.695769+0000","last_peered":"2024-04-26T12:27:57.695769+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.667575+0000","last_became_peered":"2024-04-26T12:27:48.667575+0000","last_unstale":"2024-04-26T12:27:57.695769+0000","last_undegraded":"2024-04-26T12:27:57.695769+0000","last_fullsized":"2024-04-26T12:27:48.664563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:03.604566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695828+0000","last_change":"2024-04-26T12:27:48.668268+0000","last_active":"2024-04-26T12:27:57.695828+0000","last_peered":"2024-04-26T12:27:57.695828+0000","last_clean":"2024-04-26T12:27:45.658199+0000","last_became_active":"2024-04-26T12:27:48.668268+0000","last_became_peered":"2024-04-26T12:27:48.668268+0000","last_unstale":"2024-04-26T12:27:57.695828+0000","last_undegraded":"2024-04-26T12:27:57.695828+0000","last_fullsized":"2024-04-26T12:27:48.664879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:48.125904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.697025+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:27:57.697025+0000","last_peered":"2024-04-26T12:27:57.697025+0000","last_clean":"2024-04-26T12:27:57.697025+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:27:57.697025+0000","last_undegraded":"2024-04-26T12:27:57.697025+0000","last_fullsized":"2024-04-26T12:27:57.697025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.697095+0000","last_change":"2024-04-26T12:27:48.669843+0000","last_active":"2024-04-26T12:27:57.697095+0000","last_peered":"2024-04-26T12:27:57.697095+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.669843+0000","last_became_peered":"2024-04-26T12:27:48.669843+0000","last_unstale":"2024-04-26T12:27:57.697095+0000","last_undegraded":"2024-04-26T12:27:57.697095+0000","last_fullsized":"2024-04-26T12:27:48.666772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:22.807739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696864+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:27:57.696864+0000","last_peered":"2024-04-26T12:27:57.696864+0000","last_clean":"2024-04-26T12:27:57.696864+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:27:57.696864+0000","last_undegraded":"2024-04-26T12:27:57.696864+0000","last_fullsized":"2024-04-26T12:27:57.696864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"15'1","reported_seq":36,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695928+0000","last_change":"2024-04-26T12:27:48.668365+0000","last_active":"2024-04-26T12:27:57.695928+0000","last_peered":"2024-04-26T12:27:57.695928+0000","last_clean":"2024-04-26T12:27:45.658326+0000","last_became_active":"2024-04-26T12:27:48.668365+0000","last_became_peered":"2024-04-26T12:27:48.668365+0000","last_unstale":"2024-04-26T12:27:57.695928+0000","last_undegraded":"2024-04-26T12:27:57.695928+0000","last_fullsized":"2024-04-26T12:27:48.664578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:49.177447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696677+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:27:57.696677+0000","last_peered":"2024-04-26T12:27:57.696677+0000","last_clean":"2024-04-26T12:27:57.696677+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:27:57.696677+0000","last_undegraded":"2024-04-26T12:27:57.696677+0000","last_fullsized":"2024-04-26T12:27:57.696677+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696054+0000","last_change":"2024-04-26T12:27:48.669601+0000","last_active":"2024-04-26T12:27:57.696054+0000","last_peered":"2024-04-26T12:27:57.696054+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.669601+0000","last_became_peered":"2024-04-26T12:27:48.669601+0000","last_unstale":"2024-04-26T12:27:57.696054+0000","last_undegraded":"2024-04-26T12:27:57.696054+0000","last_fullsized":"2024-04-26T12:27:48.664823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:24.502487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696962+0000","last_change":"2024-04-26T12:27:48.668612+0000","last_active":"2024-04-26T12:27:57.696962+0000","last_peered":"2024-04-26T12:27:57.696962+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.668612+0000","last_became_peered":"2024-04-26T12:27:48.668612+0000","last_unstale":"2024-04-26T12:27:57.696962+0000","last_undegraded":"2024-04-26T12:27:57.696962+0000","last_fullsized":"2024-04-26T12:27:48.666094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:40.211117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696108+0000","last_change":"2024-04-26T12:27:48.669519+0000","last_active":"2024-04-26T12:27:57.696108+0000","last_peered":"2024-04-26T12:27:57.696108+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.669519+0000","last_became_peered":"2024-04-26T12:27:48.669519+0000","last_unstale":"2024-04-26T12:27:57.696108+0000","last_undegraded":"2024-04-26T12:27:57.696108+0000","last_fullsized":"2024-04-26T12:27:48.665185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:22.121772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696984+0000","last_change":"2024-04-26T12:26:53.260764+0000","last_active":"2024-04-26T12:27:57.696984+0000","last_peered":"2024-04-26T12:27:57.696984+0000","last_clean":"2024-04-26T12:27:57.696984+0000","last_became_active":"2024-04-26T12:26:53.260388+0000","last_became_peered":"2024-04-26T12:26:53.260388+0000","last_unstale":"2024-04-26T12:27:57.696984+0000","last_undegraded":"2024-04-26T12:27:57.696984+0000","last_fullsized":"2024-04-26T12:27:57.696984+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:07.680383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.697082+0000","last_change":"2024-04-26T12:27:48.668792+0000","last_active":"2024-04-26T12:27:57.697082+0000","last_peered":"2024-04-26T12:27:57.697082+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.668792+0000","last_became_peered":"2024-04-26T12:27:48.668792+0000","last_unstale":"2024-04-26T12:27:57.697082+0000","last_undegraded":"2024-04-26T12:27:57.697082+0000","last_fullsized":"2024-04-26T12:27:48.666210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:14.927599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695610+0000","last_change":"2024-04-26T12:27:48.666833+0000","last_active":"2024-04-26T12:27:57.695610+0000","last_peered":"2024-04-26T12:27:57.695610+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.666833+0000","last_became_peered":"2024-04-26T12:27:48.666833+0000","last_unstale":"2024-04-26T12:27:57.695610+0000","last_undegraded":"2024-04-26T12:27:57.695610+0000","last_fullsized":"2024-04-26T12:27:48.664098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:07.963594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696798+0000","last_change":"2024-04-26T12:27:48.667986+0000","last_active":"2024-04-26T12:27:57.696798+0000","last_peered":"2024-04-26T12:27:57.696798+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.667986+0000","last_became_peered":"2024-04-26T12:27:48.667986+0000","last_unstale":"2024-04-26T12:27:57.696798+0000","last_undegraded":"2024-04-26T12:27:57.696798+0000","last_fullsized":"2024-04-26T12:27:48.665842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:08.343408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696301+0000","last_change":"2024-04-26T12:27:48.669699+0000","last_active":"2024-04-26T12:27:57.696301+0000","last_peered":"2024-04-26T12:27:57.696301+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.669699+0000","last_became_peered":"2024-04-26T12:27:48.669699+0000","last_unstale":"2024-04-26T12:27:57.696301+0000","last_undegraded":"2024-04-26T12:27:57.696301+0000","last_fullsized":"2024-04-26T12:27:48.665274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:09.673236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"15'3","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696425+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:27:57.696425+0000","last_peered":"2024-04-26T12:27:57.696425+0000","last_clean":"2024-04-26T12:27:57.696425+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:27:57.696425+0000","last_undegraded":"2024-04-26T12:27:57.696425+0000","last_fullsized":"2024-04-26T12:27:57.696425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695647+0000","last_change":"2024-04-26T12:27:48.666951+0000","last_active":"2024-04-26T12:27:57.695647+0000","last_peered":"2024-04-26T12:27:57.695647+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.666951+0000","last_became_peered":"2024-04-26T12:27:48.666951+0000","last_unstale":"2024-04-26T12:27:57.695647+0000","last_undegraded":"2024-04-26T12:27:57.695647+0000","last_fullsized":"2024-04-26T12:27:48.664103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:03.878576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"21'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696785+0000","last_change":"2024-04-26T12:26:52.841280+0000","last_active":"2024-04-26T12:27:57.696785+0000","last_peered":"2024-04-26T12:27:57.696785+0000","last_clean":"2024-04-26T12:27:57.696785+0000","last_became_active":"2024-04-26T12:26:52.839398+0000","last_became_peered":"2024-04-26T12:26:52.839398+0000","last_unstale":"2024-04-26T12:27:57.696785+0000","last_undegraded":"2024-04-26T12:27:57.696785+0000","last_fullsized":"2024-04-26T12:27:57.696785+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:53.889623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696572+0000","last_change":"2024-04-26T12:26:53.260830+0000","last_active":"2024-04-26T12:27:57.696572+0000","last_peered":"2024-04-26T12:27:57.696572+0000","last_clean":"2024-04-26T12:27:57.696572+0000","last_became_active":"2024-04-26T12:26:53.259452+0000","last_became_peered":"2024-04-26T12:26:53.259452+0000","last_unstale":"2024-04-26T12:27:57.696572+0000","last_undegraded":"2024-04-26T12:27:57.696572+0000","last_fullsized":"2024-04-26T12:27:57.696572+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"15'2","reported_seq":37,"reported_epoch":34,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:27:57.696465+0000","last_change":"2024-04-26T12:27:48.670849+0000","last_active":"2024-04-26T12:27:57.696465+0000","last_peered":"2024-04-26T12:27:57.696465+0000","last_clean":"2024-04-26T12:27:45.659179+0000","last_became_active":"2024-04-26T12:27:48.670849+0000","last_became_peered":"2024-04-26T12:27:48.670849+0000","last_unstale":"2024-04-26T12:27:57.696465+0000","last_undegraded":"2024-04-26T12:27:48.666998+0000","last_fullsized":"2024-04-26T12:27:48.666936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:31.781004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696393+0000","last_change":"2024-04-26T12:27:48.669835+0000","last_active":"2024-04-26T12:27:57.696393+0000","last_peered":"2024-04-26T12:27:57.696393+0000","last_clean":"2024-04-26T12:27:45.658491+0000","last_became_active":"2024-04-26T12:27:48.669835+0000","last_became_peered":"2024-04-26T12:27:48.669835+0000","last_unstale":"2024-04-26T12:27:57.696393+0000","last_undegraded":"2024-04-26T12:27:57.696393+0000","last_fullsized":"2024-04-26T12:27:48.664951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:50.107601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696447+0000","last_change":"2024-04-26T12:27:48.668832+0000","last_active":"2024-04-26T12:27:57.696447+0000","last_peered":"2024-04-26T12:27:57.696447+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.668832+0000","last_became_peered":"2024-04-26T12:27:48.668832+0000","last_unstale":"2024-04-26T12:27:57.696447+0000","last_undegraded":"2024-04-26T12:27:57.696447+0000","last_fullsized":"2024-04-26T12:27:48.665308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:04.128359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696659+0000","last_change":"2024-04-26T12:27:48.668718+0000","last_active":"2024-04-26T12:27:57.696659+0000","last_peered":"2024-04-26T12:27:57.696659+0000","last_clean":"2024-04-26T12:27:45.658777+0000","last_became_active":"2024-04-26T12:27:48.668718+0000","last_became_peered":"2024-04-26T12:27:48.668718+0000","last_unstale":"2024-04-26T12:27:57.696659+0000","last_undegraded":"2024-04-26T12:27:57.696659+0000","last_fullsized":"2024-04-26T12:27:48.665822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:51.866079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696156+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:27:57.696156+0000","last_peered":"2024-04-26T12:27:57.696156+0000","last_clean":"2024-04-26T12:27:57.696156+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:27:57.696156+0000","last_undegraded":"2024-04-26T12:27:57.696156+0000","last_fullsized":"2024-04-26T12:27:57.696156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.697074+0000","last_change":"2024-04-26T12:27:48.670898+0000","last_active":"2024-04-26T12:27:57.697074+0000","last_peered":"2024-04-26T12:27:57.697074+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.670898+0000","last_became_peered":"2024-04-26T12:27:48.670898+0000","last_unstale":"2024-04-26T12:27:57.697074+0000","last_undegraded":"2024-04-26T12:27:57.697074+0000","last_fullsized":"2024-04-26T12:27:48.666259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:46.263682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"15'8","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696083+0000","last_change":"2024-04-26T12:26:52.840810+0000","last_active":"2024-04-26T12:27:57.696083+0000","last_peered":"2024-04-26T12:27:57.696083+0000","last_clean":"2024-04-26T12:27:57.696083+0000","last_became_active":"2024-04-26T12:26:52.840059+0000","last_became_peered":"2024-04-26T12:26:52.840059+0000","last_unstale":"2024-04-26T12:27:57.696083+0000","last_undegraded":"2024-04-26T12:27:57.696083+0000","last_fullsized":"2024-04-26T12:27:57.696083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:17.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696967+0000","last_change":"2024-04-26T12:27:48.668069+0000","last_active":"2024-04-26T12:27:57.696967+0000","last_peered":"2024-04-26T12:27:57.696967+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.668069+0000","last_became_peered":"2024-04-26T12:27:48.668069+0000","last_unstale":"2024-04-26T12:27:57.696967+0000","last_undegraded":"2024-04-26T12:27:57.696967+0000","last_fullsized":"2024-04-26T12:27:48.665961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:26.492322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"15'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696848+0000","last_change":"2024-04-26T12:26:52.840684+0000","last_active":"2024-04-26T12:27:57.696848+0000","last_peered":"2024-04-26T12:27:57.696848+0000","last_clean":"2024-04-26T12:27:57.696848+0000","last_became_active":"2024-04-26T12:26:52.839414+0000","last_became_peered":"2024-04-26T12:26:52.839414+0000","last_unstale":"2024-04-26T12:27:57.696848+0000","last_undegraded":"2024-04-26T12:27:57.696848+0000","last_fullsized":"2024-04-26T12:27:57.696848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:24:12.837493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.695508+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:27:57.695508+0000","last_peered":"2024-04-26T12:27:57.695508+0000","last_clean":"2024-04-26T12:27:57.695508+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:27:57.695508+0000","last_undegraded":"2024-04-26T12:27:57.695508+0000","last_fullsized":"2024-04-26T12:27:57.695508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"15'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696560+0000","last_change":"2024-04-26T12:26:52.839692+0000","last_active":"2024-04-26T12:27:57.696560+0000","last_peered":"2024-04-26T12:27:57.696560+0000","last_clean":"2024-04-26T12:27:57.696560+0000","last_became_active":"2024-04-26T12:26:52.839419+0000","last_became_peered":"2024-04-26T12:26:52.839419+0000","last_unstale":"2024-04-26T12:27:57.696560+0000","last_undegraded":"2024-04-26T12:27:57.696560+0000","last_fullsized":"2024-04-26T12:27:57.696560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:25.416851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696241+0000","last_change":"2024-04-26T12:27:48.667396+0000","last_active":"2024-04-26T12:27:57.696241+0000","last_peered":"2024-04-26T12:27:57.696241+0000","last_clean":"2024-04-26T12:27:45.658276+0000","last_became_active":"2024-04-26T12:27:48.667396+0000","last_became_peered":"2024-04-26T12:27:48.667396+0000","last_unstale":"2024-04-26T12:27:57.696241+0000","last_undegraded":"2024-04-26T12:27:57.696241+0000","last_fullsized":"2024-04-26T12:27:48.664451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:15.838679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"15'1","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696378+0000","last_change":"2024-04-26T12:27:13.578220+0000","last_active":"2024-04-26T12:27:57.696378+0000","last_peered":"2024-04-26T12:27:57.696378+0000","last_clean":"2024-04-26T12:27:57.696378+0000","last_became_active":"2024-04-26T12:27:13.577940+0000","last_became_peered":"2024-04-26T12:27:13.577940+0000","last_unstale":"2024-04-26T12:27:57.696378+0000","last_undegraded":"2024-04-26T12:27:57.696378+0000","last_fullsized":"2024-04-26T12:27:57.696378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:56.100347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696299+0000","last_change":"2024-04-26T12:27:48.668258+0000","last_active":"2024-04-26T12:27:57.696299+0000","last_peered":"2024-04-26T12:27:57.696299+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.668258+0000","last_became_peered":"2024-04-26T12:27:48.668258+0000","last_unstale":"2024-04-26T12:27:57.696299+0000","last_undegraded":"2024-04-26T12:27:57.696299+0000","last_fullsized":"2024-04-26T12:27:48.665023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:50.182546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696187+0000","last_change":"2024-04-26T12:27:48.667826+0000","last_active":"2024-04-26T12:27:57.696187+0000","last_peered":"2024-04-26T12:27:57.696187+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.667826+0000","last_became_peered":"2024-04-26T12:27:48.667826+0000","last_unstale":"2024-04-26T12:27:57.696187+0000","last_undegraded":"2024-04-26T12:27:57.696187+0000","last_fullsized":"2024-04-26T12:27:48.665185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:14.177258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695910+0000","last_change":"2024-04-26T12:27:48.667634+0000","last_active":"2024-04-26T12:27:57.695910+0000","last_peered":"2024-04-26T12:27:57.695910+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.667634+0000","last_became_peered":"2024-04-26T12:27:48.667634+0000","last_unstale":"2024-04-26T12:27:57.695910+0000","last_undegraded":"2024-04-26T12:27:57.695910+0000","last_fullsized":"2024-04-26T12:27:48.664767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:49.881979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"15'2","reported_seq":20,"reported_epoch":34,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:27:57.696450+0000","last_change":"2024-04-26T12:27:48.670627+0000","last_active":"2024-04-26T12:27:57.696450+0000","last_peered":"2024-04-26T12:27:57.696450+0000","last_clean":"2024-04-26T12:26:53.247810+0000","last_became_active":"2024-04-26T12:27:48.670627+0000","last_became_peered":"2024-04-26T12:27:48.670627+0000","last_unstale":"2024-04-26T12:27:57.696450+0000","last_undegraded":"2024-04-26T12:27:48.666723+0000","last_fullsized":"2024-04-26T12:27:48.666210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:08.752822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696344+0000","last_change":"2024-04-26T12:27:48.669607+0000","last_active":"2024-04-26T12:27:57.696344+0000","last_peered":"2024-04-26T12:27:57.696344+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.669607+0000","last_became_peered":"2024-04-26T12:27:48.669607+0000","last_unstale":"2024-04-26T12:27:57.696344+0000","last_undegraded":"2024-04-26T12:27:57.696344+0000","last_fullsized":"2024-04-26T12:27:48.665480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:27.215092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695991+0000","last_change":"2024-04-26T12:27:48.668015+0000","last_active":"2024-04-26T12:27:57.695991+0000","last_peered":"2024-04-26T12:27:57.695991+0000","last_clean":"2024-04-26T12:27:45.658906+0000","last_became_active":"2024-04-26T12:27:48.668015+0000","last_became_peered":"2024-04-26T12:27:48.668015+0000","last_unstale":"2024-04-26T12:27:57.695991+0000","last_undegraded":"2024-04-26T12:27:57.695991+0000","last_fullsized":"2024-04-26T12:27:48.664776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:53.936963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.697109+0000","last_change":"2024-04-26T12:26:53.266014+0000","last_active":"2024-04-26T12:27:57.697109+0000","last_peered":"2024-04-26T12:27:57.697109+0000","last_clean":"2024-04-26T12:27:57.697109+0000","last_became_active":"2024-04-26T12:26:53.264254+0000","last_became_peered":"2024-04-26T12:26:53.264254+0000","last_unstale":"2024-04-26T12:27:57.697109+0000","last_undegraded":"2024-04-26T12:27:57.697109+0000","last_fullsized":"2024-04-26T12:27:57.697109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:04.369827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.695597+0000","last_change":"2024-04-26T12:26:52.839759+0000","last_active":"2024-04-26T12:27:57.695597+0000","last_peered":"2024-04-26T12:27:57.695597+0000","last_clean":"2024-04-26T12:27:57.695597+0000","last_became_active":"2024-04-26T12:26:52.839445+0000","last_became_peered":"2024-04-26T12:26:52.839445+0000","last_unstale":"2024-04-26T12:27:57.695597+0000","last_undegraded":"2024-04-26T12:27:57.695597+0000","last_fullsized":"2024-04-26T12:27:57.695597+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:40.499263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696976+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:27:57.696976+0000","last_peered":"2024-04-26T12:27:57.696976+0000","last_clean":"2024-04-26T12:27:57.696976+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:27:57.696976+0000","last_undegraded":"2024-04-26T12:27:57.696976+0000","last_fullsized":"2024-04-26T12:27:57.696976+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695704+0000","last_change":"2024-04-26T12:27:48.668268+0000","last_active":"2024-04-26T12:27:57.695704+0000","last_peered":"2024-04-26T12:27:57.695704+0000","last_clean":"2024-04-26T12:27:45.658104+0000","last_became_active":"2024-04-26T12:27:48.668268+0000","last_became_peered":"2024-04-26T12:27:48.668268+0000","last_unstale":"2024-04-26T12:27:57.695704+0000","last_undegraded":"2024-04-26T12:27:57.695704+0000","last_fullsized":"2024-04-26T12:27:48.664179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:23.206979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696534+0000","last_change":"2024-04-26T12:27:48.670050+0000","last_active":"2024-04-26T12:27:57.696534+0000","last_peered":"2024-04-26T12:27:57.696534+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.670050+0000","last_became_peered":"2024-04-26T12:27:48.670050+0000","last_unstale":"2024-04-26T12:27:57.696534+0000","last_undegraded":"2024-04-26T12:27:57.696534+0000","last_fullsized":"2024-04-26T12:27:48.665739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:55.100055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696498+0000","last_change":"2024-04-26T12:27:48.668575+0000","last_active":"2024-04-26T12:27:57.696498+0000","last_peered":"2024-04-26T12:27:57.696498+0000","last_clean":"2024-04-26T12:26:46.799248+0000","last_became_active":"2024-04-26T12:27:48.668575+0000","last_became_peered":"2024-04-26T12:27:48.668575+0000","last_unstale":"2024-04-26T12:27:57.696498+0000","last_undegraded":"2024-04-26T12:27:57.696498+0000","last_fullsized":"2024-04-26T12:27:48.665159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:22.199253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.697039+0000","last_change":"2024-04-26T12:27:48.669802+0000","last_active":"2024-04-26T12:27:57.697039+0000","last_peered":"2024-04-26T12:27:57.697039+0000","last_clean":"2024-04-26T12:27:45.659254+0000","last_became_active":"2024-04-26T12:27:48.669802+0000","last_became_peered":"2024-04-26T12:27:48.669802+0000","last_unstale":"2024-04-26T12:27:57.697039+0000","last_undegraded":"2024-04-26T12:27:57.697039+0000","last_fullsized":"2024-04-26T12:27:48.666715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:54.094956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696040+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:27:57.696040+0000","last_peered":"2024-04-26T12:27:57.696040+0000","last_clean":"2024-04-26T12:27:57.696040+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:27:57.696040+0000","last_undegraded":"2024-04-26T12:27:57.696040+0000","last_fullsized":"2024-04-26T12:27:57.696040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696315+0000","last_change":"2024-04-26T12:27:48.668671+0000","last_active":"2024-04-26T12:27:57.696315+0000","last_peered":"2024-04-26T12:27:57.696315+0000","last_clean":"2024-04-26T12:27:45.659071+0000","last_became_active":"2024-04-26T12:27:48.668671+0000","last_became_peered":"2024-04-26T12:27:48.668671+0000","last_unstale":"2024-04-26T12:27:57.696315+0000","last_undegraded":"2024-04-26T12:27:57.696315+0000","last_fullsized":"2024-04-26T12:27:48.665219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:12.771783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696310+0000","last_change":"2024-04-26T12:27:48.668565+0000","last_active":"2024-04-26T12:27:57.696310+0000","last_peered":"2024-04-26T12:27:57.696310+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.668565+0000","last_became_peered":"2024-04-26T12:27:48.668565+0000","last_unstale":"2024-04-26T12:27:57.696310+0000","last_undegraded":"2024-04-26T12:27:57.696310+0000","last_fullsized":"2024-04-26T12:27:48.665406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:49.102502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695901+0000","last_change":"2024-04-26T12:27:48.668236+0000","last_active":"2024-04-26T12:27:57.695901+0000","last_peered":"2024-04-26T12:27:57.695901+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.668236+0000","last_became_peered":"2024-04-26T12:27:48.668236+0000","last_unstale":"2024-04-26T12:27:57.695901+0000","last_undegraded":"2024-04-26T12:27:57.695901+0000","last_fullsized":"2024-04-26T12:27:48.664413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:13.595357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695695+0000","last_change":"2024-04-26T12:27:48.666868+0000","last_active":"2024-04-26T12:27:57.695695+0000","last_peered":"2024-04-26T12:27:57.695695+0000","last_clean":"2024-04-26T12:26:46.799248+0000","last_became_active":"2024-04-26T12:27:48.666868+0000","last_became_peered":"2024-04-26T12:27:48.666868+0000","last_unstale":"2024-04-26T12:27:57.695695+0000","last_undegraded":"2024-04-26T12:27:57.695695+0000","last_fullsized":"2024-04-26T12:27:48.664153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:07.383100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.695600+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:27:57.695600+0000","last_peered":"2024-04-26T12:27:57.695600+0000","last_clean":"2024-04-26T12:27:57.695600+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:27:57.695600+0000","last_undegraded":"2024-04-26T12:27:57.695600+0000","last_fullsized":"2024-04-26T12:27:57.695600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696492+0000","last_change":"2024-04-26T12:27:48.669503+0000","last_active":"2024-04-26T12:27:57.696492+0000","last_peered":"2024-04-26T12:27:57.696492+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.669503+0000","last_became_peered":"2024-04-26T12:27:48.669503+0000","last_unstale":"2024-04-26T12:27:57.696492+0000","last_undegraded":"2024-04-26T12:27:57.696492+0000","last_fullsized":"2024-04-26T12:27:48.665538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:57.602196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696324+0000","last_change":"2024-04-26T12:27:48.670062+0000","last_active":"2024-04-26T12:27:57.696324+0000","last_peered":"2024-04-26T12:27:57.696324+0000","last_clean":"2024-04-26T12:27:45.659028+0000","last_became_active":"2024-04-26T12:27:48.670062+0000","last_became_peered":"2024-04-26T12:27:48.670062+0000","last_unstale":"2024-04-26T12:27:57.696324+0000","last_undegraded":"2024-04-26T12:27:57.696324+0000","last_fullsized":"2024-04-26T12:27:48.665975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:54.638284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.695906+0000","last_change":"2024-04-26T12:26:46.810189+0000","last_active":"2024-04-26T12:27:57.695906+0000","last_peered":"2024-04-26T12:27:57.695906+0000","last_clean":"2024-04-26T12:27:57.695906+0000","last_became_active":"2024-04-26T12:26:46.809453+0000","last_became_peered":"2024-04-26T12:26:46.809453+0000","last_unstale":"2024-04-26T12:27:57.695906+0000","last_undegraded":"2024-04-26T12:27:57.695906+0000","last_fullsized":"2024-04-26T12:27:57.695906+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:18.618650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695784+0000","last_change":"2024-04-26T12:27:48.667062+0000","last_active":"2024-04-26T12:27:57.695784+0000","last_peered":"2024-04-26T12:27:57.695784+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.667062+0000","last_became_peered":"2024-04-26T12:27:48.667062+0000","last_unstale":"2024-04-26T12:27:57.695784+0000","last_undegraded":"2024-04-26T12:27:57.695784+0000","last_fullsized":"2024-04-26T12:27:48.664383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:46.137368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.697028+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:27:57.697028+0000","last_peered":"2024-04-26T12:27:57.697028+0000","last_clean":"2024-04-26T12:27:57.697028+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:27:57.697028+0000","last_undegraded":"2024-04-26T12:27:57.697028+0000","last_fullsized":"2024-04-26T12:27:57.697028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.695998+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:27:57.695998+0000","last_peered":"2024-04-26T12:27:57.695998+0000","last_clean":"2024-04-26T12:27:57.695998+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:27:57.695998+0000","last_undegraded":"2024-04-26T12:27:57.695998+0000","last_fullsized":"2024-04-26T12:27:57.695998+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695942+0000","last_change":"2024-04-26T12:27:48.668810+0000","last_active":"2024-04-26T12:27:57.695942+0000","last_peered":"2024-04-26T12:27:57.695942+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.668810+0000","last_became_peered":"2024-04-26T12:27:48.668810+0000","last_unstale":"2024-04-26T12:27:57.695942+0000","last_undegraded":"2024-04-26T12:27:57.695942+0000","last_fullsized":"2024-04-26T12:27:48.664798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:00.771299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696768+0000","last_change":"2024-04-26T12:27:48.669740+0000","last_active":"2024-04-26T12:27:57.696768+0000","last_peered":"2024-04-26T12:27:57.696768+0000","last_clean":"2024-04-26T12:27:45.658919+0000","last_became_active":"2024-04-26T12:27:48.669740+0000","last_became_peered":"2024-04-26T12:27:48.669740+0000","last_unstale":"2024-04-26T12:27:57.696768+0000","last_undegraded":"2024-04-26T12:27:57.696768+0000","last_fullsized":"2024-04-26T12:27:48.665507+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:09.757922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696766+0000","last_change":"2024-04-26T12:27:48.671446+0000","last_active":"2024-04-26T12:27:57.696766+0000","last_peered":"2024-04-26T12:27:57.696766+0000","last_clean":"2024-04-26T12:27:45.658894+0000","last_became_active":"2024-04-26T12:27:48.671446+0000","last_became_peered":"2024-04-26T12:27:48.671446+0000","last_unstale":"2024-04-26T12:27:57.696766+0000","last_undegraded":"2024-04-26T12:27:57.696766+0000","last_fullsized":"2024-04-26T12:27:48.666106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:09.912135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696683+0000","last_change":"2024-04-26T12:27:48.668790+0000","last_active":"2024-04-26T12:27:57.696683+0000","last_peered":"2024-04-26T12:27:57.696683+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.668790+0000","last_became_peered":"2024-04-26T12:27:48.668790+0000","last_unstale":"2024-04-26T12:27:57.696683+0000","last_undegraded":"2024-04-26T12:27:57.696683+0000","last_fullsized":"2024-04-26T12:27:48.665576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:47.646378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696050+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:27:57.696050+0000","last_peered":"2024-04-26T12:27:57.696050+0000","last_clean":"2024-04-26T12:27:57.696050+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:27:57.696050+0000","last_undegraded":"2024-04-26T12:27:57.696050+0000","last_fullsized":"2024-04-26T12:27:57.696050+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"15'2","reported_seq":20,"reported_epoch":34,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:27:57.697078+0000","last_change":"2024-04-26T12:27:48.671526+0000","last_active":"2024-04-26T12:27:57.697078+0000","last_peered":"2024-04-26T12:27:57.697078+0000","last_clean":"2024-04-26T12:26:53.249212+0000","last_became_active":"2024-04-26T12:27:48.671526+0000","last_became_peered":"2024-04-26T12:27:48.671526+0000","last_unstale":"2024-04-26T12:27:57.697078+0000","last_undegraded":"2024-04-26T12:27:48.667114+0000","last_fullsized":"2024-04-26T12:27:48.667045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:12.431613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696650+0000","last_change":"2024-04-26T12:27:48.668705+0000","last_active":"2024-04-26T12:27:57.696650+0000","last_peered":"2024-04-26T12:27:57.696650+0000","last_clean":"2024-04-26T12:26:46.799248+0000","last_became_active":"2024-04-26T12:27:48.668705+0000","last_became_peered":"2024-04-26T12:27:48.668705+0000","last_unstale":"2024-04-26T12:27:57.696650+0000","last_undegraded":"2024-04-26T12:27:57.696650+0000","last_fullsized":"2024-04-26T12:27:48.664952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:26.753235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695762+0000","last_change":"2024-04-26T12:27:48.666997+0000","last_active":"2024-04-26T12:27:57.695762+0000","last_peered":"2024-04-26T12:27:57.695762+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.666997+0000","last_became_peered":"2024-04-26T12:27:48.666997+0000","last_unstale":"2024-04-26T12:27:57.695762+0000","last_undegraded":"2024-04-26T12:27:57.695762+0000","last_fullsized":"2024-04-26T12:27:48.664524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:35.445817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696943+0000","last_change":"2024-04-26T12:26:47.811204+0000","last_active":"2024-04-26T12:27:57.696943+0000","last_peered":"2024-04-26T12:27:57.696943+0000","last_clean":"2024-04-26T12:27:57.696943+0000","last_became_active":"2024-04-26T12:26:47.810997+0000","last_became_peered":"2024-04-26T12:26:47.810997+0000","last_unstale":"2024-04-26T12:27:57.696943+0000","last_undegraded":"2024-04-26T12:27:57.696943+0000","last_fullsized":"2024-04-26T12:27:57.696943+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:24.967175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'3","reported_seq":29,"reported_epoch":34,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:27:57.696860+0000","last_change":"2024-04-26T12:27:48.668216+0000","last_active":"2024-04-26T12:27:57.696860+0000","last_peered":"2024-04-26T12:27:57.696860+0000","last_clean":"2024-04-26T12:27:21.599360+0000","last_became_active":"2024-04-26T12:27:48.668216+0000","last_became_peered":"2024-04-26T12:27:48.668216+0000","last_unstale":"2024-04-26T12:27:57.696860+0000","last_undegraded":"2024-04-26T12:27:48.665969+0000","last_fullsized":"2024-04-26T12:27:48.665887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:27.522039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696146+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:27:57.696146+0000","last_peered":"2024-04-26T12:27:57.696146+0000","last_clean":"2024-04-26T12:27:57.696146+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:27:57.696146+0000","last_undegraded":"2024-04-26T12:27:57.696146+0000","last_fullsized":"2024-04-26T12:27:57.696146+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"15'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.695978+0000","last_change":"2024-04-26T12:26:52.840797+0000","last_active":"2024-04-26T12:27:57.695978+0000","last_peered":"2024-04-26T12:27:57.695978+0000","last_clean":"2024-04-26T12:27:57.695978+0000","last_became_active":"2024-04-26T12:26:52.840409+0000","last_became_peered":"2024-04-26T12:26:52.840409+0000","last_unstale":"2024-04-26T12:27:57.695978+0000","last_undegraded":"2024-04-26T12:27:57.695978+0000","last_fullsized":"2024-04-26T12:27:57.695978+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:57.898978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696931+0000","last_change":"2024-04-26T12:27:48.669598+0000","last_active":"2024-04-26T12:27:57.696931+0000","last_peered":"2024-04-26T12:27:57.696931+0000","last_clean":"2024-04-26T12:27:45.658753+0000","last_became_active":"2024-04-26T12:27:48.669598+0000","last_became_peered":"2024-04-26T12:27:48.669598+0000","last_unstale":"2024-04-26T12:27:57.696931+0000","last_undegraded":"2024-04-26T12:27:57.696931+0000","last_fullsized":"2024-04-26T12:27:48.665738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:07.518579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"15'2","reported_seq":23,"reported_epoch":34,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:27:57.696568+0000","last_change":"2024-04-26T12:27:48.669676+0000","last_active":"2024-04-26T12:27:57.696568+0000","last_peered":"2024-04-26T12:27:57.696568+0000","last_clean":"2024-04-26T12:26:55.295915+0000","last_became_active":"2024-04-26T12:27:48.669676+0000","last_became_peered":"2024-04-26T12:27:48.669676+0000","last_unstale":"2024-04-26T12:27:57.696568+0000","last_undegraded":"2024-04-26T12:27:48.665783+0000","last_fullsized":"2024-04-26T12:27:48.665708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:06.786760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696106+0000","last_change":"2024-04-26T12:27:48.668784+0000","last_active":"2024-04-26T12:27:57.696106+0000","last_peered":"2024-04-26T12:27:57.696106+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.668784+0000","last_became_peered":"2024-04-26T12:27:48.668784+0000","last_unstale":"2024-04-26T12:27:57.696106+0000","last_undegraded":"2024-04-26T12:27:57.696106+0000","last_fullsized":"2024-04-26T12:27:48.665101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:14.294850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"15'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696484+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:27:57.696484+0000","last_peered":"2024-04-26T12:27:57.696484+0000","last_clean":"2024-04-26T12:27:57.696484+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:27:57.696484+0000","last_undegraded":"2024-04-26T12:27:57.696484+0000","last_fullsized":"2024-04-26T12:27:57.696484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696077+0000","last_change":"2024-04-26T12:27:48.668102+0000","last_active":"2024-04-26T12:27:57.696077+0000","last_peered":"2024-04-26T12:27:57.696077+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.668102+0000","last_became_peered":"2024-04-26T12:27:48.668102+0000","last_unstale":"2024-04-26T12:27:57.696077+0000","last_undegraded":"2024-04-26T12:27:57.696077+0000","last_fullsized":"2024-04-26T12:27:48.664978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:28.219817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"15'1","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696432+0000","last_change":"2024-04-26T12:27:48.668509+0000","last_active":"2024-04-26T12:27:57.696432+0000","last_peered":"2024-04-26T12:27:57.696432+0000","last_clean":"2024-04-26T12:26:51.814712+0000","last_became_active":"2024-04-26T12:27:48.668509+0000","last_became_peered":"2024-04-26T12:27:48.668509+0000","last_unstale":"2024-04-26T12:27:57.696432+0000","last_undegraded":"2024-04-26T12:27:57.696432+0000","last_fullsized":"2024-04-26T12:27:48.664656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:21.541532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":2,"reported_epoch":35,"state":"peering","last_fresh":"2024-04-26T12:27:57.696299+0000","last_change":"2024-04-26T12:28:00.305238+0000","last_active":"2024-04-26T12:28:00.305238+0000","last_peered":"2024-04-26T12:27:57.696299+0000","last_clean":"2024-04-26T12:27:45.658304+0000","last_became_active":"2024-04-26T12:27:48.668437+0000","last_became_peered":"2024-04-26T12:27:48.668437+0000","last_unstale":"2024-04-26T12:27:57.696299+0000","last_undegraded":"2024-04-26T12:27:57.696299+0000","last_fullsized":"2024-04-26T12:27:48.664530+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:07.657551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"15'4","reported_seq":20,"reported_epoch":34,"state":"active+undersized+degraded","last_fresh":"2024-04-26T12:27:57.697048+0000","last_change":"2024-04-26T12:27:48.668882+0000","last_active":"2024-04-26T12:27:57.697048+0000","last_peered":"2024-04-26T12:27:57.697048+0000","last_clean":"2024-04-26T12:26:53.249466+0000","last_became_active":"2024-04-26T12:27:48.668882+0000","last_became_peered":"2024-04-26T12:27:48.668882+0000","last_unstale":"2024-04-26T12:27:57.697048+0000","last_undegraded":"2024-04-26T12:27:48.666190+0000","last_fullsized":"2024-04-26T12:27:48.666104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:59.729519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696152+0000","last_change":"2024-04-26T12:27:48.668041+0000","last_active":"2024-04-26T12:27:57.696152+0000","last_peered":"2024-04-26T12:27:57.696152+0000","last_clean":"2024-04-26T12:27:45.658980+0000","last_became_active":"2024-04-26T12:27:48.668041+0000","last_became_peered":"2024-04-26T12:27:48.668041+0000","last_unstale":"2024-04-26T12:27:57.696152+0000","last_undegraded":"2024-04-26T12:27:57.696152+0000","last_fullsized":"2024-04-26T12:27:48.665471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:25.403127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.696022+0000","last_change":"2024-04-26T12:27:48.669908+0000","last_active":"2024-04-26T12:27:57.696022+0000","last_peered":"2024-04-26T12:27:57.696022+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.669908+0000","last_became_peered":"2024-04-26T12:27:48.669908+0000","last_unstale":"2024-04-26T12:27:57.696022+0000","last_undegraded":"2024-04-26T12:27:57.696022+0000","last_fullsized":"2024-04-26T12:27:48.664986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:44.773012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695638+0000","last_change":"2024-04-26T12:27:48.666218+0000","last_active":"2024-04-26T12:27:57.695638+0000","last_peered":"2024-04-26T12:27:57.695638+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.666218+0000","last_became_peered":"2024-04-26T12:27:48.666218+0000","last_unstale":"2024-04-26T12:27:57.695638+0000","last_undegraded":"2024-04-26T12:27:57.695638+0000","last_fullsized":"2024-04-26T12:27:48.664092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:17.742404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696064+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:27:57.696064+0000","last_peered":"2024-04-26T12:27:57.696064+0000","last_clean":"2024-04-26T12:27:57.696064+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:27:57.696064+0000","last_undegraded":"2024-04-26T12:27:57.696064+0000","last_fullsized":"2024-04-26T12:27:57.696064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-04-26T12:27:57.695895+0000","last_change":"2024-04-26T12:27:48.667318+0000","last_active":"2024-04-26T12:27:57.695895+0000","last_peered":"2024-04-26T12:27:57.695895+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.667318+0000","last_became_peered":"2024-04-26T12:27:48.667318+0000","last_unstale":"2024-04-26T12:27:57.695895+0000","last_undegraded":"2024-04-26T12:27:57.695895+0000","last_fullsized":"2024-04-26T12:27:48.664546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:35.445817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T12:27:57.696806+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:27:57.696806+0000","last_peered":"2024-04-26T12:27:57.696806+0000","last_clean":"2024-04-26T12:27:57.696806+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:27:57.696806+0000","last_undegraded":"2024-04-26T12:27:57.696806+0000","last_fullsized":"2024-04-26T12:27:57.696806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7305,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":43,"acting":43,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738386,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":728051,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.307}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.35899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738386,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":728667,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.33100000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738382,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":100398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:28:06.041 INFO:tasks.thrashosds.thrasher:Setting 4.8 to [1, 0, 2] 2024-04-26T12:28:06.042 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.8', '1', '0', '2'] 2024-04-26T12:28:06.042 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.8 1 0 2 2024-04-26T12:28:06.043 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:06.104 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:06.104+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:06.169 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:06.169 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:06.179 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:06.205 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:06.205+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:06.305 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:06.306 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:06.306 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:06.305+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:06.315 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:06.407 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:06.405+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:06.441 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:06.441 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:06.451 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:06.487 INFO:teuthology.orchestra.run.smithi046.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-26T12:28:06.489 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:28:06.490 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-26T12:28:06.534 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:06.533+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:06.608 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:06.607+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:06.618 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:06.618 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:06.628 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:06.673 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:28:06.708 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:06.708+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:06.731 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2024-04-26T12:28:06.759 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:06.759 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:06.769 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:06.810 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:06.810+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:06.887 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:06.911 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:06.910+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:06.914 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:06.914 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:06.914 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:06.914 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:06.918 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:06.918 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:06.937 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:06.937 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:06.937 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:06.937 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:06.937 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:06.947 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:07.031 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:07.031+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:07.113 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:07.112+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:07.116 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:28:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.232430859000004, 2024-04-26T12:28:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:28:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:28:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:28:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:28:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:28:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:28:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:28:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:28:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:28:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:28:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:28:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:28:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:28:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:28:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:28:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.231791512000001, 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:28:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:28:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:28:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:28:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:28:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:28:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:28:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:28:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:28:07.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:28:07.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:28:07.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:28:07.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:28:07.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:28:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:28:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:28:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.102089321999998, 2024-04-26T12:28:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:28:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.127 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:07.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:07.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:28:07.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:07.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:28:07.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:28:07.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:28:07.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:28:07.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:28:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:28:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:28:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:28:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:28:07.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:28:07.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:28:07.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:28:07.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:28:07.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:28:07.132 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.132 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.133 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.133 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:28:07.133 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:07.133 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.101594735999996, 2024-04-26T12:28:07.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:28:07.133 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.133 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.133 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:07.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:07.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:07.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:28:07.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:28:07.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:28:07.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:28:07.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:28:07.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:28:07.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:28:07.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:28:07.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:28:07.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:28:07.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:28:07.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:28:07.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:28:07.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:28:07.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.137 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.137 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:28:07.137 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:07.138 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.099592552000004, 2024-04-26T12:28:07.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:28:07.138 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.138 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.138 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:07.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:07.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:28:07.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:28:07.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:28:07.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:28:07.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:28:07.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:28:07.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:07.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:28:07.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:28:07.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.141 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.142 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.142 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:28:07.142 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:07.142 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.099186212000006, 2024-04-26T12:28:07.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:28:07.142 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.142 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.142 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:07.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:07.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:28:07.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:28:07.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:28:07.146 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.146 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.146 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.146 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:28:07.146 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:07.146 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.098831387999994, 2024-04-26T12:28:07.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:28:07.146 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.146 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.147 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:07.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:07.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:28:07.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:28:07.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:28:07.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:28:07.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:28:07.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:28:07.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:07.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:28:07.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:28:07.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:28:07.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:28:07.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:28:07.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:28:07.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:28:07.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:28:07.150 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.150 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.150 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.150 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:28:07.151 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:07.151 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.996272973999993, 2024-04-26T12:28:07.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:28:07.151 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.151 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.151 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:07.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:07.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:28:07.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:07.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:28:07.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:28:07.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:28:07.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:28:07.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:28:07.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:07.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.995876445999997, 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:28:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:28:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:28:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:28:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:28:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:28:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:28:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:28:07.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:28:07.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:28:07.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:28:07.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:28:07.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:28:07.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:28:07.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:28:07.159 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.159 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.159 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.159 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:28:07.159 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:07.159 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.898866838000004, 2024-04-26T12:28:07.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:28:07.160 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.160 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.160 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:07.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:07.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:07.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:28:07.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:28:07.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:28:07.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:28:07.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:28:07.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:07.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:28:07.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:28:07.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.164 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:28:07.164 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:07.164 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.898173122000003, 2024-04-26T12:28:07.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:28:07.164 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.164 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.164 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:07.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:07.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:07.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:28:07.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:28:07.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:28:07.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:28:07.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:28:07.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:28:07.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:28:07.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:28:07.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:28:07.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:28:07.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:28:07.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:28:07.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:28:07.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:28:07.168 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.168 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.168 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.168 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.168 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:07.168 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.863434067, 2024-04-26T12:28:07.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:07.168 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.168 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.168 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:07.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:07.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:07.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:07.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:07.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:07.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:07.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:07.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:07.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:07.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:07.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:07.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:07.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:07.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:07.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:07.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:07.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:07.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:07.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:07.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:07.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:07.173 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.862613147999994, 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:07.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:07.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:07.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:07.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:07.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:07.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:07.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:07.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:07.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:07.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:07.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:07.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:07.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:07.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:07.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:07.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:07.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.862583057999998, 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:07.179 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:07.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:07.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:07.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:07.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:07.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:07.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:07.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:07.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:07.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:07.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.184 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.184 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.862529269999996, 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:07.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:07.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:07.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:07.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:07.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.862476713000007, 2024-04-26T12:28:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.862436498999998, 2024-04-26T12:28:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:07.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:07.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.862408337999995, 2024-04-26T12:28:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:07.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:07.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:07.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:07.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:07.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:07.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:07.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.862377648999995, 2024-04-26T12:28:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.862351075999996, 2024-04-26T12:28:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:07.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:07.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:07.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:07.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:07.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:07.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:07.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:07.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:07.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:07.217 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:07.219 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:07.218+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:07.219 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:07.319 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:07.319+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:07.348 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:07.348 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:07.348 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:07.358 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:07.442 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:07.442+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:07.521 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:07.521+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:07.524 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:07.524 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:07.524 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:07.524 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:07.524 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:07.534 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:07.623 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:07.622+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:07.703 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:07.703 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:07.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:07.703 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:07.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.703 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:28:07.703 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:07.703 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 80.370248317000005, 2024-04-26T12:28:07.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:28:07.704 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.704 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.704 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:07.704 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:28:07.704 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:28:07.704 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:28:07.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.704 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:07.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:07.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:07.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:28:07.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:28:07.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:28:07.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:28:07.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:28:07.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:28:07.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:28:07.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:28:07.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:28:07.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:28:07.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:28:07.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:28:07.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:28:07.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:28:07.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:28:07.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:28:07.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:28:07.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:28:07.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:28:07.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:28:07.710 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.710 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.710 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.710 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.711 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:07.711 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.451382494000001, 2024-04-26T12:28:07.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:07.711 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.711 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.711 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:07.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:07.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:07.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:07.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:07.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:07.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:07.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:07.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:07.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:07.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:07.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:07.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:07.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:07.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:07.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:07.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:07.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:07.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:07.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:07.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:07.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:07.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:07.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:07.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:07.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:07.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:07.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:07.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:07.717 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.717 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.717 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.717 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.717 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:07.718 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.451346282000003, 2024-04-26T12:28:07.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:07.718 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.718 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.718 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:07.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:07.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:07.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:07.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:07.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:07.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:07.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:07.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:07.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:07.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:07.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:07.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:07.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:07.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:07.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:07.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:07.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:07.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:07.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.723 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.724 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.724 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.724 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:07.724 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.451307307999997, 2024-04-26T12:28:07.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:07.724 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.724 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.724 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:07.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:07.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:07.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:07.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:07.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:07.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:07.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:07.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:07.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:07.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:07.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:07.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:07.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:07.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:07.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:07.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:07.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:07.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:07.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:07.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:07.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:07.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:07.730 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.730 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.730 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.730 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.730 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:07.730 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.451284141000002, 2024-04-26T12:28:07.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:07.730 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.731 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.731 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:07.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:07.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:07.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:07.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:07.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:07.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:07.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:07.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:07.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:07.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:07.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:07.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:07.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:07.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:07.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.737 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.737 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:07.737 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.451268764000005, 2024-04-26T12:28:07.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:07.737 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.737 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.737 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:07.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:07.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:07.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:07.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:07.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:07.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:07.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:07.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:07.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:07.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:07.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:07.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:07.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:07.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:07.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:07.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:07.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:07.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:07.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:07.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.451240573999996, 2024-04-26T12:28:07.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:07.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:07.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:07.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:07.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:07.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:07.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:07.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:07.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:07.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:07.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:07.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:07.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:07.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:07.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:07.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:07.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:07.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:07.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:07.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:07.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:07.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:07.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:07.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:07.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:07.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:07.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.752 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.753 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.753 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.753 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:07.753 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.451222576000006, 2024-04-26T12:28:07.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:07.753 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.753 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.753 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:07.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:07.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:07.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:07.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:07.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:07.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:07.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:07.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:07.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:07.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:07.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:07.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:07.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:07.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:07.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:07.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:07.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:07.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:07.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.451197984999993, 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:07.759 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.760 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.760 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:07.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:07.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:07.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:07.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:07.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:07.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:07.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:07.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:07.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:07.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:07.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:07.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:07.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:07.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:07.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:07.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:07.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:07.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:07.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:07.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:07.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:07.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:07.767 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.767 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.767 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.767 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.767 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:07.767 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.451173036, 2024-04-26T12:28:07.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:07.767 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.767 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.767 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:07.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:07.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:07.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:07.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:07.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:07.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:07.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:07.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:07.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:07.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:07.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:07.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:07.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:07.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:07.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:07.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:07.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:07.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:07.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:07.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:07.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:07.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:07.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:07.773 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.773 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.773 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.774 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.774 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:07.774 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.451152112000003, 2024-04-26T12:28:07.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:07.774 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.774 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.774 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:07.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:07.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:07.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:07.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:07.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:07.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:07.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:07.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:07.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:07.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:07.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:07.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:07.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:07.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:07.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:07.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:07.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:07.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.780 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.780 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:07.780 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.451117263, 2024-04-26T12:28:07.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:07.780 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.780 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.780 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:07.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:07.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:07.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:07.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:07.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:07.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:07.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:07.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:07.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:07.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:07.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:07.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:07.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:07.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:07.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:07.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:07.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:07.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:07.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:07.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:07.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:07.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:07.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:07.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:07.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:07.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:07.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:07.787 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.787 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.787 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.787 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.788 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:07.788 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.451083312999998, 2024-04-26T12:28:07.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:07.788 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.788 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.788 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:07.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:07.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:07.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:07.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:07.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:07.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:07.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:07.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:07.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:07.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:07.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:07.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:07.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:07.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:07.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:07.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:07.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:07.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:07.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:07.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:07.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:07.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:07.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:07.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:07.794 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.794 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.794 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.794 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.794 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:07.794 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.451063016000006, 2024-04-26T12:28:07.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:07.794 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.794 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.795 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:07.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:07.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:07.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:07.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:07.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:07.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:07.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:07.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:07.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:07.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:07.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:07.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:07.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:07.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:07.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:07.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:07.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:07.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:07.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:07.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:07.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:07.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:07.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:07.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:07.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:07.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:07.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:07.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:07.800 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.801 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.801 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.801 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:07.801 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.451027894999996, 2024-04-26T12:28:07.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:07.801 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.801 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.801 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:07.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:07.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:07.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:07.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:07.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:07.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:07.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:07.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:07.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:07.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:07.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:07.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:07.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:07.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:07.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:07.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:07.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:07.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:07.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:07.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:07.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:07.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:07.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:07.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:07.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:07.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:07.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:07.809 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.809 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.809 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.809 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.809 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:07.809 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.450992654999993, 2024-04-26T12:28:07.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:07.809 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.809 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.809 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:07.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:07.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:07.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:07.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:07.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:07.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:07.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:07.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:07.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:07.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:07.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:07.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:07.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:07.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:07.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:07.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:07.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:07.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:07.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:07.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:07.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:07.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:07.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:07.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:07.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:07.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:07.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:07.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:07.815 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.815 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.815 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.815 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.815 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:07.815 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.450850907000003, 2024-04-26T12:28:07.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:07.816 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.816 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.816 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:07.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:07.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:07.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:07.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:07.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:07.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:07.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:07.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:07.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:07.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:07.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:07.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:07.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:07.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:07.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:07.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.822 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.822 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:07.822 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.450826887999995, 2024-04-26T12:28:07.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:07.822 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.822 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.822 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:07.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:07.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:07.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:07.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:07.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:07.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:07.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:07.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:07.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:07.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:07.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:07.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:07.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:07.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:07.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:07.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:07.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:07.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:07.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:07.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:07.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:07.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:07.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:07.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:07.827 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.827 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.827 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.828 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.828 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:07.828 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.450802920000001, 2024-04-26T12:28:07.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:07.828 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.828 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:07.828 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:07.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:07.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:07.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:07.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:07.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:07.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:07.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:07.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:07.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:07.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:07.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:07.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:07.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:07.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:07.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:07.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:07.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:07.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:07.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:07.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:07.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:07.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:07.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:07.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:07.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:07.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:07.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:07.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:07.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:07.834 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.834 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.834 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.835 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:07.835 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:07.835 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.450769539000007, 2024-04-26T12:28:07.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:07.835 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:07.835 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:07.835 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:07.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:07.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:07.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:07.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:07.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:07.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:07.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:07.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:07.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:07.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:07.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:07.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:07.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:07.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:07.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:07.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:07.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:07.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:07.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:07.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:07.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:07.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:07.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:07.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:07.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:07.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:07.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:07.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:07.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:07.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:07.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:07.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:07.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:07.840 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.840 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.840 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.840 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:07.840 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:07.840 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:07.842 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:07.843 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:07.841+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:07.942 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:07.942+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:07.981 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:07.982 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:07.982 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:07.982 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:07.992 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:08.075 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:08.075+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:08.144 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:08.143+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:08.158 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:08.158 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:08.158 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:08.158 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:08.158 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:08.168 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:08.244 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:08.244+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:08.337 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:28:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 81.453234526000003, 2024-04-26T12:28:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:28:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:28:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:28:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:28:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:28:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:28:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 81.452595178999999, 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:28:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:28:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:28:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:28:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:28:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:28:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:28:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:28:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:28:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:28:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:28:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:28:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:28:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:28:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:28:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:28:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 81.322892988999996, 2024-04-26T12:28:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:28:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:28:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:28:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:28:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:28:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:28:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:28:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:28:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:28:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:28:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:28:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:28:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:28:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:28:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:28:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 81.322398402999994, 2024-04-26T12:28:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:28:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:28:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:28:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:28:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:28:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:28:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:28:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:28:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:28:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:28:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:28:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:28:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:28:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:28:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:28:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 81.320396219000003, 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:28:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:28:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:28:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:28:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:28:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:28:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:28:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:28:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:28:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:28:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 81.319989879000005, 2024-04-26T12:28:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:28:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:28:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:28:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:28:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:28:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:28:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:28:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:28:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:28:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:28:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 81.319635055000006, 2024-04-26T12:28:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:28:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:28:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:28:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:28:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:28:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:28:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 81.217076641000006, 2024-04-26T12:28:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:28:08.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:08.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:28:08.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:28:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:28:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:28:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:28:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:28:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:28:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:28:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 81.216680112999995, 2024-04-26T12:28:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:28:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:28:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:28:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:28:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:28:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:28:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:28:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:28:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:28:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:28:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:28:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:28:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 81.119670505000002, 2024-04-26T12:28:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:28:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:28:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:28:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:28:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:28:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:28:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:28:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:28:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:28:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:28:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:28:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:28:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:28:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:28:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 81.118976789000001, 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:28:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:28:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:28:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:28:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:28:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:28:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:28:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:28:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.084237733999998, 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.083416815000007, 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.083386724999997, 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.083332936999994, 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.083280380000005, 2024-04-26T12:28:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.083240165999996, 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.083212004999993, 2024-04-26T12:28:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.083181315999994, 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.083154742999994, 2024-04-26T12:28:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:08.430 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:08.432 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:08.432 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:08.431+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:08.533 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:08.532+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:08.565 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:08.565 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:08.565 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:08.565 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:08.575 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:08.634 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:08.633+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:08.703 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:08.703 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:08.703 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:08.703 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:08.703 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:08.713 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:08.735 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:08.735+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:08.747 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:28:08.836 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:08.835+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:08.882 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:08.882 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:08.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:08.882 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:08.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.882 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:28:08.882 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:08.882 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 81.548982585000005, 2024-04-26T12:28:08.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:28:08.883 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.883 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.883 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:08.883 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:28:08.883 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:28:08.883 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:28:08.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.883 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:08.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:08.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:08.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:28:08.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:28:08.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:28:08.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:28:08.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:28:08.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:28:08.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:28:08.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:28:08.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:28:08.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:28:08.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:08.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:28:08.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:28:08.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:28:08.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:28:08.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:28:08.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:28:08.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:28:08.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:28:08.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.630116762, 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.889 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:08.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:08.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:08.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:08.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:08.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:08.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:08.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:08.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:08.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:08.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:08.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:08.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:08.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:08.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:08.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:08.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:08.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:08.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:08.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:08.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:08.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:08.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:08.895 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.895 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.895 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.895 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.630080550000002, 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:08.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:08.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:08.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:08.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:08.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:08.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:08.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:08.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:08.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:08.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:08.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:08.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:08.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:08.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:08.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:08.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:08.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:08.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:08.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:08.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:08.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:08.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.901 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.902 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.902 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.902 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:08.902 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.630041575999996, 2024-04-26T12:28:08.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:08.902 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.902 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.902 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:08.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:08.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:08.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:08.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:08.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:08.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:08.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:08.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:08.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:08.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:08.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:08.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:08.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:08.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:08.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:08.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:08.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:08.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:08.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:08.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:08.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:08.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:08.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:08.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:08.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:08.908 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.908 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.908 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.908 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.630018409000002, 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:08.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:08.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:08.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:08.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:08.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:08.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:08.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:08.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:08.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:08.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:08.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:08.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:08.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:08.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:08.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:08.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:08.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:08.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:08.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:08.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:08.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:08.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:08.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:08.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:08.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:08.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:08.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:08.915 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.915 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.915 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.915 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.915 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:08.915 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.630003032000005, 2024-04-26T12:28:08.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:08.915 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.915 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:08.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:08.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:08.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:08.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:08.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:08.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:08.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:08.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:08.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:08.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:08.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:08.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:08.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:08.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:08.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:08.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:08.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:08.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:08.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:08.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:08.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:08.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:08.921 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.921 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.921 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.921 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.922 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:08.922 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.629974841999996, 2024-04-26T12:28:08.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:08.922 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.922 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.922 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:08.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:08.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:08.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:08.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:08.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:08.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:08.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:08.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:08.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:08.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:08.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:08.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:08.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:08.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:08.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:08.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:08.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:08.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.629956844000006, 2024-04-26T12:28:08.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:08.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:08.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:08.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:08.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:08.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:08.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:08.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:08.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:08.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:08.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:08.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:08.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:08.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:08.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:08.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:08.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:08.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:08.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:08.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:08.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:08.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:08.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:08.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.934 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:08.935 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.629932253000007, 2024-04-26T12:28:08.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:08.935 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.935 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.935 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:08.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:08.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:08.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:08.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:08.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:08.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:08.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:08.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:08.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:08.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:08.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:08.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:08.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:08.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:08.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:08.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:08.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:08.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:08.940 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.940 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.940 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.629907304, 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:08.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:08.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:08.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:08.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:08.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:08.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:08.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:08.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:08.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:08.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:08.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:08.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:08.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:08.946 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.946 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.946 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.947 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.947 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:08.947 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.629886380000002, 2024-04-26T12:28:08.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:08.947 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.947 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.947 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:08.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:08.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:08.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:08.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:08.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:08.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:08.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:08.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:08.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:08.952 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.952 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.952 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.953 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.953 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:08.953 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.629851531, 2024-04-26T12:28:08.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:08.953 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.953 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.953 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:08.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:08.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:08.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:08.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:08.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:08.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:08.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:08.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:08.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:08.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:08.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:08.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:08.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:08.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:08.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:08.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:08.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:08.958 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.958 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.958 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.959 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.959 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:08.959 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.629817580999998, 2024-04-26T12:28:08.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:08.959 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.959 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.959 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:08.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:08.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:08.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:08.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:08.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:08.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:08.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:08.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:08.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:08.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:08.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:08.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:08.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:08.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:08.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:08.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:08.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:08.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:08.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:08.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:08.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:08.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:08.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:08.966 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.629797284000006, 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:08.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:08.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:08.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:08.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:08.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:08.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:08.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:08.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:08.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:08.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:08.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:08.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:08.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:08.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:08.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:08.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:08.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:08.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:08.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:08.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:08.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:08.972 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.629762162999995, 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:08.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:08.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:08.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:08.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:08.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:08.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:08.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:08.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:08.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:08.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:08.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:08.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:08.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:08.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:08.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:08.978 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.629726923000007, 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:08.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:08.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:08.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:08.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:08.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:08.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:08.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:08.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:08.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:08.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:08.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:08.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:08.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:08.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:08.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:08.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:08.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:08.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:08.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:08.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:08.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:08.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:08.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:08.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:08.985 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.985 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.985 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.985 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.985 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:08.985 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.629585175000003, 2024-04-26T12:28:08.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:08.985 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.985 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.986 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:08.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:08.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:08.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:08.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:08.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:08.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:08.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:08.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:08.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:08.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:08.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:08.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:08.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:08.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:08.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:08.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:08.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:08.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:08.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:08.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:08.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:08.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:08.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:08.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:08.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:08.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:08.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:08.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:08.991 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.991 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.991 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.629561155999994, 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:08.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:08.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:08.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:08.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:08.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:08.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:08.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:08.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:08.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:08.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:08.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:08.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:08.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:08.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:08.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:08.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:08.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.998 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:08.998 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:08.998 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.629537188, 2024-04-26T12:28:08.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:08.998 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:08.998 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:08.998 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:08.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:08.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:08.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:08.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:09.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:09.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:09.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:09.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:09.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:09.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:09.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:09.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:09.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:09.003 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:09.004 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 75.629503807000006, 2024-04-26T12:28:09.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:09.004 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:09.004 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:09.004 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:09.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:09.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:09.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:09.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:09.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:09.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:09.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:09.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:09.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:09.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:09.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:09.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:09.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:09.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:09.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:09.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:09.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:09.008 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:09.008 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:09.008 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:09.008 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:09.008 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:09.008 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:09.008 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:28:09.010 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:09.009+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:09.010 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:09.110 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:09.110+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:09.139 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:09.140 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:09.140 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:09.140 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:09.151 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:09.211 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:09.211+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:09.241 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:09.277 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:09.278 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:09.278 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:09.278 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:09.278 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:09.278 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:09.281 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:09.282 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:09.288 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:09.312 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:09.312+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:09.413 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:09.413+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:09.414 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:09.414 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:09.424 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:09.514 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:09.513+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:09.552 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:09.552 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:09.561 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:09.614 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~17s 2024-04-26T12:28:09.615 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:09.615+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:09.687 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:09.688 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:09.697 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:09.739 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:09.739+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2024-04-26T12:28:09.817 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:09.816+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:09.866 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:09.866 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:09.876 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:09.917 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:09.917+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:10.004 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:10.004 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:10.013 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:10.019 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:10.018+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:10.119 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:10.119+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:10.139 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:10.139 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:10.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:10.220 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:10.220+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:10.275 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:10.275 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:10.285 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:10.327 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:10.326+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:10.412 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:10.413 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:10.423 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:10.424 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:10.422+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:10.523 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:10.522+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:10.589 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:10.590 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:10.602 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:10.625 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:10.624+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:10.726 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:10.725+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:10.729 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:10.729 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:10.739 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:10.827 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:10.826+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:10.876 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:10.876 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:10.886 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:10.928 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:10.927+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:11.029 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:11.028+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:11.051 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:11.051 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:11.062 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:11.130 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:11.130+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:11.227 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:11.228 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:11.231 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:11.230+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:11.238 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:11.282 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:28:11.332 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:11.332+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:11.367 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:11.367 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:11.377 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:11.434 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:11.433+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:11.448 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:11.468 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:11.468 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:11.469 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:11.469 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:11.471 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:11.472 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:11.491 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T12:28:11.491 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:28:11.491 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-26T12:28:11.491 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:28:11.491 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:28:11.492 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-26T12:28:11.504 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:11.504 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:11.504 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:11.504 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:11.504 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:11.515 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:11.534 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:11.534+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:11.620 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: "success": "" 2024-04-26T12:28:11.620 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:11.635 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:11.634+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:11.687 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:11.687 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:11.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:11.687 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:11.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.687 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:28:11.687 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:11.687 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.354082790999996, 2024-04-26T12:28:11.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:28:11.688 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.688 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.688 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:11.688 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:28:11.688 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:28:11.688 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:28:11.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.688 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:11.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:11.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:11.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:28:11.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:28:11.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:28:11.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:28:11.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:28:11.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:28:11.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:28:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:28:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:28:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:28:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:28:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:28:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:28:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:28:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:28:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:28:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.693 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.435216968000006, 2024-04-26T12:28:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:11.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.699 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.435180755999994, 2024-04-26T12:28:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:11.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:11.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:11.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:11.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:11.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:11.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:11.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:11.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:11.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:11.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:11.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:11.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:11.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:11.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:11.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:11.706 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.706 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.706 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.706 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.706 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:11.706 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.435141782000002, 2024-04-26T12:28:11.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:11.707 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.707 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.707 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:11.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:11.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:11.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:11.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:11.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:11.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:11.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:11.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:11.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:11.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:11.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:11.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:11.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:11.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:11.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:11.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:11.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:11.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:11.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.712 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:11.713 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.435118614999993, 2024-04-26T12:28:11.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:11.713 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.713 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.713 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:11.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:11.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:11.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:11.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:11.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:11.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:11.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:11.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:11.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:11.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:11.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:11.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:11.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:11.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:11.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:11.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:11.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:11.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:11.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:11.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:11.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:11.718 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.718 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.718 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.435103237999996, 2024-04-26T12:28:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:11.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:11.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:11.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:11.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:11.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:11.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:11.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:11.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:11.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:11.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:11.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:11.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:11.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:11.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:11.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:11.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:11.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:11.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:11.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:11.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:11.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:11.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:11.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:11.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:11.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:11.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:11.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:11.725 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.725 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.725 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.725 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.725 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:11.725 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.435075048000002, 2024-04-26T12:28:11.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:11.725 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.725 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.725 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:11.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:11.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:11.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:11.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:11.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:11.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:11.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:11.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:11.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:11.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:11.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:11.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:11.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:11.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:11.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:11.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:11.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:11.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:11.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:11.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:11.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:11.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:11.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:11.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:11.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:11.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.435057049999998, 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.731 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.732 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:11.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:11.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:11.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:11.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:11.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:11.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:11.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:11.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:11.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:11.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:11.737 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.737 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.737 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.737 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.737 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:11.737 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.435032458999999, 2024-04-26T12:28:11.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:11.737 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.738 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.738 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:11.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:11.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:11.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:11.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:11.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:11.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:11.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:11.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:11.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:11.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:11.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:11.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:11.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:11.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:11.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:11.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:11.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:11.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:11.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:11.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:11.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:11.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:11.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:11.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:11.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:11.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:11.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:11.743 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.743 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.743 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.743 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.744 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:11.744 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.435007510000005, 2024-04-26T12:28:11.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:11.744 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.744 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.744 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:11.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:11.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:11.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:11.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:11.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:11.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:11.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:11.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:11.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:11.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:11.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:11.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:11.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:11.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:11.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:11.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:11.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:11.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:11.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:11.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:11.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:11.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:11.750 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.750 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.750 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.750 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.750 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.434986585999994, 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:11.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:11.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:11.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:11.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:11.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:11.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:11.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:11.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:11.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:11.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:11.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:11.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:11.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:11.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:11.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:11.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:11.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:11.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:11.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:11.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:11.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:11.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:11.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:11.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:11.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:11.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:11.756 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.756 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.757 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.757 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.757 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:11.757 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.434951737000006, 2024-04-26T12:28:11.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:11.757 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.757 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.757 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:11.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:11.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:11.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:11.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:11.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:11.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:11.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:11.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:11.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:11.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:11.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:11.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:11.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:11.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:11.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:11.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:11.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:11.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:11.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:11.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:11.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:11.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:11.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:11.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:11.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:11.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:11.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:11.763 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.763 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.763 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.763 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.763 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:11.763 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.434917787000003, 2024-04-26T12:28:11.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:11.764 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.764 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.764 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:11.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:11.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:11.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:11.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:11.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:11.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:11.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:11.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:11.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:11.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:11.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:11.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:11.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:11.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:11.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:11.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:11.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:11.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:11.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:11.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:11.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:11.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:11.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:11.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:11.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:11.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:11.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:11.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:11.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.769 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.770 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.770 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:11.770 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.434897489999997, 2024-04-26T12:28:11.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:11.770 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.770 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.770 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:11.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:11.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:11.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:11.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:11.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:11.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:11.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:11.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:11.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:11.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:11.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:11.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:11.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:11.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:11.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:11.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:11.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:11.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:11.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:11.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:11.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:11.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:11.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:11.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:11.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:11.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:11.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:11.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:11.776 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.776 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.776 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.777 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.777 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:11.777 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.434862369000001, 2024-04-26T12:28:11.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:11.777 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.777 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.777 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:11.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:11.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:11.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:11.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:11.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:11.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:11.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:11.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:11.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:11.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:11.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:11.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:11.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:11.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:11.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:11.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:11.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:11.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:11.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:11.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:11.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:11.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:11.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:11.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:11.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:11.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:11.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:11.782 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.782 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.783 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.783 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.783 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:11.783 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.434827128999999, 2024-04-26T12:28:11.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:11.783 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.783 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.783 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:11.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:11.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:11.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:11.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:11.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:11.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:11.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:11.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:11.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:11.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:11.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:11.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:11.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:11.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:11.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:11.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:11.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:11.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:11.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:11.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:11.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:11.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:11.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:11.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:11.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:11.789 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.789 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.789 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.789 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.789 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:11.789 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.434685380999994, 2024-04-26T12:28:11.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:11.789 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.789 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.789 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:11.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:11.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:11.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:11.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:11.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:11.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:11.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:11.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:11.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:11.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:11.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:11.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:11.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:11.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:11.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:11.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:11.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:11.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:11.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:11.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:11.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:11.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:11.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:11.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:11.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:11.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:11.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:11.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.795 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.795 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.795 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:11.795 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.434661362, 2024-04-26T12:28:11.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:11.796 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.796 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.796 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:11.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:11.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:11.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:11.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:11.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:11.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:11.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:11.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:11.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:11.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:11.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:11.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:11.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:11.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:11.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:11.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:11.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:11.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:11.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:11.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:11.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:11.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:11.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:11.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:11.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:11.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:11.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:11.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:11.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.801 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.801 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.802 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:11.802 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.434637394000006, 2024-04-26T12:28:11.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:11.802 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.802 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:11.802 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:11.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:11.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:11.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:11.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:11.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:11.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:11.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:11.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:11.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:11.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:11.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:11.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:11.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:11.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:11.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:11.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:11.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:11.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:11.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:11.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:11.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:11.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:11.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:11.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:11.808 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.808 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.808 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.808 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:11.808 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:11.808 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.434604012999998, 2024-04-26T12:28:11.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:11.808 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:11.808 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:11.808 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:11.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:11.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:11.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:11.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:11.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:11.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:11.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:11.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:11.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:11.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:11.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:11.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:11.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:11.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:11.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:11.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:11.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:11.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:11.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:11.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:11.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:11.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:11.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:11.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.812 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.813 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.813 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:11.813 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:11.813 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:11.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:28:11.815 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:11.815 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:11.814+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:11.915 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:11.914+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:11.948 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:11.948 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:11.948 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:11.948 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:11.958 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:12.015 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:12.015+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:12.116 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:12.116+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:12.124 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:12.124 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:12.125 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:12.125 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:12.125 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:12.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:12.218 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:12.218+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:12.304 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:28:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:12.304 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.419922334000006, 2024-04-26T12:28:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:28:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:12.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:28:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:28:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:28:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:28:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:28:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:28:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:28:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:28:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:28:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:28:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:28:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:28:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:28:12.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:28:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:28:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.419282987000003, 2024-04-26T12:28:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:28:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.309 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:28:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:28:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:28:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:28:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:28:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:28:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:28:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:28:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:28:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:28:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:28:12.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:28:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:28:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:28:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:28:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:28:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.289580796999999, 2024-04-26T12:28:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:28:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:12.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:28:12.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:12.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:28:12.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:28:12.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:28:12.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:28:12.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:28:12.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:28:12.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:28:12.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:28:12.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:28:12.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:28:12.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:28:12.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:28:12.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:28:12.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:28:12.318 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.318 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.318 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.318 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:28:12.318 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:12.318 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.289086210999997, 2024-04-26T12:28:12.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:28:12.318 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.318 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.319 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:12.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:12.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:28:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:28:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:28:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:28:12.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:28:12.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:28:12.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:28:12.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:28:12.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:28:12.322 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.322 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.322 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:28:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.287084027000006, 2024-04-26T12:28:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:28:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:28:12.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:28:12.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:28:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:28:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:28:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:28:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:28:12.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.286677686999994, 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:12.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:28:12.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:28:12.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:28:12.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:28:12.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:28:12.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:28:12.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:28:12.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:28:12.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:28:12.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:28:12.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:28:12.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.286322862999995, 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:12.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:12.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:28:12.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:28:12.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:28:12.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:28:12.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:28:12.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:28:12.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:12.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:28:12.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:28:12.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:28:12.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:28:12.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:28:12.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:28:12.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:28:12.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:28:12.335 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.335 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.335 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.336 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:28:12.336 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:12.336 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.183764448999995, 2024-04-26T12:28:12.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:28:12.336 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.336 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.336 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:12.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:28:12.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:28:12.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:28:12.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:28:12.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:28:12.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:12.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:28:12.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:28:12.340 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.340 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.340 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.340 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:28:12.340 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:12.340 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.183367920999999, 2024-04-26T12:28:12.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:28:12.340 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.340 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.341 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:12.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:12.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:28:12.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:28:12.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:28:12.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:28:12.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:28:12.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:28:12.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:28:12.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:28:12.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:28:12.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:28:12.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:28:12.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:28:12.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:28:12.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:28:12.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:28:12.344 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.344 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.345 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.345 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:28:12.345 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:12.345 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.086358313000005, 2024-04-26T12:28:12.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:28:12.345 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.345 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.345 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:28:12.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:28:12.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:28:12.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:28:12.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:28:12.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:12.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:28:12.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:28:12.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:28:12.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:28:12.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:28:12.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:28:12.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:28:12.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:28:12.349 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.349 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.349 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.349 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:28:12.349 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:12.350 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.085664597000005, 2024-04-26T12:28:12.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:28:12.350 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.350 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.350 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:12.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:12.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:12.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:28:12.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:28:12.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:28:12.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:28:12.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:28:12.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:28:12.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:28:12.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:28:12.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:28:12.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:28:12.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:28:12.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:28:12.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:28:12.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:28:12.354 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.354 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.354 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.354 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.354 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:12.354 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.050925542000002, 2024-04-26T12:28:12.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:12.354 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.354 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.354 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:12.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:12.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:12.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:12.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:12.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:12.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:12.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:12.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:12.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:12.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:12.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:12.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:12.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:12.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:12.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:12.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:12.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:12.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:12.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:12.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:12.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:12.359 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.359 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.359 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.359 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.360 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:12.360 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.050104622999996, 2024-04-26T12:28:12.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:12.360 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.360 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.360 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:12.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:12.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:12.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:12.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:12.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:12.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:12.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:12.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:12.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:12.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:12.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:12.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:12.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:12.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.050074533, 2024-04-26T12:28:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:12.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:12.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:12.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:12.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:12.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:12.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:12.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:12.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:12.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:12.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:12.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:12.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:12.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:12.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:12.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:12.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:12.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:12.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:12.371 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.371 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.371 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.371 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.371 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:12.371 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.050020744999998, 2024-04-26T12:28:12.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:12.371 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.371 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.372 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:12.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:12.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:12.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:12.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:12.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:12.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:12.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:12.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:12.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:12.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:12.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:12.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:12.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:12.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:12.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:12.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:12.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:12.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:12.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:12.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:12.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:12.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:12.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:12.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:12.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:12.377 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.377 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.377 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.377 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.377 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:12.377 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.049968187999994, 2024-04-26T12:28:12.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:12.377 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.377 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.377 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:12.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:12.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:12.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:12.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:12.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:12.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:12.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:12.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:12.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:12.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:12.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:12.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:12.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:12.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:12.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:12.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:12.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:12.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:12.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:12.382 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.382 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.382 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.049927973999999, 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:12.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:12.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:12.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:12.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:12.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:12.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:12.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:12.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:12.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:12.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:12.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:12.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:12.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:12.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:12.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:12.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:12.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:12.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:12.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:12.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:12.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:12.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:12.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:12.388 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.388 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.388 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.388 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.388 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:12.388 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.049899812999996, 2024-04-26T12:28:12.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:12.389 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.389 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.389 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:12.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:12.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:12.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:12.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:12.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:12.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:12.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:12.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:12.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:12.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:12.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:12.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:12.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:12.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:12.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:12.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:12.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:12.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:12.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:12.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:12.393 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.394 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.394 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.394 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.394 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:12.394 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.049869123999997, 2024-04-26T12:28:12.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:12.394 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.394 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:12.394 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:12.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:12.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:12.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:12.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:12.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:12.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:12.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:12.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:12.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:12.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.397 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.398 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.398 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.398 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:12.398 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 79.049842550999998, 2024-04-26T12:28:12.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:12.398 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:12.398 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:12.398 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:12.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:12.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:12.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:12.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:12.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:12.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:12.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:12.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:12.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:12.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:12.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:12.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:12.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:12.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:12.401 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.401 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.401 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.402 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:12.402 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:12.402 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:12.403 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:12.404 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:12.403+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:12.504 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:12.503+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:12.532 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:12.533 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:12.533 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:12.533 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:12.542 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:12.605 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:12.605+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:12.670 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:12.670 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:12.670 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:12.680 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:12.706 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:12.705+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:12.750 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2024-04-26T12:28:12.806 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:12.806+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:12.851 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:12.851 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:12.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:12.851 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:12.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.851 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:28:12.851 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:12.851 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 85.518030068000002, 2024-04-26T12:28:12.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:28:12.851 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.851 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.852 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:12.852 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:28:12.852 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:28:12.852 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:28:12.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.852 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:12.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:12.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:12.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:28:12.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:28:12.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:28:12.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:28:12.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:28:12.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:28:12.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:28:12.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:28:12.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:28:12.857 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.857 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.857 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.857 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.857 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:12.857 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.599164244999997, 2024-04-26T12:28:12.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:12.857 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.857 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.857 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:12.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:12.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:12.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:12.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:12.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:12.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:12.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:12.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:12.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:12.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:12.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:12.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:12.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:12.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:12.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:12.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:12.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:12.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:12.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:12.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:12.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.599128033, 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:12.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:12.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:12.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:12.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:12.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:12.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:12.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:12.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:12.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:12.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:12.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:12.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:12.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:12.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:12.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:12.869 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.869 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.869 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.869 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.869 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:12.869 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.599089058999994, 2024-04-26T12:28:12.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:12.869 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.869 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.869 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:12.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:12.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:12.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:12.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:12.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:12.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:12.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:12.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:12.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:12.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:12.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:12.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:12.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:12.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:12.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:12.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:12.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:12.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:12.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:12.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:12.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:12.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:12.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:12.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:12.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:12.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:12.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:12.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:12.875 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.875 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.875 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.875 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.875 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:12.875 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.599065891999999, 2024-04-26T12:28:12.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:12.875 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.875 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:12.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:12.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:12.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:12.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:12.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:12.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:12.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:12.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:12.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:12.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:12.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:12.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:12.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:12.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:12.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:12.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:12.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:12.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:12.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:12.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:12.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:12.881 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.881 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.881 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.881 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.881 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:12.881 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.599050515000002, 2024-04-26T12:28:12.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:12.882 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.882 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.882 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:12.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:12.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:12.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:12.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:12.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:12.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:12.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:12.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:12.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:12.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:12.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:12.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:12.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:12.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:12.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:12.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:12.887 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.887 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.887 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.887 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.887 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:12.887 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.599022324999993, 2024-04-26T12:28:12.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:12.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:12.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:12.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:12.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:12.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:12.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:12.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:12.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:12.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:12.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:12.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:12.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:12.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:12.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:12.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:12.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:12.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:12.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:12.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:12.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:12.893 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.893 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.893 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.893 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.893 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:12.893 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.599004327000003, 2024-04-26T12:28:12.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:12.894 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.894 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.894 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:12.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:12.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:12.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:12.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:12.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:12.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:12.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:12.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:12.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:12.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:12.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:12.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:12.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:12.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:12.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:12.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:12.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:12.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:12.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:12.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:12.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:12.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:12.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:12.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:12.899 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.598979736000004, 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:12.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:12.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:12.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:12.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:12.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:12.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:12.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:12.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:12.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:12.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:12.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:12.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:12.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:12.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:12.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:12.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:12.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:12.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:12.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:12.905 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.905 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.905 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.905 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.905 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.598954786999997, 2024-04-26T12:28:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:12.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:12.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:12.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:12.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:12.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:12.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:12.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:12.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:12.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:12.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:12.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:12.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:12.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:12.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.911 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:12.912 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.598933862999999, 2024-04-26T12:28:12.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:12.912 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.912 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.912 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:12.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:12.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:12.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:12.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:12.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:12.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:12.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:12.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:12.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:12.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:12.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:12.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:12.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:12.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:12.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:12.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:12.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:12.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:12.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:12.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:12.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:12.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:12.917 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.917 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.917 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.918 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.918 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:12.918 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.598899013999997, 2024-04-26T12:28:12.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:12.918 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.918 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.918 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:12.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:12.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:12.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:12.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:12.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:12.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:12.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:12.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:12.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:12.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:12.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:12.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:12.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:12.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:12.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:12.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:12.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:12.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:12.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:12.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:12.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:12.923 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.923 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.923 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.598865063999995, 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:12.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:12.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:12.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:12.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:12.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:12.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:12.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:12.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:12.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:12.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:12.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.929 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.930 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:12.930 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.598844767000003, 2024-04-26T12:28:12.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:12.930 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.930 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.930 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:12.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:12.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:12.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:12.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:12.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:12.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:12.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:12.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:12.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:12.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:12.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:12.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:12.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:12.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:12.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:12.935 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.935 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.935 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.598809646000007, 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:12.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:12.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:12.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:12.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:12.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:12.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:12.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:12.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:12.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:12.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:12.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:12.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:12.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:12.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:12.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:12.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:12.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:12.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.941 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.942 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:12.942 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.598774406000004, 2024-04-26T12:28:12.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:12.942 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.942 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.942 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:12.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:12.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:12.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:12.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:12.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:12.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:12.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:12.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:12.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:12.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:12.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:12.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:12.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:12.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:12.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:12.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:12.947 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.947 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.947 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.947 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.598632658, 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:12.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:12.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:12.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:12.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:12.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:12.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:12.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:12.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:12.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:12.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:12.953 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.598608639000005, 2024-04-26T12:28:12.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:12.954 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.954 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.954 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:12.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:12.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:12.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:12.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:12.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:12.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:12.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:12.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:12.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:12.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.598584670999998, 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:12.959 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.960 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:12.960 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:12.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:12.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:12.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:12.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:12.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:12.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:12.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:12.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:12.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:12.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:12.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.598551290000003, 2024-04-26T12:28:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:12.965 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:12.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:12.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:12.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:12.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:12.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:12.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:12.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:12.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:12.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:12.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:12.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:12.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:12.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:12.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:12.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:12.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:12.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:12.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:12.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:12.969 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.969 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.970 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.970 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:12.970 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:12.970 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:12.971 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:12.972 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:12.971+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:13.072 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:13.071+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:13.100 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:13.100 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:13.100 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:13.100 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:13.110 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:13.194 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:13.194+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:13.274 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:13.274+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:13.277 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:13.278 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:13.288 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:13.375 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:13.375+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:13.455 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:13.455 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:13.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:13.456 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:13.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.456 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:28:13.456 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:13.456 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.571743807999994, 2024-04-26T12:28:13.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:28:13.456 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.456 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.456 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:13.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:13.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:13.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:13.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:28:13.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:28:13.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:28:13.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:28:13.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:28:13.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:28:13.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:28:13.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:28:13.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:28:13.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:28:13.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:28:13.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:28:13.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:28:13.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:28:13.460 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.460 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:28:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.571104461000004, 2024-04-26T12:28:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:28:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:13.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:13.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:28:13.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:13.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:28:13.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:28:13.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:28:13.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:28:13.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:28:13.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:28:13.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:28:13.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:28:13.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:28:13.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:28:13.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:28:13.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:28:13.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:28:13.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:28:13.465 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.465 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.465 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.466 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:28:13.466 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:13.466 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.441402271000001, 2024-04-26T12:28:13.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:28:13.466 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.466 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.466 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:13.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:28:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:28:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:28:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:28:13.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:28:13.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:28:13.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:28:13.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:28:13.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:28:13.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:28:13.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:28:13.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:28:13.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:28:13.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:28:13.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:28:13.470 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.470 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.470 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.470 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:28:13.470 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:13.470 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.440907684999999, 2024-04-26T12:28:13.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:28:13.471 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.471 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.471 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:13.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:13.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:13.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:13.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:28:13.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:28:13.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:28:13.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:28:13.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:28:13.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:28:13.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:28:13.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:28:13.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:28:13.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:28:13.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:28:13.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:28:13.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:28:13.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:28:13.475 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.475 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.475 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.475 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:28:13.475 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:13.475 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.438905500999994, 2024-04-26T12:28:13.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:28:13.475 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.475 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.475 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:28:13.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:28:13.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:28:13.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:28:13.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:28:13.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:13.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:28:13.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:28:13.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:28:13.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:28:13.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:28:13.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:28:13.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:28:13.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:28:13.479 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.479 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.479 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.479 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:28:13.479 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:13.480 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.438499160999996, 2024-04-26T12:28:13.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:28:13.480 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.480 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.480 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:13.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:13.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:28:13.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:13.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:28:13.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:28:13.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:28:13.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:28:13.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:28:13.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:28:13.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:28:13.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:28:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:28:13.484 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.484 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.484 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.484 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:28:13.484 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:13.484 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.438144336999997, 2024-04-26T12:28:13.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:28:13.484 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.484 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.484 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:13.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:13.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:28:13.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:13.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:28:13.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:28:13.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:28:13.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:28:13.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:28:13.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:13.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:28:13.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:28:13.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:28:13.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:28:13.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:28:13.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:28:13.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:28:13.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:28:13.488 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.489 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.489 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.489 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:28:13.489 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:13.489 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.335585922999996, 2024-04-26T12:28:13.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:28:13.490 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.490 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.490 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:13.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:13.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:28:13.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:13.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:28:13.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:28:13.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:28:13.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:28:13.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:28:13.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:13.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:28:13.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:28:13.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:28:13.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:28:13.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:28:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:28:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:28:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:28:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.495 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:28:13.495 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:13.495 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.335189395, 2024-04-26T12:28:13.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:28:13.495 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.495 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.495 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:13.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:13.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:28:13.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:13.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:28:13.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:28:13.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:28:13.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:28:13.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:28:13.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:28:13.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:28:13.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:28:13.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:28:13.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:28:13.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:28:13.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:28:13.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:28:13.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:28:13.500 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.500 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.500 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.500 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:28:13.500 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:13.500 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.238179787000007, 2024-04-26T12:28:13.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:28:13.500 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.500 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.501 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:13.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:13.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:13.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:13.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:28:13.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:28:13.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:28:13.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:28:13.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:28:13.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:13.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:28:13.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:28:13.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:28:13.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:28:13.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:28:13.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:28:13.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:28:13.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:28:13.507 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.507 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.507 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.507 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:28:13.507 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:13.508 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 86.237486071000006, 2024-04-26T12:28:13.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:28:13.508 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.508 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.508 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:13.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:13.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:13.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:13.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:28:13.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:28:13.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:28:13.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:28:13.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:28:13.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:28:13.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:28:13.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:28:13.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:28:13.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:28:13.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:28:13.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:28:13.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:28:13.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:28:13.514 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.514 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.514 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.514 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:13.514 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:13.514 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.202747016000004, 2024-04-26T12:28:13.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:13.515 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.515 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.515 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:13.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:13.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:13.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:13.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:13.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:13.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:13.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:13.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:13.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:13.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:13.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:13.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:13.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:13.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:13.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:13.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:13.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:13.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:13.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:13.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:13.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:13.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:13.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:13.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:13.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:13.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:13.522 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.522 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.523 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.523 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:13.523 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:13.523 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.201926096999998, 2024-04-26T12:28:13.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:13.523 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.523 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.524 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:13.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:13.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:13.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:13.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:13.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:13.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:13.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:13.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:13.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:13.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:13.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:13.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:13.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:13.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:13.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:13.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:13.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:13.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:13.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:13.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:13.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:13.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:13.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:13.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:13.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:13.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:13.530 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.530 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.530 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.531 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:13.531 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:13.531 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.201896007000002, 2024-04-26T12:28:13.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:13.531 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.531 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.531 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:13.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:13.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:13.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:13.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:13.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:13.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:13.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:13.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:13.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:13.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:13.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:13.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:13.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:13.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:13.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:13.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:13.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:13.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:13.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:13.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:13.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:13.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:13.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:13.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:13.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:13.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:13.537 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.538 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.538 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.538 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:13.538 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:13.538 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.201842219, 2024-04-26T12:28:13.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:13.538 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.538 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.539 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:13.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:13.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:13.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:13.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:13.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:13.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:13.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:13.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:13.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:13.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:13.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:13.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:13.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:13.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:13.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:13.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:13.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:13.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:13.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:13.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:13.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:13.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:13.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:13.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:13.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:13.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:13.545 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.545 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.545 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.545 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:13.545 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:13.545 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.201789661999996, 2024-04-26T12:28:13.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:13.545 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.546 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.546 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:13.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:13.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:13.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:13.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:13.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:13.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:13.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:13.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:13.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:13.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:13.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:13.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:13.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:13.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:13.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:13.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:13.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:13.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:13.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:13.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:13.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:13.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:13.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:13.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:13.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:13.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:13.553 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.553 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.553 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.554 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:13.554 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:13.554 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.201749448000001, 2024-04-26T12:28:13.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:13.554 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.554 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.555 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:13.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:13.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:13.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:13.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:13.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:13.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:13.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:13.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:13.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:13.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:13.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:13.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:13.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:13.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:13.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:13.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:13.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:13.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:13.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:13.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:13.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:13.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:13.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:13.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:13.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:13.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:13.564 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.564 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.564 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.564 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:13.564 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:13.564 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.201721286999998, 2024-04-26T12:28:13.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:13.564 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.564 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:13.565 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:13.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:13.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:13.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:13.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:13.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:13.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:13.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:13.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:13.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:13.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:13.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:13.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:13.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:13.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:13.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:13.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:13.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:13.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:13.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:13.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:13.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:13.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:13.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:13.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:13.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:13.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:13.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:13.572 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.572 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.572 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.572 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:13.573 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:13.573 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.201690597999999, 2024-04-26T12:28:13.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:13.573 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.573 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:13.573 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:13.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:13.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:13.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:13.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:13.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:13.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:13.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:13.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:13.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:13.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:13.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:13.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:13.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:13.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:13.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:13.579 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.579 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.579 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.580 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:13.580 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:13.580 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 80.201664024999999, 2024-04-26T12:28:13.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:13.580 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:13.580 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:13.580 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:13.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:13.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:13.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:13.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:13.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:13.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:13.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:13.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:13.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:13.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:13.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:13.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:13.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:13.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:13.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:13.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:13.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:13.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:13.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:13.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:13.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:13.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:13.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:13.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:13.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:13.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:13.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:13.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:13.585 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.585 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.585 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.585 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:13.585 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:13.585 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:13.586 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:28:13.588 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:13.589 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:13.588+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:13.690 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:13.690+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:13.724 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:13.724 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:13.724 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:13.724 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:13.733 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:13.761 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:13.781 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:13.781 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:13.781 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:13.781 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:13.784 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:13.785 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:13.827 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:13.822+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:13.891 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:13.890+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:13.905 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:13.906 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:13.916 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:14.009 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:14.005+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:14.089 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:14.089 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:14.091 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:14.091+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:14.099 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:14.192 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:14.192+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:14.228 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:14.228 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:14.239 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:14.294 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:14.293+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:14.395 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:14.395+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:14.408 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:14.408 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:14.418 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:14.497 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:14.496+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:14.547 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:14.548 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:14.558 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:14.604 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:14.603+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:14.691 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:14.691 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:14.698 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:14.698+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:14.700 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:14.763 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:28:14.798 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:14.798+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:14.869 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:14.869 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:14.879 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:14.899 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:14.899+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:15.000 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:15.000+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:15.006 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:15.006 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:15.016 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:15.101 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:15.101+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:15.146 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:15.147 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:15.156 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:15.202 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:15.201+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:15.282 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:15.282 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:15.292 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:15.302 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:15.302+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:15.403 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:15.403+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:15.419 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:15.419 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:15.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~23s 2024-04-26T12:28:15.430 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:15.504 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:15.503+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:15.561 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:15.561 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:15.571 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:15.605 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:15.605+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:15.697 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:15.697 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:15.707 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:15.707 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:15.706+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:15.770 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2024-04-26T12:28:15.785 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:28:15.808 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:15.807+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:15.875 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:15.875 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:15.885 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:15.926 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:15.926+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:15.949 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:15.969 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:15.969 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:15.969 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:15.970 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:15.973 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:15.973 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:16.009 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:16.008+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:16.015 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:16.016 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:16.016 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:16.016 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:16.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:16.110 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:16.110+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:16.193 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:16.193 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:16.193 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:16.194 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:16.194 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:16.203 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:16.247 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:16.247+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:16.312 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:16.312+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:16.331 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:16.331 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:16.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:28:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.447820897, 2024-04-26T12:28:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:28:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.332 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:16.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:16.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:16.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:28:16.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:28:16.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:28:16.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:28:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:28:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:28:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:28:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:28:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:28:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:28:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:28:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:28:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:28:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:28:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.337 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:28:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.447181549999996, 2024-04-26T12:28:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:28:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.338 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:28:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:28:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:28:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:28:16.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:28:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:28:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:28:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:28:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:28:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:28:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:28:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:28:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:28:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:28:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:28:16.342 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:28:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.317479359999993, 2024-04-26T12:28:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:28:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:28:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:28:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:28:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:28:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:28:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:28:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:28:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:28:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:28:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:28:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:28:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:28:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:28:16.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:28:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:28:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:28:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.316984774000005, 2024-04-26T12:28:16.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:28:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:16.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:28:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:28:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:28:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:28:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:28:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:28:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:28:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:28:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:28:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:28:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:28:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:28:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:28:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:28:16.351 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:28:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.31498259, 2024-04-26T12:28:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:28:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:28:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:28:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:28:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:28:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:28:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:28:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:16.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:28:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:28:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:28:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:28:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:28:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:28:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:28:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:28:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:28:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:16.356 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.314576250000002, 2024-04-26T12:28:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:28:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:28:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:28:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:28:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:28:16.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:28:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:28:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:28:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:28:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:28:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:28:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:28:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:28:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:28:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:28:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:28:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.360 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:28:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.314221426000003, 2024-04-26T12:28:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:28:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:16.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:28:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:28:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:28:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:28:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:28:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:28:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:28:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:28:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:28:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:28:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:28:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:28:16.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:28:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:28:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:28:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.211663012000002, 2024-04-26T12:28:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:28:16.365 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:28:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:28:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:28:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:28:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:28:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:28:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:28:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:28:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:28:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:28:16.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:28:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:28:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:28:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:28:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:28:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.211266484000006, 2024-04-26T12:28:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:28:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:28:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:28:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:28:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:28:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:28:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:28:16.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:28:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:28:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:28:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:28:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:28:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:28:16.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:28:16.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:28:16.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:28:16.374 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:28:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.114256875999999, 2024-04-26T12:28:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:28:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.375 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:28:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:28:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:28:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:28:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:28:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:28:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:28:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:28:16.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:28:16.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:28:16.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:28:16.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:28:16.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:28:16.381 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.381 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.381 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.382 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:28:16.382 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:16.382 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 89.113563159999998, 2024-04-26T12:28:16.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:28:16.382 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.382 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.382 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:16.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:16.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:28:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:28:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:28:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:28:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:28:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:28:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:28:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:28:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:28:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:28:16.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:28:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:28:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:28:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:28:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 83.078824104999995, 2024-04-26T12:28:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:16.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:16.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:16.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:16.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.396 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 83.078003186000004, 2024-04-26T12:28:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:16.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:16.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:16.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:16.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:16.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:16.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:16.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:16.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:16.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:16.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:16.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:16.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:16.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:16.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:16.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:16.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 83.077973095999994, 2024-04-26T12:28:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.406 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:16.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:16.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:16.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:16.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:16.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:16.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:16.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:16.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:16.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 83.077919308000006, 2024-04-26T12:28:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.415 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:16.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:16.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:16.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:16.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:16.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:16.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:16.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:16.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.421 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 83.077866751000002, 2024-04-26T12:28:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:16.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:16.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:16.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:16.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:16.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:16.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 83.077826537000007, 2024-04-26T12:28:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:16.427 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:16.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:16.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:16.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:16.433 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 83.077798376000004, 2024-04-26T12:28:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:16.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:16.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 83.077767687000005, 2024-04-26T12:28:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:16.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:16.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:16.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:16.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:16.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:16.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:16.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:16.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:16.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:16.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:16.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 83.077741114000005, 2024-04-26T12:28:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:16.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:16.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:16.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:16.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:16.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:16.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:16.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:16.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:16.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:16.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:16.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:16.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:16.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:16.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:16.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:16.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:16.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:16.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:16.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:16.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:16.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:16.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:16.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:16.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:16.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:16.451 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.451 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.451 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.451 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:16.451 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:16.451 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:16.453 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:16.453 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:16.452+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:16.553 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:16.553+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:16.585 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:16.586 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:16.586 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:16.586 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:16.595 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:16.632 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T12:28:16.632 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:28:16.632 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-26T12:28:16.632 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:28:16.632 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:28:16.633 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-26T12:28:16.676 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:16.676+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:16.755 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:16.755+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:16.760 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:16.760 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "" 2024-04-26T12:28:16.760 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:16.763 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:16.763 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:16.763 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:16.763 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:16.764 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:16.773 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:16.857 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:16.857+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:16.942 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:16.943 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:16.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:16.943 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:16.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.943 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:28:16.943 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:16.943 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 89.609613808999995, 2024-04-26T12:28:16.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:28:16.943 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:16.943 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.944 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:16.944 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:28:16.944 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:28:16.944 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:28:16.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.944 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:16.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:16.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:16.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:16.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:16.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:16.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:16.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:16.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:28:16.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:28:16.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:28:16.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:28:16.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:28:16.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:16.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:28:16.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:28:16.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:16.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:28:16.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:28:16.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:16.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:28:16.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:28:16.949 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.949 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:16.949 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.949 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.950 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:16.950 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690747986000005, 2024-04-26T12:28:16.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:16.950 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:16.950 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.950 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:16.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:16.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:16.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:16.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:16.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:16.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:16.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:16.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:16.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:16.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:16.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:16.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:16.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:16.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:16.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:16.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:16.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:16.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.955 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:16.956 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.956 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.956 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:16.956 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690711773999993, 2024-04-26T12:28:16.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:16.956 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:16.956 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.956 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:16.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:16.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:16.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:16.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:16.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:16.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:16.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:16.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:16.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:16.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:16.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:16.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:16.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:16.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:16.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:16.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:16.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:16.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:16.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:16.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:16.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:16.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:16.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.961 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690672800000002, 2024-04-26T12:28:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:16.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:16.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:16.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:16.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:16.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:16.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:16.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:16.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:16.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:16.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:16.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:16.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:16.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:16.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:16.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:16.967 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.968 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.968 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:16.968 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690649633000007, 2024-04-26T12:28:16.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:16.968 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:16.968 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.968 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:16.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:16.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:16.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:16.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:16.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:16.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:16.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:16.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:16.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:16.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:16.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:16.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:16.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:16.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:16.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:16.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:16.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:16.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:16.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:16.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:16.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:16.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:16.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:16.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:16.973 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.973 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:16.973 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.974 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.974 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:16.974 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690634255999996, 2024-04-26T12:28:16.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:16.974 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:16.974 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.974 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:16.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:16.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:16.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:16.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:16.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:16.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:16.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:16.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:16.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:16.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:16.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:16.979 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690606066000001, 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:16.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:16.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:16.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690588067999997, 2024-04-26T12:28:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:16.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:16.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690563476999998, 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:16.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:16.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.997 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690538528000005, 2024-04-26T12:28:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:16.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:16.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:17.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:17.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:17.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:17.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:17.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:17.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:17.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:17.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:17.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:17.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:17.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:17.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:17.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:17.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.003 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690517603999993, 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:17.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.009 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690482755000005, 2024-04-26T12:28:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:17.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:17.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:17.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.015 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690448805000003, 2024-04-26T12:28:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:17.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:17.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:17.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:17.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:17.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:17.021 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690428507999997, 2024-04-26T12:28:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:17.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:17.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:17.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.027 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690393387, 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:17.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:17.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:17.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.033 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690358146999998, 2024-04-26T12:28:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:17.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:17.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:17.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690216398999993, 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:17.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:17.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690192379999999, 2024-04-26T12:28:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:17.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:17.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690168412000006, 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:17.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:17.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:17.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.690135030999997, 2024-04-26T12:28:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:17.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:17.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:17.062 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:17.062 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:17.064 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:17.064 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:17.063+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:17.165 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:17.164+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:17.191 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:17.191 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:17.192 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:17.192 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:17.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:17.266 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:17.266+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:17.367 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:17.366+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:17.367 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:17.367 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:17.368 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:17.368 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:17.368 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:17.378 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:17.468 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:17.467+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:17.547 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:17.548 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:17.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:17.548 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:17.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.548 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:28:17.548 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:17.548 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.663909719000003, 2024-04-26T12:28:17.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:28:17.548 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.548 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:17.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:28:17.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:28:17.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:28:17.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:28:17.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:28:17.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:28:17.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:28:17.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:28:17.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:28:17.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:28:17.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:28:17.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:28:17.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:28:17.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:28:17.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.552 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.553 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:28:17.553 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:17.553 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.663270371999999, 2024-04-26T12:28:17.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:28:17.553 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.553 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.553 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:17.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:17.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:28:17.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:28:17.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:28:17.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:28:17.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:28:17.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:28:17.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:28:17.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:28:17.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:28:17.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:28:17.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:28:17.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:28:17.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:28:17.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:28:17.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:28:17.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.560 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.560 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:28:17.560 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:17.560 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.533568181999996, 2024-04-26T12:28:17.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:28:17.560 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.561 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.561 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:17.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:17.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:28:17.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:17.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:28:17.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:28:17.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:28:17.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:28:17.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:28:17.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:28:17.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:28:17.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:28:17.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:28:17.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:28:17.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:28:17.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:28:17.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:28:17.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:28:17.564 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.564 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.564 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.565 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:28:17.565 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:17.565 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.533073595999994, 2024-04-26T12:28:17.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:28:17.565 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.565 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.565 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:17.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:17.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:17.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:28:17.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:28:17.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:28:17.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:28:17.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:28:17.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:28:17.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:28:17.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:28:17.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:28:17.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:28:17.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:28:17.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:28:17.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:28:17.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:28:17.569 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.569 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.569 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.569 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:28:17.569 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:17.569 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.531071412000003, 2024-04-26T12:28:17.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:28:17.569 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.570 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.570 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:17.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:17.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:28:17.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:28:17.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:28:17.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:28:17.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:28:17.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:28:17.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:17.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:28:17.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:28:17.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:28:17.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:28:17.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:28:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:28:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:28:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:28:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.574 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:28:17.574 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:17.574 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.530665072000005, 2024-04-26T12:28:17.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:28:17.574 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.574 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.574 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:17.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:17.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:28:17.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:28:17.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:28:17.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:28:17.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:28:17.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:28:17.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:28:17.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:28:17.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:28:17.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:28:17.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:28:17.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:28:17.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:28:17.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:28:17.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:28:17.578 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.578 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.578 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.578 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:28:17.578 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:17.578 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.530310248000006, 2024-04-26T12:28:17.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:28:17.578 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.578 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.578 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:17.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:17.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:28:17.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:17.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:28:17.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:28:17.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:28:17.582 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.582 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.582 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.582 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:28:17.582 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:17.582 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.427751834000006, 2024-04-26T12:28:17.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:28:17.583 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.583 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.583 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:17.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:17.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:28:17.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:17.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:28:17.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:28:17.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:28:17.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:28:17.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:28:17.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:28:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:28:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:28:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:28:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.587 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:28:17.587 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:17.587 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.427355305999995, 2024-04-26T12:28:17.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:28:17.587 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.587 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.587 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:17.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:17.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:28:17.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:28:17.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:28:17.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:28:17.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:28:17.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:28:17.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:28:17.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:28:17.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:28:17.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:28:17.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:28:17.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:28:17.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:28:17.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:28:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:28:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:28:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.330345698000002, 2024-04-26T12:28:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:28:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.591 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:17.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:28:17.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:28:17.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:28:17.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:28:17.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:28:17.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:17.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:28:17.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:28:17.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:28:17.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:28:17.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:28:17.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:28:17.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:28:17.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:28:17.595 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.595 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.595 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.596 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:28:17.596 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:17.596 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 90.329651982000001, 2024-04-26T12:28:17.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:28:17.596 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.596 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.596 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:17.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:28:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:28:17.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:28:17.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:28:17.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:28:17.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:28:17.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:28:17.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:28:17.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:28:17.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:28:17.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:28:17.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:28:17.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:28:17.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:28:17.600 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.600 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.600 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.600 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.600 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:17.600 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.294912926999999, 2024-04-26T12:28:17.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:17.600 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.600 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.600 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:17.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:17.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:17.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:17.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:17.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:17.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:17.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:17.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:17.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:17.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:17.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:17.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:17.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:17.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:17.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:17.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:17.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:17.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:17.605 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.605 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.605 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.605 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.605 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:17.605 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.294092008000007, 2024-04-26T12:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:17.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:17.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:17.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:17.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:17.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:17.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:17.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:17.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:17.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:17.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:17.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:17.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:17.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:17.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:17.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:17.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:17.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:17.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:17.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:17.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:17.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:17.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:17.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:17.610 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.610 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.611 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.611 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.611 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:17.611 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.294061917999997, 2024-04-26T12:28:17.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:17.611 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.611 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.611 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:17.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:17.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:17.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:17.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:17.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:17.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:17.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:17.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:17.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:17.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:17.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:17.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:17.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:17.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:17.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:17.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:17.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:17.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:17.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:17.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:17.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.294008129999995, 2024-04-26T12:28:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.616 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:17.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:17.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:17.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:17.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:17.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:17.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:17.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:17.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:17.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:17.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:17.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:17.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:17.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:17.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:17.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:17.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:17.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:17.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:17.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:17.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:17.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:17.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:17.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:17.621 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.621 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.621 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.621 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.293955573000005, 2024-04-26T12:28:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:17.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:17.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:17.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:17.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:17.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:17.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:17.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:17.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:17.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:17.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:17.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.627 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.627 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.627 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:17.627 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.293915358999996, 2024-04-26T12:28:17.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:17.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.627 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.627 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:17.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:17.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:17.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:17.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:17.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:17.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:17.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:17.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:17.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:17.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:17.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:17.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:17.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:17.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:17.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:17.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.293887197999993, 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:17.632 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:17.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:17.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:17.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:17.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:17.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:17.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:17.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:17.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:17.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:17.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:17.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:17.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:17.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:17.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:17.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.638 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.638 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:17.638 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.293856508999994, 2024-04-26T12:28:17.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:17.638 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.638 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:17.638 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:17.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:17.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:17.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:17.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:17.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:17.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.642 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:17.642 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:17.642 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.293829935999995, 2024-04-26T12:28:17.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:17.642 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:17.642 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:17.642 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:17.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:17.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:17.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:17.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:17.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:17.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:17.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:17.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:17.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:17.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:17.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:17.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:17.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:17.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:17.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:17.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:17.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:17.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:17.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:17.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:17.645 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.645 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.645 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.645 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:17.645 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:17.646 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:17.647 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:17.646+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:17.647 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:17.748 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:17.748+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:17.782 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:17.782 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:17.782 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:17.783 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:17.784 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:28:17.793 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:17.849 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:17.849+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:17.919 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:17.919 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:17.919 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:17.919 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:17.919 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:17.929 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:17.972 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:17.972+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:17.975 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:28:18.051 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:18.051+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:18.057 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:18.057 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:18.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:18.058 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:18.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.058 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:28:18.058 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:18.058 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.724915193000001, 2024-04-26T12:28:18.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:28:18.058 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.058 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.058 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:18.058 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:28:18.058 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:28:18.058 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:28:18.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.059 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:18.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:18.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:18.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:28:18.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:28:18.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:28:18.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:28:18.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:28:18.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:28:18.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:28:18.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:28:18.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:28:18.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:28:18.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:28:18.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:28:18.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:28:18.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:28:18.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:28:18.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:28:18.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:28:18.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:28:18.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:28:18.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:28:18.063 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.064 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.064 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.064 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.064 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:18.064 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.806049369999997, 2024-04-26T12:28:18.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:18.064 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.064 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.064 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:18.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:18.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:18.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:18.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:18.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:18.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:18.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:18.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:18.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:18.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:18.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:18.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:18.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:18.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:18.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:18.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:18.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:18.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:18.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:18.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:18.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:18.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:18.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:18.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:18.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:18.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:18.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:18.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:18.070 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.070 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.070 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.070 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.071 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:18.071 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.806013157999999, 2024-04-26T12:28:18.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:18.071 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.071 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.071 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:18.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:18.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:18.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:18.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:18.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:18.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:18.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:18.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:18.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:18.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:18.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:18.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:18.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:18.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:18.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:18.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:18.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:18.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:18.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:18.077 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.077 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.077 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.077 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.077 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:18.077 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805974183999993, 2024-04-26T12:28:18.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:18.077 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.077 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.078 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:18.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:18.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:18.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:18.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:18.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:18.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:18.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:18.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:18.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:18.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:18.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:18.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:18.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:18.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:18.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:18.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:18.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:18.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:18.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:18.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:18.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:18.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:18.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:18.083 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.083 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.083 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.083 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.083 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:18.083 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805951016999998, 2024-04-26T12:28:18.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:18.084 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.084 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.084 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:18.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:18.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:18.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:18.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:18.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:18.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:18.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:18.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:18.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:18.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:18.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:18.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:18.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:18.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:18.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:18.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:18.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:18.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:18.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:18.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:18.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:18.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:18.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:18.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:18.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:18.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:18.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:18.089 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.089 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.089 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.090 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.090 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:18.090 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805935640000001, 2024-04-26T12:28:18.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:18.090 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.090 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.090 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:18.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:18.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:18.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:18.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:18.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:18.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:18.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:18.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:18.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:18.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:18.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:18.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:18.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:18.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:18.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:18.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:18.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:18.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:18.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:18.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:18.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:18.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.095 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.096 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.096 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:18.096 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805907450000007, 2024-04-26T12:28:18.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:18.096 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.096 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.096 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:18.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:18.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:18.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:18.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:18.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:18.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:18.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:18.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:18.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:18.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:18.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:18.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:18.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:18.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:18.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:18.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:18.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:18.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:18.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:18.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:18.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:18.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:18.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:18.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:18.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:18.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:18.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:18.102 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.102 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.102 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.102 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.102 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805889452000002, 2024-04-26T12:28:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805864861000003, 2024-04-26T12:28:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805839911999996, 2024-04-26T12:28:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805818987999999, 2024-04-26T12:28:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805784138999996, 2024-04-26T12:28:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805750188999994, 2024-04-26T12:28:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805729892000002, 2024-04-26T12:28:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805694771000006, 2024-04-26T12:28:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805659531000003, 2024-04-26T12:28:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805517782999999, 2024-04-26T12:28:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805493764000005, 2024-04-26T12:28:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805469795999997, 2024-04-26T12:28:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 84.805436415000003, 2024-04-26T12:28:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:18.186 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:18.187 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:18.188 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:18.187+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:18.205 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:18.242 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:18.242 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:18.242 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:18.243 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:18.245 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:18.246 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:18.288 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:18.288+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:18.317 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:18.318 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:18.327 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:18.411 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:18.411+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:18.490 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:18.490+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:18.493 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:18.493 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:18.503 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:18.591 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:18.591+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:18.670 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:18.670 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:18.679 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:18.723 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:18.723+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:18.774 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2024-04-26T12:28:18.793 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:18.793+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:18.810 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:18.810 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:18.820 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:18.895 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:18.894+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:18.987 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:18.987 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:18.996 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:18.996+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:18.997 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:19.098 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:19.097+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:19.124 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:19.124 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:19.134 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:19.199 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:19.198+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:19.264 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:19.265 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:19.274 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:19.300 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:19.300+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:19.400 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:19.400 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:19.401 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:19.400+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:19.410 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:19.501 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:19.501+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:19.576 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:19.577 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:19.587 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:19.629 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:19.628+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:19.703 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:19.703+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:19.717 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:19.717 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:19.726 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:19.810 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:19.810+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:19.892 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:19.893 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:19.902 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:19.944 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:19.943+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:20.005 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:20.005+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:20.069 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:20.069 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:20.078 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:20.122 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:20.122+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:20.207 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:20.207+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:20.207 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:20.208 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:20.218 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:20.246 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:28:20.308 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:20.308+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:20.383 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:20.383 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:20.393 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:20.437 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:20.437+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:20.478 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:20.511 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:20.511+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:20.515 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:20.515 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:20.515 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:20.515 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:20.519 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:20.519 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:20.522 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:20.522 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:20.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:20.522 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:28:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.638793174, 2024-04-26T12:28:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:28:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:28:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:28:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:28:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:28:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:28:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:28:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:28:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:28:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:28:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:28:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:28:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:28:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:28:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:28:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:28:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.638153826999996, 2024-04-26T12:28:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:28:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:28:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:28:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:28:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:28:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:28:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:28:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:28:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:28:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:28:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:28:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:28:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:28:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:28:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:28:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:28:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:28:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.508451636999993, 2024-04-26T12:28:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:28:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:28:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:28:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:28:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:28:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:28:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:28:20.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:28:20.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:28:20.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:28:20.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:28:20.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:28:20.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:28:20.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:28:20.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:28:20.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:28:20.538 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.538 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.538 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.538 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:28:20.538 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:20.538 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.507957051000005, 2024-04-26T12:28:20.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:28:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:20.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:20.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:20.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:28:20.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:28:20.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:28:20.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:28:20.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:28:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:28:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:28:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:28:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:28:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:28:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:28:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:28:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:28:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:28:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:28:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.505954867, 2024-04-26T12:28:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:28:20.545 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.545 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.545 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:20.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:20.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:28:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:28:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:28:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:28:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:28:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:28:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:28:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:28:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:28:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:28:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.505548527000002, 2024-04-26T12:28:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:28:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:28:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:28:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:28:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:28:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:28:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:28:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:28:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:28:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:28:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:28:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:28:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:28:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:28:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:28:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:28:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:28:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.505193703000003, 2024-04-26T12:28:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:28:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:28:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:28:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:28:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:28:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:28:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:28:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:28:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:28:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:28:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:28:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:28:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:28:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:28:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:28:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:28:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.402635289000003, 2024-04-26T12:28:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:28:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:20.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:20.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:28:20.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:28:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:28:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:28:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:28:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:28:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:28:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:28:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:28:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:28:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:28:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:28:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:28:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:28:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:28:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.402238761000007, 2024-04-26T12:28:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:28:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:28:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:28:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:28:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:28:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:28:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:28:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:28:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:28:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:28:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:28:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:28:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:28:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.305229152999999, 2024-04-26T12:28:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:28:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:20.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:20.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:28:20.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:28:20.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:28:20.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:28:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:28:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:28:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:28:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:28:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:28:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:28:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:28:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:28:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:28:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:28:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.304535436999998, 2024-04-26T12:28:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:28:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:28:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:28:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:28:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:28:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:28:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:28:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:28:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:28:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:28:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:28:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:28:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:28:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:28:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:28:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 87.269796381999996, 2024-04-26T12:28:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:20.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:20.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:20.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:20.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:20.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:20.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:20.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:20.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:20.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:20.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:20.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:20.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:20.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:20.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:20.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:20.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:20.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:20.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:20.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:20.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:20.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:20.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:20.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:20.595 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.595 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.595 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.595 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:20.595 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:20.595 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 87.268975463000004, 2024-04-26T12:28:20.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:20.595 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.595 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.596 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:20.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:20.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:20.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:20.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:20.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:20.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:20.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:20.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:20.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:20.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:20.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:20.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:20.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:20.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:20.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:20.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:20.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:20.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:20.601 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.601 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 87.268945372999994, 2024-04-26T12:28:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:20.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:20.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:20.607 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 87.268891585000006, 2024-04-26T12:28:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:20.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:20.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:20.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 87.268839028000002, 2024-04-26T12:28:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:20.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:20.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.619 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 87.268798813999993, 2024-04-26T12:28:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:20.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:20.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:20.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:20.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 87.268770653000004, 2024-04-26T12:28:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 87.268739964000005, 2024-04-26T12:28:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 87.268713391000006, 2024-04-26T12:28:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:20.639 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.643 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:20.644 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:20.644 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:20.645 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:20.644+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:20.646 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:20.746 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:20.746+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:20.773 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:20.774 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:20.774 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:20.774 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:20.783 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:20.790 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:28:20.848 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:20.847+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:20.910 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:20.910 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:20.910 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:20.910 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:20.910 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:20.920 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:20.963 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:20.963+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:21.049 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:21.049 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:28:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 93.716526402, 2024-04-26T12:28:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:28:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:28:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:28:21.050 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:28:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:28:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:28:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:28:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:28:21.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:28:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:28:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:28:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:28:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:28:21.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:28:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:28:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:28:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:28:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:28:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:28:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:28:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:28:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:28:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:28:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:28:21.055 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797660578999995, 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:21.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:21.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:21.062 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797624366999997, 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:21.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:21.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.068 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797585393000006, 2024-04-26T12:28:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:21.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:21.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:21.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797562225999997, 2024-04-26T12:28:21.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:21.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:21.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:21.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797546849, 2024-04-26T12:28:21.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:21.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:21.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797518659000005, 2024-04-26T12:28:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:21.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:21.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.094 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797500661000001, 2024-04-26T12:28:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:21.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:21.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797476070000002, 2024-04-26T12:28:21.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:21.102 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.102 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.102 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:21.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:21.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:21.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:21.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:21.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:21.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:21.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:21.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:21.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:21.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:21.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:21.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:21.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:21.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:21.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:21.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:21.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.107 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.108 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:21.108 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797451120999995, 2024-04-26T12:28:21.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:21.108 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.108 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.108 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:21.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:21.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:21.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:21.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:21.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:21.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:21.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:21.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:21.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:21.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:21.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:21.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:21.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:21.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:21.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:21.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:21.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:21.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:21.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:21.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:21.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:21.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:21.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:21.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:21.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:21.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:21.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:21.113 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.113 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797430196999997, 2024-04-26T12:28:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797395347999995, 2024-04-26T12:28:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.120 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:21.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.126 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797361398000007, 2024-04-26T12:28:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:21.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:21.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.132 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797341101000001, 2024-04-26T12:28:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:21.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.138 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797305980000004, 2024-04-26T12:28:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:21.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:21.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:21.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797270740000002, 2024-04-26T12:28:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:21.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:21.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:21.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797128991999998, 2024-04-26T12:28:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.151 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:21.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:21.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:21.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797104973000003, 2024-04-26T12:28:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:21.157 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:21.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:21.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797081004999995, 2024-04-26T12:28:21.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:21.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:21.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:21.169 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.797047624000001, 2024-04-26T12:28:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:21.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:21.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:21.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:21.174 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:21.174 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:21.176 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:21.176 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:21.175+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:21.277 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:21.276+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:21.309 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:21.310 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:21.310 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:21.310 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:21.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:21.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~29s 2024-04-26T12:28:21.378 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:21.378+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:21.478 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:21.477+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:21.487 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:21.487 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:21.487 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:21.487 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:21.487 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:21.496 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:21.580 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:21.579+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:21.624 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:21.624 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:21.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:21.624 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:21.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.624 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:28:21.624 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:21.624 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.740204719000005, 2024-04-26T12:28:21.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:28:21.624 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.624 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.624 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:21.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:21.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:21.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:28:21.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:28:21.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:28:21.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:28:21.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:28:21.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:28:21.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:28:21.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:28:21.628 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.628 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.628 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.628 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:28:21.628 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:21.628 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.739565372000001, 2024-04-26T12:28:21.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:28:21.629 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.629 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.629 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:21.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:21.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:28:21.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:28:21.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:28:21.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:28:21.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:28:21.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:28:21.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:28:21.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:28:21.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:28:21.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:28:21.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:28:21.632 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.632 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.632 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.609863181999998, 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:21.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:28:21.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:21.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:28:21.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:28:21.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:28:21.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:28:21.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:28:21.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:28:21.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:28:21.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:28:21.636 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.609368595999996, 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:21.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:21.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:21.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:28:21.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:28:21.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:28:21.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:28:21.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:28:21.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:28:21.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:28:21.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:28:21.641 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.641 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.641 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.641 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:28:21.641 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:21.641 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.607366412000005, 2024-04-26T12:28:21.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:28:21.641 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.641 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.641 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:28:21.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:28:21.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:28:21.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:28:21.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:28:21.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:21.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:28:21.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:28:21.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.646 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:28:21.646 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:21.646 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.606960072000007, 2024-04-26T12:28:21.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:28:21.646 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.646 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.646 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:21.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:28:21.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:28:21.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:28:21.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:28:21.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:28:21.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:28:21.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:28:21.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:28:21.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:28:21.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:28:21.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:28:21.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:28:21.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:28:21.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.650 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.650 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:28:21.650 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:21.650 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.606605247999994, 2024-04-26T12:28:21.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:28:21.650 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.650 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.650 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:21.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:21.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:28:21.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:28:21.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:28:21.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:28:21.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:28:21.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:28:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:28:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:28:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:28:21.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:28:21.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:28:21.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:28:21.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:28:21.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:28:21.654 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.654 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.654 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.655 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:28:21.655 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:21.655 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.504046833999993, 2024-04-26T12:28:21.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:28:21.655 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.655 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.655 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:21.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:28:21.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:28:21.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:28:21.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:21.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:28:21.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:28:21.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:28:21.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:28:21.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:28:21.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:28:21.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:28:21.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.503650305999997, 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:21.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:21.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:28:21.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:28:21.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:28:21.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:28:21.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:28:21.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:28:21.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:28:21.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:28:21.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:28:21.663 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.663 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.663 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.663 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:28:21.663 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:21.663 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.406640698000004, 2024-04-26T12:28:21.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:28:21.663 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.664 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.664 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:21.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:21.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:28:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:28:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:28:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:28:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:28:21.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:21.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:28:21.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:28:21.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:28:21.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:28:21.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.667 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 94.405946982000003, 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:21.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:28:21.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:28:21.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:28:21.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:28:21.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:28:21.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:28:21.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.672 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.672 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:21.672 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 88.371207927, 2024-04-26T12:28:21.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:21.672 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.672 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.672 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:21.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:21.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:21.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:21.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:21.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:21.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:21.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:21.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:21.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:21.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:21.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 88.370387007999994, 2024-04-26T12:28:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.677 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:21.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:21.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:21.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:21.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:21.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:21.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.682 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 88.370356917999999, 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:21.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:21.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:21.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:21.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:21.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:21.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:21.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.687 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.688 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.688 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:21.688 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 88.370303129999996, 2024-04-26T12:28:21.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:21.688 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.688 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.688 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:21.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:21.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:21.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:21.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:21.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:21.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:21.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:21.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:21.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:21.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:21.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:21.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:21.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:21.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:21.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:21.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:21.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:21.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:21.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:21.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:21.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:21.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:21.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:21.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:21.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:21.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.693 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.693 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.693 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:21.693 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 88.370250573000007, 2024-04-26T12:28:21.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:21.693 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.693 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.694 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:21.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:21.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:21.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:21.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:21.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:21.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:21.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:21.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:21.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:21.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:21.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:21.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:21.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:21.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:21.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:21.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:21.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:21.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:21.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:21.698 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.698 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.698 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.698 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.699 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:21.699 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 88.370210358999998, 2024-04-26T12:28:21.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:21.699 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.699 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.699 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:21.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:21.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:21.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:21.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:21.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:21.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:21.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:21.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:21.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:21.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:21.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:21.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:21.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:21.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:21.703 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.703 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.704 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.704 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.704 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:21.704 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 88.370182197999995, 2024-04-26T12:28:21.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:21.704 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.704 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:21.704 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:21.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:21.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:21.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:21.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:21.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:21.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:21.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:21.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:21.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:21.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:21.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:21.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:21.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:21.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:21.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:21.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:21.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:21.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:21.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:21.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:21.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:21.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:21.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:21.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:21.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:21.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 88.370151508999996, 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.709 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:21.710 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:21.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:21.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:21.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:21.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:21.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:21.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:21.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:21.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 88.370124935999996, 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:21.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:21.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:21.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:21.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:21.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:21.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:21.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:21.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:21.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:21.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:21.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:21.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:21.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:21.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:21.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:21.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:21.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:21.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:21.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:21.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:21.717 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.717 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.717 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.717 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:21.717 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:21.717 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:21.718 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:21.717+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:21.719 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:21.770 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T12:28:21.770 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:28:21.771 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-26T12:28:21.771 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:28:21.771 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:28:21.771 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-26T12:28:21.779 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2024-04-26T12:28:21.819 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:21.817+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:21.861 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:21.861 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:21.861 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:21.861 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:21.871 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:21.897 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:21.897 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "" 2024-04-26T12:28:21.897 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:21.919 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:21.919+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:22.020 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:22.020+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:22.037 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:22.037 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:22.037 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:22.037 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:22.037 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:22.047 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:22.122 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:22.120+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:22.176 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:22.176 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:22.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:22.176 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:22.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.176 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:28:22.176 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:22.176 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.843051353000007, 2024-04-26T12:28:22.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:28:22.177 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.177 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.177 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:22.177 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:28:22.177 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:28:22.177 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:28:22.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.177 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:22.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:22.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:22.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:28:22.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:28:22.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:28:22.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:28:22.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:28:22.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:28:22.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:28:22.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:28:22.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:28:22.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:28:22.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:28:22.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:28:22.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:28:22.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:28:22.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:28:22.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:28:22.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:28:22.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:28:22.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:28:22.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:28:22.182 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.182 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.182 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.182 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.182 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:22.182 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.924185530000003, 2024-04-26T12:28:22.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:22.183 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.183 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.183 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:22.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:22.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:22.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:22.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:22.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:22.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:22.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:22.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:22.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:22.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:22.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:22.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:22.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:22.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:22.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:22.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:22.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:22.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:22.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:22.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:22.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:22.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:22.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:22.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:22.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:22.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:22.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:22.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:22.188 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.188 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.188 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.188 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.188 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:22.189 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.924149318000005, 2024-04-26T12:28:22.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:22.189 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.189 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.189 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:22.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:22.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:22.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:22.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:22.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:22.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:22.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:22.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:22.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:22.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:22.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:22.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:22.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:22.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:22.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:22.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:22.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:22.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:22.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:22.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:22.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:22.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:22.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:22.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.195 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.196 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.196 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.196 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:22.196 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.924110343999999, 2024-04-26T12:28:22.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:22.196 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.196 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.196 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:22.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:22.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:22.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:22.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:22.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:22.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:22.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:22.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:22.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:22.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:22.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:22.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:22.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:22.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:22.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:22.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:22.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:22.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:22.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:22.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:22.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:22.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:22.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:22.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:22.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:22.202 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.202 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.202 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.202 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.202 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:22.202 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.924087177000004, 2024-04-26T12:28:22.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:22.202 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.202 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.203 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:22.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:22.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:22.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:22.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:22.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:22.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:22.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:22.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:22.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:22.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:22.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:22.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:22.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:22.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:22.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:22.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:22.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:22.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:22.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:22.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:22.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:22.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:22.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:22.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:22.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.924071799999993, 2024-04-26T12:28:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:22.209 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.209 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.209 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:22.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:22.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:22.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:22.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:22.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:22.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:22.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:22.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:22.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:22.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:22.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:22.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:22.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:22.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:22.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:22.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:22.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:22.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:22.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:22.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:22.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:22.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:22.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:22.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:22.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:22.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:22.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:22.214 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.214 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.214 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.214 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.924043609999998, 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:22.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:22.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:22.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:22.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:22.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:22.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:22.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:22.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:22.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:22.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:22.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:22.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:22.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:22.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:22.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:22.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:22.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:22.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:22.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:22.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:22.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:22.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:22.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:22.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:22.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:22.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:22.220 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.220 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.220 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.221 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.221 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:22.221 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.924025611999994, 2024-04-26T12:28:22.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:22.221 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.221 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.221 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:22.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:22.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:22.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:22.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:22.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:22.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:22.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:22.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:22.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:22.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:22.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:22.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:22.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:22.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:22.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:22.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:22.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:22.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:22.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:22.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:22.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:22.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:22.227 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.227 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.227 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.227 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.227 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:22.227 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.924001020999995, 2024-04-26T12:28:22.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:22.227 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.227 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.227 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:22.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:22.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:22.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:22.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:22.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:22.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:22.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:22.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:22.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:22.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:22.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:22.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:22.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:22.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:22.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:22.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:22.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:22.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:22.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:22.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:22.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:22.233 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.233 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.233 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.233 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.233 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:22.233 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.923976072000002, 2024-04-26T12:28:22.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:22.233 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.233 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.233 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:22.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:22.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:22.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:22.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:22.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:22.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:22.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:22.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:22.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:22.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:22.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:22.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:22.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:22.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:22.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:22.239 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.923955148000005, 2024-04-26T12:28:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:22.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:22.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:22.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:22.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:22.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:22.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:22.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:22.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:22.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:22.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:22.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:22.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:22.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:22.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:22.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:22.245 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.245 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.245 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.245 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.246 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:22.246 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.923920299000002, 2024-04-26T12:28:22.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:22.246 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.246 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.246 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:22.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:22.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:22.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:22.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:22.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:22.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:22.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:22.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:22.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:22.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:22.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:22.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:22.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:22.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:22.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:22.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:22.251 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.252 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.252 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.252 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.252 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:22.252 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.923886349, 2024-04-26T12:28:22.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:22.252 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.252 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.252 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:22.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:22.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:22.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:22.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:22.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:22.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:22.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:22.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:22.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:22.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:22.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:22.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:22.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:22.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:22.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:22.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:22.258 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.258 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.258 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.258 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.258 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:22.258 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.923866051999994, 2024-04-26T12:28:22.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:22.258 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.258 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.258 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:22.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:22.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:22.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:22.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:22.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:22.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:22.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:22.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:22.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:22.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:22.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:22.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:22.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:22.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:22.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:22.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:22.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:22.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:22.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:22.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:22.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:22.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:22.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:22.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:22.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:22.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:22.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:22.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:22.264 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.264 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.264 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.264 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.264 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:22.265 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.923830930999998, 2024-04-26T12:28:22.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:22.265 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.265 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.265 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:22.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:22.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:22.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:22.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:22.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:22.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:22.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:22.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:22.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:22.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:22.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:22.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:22.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:22.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:22.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:22.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:22.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:22.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:22.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:22.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:22.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:22.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:22.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:22.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:22.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:22.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:22.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:22.270 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.270 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.271 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.271 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.271 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:22.271 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.923795690999995, 2024-04-26T12:28:22.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:22.271 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.271 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.271 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:22.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:22.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:22.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:22.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:22.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:22.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:22.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:22.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:22.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:22.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:22.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:22.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:22.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:22.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:22.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:22.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:22.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:22.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:22.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:22.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:22.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:22.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:22.277 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.277 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.277 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.277 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.277 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:22.277 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.923653943000005, 2024-04-26T12:28:22.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:22.277 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.277 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.277 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:22.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:22.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:22.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:22.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:22.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:22.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:22.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:22.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:22.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:22.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:22.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:22.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:22.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:22.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:22.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:22.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:22.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:22.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:22.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:22.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:22.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:22.283 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.283 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.283 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.283 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.283 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:22.283 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.923629923999997, 2024-04-26T12:28:22.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:22.283 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.283 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.283 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:22.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:22.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:22.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:22.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:22.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:22.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:22.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:22.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:22.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:22.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:22.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:22.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:22.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:22.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:22.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:22.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:22.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:22.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:22.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:22.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:22.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:22.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:22.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:22.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:22.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:22.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:22.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:22.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:22.289 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.289 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.289 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.289 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.289 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:22.289 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.923605956000003, 2024-04-26T12:28:22.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:22.290 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.290 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:22.290 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:22.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:22.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:22.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:22.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:22.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:22.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:22.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:22.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:22.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:22.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:22.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:22.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:22.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:22.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:22.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:22.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:22.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:22.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:22.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:22.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:22.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:22.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:22.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:22.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:22.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:22.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:22.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:22.295 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.295 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.295 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.923572574999994, 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:22.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:22.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:22.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:22.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:22.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:22.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:22.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:22.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:22.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:22.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:22.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:22.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:22.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:22.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:22.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:22.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:22.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:22.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:22.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:22.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:22.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:22.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:22.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:22.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:22.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:22.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:22.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:22.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:22.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:22.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:22.300 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.300 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.300 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.300 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:22.300 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:22.300 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:22.302 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:22.302 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:22.301+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:22.402 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:22.401+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:22.429 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:22.429 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:22.430 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:22.430 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:22.440 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:22.503 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:22.502+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:22.521 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:28:22.565 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:22.565 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:22.565 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:22.576 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:22.604 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:22.603+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:22.685 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:22.704 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:22.705 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:22.705 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:22.705 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:22.705 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:22.706 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:22.706 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:22.704+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:22.707 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:22.707 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:22.715 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:22.806 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:22.805+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:22.853 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:22.853 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:22.863 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:22.907 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:22.906+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:22.989 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:22.989 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:22.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:23.043 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:23.042+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:23.109 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:23.108+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:23.125 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:23.125 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:23.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:23.210 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:23.208+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:23.266 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:23.266 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:23.276 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:23.319 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:23.319+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:23.402 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:23.402 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:23.410 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:23.409+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:23.412 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:23.511 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:23.510+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:23.578 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:23.578 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:23.588 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:23.632 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:23.631+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:23.713 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:23.712+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:23.717 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:23.718 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:23.728 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:23.795 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:28:23.814 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:23.813+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:23.895 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:23.895 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:23.905 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:23.946 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:23.945+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:24.017 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:24.015+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:24.072 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:24.072 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:24.083 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:24.126 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:24.126+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:24.212 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:24.213 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:24.218 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:24.217+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:24.224 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:24.318 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:24.318+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:24.390 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:24.390 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:24.400 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:24.442 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:24.441+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:24.521 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:24.519+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:24.566 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:24.566 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:24.577 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:24.621 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:24.620+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:24.708 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:28:24.714 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:24.714 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:24.722 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:24.721+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:24.724 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:24.781 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2024-04-26T12:28:24.823 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:24.822+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:24.860 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:24.880 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:24.881 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:24.881 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:24.881 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:24.883 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:24.883 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:24.892 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:24.892 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:24.893 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:24.893 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:24.893 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:24.903 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:24.924 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:24.923+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:25.024 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:25.024+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:25.073 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:28:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:25.073 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.739590368999998, 2024-04-26T12:28:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:28:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:28:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:28:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:28:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:25.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:25.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:28:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:28:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:28:25.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:28:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:28:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:28:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:28:25.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:28:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:28:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:28:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:28:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:28:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:28:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:28:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.080 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820724545999994, 2024-04-26T12:28:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:25.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820688333999996, 2024-04-26T12:28:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:25.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820649360000004, 2024-04-26T12:28:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.093 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:25.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:25.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820626192999995, 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.099 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:25.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:25.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820610815999999, 2024-04-26T12:28:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:25.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:25.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.111 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820582626000004, 2024-04-26T12:28:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:25.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:25.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820564628, 2024-04-26T12:28:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:25.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:25.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.124 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820540037000001, 2024-04-26T12:28:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:25.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:25.133 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820515087999993, 2024-04-26T12:28:25.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:25.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:25.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:25.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820494163999996, 2024-04-26T12:28:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:25.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:25.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:25.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:25.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:25.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:25.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:25.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:25.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:25.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:25.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:25.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:25.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:25.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:25.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:25.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:25.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:25.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:25.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:25.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:25.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:25.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:25.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:25.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:25.146 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.146 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.147 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.147 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.147 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:25.147 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820459314999994, 2024-04-26T12:28:25.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:25.147 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.147 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.147 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:25.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:25.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:25.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:25.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:25.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:25.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:25.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:25.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:25.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:25.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:25.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:25.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:25.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:25.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:25.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:25.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:25.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:25.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:25.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:25.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:25.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:25.152 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820425365000006, 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:25.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:25.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:25.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:25.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:25.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:25.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:25.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:25.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:25.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:25.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:25.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:25.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:25.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:25.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:25.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:25.159 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.159 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.159 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.159 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.159 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:25.159 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820405067999999, 2024-04-26T12:28:25.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:25.159 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.159 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.159 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:25.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:25.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:25.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:25.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:25.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:25.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:25.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:25.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:25.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:25.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:25.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:25.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:25.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:25.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:25.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:25.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:25.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:25.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:25.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:25.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:25.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:25.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:25.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:25.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:25.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:25.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.165 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.165 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.165 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:25.165 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820369947000003, 2024-04-26T12:28:25.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:25.166 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.166 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.166 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:25.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:25.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:25.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:25.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:25.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:25.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:25.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:25.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:25.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:25.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:25.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:25.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:25.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:25.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:25.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:25.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.171 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.171 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.171 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:25.171 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820334707000001, 2024-04-26T12:28:25.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:25.172 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.172 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.172 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:25.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:25.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:25.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:25.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:25.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:25.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:25.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:25.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:25.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:25.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:25.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:25.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:25.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:25.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:25.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:25.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:25.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:25.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:25.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:25.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:25.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:25.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:25.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:25.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:25.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:25.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:25.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:25.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:25.177 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.177 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.177 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.178 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.178 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:25.178 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820192958999996, 2024-04-26T12:28:25.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:25.178 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.178 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.178 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:25.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:25.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:25.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:25.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:25.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:25.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:25.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:25.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:25.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:25.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.183 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820168940000002, 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:25.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:25.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:25.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:25.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:25.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:25.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:25.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:25.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:25.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:25.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:25.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:25.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:25.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:25.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:25.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:25.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:25.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:25.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:25.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:25.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:25.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:25.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.189 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.190 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.190 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:25.190 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820144971999994, 2024-04-26T12:28:25.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:25.190 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.190 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.190 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:25.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:25.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:25.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:25.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:25.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:25.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:25.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:25.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:25.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:25.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:25.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:25.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:25.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:25.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:25.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:25.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:25.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.196 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.196 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.196 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.196 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:25.196 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.820111591, 2024-04-26T12:28:25.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:25.196 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:25.196 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:25.196 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:25.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:25.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:25.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:25.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:25.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:25.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:25.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:25.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:25.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:25.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:25.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:25.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:25.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:25.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:25.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:25.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:25.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:25.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:25.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:25.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:25.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:25.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:25.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:25.200 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.200 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.200 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.200 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:25.200 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:25.200 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:25.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:25.203 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:25.201+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:25.303 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:25.302+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:25.337 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:25.338 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:25.338 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:25.338 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:25.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:25.404 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:25.403+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:25.473 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:25.473 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:25.473 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:25.473 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:25.473 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:25.483 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:25.504 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:25.503+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:25.605 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:25.604+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:25.652 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:25.652 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:28:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.768774764, 2024-04-26T12:28:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:28:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:28:25.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:28:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:28:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:28:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:28:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:28:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:28:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:28:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:28:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:28:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:28:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:28:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:28:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:28:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:28:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.768135416999996, 2024-04-26T12:28:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:28:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.657 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:28:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:28:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:28:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:28:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:28:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:28:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:28:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:28:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:28:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:28:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.661 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:28:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.638433226999993, 2024-04-26T12:28:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:28:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:28:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:28:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:28:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:28:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:28:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:28:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:28:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:28:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:28:25.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:28:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:28:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:28:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:28:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:28:25.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:28:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:28:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.637938641000005, 2024-04-26T12:28:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:28:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:28:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:28:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:28:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:28:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:28:25.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:28:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:28:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:28:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:28:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:28:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:28:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:28:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:28:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:28:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:28:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:25.670 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.635936457, 2024-04-26T12:28:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:28:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:28:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:28:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:28:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:28:25.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:28:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:28:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:28:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:28:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:28:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:28:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:28:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:28:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:28:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:28:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.674 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:28:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.635530117000002, 2024-04-26T12:28:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:28:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:25.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:28:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:28:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:28:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:28:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:28:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:28:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:28:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:28:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:28:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:28:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:28:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:28:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:28:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:28:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:28:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:28:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.635175293000003, 2024-04-26T12:28:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:28:25.679 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:28:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:28:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:28:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:28:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:28:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:28:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:28:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:28:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:28:25.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:28:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:28:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:28:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:28:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:28:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:28:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.532616879000003, 2024-04-26T12:28:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:28:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:28:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:28:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:28:25.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:28:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:28:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:28:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:28:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:28:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:28:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.532220351000007, 2024-04-26T12:28:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:28:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:28:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:28:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:28:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:28:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:28:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:28:25.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:28:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:28:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:28:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:28:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:28:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:28:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:28:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:28:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:28:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:28:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:25.692 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.435210742999999, 2024-04-26T12:28:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:28:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:28:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:28:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:28:25.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:28:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:28:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:28:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:28:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.696 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:28:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 98.434517026999998, 2024-04-26T12:28:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:28:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:28:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:28:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:28:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:28:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:28:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:28:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:28:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:28:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:28:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:28:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:28:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:28:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 92.399777971999995, 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.701 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:25.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.706 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 92.398957053000004, 2024-04-26T12:28:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:25.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:25.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 92.398926962999994, 2024-04-26T12:28:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:25.712 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:25.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:25.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 92.398873175000006, 2024-04-26T12:28:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:25.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:25.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 92.398820618000002, 2024-04-26T12:28:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.723 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.724 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:25.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:25.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:25.729 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 92.398780403999993, 2024-04-26T12:28:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:25.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:25.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.734 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 92.398752243000004, 2024-04-26T12:28:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:25.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:25.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.743 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 92.398721554000005, 2024-04-26T12:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.747 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 92.398694981000006, 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:25.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:25.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:25.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:25.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:25.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:25.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:25.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:25.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:25.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:25.751 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.751 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.751 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.751 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:25.751 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:25.751 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:25.753 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:25.753 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:25.751+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:25.854 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:25.853+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:25.882 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:25.882 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:25.882 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:25.882 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:25.892 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:25.953 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:25.952+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:25.959 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 94% (11865/12492) Updating files: 95% (11868/12492) Updating files: 96% (11993/12492) Updating files: 97% (12118/12492) Updating files: 98% (12243/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-26T12:28:26.018 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:26.018 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:26.019 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:26.029 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:26.054 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:26.054+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:26.155 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:26.154+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:26.198 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:26.198 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:26.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:26.198 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:26.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.199 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:28:26.199 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:26.199 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.865423735999997, 2024-04-26T12:28:26.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:28:26.199 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.199 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.199 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:26.199 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:28:26.199 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:28:26.199 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:28:26.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.199 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:26.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:26.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:26.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:28:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:28:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:28:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:28:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:28:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:28:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:28:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:28:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:28:26.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:28:26.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:28:26.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:28:26.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:28:26.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:28:26.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:28:26.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:28:26.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:28:26.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:28:26.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:28:26.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:28:26.204 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.204 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.204 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.205 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.205 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:26.205 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946557913000007, 2024-04-26T12:28:26.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:26.205 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.205 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.205 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:26.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:26.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:26.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:26.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:26.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:26.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:26.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:26.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:26.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:26.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:26.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:26.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:26.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:26.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:26.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:26.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.210 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.211 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.211 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.211 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:26.211 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946521700999995, 2024-04-26T12:28:26.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:26.211 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.211 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.211 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:26.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:26.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:26.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:26.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:26.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:26.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:26.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:26.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:26.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:26.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:26.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:26.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:26.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:26.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:26.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:26.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:26.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:26.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:26.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:26.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:26.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:26.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:26.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:26.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.218 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.218 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:26.218 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946482727000003, 2024-04-26T12:28:26.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:26.218 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.218 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.218 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:26.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:26.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:26.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:26.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:26.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:26.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:26.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:26.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:26.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:26.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:26.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:26.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:26.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:26.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:26.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:26.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:26.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:26.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:26.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:26.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:26.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:26.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:26.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:26.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:26.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:26.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:26.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:26.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:26.224 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.224 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.224 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.224 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.224 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:26.224 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946459559999994, 2024-04-26T12:28:26.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:26.224 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.224 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.224 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:26.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:26.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:26.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:26.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:26.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:26.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:26.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:26.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:26.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:26.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:26.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:26.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:26.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:26.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:26.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:26.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:26.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:26.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:26.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:26.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:26.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:26.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:26.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:26.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:26.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:26.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:26.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:26.230 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.230 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.230 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.230 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.230 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:26.230 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946444182999997, 2024-04-26T12:28:26.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:26.230 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.230 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.231 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:26.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:26.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:26.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:26.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:26.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:26.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:26.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:26.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:26.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:26.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:26.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:26.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:26.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:26.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:26.236 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.236 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.236 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.236 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.236 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:26.236 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946415993000002, 2024-04-26T12:28:26.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:26.237 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.237 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.237 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:26.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:26.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:26.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:26.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:26.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:26.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:26.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:26.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:26.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:26.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:26.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:26.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:26.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:26.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:26.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:26.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:26.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:26.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:26.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:26.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:26.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:26.242 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.242 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.242 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.243 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.243 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:26.243 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946397994999998, 2024-04-26T12:28:26.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:26.243 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.243 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.243 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:26.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:26.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:26.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:26.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:26.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:26.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:26.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:26.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:26.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:26.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:26.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:26.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:26.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:26.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:26.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:26.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:26.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:26.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:26.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.248 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.249 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.249 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.249 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:26.249 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946373403999999, 2024-04-26T12:28:26.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:26.249 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.249 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.249 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:26.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:26.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:26.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:26.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:26.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:26.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:26.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:26.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:26.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:26.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:26.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:26.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:26.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:26.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:26.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:26.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:26.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:26.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:26.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:26.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:26.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:26.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.255 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.255 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.255 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:26.255 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946348455000006, 2024-04-26T12:28:26.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:26.255 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.255 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.256 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:26.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:26.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:26.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:26.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:26.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:26.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:26.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:26.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:26.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:26.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:26.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:26.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:26.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:26.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:26.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:26.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:26.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:26.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:26.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:26.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:26.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:26.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:26.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:26.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:26.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:26.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:26.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:26.261 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.261 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.261 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.261 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.261 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:26.262 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946327530999994, 2024-04-26T12:28:26.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:26.262 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.262 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.262 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:26.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:26.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:26.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:26.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:26.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:26.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:26.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:26.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:26.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:26.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:26.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:26.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:26.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:26.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:26.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:26.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:26.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:26.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:26.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:26.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:26.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:26.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:26.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:26.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:26.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:26.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:26.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:26.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:26.267 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.267 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.267 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.268 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.268 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:26.268 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946292682000006, 2024-04-26T12:28:26.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:26.268 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.268 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.268 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:26.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:26.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:26.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:26.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:26.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:26.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:26.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:26.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:26.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:26.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:26.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:26.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:26.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:26.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:26.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:26.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:26.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:26.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:26.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:26.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:26.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:26.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:26.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:26.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:26.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:26.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:26.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946258732000004, 2024-04-26T12:28:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:26.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:26.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:26.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:26.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:26.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:26.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:26.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:26.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:26.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:26.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:26.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:26.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:26.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:26.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:26.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:26.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:26.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:26.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:26.280 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.280 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.280 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.280 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.280 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:26.280 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946238434999998, 2024-04-26T12:28:26.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:26.280 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.280 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.281 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:26.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:26.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:26.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:26.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:26.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:26.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:26.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:26.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:26.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:26.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:26.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:26.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:26.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:26.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:26.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:26.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:26.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:26.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:26.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:26.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:26.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:26.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:26.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:26.286 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.286 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.286 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.286 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.286 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:26.286 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946203314000002, 2024-04-26T12:28:26.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:26.287 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.287 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.287 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:26.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:26.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:26.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:26.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:26.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:26.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:26.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:26.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:26.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:26.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:26.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:26.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:26.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:26.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:26.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:26.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:26.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:26.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:26.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:26.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:26.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:26.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:26.292 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.292 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.292 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.293 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.293 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:26.293 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946168073999999, 2024-04-26T12:28:26.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:26.293 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.293 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.293 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:26.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:26.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:26.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:26.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:26.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:26.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:26.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:26.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:26.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:26.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:26.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:26.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:26.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:26.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:26.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:26.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:26.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:26.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:26.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:26.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:26.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:26.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:26.298 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.298 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946026325999995, 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:26.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:26.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:26.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:26.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:26.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:26.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:26.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:26.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:26.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:26.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:26.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:26.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:26.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:26.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:26.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:26.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:26.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:26.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:26.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:26.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:26.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:26.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:26.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:26.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:26.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:26.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:26.304 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.305 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.305 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.305 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.305 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:26.305 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.946002307000001, 2024-04-26T12:28:26.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:26.305 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.305 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.305 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:26.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:26.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:26.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:26.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:26.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:26.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:26.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:26.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:26.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:26.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:26.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:26.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:26.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:26.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:26.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:26.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:26.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:26.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:26.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:26.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:26.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:26.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:26.311 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.311 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.311 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.311 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.311 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:26.311 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.945978339000007, 2024-04-26T12:28:26.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:26.311 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.311 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.311 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:26.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:26.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:26.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:26.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:26.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:26.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:26.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:26.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:26.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:26.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:26.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:26.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:26.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:26.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:26.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:26.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:26.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:26.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:26.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:26.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:26.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:26.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:26.317 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.317 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.317 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.317 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.317 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:26.317 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.945944957999998, 2024-04-26T12:28:26.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:26.317 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:26.317 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:26.317 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:26.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:26.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:26.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:26.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:26.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:26.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:26.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:26.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:26.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:26.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:26.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:26.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:26.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:26.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:26.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:26.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:26.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:26.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:26.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:26.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:26.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:26.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:26.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:26.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:26.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:26.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:26.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:26.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:26.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:26.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:26.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:26.321 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.321 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.322 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.322 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:26.322 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:26.322 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:26.323 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:26.324 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:26.323+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:26.424 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:26.423+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:26.453 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:26.454 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:26.454 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:26.454 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:26.466 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:26.525 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:26.524+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:26.592 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:26.592 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:26.592 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:26.593 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:26.593 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:26.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:26.626 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:26.625+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:26.727 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:26.726+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:26.772 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:28:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.888249017999996, 2024-04-26T12:28:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:28:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.772 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:28:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:28:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:28:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:28:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:28:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:28:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:28:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:28:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:28:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:28:26.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:28:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:28:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:28:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:28:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:28:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.887609671000007, 2024-04-26T12:28:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:28:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:28:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:28:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:28:26.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:28:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:28:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:28:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:28:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:28:26.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:28:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:28:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:28:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:28:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:28:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:28:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:28:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:28:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.757907481000004, 2024-04-26T12:28:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:28:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:28:26.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:28:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:28:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:28:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:28:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:28:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:28:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:28:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:28:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:28:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:28:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:28:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:28:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:28:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:28:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.785 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:28:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.757412895000002, 2024-04-26T12:28:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:28:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:28:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:28:26.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:28:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:28:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:28:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:28:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:28:26.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:28:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:28:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:28:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.755410710999996, 2024-04-26T12:28:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:28:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.790 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:28:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:28:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:28:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:28:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:28:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:28:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:28:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:28:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:28:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:28:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:28:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:28:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:28:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:28:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:28:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.755004370999998, 2024-04-26T12:28:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:28:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:28:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:28:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:28:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:28:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:28:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:28:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:28:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:28:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:28:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:28:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:28:26.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:28:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:28:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.754649547, 2024-04-26T12:28:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:28:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:28:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:28:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:28:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:28:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:28:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:28:26.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:28:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:28:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:28:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:28:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:28:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:28:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:28:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:28:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:28:26.803 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.652091132999999, 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:28:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:28:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:28:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:28:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:28:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:28:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:28:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:28:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:28:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:28:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:28:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:28:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:28:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:28:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.807 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.651694605000003, 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:28:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:28:26.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:28:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:28:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:28:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:28:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:28:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:28:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:28:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:28:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:28:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:28:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:28:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:28:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:28:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:28:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.554684996999995, 2024-04-26T12:28:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:28:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.812 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:28:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:28:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:28:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:28:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:28:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:28:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:28:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:28:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:28:26.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:28:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:28:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:28:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:28:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 99.553991280999995, 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:28:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:28:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:28:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:28:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:28:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:28:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:28:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:28:26.820 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.519252226000006, 2024-04-26T12:28:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:26.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:26.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:26.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.518431307, 2024-04-26T12:28:26.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:26.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:26.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.831 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.518401217000005, 2024-04-26T12:28:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:26.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:26.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.518347429000002, 2024-04-26T12:28:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:26.837 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:26.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:26.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:26.842 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.518294871999998, 2024-04-26T12:28:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:26.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:26.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.518254658000004, 2024-04-26T12:28:26.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:26.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:26.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:26.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:26.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:26.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:26.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:26.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:26.853 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.853 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.853 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.854 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.854 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:26.854 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.518226497000001, 2024-04-26T12:28:26.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:26.854 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.854 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:26.854 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:26.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:26.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:26.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:26.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:26.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:26.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:26.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:26.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:26.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:26.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:26.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:26.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:26.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:26.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:26.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:26.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:26.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:26.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:26.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:26.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:26.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:26.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:26.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:26.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:26.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:26.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:26.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:26.859 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.859 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.859 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.859 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.859 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:26.859 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.518195808000002, 2024-04-26T12:28:26.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:26.859 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.860 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:26.860 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:26.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:26.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:26.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:26.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:26.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:26.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:26.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:26.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:26.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:26.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:26.863 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.863 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.863 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.863 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:26.863 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:26.863 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 93.518169235000002, 2024-04-26T12:28:26.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:26.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:26.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:26.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:26.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:26.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:26.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:26.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:26.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:26.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:26.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:26.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:26.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:26.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:26.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:26.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:26.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:26.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:26.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:26.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:26.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:26.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:26.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:26.867 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.867 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.867 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.867 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:26.867 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:26.867 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:26.867 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:28:26.869 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:26.868+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:26.870 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:26.885 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:28:26.907 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T12:28:26.907 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:28:26.907 INFO:tasks.thrashosds.thrasher:Reweighting osd 0 to 0.5414270044481275 2024-04-26T12:28:26.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 0.5414270044481275 2024-04-26T12:28:26.970 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:26.970+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:26.984 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '7d2137f0a666c92a9411c1af5c33e4968be54da6'. 2024-04-26T12:28:26.984 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-04-26T12:28:26.984 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T12:28:26.984 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T12:28:26.984 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T12:28:26.984 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-04-26T12:28:26.984 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T12:28:26.984 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T12:28:26.984 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-04-26T12:28:26.984 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-04-26T12:28:26.984 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-04-26T12:28:26.984 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-04-26T12:28:26.985 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-04-26T12:28:26.985 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-04-26T12:28:26.985 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-04-26T12:28:26.985 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T12:28:26.985 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-04-26T12:28:26.985 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 7d2137f0a66 Merge pull request #57086 from zdover23/wip-doc-2024-04-25-backport-57057-to-reef 2024-04-26T12:28:26.990 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T12:28:27.007 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:27.007 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:27.007 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:27.007 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:27.017 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:27.070 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:27.070 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T12:28:27.071 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:27.071+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:27.072 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T12:28:27.072 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T12:28:27.090 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:27.090 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:27.090 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:27.091 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:27.093 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:27.094 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:27.143 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:27.144 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:27.153 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:27.198 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:27.197+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:27.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-04-26T12:28:27.272 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:27.271+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:27.281 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:27.281 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:27.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:27.374 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:27.373+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:27.420 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:27.420 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:27.430 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:27.475 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:27.473+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:27.557 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:27.557 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:27.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:27.604 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T12:28:27.611 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:27.611+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:27.660 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T12:28:27.676 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:27.676+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:27.693 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:27.693 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:27.698 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T12:28:27.700 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T12:28:27.700 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T12:28:27.703 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:27.738 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T12:28:27.741 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:28:27.741 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T12:28:27.759 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-26T12:28:27.761 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-26T12:28:27.761 DEBUG:teuthology.orchestra.run.smithi046:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d2137f0a666c92a9411c1af5c33e4968be54da6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-26T12:28:27.777 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:27.776+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:27.789 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2024-04-26T12:28:27.790 INFO:teuthology.orchestra.run.smithi046.stderr:reweighted osd.0 to 0.541427 (8a9a) 2024-04-26T12:28:27.816 INFO:tasks.workunit.client.0.smithi046.stderr:+ mkdir -p fsstress 2024-04-26T12:28:27.818 INFO:tasks.workunit.client.0.smithi046.stderr:+ pushd fsstress 2024-04-26T12:28:27.818 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T12:28:27.819 INFO:tasks.workunit.client.0.smithi046.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-26T12:28:27.833 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:27.833 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:27.844 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:27.878 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:27.878+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:27.979 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:27.978+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:28.011 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:28.011 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:28.022 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:28.106 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:28.105+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:28.180 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:28.180+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:28.190 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:28.190 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:28.199 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:28.282 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:28.281+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:28.325 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:28.326 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:28.335 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:28.383 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:28.382+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:28.461 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:28.461 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:28.472 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:28.514 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:28.513+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:28.585 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:28.584+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:28.638 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:28.638 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:28.650 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:28.686 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:28.686+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:28.779 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:28.779 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:28.788 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:28.785+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:28.791 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:28.888 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:28.887+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:28.958 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:28.958 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:28.967 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:29.008 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:29.007+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:29.090 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:29.089+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:29.170 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:28:29.172 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:29.172 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:29.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:29.213 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:29.212+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:29.292 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:29.292+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:29.300 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:29.300 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:29.310 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:29.336 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:29.356 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:29.357 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:29.357 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:29.357 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:29.359 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:29.359 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:29.394 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:29.392+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:29.477 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:29.477 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:29.487 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:29.494 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:29.493+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:29.595 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:29.595+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:29.616 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:28:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:29.616 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 102.732384481, 2024-04-26T12:28:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:28:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:28:29.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:28:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:28:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:28:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:28:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:28:29.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:28:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:28:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:28:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:28:29.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:28:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:28:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:28:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:28:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.621 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:28:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 102.73174513399999, 2024-04-26T12:28:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:28:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:28:29.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:28:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:28:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:28:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:28:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:28:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:28:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:28:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:28:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:28:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:28:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:28:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:28:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:28:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:28:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:28:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 102.602042944, 2024-04-26T12:28:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:28:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.627 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:28:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:28:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:28:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:28:29.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:28:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:28:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:28:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:28:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:28:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:28:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:28:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:28:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:28:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:28:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:28:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:28:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 102.601548358, 2024-04-26T12:28:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:28:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.632 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:28:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:28:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:28:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:28:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:28:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:28:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:28:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:28:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:28:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:28:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:28:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:28:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:28:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:28:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:28:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 102.599546174, 2024-04-26T12:28:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:28:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.637 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:28:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:28:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:28:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:28:29.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:28:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:28:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:28:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:28:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:28:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:28:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:28:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:28:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:28:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:28:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:28:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 102.599139834, 2024-04-26T12:28:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:28:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.642 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:28:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:28:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:28:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:28:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:28:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:28:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:28:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:28:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:28:29.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:28:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:28:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:28:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:28:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:28:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:28:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:28:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 102.59878501, 2024-04-26T12:28:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:28:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.647 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:28:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:28:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:28:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:28:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:28:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:28:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:28:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:28:29.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:28:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:28:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:28:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:28:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:28:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:28:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:28:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 102.496226596, 2024-04-26T12:28:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:28:29.652 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:28:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:28:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:28:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:28:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:28:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:28:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:28:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:28:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:28:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:28:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:28:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:28:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:28:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:28:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.657 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:132 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'90, mlcod=10'85)", 2024-04-26T12:28:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 102.495830068, 2024-04-26T12:28:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052149620000000001, 2024-04-26T12:28:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118388+0000", 2024-04-26T12:28:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118387+0000", 2024-04-26T12:28:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118391+0000", 2024-04-26T12:28:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3639999999999999e-06 2024-04-26T12:28:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118398+0000", 2024-04-26T12:28:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1069999999999999e-06 2024-04-26T12:28:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118402+0000", 2024-04-26T12:28:29.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8029999999999998e-06 2024-04-26T12:28:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118436+0000", 2024-04-26T12:28:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4199000000000002e-05 2024-04-26T12:28:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118449+0000", 2024-04-26T12:28:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2672e-05 2024-04-26T12:28:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123591+0000", 2024-04-26T12:28:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051420429999999998 2024-04-26T12:28:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123603+0000", 2024-04-26T12:28:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2135e-05 2024-04-26T12:28:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:28:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 102.39882046, 2024-04-26T12:28:29.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:28:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:28:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:28:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:28:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:28:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:28:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:28:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:28:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:28:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:28:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:28:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:28:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:28:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:28:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:28:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 102.398126744, 2024-04-26T12:28:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:28:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:28:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:28:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:28:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:28:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:28:29.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:28:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:28:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:28:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:28:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:28:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:28:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:28:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:28:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:28:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.363387689000007, 2024-04-26T12:28:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:29.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:29.679 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.362566770000001, 2024-04-26T12:28:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:29.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:29.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:29.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:29.686 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.362536680000005, 2024-04-26T12:28:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:29.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:29.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:29.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.362482892000003, 2024-04-26T12:28:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.693 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:29.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:29.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:29.699 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.362430334999999, 2024-04-26T12:28:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:29.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:29.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:29.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.706 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.362390121000004, 2024-04-26T12:28:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:29.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:29.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:29.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:29.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:29.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:29.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.362361960000001, 2024-04-26T12:28:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:29.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:29.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:29.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.720 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.362331271000002, 2024-04-26T12:28:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:29.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 96.362304698000003, 2024-04-26T12:28:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:29.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:29.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:29.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:29.730 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:29.730 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:29.732 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:29.731+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:29.732 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:29.803 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:28:29.833 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:29.832+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:29.867 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:29.868 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:29.868 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:29.868 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:29.877 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:29.933 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:29.933+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:30.006 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:30.006 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:30.006 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:30.006 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:30.006 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:30.016 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:30.062 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:30.061+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:30.136 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:30.136+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:30.145 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:30.145 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:30.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:30.145 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:30.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.145 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4179.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T12:28:30.146 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:30.146 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.81238632, 2024-04-26T12:28:30.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014626251999999999, 2024-04-26T12:28:30.146 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.146 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.146 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:30.146 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4179", 2024-04-26T12:28:30.146 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.46:0/514208781", 2024-04-26T12:28:30.146 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 189 2024-04-26T12:28:30.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.146 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:30.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:30.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330594+0000", 2024-04-26T12:28:30.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330597+0000", 2024-04-26T12:28:30.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2880000000000001e-06 2024-04-26T12:28:30.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330603+0000", 2024-04-26T12:28:30.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0020000000000003e-06 2024-04-26T12:28:30.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.330608+0000", 2024-04-26T12:28:30.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7219999999999999e-06 2024-04-26T12:28:30.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341762+0000", 2024-04-26T12:28:30.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011153666 2024-04-26T12:28:30.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341805+0000", 2024-04-26T12:28:30.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3837000000000001e-05 2024-04-26T12:28:30.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.341880+0000", 2024-04-26T12:28:30.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4289999999999995e-05 2024-04-26T12:28:30.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.342771+0000", 2024-04-26T12:28:30.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00089113099999999998 2024-04-26T12:28:30.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345183+0000", 2024-04-26T12:28:30.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002411898 2024-04-26T12:28:30.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345203+0000", 2024-04-26T12:28:30.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0435999999999999e-05 2024-04-26T12:28:30.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:47.345221+0000", 2024-04-26T12:28:30.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7373000000000001e-05 2024-04-26T12:28:30.151 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.151 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.151 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.151 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.152 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:30.152 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893520496999997, 2024-04-26T12:28:30.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:30.152 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.152 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.152 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:30.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:30.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:30.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:30.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:30.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:30.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:30.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:30.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:30.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:30.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:30.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:30.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:30.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:30.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:30.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:30.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:30.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:30.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:30.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:30.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:30.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:30.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:30.158 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.158 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.159 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.159 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.159 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:30.159 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893484285, 2024-04-26T12:28:30.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:30.159 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.159 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.159 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:30.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:30.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:30.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:30.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:30.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:30.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:30.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:30.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:30.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:30.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:30.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:30.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:30.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:30.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:30.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:30.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:30.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:30.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:30.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:30.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:30.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:30.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:30.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.165 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.165 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.165 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:30.165 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893445310999994, 2024-04-26T12:28:30.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:30.166 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.166 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.166 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:30.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:30.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:30.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:30.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:30.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:30.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:30.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:30.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:30.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:30.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:30.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:30.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:30.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:30.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:30.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:30.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:30.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:30.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.171 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.171 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.172 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:30.172 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893422143999999, 2024-04-26T12:28:30.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:30.172 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.172 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.172 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:30.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:30.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:30.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:30.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:30.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:30.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:30.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:30.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:30.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:30.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:30.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:30.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:30.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:30.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:30.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:30.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:30.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:30.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:30.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:30.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:30.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:30.179 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.179 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.179 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893406767000002, 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:30.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:30.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:30.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:30.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:30.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:30.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:30.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:30.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:30.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:30.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:30.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:30.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:30.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:30.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:30.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:30.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:30.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:30.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:30.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:30.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:30.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:30.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:30.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:30.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:30.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:30.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:30.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.186 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.186 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.186 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:30.186 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893378576999993, 2024-04-26T12:28:30.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:30.186 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.186 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.187 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:30.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:30.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:30.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:30.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:30.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:30.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:30.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:30.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:30.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:30.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:30.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:30.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:30.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:30.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:30.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:30.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:30.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:30.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.192 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:30.193 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893360579000003, 2024-04-26T12:28:30.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:30.193 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.193 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.193 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:30.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:30.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:30.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:30.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:30.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:30.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:30.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:30.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:30.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:30.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:30.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:30.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:30.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:30.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:30.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:30.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:30.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:30.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:30.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:30.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:30.198 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.199 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.199 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.199 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.199 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:30.199 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893335988000004, 2024-04-26T12:28:30.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:30.199 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.199 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.199 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:30.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:30.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:30.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:30.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:30.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:30.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:30.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:30.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:30.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:30.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:30.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:30.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893311038999997, 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:30.205 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.206 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.206 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:30.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:30.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:30.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:30.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:30.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:30.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:30.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:30.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:30.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:30.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:30.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:30.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:30.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:30.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:30.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:30.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:30.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:30.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:30.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:30.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:30.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:30.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:30.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:30.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:30.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:30.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:30.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:30.211 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.211 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.211 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.211 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.211 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:30.212 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893290114999999, 2024-04-26T12:28:30.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:30.212 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.212 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.212 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:30.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:30.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:30.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:30.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:30.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:30.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:30.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:30.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:30.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:30.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:30.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:30.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:30.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:30.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:30.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:30.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:30.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:30.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:30.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:30.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:30.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:30.218 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.218 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.218 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.219 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.219 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:30.219 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893255265999997, 2024-04-26T12:28:30.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:30.219 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.219 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.219 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:30.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:30.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:30.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:30.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:30.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:30.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:30.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:30.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:30.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:30.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:30.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:30.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:30.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:30.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:30.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:30.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:30.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:30.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:30.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.225 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:30.226 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893221315999995, 2024-04-26T12:28:30.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:30.226 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.226 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.226 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:30.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:30.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:30.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:30.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:30.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:30.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:30.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:30.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:30.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:30.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:30.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:30.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:30.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:30.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:30.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:30.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:30.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:30.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:30.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:30.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:30.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:30.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:30.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:30.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:30.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:30.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:30.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893201019000003, 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.232 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.233 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:30.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:30.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:30.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:30.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:30.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:30.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:30.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:30.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:30.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:30.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:30.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:30.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:30.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:30.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:30.238 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.238 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.238 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.238 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.239 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:30.239 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893165898000007, 2024-04-26T12:28:30.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:30.239 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.239 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.239 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:30.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:30.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:30.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:30.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:30.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:30.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:30.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:30.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:30.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:30.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:30.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:30.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:30.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:30.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:30.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:30.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:30.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:30.245 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.245 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.245 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.245 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.245 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:30.245 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.893130658000004, 2024-04-26T12:28:30.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:30.245 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.245 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.245 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:30.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:30.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:30.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:30.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:30.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:30.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:30.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:30.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:30.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:30.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:30.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:30.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:30.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:30.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:30.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:30.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:30.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:30.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:30.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:30.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.251 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:30.252 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.89298891, 2024-04-26T12:28:30.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:30.252 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.252 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.252 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:30.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:30.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:30.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:30.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:30.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:30.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:30.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:30.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:30.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:30.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:30.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:30.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:30.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:30.257 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.257 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.257 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.257 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.257 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.892964891000005, 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:30.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:30.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:30.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:30.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:30.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:30.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:30.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:30.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:30.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:30.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:30.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:30.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:30.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:30.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:30.263 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.263 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.263 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.263 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.263 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:30.263 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.892940922999998, 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:30.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:30.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:30.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:30.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:30.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:30.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:30.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:30.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:30.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:30.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:30.269 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.269 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.269 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.269 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.269 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:30.269 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.892907542000003, 2024-04-26T12:28:30.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:30.270 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:30.270 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:30.270 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:30.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:30.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:30.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:30.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:30.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:30.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:30.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:30.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:30.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:30.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:30.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:30.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:30.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:30.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:30.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:30.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:30.273 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.274 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.274 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.274 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:30.274 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:30.274 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:30.275 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:30.274+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:30.276 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:30.376 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:30.376+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:30.405 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:30.405 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:30.405 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:30.405 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:30.415 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:30.499 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:30.498+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:30.530 INFO:tasks.workunit.client.0.smithi046.stderr:+ tar xzf ltp-full.tgz 2024-04-26T12:28:30.579 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:30.578+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:30.590 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:30.591 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:30.591 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:30.591 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:30.591 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:30.602 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:30.680 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:30.679+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:30.781 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:69 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'43, mlcod=10'39)", 2024-04-26T12:28:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 103.898036416, 2024-04-26T12:28:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063544229999999997, 2024-04-26T12:28:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881833+0000", 2024-04-26T12:28:30.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881921+0000", 2024-04-26T12:28:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8436000000000005e-05 2024-04-26T12:28:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881930+0000", 2024-04-26T12:28:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9360000000000005e-06 2024-04-26T12:28:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881935+0000", 2024-04-26T12:28:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2249999999999999e-06 2024-04-26T12:28:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881969+0000", 2024-04-26T12:28:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3246e-05 2024-04-26T12:28:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.881986+0000", 2024-04-26T12:28:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6991999999999999e-05 2024-04-26T12:28:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888159+0000", 2024-04-26T12:28:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061729929999999999 2024-04-26T12:28:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888188+0000", 2024-04-26T12:28:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9152000000000001e-05 2024-04-26T12:28:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:70 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'44, mlcod=10'39)", 2024-04-26T12:28:30.786 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 103.89739706899999, 2024-04-26T12:28:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057312429999999996, 2024-04-26T12:28:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882473+0000", 2024-04-26T12:28:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882472+0000", 2024-04-26T12:28:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882478+0000", 2024-04-26T12:28:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6799999999999998e-06 2024-04-26T12:28:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882486+0000", 2024-04-26T12:28:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3650000000000004e-06 2024-04-26T12:28:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882491+0000", 2024-04-26T12:28:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8890000000000001e-06 2024-04-26T12:28:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882537+0000", 2024-04-26T12:28:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6412999999999998e-05 2024-04-26T12:28:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.882556+0000", 2024-04-26T12:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8621e-05 2024-04-26T12:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888191+0000", 2024-04-26T12:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005634844 2024-04-26T12:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:46.888204+0000", 2024-04-26T12:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3095000000000001e-05 2024-04-26T12:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:106 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'68, mlcod=10'64)", 2024-04-26T12:28:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 103.767694879, 2024-04-26T12:28:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058460040000000001, 2024-04-26T12:28:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012175+0000", 2024-04-26T12:28:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012174+0000", 2024-04-26T12:28:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012212+0000", 2024-04-26T12:28:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.799e-05 2024-04-26T12:28:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012222+0000", 2024-04-26T12:28:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0478e-05 2024-04-26T12:28:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012229+0000", 2024-04-26T12:28:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0650000000000004e-06 2024-04-26T12:28:30.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012260+0000", 2024-04-26T12:28:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1510000000000002e-05 2024-04-26T12:28:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012279+0000", 2024-04-26T12:28:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8737e-05 2024-04-26T12:28:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.017972+0000", 2024-04-26T12:28:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005692969 2024-04-26T12:28:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018021+0000", 2024-04-26T12:28:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9094000000000001e-05 2024-04-26T12:28:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:107 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'69, mlcod=10'64)", 2024-04-26T12:28:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:30.795 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 103.767200293, 2024-04-26T12:28:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005379923, 2024-04-26T12:28:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012669+0000", 2024-04-26T12:28:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012674+0000", 2024-04-26T12:28:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5350000000000004e-06 2024-04-26T12:28:30.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012686+0000", 2024-04-26T12:28:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1639e-05 2024-04-26T12:28:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012693+0000", 2024-04-26T12:28:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4259999999999997e-06 2024-04-26T12:28:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012718+0000", 2024-04-26T12:28:30.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4998e-05 2024-04-26T12:28:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.012732+0000", 2024-04-26T12:28:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3386e-05 2024-04-26T12:28:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018023+0000", 2024-04-26T12:28:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052913600000000002 2024-04-26T12:28:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.018049+0000", 2024-04-26T12:28:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6139000000000002e-05 2024-04-26T12:28:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:112 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'74, mlcod=10'65)", 2024-04-26T12:28:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 103.765198109, 2024-04-26T12:28:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059971979999999996, 2024-04-26T12:28:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.801 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014672+0000", 2024-04-26T12:28:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014671+0000", 2024-04-26T12:28:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014739+0000", 2024-04-26T12:28:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607999999999994e-05 2024-04-26T12:28:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014746+0000", 2024-04-26T12:28:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6939999999999998e-06 2024-04-26T12:28:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014750+0000", 2024-04-26T12:28:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014778+0000", 2024-04-26T12:28:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7555e-05 2024-04-26T12:28:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.014799+0000", 2024-04-26T12:28:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1199000000000002e-05 2024-04-26T12:28:30.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020638+0000", 2024-04-26T12:28:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058391620000000002 2024-04-26T12:28:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020669+0000", 2024-04-26T12:28:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0911000000000003e-05 2024-04-26T12:28:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:113 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'75, mlcod=10'65)", 2024-04-26T12:28:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 103.764791769, 2024-04-26T12:28:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056110539999999999, 2024-04-26T12:28:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015078+0000", 2024-04-26T12:28:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015077+0000", 2024-04-26T12:28:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015085+0000", 2024-04-26T12:28:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8679999999999999e-06 2024-04-26T12:28:30.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015094+0000", 2024-04-26T12:28:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9809999999999992e-06 2024-04-26T12:28:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015100+0000", 2024-04-26T12:28:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3060000000000003e-06 2024-04-26T12:28:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015211+0000", 2024-04-26T12:28:30.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011083599999999999 2024-04-26T12:28:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015226+0000", 2024-04-26T12:28:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5114e-05 2024-04-26T12:28:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020671+0000", 2024-04-26T12:28:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054449040000000004 2024-04-26T12:28:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020689+0000", 2024-04-26T12:28:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7739000000000001e-05 2024-04-26T12:28:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:114 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'76, mlcod=10'65)", 2024-04-26T12:28:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 103.764436945, 2024-04-26T12:28:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052685730000000004, 2024-04-26T12:28:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.810 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015433+0000", 2024-04-26T12:28:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015432+0000", 2024-04-26T12:28:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015438+0000", 2024-04-26T12:28:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6130000000000003e-06 2024-04-26T12:28:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015448+0000", 2024-04-26T12:28:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0105000000000001e-05 2024-04-26T12:28:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015453+0000", 2024-04-26T12:28:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015482+0000", 2024-04-26T12:28:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8591000000000001e-05 2024-04-26T12:28:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.015496+0000", 2024-04-26T12:28:30.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4751e-05 2024-04-26T12:28:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020690+0000", 2024-04-26T12:28:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051934520000000003 2024-04-26T12:28:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.020701+0000", 2024-04-26T12:28:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1467e-05 2024-04-26T12:28:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.814 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:131 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'89, mlcod=10'85)", 2024-04-26T12:28:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 103.661878531, 2024-04-26T12:28:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055966460000000003, 2024-04-26T12:28:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117991+0000", 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.117990+0000", 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118057+0000", 2024-04-26T12:28:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6357000000000002e-05 2024-04-26T12:28:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118065+0000", 2024-04-26T12:28:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6219999999999998e-06 2024-04-26T12:28:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118071+0000", 2024-04-26T12:28:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:30.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118116+0000", 2024-04-26T12:28:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4777999999999997e-05 2024-04-26T12:28:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.118130+0000", 2024-04-26T12:28:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4626e-05 2024-04-26T12:28:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123554+0000", 2024-04-26T12:28:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054235170000000001 2024-04-26T12:28:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.123588+0000", 2024-04-26T12:28:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3856999999999998e-05 2024-04-26T12:28:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'105)", 2024-04-26T12:28:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:30.819 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 103.564472395, 2024-04-26T12:28:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056475830000000003, 2024-04-26T12:28:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:30.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215397+0000", 2024-04-26T12:28:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215460+0000", 2024-04-26T12:28:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3386999999999995e-05 2024-04-26T12:28:30.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215467+0000", 2024-04-26T12:28:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.28e-06 2024-04-26T12:28:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215470+0000", 2024-04-26T12:28:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215491+0000", 2024-04-26T12:28:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0627000000000001e-05 2024-04-26T12:28:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.215502+0000", 2024-04-26T12:28:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0769e-05 2024-04-26T12:28:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221022+0000", 2024-04-26T12:28:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055199689999999996 2024-04-26T12:28:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221045+0000", 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3081000000000001e-05 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4179.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'108)", 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 103.563778679, 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054011349999999996, 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216091+0000", 2024-04-26T12:28:30.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216096+0000", 2024-04-26T12:28:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.967e-06 2024-04-26T12:28:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216101+0000", 2024-04-26T12:28:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7830000000000004e-06 2024-04-26T12:28:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.216105+0000", 2024-04-26T12:28:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5939999999999998e-06 2024-04-26T12:28:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218367+0000", 2024-04-26T12:28:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022623389999999999 2024-04-26T12:28:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.218380+0000", 2024-04-26T12:28:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2771e-05 2024-04-26T12:28:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221473+0000", 2024-04-26T12:28:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030925639999999999 2024-04-26T12:28:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:47.221492+0000", 2024-04-26T12:28:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9587999999999999e-05 2024-04-26T12:28:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.828 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 97.529039624000006, 2024-04-26T12:28:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:30.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:30.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:30.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:30.834 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 97.528218705, 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:30.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:30.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.839 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 97.528188615000005, 2024-04-26T12:28:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:30.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:30.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.845 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 97.528134827000002, 2024-04-26T12:28:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:30.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:30.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 97.528082269999999, 2024-04-26T12:28:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:30.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:30.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 97.528042056000004, 2024-04-26T12:28:30.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:30.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:30.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.863 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.864 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.864 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:30.864 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 97.528013895000001, 2024-04-26T12:28:30.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:30.864 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.864 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.864 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:30.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:30.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:30.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 97.527983206000002, 2024-04-26T12:28:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:30.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 97.527956633000002, 2024-04-26T12:28:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4519.0:4 4.32 e47/14 4:4def72d4:::10000000003.00000000:head v 47'2, mlcod=0'0)", 2024-04-26T12:28:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.49294493700000003, 2024-04-26T12:28:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013679491, 2024-04-26T12:28:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:30.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286924+0000", 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292324+0000", 2024-04-26T12:28:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054002099999999999 2024-04-26T12:28:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292346+0000", 2024-04-26T12:28:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1733e-05 2024-04-26T12:28:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:30.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292356+0000", 2024-04-26T12:28:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:28:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292409+0000", 2024-04-26T12:28:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3359000000000002e-05 2024-04-26T12:28:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292430+0000", 2024-04-26T12:28:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0140999999999999e-05 2024-04-26T12:28:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300546+0000", 2024-04-26T12:28:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081164429999999992 2024-04-26T12:28:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300604+0000", 2024-04-26T12:28:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8270000000000003e-05 2024-04-26T12:28:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:30.883 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:30.883 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:30.884 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:30.780+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:30.885 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:30.886 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:30.885+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2024-04-26T12:28:30.987 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:30.986+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:31.019 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:31.019 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:31.019 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:31.030 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:31.087 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:31.086+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:31.162 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:31.162 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:31.162 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:31.162 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:31.162 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:31.173 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:31.213 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:31.212+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:31.289 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:31.288+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:31.351 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:31.351 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:31.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:31.351 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:31.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.351 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.099301251, 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:31.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:31.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:31.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:31.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:31.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:31.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:31.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:31.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:31.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:31.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:31.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:31.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:31.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:31.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:31.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:31.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:31.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:31.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:31.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:31.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:31.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:31.357 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.357 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.357 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.358 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.358 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:31.358 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.099265039000002, 2024-04-26T12:28:31.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:31.358 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.358 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.358 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:31.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:31.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:31.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:31.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:31.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:31.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:31.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:31.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:31.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:31.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:31.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:31.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:31.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:31.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:31.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:31.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:31.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:31.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:31.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:31.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:31.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:31.364 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.364 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.364 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.364 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.364 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:31.364 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.099226064999996, 2024-04-26T12:28:31.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:31.364 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.365 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.365 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:31.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:31.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:31.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:31.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:31.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:31.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:31.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:31.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:31.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:31.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:31.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:31.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:31.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:31.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:31.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:31.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:31.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:31.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:31.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:31.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:31.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:31.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:31.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:31.370 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.370 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.370 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.370 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.370 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:31.370 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.099202898000001, 2024-04-26T12:28:31.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:31.371 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.371 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.371 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:31.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:31.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:31.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:31.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:31.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:31.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:31.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:31.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:31.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:31.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:31.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:31.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:31.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:31.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:31.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:31.377 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.377 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.377 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.377 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.377 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:31.377 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.099187521000005, 2024-04-26T12:28:31.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:31.377 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.377 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.377 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:31.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:31.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:31.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:31.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:31.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:31.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:31.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:31.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:31.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:31.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:31.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:31.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.383 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.384 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:31.384 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.099159330999996, 2024-04-26T12:28:31.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:31.384 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.384 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.384 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:31.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:31.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:31.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:31.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:31.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:31.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:31.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:31.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:31.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:31.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:31.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:31.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:31.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:31.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:31.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:31.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:31.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:31.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:31.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:31.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:31.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:31.390 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.390 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.390 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.390 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.390 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:31.390 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.099141333000006, 2024-04-26T12:28:31.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:31.390 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.390 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.391 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:31.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:31.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:31.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:31.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:31.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:31.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:31.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:31.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:31.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:31.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:31.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:31.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:31.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:31.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:31.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:31.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:31.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:31.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:31.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:31.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:31.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:31.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:31.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:31.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:31.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:31.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:31.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:31.396 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.396 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.396 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.396 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.397 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:31.397 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.099116742000007, 2024-04-26T12:28:31.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:31.397 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.397 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.397 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:31.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:31.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:31.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:31.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:31.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:31.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:31.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:31.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:31.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:31.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:31.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:31.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:31.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:31.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:31.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:31.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:31.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:31.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:31.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:31.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:31.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:31.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:31.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:31.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:31.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:31.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:31.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:31.403 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.403 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.403 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.403 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.403 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:31.403 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.099091792999999, 2024-04-26T12:28:31.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:31.403 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.403 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.404 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:31.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:31.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:31.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:31.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:31.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:31.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:31.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:31.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:31.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:31.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:31.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:31.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:31.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:31.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:31.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:31.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:31.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:31.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:31.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:31.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:31.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:31.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:31.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:31.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.410 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.410 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:31.410 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.099070869000002, 2024-04-26T12:28:31.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:31.410 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.410 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.410 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:31.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:31.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:31.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:31.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:31.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:31.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:31.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:31.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:31.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:31.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:31.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:31.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:31.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:31.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:31.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:31.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:31.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:31.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:31.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:31.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:31.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:31.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:31.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:31.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:31.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:31.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:31.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:31.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:31.415 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.415 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.416 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.416 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.416 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:31.416 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.09903602, 2024-04-26T12:28:31.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:31.416 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.416 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.416 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:31.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:31.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:31.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:31.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:31.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:31.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:31.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:31.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:31.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:31.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:31.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:31.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:31.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:31.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:31.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:31.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:31.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:31.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:31.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:31.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:31.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:31.422 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.422 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.422 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.422 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.422 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:31.422 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.099002069999997, 2024-04-26T12:28:31.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:31.422 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.422 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.423 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:31.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:31.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:31.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:31.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:31.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:31.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:31.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:31.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:31.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:31.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:31.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:31.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:31.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:31.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:31.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:31.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:31.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:31.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:31.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:31.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:31.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:31.428 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.429 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.429 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.429 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.429 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:31.429 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.098981773000006, 2024-04-26T12:28:31.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:31.429 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.429 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.429 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:31.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:31.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:31.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:31.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:31.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:31.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:31.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:31.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:31.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:31.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:31.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:31.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:31.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:31.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:31.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:31.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:31.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:31.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:31.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:31.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:31.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:31.435 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.435 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.435 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.435 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.435 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:31.435 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.098946651999995, 2024-04-26T12:28:31.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:31.436 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.436 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.436 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:31.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:31.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:31.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:31.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:31.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:31.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:31.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:31.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:31.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:31.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:31.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:31.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:31.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:31.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:31.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:31.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:31.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:31.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:31.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:31.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:31.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:31.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:31.441 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.441 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.441 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.442 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.442 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:31.442 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.098911412000007, 2024-04-26T12:28:31.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:31.442 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.442 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.442 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:31.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:31.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:31.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:31.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:31.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:31.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:31.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:31.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:31.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:31.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:31.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:31.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:31.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:31.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:31.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:31.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:31.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:31.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:31.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:31.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:31.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:31.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:31.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:31.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:31.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:31.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:31.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:31.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:31.452 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.452 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.452 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.453 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.453 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:31.453 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.098769664000002, 2024-04-26T12:28:31.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:31.454 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.454 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.454 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:31.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:31.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:31.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:31.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:31.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:31.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:31.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:31.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:31.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:31.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:31.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:31.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:31.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:31.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:31.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:31.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:31.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:31.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:31.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:31.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:31.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:31.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:31.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:31.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:31.460 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.098745644999994, 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:31.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:31.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:31.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:31.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:31.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:31.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:31.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:31.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:31.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:31.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:31.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:31.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:31.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:31.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:31.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:31.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:31.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:31.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:31.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:31.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:31.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:31.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:31.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:31.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:31.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:31.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:31.467 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.467 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.467 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.467 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.467 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:31.467 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.098721677, 2024-04-26T12:28:31.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:31.467 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.468 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.468 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:31.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:31.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:31.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:31.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:31.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:31.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:31.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:31.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:31.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:31.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:31.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:31.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:31.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:31.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:31.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:31.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:31.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:31.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:31.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:31.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:31.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:31.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:31.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:31.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:31.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:31.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:31.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:31.473 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.474 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.474 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.474 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:31.474 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:31.474 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 98.098688296000006, 2024-04-26T12:28:31.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:31.474 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.474 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:31.474 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:31.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:31.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:31.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:31.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:31.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:31.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:31.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:31.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:31.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:31.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:31.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:31.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:31.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:31.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:31.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:31.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:31.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:31.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:31.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:31.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:31.478 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.478 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.478 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.479 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4519.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:28:31.479 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:31.479 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.070439707, 2024-04-26T12:28:31.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022614038, 2024-04-26T12:28:31.479 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:31.479 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:31.479 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:31.479 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4519", 2024-04-26T12:28:31.479 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:31.480 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 4 2024-04-26T12:28:31.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.480 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:31.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:31.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:31.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:31.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:31.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:31.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278320+0000", 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286502+0000", 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0081813960000000005 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286518+0000", 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6025e-05 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:31.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286526+0000", 2024-04-26T12:28:31.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.4290000000000001e-06 2024-04-26T12:28:31.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:31.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286596+0000", 2024-04-26T12:28:31.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9748999999999999e-05 2024-04-26T12:28:31.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:31.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286671+0000", 2024-04-26T12:28:31.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5097000000000003e-05 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286790+0000", 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011916799999999999 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.294164+0000", 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073738320000000003 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300871+0000", 2024-04-26T12:28:31.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067069499999999997 2024-04-26T12:28:31.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:31.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300904+0000", 2024-04-26T12:28:31.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2512999999999999e-05 2024-04-26T12:28:31.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:31.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:31.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:31.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300936+0000", 2024-04-26T12:28:31.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2218000000000002e-05 2024-04-26T12:28:31.484 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.484 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.484 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.484 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:31.485 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:31.485 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:31.485 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:28:31.487 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:31.487 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:31.485+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:31.587 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:31.586+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:31.631 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:31.632 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:31.632 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:31.632 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:31.642 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:31.643 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:31.663 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:31.663 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:31.663 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:31.663 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:31.665 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:31.666 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:31.688 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:31.687+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:31.776 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:31.776 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:31.787 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:31.788 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:31.787+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:31.889 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:31.888+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:31.922 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:31.922 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:31.933 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:31.989 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:31.989+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:32.069 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:32.069 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:32.080 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:32.123 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:32.122+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:32.191 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:32.190+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:32.217 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:32.217 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:32.228 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:32.292 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:32.292+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:32.393 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:32.392+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:32.402 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:32.402 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:32.413 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:32.494 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:32.493+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:32.552 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:32.552 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:32.563 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:32.606 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:32.606+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:32.696 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:32.694+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:32.700 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:32.700 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:32.712 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:32.796 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:32.795+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:32.803 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T12:28:32.803 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T12:28:32.803 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-04-26T12:28:32.803 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T12:28:32.804 INFO:teuthology.orchestra.console.smithi136:Power on 2024-04-26T12:28:32.804 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-26T12:28:32.828 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2024-04-26T12:28:32.829 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:28:32.850 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-26T12:28:32.888 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:28:32.890 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:32.890 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:32.897 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:32.896+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:32.902 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:32.998 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:32.997+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:33.036 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:33.036 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:33.046 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:33.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2024-04-26T12:28:33.099 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:33.098+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:33.179 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:33.179 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:33.190 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:33.200 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:33.199+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:33.301 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:33.299+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:33.365 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:33.365 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:33.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:33.420 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:33.419+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:33.503 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:33.502+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:33.515 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:33.515 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:33.527 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:33.610 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:33.609+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:33.667 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:28:33.706 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:33.704+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:33.715 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:33.715 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:33.727 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:33.802 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2024-04-26T12:28:33.807 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:33.805+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:33.838 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:33.861 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:33.861 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:33.862 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:33.862 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:33.864 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:33.864 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:33.908 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.908 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.65554815500001, 2024-04-26T12:28:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:33.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:33.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:33.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:33.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.914 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.654727236, 2024-04-26T12:28:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:33.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.654697146, 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:33.920 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:33.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:33.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:33.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:33.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:33.930 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.654643358, 2024-04-26T12:28:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.654590801, 2024-04-26T12:28:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:33.936 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:33.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:33.942 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:33.906+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:33.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:33.943 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.654550587, 2024-04-26T12:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:33.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:33.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.654522426, 2024-04-26T12:28:33.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:33.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:33.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:33.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.954 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.654491737, 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:33.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.958 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:34 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 100.654465164, 2024-04-26T12:28:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077464860000000003, 2024-04-26T12:28:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251913+0000", 2024-04-26T12:28:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251917+0000", 2024-04-26T12:28:33.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1330000000000001e-06 2024-04-26T12:28:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251925+0000", 2024-04-26T12:28:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2479999999999996e-06 2024-04-26T12:28:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251932+0000", 2024-04-26T12:28:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6379999999999998e-06 2024-04-26T12:28:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251989+0000", 2024-04-26T12:28:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7790000000000001e-05 2024-04-26T12:28:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252103+0000", 2024-04-26T12:28:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011375900000000001 2024-04-26T12:28:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.259660+0000", 2024-04-26T12:28:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075564860000000003 2024-04-26T12:28:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.962 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4519.0:4 4.32 e47/14 4:4def72d4:::10000000003.00000000:head v 47'2, mlcod=0'0)", 2024-04-26T12:28:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.6194534680000001, 2024-04-26T12:28:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013679491, 2024-04-26T12:28:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:33.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286924+0000", 2024-04-26T12:28:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292324+0000", 2024-04-26T12:28:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054002099999999999 2024-04-26T12:28:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292346+0000", 2024-04-26T12:28:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1733e-05 2024-04-26T12:28:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292356+0000", 2024-04-26T12:28:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:28:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292409+0000", 2024-04-26T12:28:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3359000000000002e-05 2024-04-26T12:28:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292430+0000", 2024-04-26T12:28:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0140999999999999e-05 2024-04-26T12:28:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300546+0000", 2024-04-26T12:28:33.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081164429999999992 2024-04-26T12:28:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300604+0000", 2024-04-26T12:28:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8270000000000003e-05 2024-04-26T12:28:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:5 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:33.967 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.3752750690000002, 2024-04-26T12:28:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015201111, 2024-04-26T12:28:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 5 2024-04-26T12:28:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531102+0000", 2024-04-26T12:28:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535869+0000", 2024-04-26T12:28:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047671199999999997 2024-04-26T12:28:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535886+0000", 2024-04-26T12:28:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6861e-05 2024-04-26T12:28:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535900+0000", 2024-04-26T12:28:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4457999999999999e-05 2024-04-26T12:28:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535985+0000", 2024-04-26T12:28:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4656999999999999e-05 2024-04-26T12:28:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.536103+0000", 2024-04-26T12:28:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118163 2024-04-26T12:28:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.536198+0000", 2024-04-26T12:28:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4840999999999995e-05 2024-04-26T12:28:33.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.539923+0000", 2024-04-26T12:28:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037246639999999999 2024-04-26T12:28:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546203+0000", 2024-04-26T12:28:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062805420000000001 2024-04-26T12:28:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546245+0000", 2024-04-26T12:28:33.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1270999999999998e-05 2024-04-26T12:28:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546304+0000", 2024-04-26T12:28:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9769999999999999e-05 2024-04-26T12:28:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:6 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.3704592139999998, 2024-04-26T12:28:33.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021621960999999999, 2024-04-26T12:28:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 6 2024-04-26T12:28:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535918+0000", 2024-04-26T12:28:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547051+0000", 2024-04-26T12:28:33.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011132853999999999 2024-04-26T12:28:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547063+0000", 2024-04-26T12:28:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2113000000000001e-05 2024-04-26T12:28:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547086+0000", 2024-04-26T12:28:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3538000000000001e-05 2024-04-26T12:28:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547144+0000", 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7284000000000002e-05 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547289+0000", 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014546900000000001 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557445+0000", 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010155717 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:33.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557492+0000", 2024-04-26T12:28:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6749999999999998e-05 2024-04-26T12:28:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557541+0000", 2024-04-26T12:28:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9440000000000001e-05 2024-04-26T12:28:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:33 4.2d 4:b79a54f6:::10000000218.00000000:head [write 0~1440] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:33.978 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.575420+0000", 2024-04-26T12:28:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.3309582949999998, 2024-04-26T12:28:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088017700000000004, 2024-04-26T12:28:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 33 2024-04-26T12:28:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.575420+0000", 2024-04-26T12:28:33.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.575420+0000", 2024-04-26T12:28:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.575419+0000", 2024-04-26T12:28:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.575427+0000", 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7109999999999995e-06 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.575438+0000", 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1632e-05 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.575447+0000", 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2570000000000007e-06 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.575484+0000", 2024-04-26T12:28:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6837e-05 2024-04-26T12:28:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.575596+0000", 2024-04-26T12:28:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112658 2024-04-26T12:28:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.584103+0000", 2024-04-26T12:28:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085064609999999999 2024-04-26T12:28:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.584150+0000", 2024-04-26T12:28:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7485999999999999e-05 2024-04-26T12:28:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.584222+0000", 2024-04-26T12:28:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1569999999999994e-05 2024-04-26T12:28:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:34 4.3d 4:bc0c3701:::10000000219.00000000:head [write 0~1559] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:33.983 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.576222+0000", 2024-04-26T12:28:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.3301566920000001, 2024-04-26T12:28:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00814841, 2024-04-26T12:28:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 34 2024-04-26T12:28:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.576222+0000", 2024-04-26T12:28:33.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.576222+0000", 2024-04-26T12:28:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.576221+0000", 2024-04-26T12:28:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.576226+0000", 2024-04-26T12:28:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0699999999999997e-06 2024-04-26T12:28:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.576234+0000", 2024-04-26T12:28:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7209999999999994e-06 2024-04-26T12:28:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.576239+0000", 2024-04-26T12:28:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2120000000000002e-06 2024-04-26T12:28:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.576276+0000", 2024-04-26T12:28:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7685000000000003e-05 2024-04-26T12:28:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.576393+0000", 2024-04-26T12:28:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011689 2024-04-26T12:28:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.576526+0000", 2024-04-26T12:28:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000132304 2024-04-26T12:28:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.577430+0000", 2024-04-26T12:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090471599999999996 2024-04-26T12:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.584242+0000", 2024-04-26T12:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068112720000000002 2024-04-26T12:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.584289+0000", 2024-04-26T12:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7491999999999999e-05 2024-04-26T12:28:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.584370+0000", 2024-04-26T12:28:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0835999999999997e-05 2024-04-26T12:28:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:35 4.27 4:e5a5749e:::1000000021a.00000000:head [write 0~1481] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.577047+0000", 2024-04-26T12:28:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.329331212, 2024-04-26T12:28:33.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071659660000000002, 2024-04-26T12:28:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 35 2024-04-26T12:28:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.577047+0000", 2024-04-26T12:28:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.577047+0000", 2024-04-26T12:28:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.577047+0000", 2024-04-26T12:28:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.577050+0000", 2024-04-26T12:28:33.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9629999999999998e-06 2024-04-26T12:28:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.577056+0000", 2024-04-26T12:28:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2740000000000004e-06 2024-04-26T12:28:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.577060+0000", 2024-04-26T12:28:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.76e-06 2024-04-26T12:28:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.577087+0000", 2024-04-26T12:28:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7223999999999999e-05 2024-04-26T12:28:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.577162+0000", 2024-04-26T12:28:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4789999999999994e-05 2024-04-26T12:28:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.577237+0000", 2024-04-26T12:28:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5082999999999999e-05 2024-04-26T12:28:33.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.578215+0000", 2024-04-26T12:28:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00097875799999999993 2024-04-26T12:28:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.584127+0000", 2024-04-26T12:28:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059113899999999999 2024-04-26T12:28:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.584175+0000", 2024-04-26T12:28:33.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7984e-05 2024-04-26T12:28:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.584213+0000", 2024-04-26T12:28:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8226000000000003e-05 2024-04-26T12:28:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:55 4.f 4:f25dd5df:::1000000022e.00000000:head [write 0~1145] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.593358+0000", 2024-04-26T12:28:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.3130206910000002, 2024-04-26T12:28:33.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086807399999999993, 2024-04-26T12:28:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 55 2024-04-26T12:28:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.593358+0000", 2024-04-26T12:28:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.593358+0000", 2024-04-26T12:28:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.593357+0000", 2024-04-26T12:28:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.593362+0000", 2024-04-26T12:28:33.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7770000000000002e-06 2024-04-26T12:28:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.593370+0000", 2024-04-26T12:28:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2770000000000005e-06 2024-04-26T12:28:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.593378+0000", 2024-04-26T12:28:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1799999999999996e-06 2024-04-26T12:28:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.593426+0000", 2024-04-26T12:28:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7750000000000002e-05 2024-04-26T12:28:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.593560+0000", 2024-04-26T12:28:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013433100000000001 2024-04-26T12:28:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.601973+0000", 2024-04-26T12:28:33.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084129430000000009 2024-04-26T12:28:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.602000+0000", 2024-04-26T12:28:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6693999999999999e-05 2024-04-26T12:28:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.602038+0000", 2024-04-26T12:28:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8516000000000002e-05 2024-04-26T12:28:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:61 4.24 4:242ba651:::10000000234.00000000:head [write 0~1144] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.598253+0000", 2024-04-26T12:28:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.3081254850000001, 2024-04-26T12:28:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.008644021, 2024-04-26T12:28:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 61 2024-04-26T12:28:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:34.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.598253+0000", 2024-04-26T12:28:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.598253+0000", 2024-04-26T12:28:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.598252+0000", 2024-04-26T12:28:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.598257+0000", 2024-04-26T12:28:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.096e-06 2024-04-26T12:28:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.598265+0000", 2024-04-26T12:28:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3719999999999999e-06 2024-04-26T12:28:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.598269+0000", 2024-04-26T12:28:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1880000000000004e-06 2024-04-26T12:28:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.598306+0000", 2024-04-26T12:28:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7172999999999998e-05 2024-04-26T12:28:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.598418+0000", 2024-04-26T12:28:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112015 2024-04-26T12:28:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.598546+0000", 2024-04-26T12:28:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012829599999999999 2024-04-26T12:28:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.601001+0000", 2024-04-26T12:28:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024543830000000001 2024-04-26T12:28:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.606819+0000", 2024-04-26T12:28:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058178960000000004 2024-04-26T12:28:34.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.606862+0000", 2024-04-26T12:28:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3334000000000002e-05 2024-04-26T12:28:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.606897+0000", 2024-04-26T12:28:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4925999999999997e-05 2024-04-26T12:28:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:62 4.22 4:47efb22f:::10000000235.00000000:head [write 0~1242] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.599062+0000", 2024-04-26T12:28:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.3073166980000002, 2024-04-26T12:28:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078155780000000001, 2024-04-26T12:28:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 62 2024-04-26T12:28:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.599062+0000", 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.599062+0000", 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.599061+0000", 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.008 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.599068+0000", 2024-04-26T12:28:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3490000000000003e-06 2024-04-26T12:28:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.599079+0000", 2024-04-26T12:28:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1273e-05 2024-04-26T12:28:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.599086+0000", 2024-04-26T12:28:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3069999999999999e-06 2024-04-26T12:28:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.599127+0000", 2024-04-26T12:28:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1539000000000003e-05 2024-04-26T12:28:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.599233+0000", 2024-04-26T12:28:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105413 2024-04-26T12:28:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.599347+0000", 2024-04-26T12:28:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114876 2024-04-26T12:28:34.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.601021+0000", 2024-04-26T12:28:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00167333 2024-04-26T12:28:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.606806+0000", 2024-04-26T12:28:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057856849999999996 2024-04-26T12:28:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.606845+0000", 2024-04-26T12:28:34.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8055000000000001e-05 2024-04-26T12:28:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.606877+0000", 2024-04-26T12:28:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2594e-05 2024-04-26T12:28:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:137 4.20 4:04cd38c2:::10000000282.00000000:head [write 0~98] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.664663+0000", 2024-04-26T12:28:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.2417156550000001, 2024-04-26T12:28:34.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082443870000000006, 2024-04-26T12:28:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 137 2024-04-26T12:28:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.664663+0000", 2024-04-26T12:28:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:34.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.664663+0000", 2024-04-26T12:28:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.664662+0000", 2024-04-26T12:28:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:34.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.664667+0000", 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1309999999999997e-06 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.664680+0000", 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2985e-05 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.664688+0000", 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3620000000000006e-06 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.664717+0000", 2024-04-26T12:28:34.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8918999999999999e-05 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.664792+0000", 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4856000000000003e-05 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.664873+0000", 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0820000000000002e-05 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.667473+0000", 2024-04-26T12:28:34.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026003829999999999 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.672811+0000", 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053378039999999998 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.672844+0000", 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3238000000000003e-05 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.672907+0000", 2024-04-26T12:28:34.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2657999999999995e-05 2024-04-26T12:28:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:53 3.14 3:2e2fa760:::200.00000001:head [write 1019835~1023974 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-26T12:28:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:31.453567+0000", 2024-04-26T12:28:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.4528109809999998, 2024-04-26T12:28:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01197317, 2024-04-26T12:28:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.018 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.453567+0000", 2024-04-26T12:28:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.453567+0000", 2024-04-26T12:28:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.453566+0000", 2024-04-26T12:28:34.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459556+0000", 2024-04-26T12:28:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059900830000000002 2024-04-26T12:28:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459585+0000", 2024-04-26T12:28:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8620999999999999e-05 2024-04-26T12:28:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459593+0000", 2024-04-26T12:28:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8080000000000005e-06 2024-04-26T12:28:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459624+0000", 2024-04-26T12:28:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1065000000000002e-05 2024-04-26T12:28:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459675+0000", 2024-04-26T12:28:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1415000000000002e-05 2024-04-26T12:28:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459748+0000", 2024-04-26T12:28:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3053999999999995e-05 2024-04-26T12:28:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.462144+0000", 2024-04-26T12:28:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023954369999999998 2024-04-26T12:28:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.465338+0000", 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031939429999999999 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.465457+0000", 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118961 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.465540+0000", 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3725000000000002e-05 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.023 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.024 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:34.024 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:34.024 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:34.025 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:34.024+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:34.126 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:34.125+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:34.158 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:34.158 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:34.158 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:34.158 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:34.170 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:34.254 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:34.253+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:34.327 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:34.326+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:34.344 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:34.344 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:34.344 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:34.344 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:34.344 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:34.355 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:34.439 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:34.438+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:34.530 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:34.529+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:34.533 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:34.533 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:34.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:34.533 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:34.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.534 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.534 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:34.534 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.2812241, 2024-04-26T12:28:34.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:34.534 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.534 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.534 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:34.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:34.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:34.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:34.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:34.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:34.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:34.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:34.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:34.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:34.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:34.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:34.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:34.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:34.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:34.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:34.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:34.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:34.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:34.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:34.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:34.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:34.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:34.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.540 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.541 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.541 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:34.541 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.28118788800001, 2024-04-26T12:28:34.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:34.541 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.541 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.541 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:34.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:34.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:34.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:34.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:34.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:34.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:34.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:34.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:34.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:34.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:34.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:34.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:34.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:34.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:34.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:34.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:34.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:34.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:34.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:34.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:34.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:34.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:34.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:34.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:34.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:34.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:34.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:34.547 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.547 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.547 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.547 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.547 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:34.547 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.281148914, 2024-04-26T12:28:34.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:34.547 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.547 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.547 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:34.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:34.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:34.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:34.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:34.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:34.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:34.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:34.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:34.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:34.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:34.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:34.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:34.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:34.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:34.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:34.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:34.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:34.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:34.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:34.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:34.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:34.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:34.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.281125747, 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.553 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.554 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:34.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:34.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:34.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:34.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:34.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:34.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:34.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:34.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:34.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:34.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:34.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:34.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:34.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:34.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:34.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:34.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:34.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:34.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:34.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:34.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:34.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:34.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:34.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:34.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:34.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:34.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:34.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:34.559 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.559 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.559 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.559 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.559 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:34.559 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.28111036999999, 2024-04-26T12:28:34.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:34.560 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.560 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.560 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:34.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:34.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:34.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:34.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:34.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:34.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:34.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:34.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:34.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:34.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:34.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:34.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:34.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:34.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:34.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:34.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:34.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:34.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:34.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:34.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:34.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:34.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:34.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:34.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:34.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:34.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:34.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:34.566 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.566 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.566 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.566 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.566 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:34.566 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.28108218, 2024-04-26T12:28:34.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:34.566 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.566 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.566 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:34.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:34.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:34.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:34.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:34.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:34.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:34.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:34.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:34.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:34.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:34.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:34.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:34.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:34.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:34.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:34.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:34.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:34.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:34.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:34.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:34.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:34.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:34.572 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.572 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.572 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.572 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.572 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:34.572 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.28106418199999, 2024-04-26T12:28:34.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:34.573 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.573 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.573 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:34.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:34.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:34.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:34.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:34.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:34.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:34.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:34.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:34.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:34.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:34.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:34.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:34.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:34.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:34.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:34.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:34.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:34.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:34.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:34.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:34.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:34.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:34.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:34.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:34.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:34.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:34.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:34.578 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.578 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.578 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.281039591, 2024-04-26T12:28:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:34.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:34.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:34.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:34.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:34.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:34.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:34.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:34.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:34.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:34.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:34.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:34.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:34.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:34.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:34.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:34.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:34.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:34.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:34.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:34.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:34.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:34.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:34.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:34.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:34.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:34.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:34.584 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.584 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.584 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.585 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.585 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:34.585 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.281014642, 2024-04-26T12:28:34.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:34.585 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.585 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.585 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:34.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:34.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:34.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:34.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:34.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:34.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:34.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:34.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:34.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:34.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:34.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:34.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:34.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:34.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:34.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:34.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:34.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:34.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:34.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:34.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:34.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:34.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:34.591 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.591 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.591 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.591 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.591 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:34.591 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.280993718, 2024-04-26T12:28:34.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:34.591 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.591 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.591 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:34.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:34.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:34.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:34.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:34.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:34.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:34.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:34.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:34.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:34.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:34.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:34.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:34.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:34.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:34.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:34.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:34.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:34.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:34.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:34.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:34.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:34.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:34.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:34.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:34.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:34.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:34.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:34.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:34.597 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.597 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.597 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.597 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.597 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:34.597 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.280958869, 2024-04-26T12:28:34.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:34.598 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.598 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.598 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:34.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:34.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:34.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:34.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:34.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:34.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:34.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:34.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:34.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:34.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:34.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:34.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:34.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:34.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:34.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:34.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:34.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:34.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:34.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:34.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:34.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:34.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:34.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:34.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:34.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:34.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:34.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:34.603 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.603 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.603 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.604 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.604 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:34.604 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.280924919, 2024-04-26T12:28:34.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:34.604 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.604 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.604 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:34.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:34.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:34.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:34.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:34.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:34.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:34.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:34.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:34.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:34.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:34.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:34.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:34.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:34.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:34.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:34.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:34.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:34.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:34.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:34.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:34.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:34.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:34.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:34.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:34.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:34.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:34.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:34.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:34.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.610 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.610 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.610 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:34.610 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.28090462199999, 2024-04-26T12:28:34.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:34.610 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.610 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.610 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:34.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:34.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:34.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:34.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:34.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:34.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:34.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:34.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:34.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:34.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:34.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:34.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:34.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:34.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:34.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:34.616 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.616 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.616 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.616 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.616 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:34.616 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.280869501, 2024-04-26T12:28:34.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:34.616 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.616 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.616 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:34.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:34.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:34.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:34.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:34.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:34.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:34.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:34.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:34.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:34.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:34.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:34.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:34.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:34.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:34.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:34.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:34.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:34.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:34.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:34.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:34.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:34.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:34.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:34.622 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.622 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.622 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.622 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.622 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:34.622 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.280834261, 2024-04-26T12:28:34.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:34.623 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.623 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.623 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:34.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:34.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:34.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:34.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:34.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:34.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:34.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:34.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:34.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:34.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:34.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:34.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:34.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:34.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:34.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:34.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:34.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.629 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.629 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:34.629 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.28069251300001, 2024-04-26T12:28:34.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:34.629 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.629 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.629 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:34.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:34.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:34.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:34.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:34.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:34.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:34.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:34.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:34.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:34.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:34.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:34.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:34.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:34.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:34.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:34.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:34.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:34.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:34.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:34.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:34.635 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.635 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.635 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.635 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.635 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:34.635 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.280668494, 2024-04-26T12:28:34.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:34.635 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.635 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.635 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:34.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:34.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:34.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:34.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:34.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:34.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:34.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:34.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:34.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:34.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:34.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:34.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:34.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:34.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:34.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:34.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:34.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:34.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:34.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:34.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:34.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.642 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.642 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:34.642 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.280644526, 2024-04-26T12:28:34.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:34.642 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.642 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.642 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:34.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:34.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:34.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:34.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:34.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:34.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:34.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:34.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:34.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:34.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:34.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:34.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:34.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:34.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:34.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:34.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:34.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:34.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:34.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:34.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:34.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:34.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:34.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:34.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:34.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:34.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:34.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:34.647 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.648 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.648 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.648 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:34.648 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:34.648 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 101.28061114499999, 2024-04-26T12:28:34.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:34.648 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.648 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:34.648 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:34.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.653 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4519.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:28:34.653 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:34.653 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.2523625559999996, 2024-04-26T12:28:34.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022614038, 2024-04-26T12:28:34.653 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:34.653 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:34.653 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:34.653 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4519", 2024-04-26T12:28:34.653 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:34.653 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 4 2024-04-26T12:28:34.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.653 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:34.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:34.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:34.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:34.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:34.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:34.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:34.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278320+0000", 2024-04-26T12:28:34.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:34.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:34.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286502+0000", 2024-04-26T12:28:34.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0081813960000000005 2024-04-26T12:28:34.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:34.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286518+0000", 2024-04-26T12:28:34.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6025e-05 2024-04-26T12:28:34.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286526+0000", 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.4290000000000001e-06 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286596+0000", 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9748999999999999e-05 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286671+0000", 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5097000000000003e-05 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:34.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286790+0000", 2024-04-26T12:28:34.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011916799999999999 2024-04-26T12:28:34.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:34.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.294164+0000", 2024-04-26T12:28:34.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073738320000000003 2024-04-26T12:28:34.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:34.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300871+0000", 2024-04-26T12:28:34.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067069499999999997 2024-04-26T12:28:34.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:34.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300904+0000", 2024-04-26T12:28:34.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2512999999999999e-05 2024-04-26T12:28:34.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:34.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:34.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:34.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300936+0000", 2024-04-26T12:28:34.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2218000000000002e-05 2024-04-26T12:28:34.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.658 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:34.658 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:34.659 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:34.660 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:34.658+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:34.660 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:34.761 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:34.760+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:34.800 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4001 4.1f 4:fa5c516a:::10000001320.00000000:head [write 0~363 in=363b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.794724+0000", 2024-04-26T12:28:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.0056840090000000003, 2024-04-26T12:28:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057032380000000002, 2024-04-26T12:28:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:34.801 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4001 2024-04-26T12:28:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.794724+0000", 2024-04-26T12:28:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.794724+0000", 2024-04-26T12:28:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.794723+0000", 2024-04-26T12:28:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.794729+0000", 2024-04-26T12:28:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6500000000000001e-06 2024-04-26T12:28:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.794741+0000", 2024-04-26T12:28:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1785e-05 2024-04-26T12:28:34.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.794750+0000", 2024-04-26T12:28:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6569999999999992e-06 2024-04-26T12:28:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.794782+0000", 2024-04-26T12:28:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1392e-05 2024-04-26T12:28:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.794880+0000", 2024-04-26T12:28:34.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8111999999999998e-05 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.794961+0000", 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1539999999999995e-05 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.795865+0000", 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00090386600000000002 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4003 4.20 4:07a2cfab:::10000001322.00000000:head [write 0~465 in=465b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.796469+0000", 2024-04-26T12:28:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.0039397210000000002, 2024-04-26T12:28:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040120479999999998, 2024-04-26T12:28:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4003 2024-04-26T12:28:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:34.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.796469+0000", 2024-04-26T12:28:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.796469+0000", 2024-04-26T12:28:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.796468+0000", 2024-04-26T12:28:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.796473+0000", 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7089999999999999e-06 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.796485+0000", 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.201e-05 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.796495+0000", 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5689999999999994e-06 2024-04-26T12:28:34.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.796527+0000", 2024-04-26T12:28:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1634999999999998e-05 2024-04-26T12:28:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.796621+0000", 2024-04-26T12:28:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4421999999999998e-05 2024-04-26T12:28:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.796701+0000", 2024-04-26T12:28:34.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9917000000000001e-05 2024-04-26T12:28:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.797282+0000", 2024-04-26T12:28:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058149999999999999 2024-04-26T12:28:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4006 4.18 4:1931d677:::10000001325.00000000:head [write 0~415 in=415b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.800050+0000", 2024-04-26T12:28:34.810 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.00035808500000000001, 2024-04-26T12:28:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047741, 2024-04-26T12:28:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4006 2024-04-26T12:28:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.800050+0000", 2024-04-26T12:28:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:34.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.800050+0000", 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.800049+0000", 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.800055+0000", 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4360000000000001e-06 2024-04-26T12:28:34.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.800067+0000", 2024-04-26T12:28:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1963999999999999e-05 2024-04-26T12:28:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.800075+0000", 2024-04-26T12:28:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7930000000000003e-06 2024-04-26T12:28:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.800102+0000", 2024-04-26T12:28:34.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6276999999999999e-05 2024-04-26T12:28:34.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:34.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.800177+0000", 2024-04-26T12:28:34.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5430000000000001e-05 2024-04-26T12:28:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.800258+0000", 2024-04-26T12:28:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0309999999999995e-05 2024-04-26T12:28:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-26T12:28:34.815 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 3 2024-04-26T12:28:34.815 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:34.816 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:34.861 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:34.860+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:34.958 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:34.958 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:34.958 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:34.958 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:34.958 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:34.962 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:34.961+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:34.969 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:35.063 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:35.061+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:35.155 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 101.899292917, 2024-04-26T12:28:35.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:35.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.160 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 101.89847199800001, 2024-04-26T12:28:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:35.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:35.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.166 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 101.898441908, 2024-04-26T12:28:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:35.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:35.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:35.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 101.89838812000001, 2024-04-26T12:28:35.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:35.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:35.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:35.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 101.898335563, 2024-04-26T12:28:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:35.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:35.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.183 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 101.89829534899999, 2024-04-26T12:28:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:35.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:35.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:35.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 101.89826718800001, 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:35.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:35.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:35.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:35.196 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 101.89823649900001, 2024-04-26T12:28:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:35.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4519.0:4 4.32 e47/14 4:4def72d4:::10000000003.00000000:head v 47'2, mlcod=0'0)", 2024-04-26T12:28:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:35.200 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.8631982300000001, 2024-04-26T12:28:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013679491, 2024-04-26T12:28:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286924+0000", 2024-04-26T12:28:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292324+0000", 2024-04-26T12:28:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054002099999999999 2024-04-26T12:28:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292346+0000", 2024-04-26T12:28:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1733e-05 2024-04-26T12:28:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292356+0000", 2024-04-26T12:28:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:28:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292409+0000", 2024-04-26T12:28:35.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3359000000000002e-05 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292430+0000", 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0140999999999999e-05 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300546+0000", 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081164429999999992 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300604+0000", 2024-04-26T12:28:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8270000000000003e-05 2024-04-26T12:28:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:5 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.6190198310000001, 2024-04-26T12:28:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015201111, 2024-04-26T12:28:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.205 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 5 2024-04-26T12:28:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:35.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531102+0000", 2024-04-26T12:28:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535869+0000", 2024-04-26T12:28:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047671199999999997 2024-04-26T12:28:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535886+0000", 2024-04-26T12:28:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6861e-05 2024-04-26T12:28:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535900+0000", 2024-04-26T12:28:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4457999999999999e-05 2024-04-26T12:28:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535985+0000", 2024-04-26T12:28:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4656999999999999e-05 2024-04-26T12:28:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.536103+0000", 2024-04-26T12:28:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118163 2024-04-26T12:28:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.536198+0000", 2024-04-26T12:28:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4840999999999995e-05 2024-04-26T12:28:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.539923+0000", 2024-04-26T12:28:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037246639999999999 2024-04-26T12:28:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546203+0000", 2024-04-26T12:28:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062805420000000001 2024-04-26T12:28:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546245+0000", 2024-04-26T12:28:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1270999999999998e-05 2024-04-26T12:28:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546304+0000", 2024-04-26T12:28:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9769999999999999e-05 2024-04-26T12:28:35.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:6 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.6142039759999998, 2024-04-26T12:28:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021621960999999999, 2024-04-26T12:28:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:35.211 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 6 2024-04-26T12:28:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535918+0000", 2024-04-26T12:28:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547051+0000", 2024-04-26T12:28:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011132853999999999 2024-04-26T12:28:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547063+0000", 2024-04-26T12:28:35.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2113000000000001e-05 2024-04-26T12:28:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547086+0000", 2024-04-26T12:28:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3538000000000001e-05 2024-04-26T12:28:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547144+0000", 2024-04-26T12:28:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7284000000000002e-05 2024-04-26T12:28:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547289+0000", 2024-04-26T12:28:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014546900000000001 2024-04-26T12:28:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557445+0000", 2024-04-26T12:28:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010155717 2024-04-26T12:28:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557492+0000", 2024-04-26T12:28:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6749999999999998e-05 2024-04-26T12:28:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557541+0000", 2024-04-26T12:28:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9440000000000001e-05 2024-04-26T12:28:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:53 3.14 3:2e2fa760:::200.00000001:head [write 1019835~1023974 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-26T12:28:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:31.453567+0000", 2024-04-26T12:28:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.6965557430000002, 2024-04-26T12:28:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01197317, 2024-04-26T12:28:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.216 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.453567+0000", 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.453567+0000", 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.453566+0000", 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:35.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459556+0000", 2024-04-26T12:28:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059900830000000002 2024-04-26T12:28:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459585+0000", 2024-04-26T12:28:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8620999999999999e-05 2024-04-26T12:28:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459593+0000", 2024-04-26T12:28:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8080000000000005e-06 2024-04-26T12:28:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459624+0000", 2024-04-26T12:28:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1065000000000002e-05 2024-04-26T12:28:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459675+0000", 2024-04-26T12:28:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1415000000000002e-05 2024-04-26T12:28:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459748+0000", 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3053999999999995e-05 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.462144+0000", 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023954369999999998 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.465338+0000", 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031939429999999999 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.465457+0000", 2024-04-26T12:28:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118961 2024-04-26T12:28:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.465540+0000", 2024-04-26T12:28:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3725000000000002e-05 2024-04-26T12:28:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:65 3.1b 3:ddb4e4d7:::200.00000002:head [write 2912462~997814 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-26T12:28:35.221 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.71217427099999997, 2024-04-26T12:28:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014884231, 2024-04-26T12:28:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:35.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437948+0000", 2024-04-26T12:28:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440692+0000", 2024-04-26T12:28:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027439579999999999 2024-04-26T12:28:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440720+0000", 2024-04-26T12:28:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8209999999999999e-05 2024-04-26T12:28:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440735+0000", 2024-04-26T12:28:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.554e-05 2024-04-26T12:28:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440839+0000", 2024-04-26T12:28:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001038 2024-04-26T12:28:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440895+0000", 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6221000000000003e-05 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440982+0000", 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6556000000000003e-05 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.443471+0000", 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024888250000000001 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452760+0000", 2024-04-26T12:28:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092887869999999997 2024-04-26T12:28:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452790+0000", 2024-04-26T12:28:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0267e-05 2024-04-26T12:28:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452833+0000", 2024-04-26T12:28:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3093999999999998e-05 2024-04-26T12:28:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.226 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:3891 4.14 4:2914052b:::100000012aa.00000000:head [write 0~1579] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.452139711, 2024-04-26T12:28:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012921406, 2024-04-26T12:28:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:35.227 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 3891 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697988+0000", 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.395e-06 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697994+0000", 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1539999999999999e-06 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697999+0000", 2024-04-26T12:28:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4569999999999998e-06 2024-04-26T12:28:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698025+0000", 2024-04-26T12:28:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6384e-05 2024-04-26T12:28:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698100+0000", 2024-04-26T12:28:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5340999999999996e-05 2024-04-26T12:28:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710785+0000", 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012684755000000001 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710834+0000", 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8955000000000001e-05 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710905+0000", 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0754999999999996e-05 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.231 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:3892 4.8 4:12bbb26b:::100000012ab.00000000:head [write 0~3199] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.698875+0000", 2024-04-26T12:28:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.451248127, 2024-04-26T12:28:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012025522, 2024-04-26T12:28:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 3892 2024-04-26T12:28:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.232 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698875+0000", 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698875+0000", 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698874+0000", 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698880+0000", 2024-04-26T12:28:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4450000000000004e-06 2024-04-26T12:28:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698889+0000", 2024-04-26T12:28:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:28:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698894+0000", 2024-04-26T12:28:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0379999999999999e-06 2024-04-26T12:28:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698944+0000", 2024-04-26T12:28:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0324999999999997e-05 2024-04-26T12:28:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.699020+0000", 2024-04-26T12:28:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5805999999999999e-05 2024-04-26T12:28:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.699094+0000", 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4579999999999994e-05 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.699916+0000", 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000821998 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710827+0000", 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010911021 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710866+0000", 2024-04-26T12:28:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9208999999999997e-05 2024-04-26T12:28:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710900+0000", 2024-04-26T12:28:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3921999999999998e-05 2024-04-26T12:28:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.237 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4057 4.10 4:0a22fc52:::1000000135a.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.30485335600000002, 2024-04-26T12:28:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021108387999999999, 2024-04-26T12:28:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4057 2024-04-26T12:28:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845269+0000", 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845276+0000", 2024-04-26T12:28:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:28:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845286+0000", 2024-04-26T12:28:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0219e-05 2024-04-26T12:28:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845291+0000", 2024-04-26T12:28:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5840000000000002e-06 2024-04-26T12:28:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845325+0000", 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3429000000000001e-05 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845409+0000", 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4529000000000003e-05 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866264+0000", 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020854731000000001 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866305+0000", 2024-04-26T12:28:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0571000000000002e-05 2024-04-26T12:28:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866378+0000", 2024-04-26T12:28:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3447000000000003e-05 2024-04-26T12:28:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4064 4.3b 4:de2f294e:::10000001361.00000000:head [write 0~127] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:35.242 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.29893531299999998, 2024-04-26T12:28:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014714163000000001, 2024-04-26T12:28:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4064 2024-04-26T12:28:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:35.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851187+0000", 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851193+0000", 2024-04-26T12:28:35.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5999999999999997e-06 2024-04-26T12:28:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851204+0000", 2024-04-26T12:28:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1172000000000001e-05 2024-04-26T12:28:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851211+0000", 2024-04-26T12:28:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6750000000000002e-06 2024-04-26T12:28:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851254+0000", 2024-04-26T12:28:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2919e-05 2024-04-26T12:28:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851384+0000", 2024-04-26T12:28:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130013 2024-04-26T12:28:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865803+0000", 2024-04-26T12:28:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014418343 2024-04-26T12:28:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865857+0000", 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4567000000000001e-05 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865902+0000", 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4576999999999997e-05 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4065 4.3f 4:fea32a34:::10000001362.00000000:head [write 0~290] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:35.247 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.29810811199999998, 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013949731, 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4065 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852014+0000", 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852018+0000", 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7890000000000001e-06 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852025+0000", 2024-04-26T12:28:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8750000000000002e-06 2024-04-26T12:28:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852029+0000", 2024-04-26T12:28:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0999999999999997e-06 2024-04-26T12:28:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852083+0000", 2024-04-26T12:28:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000001e-05 2024-04-26T12:28:35.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852161+0000", 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7577000000000006e-05 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865845+0000", 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013684405 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865890+0000", 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5209e-05 2024-04-26T12:28:35.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865965+0000", 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4345999999999996e-05 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4066 4.1d 4:b9ed4029:::10000001363.00000000:head [write 0~133] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.29731065600000001, 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013115296, 2024-04-26T12:28:35.252 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4066 2024-04-26T12:28:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852816+0000", 2024-04-26T12:28:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:28:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852824+0000", 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.994e-06 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852831+0000", 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0600000000000002e-06 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852858+0000", 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6605e-05 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852932+0000", 2024-04-26T12:28:35.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4052000000000002e-05 2024-04-26T12:28:35.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:35.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853007+0000", 2024-04-26T12:28:35.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5580000000000005e-05 2024-04-26T12:28:35.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.857934+0000", 2024-04-26T12:28:35.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049264030000000002 2024-04-26T12:28:35.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865834+0000", 2024-04-26T12:28:35.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079004829999999998 2024-04-26T12:28:35.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865883+0000", 2024-04-26T12:28:35.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8723000000000001e-05 2024-04-26T12:28:35.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865928+0000", 2024-04-26T12:28:35.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4904999999999998e-05 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4067 4.15 4:a8b5213c:::10000001364.00000000:head [write 0~261] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.296484786, 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012718304, 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:35.258 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4067 2024-04-26T12:28:35.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.259 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:35.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:35.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:35.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:35.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:35.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:35.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853641+0000", 2024-04-26T12:28:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4620000000000001e-06 2024-04-26T12:28:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853649+0000", 2024-04-26T12:28:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6469999999999998e-06 2024-04-26T12:28:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853655+0000", 2024-04-26T12:28:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5699999999999998e-06 2024-04-26T12:28:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853681+0000", 2024-04-26T12:28:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6152999999999998e-05 2024-04-26T12:28:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853763+0000", 2024-04-26T12:28:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1656999999999994e-05 2024-04-26T12:28:35.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866245+0000", 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012482304 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866279+0000", 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3942999999999997e-05 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866357+0000", 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7151999999999996e-05 2024-04-26T12:28:35.262 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.263 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.263 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.263 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:35.263 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:35.263 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:35.264 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:35.262+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:35.265 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:35.365 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:35.364+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:35.398 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:35.398 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:35.399 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:35.399 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:35.409 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:35.467 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:35.465+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:35.567 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:35.566+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:35.585 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:35.585 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:35.586 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:35.586 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:35.586 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:35.597 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:35.683 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:35.681+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:35.771 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:35.770+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:35.774 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:35.775 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:35.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:35.775 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:35.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.775 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.776 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:35.776 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.52183593700001, 2024-04-26T12:28:35.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:35.776 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.776 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.776 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:35.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:35.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:35.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:35.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:35.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:35.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:35.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:35.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:35.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:35.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:35.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:35.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:35.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:35.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:35.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:35.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:35.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:35.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:35.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:35.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:35.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:35.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:35.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:35.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:35.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:35.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:35.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:35.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:35.790 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.790 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.790 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.791 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.791 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:35.791 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.52179972499999, 2024-04-26T12:28:35.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:35.791 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.791 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.792 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:35.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:35.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:35.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:35.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:35.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:35.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:35.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:35.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:35.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:35.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:35.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:35.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:35.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:35.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:35.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:35.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:35.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:35.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:35.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:35.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:35.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:35.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:35.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:35.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:35.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:35.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:35.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:35.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.805 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.805 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.806 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:35.806 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.521760751, 2024-04-26T12:28:35.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:35.806 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.807 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.807 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:35.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:35.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:35.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:35.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:35.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:35.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:35.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:35.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:35.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:35.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:35.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:35.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:35.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:35.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:35.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:35.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:35.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:35.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.52173758399999, 2024-04-26T12:28:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:35.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:35.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:35.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:35.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:35.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:35.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:35.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:35.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:35.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:35.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:35.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:35.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:35.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:35.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:35.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:35.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:35.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:35.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:35.835 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.835 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.835 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.836 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.836 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:35.836 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.521722207, 2024-04-26T12:28:35.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:35.836 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.836 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.836 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:35.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:35.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:35.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:35.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:35.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:35.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:35.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:35.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:35.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:35.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:35.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:35.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:35.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:35.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:35.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:35.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:35.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:35.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:35.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:35.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:35.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:35.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:35.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:35.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:35.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:35.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:35.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:35.842 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.842 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.842 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.842 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.842 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:35.842 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.521694017, 2024-04-26T12:28:35.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:35.842 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.842 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.843 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:35.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:35.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:35.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:35.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:35.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:35.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:35.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:35.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:35.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:35.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:35.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:35.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:35.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:35.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.521676019, 2024-04-26T12:28:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:35.848 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:35.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:35.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:35.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:35.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:35.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:35.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:35.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:35.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:35.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:35.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:35.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:35.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:35.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:35.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:35.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:35.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:35.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:35.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:35.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:35.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:35.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:35.854 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.854 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.854 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.854 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.854 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:35.854 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.521651428, 2024-04-26T12:28:35.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:35.855 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.855 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.855 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:35.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:35.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:35.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:35.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:35.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:35.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:35.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:35.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:35.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:35.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:35.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:35.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:35.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:35.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:35.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:35.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:35.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:35.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:35.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:35.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:35.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:35.860 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.860 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.860 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.860 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.861 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:35.861 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.52162647900001, 2024-04-26T12:28:35.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:35.861 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.861 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.861 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:35.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:35.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:35.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:35.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:35.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:35.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:35.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:35.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:35.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:35.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:35.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:35.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:35.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:35.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:35.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:35.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:35.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:35.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:35.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:35.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:35.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:35.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:35.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:35.866 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.866 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.866 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.867 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.867 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:35.867 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.52160555499999, 2024-04-26T12:28:35.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:35.867 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.867 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.867 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:35.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:35.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:35.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:35.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:35.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:35.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:35.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:35.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:35.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:35.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:35.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:35.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:35.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:35.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:35.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:35.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:35.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:35.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:35.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:35.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:35.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:35.872 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.872 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.52157070600001, 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:35.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:35.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:35.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:35.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:35.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:35.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:35.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:35.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:35.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:35.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:35.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:35.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:35.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:35.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:35.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:35.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:35.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:35.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:35.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:35.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:35.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:35.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:35.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:35.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:35.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:35.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:35.879 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.879 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.879 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.879 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.879 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:35.879 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.521536756, 2024-04-26T12:28:35.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:35.879 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.879 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.879 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:35.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:35.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:35.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:35.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:35.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:35.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:35.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:35.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:35.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:35.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:35.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:35.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:35.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:35.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:35.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:35.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:35.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:35.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:35.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:35.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:35.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.521516459, 2024-04-26T12:28:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:35.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:35.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:35.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:35.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:35.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:35.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:35.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:35.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:35.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:35.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:35.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:35.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:35.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:35.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:35.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:35.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:35.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:35.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:35.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:35.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.521481338, 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.891 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:35.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:35.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:35.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:35.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:35.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:35.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:35.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:35.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:35.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:35.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:35.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:35.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:35.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:35.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:35.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:35.897 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.897 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.897 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.897 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.897 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:35.898 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.521446098, 2024-04-26T12:28:35.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:35.898 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.898 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.898 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:35.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:35.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:35.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:35.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:35.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:35.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:35.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:35.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:35.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:35.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:35.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:35.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:35.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:35.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:35.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:35.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:35.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:35.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:35.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:35.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:35.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:35.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:35.903 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.903 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.903 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.903 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.52130434999999, 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:35.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:35.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:35.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:35.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:35.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:35.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:35.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:35.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:35.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:35.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:35.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:35.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:35.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:35.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:35.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:35.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:35.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:35.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:35.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:35.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:35.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:35.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:35.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:35.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:35.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:35.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:35.909 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.909 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.909 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.910 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.910 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:35.910 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.521280331, 2024-04-26T12:28:35.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:35.910 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.910 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.910 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:35.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:35.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:35.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:35.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:35.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:35.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:35.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:35.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:35.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:35.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:35.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:35.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:35.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:35.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:35.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:35.916 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.916 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.916 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.916 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.916 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:35.916 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.52125636300001, 2024-04-26T12:28:35.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:35.916 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.916 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.916 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:35.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:35.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:35.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:35.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:35.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:35.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:35.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:35.922 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.922 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.922 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.922 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:35.922 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:35.922 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 102.521222982, 2024-04-26T12:28:35.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:35.923 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.923 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:35.923 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:35.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:35.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:35.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:35.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:35.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:35.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:35.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:35.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:35.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:35.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:35.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:35.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:35.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:35.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:35.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:35.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:35.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:35.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:35.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:35.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:35.927 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.927 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.927 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.927 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4519.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:28:35.927 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:35.927 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.4929743929999999, 2024-04-26T12:28:35.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022614038, 2024-04-26T12:28:35.927 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:35.927 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:35.927 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:35.928 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4519", 2024-04-26T12:28:35.928 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:35.928 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 4 2024-04-26T12:28:35.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.928 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:35.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:35.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:35.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:35.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:35.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:35.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:35.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278320+0000", 2024-04-26T12:28:35.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:35.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:35.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286502+0000", 2024-04-26T12:28:35.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0081813960000000005 2024-04-26T12:28:35.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:35.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286518+0000", 2024-04-26T12:28:35.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6025e-05 2024-04-26T12:28:35.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:35.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286526+0000", 2024-04-26T12:28:35.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.4290000000000001e-06 2024-04-26T12:28:35.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:35.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286596+0000", 2024-04-26T12:28:35.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9748999999999999e-05 2024-04-26T12:28:35.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:35.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286671+0000", 2024-04-26T12:28:35.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5097000000000003e-05 2024-04-26T12:28:35.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:35.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286790+0000", 2024-04-26T12:28:35.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011916799999999999 2024-04-26T12:28:35.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:35.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.294164+0000", 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073738320000000003 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300871+0000", 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067069499999999997 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300904+0000", 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2512999999999999e-05 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:35.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300936+0000", 2024-04-26T12:28:35.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2218000000000002e-05 2024-04-26T12:28:35.933 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.933 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.933 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.933 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:35.933 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:35.933 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:35.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:28:35.934 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:28:35.935 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:35.933+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:35.936 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:36.036 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:36.035+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:36.076 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:36.076 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:36.076 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:36.076 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:36.087 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:36.127 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:36.150 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:36.151 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:36.151 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:36.151 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:36.154 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:36.154 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:36.171 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:36.170+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:36.238 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:36.236+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:36.270 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:36.270 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:36.282 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:36.365 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:36.364+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:36.440 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:36.438+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:36.470 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:36.470 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:36.482 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:36.541 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:36.539+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:36.616 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:36.616 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:36.627 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:36.641 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:36.640+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:36.742 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:36.741+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:36.763 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:36.763 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:36.775 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:36.808 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2024-04-26T12:28:36.843 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:36.842+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:36.852 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:28:36.907 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:36.907 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:36.918 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:36.962 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-26T12:28:36.963 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:36.961+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:37.045 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:37.043+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:37.077 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:37.078 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:37.090 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:37.146 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:37.145+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:37.247 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:37.245+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:37.270 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:37.270 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:37.282 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:37.366 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:37.365+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:37.449 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:37.447+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:37.463 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:37.463 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:37.474 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:37.550 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:37.549+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:37.608 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:37.608 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:37.620 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:37.661 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:37.660+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:37.752 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:37.751+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:37.800 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:37.800 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:37.811 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:37.853 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:37.851+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:37.953 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:37.952+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:37.985 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:37.986 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:37.997 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:38.054 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:38.053+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:38.138 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:38.138 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:38.149 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:38.154 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:28:38.194 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:38.193+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:38.256 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:38.254+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:38.288 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:38.288 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:38.299 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:38.330 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:38.353 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:38.353 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:38.353 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:38.353 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:38.356 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:38.356 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:38.357 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:38.355+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:38.458 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:38.456+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:38.478 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:38.478 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:38.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:38.478 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:38.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 105.225268533, 2024-04-26T12:28:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:38.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:38.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:38.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:38.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:38.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:38.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:38.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:38.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:38.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:38.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:38.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:38.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:38.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:38.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:38.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:38.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:38.484 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.484 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.484 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.484 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:38.484 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:38.484 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 105.224447614, 2024-04-26T12:28:38.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:38.485 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.485 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.485 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:38.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:38.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:38.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:38.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:38.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:38.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:38.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:38.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.489 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 105.224417524, 2024-04-26T12:28:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:38.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 105.224363736, 2024-04-26T12:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:38.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:38.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 105.224311179, 2024-04-26T12:28:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:38.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:38.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 105.224270965, 2024-04-26T12:28:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.506 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:38.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:38.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:38.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:38.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:38.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:38.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:38.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 105.224242804, 2024-04-26T12:28:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:38.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:38.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 105.224212115, 2024-04-26T12:28:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:38.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4519.0:4 4.32 e47/14 4:4def72d4:::10000000003.00000000:head v 47'2, mlcod=0'0)", 2024-04-26T12:28:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.1891738459999992, 2024-04-26T12:28:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013679491, 2024-04-26T12:28:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.521 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286924+0000", 2024-04-26T12:28:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292324+0000", 2024-04-26T12:28:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054002099999999999 2024-04-26T12:28:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292346+0000", 2024-04-26T12:28:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1733e-05 2024-04-26T12:28:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292356+0000", 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292409+0000", 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3359000000000002e-05 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292430+0000", 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0140999999999999e-05 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300546+0000", 2024-04-26T12:28:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081164429999999992 2024-04-26T12:28:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300604+0000", 2024-04-26T12:28:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8270000000000003e-05 2024-04-26T12:28:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:5 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:38.525 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 7.9449954470000002, 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015201111, 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 5 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531102+0000", 2024-04-26T12:28:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535869+0000", 2024-04-26T12:28:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047671199999999997 2024-04-26T12:28:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535886+0000", 2024-04-26T12:28:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6861e-05 2024-04-26T12:28:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535900+0000", 2024-04-26T12:28:38.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4457999999999999e-05 2024-04-26T12:28:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535985+0000", 2024-04-26T12:28:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4656999999999999e-05 2024-04-26T12:28:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.536103+0000", 2024-04-26T12:28:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118163 2024-04-26T12:28:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:38.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.536198+0000", 2024-04-26T12:28:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4840999999999995e-05 2024-04-26T12:28:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.539923+0000", 2024-04-26T12:28:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037246639999999999 2024-04-26T12:28:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546203+0000", 2024-04-26T12:28:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062805420000000001 2024-04-26T12:28:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546245+0000", 2024-04-26T12:28:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1270999999999998e-05 2024-04-26T12:28:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546304+0000", 2024-04-26T12:28:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9769999999999999e-05 2024-04-26T12:28:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:6 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:38.531 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 7.9401795919999998, 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021621960999999999, 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 6 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535918+0000", 2024-04-26T12:28:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547051+0000", 2024-04-26T12:28:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011132853999999999 2024-04-26T12:28:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547063+0000", 2024-04-26T12:28:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2113000000000001e-05 2024-04-26T12:28:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547086+0000", 2024-04-26T12:28:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3538000000000001e-05 2024-04-26T12:28:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547144+0000", 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7284000000000002e-05 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547289+0000", 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014546900000000001 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557445+0000", 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010155717 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557492+0000", 2024-04-26T12:28:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6749999999999998e-05 2024-04-26T12:28:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557541+0000", 2024-04-26T12:28:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9440000000000001e-05 2024-04-26T12:28:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.536 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:53 3.14 3:2e2fa760:::200.00000001:head [write 1019835~1023974 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:31.453567+0000", 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 7.0225313590000003, 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01197317, 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.453567+0000", 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.453567+0000", 2024-04-26T12:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.453566+0000", 2024-04-26T12:28:38.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:38.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459556+0000", 2024-04-26T12:28:38.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059900830000000002 2024-04-26T12:28:38.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459585+0000", 2024-04-26T12:28:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8620999999999999e-05 2024-04-26T12:28:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459593+0000", 2024-04-26T12:28:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8080000000000005e-06 2024-04-26T12:28:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459624+0000", 2024-04-26T12:28:38.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1065000000000002e-05 2024-04-26T12:28:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459675+0000", 2024-04-26T12:28:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1415000000000002e-05 2024-04-26T12:28:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.459748+0000", 2024-04-26T12:28:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3053999999999995e-05 2024-04-26T12:28:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.462144+0000", 2024-04-26T12:28:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023954369999999998 2024-04-26T12:28:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.465338+0000", 2024-04-26T12:28:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031939429999999999 2024-04-26T12:28:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.465457+0000", 2024-04-26T12:28:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118961 2024-04-26T12:28:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:31.465540+0000", 2024-04-26T12:28:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3725000000000002e-05 2024-04-26T12:28:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:65 3.1b 3:ddb4e4d7:::200.00000002:head [write 2912462~997814 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-26T12:28:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.0381498870000003, 2024-04-26T12:28:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014884231, 2024-04-26T12:28:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.542 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437948+0000", 2024-04-26T12:28:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440692+0000", 2024-04-26T12:28:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027439579999999999 2024-04-26T12:28:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440720+0000", 2024-04-26T12:28:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8209999999999999e-05 2024-04-26T12:28:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440735+0000", 2024-04-26T12:28:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.554e-05 2024-04-26T12:28:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440839+0000", 2024-04-26T12:28:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001038 2024-04-26T12:28:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440895+0000", 2024-04-26T12:28:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6221000000000003e-05 2024-04-26T12:28:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440982+0000", 2024-04-26T12:28:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6556000000000003e-05 2024-04-26T12:28:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.443471+0000", 2024-04-26T12:28:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024888250000000001 2024-04-26T12:28:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452760+0000", 2024-04-26T12:28:38.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092887869999999997 2024-04-26T12:28:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452790+0000", 2024-04-26T12:28:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0267e-05 2024-04-26T12:28:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452833+0000", 2024-04-26T12:28:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3093999999999998e-05 2024-04-26T12:28:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:3891 4.14 4:2914052b:::100000012aa.00000000:head [write 0~1579] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.7781153270000001, 2024-04-26T12:28:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012921406, 2024-04-26T12:28:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 3891 2024-04-26T12:28:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.548 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:38.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697988+0000", 2024-04-26T12:28:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.395e-06 2024-04-26T12:28:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697994+0000", 2024-04-26T12:28:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1539999999999999e-06 2024-04-26T12:28:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697999+0000", 2024-04-26T12:28:38.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4569999999999998e-06 2024-04-26T12:28:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698025+0000", 2024-04-26T12:28:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6384e-05 2024-04-26T12:28:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698100+0000", 2024-04-26T12:28:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5340999999999996e-05 2024-04-26T12:28:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710785+0000", 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012684755000000001 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710834+0000", 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8955000000000001e-05 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710905+0000", 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0754999999999996e-05 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:3892 4.8 4:12bbb26b:::100000012ab.00000000:head [write 0~3199] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.698875+0000", 2024-04-26T12:28:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.777223743, 2024-04-26T12:28:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012025522, 2024-04-26T12:28:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 3892 2024-04-26T12:28:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.553 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698875+0000", 2024-04-26T12:28:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698875+0000", 2024-04-26T12:28:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698874+0000", 2024-04-26T12:28:38.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698880+0000", 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4450000000000004e-06 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698889+0000", 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698894+0000", 2024-04-26T12:28:38.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0379999999999999e-06 2024-04-26T12:28:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698944+0000", 2024-04-26T12:28:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0324999999999997e-05 2024-04-26T12:28:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.699020+0000", 2024-04-26T12:28:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5805999999999999e-05 2024-04-26T12:28:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:38.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.699094+0000", 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4579999999999994e-05 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.699916+0000", 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000821998 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710827+0000", 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010911021 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710866+0000", 2024-04-26T12:28:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9208999999999997e-05 2024-04-26T12:28:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710900+0000", 2024-04-26T12:28:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3921999999999998e-05 2024-04-26T12:28:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4057 4.10 4:0a22fc52:::1000000135a.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:38.558 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.6308289719999998, 2024-04-26T12:28:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021108387999999999, 2024-04-26T12:28:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4057 2024-04-26T12:28:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845269+0000", 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845276+0000", 2024-04-26T12:28:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:28:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845286+0000", 2024-04-26T12:28:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0219e-05 2024-04-26T12:28:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845291+0000", 2024-04-26T12:28:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5840000000000002e-06 2024-04-26T12:28:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845325+0000", 2024-04-26T12:28:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3429000000000001e-05 2024-04-26T12:28:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845409+0000", 2024-04-26T12:28:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4529000000000003e-05 2024-04-26T12:28:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866264+0000", 2024-04-26T12:28:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020854731000000001 2024-04-26T12:28:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866305+0000", 2024-04-26T12:28:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0571000000000002e-05 2024-04-26T12:28:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866378+0000", 2024-04-26T12:28:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3447000000000003e-05 2024-04-26T12:28:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.566 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4064 4.3b 4:de2f294e:::10000001361.00000000:head [write 0~127] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.6249109289999999, 2024-04-26T12:28:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014714163000000001, 2024-04-26T12:28:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4064 2024-04-26T12:28:38.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851187+0000", 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851193+0000", 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5999999999999997e-06 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851204+0000", 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1172000000000001e-05 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851211+0000", 2024-04-26T12:28:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6750000000000002e-06 2024-04-26T12:28:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851254+0000", 2024-04-26T12:28:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2919e-05 2024-04-26T12:28:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851384+0000", 2024-04-26T12:28:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130013 2024-04-26T12:28:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865803+0000", 2024-04-26T12:28:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014418343 2024-04-26T12:28:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865857+0000", 2024-04-26T12:28:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4567000000000001e-05 2024-04-26T12:28:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865902+0000", 2024-04-26T12:28:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4576999999999997e-05 2024-04-26T12:28:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.571 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4065 4.3f 4:fea32a34:::10000001362.00000000:head [write 0~290] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.624083728, 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013949731, 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4065 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.572 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852014+0000", 2024-04-26T12:28:38.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852018+0000", 2024-04-26T12:28:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7890000000000001e-06 2024-04-26T12:28:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852025+0000", 2024-04-26T12:28:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8750000000000002e-06 2024-04-26T12:28:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852029+0000", 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0999999999999997e-06 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852083+0000", 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000001e-05 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852161+0000", 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7577000000000006e-05 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865845+0000", 2024-04-26T12:28:38.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013684405 2024-04-26T12:28:38.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865890+0000", 2024-04-26T12:28:38.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5209e-05 2024-04-26T12:28:38.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865965+0000", 2024-04-26T12:28:38.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4345999999999996e-05 2024-04-26T12:28:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4066 4.1d 4:b9ed4029:::10000001363.00000000:head [write 0~133] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.6232862720000001, 2024-04-26T12:28:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013115296, 2024-04-26T12:28:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:38.577 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:38.578 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4066 2024-04-26T12:28:38.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.578 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:38.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:38.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852816+0000", 2024-04-26T12:28:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:28:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852824+0000", 2024-04-26T12:28:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.994e-06 2024-04-26T12:28:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852831+0000", 2024-04-26T12:28:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0600000000000002e-06 2024-04-26T12:28:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852858+0000", 2024-04-26T12:28:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6605e-05 2024-04-26T12:28:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852932+0000", 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4052000000000002e-05 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853007+0000", 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5580000000000005e-05 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.857934+0000", 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049264030000000002 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865834+0000", 2024-04-26T12:28:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079004829999999998 2024-04-26T12:28:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865883+0000", 2024-04-26T12:28:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8723000000000001e-05 2024-04-26T12:28:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865928+0000", 2024-04-26T12:28:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4904999999999998e-05 2024-04-26T12:28:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.582 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4067 4.15 4:a8b5213c:::10000001364.00000000:head [write 0~261] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.6224604019999997, 2024-04-26T12:28:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012718304, 2024-04-26T12:28:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4067 2024-04-26T12:28:38.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:38.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853641+0000", 2024-04-26T12:28:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4620000000000001e-06 2024-04-26T12:28:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853649+0000", 2024-04-26T12:28:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6469999999999998e-06 2024-04-26T12:28:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853655+0000", 2024-04-26T12:28:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5699999999999998e-06 2024-04-26T12:28:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853681+0000", 2024-04-26T12:28:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6152999999999998e-05 2024-04-26T12:28:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853763+0000", 2024-04-26T12:28:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1656999999999994e-05 2024-04-26T12:28:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866245+0000", 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012482304 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866279+0000", 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3942999999999997e-05 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866357+0000", 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7151999999999996e-05 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.587 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.588 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:38.588 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:38.588 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:38.589 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:38.587+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:38.589 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:38.690 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:38.688+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:38.724 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4519.0:7661 4.5 4:a09b8470:::100000022e7.00000000:head [write 0~2685 in=2685b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:28:38.725 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:38.720663+0000", 2024-04-26T12:28:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0038023900000000001, 2024-04-26T12:28:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003821826, 2024-04-26T12:28:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4519", 2024-04-26T12:28:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 7661 2024-04-26T12:28:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:38.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.720663+0000", 2024-04-26T12:28:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.720663+0000", 2024-04-26T12:28:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.720663+0000", 2024-04-26T12:28:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.720668+0000", 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9799999999999998e-06 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.720676+0000", 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2490000000000001e-06 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.720683+0000", 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0929999999999997e-06 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.720713+0000", 2024-04-26T12:28:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.995e-05 2024-04-26T12:28:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.720794+0000", 2024-04-26T12:28:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0488000000000006e-05 2024-04-26T12:28:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.720869+0000", 2024-04-26T12:28:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5604000000000003e-05 2024-04-26T12:28:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.721990+0000", 2024-04-26T12:28:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0011211540000000001 2024-04-26T12:28:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4519.0:7662 4.22 e50/14 4:44ac1308:::100000022e8.00000000:head v 50'135, mlcod=50'133)", 2024-04-26T12:28:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:38.722043+0000", 2024-04-26T12:28:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0024223840000000001, 2024-04-26T12:28:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0024923390000000001, 2024-04-26T12:28:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:38.730 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722043+0000", 2024-04-26T12:28:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722043+0000", 2024-04-26T12:28:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:38.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722043+0000", 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722055+0000", 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2142e-05 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722063+0000", 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7360000000000001e-06 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722066+0000", 2024-04-26T12:28:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.743e-06 2024-04-26T12:28:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722096+0000", 2024-04-26T12:28:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9164000000000001e-05 2024-04-26T12:28:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722108+0000", 2024-04-26T12:28:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2213e-05 2024-04-26T12:28:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:38.733 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4519.0:7663 4.e 4:7398ade1:::100000022e9.00000000:head [write 0~5227 in=5227b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:28:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:38.722775+0000", 2024-04-26T12:28:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0016912909999999999, 2024-04-26T12:28:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001796452, 2024-04-26T12:28:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4519", 2024-04-26T12:28:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:38.734 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 7663 2024-04-26T12:28:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722775+0000", 2024-04-26T12:28:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722775+0000", 2024-04-26T12:28:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722774+0000", 2024-04-26T12:28:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722783+0000", 2024-04-26T12:28:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5699999999999999e-06 2024-04-26T12:28:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722794+0000", 2024-04-26T12:28:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1205e-05 2024-04-26T12:28:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722802+0000", 2024-04-26T12:28:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9820000000000008e-06 2024-04-26T12:28:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722840+0000", 2024-04-26T12:28:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7345000000000002e-05 2024-04-26T12:28:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722916+0000", 2024-04-26T12:28:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6720999999999999e-05 2024-04-26T12:28:38.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.722988+0000", 2024-04-26T12:28:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1631000000000006e-05 2024-04-26T12:28:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.723823+0000", 2024-04-26T12:28:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00083445600000000002 2024-04-26T12:28:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4519.0:7664 4.11 4:8a087bed:::100000022ea.00000000:head [write 0~2651 in=2651b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:28:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:38.723741+0000", 2024-04-26T12:28:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.00072460799999999996, 2024-04-26T12:28:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00087402699999999999, 2024-04-26T12:28:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4519", 2024-04-26T12:28:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 7664 2024-04-26T12:28:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.723741+0000", 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.723741+0000", 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.723740+0000", 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.723746+0000", 2024-04-26T12:28:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9209999999999997e-06 2024-04-26T12:28:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.723759+0000", 2024-04-26T12:28:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2194e-05 2024-04-26T12:28:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.723767+0000", 2024-04-26T12:28:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3669999999999997e-06 2024-04-26T12:28:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.723810+0000", 2024-04-26T12:28:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.286e-05 2024-04-26T12:28:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:38.723892+0000", 2024-04-26T12:28:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2276999999999998e-05 2024-04-26T12:28:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-04-26T12:28:38.742 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 4 2024-04-26T12:28:38.743 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:38.744 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:38.821 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:28:38.828 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:38.827+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:38.891 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:38.890+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:38.919 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:38.919 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:38.919 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:38.919 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:38.919 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:38.929 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:38.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~47s 2024-04-26T12:28:38.992 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:38.990+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:39.092 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:39.091+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:39.104 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:39.105 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:39.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:39.105 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:39.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.105 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.105 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:39.105 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.85308365900001, 2024-04-26T12:28:39.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:39.105 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.105 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.105 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:39.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:39.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:39.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:39.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:39.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:39.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:39.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:39.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:39.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:39.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:39.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:39.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:39.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:39.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:39.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:39.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:39.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.85304744699999, 2024-04-26T12:28:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:39.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:39.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.853008473, 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:39.117 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:39.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:39.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.85298530599999, 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:39.123 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:39.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:39.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:39.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:39.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:39.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:39.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:39.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:39.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:39.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:39.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:39.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:39.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.852969929, 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.130 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:39.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:39.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:39.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:39.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:39.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:39.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:39.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:39.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:39.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:39.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:39.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:39.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:39.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:39.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:39.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:39.135 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.135 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.135 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.135 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.135 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:39.135 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.852941739, 2024-04-26T12:28:39.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:39.135 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:39.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:39.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:39.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:39.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:39.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:39.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:39.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:39.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:39.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:39.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:39.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:39.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:39.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.852923741, 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.141 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:39.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:39.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:39.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:39.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:39.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:39.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:39.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:39.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:39.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:39.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:39.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:39.147 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.147 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.147 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.147 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.147 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:39.147 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.85289915, 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:39.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:39.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:39.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:39.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:39.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:39.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:39.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:39.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:39.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:39.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:39.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:39.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:39.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:39.153 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.153 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.153 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.153 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.153 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:39.153 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.85287420100001, 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:39.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:39.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:39.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:39.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:39.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:39.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:39.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:39.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:39.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:39.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:39.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.85285327699999, 2024-04-26T12:28:39.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:39.160 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.160 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.160 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:39.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:39.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:39.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:39.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:39.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:39.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:39.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:39.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:39.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:39.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:39.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:39.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:39.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:39.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:39.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:39.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:39.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:39.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.165 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.165 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.165 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:39.165 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.85281842800001, 2024-04-26T12:28:39.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:39.166 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.166 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.166 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:39.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:39.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:39.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:39.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:39.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:39.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:39.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:39.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:39.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:39.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.171 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.171 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.171 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:39.171 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.852784478, 2024-04-26T12:28:39.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:39.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:39.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:39.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:39.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:39.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:39.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:39.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:39.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:39.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:39.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:39.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:39.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:39.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:39.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:39.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:39.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:39.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:39.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:39.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.852764181, 2024-04-26T12:28:39.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:39.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:39.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:39.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:39.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:39.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:39.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:39.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:39.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:39.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:39.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:39.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:39.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:39.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.85272906, 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.183 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.184 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:39.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:39.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:39.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:39.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:39.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:39.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:39.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:39.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.85269382, 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.189 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:39.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:39.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:39.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:39.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:39.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:39.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:39.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:39.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:39.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:39.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:39.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:39.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:39.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:39.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:39.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.195 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.195 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.195 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:39.195 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.85255207199999, 2024-04-26T12:28:39.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:39.195 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.195 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.195 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:39.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:39.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:39.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:39.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:39.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:39.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:39.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:39.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:39.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:39.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:39.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:39.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:39.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:39.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:39.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:39.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:39.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:39.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:39.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.201 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.201 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.201 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:39.201 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.852528053, 2024-04-26T12:28:39.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:39.201 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.201 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.201 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:39.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:39.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:39.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:39.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:39.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:39.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:39.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:39.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:39.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:39.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:39.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:39.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:39.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:39.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:39.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.85250408500001, 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:39.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:39.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:39.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:39.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:39.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:39.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:39.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:39.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:39.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:39.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:39.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:39.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:39.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:39.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:39.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:39.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:39.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:39.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:39.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:39.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.852470704, 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:39.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:39.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:39.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:39.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:39.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:39.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:39.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:39.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:39.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:39.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.218 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4519.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:28:39.218 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:39.218 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.8242221149999995, 2024-04-26T12:28:39.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022614038, 2024-04-26T12:28:39.218 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.218 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.218 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:39.218 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4519", 2024-04-26T12:28:39.218 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:39.218 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 4 2024-04-26T12:28:39.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.218 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278320+0000", 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286502+0000", 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0081813960000000005 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286518+0000", 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6025e-05 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286526+0000", 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.4290000000000001e-06 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286596+0000", 2024-04-26T12:28:39.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9748999999999999e-05 2024-04-26T12:28:39.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286671+0000", 2024-04-26T12:28:39.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5097000000000003e-05 2024-04-26T12:28:39.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:39.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286790+0000", 2024-04-26T12:28:39.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011916799999999999 2024-04-26T12:28:39.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.294164+0000", 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073738320000000003 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300871+0000", 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067069499999999997 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300904+0000", 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2512999999999999e-05 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300936+0000", 2024-04-26T12:28:39.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2218000000000002e-05 2024-04-26T12:28:39.223 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.223 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.223 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.223 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.223 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.223 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:39.224 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:39.223+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:39.225 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:39.325 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:39.324+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:39.372 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:39.373 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:39.373 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:39.373 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:39.383 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:39.427 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:39.426+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:39.519 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:39.519 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:39.519 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:39.520 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:39.520 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:39.527 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:39.525+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:39.530 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:39.628 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:39.627+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:39.713 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:39.713 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:39.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:39.713 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:39.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.714 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.714 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:39.714 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 106.45980274199999, 2024-04-26T12:28:39.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:39.714 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.714 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.714 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:39.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:39.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:39.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:39.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:39.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:39.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:39.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:39.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:39.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:39.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.716 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.716 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:39.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:39.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:39.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:39.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:39.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:39.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:39.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:39.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:39.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:39.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:39.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:39.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:39.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:39.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:39.719 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.719 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.719 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.719 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.719 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:39.719 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 106.458981823, 2024-04-26T12:28:39.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:39.719 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:39.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:39.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:39.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:39.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:39.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:39.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:39.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:39.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:39.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:39.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:39.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:39.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:39.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:39.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:39.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:39.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:39.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:39.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.725 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.725 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:39.725 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 106.45895173300001, 2024-04-26T12:28:39.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:39.725 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.725 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.725 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:39.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:39.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:39.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:39.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:39.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:39.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:39.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:39.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:39.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:39.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:39.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:39.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:39.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:39.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:39.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:39.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:39.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:39.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:39.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:39.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:39.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:39.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:39.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:39.730 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.730 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.730 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.730 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.730 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:39.730 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 106.458897945, 2024-04-26T12:28:39.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:39.730 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.730 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.730 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:39.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:39.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:39.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:39.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:39.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:39.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:39.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:39.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:39.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:39.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:39.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:39.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:39.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:39.735 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.735 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.735 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.735 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.735 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:39.736 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 106.458845388, 2024-04-26T12:28:39.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:39.736 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.736 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.736 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:39.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:39.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:39.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:39.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:39.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:39.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:39.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:39.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:39.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:39.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:39.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:39.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:39.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:39.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:39.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:39.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:39.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:39.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:39.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:39.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:39.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:39.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:39.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:39.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:39.741 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.741 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.741 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.741 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.741 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:39.741 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 106.45880517400001, 2024-04-26T12:28:39.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:39.741 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.741 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.741 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:39.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:39.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:39.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:39.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:39.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:39.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:39.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:39.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:39.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:39.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:39.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.744 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.744 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:39.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:39.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:39.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:39.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:39.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:39.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:39.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:39.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:39.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 106.458777013, 2024-04-26T12:28:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:39.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:39.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:39.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:39.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:39.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:39.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:39.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:39.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:39.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:39.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:39.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:39.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:39.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:39.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:39.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:39.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:39.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 106.458746324, 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:39.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:39.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:39.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:39.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:39.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:39.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:39.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:39.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:39.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:39.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:39.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:39.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:39.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:39.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:39.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4519.0:4 4.32 e47/14 4:4def72d4:::10000000003.00000000:head v 47'2, mlcod=0'0)", 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.4237080550000005, 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013679491, 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:39.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:39.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286924+0000", 2024-04-26T12:28:39.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:39.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292324+0000", 2024-04-26T12:28:39.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054002099999999999 2024-04-26T12:28:39.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292346+0000", 2024-04-26T12:28:39.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1733e-05 2024-04-26T12:28:39.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292356+0000", 2024-04-26T12:28:39.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:28:39.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292409+0000", 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3359000000000002e-05 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292430+0000", 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0140999999999999e-05 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300546+0000", 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081164429999999992 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300604+0000", 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8270000000000003e-05 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:5 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.1795296559999997, 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015201111, 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.760 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 5 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531102+0000", 2024-04-26T12:28:39.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:39.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535869+0000", 2024-04-26T12:28:39.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047671199999999997 2024-04-26T12:28:39.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535886+0000", 2024-04-26T12:28:39.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6861e-05 2024-04-26T12:28:39.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535900+0000", 2024-04-26T12:28:39.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4457999999999999e-05 2024-04-26T12:28:39.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535985+0000", 2024-04-26T12:28:39.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4656999999999999e-05 2024-04-26T12:28:39.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.536103+0000", 2024-04-26T12:28:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118163 2024-04-26T12:28:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.536198+0000", 2024-04-26T12:28:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4840999999999995e-05 2024-04-26T12:28:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.539923+0000", 2024-04-26T12:28:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037246639999999999 2024-04-26T12:28:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546203+0000", 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062805420000000001 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546245+0000", 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1270999999999998e-05 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546304+0000", 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9769999999999999e-05 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.765 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:6 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.1747138009999993, 2024-04-26T12:28:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021621960999999999, 2024-04-26T12:28:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 6 2024-04-26T12:28:39.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535918+0000", 2024-04-26T12:28:39.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547051+0000", 2024-04-26T12:28:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011132853999999999 2024-04-26T12:28:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547063+0000", 2024-04-26T12:28:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2113000000000001e-05 2024-04-26T12:28:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547086+0000", 2024-04-26T12:28:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3538000000000001e-05 2024-04-26T12:28:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547144+0000", 2024-04-26T12:28:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7284000000000002e-05 2024-04-26T12:28:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547289+0000", 2024-04-26T12:28:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014546900000000001 2024-04-26T12:28:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557445+0000", 2024-04-26T12:28:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010155717 2024-04-26T12:28:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557492+0000", 2024-04-26T12:28:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6749999999999998e-05 2024-04-26T12:28:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557541+0000", 2024-04-26T12:28:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9440000000000001e-05 2024-04-26T12:28:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.770 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:65 3.1b 3:ddb4e4d7:::200.00000002:head [write 2912462~997814 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-26T12:28:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.2726840959999999, 2024-04-26T12:28:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014884231, 2024-04-26T12:28:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:39.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437948+0000", 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440692+0000", 2024-04-26T12:28:39.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027439579999999999 2024-04-26T12:28:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440720+0000", 2024-04-26T12:28:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8209999999999999e-05 2024-04-26T12:28:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440735+0000", 2024-04-26T12:28:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.554e-05 2024-04-26T12:28:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440839+0000", 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001038 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440895+0000", 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6221000000000003e-05 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440982+0000", 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6556000000000003e-05 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.443471+0000", 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024888250000000001 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452760+0000", 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092887869999999997 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452790+0000", 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0267e-05 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452833+0000", 2024-04-26T12:28:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3093999999999998e-05 2024-04-26T12:28:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:3891 4.14 4:2914052b:::100000012aa.00000000:head [write 0~1579] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.0126495359999996, 2024-04-26T12:28:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012921406, 2024-04-26T12:28:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.776 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 3891 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:39.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:39.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697988+0000", 2024-04-26T12:28:39.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.395e-06 2024-04-26T12:28:39.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697994+0000", 2024-04-26T12:28:39.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1539999999999999e-06 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697999+0000", 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4569999999999998e-06 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698025+0000", 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6384e-05 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698100+0000", 2024-04-26T12:28:39.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5340999999999996e-05 2024-04-26T12:28:39.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710785+0000", 2024-04-26T12:28:39.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012684755000000001 2024-04-26T12:28:39.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710834+0000", 2024-04-26T12:28:39.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8955000000000001e-05 2024-04-26T12:28:39.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710905+0000", 2024-04-26T12:28:39.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0754999999999996e-05 2024-04-26T12:28:39.781 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.781 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.781 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.781 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:3892 4.8 4:12bbb26b:::100000012ab.00000000:head [write 0~3199] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:39.781 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.698875+0000", 2024-04-26T12:28:39.781 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.011757952, 2024-04-26T12:28:39.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012025522, 2024-04-26T12:28:39.781 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.781 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.781 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:39.781 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:39.782 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:39.782 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 3892 2024-04-26T12:28:39.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.782 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698875+0000", 2024-04-26T12:28:39.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698875+0000", 2024-04-26T12:28:39.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698874+0000", 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698880+0000", 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4450000000000004e-06 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698889+0000", 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:28:39.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698894+0000", 2024-04-26T12:28:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0379999999999999e-06 2024-04-26T12:28:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698944+0000", 2024-04-26T12:28:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0324999999999997e-05 2024-04-26T12:28:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.699020+0000", 2024-04-26T12:28:39.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5805999999999999e-05 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.699094+0000", 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4579999999999994e-05 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.699916+0000", 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000821998 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710827+0000", 2024-04-26T12:28:39.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010911021 2024-04-26T12:28:39.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710866+0000", 2024-04-26T12:28:39.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9208999999999997e-05 2024-04-26T12:28:39.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710900+0000", 2024-04-26T12:28:39.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3921999999999998e-05 2024-04-26T12:28:39.786 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.786 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.786 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.787 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4057 4.10 4:0a22fc52:::1000000135a.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:39.787 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:39.787 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.8653631810000002, 2024-04-26T12:28:39.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021108387999999999, 2024-04-26T12:28:39.787 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.787 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.787 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:39.787 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:39.787 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:39.787 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4057 2024-04-26T12:28:39.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.787 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845269+0000", 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845276+0000", 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845286+0000", 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0219e-05 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845291+0000", 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5840000000000002e-06 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845325+0000", 2024-04-26T12:28:39.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3429000000000001e-05 2024-04-26T12:28:39.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845409+0000", 2024-04-26T12:28:39.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4529000000000003e-05 2024-04-26T12:28:39.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866264+0000", 2024-04-26T12:28:39.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020854731000000001 2024-04-26T12:28:39.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866305+0000", 2024-04-26T12:28:39.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0571000000000002e-05 2024-04-26T12:28:39.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866378+0000", 2024-04-26T12:28:39.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3447000000000003e-05 2024-04-26T12:28:39.791 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.791 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.791 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4064 4.3b 4:de2f294e:::10000001361.00000000:head [write 0~127] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.8594451379999999, 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014714163000000001, 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4064 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:39.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:39.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851187+0000", 2024-04-26T12:28:39.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851193+0000", 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5999999999999997e-06 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851204+0000", 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1172000000000001e-05 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851211+0000", 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6750000000000002e-06 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851254+0000", 2024-04-26T12:28:39.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2919e-05 2024-04-26T12:28:39.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851384+0000", 2024-04-26T12:28:39.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130013 2024-04-26T12:28:39.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865803+0000", 2024-04-26T12:28:39.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014418343 2024-04-26T12:28:39.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865857+0000", 2024-04-26T12:28:39.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4567000000000001e-05 2024-04-26T12:28:39.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865902+0000", 2024-04-26T12:28:39.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4576999999999997e-05 2024-04-26T12:28:39.796 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.796 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.796 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.796 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4065 4.3f 4:fea32a34:::10000001362.00000000:head [write 0~290] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.858617937, 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013949731, 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4065 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:39.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:39.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852014+0000", 2024-04-26T12:28:39.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852018+0000", 2024-04-26T12:28:39.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7890000000000001e-06 2024-04-26T12:28:39.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852025+0000", 2024-04-26T12:28:39.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8750000000000002e-06 2024-04-26T12:28:39.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852029+0000", 2024-04-26T12:28:39.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0999999999999997e-06 2024-04-26T12:28:39.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852083+0000", 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000001e-05 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852161+0000", 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7577000000000006e-05 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865845+0000", 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013684405 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865890+0000", 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5209e-05 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865965+0000", 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4345999999999996e-05 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4066 4.1d 4:b9ed4029:::10000001363.00000000:head [write 0~133] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:39.801 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.8578204810000001, 2024-04-26T12:28:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013115296, 2024-04-26T12:28:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4066 2024-04-26T12:28:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:39.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:39.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:39.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852816+0000", 2024-04-26T12:28:39.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852824+0000", 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.994e-06 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852831+0000", 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0600000000000002e-06 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852858+0000", 2024-04-26T12:28:39.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6605e-05 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852932+0000", 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4052000000000002e-05 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853007+0000", 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5580000000000005e-05 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.857934+0000", 2024-04-26T12:28:39.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049264030000000002 2024-04-26T12:28:39.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865834+0000", 2024-04-26T12:28:39.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079004829999999998 2024-04-26T12:28:39.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865883+0000", 2024-04-26T12:28:39.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8723000000000001e-05 2024-04-26T12:28:39.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865928+0000", 2024-04-26T12:28:39.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4904999999999998e-05 2024-04-26T12:28:39.807 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.807 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.807 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.807 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4067 4.15 4:a8b5213c:::10000001364.00000000:head [write 0~261] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:39.807 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:39.807 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.8569946110000002, 2024-04-26T12:28:39.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012718304, 2024-04-26T12:28:39.807 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.807 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.807 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:39.807 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4067 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:39.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:39.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853641+0000", 2024-04-26T12:28:39.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4620000000000001e-06 2024-04-26T12:28:39.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853649+0000", 2024-04-26T12:28:39.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6469999999999998e-06 2024-04-26T12:28:39.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853655+0000", 2024-04-26T12:28:39.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5699999999999998e-06 2024-04-26T12:28:39.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853681+0000", 2024-04-26T12:28:39.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6152999999999998e-05 2024-04-26T12:28:39.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853763+0000", 2024-04-26T12:28:39.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1656999999999994e-05 2024-04-26T12:28:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866245+0000", 2024-04-26T12:28:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012482304 2024-04-26T12:28:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866279+0000", 2024-04-26T12:28:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3942999999999997e-05 2024-04-26T12:28:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866357+0000", 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7151999999999996e-05 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:7338 4.12 4:48cb1742:::10000002181.00000000:head [write 0~1379] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:38.366916+0000", 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.3437164959999999, 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012028815999999999, 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:39.812 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 7338 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:38.366916+0000", 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:38.366916+0000", 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:38.366915+0000", 2024-04-26T12:28:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:38.366922+0000", 2024-04-26T12:28:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3990000000000001e-06 2024-04-26T12:28:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:38.366936+0000", 2024-04-26T12:28:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4064e-05 2024-04-26T12:28:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:38.366944+0000", 2024-04-26T12:28:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1249999999999993e-06 2024-04-26T12:28:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:38.366977+0000", 2024-04-26T12:28:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3012999999999997e-05 2024-04-26T12:28:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:38.367071+0000", 2024-04-26T12:28:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3757000000000004e-05 2024-04-26T12:28:39.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:38.378824+0000", 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011753398 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:38.378873+0000", 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9081e-05 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:38.378945+0000", 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1879999999999996e-05 2024-04-26T12:28:39.816 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.817 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.817 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.817 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:39.817 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:39.817 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:39.818 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2024-04-26T12:28:39.818 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:39.817+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:39.819 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:39.919 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:39.918+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:39.955 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4519.0:8700 4.2c 4:35767bd5:::100000027c4.00000000:head [write 0~6684 in=6684b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:28:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:39.954676+0000", 2024-04-26T12:28:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.00083879500000000004, 2024-04-26T12:28:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00085534999999999995, 2024-04-26T12:28:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4519", 2024-04-26T12:28:39.956 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 8700 2024-04-26T12:28:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:39.954676+0000", 2024-04-26T12:28:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:39.954676+0000", 2024-04-26T12:28:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:39.954675+0000", 2024-04-26T12:28:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:39.954683+0000", 2024-04-26T12:28:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1519999999999992e-06 2024-04-26T12:28:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:39.954694+0000", 2024-04-26T12:28:39.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012000000000001e-05 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:39.954700+0000", 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0410000000000003e-06 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:39.954727+0000", 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.65e-05 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:39.954800+0000", 2024-04-26T12:28:39.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2917000000000007e-05 2024-04-26T12:28:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:39.955445+0000", 2024-04-26T12:28:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00064487799999999999 2024-04-26T12:28:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:39.955477+0000", 2024-04-26T12:28:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2021999999999999e-05 2024-04-26T12:28:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:39.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:39.955531+0000", 2024-04-26T12:28:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4614000000000003e-05 2024-04-26T12:28:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-04-26T12:28:39.961 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 1 2024-04-26T12:28:39.961 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:39.966 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:40.021 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:40.019+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:40.101 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:40.101 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:40.102 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:40.102 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:40.102 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:40.112 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:40.121 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:40.120+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:40.222 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:40.220+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:40.248 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.99603162299999, 2024-04-26T12:28:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020105033000000001, 2024-04-26T12:28:40.248 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249460+0000", 2024-04-26T12:28:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249459+0000", 2024-04-26T12:28:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249465+0000", 2024-04-26T12:28:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6660000000000002e-06 2024-04-26T12:28:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249475+0000", 2024-04-26T12:28:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7690000000000008e-06 2024-04-26T12:28:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249486+0000", 2024-04-26T12:28:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.11e-05 2024-04-26T12:28:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249546+0000", 2024-04-26T12:28:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9713999999999998e-05 2024-04-26T12:28:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249551+0000", 2024-04-26T12:28:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8509999999999998e-06 2024-04-26T12:28:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264828+0000", 2024-04-26T12:28:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015276758 2024-04-26T12:28:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265356+0000", 2024-04-26T12:28:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00052840799999999996 2024-04-26T12:28:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265508+0000", 2024-04-26T12:28:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000151674 2024-04-26T12:28:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268685+0000", 2024-04-26T12:28:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031775670000000001 2024-04-26T12:28:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269489+0000", 2024-04-26T12:28:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00080400700000000003 2024-04-26T12:28:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269529+0000", 2024-04-26T12:28:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9271999999999999e-05 2024-04-26T12:28:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269565+0000", 2024-04-26T12:28:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6675999999999999e-05 2024-04-26T12:28:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.255 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.995995411, 2024-04-26T12:28:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425193000000001, 2024-04-26T12:28:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249496+0000", 2024-04-26T12:28:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249499+0000", 2024-04-26T12:28:40.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.463e-06 2024-04-26T12:28:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249505+0000", 2024-04-26T12:28:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7920000000000004e-06 2024-04-26T12:28:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249518+0000", 2024-04-26T12:28:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2395000000000001e-05 2024-04-26T12:28:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249630+0000", 2024-04-26T12:28:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112341 2024-04-26T12:28:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249636+0000", 2024-04-26T12:28:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2090000000000002e-06 2024-04-26T12:28:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265925+0000", 2024-04-26T12:28:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016289138000000002 2024-04-26T12:28:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266012+0000", 2024-04-26T12:28:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6675000000000006e-05 2024-04-26T12:28:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266143+0000", 2024-04-26T12:28:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013114800000000001 2024-04-26T12:28:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268703+0000", 2024-04-26T12:28:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0025594749999999999 2024-04-26T12:28:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269857+0000", 2024-04-26T12:28:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115441 2024-04-26T12:28:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269900+0000", 2024-04-26T12:28:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2833000000000001e-05 2024-04-26T12:28:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269922+0000", 2024-04-26T12:28:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1654999999999998e-05 2024-04-26T12:28:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.262 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.995956437, 2024-04-26T12:28:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020495497000000001, 2024-04-26T12:28:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249535+0000", 2024-04-26T12:28:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249543+0000", 2024-04-26T12:28:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6590000000000007e-06 2024-04-26T12:28:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249548+0000", 2024-04-26T12:28:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1120000000000004e-06 2024-04-26T12:28:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249552+0000", 2024-04-26T12:28:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:28:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118523 2024-04-26T12:28:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249673+0000", 2024-04-26T12:28:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1089999999999998e-06 2024-04-26T12:28:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266703+0000", 2024-04-26T12:28:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017029355999999999 2024-04-26T12:28:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:40.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000127076 2024-04-26T12:28:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266979+0000", 2024-04-26T12:28:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000149555 2024-04-26T12:28:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269929+0000", 2024-04-26T12:28:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029497030000000001 2024-04-26T12:28:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269969+0000", 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0445000000000003e-05 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269997+0000", 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7480000000000001e-05 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270031+0000", 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3917000000000001e-05 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.99593326999999, 2024-04-26T12:28:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020563031999999998, 2024-04-26T12:28:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249559+0000", 2024-04-26T12:28:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249558+0000", 2024-04-26T12:28:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249562+0000", 2024-04-26T12:28:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.489e-06 2024-04-26T12:28:40.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249566+0000", 2024-04-26T12:28:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249569+0000", 2024-04-26T12:28:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1999999999999999e-06 2024-04-26T12:28:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249708+0000", 2024-04-26T12:28:40.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013932500000000001 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249713+0000", 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7230000000000004e-06 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267321+0000", 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017608283999999998 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267413+0000", 2024-04-26T12:28:40.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2022999999999996e-05 2024-04-26T12:28:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267843+0000", 2024-04-26T12:28:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043022500000000001 2024-04-26T12:28:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269933+0000", 2024-04-26T12:28:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020890570000000001 2024-04-26T12:28:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270066+0000", 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000133566 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270090+0000", 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4360000000000001e-05 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270122+0000", 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1139000000000001e-05 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.995917893, 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020644332000000001, 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249574+0000", 2024-04-26T12:28:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249576+0000", 2024-04-26T12:28:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8430000000000001e-06 2024-04-26T12:28:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249584+0000", 2024-04-26T12:28:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1879999999999996e-06 2024-04-26T12:28:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249589+0000", 2024-04-26T12:28:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0780000000000003e-06 2024-04-26T12:28:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249769+0000", 2024-04-26T12:28:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018070799999999999 2024-04-26T12:28:40.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8289999999999996e-06 2024-04-26T12:28:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268169+0000", 2024-04-26T12:28:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018394010999999998 2024-04-26T12:28:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268300+0000", 2024-04-26T12:28:40.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013062999999999999 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268425+0000", 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012486299999999999 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269936+0000", 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0015113749999999999 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270159+0000", 2024-04-26T12:28:40.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022323500000000001 2024-04-26T12:28:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270185+0000", 2024-04-26T12:28:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6129e-05 2024-04-26T12:28:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270218+0000", 2024-04-26T12:28:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2811999999999997e-05 2024-04-26T12:28:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.995889703, 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020725563999999998, 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249602+0000", 2024-04-26T12:28:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249608+0000", 2024-04-26T12:28:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-26T12:28:40.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249612+0000", 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0799999999999999e-06 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249615+0000", 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00020130899999999999 2024-04-26T12:28:40.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249821+0000", 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.42e-06 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268721+0000", 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018900380000000001 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268781+0000", 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9259000000000003e-05 2024-04-26T12:28:40.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268902+0000", 2024-04-26T12:28:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121545 2024-04-26T12:28:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270134+0000", 2024-04-26T12:28:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012318909999999999 2024-04-26T12:28:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270256+0000", 2024-04-26T12:28:40.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000121771 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270295+0000", 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8962999999999999e-05 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270328+0000", 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2885000000000001e-05 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.995871705, 2024-04-26T12:28:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020800038999999999, 2024-04-26T12:28:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249620+0000", 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249623+0000", 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2679999999999999e-06 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249631+0000", 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8320000000000006e-06 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249640+0000", 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8210000000000008e-06 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249891+0000", 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00025161699999999999 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:40.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249896+0000", 2024-04-26T12:28:40.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4009999999999999e-06 2024-04-26T12:28:40.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269115+0000", 2024-04-26T12:28:40.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019219346000000002 2024-04-26T12:28:40.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269194+0000", 2024-04-26T12:28:40.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8967999999999993e-05 2024-04-26T12:28:40.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269300+0000", 2024-04-26T12:28:40.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000105944 2024-04-26T12:28:40.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270337+0000", 2024-04-26T12:28:40.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0010374609999999999 2024-04-26T12:28:40.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270359+0000", 2024-04-26T12:28:40.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1661000000000001e-05 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270384+0000", 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5389e-05 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270420+0000", 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5719999999999997e-05 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.293 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.293 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:40.293 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.995847114, 2024-04-26T12:28:40.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020876420999999999, 2024-04-26T12:28:40.293 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.293 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.293 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:40.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249645+0000", 2024-04-26T12:28:40.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249644+0000", 2024-04-26T12:28:40.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249647+0000", 2024-04-26T12:28:40.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2219999999999998e-06 2024-04-26T12:28:40.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249654+0000", 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0950000000000001e-06 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249659+0000", 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249924+0000", 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00026532999999999998 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:40.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249928+0000", 2024-04-26T12:28:40.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1130000000000003e-06 2024-04-26T12:28:40.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269587+0000", 2024-04-26T12:28:40.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019658925000000001 2024-04-26T12:28:40.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269636+0000", 2024-04-26T12:28:40.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8618000000000001e-05 2024-04-26T12:28:40.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269708+0000", 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2893999999999997e-05 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270435+0000", 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00072620300000000003 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270476+0000", 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1631000000000002e-05 2024-04-26T12:28:40.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270503+0000", 2024-04-26T12:28:40.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6531000000000001e-05 2024-04-26T12:28:40.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.270521+0000", 2024-04-26T12:28:40.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.8270999999999998e-05 2024-04-26T12:28:40.298 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.298 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.298 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:17 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.99582216500001, 2024-04-26T12:28:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018784164999999999, 2024-04-26T12:28:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249670+0000", 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249669+0000", 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249672+0000", 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.588e-06 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249677+0000", 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4979999999999997e-06 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249681+0000", 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4369999999999999e-06 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249724+0000", 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3180000000000003e-05 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:40.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249738+0000", 2024-04-26T12:28:40.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3533000000000001e-05 2024-04-26T12:28:40.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263399+0000", 2024-04-26T12:28:40.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013661055 2024-04-26T12:28:40.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.263552+0000", 2024-04-26T12:28:40.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015341700000000001 2024-04-26T12:28:40.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264376+0000", 2024-04-26T12:28:40.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00082363300000000005 2024-04-26T12:28:40.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268160+0000", 2024-04-26T12:28:40.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003784464 2024-04-26T12:28:40.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268375+0000", 2024-04-26T12:28:40.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021474999999999999 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268417+0000", 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2429000000000003e-05 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268454+0000", 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6476000000000001e-05 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.305 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.305 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:40.305 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.995801241, 2024-04-26T12:28:40.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015105393, 2024-04-26T12:28:40.305 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.305 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.305 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:40.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249691+0000", 2024-04-26T12:28:40.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249690+0000", 2024-04-26T12:28:40.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249694+0000", 2024-04-26T12:28:40.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6820000000000001e-06 2024-04-26T12:28:40.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249701+0000", 2024-04-26T12:28:40.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:28:40.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249709+0000", 2024-04-26T12:28:40.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0120000000000005e-06 2024-04-26T12:28:40.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249745+0000", 2024-04-26T12:28:40.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6600999999999997e-05 2024-04-26T12:28:40.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249752+0000", 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.258216+0000", 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0084642529999999997 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259167+0000", 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00095029399999999997 2024-04-26T12:28:40.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:40.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259604+0000", 2024-04-26T12:28:40.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043725200000000001 2024-04-26T12:28:40.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264687+0000", 2024-04-26T12:28:40.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.005082675 2024-04-26T12:28:40.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264695+0000", 2024-04-26T12:28:40.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.799e-06 2024-04-26T12:28:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264754+0000", 2024-04-26T12:28:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8938999999999999e-05 2024-04-26T12:28:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264796+0000", 2024-04-26T12:28:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1644999999999999e-05 2024-04-26T12:28:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.99576639199999, 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019092184000000002, 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249725+0000", 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249734+0000", 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8899999999999996e-06 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249748+0000", 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4645e-05 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249753+0000", 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0269999999999997e-06 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249772+0000", 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9448000000000001e-05 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249776+0000", 2024-04-26T12:28:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2889999999999999e-06 2024-04-26T12:28:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264682+0000", 2024-04-26T12:28:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014906147999999999 2024-04-26T12:28:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264760+0000", 2024-04-26T12:28:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7527999999999994e-05 2024-04-26T12:28:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264876+0000", 2024-04-26T12:28:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000116428 2024-04-26T12:28:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268360+0000", 2024-04-26T12:28:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0034834279999999998 2024-04-26T12:28:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268733+0000", 2024-04-26T12:28:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00037301499999999998 2024-04-26T12:28:40.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268782+0000", 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9203000000000003e-05 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268818+0000", 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5620000000000001e-05 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.316 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:28 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.995732442, 2024-04-26T12:28:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018489504, 2024-04-26T12:28:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249759+0000", 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249762+0000", 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5470000000000001e-06 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249770+0000", 2024-04-26T12:28:40.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.34e-06 2024-04-26T12:28:40.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249775+0000", 2024-04-26T12:28:40.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5940000000000001e-06 2024-04-26T12:28:40.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249817+0000", 2024-04-26T12:28:40.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2082000000000001e-05 2024-04-26T12:28:40.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249822+0000", 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5589999999999999e-06 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260617+0000", 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010794585000000001 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260726+0000", 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109035 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260871+0000", 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014530500000000001 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264836+0000", 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039649519999999999 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268158+0000", 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033226409999999999 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268212+0000", 2024-04-26T12:28:40.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3440999999999999e-05 2024-04-26T12:28:40.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268249+0000", 2024-04-26T12:28:40.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6968999999999998e-05 2024-04-26T12:28:40.322 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.322 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.322 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.322 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.322 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:40.323 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.995712145, 2024-04-26T12:28:40.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018215019999999998, 2024-04-26T12:28:40.323 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.323 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.323 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:40.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249780+0000", 2024-04-26T12:28:40.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249779+0000", 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249789+0000", 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8840000000000006e-06 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249795+0000", 2024-04-26T12:28:40.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3280000000000002e-06 2024-04-26T12:28:40.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249801+0000", 2024-04-26T12:28:40.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3009999999999997e-06 2024-04-26T12:28:40.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249846+0000", 2024-04-26T12:28:40.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5358000000000002e-05 2024-04-26T12:28:40.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:40.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249852+0000", 2024-04-26T12:28:40.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1670000000000004e-06 2024-04-26T12:28:40.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.261887+0000", 2024-04-26T12:28:40.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012034716000000001 2024-04-26T12:28:40.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262024+0000", 2024-04-26T12:28:40.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000136594 2024-04-26T12:28:40.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.262355+0000", 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000331174 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267410+0000", 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050550669999999999 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267851+0000", 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00044076599999999999 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267952+0000", 2024-04-26T12:28:40.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000101593 2024-04-26T12:28:40.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267995+0000", 2024-04-26T12:28:40.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2463999999999999e-05 2024-04-26T12:28:40.328 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.328 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.328 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.328 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.328 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.995677024, 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019156192999999998, 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249815+0000", 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249814+0000", 2024-04-26T12:28:40.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249819+0000", 2024-04-26T12:28:40.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5050000000000001e-06 2024-04-26T12:28:40.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249833+0000", 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4501000000000001e-05 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249840+0000", 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0339999999999999e-06 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249881+0000", 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0930999999999998e-05 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:40.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249884+0000", 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5979999999999999e-06 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265618+0000", 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015734623999999999 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.265916+0000", 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00029750799999999998 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266044+0000", 2024-04-26T12:28:40.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000128338 2024-04-26T12:28:40.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268491+0000", 2024-04-26T12:28:40.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002446681 2024-04-26T12:28:40.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268898+0000", 2024-04-26T12:28:40.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040724700000000001 2024-04-26T12:28:40.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268938+0000", 2024-04-26T12:28:40.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9748e-05 2024-04-26T12:28:40.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268971+0000", 2024-04-26T12:28:40.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3058000000000001e-05 2024-04-26T12:28:40.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.334 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.334 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.334 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:40.335 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.995641784, 2024-04-26T12:28:40.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01847615, 2024-04-26T12:28:40.335 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.335 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.335 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:40.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249850+0000", 2024-04-26T12:28:40.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249849+0000", 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249853+0000", 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1309999999999999e-06 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249861+0000", 2024-04-26T12:28:40.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3810000000000001e-06 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249866+0000", 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6450000000000002e-06 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250052+0000", 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00018566700000000001 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250058+0000", 2024-04-26T12:28:40.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0039999999999996e-06 2024-04-26T12:28:40.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260445+0000", 2024-04-26T12:28:40.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.010386871000000001 2024-04-26T12:28:40.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260636+0000", 2024-04-26T12:28:40.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000190588 2024-04-26T12:28:40.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260923+0000", 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00028790199999999998 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266117+0000", 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051930650000000002 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268221+0000", 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0021046820000000001 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268290+0000", 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8909e-05 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268326+0000", 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6071000000000001e-05 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:40.340 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.995500036, 2024-04-26T12:28:40.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019583867000000001, 2024-04-26T12:28:40.341 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.341 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.341 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:40.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249992+0000", 2024-04-26T12:28:40.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249991+0000", 2024-04-26T12:28:40.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.249999+0000", 2024-04-26T12:28:40.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5159999999999997e-06 2024-04-26T12:28:40.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250004+0000", 2024-04-26T12:28:40.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4439999999999999e-06 2024-04-26T12:28:40.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250008+0000", 2024-04-26T12:28:40.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9519999999999996e-06 2024-04-26T12:28:40.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250041+0000", 2024-04-26T12:28:40.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2197999999999999e-05 2024-04-26T12:28:40.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:40.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250044+0000", 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6890000000000002e-06 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266693+0000", 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016649029999999999 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266830+0000", 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013679999999999999 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266978+0000", 2024-04-26T12:28:40.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014772299999999999 2024-04-26T12:28:40.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269226+0000", 2024-04-26T12:28:40.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00224792 2024-04-26T12:28:40.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269503+0000", 2024-04-26T12:28:40.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00027740600000000001 2024-04-26T12:28:40.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269533+0000", 2024-04-26T12:28:40.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9848e-05 2024-04-26T12:28:40.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269576+0000", 2024-04-26T12:28:40.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2682999999999998e-05 2024-04-26T12:28:40.346 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.346 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.346 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.346 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:22 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.346 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.995476017, 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018340707000000001, 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250016+0000", 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250015+0000", 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250019+0000", 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.202e-06 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250025+0000", 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1229999999999997e-06 2024-04-26T12:28:40.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250030+0000", 2024-04-26T12:28:40.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0459999999999996e-06 2024-04-26T12:28:40.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:40.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3523999999999999e-05 2024-04-26T12:28:40.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:40.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250078+0000", 2024-04-26T12:28:40.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3599999999999998e-06 2024-04-26T12:28:40.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264028+0000", 2024-04-26T12:28:40.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013950137 2024-04-26T12:28:40.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264154+0000", 2024-04-26T12:28:40.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125995 2024-04-26T12:28:40.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 1", 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.264311+0000", 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00015746999999999999 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267830+0000", 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035192159999999999 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268166+0000", 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00033572400000000003 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268299+0000", 2024-04-26T12:28:40.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013290700000000001 2024-04-26T12:28:40.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268357+0000", 2024-04-26T12:28:40.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7408000000000003e-05 2024-04-26T12:28:40.352 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.352 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.352 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.352 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:25 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.352 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.99545204899999, 2024-04-26T12:28:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.018393103000000001, 2024-04-26T12:28:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250040+0000", 2024-04-26T12:28:40.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250039+0000", 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250054+0000", 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5291e-05 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250060+0000", 2024-04-26T12:28:40.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4020000000000001e-06 2024-04-26T12:28:40.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250065+0000", 2024-04-26T12:28:40.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8069999999999999e-06 2024-04-26T12:28:40.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250100+0000", 2024-04-26T12:28:40.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4858999999999999e-05 2024-04-26T12:28:40.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op must wait for map", 2024-04-26T12:28:40.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250104+0000", 2024-04-26T12:28:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7890000000000002e-06 2024-04-26T12:28:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259570+0000", 2024-04-26T12:28:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0094660520000000008 2024-04-26T12:28:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.259781+0000", 2024-04-26T12:28:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00021089700000000001 2024-04-26T12:28:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.260551+0000", 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00077014599999999998 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.266108+0000", 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055569729999999998 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268338+0000", 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0022297860000000001 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268389+0000", 2024-04-26T12:28:40.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0345e-05 2024-04-26T12:28:40.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.268433+0000", 2024-04-26T12:28:40.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4369000000000002e-05 2024-04-26T12:28:40.358 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.358 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.358 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.358 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:30 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:40.358 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 106.995418668, 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.019837476, 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250073+0000", 2024-04-26T12:28:40.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250075+0000", 2024-04-26T12:28:40.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9439999999999999e-06 2024-04-26T12:28:40.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250079+0000", 2024-04-26T12:28:40.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4229999999999998e-06 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250082+0000", 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9969999999999999e-06 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250115+0000", 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3147e-05 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting_for_map not empty", 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.250119+0000", 2024-04-26T12:28:40.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2819999999999998e-06 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267436+0000", 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017316445999999999 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.267871+0000", 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00043469899999999998 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:26:53.269911+0000", 2024-04-26T12:28:40.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0020400409999999998 2024-04-26T12:28:40.363 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.363 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.363 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.363 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4519.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T12:28:40.363 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:40.363 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9671700790000006, 2024-04-26T12:28:40.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.022614038, 2024-04-26T12:28:40.363 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:40.363 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:40.363 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:40.363 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4519", 2024-04-26T12:28:40.363 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:40.364 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 4 2024-04-26T12:28:40.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.364 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:40.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:40.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:40.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:40.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278322+0000", 2024-04-26T12:28:40.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:40.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:40.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.278320+0000", 2024-04-26T12:28:40.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:40.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:40.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286502+0000", 2024-04-26T12:28:40.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0081813960000000005 2024-04-26T12:28:40.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:40.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286518+0000", 2024-04-26T12:28:40.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6025e-05 2024-04-26T12:28:40.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286526+0000", 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.4290000000000001e-06 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286596+0000", 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9748999999999999e-05 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286671+0000", 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5097000000000003e-05 2024-04-26T12:28:40.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-26T12:28:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.286790+0000", 2024-04-26T12:28:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011916799999999999 2024-04-26T12:28:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.294164+0000", 2024-04-26T12:28:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0073738320000000003 2024-04-26T12:28:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300871+0000", 2024-04-26T12:28:40.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067069499999999997 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300904+0000", 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2512999999999999e-05 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:30.300936+0000", 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2218000000000002e-05 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:40.368 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:40.369 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:40.369 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:28:40.371 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:40.371 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:40.368+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:40.471 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:40.470+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:40.509 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:40.509 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:40.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.509 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:9164 4.3 4:c163403c:::10000002a09.00000000:head [write 0~4001 in=4001b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:28:40.509 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:40.505916+0000", 2024-04-26T12:28:40.509 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.00301484, 2024-04-26T12:28:40.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030329889999999998, 2024-04-26T12:28:40.510 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:40.510 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:40.510 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:40.510 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:40.510 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:40.510 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 9164 2024-04-26T12:28:40.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.510 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:40.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:40.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.505916+0000", 2024-04-26T12:28:40.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:40.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.505916+0000", 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.505915+0000", 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.505922+0000", 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5690000000000001e-06 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:40.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.505931+0000", 2024-04-26T12:28:40.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9740000000000008e-06 2024-04-26T12:28:40.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.505935+0000", 2024-04-26T12:28:40.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6990000000000002e-06 2024-04-26T12:28:40.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:40.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.505966+0000", 2024-04-26T12:28:40.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0561000000000001e-05 2024-04-26T12:28:40.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:40.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.506053+0000", 2024-04-26T12:28:40.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7663000000000004e-05 2024-04-26T12:28:40.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:40.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.506140+0000", 2024-04-26T12:28:40.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6243999999999996e-05 2024-04-26T12:28:40.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:40.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.506858+0000", 2024-04-26T12:28:40.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00071841899999999998 2024-04-26T12:28:40.514 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:40.514 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:40.514 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:40.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.514 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:9165 4.18 4:1a32333f:::10000002a0a.00000000:head [write 0~4249 in=4249b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T12:28:40.514 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:40.507065+0000", 2024-04-26T12:28:40.514 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.001865661, 2024-04-26T12:28:40.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0019338949999999999, 2024-04-26T12:28:40.515 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:40.515 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:40.515 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:40.515 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:40.515 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:40.515 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 9165 2024-04-26T12:28:40.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.515 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:40.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:40.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.507065+0000", 2024-04-26T12:28:40.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:40.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:40.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.507065+0000", 2024-04-26T12:28:40.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:40.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:40.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.507064+0000", 2024-04-26T12:28:40.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:40.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:40.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.507069+0000", 2024-04-26T12:28:40.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.933e-06 2024-04-26T12:28:40.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:40.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.507076+0000", 2024-04-26T12:28:40.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6460000000000004e-06 2024-04-26T12:28:40.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:40.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.507080+0000", 2024-04-26T12:28:40.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0899999999999998e-06 2024-04-26T12:28:40.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:40.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.507107+0000", 2024-04-26T12:28:40.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7472000000000001e-05 2024-04-26T12:28:40.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:40.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.507187+0000", 2024-04-26T12:28:40.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9918000000000003e-05 2024-04-26T12:28:40.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:40.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.507268+0000", 2024-04-26T12:28:40.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1007000000000006e-05 2024-04-26T12:28:40.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:40.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:40.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:40.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.507851+0000", 2024-04-26T12:28:40.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058224600000000002 2024-04-26T12:28:40.519 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:40.519 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:40.519 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:40.519 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:40.519 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-26T12:28:40.519 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 2 2024-04-26T12:28:40.519 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:40.520 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:40.532 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:40.557 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:40.557 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:40.557 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:40.557 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:40.560 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:40.560 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:40.572 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:40.571+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:40.673 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:40.673 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:40.673 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:40.671+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:40.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:40.774 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:40.773+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:40.870 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:40.870 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:40.875 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:40.874+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:40.882 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:40.963 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T12:28:40.977 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:40.975+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:41.022 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:41.022 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:41.033 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:41.077 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-26T12:28:41.078 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:41.077+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:41.168 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:41.168 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:41.177 INFO:teuthology.orchestra.console.smithi136:Power on completed 2024-04-26T12:28:41.179 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:41.180 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:41.177+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:41.278 DEBUG:teuthology.orchestra.console.smithi136:Waiting for login prompt 2024-04-26T12:28:41.278 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi136 2024-04-26T12:28:41.290 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:41.289+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:41.314 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:41.315 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:41.326 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:41.391 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:41.390+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:41.470 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:41.470 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:41.481 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:41.492 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:41.491+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:41.593 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:41.592+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:41.667 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:41.667 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:41.679 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:41.694 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:41.693+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:41.795 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:41.794+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:41.823 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:28:41.828 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:41.829 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:41.840 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:41.896 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:41.894+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:41.975 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:41.975 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:41.986 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:41.997 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:41.996+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:42.098 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:42.097+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:42.102 INFO:tasks.workunit.client.0.smithi046.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-26T12:28:42.106 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T12:28:42.106 INFO:tasks.workunit.client.0.smithi046.stderr:+ make 2024-04-26T12:28:42.122 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:42.123 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:42.131 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:42.134 INFO:tasks.workunit.client.0.smithi046.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-26T12:28:42.199 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:42.198+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:42.259 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:42.259 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:42.269 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:42.310 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:42.309+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:42.396 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:42.396 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:42.400 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:42.400+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:42.406 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:42.446 INFO:tasks.workunit.client.0.smithi046.stderr:++ readlink -f fsstress 2024-04-26T12:28:42.447 INFO:tasks.workunit.client.0.smithi046.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-26T12:28:42.447 INFO:tasks.workunit.client.0.smithi046.stderr:+ popd 2024-04-26T12:28:42.448 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T12:28:42.448 INFO:tasks.workunit.client.0.smithi046.stderr:+ popd 2024-04-26T12:28:42.449 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-26T12:28:42.449 INFO:tasks.workunit.client.0.smithi046.stderr:++ mktemp -d -p . 2024-04-26T12:28:42.450 INFO:tasks.workunit.client.0.smithi046.stderr:+ T=./tmp.w9w6ARTAD2 2024-04-26T12:28:42.450 INFO:tasks.workunit.client.0.smithi046.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.w9w6ARTAD2 -l 1 -n 1000 -p 10 -v 2024-04-26T12:28:42.452 INFO:tasks.workunit.client.0.smithi046.stdout:seed = 1714255911 2024-04-26T12:28:42.452 INFO:tasks.workunit.client.0.smithi046.stdout:0/0: write - no filename 2024-04-26T12:28:42.453 INFO:tasks.workunit.client.0.smithi046.stdout:0/1: truncate - no filename 2024-04-26T12:28:42.453 INFO:tasks.workunit.client.0.smithi046.stdout:0/2: mknod c0 0 2024-04-26T12:28:42.453 INFO:tasks.workunit.client.0.smithi046.stdout:0/3: dread - no filename 2024-04-26T12:28:42.453 INFO:tasks.workunit.client.0.smithi046.stdout:0/4: write - no filename 2024-04-26T12:28:42.453 INFO:tasks.workunit.client.0.smithi046.stdout:0/5: fsync - no filename 2024-04-26T12:28:42.455 INFO:tasks.workunit.client.0.smithi046.stdout:2/0: dwrite - no filename 2024-04-26T12:28:42.456 INFO:tasks.workunit.client.0.smithi046.stdout:1/0: mknod c0 0 2024-04-26T12:28:42.456 INFO:tasks.workunit.client.0.smithi046.stdout:1/1: dwrite - no filename 2024-04-26T12:28:42.456 INFO:tasks.workunit.client.0.smithi046.stdout:1/2: write - no filename 2024-04-26T12:28:42.456 INFO:tasks.workunit.client.0.smithi046.stdout:0/6: chown c0 11068454 1 2024-04-26T12:28:42.456 INFO:tasks.workunit.client.0.smithi046.stdout:0/7: write - no filename 2024-04-26T12:28:42.456 INFO:tasks.workunit.client.0.smithi046.stdout:1/3: chown c0 11987 1 2024-04-26T12:28:42.456 INFO:tasks.workunit.client.0.smithi046.stdout:2/1: mknod c0 0 2024-04-26T12:28:42.456 INFO:tasks.workunit.client.0.smithi046.stdout:0/8: rename c0 to c1 0 2024-04-26T12:28:42.456 INFO:tasks.workunit.client.0.smithi046.stdout:4/0: dread - no filename 2024-04-26T12:28:42.456 INFO:tasks.workunit.client.0.smithi046.stdout:3/0: symlink l0 0 2024-04-26T12:28:42.456 INFO:tasks.workunit.client.0.smithi046.stdout:3/1: dread - no filename 2024-04-26T12:28:42.457 INFO:tasks.workunit.client.0.smithi046.stdout:2/2: unlink c0 0 2024-04-26T12:28:42.457 INFO:tasks.workunit.client.0.smithi046.stdout:0/9: creat f2 x:0 0 0 2024-04-26T12:28:42.457 INFO:tasks.workunit.client.0.smithi046.stdout:5/0: unlink - no file 2024-04-26T12:28:42.457 INFO:tasks.workunit.client.0.smithi046.stdout:5/1: fdatasync - no filename 2024-04-26T12:28:42.457 INFO:tasks.workunit.client.0.smithi046.stdout:5/2: chown . 46 1 2024-04-26T12:28:42.457 INFO:tasks.workunit.client.0.smithi046.stdout:5/3: dread - no filename 2024-04-26T12:28:42.457 INFO:tasks.workunit.client.0.smithi046.stdout:5/4: dread - no filename 2024-04-26T12:28:42.457 INFO:tasks.workunit.client.0.smithi046.stdout:3/2: chown l0 277886 1 2024-04-26T12:28:42.457 INFO:tasks.workunit.client.0.smithi046.stdout:4/1: mkdir d0 0 2024-04-26T12:28:42.457 INFO:tasks.workunit.client.0.smithi046.stdout:4/2: unlink - no file 2024-04-26T12:28:42.457 INFO:tasks.workunit.client.0.smithi046.stdout:2/3: mkdir d1 0 2024-04-26T12:28:42.457 INFO:tasks.workunit.client.0.smithi046.stdout:2/4: dwrite - no filename 2024-04-26T12:28:42.457 INFO:tasks.workunit.client.0.smithi046.stdout:2/5: link - no file 2024-04-26T12:28:42.457 INFO:tasks.workunit.client.0.smithi046.stdout:2/6: write - no filename 2024-04-26T12:28:42.458 INFO:tasks.workunit.client.0.smithi046.stdout:0/10: creat f3 x:0 0 0 2024-04-26T12:28:42.463 INFO:tasks.workunit.client.0.smithi046.stdout:6/0: dread - no filename 2024-04-26T12:28:42.463 INFO:tasks.workunit.client.0.smithi046.stdout:6/1: unlink - no file 2024-04-26T12:28:42.463 INFO:tasks.workunit.client.0.smithi046.stdout:0/11: dread - f3 zero size 2024-04-26T12:28:42.464 INFO:tasks.workunit.client.0.smithi046.stdout:5/5: creat f0 x:0 0 0 2024-04-26T12:28:42.464 INFO:tasks.workunit.client.0.smithi046.stdout:4/3: mkdir d0/d1 0 2024-04-26T12:28:42.464 INFO:tasks.workunit.client.0.smithi046.stdout:4/4: write - no filename 2024-04-26T12:28:42.464 INFO:tasks.workunit.client.0.smithi046.stdout:2/7: creat d1/f2 x:0 0 0 2024-04-26T12:28:42.464 INFO:tasks.workunit.client.0.smithi046.stdout:0/12: mknod c4 0 2024-04-26T12:28:42.464 INFO:tasks.workunit.client.0.smithi046.stdout:7/0: chown . 84283 1 2024-04-26T12:28:42.464 INFO:tasks.workunit.client.0.smithi046.stdout:7/1: link - no file 2024-04-26T12:28:42.464 INFO:tasks.workunit.client.0.smithi046.stdout:7/2: fsync - no filename 2024-04-26T12:28:42.464 INFO:tasks.workunit.client.0.smithi046.stdout:7/3: dwrite - no filename 2024-04-26T12:28:42.464 INFO:tasks.workunit.client.0.smithi046.stdout:7/4: write - no filename 2024-04-26T12:28:42.465 INFO:tasks.workunit.client.0.smithi046.stdout:7/5: rename - no filename 2024-04-26T12:28:42.465 INFO:tasks.workunit.client.0.smithi046.stdout:7/6: link - no file 2024-04-26T12:28:42.465 INFO:tasks.workunit.client.0.smithi046.stdout:7/7: truncate - no filename 2024-04-26T12:28:42.465 INFO:tasks.workunit.client.0.smithi046.stdout:7/8: unlink - no file 2024-04-26T12:28:42.465 INFO:tasks.workunit.client.0.smithi046.stdout:3/3: link l0 l1 0 2024-04-26T12:28:42.465 INFO:tasks.workunit.client.0.smithi046.stdout:3/4: dwrite - no filename 2024-04-26T12:28:42.465 INFO:tasks.workunit.client.0.smithi046.stdout:8/0: write - no filename 2024-04-26T12:28:42.465 INFO:tasks.workunit.client.0.smithi046.stdout:8/1: rename - no filename 2024-04-26T12:28:42.465 INFO:tasks.workunit.client.0.smithi046.stdout:8/2: rmdir - no directory 2024-04-26T12:28:42.465 INFO:tasks.workunit.client.0.smithi046.stdout:8/3: write - no filename 2024-04-26T12:28:42.466 INFO:tasks.workunit.client.0.smithi046.stdout:8/4: dread - no filename 2024-04-26T12:28:42.466 INFO:tasks.workunit.client.0.smithi046.stdout:8/5: fsync - no filename 2024-04-26T12:28:42.466 INFO:tasks.workunit.client.0.smithi046.stdout:6/2: symlink l0 0 2024-04-26T12:28:42.466 INFO:tasks.workunit.client.0.smithi046.stdout:2/8: mknod d1/c3 0 2024-04-26T12:28:42.466 INFO:tasks.workunit.client.0.smithi046.stdout:4/5: creat d0/f2 x:0 0 0 2024-04-26T12:28:42.466 INFO:tasks.workunit.client.0.smithi046.stdout:0/13: truncate f3 908877 0 2024-04-26T12:28:42.466 INFO:tasks.workunit.client.0.smithi046.stdout:3/5: readlink l1 0 2024-04-26T12:28:42.466 INFO:tasks.workunit.client.0.smithi046.stdout:6/3: chown l0 116089595 1 2024-04-26T12:28:42.466 INFO:tasks.workunit.client.0.smithi046.stdout:9/0: dread - no filename 2024-04-26T12:28:42.467 INFO:tasks.workunit.client.0.smithi046.stdout:9/1: fsync - no filename 2024-04-26T12:28:42.467 INFO:tasks.workunit.client.0.smithi046.stdout:9/2: dwrite - no filename 2024-04-26T12:28:42.467 INFO:tasks.workunit.client.0.smithi046.stdout:9/3: read - no filename 2024-04-26T12:28:42.467 INFO:tasks.workunit.client.0.smithi046.stdout:0/14: write f2 [69831,5772] 0 2024-04-26T12:28:42.467 INFO:tasks.workunit.client.0.smithi046.stdout:7/9: creat f0 x:0 0 0 2024-04-26T12:28:42.467 INFO:tasks.workunit.client.0.smithi046.stdout:7/10: readlink - no filename 2024-04-26T12:28:42.467 INFO:tasks.workunit.client.0.smithi046.stdout:3/6: mkdir d2 0 2024-04-26T12:28:42.467 INFO:tasks.workunit.client.0.smithi046.stdout:8/6: mknod c0 0 2024-04-26T12:28:42.467 INFO:tasks.workunit.client.0.smithi046.stdout:8/7: rmdir - no directory 2024-04-26T12:28:42.468 INFO:tasks.workunit.client.0.smithi046.stdout:0/15: creat f5 x:0 0 0 2024-04-26T12:28:42.468 INFO:tasks.workunit.client.0.smithi046.stdout:7/11: symlink l1 0 2024-04-26T12:28:42.468 INFO:tasks.workunit.client.0.smithi046.stdout:9/4: mkdir d0 0 2024-04-26T12:28:42.468 INFO:tasks.workunit.client.0.smithi046.stdout:9/5: fdatasync - no filename 2024-04-26T12:28:42.468 INFO:tasks.workunit.client.0.smithi046.stdout:9/6: dwrite - no filename 2024-04-26T12:28:42.468 INFO:tasks.workunit.client.0.smithi046.stdout:2/9: creat d1/f4 x:0 0 0 2024-04-26T12:28:42.468 INFO:tasks.workunit.client.0.smithi046.stdout:8/8: chown c0 108025541 1 2024-04-26T12:28:42.469 INFO:tasks.workunit.client.0.smithi046.stdout:9/7: rename d0 to d0/d1 22 2024-04-26T12:28:42.469 INFO:tasks.workunit.client.0.smithi046.stdout:0/16: creat f6 x:0 0 0 2024-04-26T12:28:42.469 INFO:tasks.workunit.client.0.smithi046.stdout:8/9: mknod c1 0 2024-04-26T12:28:42.469 INFO:tasks.workunit.client.0.smithi046.stdout:8/10: rmdir - no directory 2024-04-26T12:28:42.469 INFO:tasks.workunit.client.0.smithi046.stdout:8/11: write - no filename 2024-04-26T12:28:42.469 INFO:tasks.workunit.client.0.smithi046.stdout:8/12: truncate - no filename 2024-04-26T12:28:42.469 INFO:tasks.workunit.client.0.smithi046.stdout:3/7: chown l0 3077939 1 2024-04-26T12:28:42.469 INFO:tasks.workunit.client.0.smithi046.stdout:3/8: write - no filename 2024-04-26T12:28:42.469 INFO:tasks.workunit.client.0.smithi046.stdout:9/8: rename d0 to d0/d2 22 2024-04-26T12:28:42.469 INFO:tasks.workunit.client.0.smithi046.stdout:7/12: link l1 l2 0 2024-04-26T12:28:42.469 INFO:tasks.workunit.client.0.smithi046.stdout:0/17: dread - f6 zero size 2024-04-26T12:28:42.469 INFO:tasks.workunit.client.0.smithi046.stdout:2/10: write d1/f4 [878577,127064] 0 2024-04-26T12:28:42.470 INFO:tasks.workunit.client.0.smithi046.stdout:3/9: stat d2 0 2024-04-26T12:28:42.470 INFO:tasks.workunit.client.0.smithi046.stdout:8/13: mknod c2 0 2024-04-26T12:28:42.470 INFO:tasks.workunit.client.0.smithi046.stdout:7/13: creat f3 x:0 0 0 2024-04-26T12:28:42.470 INFO:tasks.workunit.client.0.smithi046.stdout:0/18: creat f7 x:0 0 0 2024-04-26T12:28:42.470 INFO:tasks.workunit.client.0.smithi046.stdout:8/14: symlink l3 0 2024-04-26T12:28:42.470 INFO:tasks.workunit.client.0.smithi046.stdout:3/10: chown l1 3686 1 2024-04-26T12:28:42.470 INFO:tasks.workunit.client.0.smithi046.stdout:8/15: creat f4 x:0 0 0 2024-04-26T12:28:42.470 INFO:tasks.workunit.client.0.smithi046.stdout:0/19: write f2 [1112089,12715] 0 2024-04-26T12:28:42.470 INFO:tasks.workunit.client.0.smithi046.stdout:7/14: link f0 f4 0 2024-04-26T12:28:42.470 INFO:tasks.workunit.client.0.smithi046.stdout:8/16: chown l3 199937 1 2024-04-26T12:28:42.470 INFO:tasks.workunit.client.0.smithi046.stdout:3/11: symlink d2/l3 0 2024-04-26T12:28:42.474 INFO:tasks.workunit.client.0.smithi046.stdout:0/20: chown f5 1300 1 2024-04-26T12:28:42.475 INFO:tasks.workunit.client.0.smithi046.stdout:8/17: unlink c0 0 2024-04-26T12:28:42.475 INFO:tasks.workunit.client.0.smithi046.stdout:7/15: write f4 [775768,39341] 0 2024-04-26T12:28:42.475 INFO:tasks.workunit.client.0.smithi046.stdout:0/21: creat f8 x:0 0 0 2024-04-26T12:28:42.475 INFO:tasks.workunit.client.0.smithi046.stdout:8/18: write f4 [610327,39799] 0 2024-04-26T12:28:42.475 INFO:tasks.workunit.client.0.smithi046.stdout:7/16: write f4 [941881,71622] 0 2024-04-26T12:28:42.475 INFO:tasks.workunit.client.0.smithi046.stdout:0/22: mkdir d9 0 2024-04-26T12:28:42.475 INFO:tasks.workunit.client.0.smithi046.stdout:4/6: dwrite d0/f2 [0,4194304] 0 2024-04-26T12:28:42.475 INFO:tasks.workunit.client.0.smithi046.stdout:7/17: creat f5 x:0 0 0 2024-04-26T12:28:42.475 INFO:tasks.workunit.client.0.smithi046.stdout:0/23: creat d9/fa x:0 0 0 2024-04-26T12:28:42.475 INFO:tasks.workunit.client.0.smithi046.stdout:7/18: chown f0 29671 1 2024-04-26T12:28:42.475 INFO:tasks.workunit.client.0.smithi046.stdout:4/7: write d0/f2 [3572462,126075] 0 2024-04-26T12:28:42.475 INFO:tasks.workunit.client.0.smithi046.stdout:0/24: truncate f8 736145 0 2024-04-26T12:28:42.475 INFO:tasks.workunit.client.0.smithi046.stdout:4/8: chown d0 6316 1 2024-04-26T12:28:42.475 INFO:tasks.workunit.client.0.smithi046.stdout:7/19: creat f6 x:0 0 0 2024-04-26T12:28:42.476 INFO:tasks.workunit.client.0.smithi046.stdout:5/6: getdents . 0 2024-04-26T12:28:42.476 INFO:tasks.workunit.client.0.smithi046.stdout:6/4: getdents . 0 2024-04-26T12:28:42.476 INFO:tasks.workunit.client.0.smithi046.stdout:6/5: dread - no filename 2024-04-26T12:28:42.476 INFO:tasks.workunit.client.0.smithi046.stdout:2/11: getdents d1 0 2024-04-26T12:28:42.476 INFO:tasks.workunit.client.0.smithi046.stdout:7/20: symlink l7 0 2024-04-26T12:28:42.476 INFO:tasks.workunit.client.0.smithi046.stdout:5/7: mknod c1 0 2024-04-26T12:28:42.476 INFO:tasks.workunit.client.0.smithi046.stdout:7/21: truncate f0 1445895 0 2024-04-26T12:28:42.476 INFO:tasks.workunit.client.0.smithi046.stdout:2/12: truncate d1/f4 1775698 0 2024-04-26T12:28:42.476 INFO:tasks.workunit.client.0.smithi046.stdout:5/8: write f0 [150609,119125] 0 2024-04-26T12:28:42.476 INFO:tasks.workunit.client.0.smithi046.stdout:7/22: creat f8 x:0 0 0 2024-04-26T12:28:42.476 INFO:tasks.workunit.client.0.smithi046.stdout:5/9: write f0 [1034212,74416] 0 2024-04-26T12:28:42.476 INFO:tasks.workunit.client.0.smithi046.stdout:7/23: rename f8 to f9 0 2024-04-26T12:28:42.477 INFO:tasks.workunit.client.0.smithi046.stdout:2/13: link d1/f4 d1/f5 0 2024-04-26T12:28:42.477 INFO:tasks.workunit.client.0.smithi046.stdout:5/10: rename f0 to f2 0 2024-04-26T12:28:42.477 INFO:tasks.workunit.client.0.smithi046.stdout:7/24: write f9 [558246,119037] 0 2024-04-26T12:28:42.477 INFO:tasks.workunit.client.0.smithi046.stdout:5/11: mknod c3 0 2024-04-26T12:28:42.477 INFO:tasks.workunit.client.0.smithi046.stdout:7/25: fsync f5 0 2024-04-26T12:28:42.477 INFO:tasks.workunit.client.0.smithi046.stdout:0/25: dwrite f2 [0,4194304] 0 2024-04-26T12:28:42.477 INFO:tasks.workunit.client.0.smithi046.stdout:5/12: creat f4 x:0 0 0 2024-04-26T12:28:42.477 INFO:tasks.workunit.client.0.smithi046.stdout:7/26: symlink la 0 2024-04-26T12:28:42.478 INFO:tasks.workunit.client.0.smithi046.stdout:5/13: write f2 [1633408,6048] 0 2024-04-26T12:28:42.478 INFO:tasks.workunit.client.0.smithi046.stdout:7/27: write f0 [1174377,11358] 0 2024-04-26T12:28:42.478 INFO:tasks.workunit.client.0.smithi046.stdout:7/28: truncate f9 1307569 0 2024-04-26T12:28:42.478 INFO:tasks.workunit.client.0.smithi046.stdout:5/14: write f2 [1374322,128781] 0 2024-04-26T12:28:42.478 INFO:tasks.workunit.client.0.smithi046.stdout:5/15: rename f4 to f5 0 2024-04-26T12:28:42.479 INFO:tasks.workunit.client.0.smithi046.stdout:2/14: dwrite d1/f2 [0,4194304] 0 2024-04-26T12:28:42.480 INFO:tasks.workunit.client.0.smithi046.stdout:2/15: creat d1/f6 x:0 0 0 2024-04-26T12:28:42.480 INFO:tasks.workunit.client.0.smithi046.stdout:2/16: unlink d1/f5 0 2024-04-26T12:28:42.481 INFO:tasks.workunit.client.0.smithi046.stdout:2/17: write d1/f6 [467779,9646] 0 2024-04-26T12:28:42.481 INFO:tasks.workunit.client.0.smithi046.stdout:7/29: truncate f0 868333 0 2024-04-26T12:28:42.481 INFO:tasks.workunit.client.0.smithi046.stdout:7/30: write f6 [870678,119662] 0 2024-04-26T12:28:42.482 INFO:tasks.workunit.client.0.smithi046.stdout:2/18: chown d1/f4 3320 1 2024-04-26T12:28:42.482 INFO:tasks.workunit.client.0.smithi046.stdout:7/31: dread - f3 zero size 2024-04-26T12:28:42.482 INFO:tasks.workunit.client.0.smithi046.stdout:0/26: dread f8 [0,4194304] 0 2024-04-26T12:28:42.483 INFO:tasks.workunit.client.0.smithi046.stdout:7/32: getdents . 0 2024-04-26T12:28:42.483 INFO:tasks.workunit.client.0.smithi046.stdout:2/19: truncate d1/f4 1251788 0 2024-04-26T12:28:42.484 INFO:tasks.workunit.client.0.smithi046.stdout:2/20: unlink d1/c3 0 2024-04-26T12:28:42.484 INFO:tasks.workunit.client.0.smithi046.stdout:2/21: readlink - no filename 2024-04-26T12:28:42.487 INFO:tasks.workunit.client.0.smithi046.stdout:7/33: write f0 [790694,59625] 0 2024-04-26T12:28:42.488 INFO:tasks.workunit.client.0.smithi046.stdout:7/34: stat f3 0 2024-04-26T12:28:42.489 INFO:tasks.workunit.client.0.smithi046.stdout:0/27: dwrite f3 [0,4194304] 0 2024-04-26T12:28:42.489 INFO:tasks.workunit.client.0.smithi046.stdout:7/35: mknod cb 0 2024-04-26T12:28:42.490 INFO:tasks.workunit.client.0.smithi046.stdout:7/36: write f6 [613600,38268] 0 2024-04-26T12:28:42.491 INFO:tasks.workunit.client.0.smithi046.stdout:7/37: rename cb to cc 0 2024-04-26T12:28:42.495 INFO:tasks.workunit.client.0.smithi046.stdout:7/38: link l1 ld 0 2024-04-26T12:28:42.495 INFO:tasks.workunit.client.0.smithi046.stdout:2/22: dwrite d1/f4 [0,4194304] 0 2024-04-26T12:28:42.495 INFO:tasks.workunit.client.0.smithi046.stdout:7/39: dread - f3 zero size 2024-04-26T12:28:42.496 INFO:tasks.workunit.client.0.smithi046.stdout:7/40: write f0 [1909570,13604] 0 2024-04-26T12:28:42.496 INFO:tasks.workunit.client.0.smithi046.stdout:0/28: dwrite f3 [0,4194304] 0 2024-04-26T12:28:42.497 INFO:tasks.workunit.client.0.smithi046.stdout:7/41: symlink le 0 2024-04-26T12:28:42.497 INFO:tasks.workunit.client.0.smithi046.stdout:0/29: symlink d9/lb 0 2024-04-26T12:28:42.497 INFO:tasks.workunit.client.0.smithi046.stdout:7/42: rename ld to lf 0 2024-04-26T12:28:42.498 INFO:tasks.workunit.client.0.smithi046.stdout:0/30: dread - d9/fa zero size 2024-04-26T12:28:42.498 INFO:tasks.workunit.client.0.smithi046.stdout:7/43: write f6 [250064,65140] 0 2024-04-26T12:28:42.500 INFO:tasks.workunit.client.0.smithi046.stdout:2/23: truncate d1/f4 2465167 0 2024-04-26T12:28:42.501 INFO:tasks.workunit.client.0.smithi046.stdout:2/24: chown d1/f4 10964 1 2024-04-26T12:28:42.501 INFO:tasks.workunit.client.0.smithi046.stdout:7/44: truncate f4 109680 0 2024-04-26T12:28:42.501 INFO:tasks.workunit.client.0.smithi046.stdout:0/31: getdents d9 0 2024-04-26T12:28:42.501 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:42.500+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:42.502 INFO:tasks.workunit.client.0.smithi046.stdout:2/25: write d1/f2 [3313159,93928] 0 2024-04-26T12:28:42.502 INFO:tasks.workunit.client.0.smithi046.stdout:0/32: truncate d9/fa 730624 0 2024-04-26T12:28:42.504 INFO:tasks.workunit.client.0.smithi046.stdout:2/26: write d1/f4 [49900,89982] 0 2024-04-26T12:28:42.504 INFO:tasks.workunit.client.0.smithi046.stdout:2/27: readlink - no filename 2024-04-26T12:28:42.506 INFO:tasks.workunit.client.0.smithi046.stdout:5/16: dread f2 [0,4194304] 0 2024-04-26T12:28:42.506 INFO:tasks.workunit.client.0.smithi046.stdout:7/45: write f4 [148867,83081] 0 2024-04-26T12:28:42.507 INFO:tasks.workunit.client.0.smithi046.stdout:0/33: dwrite d9/fa [0,4194304] 0 2024-04-26T12:28:42.507 INFO:tasks.workunit.client.0.smithi046.stdout:0/34: dread - f5 zero size 2024-04-26T12:28:42.507 INFO:tasks.workunit.client.0.smithi046.stdout:7/46: symlink l10 0 2024-04-26T12:28:42.507 INFO:tasks.workunit.client.0.smithi046.stdout:0/35: dread - f6 zero size 2024-04-26T12:28:42.508 INFO:tasks.workunit.client.0.smithi046.stdout:7/47: symlink l11 0 2024-04-26T12:28:42.508 INFO:tasks.workunit.client.0.smithi046.stdout:2/28: dread d1/f2 [0,4194304] 0 2024-04-26T12:28:42.508 INFO:tasks.workunit.client.0.smithi046.stdout:7/48: fdatasync f9 0 2024-04-26T12:28:42.508 INFO:tasks.workunit.client.0.smithi046.stdout:0/36: truncate f5 809643 0 2024-04-26T12:28:42.509 INFO:tasks.workunit.client.0.smithi046.stdout:0/37: fsync f5 0 2024-04-26T12:28:42.509 INFO:tasks.workunit.client.0.smithi046.stdout:7/49: chown f0 8 1 2024-04-26T12:28:42.509 INFO:tasks.workunit.client.0.smithi046.stdout:2/29: mknod d1/c7 0 2024-04-26T12:28:42.509 INFO:tasks.workunit.client.0.smithi046.stdout:2/30: write d1/f6 [642134,127893] 0 2024-04-26T12:28:42.510 INFO:tasks.workunit.client.0.smithi046.stdout:2/31: write d1/f4 [2326854,24027] 0 2024-04-26T12:28:42.510 INFO:tasks.workunit.client.0.smithi046.stdout:2/32: creat d1/f8 x:0 0 0 2024-04-26T12:28:42.514 INFO:tasks.workunit.client.0.smithi046.stdout:7/50: getdents . 0 2024-04-26T12:28:42.514 INFO:tasks.workunit.client.0.smithi046.stdout:2/33: dwrite d1/f2 [0,4194304] 0 2024-04-26T12:28:42.514 INFO:tasks.workunit.client.0.smithi046.stdout:7/51: creat f12 x:0 0 0 2024-04-26T12:28:42.515 INFO:tasks.workunit.client.0.smithi046.stdout:2/34: rename d1/f6 to d1/f9 0 2024-04-26T12:28:42.515 INFO:tasks.workunit.client.0.smithi046.stdout:2/35: mknod d1/ca 0 2024-04-26T12:28:42.516 INFO:tasks.workunit.client.0.smithi046.stdout:0/38: truncate f8 375702 0 2024-04-26T12:28:42.517 INFO:tasks.workunit.client.0.smithi046.stdout:0/39: mkdir d9/dc 0 2024-04-26T12:28:42.517 INFO:tasks.workunit.client.0.smithi046.stdout:0/40: mkdir d9/dc/dd 0 2024-04-26T12:28:42.522 INFO:tasks.workunit.client.0.smithi046.stdout:0/41: dwrite f7 [0,4194304] 0 2024-04-26T12:28:42.523 INFO:tasks.workunit.client.0.smithi046.stdout:0/42: creat d9/dc/fe x:0 0 0 2024-04-26T12:28:42.524 INFO:tasks.workunit.client.0.smithi046.stdout:0/43: read f5 [11429,2641] 0 2024-04-26T12:28:42.524 INFO:tasks.workunit.client.0.smithi046.stdout:0/44: stat f6 0 2024-04-26T12:28:42.527 INFO:tasks.workunit.client.0.smithi046.stdout:2/36: dread d1/f9 [0,4194304] 0 2024-04-26T12:28:42.529 INFO:tasks.workunit.client.0.smithi046.stdout:2/37: write d1/f9 [1222402,67957] 0 2024-04-26T12:28:42.529 INFO:tasks.workunit.client.0.smithi046.stdout:0/45: dwrite f7 [4194304,4194304] 0 2024-04-26T12:28:42.530 INFO:tasks.workunit.client.0.smithi046.stdout:0/46: fsync f8 0 2024-04-26T12:28:42.532 INFO:tasks.workunit.client.0.smithi046.stdout:2/38: truncate d1/f4 254026 0 2024-04-26T12:28:42.532 INFO:tasks.workunit.client.0.smithi046.stdout:2/39: symlink d1/lb 0 2024-04-26T12:28:42.533 INFO:tasks.workunit.client.0.smithi046.stdout:7/52: dread f6 [0,4194304] 0 2024-04-26T12:28:42.533 INFO:tasks.workunit.client.0.smithi046.stdout:2/40: dread - d1/f8 zero size 2024-04-26T12:28:42.533 INFO:tasks.workunit.client.0.smithi046.stdout:7/53: chown cc 13 1 2024-04-26T12:28:42.534 INFO:tasks.workunit.client.0.smithi046.stdout:7/54: symlink l13 0 2024-04-26T12:28:42.535 INFO:tasks.workunit.client.0.smithi046.stdout:7/55: write f12 [172658,27845] 0 2024-04-26T12:28:42.535 INFO:tasks.workunit.client.0.smithi046.stdout:0/47: dwrite f6 [0,4194304] 0 2024-04-26T12:28:42.536 INFO:tasks.workunit.client.0.smithi046.stdout:7/56: creat f14 x:0 0 0 2024-04-26T12:28:42.537 INFO:tasks.workunit.client.0.smithi046.stdout:0/48: dread f5 [0,4194304] 0 2024-04-26T12:28:42.539 INFO:tasks.workunit.client.0.smithi046.stdout:2/41: dwrite d1/f2 [0,4194304] 0 2024-04-26T12:28:42.543 INFO:tasks.workunit.client.0.smithi046.stdout:0/49: dwrite d9/dc/fe [0,4194304] 0 2024-04-26T12:28:42.543 INFO:tasks.workunit.client.0.smithi046.stdout:0/50: symlink d9/dc/lf 0 2024-04-26T12:28:42.544 INFO:tasks.workunit.client.0.smithi046.stdout:0/51: rename d9/dc/fe to d9/f10 0 2024-04-26T12:28:42.545 INFO:tasks.workunit.client.0.smithi046.stdout:0/52: mkdir d9/dc/dd/d11 0 2024-04-26T12:28:42.548 INFO:tasks.workunit.client.0.smithi046.stdout:0/53: dread f3 [0,4194304] 0 2024-04-26T12:28:42.548 INFO:tasks.workunit.client.0.smithi046.stdout:2/42: dread d1/f9 [0,4194304] 0 2024-04-26T12:28:42.548 INFO:tasks.workunit.client.0.smithi046.stdout:0/54: stat d9 0 2024-04-26T12:28:42.548 INFO:tasks.workunit.client.0.smithi046.stdout:0/55: truncate d9/fa 4413215 0 2024-04-26T12:28:42.548 INFO:tasks.workunit.client.0.smithi046.stdout:2/43: rename d1/ca to d1/cc 0 2024-04-26T12:28:42.549 INFO:tasks.workunit.client.0.smithi046.stdout:2/44: mknod d1/cd 0 2024-04-26T12:28:42.549 INFO:tasks.workunit.client.0.smithi046.stdout:2/45: readlink d1/lb 0 2024-04-26T12:28:42.551 INFO:tasks.workunit.client.0.smithi046.stdout:2/46: write d1/f4 [253977,48210] 0 2024-04-26T12:28:42.552 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:42.552 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:42.552 INFO:tasks.workunit.client.0.smithi046.stdout:2/47: readlink d1/lb 0 2024-04-26T12:28:42.553 INFO:tasks.workunit.client.0.smithi046.stdout:2/48: stat d1/lb 0 2024-04-26T12:28:42.554 INFO:tasks.workunit.client.0.smithi046.stdout:2/49: write d1/f4 [84467,115128] 0 2024-04-26T12:28:42.554 INFO:tasks.workunit.client.0.smithi046.stdout:0/56: dwrite f5 [0,4194304] 0 2024-04-26T12:28:42.554 INFO:tasks.workunit.client.0.smithi046.stdout:0/57: stat f8 0 2024-04-26T12:28:42.554 INFO:tasks.workunit.client.0.smithi046.stdout:2/50: mkdir d1/de 0 2024-04-26T12:28:42.555 INFO:tasks.workunit.client.0.smithi046.stdout:2/51: rename d1/f9 to d1/de/ff 0 2024-04-26T12:28:42.555 INFO:tasks.workunit.client.0.smithi046.stdout:2/52: readlink d1/lb 0 2024-04-26T12:28:42.556 INFO:tasks.workunit.client.0.smithi046.stdout:2/53: link d1/cc d1/c10 0 2024-04-26T12:28:42.556 INFO:tasks.workunit.client.0.smithi046.stdout:0/58: truncate d9/fa 2057553 0 2024-04-26T12:28:42.557 INFO:tasks.workunit.client.0.smithi046.stdout:2/54: creat d1/de/f11 x:0 0 0 2024-04-26T12:28:42.557 INFO:tasks.workunit.client.0.smithi046.stdout:0/59: creat d9/f12 x:0 0 0 2024-04-26T12:28:42.557 INFO:tasks.workunit.client.0.smithi046.stdout:2/55: read d1/f4 [149852,44559] 0 2024-04-26T12:28:42.558 INFO:tasks.workunit.client.0.smithi046.stdout:0/60: rmdir d9/dc/dd/d11 0 2024-04-26T12:28:42.559 INFO:tasks.workunit.client.0.smithi046.stdout:2/56: dread d1/de/ff [0,4194304] 0 2024-04-26T12:28:42.560 INFO:tasks.workunit.client.0.smithi046.stdout:0/61: rmdir d9/dc 39 2024-04-26T12:28:42.560 INFO:tasks.workunit.client.0.smithi046.stdout:2/57: link d1/cd d1/de/c12 0 2024-04-26T12:28:42.561 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:28:42.563 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:42.564 INFO:tasks.workunit.client.0.smithi046.stdout:0/62: dwrite f7 [4194304,4194304] 0 2024-04-26T12:28:42.565 INFO:tasks.workunit.client.0.smithi046.stdout:2/58: dwrite d1/f4 [0,4194304] 0 2024-04-26T12:28:42.567 INFO:tasks.workunit.client.0.smithi046.stdout:2/59: write d1/de/ff [1386796,1339] 0 2024-04-26T12:28:42.567 INFO:tasks.workunit.client.0.smithi046.stdout:0/63: link f6 d9/dc/dd/f13 0 2024-04-26T12:28:42.567 INFO:tasks.workunit.client.0.smithi046.stdout:2/60: mkdir d1/d13 0 2024-04-26T12:28:42.570 INFO:tasks.workunit.client.0.smithi046.stdout:0/64: dread f7 [0,4194304] 0 2024-04-26T12:28:42.573 INFO:tasks.workunit.client.0.smithi046.stdout:2/61: dwrite d1/f8 [0,4194304] 0 2024-04-26T12:28:42.573 INFO:tasks.workunit.client.0.smithi046.stdout:2/62: chown d1 645433 1 2024-04-26T12:28:42.574 INFO:tasks.workunit.client.0.smithi046.stdout:2/63: mknod d1/de/c14 0 2024-04-26T12:28:42.574 INFO:tasks.workunit.client.0.smithi046.stdout:2/64: readlink d1/lb 0 2024-04-26T12:28:42.580 INFO:tasks.workunit.client.0.smithi046.stdout:2/65: dwrite d1/de/ff [0,4194304] 0 2024-04-26T12:28:42.581 INFO:tasks.workunit.client.0.smithi046.stdout:2/66: mkdir d1/de/d15 0 2024-04-26T12:28:42.582 INFO:tasks.workunit.client.0.smithi046.stdout:2/67: link d1/f8 d1/de/d15/f16 0 2024-04-26T12:28:42.582 INFO:tasks.workunit.client.0.smithi046.stdout:2/68: symlink d1/de/l17 2 2024-04-26T12:28:42.582 INFO:tasks.workunit.client.0.smithi046.stdout:2/69: read d1/f2 [2536539,35709] 0 2024-04-26T12:28:42.583 INFO:tasks.workunit.client.0.smithi046.stdout:2/70: mkdir d1/de/d15/d18 0 2024-04-26T12:28:42.583 INFO:tasks.workunit.client.0.smithi046.stdout:2/71: chown d1/cd 3 1 2024-04-26T12:28:42.584 INFO:tasks.workunit.client.0.smithi046.stdout:2/72: symlink d1/de/d15/l19 0 2024-04-26T12:28:42.584 INFO:tasks.workunit.client.0.smithi046.stdout:2/73: chown d1/d13 22 1 2024-04-26T12:28:42.585 INFO:tasks.workunit.client.0.smithi046.stdout:2/74: chown d1/c7 0 1 2024-04-26T12:28:42.602 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:42.601+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:42.694 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:42.694 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:42.702 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:42.701+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:42.705 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:42.715 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:42.735 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:42.735 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:42.736 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:42.736 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:42.737 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:42.738 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:42.803 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:42.802+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:42.815 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2024-04-26T12:28:42.832 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:42.832 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:42.832 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:42.842 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:42.904 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:42.902+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:43.005 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:43.003+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:43.019 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:43.019 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:43.019 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:43.019 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:43.019 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:43.029 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:43.105 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:43.104+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:43.198 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:43.198 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:43.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:43.198 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:43.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.198 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:293 3.13 3:ceffbd45:::200.0000000a:head [write 594763~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.199 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:43.199 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.27112677200000002, 2024-04-26T12:28:43.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038803585000000002, 2024-04-26T12:28:43.199 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.199 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.199 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:43.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:43.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924874+0000", 2024-04-26T12:28:43.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924877+0000", 2024-04-26T12:28:43.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7329999999999999e-06 2024-04-26T12:28:43.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924884+0000", 2024-04-26T12:28:43.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:28:43.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924890+0000", 2024-04-26T12:28:43.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:28:43.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958764+0000", 2024-04-26T12:28:43.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.033873863999999997 2024-04-26T12:28:43.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958855+0000", 2024-04-26T12:28:43.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1402000000000003e-05 2024-04-26T12:28:43.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963608+0000", 2024-04-26T12:28:43.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047529039999999996 2024-04-26T12:28:43.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963636+0000", 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8194000000000001e-05 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963678+0000", 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2095999999999998e-05 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:294 3.13 3:ceffbd45:::200.0000000a:head [write 596172~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:43.204 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.27108202799999997, 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041225228000000003, 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924919+0000", 2024-04-26T12:28:43.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924922+0000", 2024-04-26T12:28:43.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9160000000000001e-06 2024-04-26T12:28:43.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924928+0000", 2024-04-26T12:28:43.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3929999999999996e-06 2024-04-26T12:28:43.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924933+0000", 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7820000000000001e-06 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959359+0000", 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034425782000000002 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959439+0000", 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0275e-05 2024-04-26T12:28:43.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966079+0000", 2024-04-26T12:28:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0066397089999999997 2024-04-26T12:28:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966106+0000", 2024-04-26T12:28:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7178e-05 2024-04-26T12:28:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966145+0000", 2024-04-26T12:28:43.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8618999999999997e-05 2024-04-26T12:28:43.209 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.209 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.209 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.209 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:295 3.13 3:ceffbd45:::200.0000000a:head [write 597574~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.209 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:43.209 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.27105587799999997, 2024-04-26T12:28:43.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041258571000000001, 2024-04-26T12:28:43.209 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.209 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.209 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924945+0000", 2024-04-26T12:28:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924948+0000", 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924955+0000", 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4629999999999998e-06 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924959+0000", 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2719999999999999e-06 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959957+0000", 2024-04-26T12:28:43.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034997588000000003 2024-04-26T12:28:43.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960042+0000", 2024-04-26T12:28:43.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5811999999999998e-05 2024-04-26T12:28:43.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966149+0000", 2024-04-26T12:28:43.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061071650000000003 2024-04-26T12:28:43.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966171+0000", 2024-04-26T12:28:43.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1905000000000001e-05 2024-04-26T12:28:43.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966204+0000", 2024-04-26T12:28:43.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2845999999999997e-05 2024-04-26T12:28:43.213 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.213 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.213 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.214 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:296 3.13 3:ceffbd45:::200.0000000a:head [write 598977~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.214 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:43.214 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.27102424800000002, 2024-04-26T12:28:43.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041282538000000001, 2024-04-26T12:28:43.214 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.214 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.214 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:43.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:43.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:43.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:43.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924979+0000", 2024-04-26T12:28:43.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3609999999999999e-06 2024-04-26T12:28:43.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924984+0000", 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3259999999999997e-06 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924987+0000", 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7810000000000001e-06 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960618+0000", 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035631875 2024-04-26T12:28:43.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960698+0000", 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9373000000000001e-05 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966208+0000", 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055104359999999996 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966228+0000", 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0208e-05 2024-04-26T12:28:43.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966260+0000", 2024-04-26T12:28:43.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1404e-05 2024-04-26T12:28:43.218 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.218 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.218 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.218 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:297 3.13 3:ceffbd45:::200.0000000a:head [write 600380~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.218 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:43.218 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.27098741399999998, 2024-04-26T12:28:43.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041309850000000002, 2024-04-26T12:28:43.219 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.219 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.219 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:43.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:43.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925017+0000", 2024-04-26T12:28:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.96e-06 2024-04-26T12:28:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925020+0000", 2024-04-26T12:28:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6629999999999999e-06 2024-04-26T12:28:43.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925023+0000", 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961241+0000", 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036217390000000002 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961335+0000", 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4537000000000006e-05 2024-04-26T12:28:43.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966264+0000", 2024-04-26T12:28:43.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004928516 2024-04-26T12:28:43.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966290+0000", 2024-04-26T12:28:43.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5658999999999999e-05 2024-04-26T12:28:43.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966324+0000", 2024-04-26T12:28:43.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4459000000000003e-05 2024-04-26T12:28:43.223 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.223 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.223 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.223 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:298 3.13 3:ceffbd45:::200.0000000a:head [write 602634~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.223 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:43.223 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.27095481900000001, 2024-04-26T12:28:43.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046387536, 2024-04-26T12:28:43.223 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.223 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.223 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:43.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:43.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925046+0000", 2024-04-26T12:28:43.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:43.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925049+0000", 2024-04-26T12:28:43.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4770000000000002e-06 2024-04-26T12:28:43.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925057+0000", 2024-04-26T12:28:43.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9219999999999997e-06 2024-04-26T12:28:43.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925062+0000", 2024-04-26T12:28:43.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:28:43.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961918+0000", 2024-04-26T12:28:43.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036856170000000001 2024-04-26T12:28:43.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962014+0000", 2024-04-26T12:28:43.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6731999999999995e-05 2024-04-26T12:28:43.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971360+0000", 2024-04-26T12:28:43.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0093454569999999997 2024-04-26T12:28:43.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971393+0000", 2024-04-26T12:28:43.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3130999999999998e-05 2024-04-26T12:28:43.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971434+0000", 2024-04-26T12:28:43.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1244e-05 2024-04-26T12:28:43.228 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.228 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.228 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.228 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:299 3.13 3:ceffbd45:::200.0000000a:head [write 604033~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.228 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:43.228 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.27090098800000001, 2024-04-26T12:28:43.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046395615000000001, 2024-04-26T12:28:43.228 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.228 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.228 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:43.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:43.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925100+0000", 2024-04-26T12:28:43.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925103+0000", 2024-04-26T12:28:43.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3520000000000001e-06 2024-04-26T12:28:43.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925108+0000", 2024-04-26T12:28:43.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6489999999999996e-06 2024-04-26T12:28:43.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925111+0000", 2024-04-26T12:28:43.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.79e-06 2024-04-26T12:28:43.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962405+0000", 2024-04-26T12:28:43.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037293953999999997 2024-04-26T12:28:43.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962457+0000", 2024-04-26T12:28:43.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2003000000000003e-05 2024-04-26T12:28:43.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971440+0000", 2024-04-26T12:28:43.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0089831719999999993 2024-04-26T12:28:43.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971463+0000", 2024-04-26T12:28:43.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3201e-05 2024-04-26T12:28:43.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971496+0000", 2024-04-26T12:28:43.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2836000000000002e-05 2024-04-26T12:28:43.233 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.233 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.233 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.233 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:300 3.13 3:ceffbd45:::200.0000000a:head [write 605436~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.233 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:43.233 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.27083712999999998, 2024-04-26T12:28:43.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046389606999999999, 2024-04-26T12:28:43.233 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.233 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.234 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:43.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:43.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:43.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925167+0000", 2024-04-26T12:28:43.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8870000000000001e-06 2024-04-26T12:28:43.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925171+0000", 2024-04-26T12:28:43.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6049999999999998e-06 2024-04-26T12:28:43.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925173+0000", 2024-04-26T12:28:43.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8250000000000001e-06 2024-04-26T12:28:43.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962740+0000", 2024-04-26T12:28:43.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037566436000000002 2024-04-26T12:28:43.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962818+0000", 2024-04-26T12:28:43.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8231000000000004e-05 2024-04-26T12:28:43.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971501+0000", 2024-04-26T12:28:43.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008682525 2024-04-26T12:28:43.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971522+0000", 2024-04-26T12:28:43.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1673999999999999e-05 2024-04-26T12:28:43.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971554+0000", 2024-04-26T12:28:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1786999999999999e-05 2024-04-26T12:28:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:301 3.13 3:ceffbd45:::200.0000000a:head [write 606838~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.27082052200000001, 2024-04-26T12:28:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046429455000000001, 2024-04-26T12:28:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:43.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925183+0000", 2024-04-26T12:28:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0150000000000002e-06 2024-04-26T12:28:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925186+0000", 2024-04-26T12:28:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2210000000000002e-06 2024-04-26T12:28:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925190+0000", 2024-04-26T12:28:43.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8489999999999999e-06 2024-04-26T12:28:43.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963304+0000", 2024-04-26T12:28:43.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038114207999999997 2024-04-26T12:28:43.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963356+0000", 2024-04-26T12:28:43.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1628000000000001e-05 2024-04-26T12:28:43.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971558+0000", 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082025199999999996 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971579+0000", 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1019e-05 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971610+0000", 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1205999999999999e-05 2024-04-26T12:28:43.242 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.243 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.243 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.243 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:302 3.13 3:ceffbd45:::200.0000000a:head [write 608236~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.243 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:43.243 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.27079932899999998, 2024-04-26T12:28:43.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046464057000000003, 2024-04-26T12:28:43.243 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.243 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.243 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:43.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:43.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:43.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925204+0000", 2024-04-26T12:28:43.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1270000000000001e-06 2024-04-26T12:28:43.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925207+0000", 2024-04-26T12:28:43.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3720000000000001e-06 2024-04-26T12:28:43.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925210+0000", 2024-04-26T12:28:43.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7489999999999999e-06 2024-04-26T12:28:43.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963713+0000", 2024-04-26T12:28:43.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038502508999999997 2024-04-26T12:28:43.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963792+0000", 2024-04-26T12:28:43.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9087999999999999e-05 2024-04-26T12:28:43.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971615+0000", 2024-04-26T12:28:43.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078230130000000002 2024-04-26T12:28:43.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971636+0000", 2024-04-26T12:28:43.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0996999999999999e-05 2024-04-26T12:28:43.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971666+0000", 2024-04-26T12:28:43.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0443999999999999e-05 2024-04-26T12:28:43.247 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.247 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.247 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.248 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:303 3.13 3:ceffbd45:::200.0000000a:head [write 609649~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.248 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:43.248 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.270756308, 2024-04-26T12:28:43.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.047363031, 2024-04-26T12:28:43.248 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.248 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.248 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:43.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:43.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:43.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925253+0000", 2024-04-26T12:28:43.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0369999999999995e-06 2024-04-26T12:28:43.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925261+0000", 2024-04-26T12:28:43.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7420000000000003e-06 2024-04-26T12:28:43.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925271+0000", 2024-04-26T12:28:43.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1589999999999999e-06 2024-04-26T12:28:43.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964198+0000", 2024-04-26T12:28:43.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038927182999999997 2024-04-26T12:28:43.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964281+0000", 2024-04-26T12:28:43.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3355000000000004e-05 2024-04-26T12:28:43.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972542+0000", 2024-04-26T12:28:43.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082607930000000006 2024-04-26T12:28:43.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972570+0000", 2024-04-26T12:28:43.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7937999999999999e-05 2024-04-26T12:28:43.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972608+0000", 2024-04-26T12:28:43.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8384999999999999e-05 2024-04-26T12:28:43.252 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.252 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.252 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.252 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:304 3.13 3:ceffbd45:::200.0000000a:head [write 611057~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.253 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:43.253 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.269590679, 2024-04-26T12:28:43.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046259867000000003, 2024-04-26T12:28:43.253 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.253 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.253 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:43.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:43.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926410+0000", 2024-04-26T12:28:43.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926415+0000", 2024-04-26T12:28:43.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7999999999999998e-06 2024-04-26T12:28:43.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926423+0000", 2024-04-26T12:28:43.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8569999999999995e-06 2024-04-26T12:28:43.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926429+0000", 2024-04-26T12:28:43.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.421e-06 2024-04-26T12:28:43.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964778+0000", 2024-04-26T12:28:43.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038349045999999998 2024-04-26T12:28:43.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964830+0000", 2024-04-26T12:28:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1309e-05 2024-04-26T12:28:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972614+0000", 2024-04-26T12:28:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077847070000000001 2024-04-26T12:28:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972638+0000", 2024-04-26T12:28:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3388999999999999e-05 2024-04-26T12:28:43.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972671+0000", 2024-04-26T12:28:43.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2999e-05 2024-04-26T12:28:43.257 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.257 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.257 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.257 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:305 3.13 3:ceffbd45:::200.0000000a:head [write 613824~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.257 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:43.257 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.26954563999999998, 2024-04-26T12:28:43.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046273460000000002, 2024-04-26T12:28:43.258 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.258 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.258 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:43.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:43.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926463+0000", 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926467+0000", 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3000000000000003e-06 2024-04-26T12:28:43.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926470+0000", 2024-04-26T12:28:43.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1930000000000002e-06 2024-04-26T12:28:43.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965122+0000", 2024-04-26T12:28:43.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038652207000000001 2024-04-26T12:28:43.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965210+0000", 2024-04-26T12:28:43.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7832999999999997e-05 2024-04-26T12:28:43.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972675+0000", 2024-04-26T12:28:43.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074651450000000003 2024-04-26T12:28:43.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972696+0000", 2024-04-26T12:28:43.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0871999999999999e-05 2024-04-26T12:28:43.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972729+0000", 2024-04-26T12:28:43.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:28:43.262 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.262 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.262 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.262 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:306 3.13 3:ceffbd45:::200.0000000a:head [write 618844~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.262 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:43.262 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.268702895, 2024-04-26T12:28:43.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.04548866, 2024-04-26T12:28:43.262 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.262 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.262 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:43.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:43.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927298+0000", 2024-04-26T12:28:43.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927303+0000", 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6079999999999998e-06 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927310+0000", 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6240000000000002e-06 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927319+0000", 2024-04-26T12:28:43.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:28:43.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965791+0000", 2024-04-26T12:28:43.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038471350000000001 2024-04-26T12:28:43.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965839+0000", 2024-04-26T12:28:43.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8647999999999999e-05 2024-04-26T12:28:43.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972735+0000", 2024-04-26T12:28:43.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068952429999999997 2024-04-26T12:28:43.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972755+0000", 2024-04-26T12:28:43.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0219000000000001e-05 2024-04-26T12:28:43.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972787+0000", 2024-04-26T12:28:43.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2450000000000003e-05 2024-04-26T12:28:43.266 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.266 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.266 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:307 3.13 3:ceffbd45:::200.0000000a:head [write 621801~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.26865333000000002, 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.045498166, 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:43.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:43.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927351+0000", 2024-04-26T12:28:43.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7130000000000001e-06 2024-04-26T12:28:43.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927355+0000", 2024-04-26T12:28:43.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1339999999999997e-06 2024-04-26T12:28:43.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927358+0000", 2024-04-26T12:28:43.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:28:43.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966366+0000", 2024-04-26T12:28:43.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039008207000000003 2024-04-26T12:28:43.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966457+0000", 2024-04-26T12:28:43.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1144999999999996e-05 2024-04-26T12:28:43.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972792+0000", 2024-04-26T12:28:43.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0063344819999999998 2024-04-26T12:28:43.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972815+0000", 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3336000000000002e-05 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972846+0000", 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1504000000000002e-05 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:308 3.13 3:ceffbd45:::200.0000000a:head [write 623718~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:43.271 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.26697528500000001, 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043878271000000003, 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:43.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929042+0000", 2024-04-26T12:28:43.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6039e-05 2024-04-26T12:28:43.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929054+0000", 2024-04-26T12:28:43.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2275e-05 2024-04-26T12:28:43.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929063+0000", 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7150000000000004e-06 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967060+0000", 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037996907000000003 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967117+0000", 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7701999999999997e-05 2024-04-26T12:28:43.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972850+0000", 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0057332679999999997 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972872+0000", 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1138999999999999e-05 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972905+0000", 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2904999999999998e-05 2024-04-26T12:28:43.275 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.276 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.276 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.276 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:309 3.13 3:ceffbd45:::200.0000000a:head [write 638707~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.276 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:43.276 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.26615217400000002, 2024-04-26T12:28:43.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043114311000000002, 2024-04-26T12:28:43.276 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.276 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.276 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929853+0000", 2024-04-26T12:28:43.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2690000000000001e-06 2024-04-26T12:28:43.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929861+0000", 2024-04-26T12:28:43.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.515e-06 2024-04-26T12:28:43.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929867+0000", 2024-04-26T12:28:43.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4640000000000003e-06 2024-04-26T12:28:43.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967590+0000", 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037722506000000003 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967672+0000", 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2082000000000005e-05 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972908+0000", 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052366289999999996 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972929+0000", 2024-04-26T12:28:43.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0752999999999999e-05 2024-04-26T12:28:43.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972964+0000", 2024-04-26T12:28:43.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4666999999999999e-05 2024-04-26T12:28:43.280 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.280 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.280 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.280 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:310 3.13 3:ceffbd45:::200.0000000a:head [write 641140~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.280 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:43.281 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.266104901, 2024-04-26T12:28:43.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043126171999999997, 2024-04-26T12:28:43.281 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.281 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.281 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:43.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:43.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929896+0000", 2024-04-26T12:28:43.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929899+0000", 2024-04-26T12:28:43.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-04-26T12:28:43.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929903+0000", 2024-04-26T12:28:43.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.087e-06 2024-04-26T12:28:43.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929907+0000", 2024-04-26T12:28:43.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1480000000000002e-06 2024-04-26T12:28:43.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.969962+0000", 2024-04-26T12:28:43.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040055457000000003 2024-04-26T12:28:43.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970018+0000", 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6209999999999999e-05 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972968+0000", 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029501689999999999 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972989+0000", 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0618000000000001e-05 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.973023+0000", 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:312 3.13 3:ceffbd45:::200.0000000a:head [write 648907~1910 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.26077564600000003, 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039844011999999998, 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:43.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:43.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935225+0000", 2024-04-26T12:28:43.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935229+0000", 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1790000000000001e-06 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935235+0000", 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.716e-06 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935239+0000", 2024-04-26T12:28:43.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5379999999999998e-06 2024-04-26T12:28:43.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970917+0000", 2024-04-26T12:28:43.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035678223000000002 2024-04-26T12:28:43.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971006+0000", 2024-04-26T12:28:43.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9248999999999999e-05 2024-04-26T12:28:43.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.974984+0000", 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039776769999999998 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975031+0000", 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7500000000000003e-05 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975070+0000", 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8509e-05 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.290 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:313 3.13 3:ceffbd45:::200.0000000a:head [write 650817~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.290 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:43.290 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.26054931799999997, 2024-04-26T12:28:43.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040236782999999998, 2024-04-26T12:28:43.290 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:43.290 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.290 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:43.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:43.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:43.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:43.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:43.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:43.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:43.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935451+0000", 2024-04-26T12:28:43.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:43.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:43.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935457+0000", 2024-04-26T12:28:43.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5079999999999996e-06 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935467+0000", 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0407e-05 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935477+0000", 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3989999999999993e-06 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971691+0000", 2024-04-26T12:28:43.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036214534 2024-04-26T12:28:43.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:43.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971741+0000", 2024-04-26T12:28:43.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0294000000000003e-05 2024-04-26T12:28:43.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:43.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975619+0000", 2024-04-26T12:28:43.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038779259999999999 2024-04-26T12:28:43.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:43.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975647+0000", 2024-04-26T12:28:43.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:28:43.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:43.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:43.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:43.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975689+0000", 2024-04-26T12:28:43.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2055999999999998e-05 2024-04-26T12:28:43.294 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.294 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.294 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.294 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:43.294 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:43.294 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:43.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:43.296 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:43.295+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:43.397 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:43.395+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:43.424 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:43.424 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:43.424 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:43.425 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:43.434 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:43.518 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:43.517+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:43.599 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:43.598+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:43.600 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:43.600 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:43.600 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:43.600 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:43.600 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:43.610 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:43.700 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:43.699+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:43.779 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:43.779 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:43.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:43.779 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:43.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.779 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:43.779 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:43.779 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 110.52626623499999, 2024-04-26T12:28:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:43.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:43.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:43.784 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 110.525445316, 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:43.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:43.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:43.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:43.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:43.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:43.791 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.791 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.791 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.791 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 110.52541522600001, 2024-04-26T12:28:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:43.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:43.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 110.525361438, 2024-04-26T12:28:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:43.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:43.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:43.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:43.802 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 110.525308881, 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:43.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:43.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:43.808 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.808 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.808 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.808 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:43.808 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:43.808 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 110.52526866700001, 2024-04-26T12:28:43.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:43.808 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.808 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.808 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:43.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:43.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:43.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:43.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:43.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:43.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:43.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:43.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:43.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:43.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:43.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:43.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:43.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:43.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:43.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:43.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:43.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:43.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:43.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:43.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:43.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:43.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:43.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:43.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:43.813 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.813 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.813 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.814 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:43.814 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:43.814 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 110.525240506, 2024-04-26T12:28:43.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:43.814 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.814 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.814 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:43.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:43.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:43.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:43.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:43.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:43.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:43.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:43.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:43.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:43.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:43.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:43.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:43.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:43.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:43.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:43.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:43.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:43.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:43.819 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.819 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.819 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.819 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:43.819 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:43.819 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 110.525209817, 2024-04-26T12:28:43.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:43.819 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.819 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:43.819 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:43.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:43.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:43.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:43.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:43.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:43.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:43.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:43.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:43.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:43.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:43.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:43.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:43.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:43.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:43.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:43.823 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.823 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.823 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.823 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4519.0:4 4.32 e47/14 4:4def72d4:::10000000003.00000000:head v 47'2, mlcod=0'0)", 2024-04-26T12:28:43.823 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:43.823 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.490171547999999, 2024-04-26T12:28:43.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013679491, 2024-04-26T12:28:43.823 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286924+0000", 2024-04-26T12:28:43.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:43.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292324+0000", 2024-04-26T12:28:43.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054002099999999999 2024-04-26T12:28:43.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292346+0000", 2024-04-26T12:28:43.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1733e-05 2024-04-26T12:28:43.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292356+0000", 2024-04-26T12:28:43.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:28:43.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292409+0000", 2024-04-26T12:28:43.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3359000000000002e-05 2024-04-26T12:28:43.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292430+0000", 2024-04-26T12:28:43.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0140999999999999e-05 2024-04-26T12:28:43.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300546+0000", 2024-04-26T12:28:43.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081164429999999992 2024-04-26T12:28:43.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300604+0000", 2024-04-26T12:28:43.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8270000000000003e-05 2024-04-26T12:28:43.827 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.827 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.827 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:5 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.245993149, 2024-04-26T12:28:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015201111, 2024-04-26T12:28:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 5 2024-04-26T12:28:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:43.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:43.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531102+0000", 2024-04-26T12:28:43.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:43.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535869+0000", 2024-04-26T12:28:43.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047671199999999997 2024-04-26T12:28:43.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535886+0000", 2024-04-26T12:28:43.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6861e-05 2024-04-26T12:28:43.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535900+0000", 2024-04-26T12:28:43.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4457999999999999e-05 2024-04-26T12:28:43.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535985+0000", 2024-04-26T12:28:43.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4656999999999999e-05 2024-04-26T12:28:43.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.536103+0000", 2024-04-26T12:28:43.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118163 2024-04-26T12:28:43.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:43.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.536198+0000", 2024-04-26T12:28:43.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4840999999999995e-05 2024-04-26T12:28:43.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.539923+0000", 2024-04-26T12:28:43.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037246639999999999 2024-04-26T12:28:43.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:43.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546203+0000", 2024-04-26T12:28:43.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062805420000000001 2024-04-26T12:28:43.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546245+0000", 2024-04-26T12:28:43.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1270999999999998e-05 2024-04-26T12:28:43.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546304+0000", 2024-04-26T12:28:43.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9769999999999999e-05 2024-04-26T12:28:43.833 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.833 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.833 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.834 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:6 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:43.834 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:43.834 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.241177294, 2024-04-26T12:28:43.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021621960999999999, 2024-04-26T12:28:43.834 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.834 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.834 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:43.834 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:43.834 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:43.834 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 6 2024-04-26T12:28:43.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.834 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:43.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:43.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535918+0000", 2024-04-26T12:28:43.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:43.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547051+0000", 2024-04-26T12:28:43.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011132853999999999 2024-04-26T12:28:43.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547063+0000", 2024-04-26T12:28:43.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2113000000000001e-05 2024-04-26T12:28:43.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547086+0000", 2024-04-26T12:28:43.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3538000000000001e-05 2024-04-26T12:28:43.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547144+0000", 2024-04-26T12:28:43.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7284000000000002e-05 2024-04-26T12:28:43.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547289+0000", 2024-04-26T12:28:43.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014546900000000001 2024-04-26T12:28:43.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557445+0000", 2024-04-26T12:28:43.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010155717 2024-04-26T12:28:43.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557492+0000", 2024-04-26T12:28:43.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6749999999999998e-05 2024-04-26T12:28:43.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557541+0000", 2024-04-26T12:28:43.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9440000000000001e-05 2024-04-26T12:28:43.838 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.838 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.839 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.839 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:65 3.1b 3:ddb4e4d7:::200.00000002:head [write 2912462~997814 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-26T12:28:43.839 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:43.839 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.3391475889999995, 2024-04-26T12:28:43.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014884231, 2024-04-26T12:28:43.839 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.839 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.839 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:43.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:43.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437948+0000", 2024-04-26T12:28:43.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:43.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440692+0000", 2024-04-26T12:28:43.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027439579999999999 2024-04-26T12:28:43.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440720+0000", 2024-04-26T12:28:43.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8209999999999999e-05 2024-04-26T12:28:43.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440735+0000", 2024-04-26T12:28:43.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.554e-05 2024-04-26T12:28:43.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440839+0000", 2024-04-26T12:28:43.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001038 2024-04-26T12:28:43.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440895+0000", 2024-04-26T12:28:43.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6221000000000003e-05 2024-04-26T12:28:43.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:43.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440982+0000", 2024-04-26T12:28:43.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6556000000000003e-05 2024-04-26T12:28:43.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.443471+0000", 2024-04-26T12:28:43.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024888250000000001 2024-04-26T12:28:43.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:43.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452760+0000", 2024-04-26T12:28:43.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092887869999999997 2024-04-26T12:28:43.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452790+0000", 2024-04-26T12:28:43.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0267e-05 2024-04-26T12:28:43.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452833+0000", 2024-04-26T12:28:43.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3093999999999998e-05 2024-04-26T12:28:43.844 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.844 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.844 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.844 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:3891 4.14 4:2914052b:::100000012aa.00000000:head [write 0~1579] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:43.844 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:43.844 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.0791130290000002, 2024-04-26T12:28:43.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012921406, 2024-04-26T12:28:43.845 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.845 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.845 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:43.845 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:43.845 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:43.845 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 3891 2024-04-26T12:28:43.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.845 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:43.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:43.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:43.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:43.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697988+0000", 2024-04-26T12:28:43.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.395e-06 2024-04-26T12:28:43.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697994+0000", 2024-04-26T12:28:43.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1539999999999999e-06 2024-04-26T12:28:43.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697999+0000", 2024-04-26T12:28:43.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4569999999999998e-06 2024-04-26T12:28:43.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698025+0000", 2024-04-26T12:28:43.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6384e-05 2024-04-26T12:28:43.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698100+0000", 2024-04-26T12:28:43.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5340999999999996e-05 2024-04-26T12:28:43.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710785+0000", 2024-04-26T12:28:43.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012684755000000001 2024-04-26T12:28:43.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710834+0000", 2024-04-26T12:28:43.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8955000000000001e-05 2024-04-26T12:28:43.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710905+0000", 2024-04-26T12:28:43.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0754999999999996e-05 2024-04-26T12:28:43.849 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.849 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.849 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.849 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4057 4.10 4:0a22fc52:::1000000135a.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:43.849 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:43.849 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.9318266739999999, 2024-04-26T12:28:43.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021108387999999999, 2024-04-26T12:28:43.850 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.850 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.850 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:43.850 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:43.850 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:43.850 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4057 2024-04-26T12:28:43.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.850 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:43.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:43.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845269+0000", 2024-04-26T12:28:43.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:43.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845276+0000", 2024-04-26T12:28:43.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:28:43.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845286+0000", 2024-04-26T12:28:43.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0219e-05 2024-04-26T12:28:43.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845291+0000", 2024-04-26T12:28:43.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5840000000000002e-06 2024-04-26T12:28:43.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845325+0000", 2024-04-26T12:28:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3429000000000001e-05 2024-04-26T12:28:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845409+0000", 2024-04-26T12:28:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4529000000000003e-05 2024-04-26T12:28:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866264+0000", 2024-04-26T12:28:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020854731000000001 2024-04-26T12:28:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866305+0000", 2024-04-26T12:28:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0571000000000002e-05 2024-04-26T12:28:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866378+0000", 2024-04-26T12:28:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3447000000000003e-05 2024-04-26T12:28:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4064 4.3b 4:de2f294e:::10000001361.00000000:head [write 0~127] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:43.854 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.9259086310000004, 2024-04-26T12:28:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014714163000000001, 2024-04-26T12:28:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4064 2024-04-26T12:28:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:43.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:43.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851187+0000", 2024-04-26T12:28:43.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851193+0000", 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5999999999999997e-06 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851204+0000", 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1172000000000001e-05 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851211+0000", 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6750000000000002e-06 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851254+0000", 2024-04-26T12:28:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2919e-05 2024-04-26T12:28:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851384+0000", 2024-04-26T12:28:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130013 2024-04-26T12:28:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865803+0000", 2024-04-26T12:28:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014418343 2024-04-26T12:28:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865857+0000", 2024-04-26T12:28:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4567000000000001e-05 2024-04-26T12:28:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865902+0000", 2024-04-26T12:28:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4576999999999997e-05 2024-04-26T12:28:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4065 4.3f 4:fea32a34:::10000001362.00000000:head [write 0~290] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.9250814300000005, 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013949731, 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4065 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:43.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:43.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852014+0000", 2024-04-26T12:28:43.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852018+0000", 2024-04-26T12:28:43.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7890000000000001e-06 2024-04-26T12:28:43.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852025+0000", 2024-04-26T12:28:43.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8750000000000002e-06 2024-04-26T12:28:43.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852029+0000", 2024-04-26T12:28:43.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0999999999999997e-06 2024-04-26T12:28:43.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852083+0000", 2024-04-26T12:28:43.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000001e-05 2024-04-26T12:28:43.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852161+0000", 2024-04-26T12:28:43.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7577000000000006e-05 2024-04-26T12:28:43.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865845+0000", 2024-04-26T12:28:43.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013684405 2024-04-26T12:28:43.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865890+0000", 2024-04-26T12:28:43.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5209e-05 2024-04-26T12:28:43.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865965+0000", 2024-04-26T12:28:43.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4345999999999996e-05 2024-04-26T12:28:43.864 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.864 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.864 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.865 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4066 4.1d 4:b9ed4029:::10000001363.00000000:head [write 0~133] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:43.865 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:43.865 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.9242839739999997, 2024-04-26T12:28:43.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013115296, 2024-04-26T12:28:43.865 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.865 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.865 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:43.865 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:43.865 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:43.865 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4066 2024-04-26T12:28:43.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.865 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:43.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:43.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:43.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:43.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852816+0000", 2024-04-26T12:28:43.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:28:43.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852824+0000", 2024-04-26T12:28:43.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.994e-06 2024-04-26T12:28:43.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852831+0000", 2024-04-26T12:28:43.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0600000000000002e-06 2024-04-26T12:28:43.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852858+0000", 2024-04-26T12:28:43.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6605e-05 2024-04-26T12:28:43.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852932+0000", 2024-04-26T12:28:43.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4052000000000002e-05 2024-04-26T12:28:43.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:43.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853007+0000", 2024-04-26T12:28:43.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5580000000000005e-05 2024-04-26T12:28:43.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:43.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.857934+0000", 2024-04-26T12:28:43.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049264030000000002 2024-04-26T12:28:43.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865834+0000", 2024-04-26T12:28:43.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079004829999999998 2024-04-26T12:28:43.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865883+0000", 2024-04-26T12:28:43.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8723000000000001e-05 2024-04-26T12:28:43.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865928+0000", 2024-04-26T12:28:43.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4904999999999998e-05 2024-04-26T12:28:43.870 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.870 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.870 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4067 4.15 4:a8b5213c:::10000001364.00000000:head [write 0~261] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.9234581039999998, 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012718304, 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4067 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:43.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:43.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:43.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:43.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853641+0000", 2024-04-26T12:28:43.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4620000000000001e-06 2024-04-26T12:28:43.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853649+0000", 2024-04-26T12:28:43.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6469999999999998e-06 2024-04-26T12:28:43.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853655+0000", 2024-04-26T12:28:43.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5699999999999998e-06 2024-04-26T12:28:43.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853681+0000", 2024-04-26T12:28:43.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6152999999999998e-05 2024-04-26T12:28:43.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853763+0000", 2024-04-26T12:28:43.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1656999999999994e-05 2024-04-26T12:28:43.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866245+0000", 2024-04-26T12:28:43.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012482304 2024-04-26T12:28:43.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866279+0000", 2024-04-26T12:28:43.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3942999999999997e-05 2024-04-26T12:28:43.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866357+0000", 2024-04-26T12:28:43.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7151999999999996e-05 2024-04-26T12:28:43.875 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.875 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.876 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.876 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:159 3.1d 3:bec1251c:::200.00000007:head [write 1564232~2630072 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-26T12:28:43.876 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:40.228490+0000", 2024-04-26T12:28:43.876 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.54860635, 2024-04-26T12:28:43.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012297483, 2024-04-26T12:28:43.876 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.876 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.876 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.228490+0000", 2024-04-26T12:28:43.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.228490+0000", 2024-04-26T12:28:43.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.228487+0000", 2024-04-26T12:28:43.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999971 2024-04-26T12:28:43.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.230961+0000", 2024-04-26T12:28:43.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002473538 2024-04-26T12:28:43.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.230969+0000", 2024-04-26T12:28:43.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5890000000000003e-06 2024-04-26T12:28:43.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.230975+0000", 2024-04-26T12:28:43.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7259999999999999e-06 2024-04-26T12:28:43.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.231008+0000", 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3081999999999999e-05 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.231054+0000", 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5917000000000001e-05 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.231123+0000", 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9307999999999994e-05 2024-04-26T12:28:43.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.236736+0000", 2024-04-26T12:28:43.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056120759999999997 2024-04-26T12:28:43.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:43.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.240734+0000", 2024-04-26T12:28:43.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039984310000000002 2024-04-26T12:28:43.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.240766+0000", 2024-04-26T12:28:43.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1921999999999997e-05 2024-04-26T12:28:43.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.240787+0000", 2024-04-26T12:28:43.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1600999999999999e-05 2024-04-26T12:28:43.881 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.881 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.881 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.881 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:232 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:43.881 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:42.925026+0000", 2024-04-26T12:28:43.881 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.85207058999999996, 2024-04-26T12:28:43.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027270579999999999, 2024-04-26T12:28:43.882 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:43.882 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:43.882 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:43.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:43.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925026+0000", 2024-04-26T12:28:43.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:43.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925026+0000", 2024-04-26T12:28:43.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:43.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:43.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925024+0000", 2024-04-26T12:28:43.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999976 2024-04-26T12:28:43.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:43.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925406+0000", 2024-04-26T12:28:43.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038199600000000001 2024-04-26T12:28:43.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:43.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925417+0000", 2024-04-26T12:28:43.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1904e-05 2024-04-26T12:28:43.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:43.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925426+0000", 2024-04-26T12:28:43.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1820000000000006e-06 2024-04-26T12:28:43.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:43.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925464+0000", 2024-04-26T12:28:43.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689000000000002e-05 2024-04-26T12:28:43.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:43.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925522+0000", 2024-04-26T12:28:43.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7370000000000001e-05 2024-04-26T12:28:43.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:43.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.934737+0000", 2024-04-26T12:28:43.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.009215361 2024-04-26T12:28:43.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:43.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.949281+0000", 2024-04-26T12:28:43.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014543762999999999 2024-04-26T12:28:43.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:43.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.952211+0000", 2024-04-26T12:28:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029305860000000002 2024-04-26T12:28:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.952245+0000", 2024-04-26T12:28:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3083000000000002e-05 2024-04-26T12:28:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.952296+0000", 2024-04-26T12:28:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1808999999999998e-05 2024-04-26T12:28:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.886 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.887 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:43.887 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:43.887 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:43.888 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:43.886+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:43.888 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:43.989 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:43.987+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:44.017 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:44.017 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:44.017 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:44.017 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:44.027 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:44.090 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:44.089+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:44.153 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:44.153 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:44.163 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:44.206 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:44.205+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:44.292 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:44.291+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:44.295 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:44.295 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:44.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:44.296 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:44.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.296 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:293 3.13 3:ceffbd45:::200.0000000a:head [write 594763~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.296 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:44.296 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.3689790399999999, 2024-04-26T12:28:44.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038803585000000002, 2024-04-26T12:28:44.296 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.296 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.296 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:44.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:44.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924874+0000", 2024-04-26T12:28:44.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924877+0000", 2024-04-26T12:28:44.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7329999999999999e-06 2024-04-26T12:28:44.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924884+0000", 2024-04-26T12:28:44.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:28:44.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924890+0000", 2024-04-26T12:28:44.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:28:44.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958764+0000", 2024-04-26T12:28:44.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.033873863999999997 2024-04-26T12:28:44.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958855+0000", 2024-04-26T12:28:44.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1402000000000003e-05 2024-04-26T12:28:44.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963608+0000", 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047529039999999996 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963636+0000", 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8194000000000001e-05 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963678+0000", 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2095999999999998e-05 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.301 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:294 3.13 3:ceffbd45:::200.0000000a:head [write 596172~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.301 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:44.301 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.3689342959999999, 2024-04-26T12:28:44.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041225228000000003, 2024-04-26T12:28:44.301 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.301 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.301 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:44.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:44.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924919+0000", 2024-04-26T12:28:44.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924922+0000", 2024-04-26T12:28:44.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9160000000000001e-06 2024-04-26T12:28:44.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924928+0000", 2024-04-26T12:28:44.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3929999999999996e-06 2024-04-26T12:28:44.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924933+0000", 2024-04-26T12:28:44.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7820000000000001e-06 2024-04-26T12:28:44.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959359+0000", 2024-04-26T12:28:44.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034425782000000002 2024-04-26T12:28:44.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959439+0000", 2024-04-26T12:28:44.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0275e-05 2024-04-26T12:28:44.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966079+0000", 2024-04-26T12:28:44.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0066397089999999997 2024-04-26T12:28:44.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966106+0000", 2024-04-26T12:28:44.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7178e-05 2024-04-26T12:28:44.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966145+0000", 2024-04-26T12:28:44.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8618999999999997e-05 2024-04-26T12:28:44.305 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.305 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.305 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.305 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:295 3.13 3:ceffbd45:::200.0000000a:head [write 597574~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.305 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:44.305 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.3689081459999999, 2024-04-26T12:28:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041258571000000001, 2024-04-26T12:28:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924945+0000", 2024-04-26T12:28:44.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924948+0000", 2024-04-26T12:28:44.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:28:44.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924955+0000", 2024-04-26T12:28:44.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4629999999999998e-06 2024-04-26T12:28:44.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924959+0000", 2024-04-26T12:28:44.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2719999999999999e-06 2024-04-26T12:28:44.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959957+0000", 2024-04-26T12:28:44.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034997588000000003 2024-04-26T12:28:44.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960042+0000", 2024-04-26T12:28:44.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5811999999999998e-05 2024-04-26T12:28:44.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966149+0000", 2024-04-26T12:28:44.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061071650000000003 2024-04-26T12:28:44.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966171+0000", 2024-04-26T12:28:44.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1905000000000001e-05 2024-04-26T12:28:44.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966204+0000", 2024-04-26T12:28:44.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2845999999999997e-05 2024-04-26T12:28:44.310 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.310 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.310 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.310 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:296 3.13 3:ceffbd45:::200.0000000a:head [write 598977~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.311 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:44.311 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.368876516, 2024-04-26T12:28:44.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041282538000000001, 2024-04-26T12:28:44.311 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.311 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.311 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:44.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:44.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:44.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:44.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924979+0000", 2024-04-26T12:28:44.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3609999999999999e-06 2024-04-26T12:28:44.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924984+0000", 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3259999999999997e-06 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924987+0000", 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7810000000000001e-06 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960618+0000", 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035631875 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960698+0000", 2024-04-26T12:28:44.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9373000000000001e-05 2024-04-26T12:28:44.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966208+0000", 2024-04-26T12:28:44.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055104359999999996 2024-04-26T12:28:44.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966228+0000", 2024-04-26T12:28:44.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0208e-05 2024-04-26T12:28:44.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966260+0000", 2024-04-26T12:28:44.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1404e-05 2024-04-26T12:28:44.315 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.315 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.315 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.315 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:297 3.13 3:ceffbd45:::200.0000000a:head [write 600380~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.315 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:44.315 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.3688396819999999, 2024-04-26T12:28:44.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041309850000000002, 2024-04-26T12:28:44.315 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:44.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925017+0000", 2024-04-26T12:28:44.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.96e-06 2024-04-26T12:28:44.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925020+0000", 2024-04-26T12:28:44.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6629999999999999e-06 2024-04-26T12:28:44.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925023+0000", 2024-04-26T12:28:44.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:28:44.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961241+0000", 2024-04-26T12:28:44.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036217390000000002 2024-04-26T12:28:44.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961335+0000", 2024-04-26T12:28:44.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4537000000000006e-05 2024-04-26T12:28:44.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966264+0000", 2024-04-26T12:28:44.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004928516 2024-04-26T12:28:44.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966290+0000", 2024-04-26T12:28:44.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5658999999999999e-05 2024-04-26T12:28:44.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966324+0000", 2024-04-26T12:28:44.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4459000000000003e-05 2024-04-26T12:28:44.319 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.320 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.320 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.320 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:298 3.13 3:ceffbd45:::200.0000000a:head [write 602634~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.320 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:44.320 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.368807087, 2024-04-26T12:28:44.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046387536, 2024-04-26T12:28:44.320 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.320 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.320 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925046+0000", 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925049+0000", 2024-04-26T12:28:44.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4770000000000002e-06 2024-04-26T12:28:44.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925057+0000", 2024-04-26T12:28:44.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9219999999999997e-06 2024-04-26T12:28:44.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925062+0000", 2024-04-26T12:28:44.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:28:44.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961918+0000", 2024-04-26T12:28:44.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036856170000000001 2024-04-26T12:28:44.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962014+0000", 2024-04-26T12:28:44.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6731999999999995e-05 2024-04-26T12:28:44.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971360+0000", 2024-04-26T12:28:44.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0093454569999999997 2024-04-26T12:28:44.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971393+0000", 2024-04-26T12:28:44.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3130999999999998e-05 2024-04-26T12:28:44.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971434+0000", 2024-04-26T12:28:44.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1244e-05 2024-04-26T12:28:44.324 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.324 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.324 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.325 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:299 3.13 3:ceffbd45:::200.0000000a:head [write 604033~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.325 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:44.325 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.368753256, 2024-04-26T12:28:44.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046395615000000001, 2024-04-26T12:28:44.325 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.325 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.325 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:44.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925100+0000", 2024-04-26T12:28:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925103+0000", 2024-04-26T12:28:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3520000000000001e-06 2024-04-26T12:28:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925108+0000", 2024-04-26T12:28:44.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6489999999999996e-06 2024-04-26T12:28:44.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925111+0000", 2024-04-26T12:28:44.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.79e-06 2024-04-26T12:28:44.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962405+0000", 2024-04-26T12:28:44.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037293953999999997 2024-04-26T12:28:44.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962457+0000", 2024-04-26T12:28:44.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2003000000000003e-05 2024-04-26T12:28:44.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971440+0000", 2024-04-26T12:28:44.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0089831719999999993 2024-04-26T12:28:44.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971463+0000", 2024-04-26T12:28:44.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3201e-05 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971496+0000", 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2836000000000002e-05 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:300 3.13 3:ceffbd45:::200.0000000a:head [write 605436~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.3686893979999999, 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046389606999999999, 2024-04-26T12:28:44.329 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.330 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.330 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:44.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:44.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:44.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925167+0000", 2024-04-26T12:28:44.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8870000000000001e-06 2024-04-26T12:28:44.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925171+0000", 2024-04-26T12:28:44.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6049999999999998e-06 2024-04-26T12:28:44.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925173+0000", 2024-04-26T12:28:44.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8250000000000001e-06 2024-04-26T12:28:44.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962740+0000", 2024-04-26T12:28:44.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037566436000000002 2024-04-26T12:28:44.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962818+0000", 2024-04-26T12:28:44.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8231000000000004e-05 2024-04-26T12:28:44.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971501+0000", 2024-04-26T12:28:44.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008682525 2024-04-26T12:28:44.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971522+0000", 2024-04-26T12:28:44.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1673999999999999e-05 2024-04-26T12:28:44.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971554+0000", 2024-04-26T12:28:44.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1786999999999999e-05 2024-04-26T12:28:44.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.334 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.334 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:301 3.13 3:ceffbd45:::200.0000000a:head [write 606838~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.334 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:44.334 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.36867279, 2024-04-26T12:28:44.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046429455000000001, 2024-04-26T12:28:44.334 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.334 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.335 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:44.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:44.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925183+0000", 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0150000000000002e-06 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925186+0000", 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2210000000000002e-06 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925190+0000", 2024-04-26T12:28:44.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8489999999999999e-06 2024-04-26T12:28:44.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963304+0000", 2024-04-26T12:28:44.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038114207999999997 2024-04-26T12:28:44.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963356+0000", 2024-04-26T12:28:44.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1628000000000001e-05 2024-04-26T12:28:44.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971558+0000", 2024-04-26T12:28:44.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082025199999999996 2024-04-26T12:28:44.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971579+0000", 2024-04-26T12:28:44.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1019e-05 2024-04-26T12:28:44.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971610+0000", 2024-04-26T12:28:44.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1205999999999999e-05 2024-04-26T12:28:44.338 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:302 3.13 3:ceffbd45:::200.0000000a:head [write 608236~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.3686515969999999, 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046464057000000003, 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:44.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:44.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:44.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925204+0000", 2024-04-26T12:28:44.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1270000000000001e-06 2024-04-26T12:28:44.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925207+0000", 2024-04-26T12:28:44.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3720000000000001e-06 2024-04-26T12:28:44.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925210+0000", 2024-04-26T12:28:44.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7489999999999999e-06 2024-04-26T12:28:44.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963713+0000", 2024-04-26T12:28:44.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038502508999999997 2024-04-26T12:28:44.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963792+0000", 2024-04-26T12:28:44.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9087999999999999e-05 2024-04-26T12:28:44.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971615+0000", 2024-04-26T12:28:44.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078230130000000002 2024-04-26T12:28:44.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971636+0000", 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0996999999999999e-05 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971666+0000", 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0443999999999999e-05 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:303 3.13 3:ceffbd45:::200.0000000a:head [write 609649~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.343 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:44.344 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.368608576, 2024-04-26T12:28:44.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.047363031, 2024-04-26T12:28:44.344 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.344 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.344 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:44.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:44.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:44.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925253+0000", 2024-04-26T12:28:44.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0369999999999995e-06 2024-04-26T12:28:44.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925261+0000", 2024-04-26T12:28:44.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7420000000000003e-06 2024-04-26T12:28:44.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925271+0000", 2024-04-26T12:28:44.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1589999999999999e-06 2024-04-26T12:28:44.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964198+0000", 2024-04-26T12:28:44.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038927182999999997 2024-04-26T12:28:44.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964281+0000", 2024-04-26T12:28:44.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3355000000000004e-05 2024-04-26T12:28:44.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972542+0000", 2024-04-26T12:28:44.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082607930000000006 2024-04-26T12:28:44.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972570+0000", 2024-04-26T12:28:44.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7937999999999999e-05 2024-04-26T12:28:44.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972608+0000", 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8384999999999999e-05 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:304 3.13 3:ceffbd45:::200.0000000a:head [write 611057~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.367442947, 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046259867000000003, 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.348 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:44.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:44.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926410+0000", 2024-04-26T12:28:44.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926415+0000", 2024-04-26T12:28:44.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7999999999999998e-06 2024-04-26T12:28:44.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926423+0000", 2024-04-26T12:28:44.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8569999999999995e-06 2024-04-26T12:28:44.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926429+0000", 2024-04-26T12:28:44.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.421e-06 2024-04-26T12:28:44.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964778+0000", 2024-04-26T12:28:44.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038349045999999998 2024-04-26T12:28:44.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964830+0000", 2024-04-26T12:28:44.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1309e-05 2024-04-26T12:28:44.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972614+0000", 2024-04-26T12:28:44.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077847070000000001 2024-04-26T12:28:44.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972638+0000", 2024-04-26T12:28:44.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3388999999999999e-05 2024-04-26T12:28:44.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972671+0000", 2024-04-26T12:28:44.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2999e-05 2024-04-26T12:28:44.358 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.358 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.358 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.359 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:305 3.13 3:ceffbd45:::200.0000000a:head [write 613824~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.359 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:44.359 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.3673979080000001, 2024-04-26T12:28:44.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046273460000000002, 2024-04-26T12:28:44.359 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.359 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.359 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:44.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:44.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:44.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926463+0000", 2024-04-26T12:28:44.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:28:44.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926467+0000", 2024-04-26T12:28:44.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3000000000000003e-06 2024-04-26T12:28:44.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926470+0000", 2024-04-26T12:28:44.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1930000000000002e-06 2024-04-26T12:28:44.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965122+0000", 2024-04-26T12:28:44.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038652207000000001 2024-04-26T12:28:44.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965210+0000", 2024-04-26T12:28:44.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7832999999999997e-05 2024-04-26T12:28:44.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972675+0000", 2024-04-26T12:28:44.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074651450000000003 2024-04-26T12:28:44.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972696+0000", 2024-04-26T12:28:44.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0871999999999999e-05 2024-04-26T12:28:44.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972729+0000", 2024-04-26T12:28:44.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:28:44.363 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.363 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.363 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.363 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:306 3.13 3:ceffbd45:::200.0000000a:head [write 618844~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.363 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:44.363 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.3665551630000001, 2024-04-26T12:28:44.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.04548866, 2024-04-26T12:28:44.364 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.364 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.364 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:44.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:44.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927298+0000", 2024-04-26T12:28:44.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927303+0000", 2024-04-26T12:28:44.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6079999999999998e-06 2024-04-26T12:28:44.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927310+0000", 2024-04-26T12:28:44.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6240000000000002e-06 2024-04-26T12:28:44.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927319+0000", 2024-04-26T12:28:44.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:28:44.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965791+0000", 2024-04-26T12:28:44.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038471350000000001 2024-04-26T12:28:44.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965839+0000", 2024-04-26T12:28:44.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8647999999999999e-05 2024-04-26T12:28:44.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972735+0000", 2024-04-26T12:28:44.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068952429999999997 2024-04-26T12:28:44.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972755+0000", 2024-04-26T12:28:44.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0219000000000001e-05 2024-04-26T12:28:44.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972787+0000", 2024-04-26T12:28:44.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2450000000000003e-05 2024-04-26T12:28:44.372 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.372 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.372 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.372 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:307 3.13 3:ceffbd45:::200.0000000a:head [write 621801~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.372 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:44.373 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.366505598, 2024-04-26T12:28:44.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.045498166, 2024-04-26T12:28:44.373 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.373 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.373 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:44.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:44.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:44.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927351+0000", 2024-04-26T12:28:44.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7130000000000001e-06 2024-04-26T12:28:44.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927355+0000", 2024-04-26T12:28:44.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1339999999999997e-06 2024-04-26T12:28:44.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927358+0000", 2024-04-26T12:28:44.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:28:44.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966366+0000", 2024-04-26T12:28:44.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039008207000000003 2024-04-26T12:28:44.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966457+0000", 2024-04-26T12:28:44.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1144999999999996e-05 2024-04-26T12:28:44.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972792+0000", 2024-04-26T12:28:44.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0063344819999999998 2024-04-26T12:28:44.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972815+0000", 2024-04-26T12:28:44.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3336000000000002e-05 2024-04-26T12:28:44.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972846+0000", 2024-04-26T12:28:44.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1504000000000002e-05 2024-04-26T12:28:44.377 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.377 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.377 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.377 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:308 3.13 3:ceffbd45:::200.0000000a:head [write 623718~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.377 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:44.377 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.364827553, 2024-04-26T12:28:44.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043878271000000003, 2024-04-26T12:28:44.378 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.378 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.378 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:44.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:44.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:44.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929042+0000", 2024-04-26T12:28:44.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6039e-05 2024-04-26T12:28:44.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929054+0000", 2024-04-26T12:28:44.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2275e-05 2024-04-26T12:28:44.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929063+0000", 2024-04-26T12:28:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7150000000000004e-06 2024-04-26T12:28:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967060+0000", 2024-04-26T12:28:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037996907000000003 2024-04-26T12:28:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967117+0000", 2024-04-26T12:28:44.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7701999999999997e-05 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972850+0000", 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0057332679999999997 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972872+0000", 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1138999999999999e-05 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972905+0000", 2024-04-26T12:28:44.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2904999999999998e-05 2024-04-26T12:28:44.382 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.382 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.382 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.382 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:309 3.13 3:ceffbd45:::200.0000000a:head [write 638707~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.382 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:44.382 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.3640044419999999, 2024-04-26T12:28:44.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043114311000000002, 2024-04-26T12:28:44.382 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.382 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.382 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:44.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:44.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:44.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929853+0000", 2024-04-26T12:28:44.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2690000000000001e-06 2024-04-26T12:28:44.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929861+0000", 2024-04-26T12:28:44.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.515e-06 2024-04-26T12:28:44.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929867+0000", 2024-04-26T12:28:44.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4640000000000003e-06 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967590+0000", 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037722506000000003 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967672+0000", 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2082000000000005e-05 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972908+0000", 2024-04-26T12:28:44.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052366289999999996 2024-04-26T12:28:44.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972929+0000", 2024-04-26T12:28:44.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0752999999999999e-05 2024-04-26T12:28:44.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972964+0000", 2024-04-26T12:28:44.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4666999999999999e-05 2024-04-26T12:28:44.386 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.386 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.386 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.387 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:310 3.13 3:ceffbd45:::200.0000000a:head [write 641140~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.387 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:44.387 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.3639571690000001, 2024-04-26T12:28:44.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043126171999999997, 2024-04-26T12:28:44.387 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.387 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.387 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:44.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:44.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929896+0000", 2024-04-26T12:28:44.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929899+0000", 2024-04-26T12:28:44.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-04-26T12:28:44.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929903+0000", 2024-04-26T12:28:44.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.087e-06 2024-04-26T12:28:44.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929907+0000", 2024-04-26T12:28:44.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1480000000000002e-06 2024-04-26T12:28:44.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.969962+0000", 2024-04-26T12:28:44.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040055457000000003 2024-04-26T12:28:44.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970018+0000", 2024-04-26T12:28:44.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6209999999999999e-05 2024-04-26T12:28:44.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972968+0000", 2024-04-26T12:28:44.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029501689999999999 2024-04-26T12:28:44.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972989+0000", 2024-04-26T12:28:44.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0618000000000001e-05 2024-04-26T12:28:44.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.973023+0000", 2024-04-26T12:28:44.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-26T12:28:44.391 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.391 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.391 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.391 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:312 3.13 3:ceffbd45:::200.0000000a:head [write 648907~1910 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.392 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:44.392 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.3586279139999999, 2024-04-26T12:28:44.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039844011999999998, 2024-04-26T12:28:44.392 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.392 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.392 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:44.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:44.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935225+0000", 2024-04-26T12:28:44.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935229+0000", 2024-04-26T12:28:44.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1790000000000001e-06 2024-04-26T12:28:44.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935235+0000", 2024-04-26T12:28:44.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.716e-06 2024-04-26T12:28:44.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935239+0000", 2024-04-26T12:28:44.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5379999999999998e-06 2024-04-26T12:28:44.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970917+0000", 2024-04-26T12:28:44.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035678223000000002 2024-04-26T12:28:44.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971006+0000", 2024-04-26T12:28:44.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9248999999999999e-05 2024-04-26T12:28:44.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.974984+0000", 2024-04-26T12:28:44.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039776769999999998 2024-04-26T12:28:44.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975031+0000", 2024-04-26T12:28:44.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7500000000000003e-05 2024-04-26T12:28:44.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975070+0000", 2024-04-26T12:28:44.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8509e-05 2024-04-26T12:28:44.396 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.396 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.396 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.396 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:313 3.13 3:ceffbd45:::200.0000000a:head [write 650817~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.396 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:44.396 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 1.358401586, 2024-04-26T12:28:44.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040236782999999998, 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:44.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935451+0000", 2024-04-26T12:28:44.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:44.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:44.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935457+0000", 2024-04-26T12:28:44.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5079999999999996e-06 2024-04-26T12:28:44.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:44.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935467+0000", 2024-04-26T12:28:44.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0407e-05 2024-04-26T12:28:44.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935477+0000", 2024-04-26T12:28:44.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3989999999999993e-06 2024-04-26T12:28:44.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:44.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971691+0000", 2024-04-26T12:28:44.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036214534 2024-04-26T12:28:44.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:44.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971741+0000", 2024-04-26T12:28:44.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0294000000000003e-05 2024-04-26T12:28:44.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:44.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975619+0000", 2024-04-26T12:28:44.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038779259999999999 2024-04-26T12:28:44.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:44.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975647+0000", 2024-04-26T12:28:44.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:28:44.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:44.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:44.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:44.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975689+0000", 2024-04-26T12:28:44.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2055999999999998e-05 2024-04-26T12:28:44.401 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.401 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.401 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.401 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:44.401 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:44.401 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:44.402 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:44.401+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:44.403 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:44.504 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:44.503+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:44.531 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:44.531 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:44.531 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:44.531 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:44.542 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:44.606 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:44.604+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:44.682 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:44.683 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:44.683 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:44.683 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:44.683 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:44.698 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:44.739 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:28:44.742 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:44.740+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:44.808 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:44.806+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:44.827 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:28:44.871 INFO:tasks.workunit.client.0.smithi046.stdout:7/57: sync 2024-04-26T12:28:44.872 INFO:tasks.workunit.client.0.smithi046.stdout:6/6: sync 2024-04-26T12:28:44.872 INFO:tasks.workunit.client.0.smithi046.stdout:2/75: sync 2024-04-26T12:28:44.872 INFO:tasks.workunit.client.0.smithi046.stdout:5/17: sync 2024-04-26T12:28:44.872 INFO:tasks.workunit.client.0.smithi046.stdout:0/65: sync 2024-04-26T12:28:44.872 INFO:tasks.workunit.client.0.smithi046.stdout:4/9: sync 2024-04-26T12:28:44.873 INFO:tasks.workunit.client.0.smithi046.stdout:8/19: sync 2024-04-26T12:28:44.873 INFO:tasks.workunit.client.0.smithi046.stdout:9/9: sync 2024-04-26T12:28:44.873 INFO:tasks.workunit.client.0.smithi046.stdout:1/4: sync 2024-04-26T12:28:44.873 INFO:tasks.workunit.client.0.smithi046.stdout:1/5: dread - no filename 2024-04-26T12:28:44.873 INFO:tasks.workunit.client.0.smithi046.stdout:3/12: sync 2024-04-26T12:28:44.873 INFO:tasks.workunit.client.0.smithi046.stdout:3/13: dread - no filename 2024-04-26T12:28:44.873 INFO:tasks.workunit.client.0.smithi046.stdout:9/10: chown d0 257015210 1 2024-04-26T12:28:44.874 INFO:tasks.workunit.client.0.smithi046.stdout:5/18: truncate f2 2406136 0 2024-04-26T12:28:44.874 INFO:tasks.workunit.client.0.smithi046.stdout:2/76: chown d1/de/c12 1988 1 2024-04-26T12:28:44.874 INFO:tasks.workunit.client.0.smithi046.stdout:5/19: dread - f5 zero size 2024-04-26T12:28:44.877 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:44.877 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:44.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:44.877 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:44.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.877 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:44.878 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:44.878 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 111.617939632, 2024-04-26T12:28:44.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:44.878 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.878 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.878 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:44.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:44.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:44.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:44.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:44.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:44.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:44.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:44.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:44.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:44.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:44.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:44.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:44.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:44.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:44.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:44.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:44.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:44.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:44.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:44.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:44.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:44.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:44.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:44.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:44.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:44.889 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 111.617118713, 2024-04-26T12:28:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:44.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:44.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 111.617088623, 2024-04-26T12:28:44.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:44.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 111.617034835, 2024-04-26T12:28:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:44.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:44.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:44.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 111.61698227799999, 2024-04-26T12:28:44.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.911 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 111.616942064, 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:44.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.916 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 111.616913903, 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:44.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:44.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:44.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:44.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:31 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 111.616883214, 2024-04-26T12:28:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012939166, 2024-04-26T12:28:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251887+0000", 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251886+0000", 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251889+0000", 2024-04-26T12:28:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3859999999999999e-06 2024-04-26T12:28:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251895+0000", 2024-04-26T12:28:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2609999999999999e-06 2024-04-26T12:28:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251902+0000", 2024-04-26T12:28:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2400000000000004e-06 2024-04-26T12:28:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251950+0000", 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8541000000000002e-05 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252080+0000", 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129524 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264826+0000", 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012745942999999999 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.925 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4519.0:4 4.32 e47/14 4:4def72d4:::10000000003.00000000:head v 47'2, mlcod=0'0)", 2024-04-26T12:28:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.581844945, 2024-04-26T12:28:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013679491, 2024-04-26T12:28:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286924+0000", 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292324+0000", 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054002099999999999 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292346+0000", 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1733e-05 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292356+0000", 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292409+0000", 2024-04-26T12:28:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3359000000000002e-05 2024-04-26T12:28:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292430+0000", 2024-04-26T12:28:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0140999999999999e-05 2024-04-26T12:28:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300546+0000", 2024-04-26T12:28:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081164429999999992 2024-04-26T12:28:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300604+0000", 2024-04-26T12:28:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8270000000000003e-05 2024-04-26T12:28:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:5 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.337666545999999, 2024-04-26T12:28:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015201111, 2024-04-26T12:28:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.930 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 5 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531102+0000", 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535869+0000", 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047671199999999997 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535886+0000", 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6861e-05 2024-04-26T12:28:44.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535900+0000", 2024-04-26T12:28:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4457999999999999e-05 2024-04-26T12:28:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535985+0000", 2024-04-26T12:28:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4656999999999999e-05 2024-04-26T12:28:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.536103+0000", 2024-04-26T12:28:44.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118163 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.536198+0000", 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4840999999999995e-05 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.539923+0000", 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037246639999999999 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546203+0000", 2024-04-26T12:28:44.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062805420000000001 2024-04-26T12:28:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546245+0000", 2024-04-26T12:28:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1270999999999998e-05 2024-04-26T12:28:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546304+0000", 2024-04-26T12:28:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9769999999999999e-05 2024-04-26T12:28:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:6 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.332850691000001, 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021621960999999999, 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 6 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535918+0000", 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547051+0000", 2024-04-26T12:28:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011132853999999999 2024-04-26T12:28:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547063+0000", 2024-04-26T12:28:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2113000000000001e-05 2024-04-26T12:28:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547086+0000", 2024-04-26T12:28:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3538000000000001e-05 2024-04-26T12:28:44.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547144+0000", 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7284000000000002e-05 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547289+0000", 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014546900000000001 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557445+0000", 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010155717 2024-04-26T12:28:44.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557492+0000", 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6749999999999998e-05 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557541+0000", 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9440000000000001e-05 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.940 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:65 3.1b 3:ddb4e4d7:::200.00000002:head [write 2912462~997814 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-26T12:28:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.430820986000001, 2024-04-26T12:28:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014884231, 2024-04-26T12:28:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437948+0000", 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440692+0000", 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027439579999999999 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440720+0000", 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8209999999999999e-05 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440735+0000", 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.554e-05 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440839+0000", 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001038 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440895+0000", 2024-04-26T12:28:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6221000000000003e-05 2024-04-26T12:28:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440982+0000", 2024-04-26T12:28:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6556000000000003e-05 2024-04-26T12:28:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.443471+0000", 2024-04-26T12:28:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024888250000000001 2024-04-26T12:28:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452760+0000", 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092887869999999997 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452790+0000", 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0267e-05 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452833+0000", 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3093999999999998e-05 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.945 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:3891 4.14 4:2914052b:::100000012aa.00000000:head [write 0~1579] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.170786425999999, 2024-04-26T12:28:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012921406, 2024-04-26T12:28:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 3891 2024-04-26T12:28:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.946 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697983+0000", 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:44.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697988+0000", 2024-04-26T12:28:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.395e-06 2024-04-26T12:28:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697994+0000", 2024-04-26T12:28:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1539999999999999e-06 2024-04-26T12:28:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.697999+0000", 2024-04-26T12:28:44.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4569999999999998e-06 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698025+0000", 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6384e-05 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.698100+0000", 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5340999999999996e-05 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710785+0000", 2024-04-26T12:28:44.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012684755000000001 2024-04-26T12:28:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710834+0000", 2024-04-26T12:28:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8955000000000001e-05 2024-04-26T12:28:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.710905+0000", 2024-04-26T12:28:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0754999999999996e-05 2024-04-26T12:28:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4057 4.10 4:0a22fc52:::1000000135a.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.023500071000001, 2024-04-26T12:28:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021108387999999999, 2024-04-26T12:28:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4057 2024-04-26T12:28:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845269+0000", 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845276+0000", 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845286+0000", 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0219e-05 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845291+0000", 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5840000000000002e-06 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845325+0000", 2024-04-26T12:28:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3429000000000001e-05 2024-04-26T12:28:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845409+0000", 2024-04-26T12:28:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4529000000000003e-05 2024-04-26T12:28:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866264+0000", 2024-04-26T12:28:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020854731000000001 2024-04-26T12:28:44.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866305+0000", 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0571000000000002e-05 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866378+0000", 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3447000000000003e-05 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.955 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4064 4.3b 4:de2f294e:::10000001361.00000000:head [write 0~127] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.017582028, 2024-04-26T12:28:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014714163000000001, 2024-04-26T12:28:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4064 2024-04-26T12:28:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851187+0000", 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851193+0000", 2024-04-26T12:28:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5999999999999997e-06 2024-04-26T12:28:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851204+0000", 2024-04-26T12:28:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1172000000000001e-05 2024-04-26T12:28:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851211+0000", 2024-04-26T12:28:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6750000000000002e-06 2024-04-26T12:28:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851254+0000", 2024-04-26T12:28:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2919e-05 2024-04-26T12:28:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851384+0000", 2024-04-26T12:28:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130013 2024-04-26T12:28:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865803+0000", 2024-04-26T12:28:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014418343 2024-04-26T12:28:44.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865857+0000", 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4567000000000001e-05 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865902+0000", 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4576999999999997e-05 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.960 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4065 4.3f 4:fea32a34:::10000001362.00000000:head [write 0~290] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.016754827, 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013949731, 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4065 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:44.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852014+0000", 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852018+0000", 2024-04-26T12:28:44.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7890000000000001e-06 2024-04-26T12:28:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852025+0000", 2024-04-26T12:28:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8750000000000002e-06 2024-04-26T12:28:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852029+0000", 2024-04-26T12:28:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0999999999999997e-06 2024-04-26T12:28:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852083+0000", 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000001e-05 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852161+0000", 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7577000000000006e-05 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865845+0000", 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013684405 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865890+0000", 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5209e-05 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865965+0000", 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4345999999999996e-05 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4066 4.1d 4:b9ed4029:::10000001363.00000000:head [write 0~133] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.015957371000001, 2024-04-26T12:28:44.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013115296, 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4066 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852816+0000", 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:28:44.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852824+0000", 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.994e-06 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852831+0000", 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0600000000000002e-06 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852858+0000", 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6605e-05 2024-04-26T12:28:44.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852932+0000", 2024-04-26T12:28:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4052000000000002e-05 2024-04-26T12:28:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853007+0000", 2024-04-26T12:28:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5580000000000005e-05 2024-04-26T12:28:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.857934+0000", 2024-04-26T12:28:44.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049264030000000002 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865834+0000", 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079004829999999998 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865883+0000", 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8723000000000001e-05 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865928+0000", 2024-04-26T12:28:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4904999999999998e-05 2024-04-26T12:28:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4067 4.15 4:a8b5213c:::10000001364.00000000:head [write 0~261] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.015131501000001, 2024-04-26T12:28:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012718304, 2024-04-26T12:28:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:44.971 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4067 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853638+0000", 2024-04-26T12:28:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853641+0000", 2024-04-26T12:28:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4620000000000001e-06 2024-04-26T12:28:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853649+0000", 2024-04-26T12:28:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6469999999999998e-06 2024-04-26T12:28:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853655+0000", 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5699999999999998e-06 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853681+0000", 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6152999999999998e-05 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853763+0000", 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1656999999999994e-05 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866245+0000", 2024-04-26T12:28:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012482304 2024-04-26T12:28:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866279+0000", 2024-04-26T12:28:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3942999999999997e-05 2024-04-26T12:28:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866357+0000", 2024-04-26T12:28:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7151999999999996e-05 2024-04-26T12:28:44.975 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:159 3.1d 3:bec1251c:::200.00000007:head [write 1564232~2630072 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e51)", 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:40.228490+0000", 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.6402797470000001, 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012297483, 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.228490+0000", 2024-04-26T12:28:44.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.228490+0000", 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.228487+0000", 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999971 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.230961+0000", 2024-04-26T12:28:44.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002473538 2024-04-26T12:28:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.230969+0000", 2024-04-26T12:28:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5890000000000003e-06 2024-04-26T12:28:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.230975+0000", 2024-04-26T12:28:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7259999999999999e-06 2024-04-26T12:28:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.231008+0000", 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3081999999999999e-05 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.231054+0000", 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5917000000000001e-05 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.231123+0000", 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9307999999999994e-05 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.236736+0000", 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056120759999999997 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.240734+0000", 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039984310000000002 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.240766+0000", 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1921999999999997e-05 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:40.240787+0000", 2024-04-26T12:28:44.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1600999999999999e-05 2024-04-26T12:28:44.981 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.981 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.981 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.981 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:232 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:44.981 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:42.925026+0000", 2024-04-26T12:28:44.981 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.943743987, 2024-04-26T12:28:44.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027270579999999999, 2024-04-26T12:28:44.981 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:44.981 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:44.981 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:44.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:44.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925026+0000", 2024-04-26T12:28:44.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:44.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925026+0000", 2024-04-26T12:28:44.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:44.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:44.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925024+0000", 2024-04-26T12:28:44.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999976 2024-04-26T12:28:44.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925406+0000", 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038199600000000001 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925417+0000", 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1904e-05 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925426+0000", 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1820000000000006e-06 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:44.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925464+0000", 2024-04-26T12:28:44.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689000000000002e-05 2024-04-26T12:28:44.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:44.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925522+0000", 2024-04-26T12:28:44.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7370000000000001e-05 2024-04-26T12:28:44.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:44.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.934737+0000", 2024-04-26T12:28:44.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.009215361 2024-04-26T12:28:44.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.949281+0000", 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014543762999999999 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.952211+0000", 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029305860000000002 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.952245+0000", 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3083000000000002e-05 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:44.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:44.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:44.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.952296+0000", 2024-04-26T12:28:44.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1808999999999998e-05 2024-04-26T12:28:44.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.990 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:44.990 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:44.990 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:44.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2024-04-26T12:28:44.994 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:44.991+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:44.994 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:45.000 INFO:tasks.workunit.client.0.smithi046.stdout:1/6: creat f1 x:0 0 0 2024-04-26T12:28:45.000 INFO:tasks.workunit.client.0.smithi046.stdout:7/58: mknod c15 0 2024-04-26T12:28:45.000 INFO:tasks.workunit.client.0.smithi046.stdout:3/14: creat d2/f4 x:0 0 0 2024-04-26T12:28:45.000 INFO:tasks.workunit.client.0.smithi046.stdout:4/10: symlink d0/d1/l3 0 2024-04-26T12:28:45.000 INFO:tasks.workunit.client.0.smithi046.stdout:9/11: creat d0/f3 x:0 0 0 2024-04-26T12:28:45.000 INFO:tasks.workunit.client.0.smithi046.stdout:6/7: link l0 l1 0 2024-04-26T12:28:45.000 INFO:tasks.workunit.client.0.smithi046.stdout:2/77: symlink d1/de/d15/d18/l1a 0 2024-04-26T12:28:45.000 INFO:tasks.workunit.client.0.smithi046.stdout:4/11: write d0/f2 [1707152,32025] 0 2024-04-26T12:28:45.000 INFO:tasks.workunit.client.0.smithi046.stdout:6/8: mknod c2 0 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:8/20: dread f4 [0,4194304] 0 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:6/9: symlink l3 0 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:8/21: dread f4 [0,4194304] 0 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:7/59: dwrite f3 [0,4194304] 0 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:9/12: dwrite d0/f3 [0,4194304] 0 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:7/60: chown f5 0 1 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:4/12: dwrite d0/f2 [4194304,4194304] 0 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:2/78: dwrite d1/de/d15/f16 [0,4194304] 0 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:5/20: truncate f2 1356205 0 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:3/15: getdents d2 0 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:7/61: unlink f0 0 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:6/10: rename l1 to l4 0 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:5/21: mknod c6 0 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:3/16: dread - d2/f4 zero size 2024-04-26T12:28:45.001 INFO:tasks.workunit.client.0.smithi046.stdout:3/17: rmdir d2 39 2024-04-26T12:28:45.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/11: getdents . 0 2024-04-26T12:28:45.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/12: dwrite - no filename 2024-04-26T12:28:45.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/13: fsync - no filename 2024-04-26T12:28:45.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/14: write - no filename 2024-04-26T12:28:45.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/15: truncate - no filename 2024-04-26T12:28:45.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/16: write - no filename 2024-04-26T12:28:45.002 INFO:tasks.workunit.client.0.smithi046.stdout:8/22: truncate f4 172122 0 2024-04-26T12:28:45.002 INFO:tasks.workunit.client.0.smithi046.stdout:4/13: truncate d0/f2 1044143 0 2024-04-26T12:28:45.002 INFO:tasks.workunit.client.0.smithi046.stdout:2/79: dwrite d1/de/ff [0,4194304] 0 2024-04-26T12:28:45.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/17: creat f5 x:0 0 0 2024-04-26T12:28:45.002 INFO:tasks.workunit.client.0.smithi046.stdout:3/18: link d2/l3 d2/l5 0 2024-04-26T12:28:45.002 INFO:tasks.workunit.client.0.smithi046.stdout:5/22: truncate f2 919666 0 2024-04-26T12:28:45.002 INFO:tasks.workunit.client.0.smithi046.stdout:4/14: write d0/f2 [1010166,81402] 0 2024-04-26T12:28:45.002 INFO:tasks.workunit.client.0.smithi046.stdout:8/23: dread f4 [0,4194304] 0 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:6/18: symlink l6 0 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:3/19: mknod d2/c6 0 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:7/62: dwrite f6 [0,4194304] 0 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:3/20: creat d2/f7 x:0 0 0 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:4/15: link d0/f2 d0/f4 0 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:6/19: write f5 [675020,78343] 0 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:3/21: fdatasync d2/f4 0 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:6/20: readlink l3 0 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:3/22: dread - d2/f4 zero size 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:4/16: mkdir d0/d1/d5 0 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:4/17: write d0/f2 [1181474,19680] 0 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:7/63: mkdir d16 0 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:7/64: write f9 [1406936,157] 0 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:8/24: truncate f4 615632 0 2024-04-26T12:28:45.003 INFO:tasks.workunit.client.0.smithi046.stdout:7/65: mknod d16/c17 0 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:7/66: symlink d16/l18 0 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:7/67: chown d16 24 1 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:3/23: dwrite d2/f4 [0,4194304] 0 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:3/24: write d2/f4 [3918018,81263] 0 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:3/25: dread d2/f4 [0,4194304] 0 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:4/18: dread d0/f4 [0,4194304] 0 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:3/26: creat d2/f8 x:0 0 0 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:3/27: chown d2/f7 60355 1 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:3/28: mknod d2/c9 0 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:3/29: chown d2/l5 11467823 1 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:6/21: fdatasync f5 0 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:5/23: write f2 [266317,5507] 0 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:5/24: mknod c7 0 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:6/22: write f5 [566432,82345] 0 2024-04-26T12:28:45.004 INFO:tasks.workunit.client.0.smithi046.stdout:6/23: write f5 [883227,113048] 0 2024-04-26T12:28:45.005 INFO:tasks.workunit.client.0.smithi046.stdout:5/25: dread f2 [0,4194304] 0 2024-04-26T12:28:45.005 INFO:tasks.workunit.client.0.smithi046.stdout:6/24: mkdir d7 0 2024-04-26T12:28:45.005 INFO:tasks.workunit.client.0.smithi046.stdout:4/19: dwrite d0/f4 [0,4194304] 0 2024-04-26T12:28:45.005 INFO:tasks.workunit.client.0.smithi046.stdout:5/26: creat f8 x:0 0 0 2024-04-26T12:28:45.005 INFO:tasks.workunit.client.0.smithi046.stdout:5/27: readlink - no filename 2024-04-26T12:28:45.005 INFO:tasks.workunit.client.0.smithi046.stdout:6/25: read f5 [929523,108334] 0 2024-04-26T12:28:45.005 INFO:tasks.workunit.client.0.smithi046.stdout:4/20: read d0/f4 [791447,107400] 0 2024-04-26T12:28:45.005 INFO:tasks.workunit.client.0.smithi046.stdout:5/28: mkdir d9 0 2024-04-26T12:28:45.005 INFO:tasks.workunit.client.0.smithi046.stdout:3/30: getdents d2 0 2024-04-26T12:28:45.005 INFO:tasks.workunit.client.0.smithi046.stdout:4/21: creat d0/f6 x:0 0 0 2024-04-26T12:28:45.005 INFO:tasks.workunit.client.0.smithi046.stdout:5/29: mkdir d9/da 0 2024-04-26T12:28:45.006 INFO:tasks.workunit.client.0.smithi046.stdout:3/31: read - d2/f8 zero size 2024-04-26T12:28:45.006 INFO:tasks.workunit.client.0.smithi046.stdout:5/30: creat d9/fb x:0 0 0 2024-04-26T12:28:45.006 INFO:tasks.workunit.client.0.smithi046.stdout:4/22: mknod d0/d1/d5/c7 0 2024-04-26T12:28:45.006 INFO:tasks.workunit.client.0.smithi046.stdout:3/32: readlink l1 0 2024-04-26T12:28:45.006 INFO:tasks.workunit.client.0.smithi046.stdout:5/31: dread - f8 zero size 2024-04-26T12:28:45.006 INFO:tasks.workunit.client.0.smithi046.stdout:3/33: symlink d2/la 0 2024-04-26T12:28:45.006 INFO:tasks.workunit.client.0.smithi046.stdout:5/32: symlink d9/lc 0 2024-04-26T12:28:45.006 INFO:tasks.workunit.client.0.smithi046.stdout:3/34: mkdir d2/db 0 2024-04-26T12:28:45.006 INFO:tasks.workunit.client.0.smithi046.stdout:4/23: link d0/d1/d5/c7 d0/d1/d5/c8 0 2024-04-26T12:28:45.006 INFO:tasks.workunit.client.0.smithi046.stdout:7/68: dwrite f4 [0,4194304] 0 2024-04-26T12:28:45.006 INFO:tasks.workunit.client.0.smithi046.stdout:3/35: truncate d2/f8 545182 0 2024-04-26T12:28:45.006 INFO:tasks.workunit.client.0.smithi046.stdout:6/26: dwrite f5 [0,4194304] 0 2024-04-26T12:28:45.006 INFO:tasks.workunit.client.0.smithi046.stdout:4/24: chown d0/d1/l3 1611 1 2024-04-26T12:28:45.007 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:45.012 INFO:tasks.workunit.client.0.smithi046.stdout:3/36: chown d2/la 198 1 2024-04-26T12:28:45.012 INFO:tasks.workunit.client.0.smithi046.stdout:6/27: creat d7/f8 x:0 0 0 2024-04-26T12:28:45.012 INFO:tasks.workunit.client.0.smithi046.stdout:3/37: write d2/f7 [642435,122177] 0 2024-04-26T12:28:45.012 INFO:tasks.workunit.client.0.smithi046.stdout:6/28: getdents d7 0 2024-04-26T12:28:45.012 INFO:tasks.workunit.client.0.smithi046.stdout:5/33: dwrite f2 [0,4194304] 0 2024-04-26T12:28:45.012 INFO:tasks.workunit.client.0.smithi046.stdout:3/38: symlink d2/db/lc 0 2024-04-26T12:28:45.012 INFO:tasks.workunit.client.0.smithi046.stdout:5/34: fsync f5 0 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:6/29: creat d7/f9 x:0 0 0 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:6/30: creat d7/fa x:0 0 0 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:3/39: mknod d2/db/cd 0 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:5/35: mkdir d9/da/dd 0 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:7/69: dwrite f5 [0,4194304] 0 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:6/31: unlink l0 0 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:3/40: write d2/f7 [96976,106131] 0 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:5/36: mknod d9/da/ce 0 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:4/25: dwrite d0/f2 [4194304,4194304] 0 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:5/37: dread - f5 zero size 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:5/38: creat d9/da/dd/ff x:0 0 0 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:7/70: dread f6 [0,4194304] 0 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:3/41: dread d2/f4 [0,4194304] 0 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:7/71: creat d16/f19 x:0 0 0 2024-04-26T12:28:45.013 INFO:tasks.workunit.client.0.smithi046.stdout:4/26: dwrite d0/f4 [0,4194304] 0 2024-04-26T12:28:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:7/72: mkdir d16/d1a 0 2024-04-26T12:28:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:7/73: chown cc 37 1 2024-04-26T12:28:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:7/74: write d16/f19 [353894,5351] 0 2024-04-26T12:28:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:4/27: mkdir d0/d1/d9 0 2024-04-26T12:28:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:4/28: mkdir d0/da 0 2024-04-26T12:28:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:6/32: truncate f5 2858619 0 2024-04-26T12:28:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:4/29: chown d0/d1/d5/c8 1714326505 1 2024-04-26T12:28:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:5/39: rmdir d9 39 2024-04-26T12:28:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:7/75: rmdir d16 39 2024-04-26T12:28:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:3/42: dwrite d2/f7 [0,4194304] 0 2024-04-26T12:28:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:6/33: write f5 [549821,39149] 0 2024-04-26T12:28:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:5/40: write d9/da/dd/ff [356013,44847] 0 2024-04-26T12:28:45.014 INFO:tasks.workunit.client.0.smithi046.stdout:3/43: write d2/f7 [3233852,44358] 0 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:4/30: mkdir d0/d1/d5/db 0 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:6/34: creat d7/fb x:0 0 0 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/41: rename f5 to d9/da/f10 0 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:3/44: creat d2/db/fe x:0 0 0 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:6/35: creat d7/fc x:0 0 0 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/42: symlink d9/l11 0 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:6/36: mknod d7/cd 0 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/43: dread - d9/fb zero size 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:3/45: truncate d2/db/fe 359426 0 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/44: write d9/da/dd/ff [1182352,124527] 0 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:7/76: dwrite d16/f19 [0,4194304] 0 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:3/46: read d2/f8 [430360,94578] 0 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:3/47: chown d2/c6 25229176 1 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:4/31: dread d0/f4 [4194304,4194304] 0 2024-04-26T12:28:45.015 INFO:tasks.workunit.client.0.smithi046.stdout:6/37: dread f5 [0,4194304] 0 2024-04-26T12:28:45.016 INFO:tasks.workunit.client.0.smithi046.stdout:6/38: creat d7/fe x:0 0 0 2024-04-26T12:28:45.016 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:45.016 INFO:tasks.workunit.client.0.smithi046.stdout:4/32: getdents d0/d1/d5/db 0 2024-04-26T12:28:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:45.016 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:45.017 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:45.017 INFO:tasks.workunit.client.0.smithi046.stdout:4/33: chown d0 22047516 1 2024-04-26T12:28:45.017 INFO:tasks.workunit.client.0.smithi046.stdout:6/39: symlink d7/lf 0 2024-04-26T12:28:45.017 INFO:tasks.workunit.client.0.smithi046.stdout:5/45: dread d9/da/dd/ff [0,4194304] 0 2024-04-26T12:28:45.017 INFO:tasks.workunit.client.0.smithi046.stdout:6/40: rename c2 to d7/c10 0 2024-04-26T12:28:45.017 INFO:tasks.workunit.client.0.smithi046.stdout:4/34: creat d0/da/fc x:0 0 0 2024-04-26T12:28:45.018 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:45.018 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:45.025 INFO:tasks.workunit.client.0.smithi046.stdout:3/48: dwrite d2/db/fe [0,4194304] 0 2024-04-26T12:28:45.025 INFO:tasks.workunit.client.0.smithi046.stdout:4/35: creat d0/da/fd x:0 0 0 2024-04-26T12:28:45.025 INFO:tasks.workunit.client.0.smithi046.stdout:7/77: dwrite f4 [0,4194304] 0 2024-04-26T12:28:45.025 INFO:tasks.workunit.client.0.smithi046.stdout:3/49: stat l1 0 2024-04-26T12:28:45.025 INFO:tasks.workunit.client.0.smithi046.stdout:5/46: mknod d9/da/dd/c12 0 2024-04-26T12:28:45.025 INFO:tasks.workunit.client.0.smithi046.stdout:6/41: write d7/fc [345806,31056] 0 2024-04-26T12:28:45.025 INFO:tasks.workunit.client.0.smithi046.stdout:7/78: creat d16/d1a/f1b x:0 0 0 2024-04-26T12:28:45.025 INFO:tasks.workunit.client.0.smithi046.stdout:6/42: link d7/c10 d7/c11 0 2024-04-26T12:28:45.025 INFO:tasks.workunit.client.0.smithi046.stdout:6/43: mknod d7/c12 0 2024-04-26T12:28:45.026 INFO:tasks.workunit.client.0.smithi046.stdout:6/44: chown l4 9751 1 2024-04-26T12:28:45.026 INFO:tasks.workunit.client.0.smithi046.stdout:3/50: dwrite d2/db/fe [0,4194304] 0 2024-04-26T12:28:45.026 INFO:tasks.workunit.client.0.smithi046.stdout:4/36: dwrite d0/f4 [0,4194304] 0 2024-04-26T12:28:45.026 INFO:tasks.workunit.client.0.smithi046.stdout:6/45: creat d7/f13 x:0 0 0 2024-04-26T12:28:45.026 INFO:tasks.workunit.client.0.smithi046.stdout:3/51: mkdir d2/db/df 0 2024-04-26T12:28:45.026 INFO:tasks.workunit.client.0.smithi046.stdout:6/46: write d7/fb [941243,25381] 0 2024-04-26T12:28:45.026 INFO:tasks.workunit.client.0.smithi046.stdout:4/37: rename d0/da/fc to d0/d1/d5/fe 0 2024-04-26T12:28:45.026 INFO:tasks.workunit.client.0.smithi046.stdout:3/52: creat d2/db/f10 x:0 0 0 2024-04-26T12:28:45.026 INFO:tasks.workunit.client.0.smithi046.stdout:4/38: unlink d0/f4 0 2024-04-26T12:28:45.026 INFO:tasks.workunit.client.0.smithi046.stdout:6/47: truncate d7/f9 492955 0 2024-04-26T12:28:45.026 INFO:tasks.workunit.client.0.smithi046.stdout:3/53: dread - d2/db/f10 zero size 2024-04-26T12:28:45.026 INFO:tasks.workunit.client.0.smithi046.stdout:6/48: chown d7 11 1 2024-04-26T12:28:45.026 INFO:tasks.workunit.client.0.smithi046.stdout:3/54: fsync d2/f4 0 2024-04-26T12:28:45.026 INFO:tasks.workunit.client.0.smithi046.stdout:4/39: symlink d0/d1/d9/lf 0 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/55: mkdir d2/db/df/d11 0 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:4/40: truncate d0/f6 1034247 0 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:4/41: chown d0/f6 121023 1 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/56: write d2/f7 [685316,6740] 0 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/57: unlink d2/c6 0 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:4/42: creat d0/d1/d5/db/f10 x:0 0 0 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/58: symlink d2/db/df/l12 0 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:4/43: creat d0/d1/d5/f11 x:0 0 0 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/59: link d2/db/fe d2/db/f13 0 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/60: mknod d2/c14 0 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/61: chown d2/f7 0 1 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/62: creat d2/db/f15 x:0 0 0 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:4/44: getdents d0 0 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/63: rename d2/db/df to d2/d16 0 2024-04-26T12:28:45.027 INFO:tasks.workunit.client.0.smithi046.stdout:4/45: mkdir d0/d1/d12 0 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:3/64: write d2/f7 [4955660,58695] 0 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:3/65: write d2/db/f15 [762485,57079] 0 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:3/66: creat d2/f17 x:0 0 0 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:3/67: creat d2/db/f18 x:0 0 0 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:3/68: mknod d2/c19 0 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/46: dread d0/f2 [0,4194304] 0 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/47: creat d0/d1/d9/f13 x:0 0 0 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/48: creat d0/f14 x:0 0 0 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/49: creat d0/d1/f15 x:0 0 0 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/50: getdents d0/d1 0 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/51: getdents d0/d1/d5 0 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/52: symlink d0/d1/l16 0 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/53: dread - d0/da/fd zero size 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/54: dread - d0/f14 zero size 2024-04-26T12:28:45.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/55: getdents d0 0 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/56: dread - d0/d1/d5/fe zero size 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/57: mkdir d0/da/d17 0 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/58: fsync d0/f6 0 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/59: write d0/d1/d9/f13 [51067,48929] 0 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/60: mknod d0/c18 0 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/61: write d0/d1/d9/f13 [862864,76571] 0 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/62: chown d0/da/d17 267321117 1 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/63: mkdir d0/d1/d9/d19 0 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/64: dread - d0/d1/d5/fe zero size 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/65: creat d0/d1/d9/d19/f1a x:0 0 0 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/66: symlink d0/d1/d12/l1b 0 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/67: write d0/f2 [8505495,11436] 0 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/68: link d0/c18 d0/da/d17/c1c 0 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/69: dread - d0/d1/f15 zero size 2024-04-26T12:28:45.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/70: dwrite d0/f6 [0,4194304] 0 2024-04-26T12:28:45.030 INFO:tasks.workunit.client.0.smithi046.stdout:4/71: truncate d0/d1/d5/f11 287293 0 2024-04-26T12:28:45.030 INFO:tasks.workunit.client.0.smithi046.stdout:4/72: stat d0/f2 0 2024-04-26T12:28:45.030 INFO:tasks.workunit.client.0.smithi046.stdout:4/73: mkdir d0/d1d 0 2024-04-26T12:28:45.030 INFO:tasks.workunit.client.0.smithi046.stdout:4/74: dwrite d0/da/fd [0,4194304] 0 2024-04-26T12:28:45.030 INFO:tasks.workunit.client.0.smithi046.stdout:4/75: write d0/da/fd [2154844,2875] 0 2024-04-26T12:28:45.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/76: stat d0/d1/d9/d19/f1a 0 2024-04-26T12:28:45.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/77: dread - d0/d1/f15 zero size 2024-04-26T12:28:45.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/78: mknod d0/d1/c1e 0 2024-04-26T12:28:45.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/79: creat d0/d1/d5/db/f1f x:0 0 0 2024-04-26T12:28:45.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/80: mkdir d0/da/d17/d20 0 2024-04-26T12:28:45.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/81: mkdir d0/da/d21 0 2024-04-26T12:28:45.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/82: creat d0/da/f22 x:0 0 0 2024-04-26T12:28:45.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/83: fsync d0/d1/d9/f13 0 2024-04-26T12:28:45.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/84: unlink d0/d1/d12/l1b 0 2024-04-26T12:28:45.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/85: unlink d0/d1/d5/fe 0 2024-04-26T12:28:45.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/86: creat d0/d1/d9/f23 x:0 0 0 2024-04-26T12:28:45.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/87: mknod d0/d1/c24 0 2024-04-26T12:28:45.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/88: write d0/d1/d9/f23 [179355,86931] 0 2024-04-26T12:28:45.087 INFO:tasks.workunit.client.0.smithi046.stdout:0/66: sync 2024-04-26T12:28:45.087 INFO:tasks.workunit.client.0.smithi046.stdout:1/7: sync 2024-04-26T12:28:45.087 INFO:tasks.workunit.client.0.smithi046.stdout:1/8: chown c0 7165834 1 2024-04-26T12:28:45.088 INFO:tasks.workunit.client.0.smithi046.stdout:1/9: creat f2 x:0 0 0 2024-04-26T12:28:45.090 INFO:tasks.workunit.client.0.smithi046.stdout:0/67: dread f6 [0,4194304] 0 2024-04-26T12:28:45.091 INFO:tasks.workunit.client.0.smithi046.stdout:0/68: write f2 [309113,1936] 0 2024-04-26T12:28:45.092 INFO:tasks.workunit.client.0.smithi046.stdout:0/69: creat d9/dc/dd/f14 x:0 0 0 2024-04-26T12:28:45.093 INFO:tasks.workunit.client.0.smithi046.stdout:1/10: dwrite f1 [0,4194304] 0 2024-04-26T12:28:45.094 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:45.093+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:45.094 INFO:tasks.workunit.client.0.smithi046.stdout:1/11: unlink c0 0 2024-04-26T12:28:45.098 INFO:tasks.workunit.client.0.smithi046.stdout:0/70: dwrite f7 [0,4194304] 0 2024-04-26T12:28:45.099 INFO:tasks.workunit.client.0.smithi046.stdout:0/71: write d9/dc/dd/f14 [785871,15713] 0 2024-04-26T12:28:45.100 INFO:tasks.workunit.client.0.smithi046.stdout:1/12: dwrite f1 [0,4194304] 0 2024-04-26T12:28:45.101 INFO:tasks.workunit.client.0.smithi046.stdout:1/13: symlink l3 0 2024-04-26T12:28:45.101 INFO:tasks.workunit.client.0.smithi046.stdout:1/14: rename l3 to l4 0 2024-04-26T12:28:45.103 INFO:tasks.workunit.client.0.smithi046.stdout:0/72: dread f7 [0,4194304] 0 2024-04-26T12:28:45.103 INFO:tasks.workunit.client.0.smithi046.stdout:0/73: mknod d9/c15 0 2024-04-26T12:28:45.104 INFO:tasks.workunit.client.0.smithi046.stdout:1/15: rename l4 to l5 0 2024-04-26T12:28:45.104 INFO:tasks.workunit.client.0.smithi046.stdout:1/16: symlink l6 0 2024-04-26T12:28:45.104 INFO:tasks.workunit.client.0.smithi046.stdout:1/17: mkdir d7 0 2024-04-26T12:28:45.105 INFO:tasks.workunit.client.0.smithi046.stdout:1/18: creat d7/f8 x:0 0 0 2024-04-26T12:28:45.105 INFO:tasks.workunit.client.0.smithi046.stdout:1/19: mkdir d7/d9 0 2024-04-26T12:28:45.106 INFO:tasks.workunit.client.0.smithi046.stdout:1/20: rename f2 to d7/d9/fa 0 2024-04-26T12:28:45.111 INFO:tasks.workunit.client.0.smithi046.stdout:0/74: dwrite d9/fa [0,4194304] 0 2024-04-26T12:28:45.111 INFO:tasks.workunit.client.0.smithi046.stdout:1/21: dwrite d7/f8 [0,4194304] 0 2024-04-26T12:28:45.112 INFO:tasks.workunit.client.0.smithi046.stdout:0/75: symlink d9/l16 0 2024-04-26T12:28:45.114 INFO:tasks.workunit.client.0.smithi046.stdout:1/22: dread f1 [0,4194304] 0 2024-04-26T12:28:45.115 INFO:tasks.workunit.client.0.smithi046.stdout:1/23: mkdir d7/db 0 2024-04-26T12:28:45.115 INFO:tasks.workunit.client.0.smithi046.stdout:0/76: truncate d9/f10 2271130 0 2024-04-26T12:28:45.115 INFO:tasks.workunit.client.0.smithi046.stdout:1/24: write f1 [4607883,91278] 0 2024-04-26T12:28:45.117 INFO:tasks.workunit.client.0.smithi046.stdout:1/25: link l5 d7/db/lc 0 2024-04-26T12:28:45.117 INFO:tasks.workunit.client.0.smithi046.stdout:1/26: unlink d7/f8 0 2024-04-26T12:28:45.118 INFO:tasks.workunit.client.0.smithi046.stdout:1/27: symlink d7/db/ld 0 2024-04-26T12:28:45.119 INFO:tasks.workunit.client.0.smithi046.stdout:1/28: mknod d7/ce 0 2024-04-26T12:28:45.120 INFO:tasks.workunit.client.0.smithi046.stdout:0/77: dwrite d9/f12 [0,4194304] 0 2024-04-26T12:28:45.121 INFO:tasks.workunit.client.0.smithi046.stdout:0/78: write f7 [3745691,116941] 0 2024-04-26T12:28:45.121 INFO:tasks.workunit.client.0.smithi046.stdout:0/79: write f5 [2599410,118143] 0 2024-04-26T12:28:45.123 INFO:tasks.workunit.client.0.smithi046.stdout:0/80: creat d9/f17 x:0 0 0 2024-04-26T12:28:45.126 INFO:tasks.workunit.client.0.smithi046.stdout:1/29: dwrite d7/d9/fa [0,4194304] 0 2024-04-26T12:28:45.128 INFO:tasks.workunit.client.0.smithi046.stdout:1/30: getdents d7/d9 0 2024-04-26T12:28:45.129 INFO:tasks.workunit.client.0.smithi046.stdout:1/31: rename f1 to d7/db/ff 0 2024-04-26T12:28:45.130 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:45.130 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:45.130 INFO:tasks.workunit.client.0.smithi046.stdout:1/32: write d7/d9/fa [723066,117546] 0 2024-04-26T12:28:45.130 INFO:tasks.workunit.client.0.smithi046.stdout:0/81: dwrite d9/f17 [0,4194304] 0 2024-04-26T12:28:45.131 INFO:tasks.workunit.client.0.smithi046.stdout:0/82: stat d9/l16 0 2024-04-26T12:28:45.131 INFO:tasks.workunit.client.0.smithi046.stdout:0/83: read d9/f12 [1112574,119298] 0 2024-04-26T12:28:45.131 INFO:tasks.workunit.client.0.smithi046.stdout:0/84: symlink d9/dc/dd/l18 0 2024-04-26T12:28:45.132 INFO:tasks.workunit.client.0.smithi046.stdout:0/85: write f5 [1604574,18417] 0 2024-04-26T12:28:45.134 INFO:tasks.workunit.client.0.smithi046.stdout:0/86: dread f5 [0,4194304] 0 2024-04-26T12:28:45.135 INFO:tasks.workunit.client.0.smithi046.stdout:0/87: mknod d9/dc/c19 0 2024-04-26T12:28:45.135 INFO:tasks.workunit.client.0.smithi046.stdout:0/88: creat d9/dc/f1a x:0 0 0 2024-04-26T12:28:45.136 INFO:tasks.workunit.client.0.smithi046.stdout:0/89: creat d9/f1b x:0 0 0 2024-04-26T12:28:45.136 INFO:tasks.workunit.client.0.smithi046.stdout:0/90: stat f5 0 2024-04-26T12:28:45.137 INFO:tasks.workunit.client.0.smithi046.stdout:0/91: write d9/f1b [510249,121355] 0 2024-04-26T12:28:45.137 INFO:tasks.workunit.client.0.smithi046.stdout:0/92: rename f6 to d9/dc/f1c 0 2024-04-26T12:28:45.138 INFO:tasks.workunit.client.0.smithi046.stdout:1/33: fdatasync d7/d9/fa 0 2024-04-26T12:28:45.139 INFO:tasks.workunit.client.0.smithi046.stdout:0/93: truncate f2 81124 0 2024-04-26T12:28:45.139 INFO:tasks.workunit.client.0.smithi046.stdout:0/94: mkdir d9/d1d 0 2024-04-26T12:28:45.141 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:45.197 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:45.195+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:45.203 INFO:tasks.workunit.client.0.smithi046.stdout:4/89: sync 2024-04-26T12:28:45.203 INFO:tasks.workunit.client.0.smithi046.stdout:7/79: sync 2024-04-26T12:28:45.203 INFO:tasks.workunit.client.0.smithi046.stdout:6/49: sync 2024-04-26T12:28:45.203 INFO:tasks.workunit.client.0.smithi046.stdout:8/25: sync 2024-04-26T12:28:45.204 INFO:tasks.workunit.client.0.smithi046.stdout:3/69: sync 2024-04-26T12:28:45.204 INFO:tasks.workunit.client.0.smithi046.stdout:2/80: sync 2024-04-26T12:28:45.204 INFO:tasks.workunit.client.0.smithi046.stdout:9/13: sync 2024-04-26T12:28:45.204 INFO:tasks.workunit.client.0.smithi046.stdout:5/47: sync 2024-04-26T12:28:45.204 INFO:tasks.workunit.client.0.smithi046.stdout:6/50: read - d7/f13 zero size 2024-04-26T12:28:45.204 INFO:tasks.workunit.client.0.smithi046.stdout:3/70: chown d2/d16/l12 242342142 1 2024-04-26T12:28:45.204 INFO:tasks.workunit.client.0.smithi046.stdout:9/14: creat d0/f4 x:0 0 0 2024-04-26T12:28:45.205 INFO:tasks.workunit.client.0.smithi046.stdout:5/48: write d9/da/f10 [365269,23044] 0 2024-04-26T12:28:45.206 INFO:tasks.workunit.client.0.smithi046.stdout:7/80: mkdir d16/d1c 0 2024-04-26T12:28:45.206 INFO:tasks.workunit.client.0.smithi046.stdout:3/71: rmdir d2/d16 39 2024-04-26T12:28:45.206 INFO:tasks.workunit.client.0.smithi046.stdout:4/90: mkdir d0/da/d17/d20/d25 0 2024-04-26T12:28:45.206 INFO:tasks.workunit.client.0.smithi046.stdout:6/51: truncate d7/fc 423963 0 2024-04-26T12:28:45.206 INFO:tasks.workunit.client.0.smithi046.stdout:9/15: rename d0/f3 to d0/f5 0 2024-04-26T12:28:45.206 INFO:tasks.workunit.client.0.smithi046.stdout:3/72: dread - d2/db/f18 zero size 2024-04-26T12:28:45.206 INFO:tasks.workunit.client.0.smithi046.stdout:6/52: stat d7/f8 0 2024-04-26T12:28:45.206 INFO:tasks.workunit.client.0.smithi046.stdout:5/49: creat d9/da/dd/f13 x:0 0 0 2024-04-26T12:28:45.206 INFO:tasks.workunit.client.0.smithi046.stdout:4/91: creat d0/da/f26 x:0 0 0 2024-04-26T12:28:45.206 INFO:tasks.workunit.client.0.smithi046.stdout:3/73: chown d2/la 308 1 2024-04-26T12:28:45.206 INFO:tasks.workunit.client.0.smithi046.stdout:8/26: write f4 [212055,7587] 0 2024-04-26T12:28:45.206 INFO:tasks.workunit.client.0.smithi046.stdout:5/50: symlink d9/l14 0 2024-04-26T12:28:45.206 INFO:tasks.workunit.client.0.smithi046.stdout:6/53: read d7/fc [48347,59677] 0 2024-04-26T12:28:45.207 INFO:tasks.workunit.client.0.smithi046.stdout:3/74: write d2/f17 [34412,12006] 0 2024-04-26T12:28:45.207 INFO:tasks.workunit.client.0.smithi046.stdout:4/92: write d0/da/f22 [330389,98250] 0 2024-04-26T12:28:45.207 INFO:tasks.workunit.client.0.smithi046.stdout:6/54: dread - d7/f8 zero size 2024-04-26T12:28:45.208 INFO:tasks.workunit.client.0.smithi046.stdout:5/51: rmdir d9/da 39 2024-04-26T12:28:45.208 INFO:tasks.workunit.client.0.smithi046.stdout:3/75: chown d2 200036186 1 2024-04-26T12:28:45.208 INFO:tasks.workunit.client.0.smithi046.stdout:8/27: rename c1 to c5 0 2024-04-26T12:28:45.208 INFO:tasks.workunit.client.0.smithi046.stdout:3/76: stat d2/db 0 2024-04-26T12:28:45.209 INFO:tasks.workunit.client.0.smithi046.stdout:6/55: rename d7/f9 to d7/f14 0 2024-04-26T12:28:45.209 INFO:tasks.workunit.client.0.smithi046.stdout:4/93: dread - d0/d1/d5/db/f10 zero size 2024-04-26T12:28:45.209 INFO:tasks.workunit.client.0.smithi046.stdout:2/81: dwrite d1/f4 [0,4194304] 0 2024-04-26T12:28:45.209 INFO:tasks.workunit.client.0.smithi046.stdout:8/28: write f4 [1135882,117445] 0 2024-04-26T12:28:45.209 INFO:tasks.workunit.client.0.smithi046.stdout:5/52: dread - d9/da/dd/f13 zero size 2024-04-26T12:28:45.209 INFO:tasks.workunit.client.0.smithi046.stdout:2/82: chown d1 1704557 1 2024-04-26T12:28:45.209 INFO:tasks.workunit.client.0.smithi046.stdout:6/56: creat d7/f15 x:0 0 0 2024-04-26T12:28:45.209 INFO:tasks.workunit.client.0.smithi046.stdout:3/77: getdents d2/d16/d11 0 2024-04-26T12:28:45.210 INFO:tasks.workunit.client.0.smithi046.stdout:6/57: chown l4 10 1 2024-04-26T12:28:45.210 INFO:tasks.workunit.client.0.smithi046.stdout:2/83: write d1/de/ff [3099557,14676] 0 2024-04-26T12:28:45.210 INFO:tasks.workunit.client.0.smithi046.stdout:3/78: fsync d2/db/f10 0 2024-04-26T12:28:45.211 INFO:tasks.workunit.client.0.smithi046.stdout:5/53: mkdir d9/da/d15 0 2024-04-26T12:28:45.211 INFO:tasks.workunit.client.0.smithi046.stdout:4/94: rename d0/d1/l16 to d0/d1/d12/l27 0 2024-04-26T12:28:45.211 INFO:tasks.workunit.client.0.smithi046.stdout:3/79: symlink d2/d16/l1a 0 2024-04-26T12:28:45.211 INFO:tasks.workunit.client.0.smithi046.stdout:2/84: write d1/de/ff [240147,96959] 0 2024-04-26T12:28:45.212 INFO:tasks.workunit.client.0.smithi046.stdout:2/85: mkdir d1/d13/d1b 0 2024-04-26T12:28:45.212 INFO:tasks.workunit.client.0.smithi046.stdout:3/80: mkdir d2/d16/d11/d1b 0 2024-04-26T12:28:45.214 INFO:tasks.workunit.client.0.smithi046.stdout:3/81: truncate d2/db/f18 803022 0 2024-04-26T12:28:45.214 INFO:tasks.workunit.client.0.smithi046.stdout:5/54: dread d9/da/f10 [0,4194304] 0 2024-04-26T12:28:45.215 INFO:tasks.workunit.client.0.smithi046.stdout:2/86: creat d1/de/d15/d18/f1c x:0 0 0 2024-04-26T12:28:45.215 INFO:tasks.workunit.client.0.smithi046.stdout:8/29: dwrite f4 [0,4194304] 0 2024-04-26T12:28:45.215 INFO:tasks.workunit.client.0.smithi046.stdout:3/82: stat d2/db/fe 0 2024-04-26T12:28:45.215 INFO:tasks.workunit.client.0.smithi046.stdout:2/87: stat d1/de/ff 0 2024-04-26T12:28:45.215 INFO:tasks.workunit.client.0.smithi046.stdout:5/55: chown f2 34 1 2024-04-26T12:28:45.215 INFO:tasks.workunit.client.0.smithi046.stdout:8/30: chown f4 15610621 1 2024-04-26T12:28:45.216 INFO:tasks.workunit.client.0.smithi046.stdout:2/88: creat d1/d13/f1d x:0 0 0 2024-04-26T12:28:45.216 INFO:tasks.workunit.client.0.smithi046.stdout:3/83: symlink d2/l1c 0 2024-04-26T12:28:45.216 INFO:tasks.workunit.client.0.smithi046.stdout:5/56: mknod d9/da/dd/c16 0 2024-04-26T12:28:45.216 INFO:tasks.workunit.client.0.smithi046.stdout:3/84: fdatasync d2/db/f18 0 2024-04-26T12:28:45.216 INFO:tasks.workunit.client.0.smithi046.stdout:2/89: chown d1/de/d15/d18/l1a 2 1 2024-04-26T12:28:45.217 INFO:tasks.workunit.client.0.smithi046.stdout:5/57: mknod d9/c17 0 2024-04-26T12:28:45.217 INFO:tasks.workunit.client.0.smithi046.stdout:2/90: unlink d1/de/d15/f16 0 2024-04-26T12:28:45.217 INFO:tasks.workunit.client.0.smithi046.stdout:5/58: mkdir d9/da/d18 0 2024-04-26T12:28:45.217 INFO:tasks.workunit.client.0.smithi046.stdout:6/58: rmdir d7 39 2024-04-26T12:28:45.218 INFO:tasks.workunit.client.0.smithi046.stdout:2/91: symlink d1/d13/d1b/l1e 0 2024-04-26T12:28:45.218 INFO:tasks.workunit.client.0.smithi046.stdout:5/59: dread - d9/fb zero size 2024-04-26T12:28:45.219 INFO:tasks.workunit.client.0.smithi046.stdout:6/59: chown d7/fa 14 1 2024-04-26T12:28:45.219 INFO:tasks.workunit.client.0.smithi046.stdout:5/60: stat d9/da/d15 0 2024-04-26T12:28:45.219 INFO:tasks.workunit.client.0.smithi046.stdout:2/92: symlink d1/de/l1f 0 2024-04-26T12:28:45.220 INFO:tasks.workunit.client.0.smithi046.stdout:6/60: truncate d7/fe 399748 0 2024-04-26T12:28:45.221 INFO:tasks.workunit.client.0.smithi046.stdout:2/93: readlink d1/de/d15/l19 0 2024-04-26T12:28:45.226 INFO:tasks.workunit.client.0.smithi046.stdout:8/31: dwrite f4 [4194304,4194304] 0 2024-04-26T12:28:45.229 INFO:tasks.workunit.client.0.smithi046.stdout:3/85: dwrite d2/f7 [0,4194304] 0 2024-04-26T12:28:45.229 INFO:tasks.workunit.client.0.smithi046.stdout:8/32: dread f4 [0,4194304] 0 2024-04-26T12:28:45.230 INFO:tasks.workunit.client.0.smithi046.stdout:8/33: write f4 [6219915,44946] 0 2024-04-26T12:28:45.237 INFO:tasks.workunit.client.0.smithi046.stdout:5/61: rename d9/c17 to d9/da/d15/c19 0 2024-04-26T12:28:45.237 INFO:tasks.workunit.client.0.smithi046.stdout:6/61: getdents d7 0 2024-04-26T12:28:45.238 INFO:tasks.workunit.client.0.smithi046.stdout:3/86: creat d2/f1d x:0 0 0 2024-04-26T12:28:45.238 INFO:tasks.workunit.client.0.smithi046.stdout:5/62: creat d9/da/d15/f1a x:0 0 0 2024-04-26T12:28:45.238 INFO:tasks.workunit.client.0.smithi046.stdout:6/62: rmdir d7 39 2024-04-26T12:28:45.239 INFO:tasks.workunit.client.0.smithi046.stdout:3/87: chown d2/db/f10 0 1 2024-04-26T12:28:45.239 INFO:tasks.workunit.client.0.smithi046.stdout:5/63: fdatasync d9/da/dd/f13 0 2024-04-26T12:28:45.240 INFO:tasks.workunit.client.0.smithi046.stdout:3/88: mknod d2/d16/d11/d1b/c1e 0 2024-04-26T12:28:45.242 INFO:tasks.workunit.client.0.smithi046.stdout:3/89: rmdir d2/d16/d11 39 2024-04-26T12:28:45.242 INFO:tasks.workunit.client.0.smithi046.stdout:3/90: chown d2/d16/d11/d1b/c1e 89370951 1 2024-04-26T12:28:45.244 INFO:tasks.workunit.client.0.smithi046.stdout:3/91: mkdir d2/d16/d11/d1f 0 2024-04-26T12:28:45.244 INFO:tasks.workunit.client.0.smithi046.stdout:5/64: dwrite f8 [0,4194304] 0 2024-04-26T12:28:45.246 INFO:tasks.workunit.client.0.smithi046.stdout:5/65: creat d9/da/f1b x:0 0 0 2024-04-26T12:28:45.246 INFO:tasks.workunit.client.0.smithi046.stdout:3/92: creat d2/d16/d11/f20 x:0 0 0 2024-04-26T12:28:45.247 INFO:tasks.workunit.client.0.smithi046.stdout:6/63: dwrite d7/fc [0,4194304] 0 2024-04-26T12:28:45.248 INFO:tasks.workunit.client.0.smithi046.stdout:5/66: creat d9/f1c x:0 0 0 2024-04-26T12:28:45.248 INFO:tasks.workunit.client.0.smithi046.stdout:5/67: dread - d9/f1c zero size 2024-04-26T12:28:45.248 INFO:tasks.workunit.client.0.smithi046.stdout:3/93: dread - d2/db/f10 zero size 2024-04-26T12:28:45.249 INFO:tasks.workunit.client.0.smithi046.stdout:5/68: rename c1 to d9/da/dd/c1d 0 2024-04-26T12:28:45.249 INFO:tasks.workunit.client.0.smithi046.stdout:3/94: creat d2/d16/d11/f21 x:0 0 0 2024-04-26T12:28:45.250 INFO:tasks.workunit.client.0.smithi046.stdout:3/95: write d2/f1d [965044,24926] 0 2024-04-26T12:28:45.252 INFO:tasks.workunit.client.0.smithi046.stdout:5/69: write d9/da/dd/ff [763348,75258] 0 2024-04-26T12:28:45.252 INFO:tasks.workunit.client.0.smithi046.stdout:2/94: stat d1/f8 0 2024-04-26T12:28:45.258 INFO:tasks.workunit.client.0.smithi046.stdout:2/95: unlink d1/de/l1f 0 2024-04-26T12:28:45.260 INFO:tasks.workunit.client.0.smithi046.stdout:2/96: write d1/de/d15/d18/f1c [195234,128542] 0 2024-04-26T12:28:45.263 INFO:tasks.workunit.client.0.smithi046.stdout:3/96: dwrite d2/db/fe [0,4194304] 0 2024-04-26T12:28:45.268 INFO:tasks.workunit.client.0.smithi046.stdout:8/34: truncate f4 5251229 0 2024-04-26T12:28:45.268 INFO:tasks.workunit.client.0.smithi046.stdout:2/97: mknod d1/de/c20 0 2024-04-26T12:28:45.268 INFO:tasks.workunit.client.0.smithi046.stdout:3/97: truncate d2/f4 2829960 0 2024-04-26T12:28:45.269 INFO:tasks.workunit.client.0.smithi046.stdout:2/98: chown d1/f4 108463 1 2024-04-26T12:28:45.274 INFO:tasks.workunit.client.0.smithi046.stdout:6/64: dwrite d7/fc [0,4194304] 0 2024-04-26T12:28:45.275 INFO:tasks.workunit.client.0.smithi046.stdout:3/98: getdents d2/db 0 2024-04-26T12:28:45.275 INFO:tasks.workunit.client.0.smithi046.stdout:6/65: chown d7/f14 1489348 1 2024-04-26T12:28:45.275 INFO:tasks.workunit.client.0.smithi046.stdout:3/99: creat d2/d16/d11/d1b/f22 x:0 0 0 2024-04-26T12:28:45.275 INFO:tasks.workunit.client.0.smithi046.stdout:6/66: mkdir d7/d16 0 2024-04-26T12:28:45.275 INFO:tasks.workunit.client.0.smithi046.stdout:8/35: write f4 [1485074,87350] 0 2024-04-26T12:28:45.276 INFO:tasks.workunit.client.0.smithi046.stdout:0/95: sync 2024-04-26T12:28:45.276 INFO:tasks.workunit.client.0.smithi046.stdout:1/34: sync 2024-04-26T12:28:45.276 INFO:tasks.workunit.client.0.smithi046.stdout:9/16: sync 2024-04-26T12:28:45.276 INFO:tasks.workunit.client.0.smithi046.stdout:4/95: sync 2024-04-26T12:28:45.276 INFO:tasks.workunit.client.0.smithi046.stdout:7/81: sync 2024-04-26T12:28:45.276 INFO:tasks.workunit.client.0.smithi046.stdout:6/67: dwrite f5 [0,4194304] 0 2024-04-26T12:28:45.277 INFO:tasks.workunit.client.0.smithi046.stdout:9/17: mkdir d0/d6 0 2024-04-26T12:28:45.278 INFO:tasks.workunit.client.0.smithi046.stdout:1/35: creat d7/db/f10 x:0 0 0 2024-04-26T12:28:45.279 INFO:tasks.workunit.client.0.smithi046.stdout:9/18: dread - d0/f4 zero size 2024-04-26T12:28:45.280 INFO:tasks.workunit.client.0.smithi046.stdout:0/96: link d9/f12 d9/dc/dd/f1e 0 2024-04-26T12:28:45.281 INFO:tasks.workunit.client.0.smithi046.stdout:9/19: chown d0 13 1 2024-04-26T12:28:45.282 INFO:tasks.workunit.client.0.smithi046.stdout:0/97: mknod d9/dc/c1f 0 2024-04-26T12:28:45.284 INFO:tasks.workunit.client.0.smithi046.stdout:8/36: dwrite f4 [4194304,4194304] 0 2024-04-26T12:28:45.284 INFO:tasks.workunit.client.0.smithi046.stdout:3/100: dread d2/f1d [0,4194304] 0 2024-04-26T12:28:45.286 INFO:tasks.workunit.client.0.smithi046.stdout:1/36: getdents d7/db 0 2024-04-26T12:28:45.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/98: unlink f2 0 2024-04-26T12:28:45.292 INFO:tasks.workunit.client.0.smithi046.stdout:3/101: write d2/d16/d11/d1b/f22 [557664,16310] 0 2024-04-26T12:28:45.292 INFO:tasks.workunit.client.0.smithi046.stdout:4/96: dwrite d0/d1/d9/f23 [0,4194304] 0 2024-04-26T12:28:45.293 INFO:tasks.workunit.client.0.smithi046.stdout:6/68: dwrite d7/f13 [0,4194304] 0 2024-04-26T12:28:45.293 INFO:tasks.workunit.client.0.smithi046.stdout:7/82: dwrite d16/d1a/f1b [0,4194304] 0 2024-04-26T12:28:45.295 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:45.293+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:45.296 INFO:tasks.workunit.client.0.smithi046.stdout:0/99: dread f8 [0,4194304] 0 2024-04-26T12:28:45.296 INFO:tasks.workunit.client.0.smithi046.stdout:3/102: mkdir d2/d16/d11/d23 0 2024-04-26T12:28:45.298 INFO:tasks.workunit.client.0.smithi046.stdout:4/97: symlink d0/d1/d9/l28 0 2024-04-26T12:28:45.299 INFO:tasks.workunit.client.0.smithi046.stdout:7/83: write f6 [4770625,22396] 0 2024-04-26T12:28:45.300 INFO:tasks.workunit.client.0.smithi046.stdout:8/37: dread f4 [0,4194304] 0 2024-04-26T12:28:45.300 INFO:tasks.workunit.client.0.smithi046.stdout:3/103: chown d2/d16/d11 63012 1 2024-04-26T12:28:45.300 INFO:tasks.workunit.client.0.smithi046.stdout:4/98: stat d0/f14 0 2024-04-26T12:28:45.300 INFO:tasks.workunit.client.0.smithi046.stdout:9/20: dwrite d0/f4 [0,4194304] 0 2024-04-26T12:28:45.300 INFO:tasks.workunit.client.0.smithi046.stdout:0/100: read f5 [4141027,121397] 0 2024-04-26T12:28:45.301 INFO:tasks.workunit.client.0.smithi046.stdout:7/84: creat d16/d1a/f1d x:0 0 0 2024-04-26T12:28:45.301 INFO:tasks.workunit.client.0.smithi046.stdout:3/104: read - d2/d16/d11/f20 zero size 2024-04-26T12:28:45.301 INFO:tasks.workunit.client.0.smithi046.stdout:0/101: rmdir d9 39 2024-04-26T12:28:45.303 INFO:tasks.workunit.client.0.smithi046.stdout:1/37: dwrite d7/d9/fa [4194304,4194304] 0 2024-04-26T12:28:45.304 INFO:tasks.workunit.client.0.smithi046.stdout:6/69: truncate d7/f13 2773915 0 2024-04-26T12:28:45.304 INFO:tasks.workunit.client.0.smithi046.stdout:7/85: rename l10 to d16/l1e 0 2024-04-26T12:28:45.306 INFO:tasks.workunit.client.0.smithi046.stdout:3/105: mkdir d2/d16/d11/d1f/d24 0 2024-04-26T12:28:45.306 INFO:tasks.workunit.client.0.smithi046.stdout:0/102: creat d9/f20 x:0 0 0 2024-04-26T12:28:45.306 INFO:tasks.workunit.client.0.smithi046.stdout:7/86: chown le 29 1 2024-04-26T12:28:45.308 INFO:tasks.workunit.client.0.smithi046.stdout:1/38: write d7/db/ff [1755840,51377] 0 2024-04-26T12:28:45.309 INFO:tasks.workunit.client.0.smithi046.stdout:3/106: creat d2/db/f25 x:0 0 0 2024-04-26T12:28:45.309 INFO:tasks.workunit.client.0.smithi046.stdout:8/38: dread f4 [0,4194304] 0 2024-04-26T12:28:45.309 INFO:tasks.workunit.client.0.smithi046.stdout:7/87: chown d16/l18 24 1 2024-04-26T12:28:45.309 INFO:tasks.workunit.client.0.smithi046.stdout:0/103: write d9/dc/dd/f13 [3148967,120033] 0 2024-04-26T12:28:45.310 INFO:tasks.workunit.client.0.smithi046.stdout:7/88: readlink l2 0 2024-04-26T12:28:45.311 INFO:tasks.workunit.client.0.smithi046.stdout:1/39: creat d7/d9/f11 x:0 0 0 2024-04-26T12:28:45.311 INFO:tasks.workunit.client.0.smithi046.stdout:9/21: dwrite d0/f5 [0,4194304] 0 2024-04-26T12:28:45.311 INFO:tasks.workunit.client.0.smithi046.stdout:0/104: chown d9/dc/c19 44387 1 2024-04-26T12:28:45.311 INFO:tasks.workunit.client.0.smithi046.stdout:4/99: dwrite d0/d1/d5/db/f10 [0,4194304] 0 2024-04-26T12:28:45.313 INFO:tasks.workunit.client.0.smithi046.stdout:7/89: rmdir d16/d1a 39 2024-04-26T12:28:45.316 INFO:tasks.workunit.client.0.smithi046.stdout:4/100: unlink d0/d1/d5/db/f1f 0 2024-04-26T12:28:45.316 INFO:tasks.workunit.client.0.smithi046.stdout:0/105: symlink d9/l21 0 2024-04-26T12:28:45.317 INFO:tasks.workunit.client.0.smithi046.stdout:1/40: getdents d7 0 2024-04-26T12:28:45.319 INFO:tasks.workunit.client.0.smithi046.stdout:7/90: symlink d16/l1f 0 2024-04-26T12:28:45.320 INFO:tasks.workunit.client.0.smithi046.stdout:4/101: mkdir d0/d1/d29 0 2024-04-26T12:28:45.320 INFO:tasks.workunit.client.0.smithi046.stdout:0/106: mknod d9/c22 0 2024-04-26T12:28:45.323 INFO:tasks.workunit.client.0.smithi046.stdout:8/39: dwrite f4 [8388608,4194304] 0 2024-04-26T12:28:45.323 INFO:tasks.workunit.client.0.smithi046.stdout:1/41: fdatasync d7/d9/fa 0 2024-04-26T12:28:45.327 INFO:tasks.workunit.client.0.smithi046.stdout:1/42: chown d7 164922 1 2024-04-26T12:28:45.328 INFO:tasks.workunit.client.0.smithi046.stdout:3/107: dwrite d2/d16/d11/d1b/f22 [0,4194304] 0 2024-04-26T12:28:45.328 INFO:tasks.workunit.client.0.smithi046.stdout:8/40: chown c5 37696 1 2024-04-26T12:28:45.329 INFO:tasks.workunit.client.0.smithi046.stdout:9/22: dwrite d0/f5 [0,4194304] 0 2024-04-26T12:28:45.329 INFO:tasks.workunit.client.0.smithi046.stdout:1/43: read d7/d9/fa [3867722,28505] 0 2024-04-26T12:28:45.330 INFO:tasks.workunit.client.0.smithi046.stdout:9/23: mknod d0/c7 0 2024-04-26T12:28:45.330 INFO:tasks.workunit.client.0.smithi046.stdout:4/102: dread d0/f6 [0,4194304] 0 2024-04-26T12:28:45.331 INFO:tasks.workunit.client.0.smithi046.stdout:7/91: dread f6 [0,4194304] 0 2024-04-26T12:28:45.332 INFO:tasks.workunit.client.0.smithi046.stdout:8/41: getdents . 0 2024-04-26T12:28:45.332 INFO:tasks.workunit.client.0.smithi046.stdout:9/24: creat d0/d6/f8 x:0 0 0 2024-04-26T12:28:45.332 INFO:tasks.workunit.client.0.smithi046.stdout:4/103: read - d0/f14 zero size 2024-04-26T12:28:45.333 INFO:tasks.workunit.client.0.smithi046.stdout:7/92: dread - f14 zero size 2024-04-26T12:28:45.333 INFO:tasks.workunit.client.0.smithi046.stdout:8/42: mknod c6 0 2024-04-26T12:28:45.333 INFO:tasks.workunit.client.0.smithi046.stdout:9/25: creat d0/f9 x:0 0 0 2024-04-26T12:28:45.334 INFO:tasks.workunit.client.0.smithi046.stdout:0/107: dwrite d9/f10 [0,4194304] 0 2024-04-26T12:28:45.334 INFO:tasks.workunit.client.0.smithi046.stdout:4/104: fsync d0/f6 0 2024-04-26T12:28:45.334 INFO:tasks.workunit.client.0.smithi046.stdout:5/70: sync 2024-04-26T12:28:45.336 INFO:tasks.workunit.client.0.smithi046.stdout:9/26: symlink d0/la 0 2024-04-26T12:28:45.336 INFO:tasks.workunit.client.0.smithi046.stdout:3/108: dread d2/f4 [0,4194304] 0 2024-04-26T12:28:45.337 INFO:tasks.workunit.client.0.smithi046.stdout:5/71: write d9/da/f1b [886550,8787] 0 2024-04-26T12:28:45.337 INFO:tasks.workunit.client.0.smithi046.stdout:9/27: readlink d0/la 0 2024-04-26T12:28:45.339 INFO:tasks.workunit.client.0.smithi046.stdout:4/105: symlink d0/d1d/l2a 0 2024-04-26T12:28:45.339 INFO:tasks.workunit.client.0.smithi046.stdout:1/44: dwrite d7/d9/fa [4194304,4194304] 0 2024-04-26T12:28:45.339 INFO:tasks.workunit.client.0.smithi046.stdout:5/72: chown d9 2024 1 2024-04-26T12:28:45.339 INFO:tasks.workunit.client.0.smithi046.stdout:0/108: rename c1 to d9/d1d/c23 0 2024-04-26T12:28:45.340 INFO:tasks.workunit.client.0.smithi046.stdout:9/28: write d0/f9 [417107,21884] 0 2024-04-26T12:28:45.340 INFO:tasks.workunit.client.0.smithi046.stdout:3/109: creat d2/d16/d11/d23/f26 x:0 0 0 2024-04-26T12:28:45.340 INFO:tasks.workunit.client.0.smithi046.stdout:1/45: mkdir d7/d12 0 2024-04-26T12:28:45.340 INFO:tasks.workunit.client.0.smithi046.stdout:4/106: creat d0/d1/d5/f2b x:0 0 0 2024-04-26T12:28:45.341 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:45.342 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:45.342 INFO:tasks.workunit.client.0.smithi046.stdout:5/73: creat d9/da/dd/f1e x:0 0 0 2024-04-26T12:28:45.342 INFO:tasks.workunit.client.0.smithi046.stdout:4/107: chown d0/d1/d5 232047 1 2024-04-26T12:28:45.343 INFO:tasks.workunit.client.0.smithi046.stdout:3/110: write d2/db/f25 [353820,41040] 0 2024-04-26T12:28:45.343 INFO:tasks.workunit.client.0.smithi046.stdout:8/43: dwrite f4 [0,4194304] 0 2024-04-26T12:28:45.344 INFO:tasks.workunit.client.0.smithi046.stdout:5/74: symlink d9/da/d15/l1f 0 2024-04-26T12:28:45.345 INFO:tasks.workunit.client.0.smithi046.stdout:7/93: dwrite f6 [0,4194304] 0 2024-04-26T12:28:45.345 INFO:tasks.workunit.client.0.smithi046.stdout:8/44: write f4 [13498110,15377] 0 2024-04-26T12:28:45.345 INFO:tasks.workunit.client.0.smithi046.stdout:1/46: getdents d7 0 2024-04-26T12:28:45.346 INFO:tasks.workunit.client.0.smithi046.stdout:3/111: mknod d2/db/c27 0 2024-04-26T12:28:45.347 INFO:tasks.workunit.client.0.smithi046.stdout:8/45: unlink c6 0 2024-04-26T12:28:45.348 INFO:tasks.workunit.client.0.smithi046.stdout:1/47: chown d7/d9/fa 122471 1 2024-04-26T12:28:45.348 INFO:tasks.workunit.client.0.smithi046.stdout:7/94: creat d16/f20 x:0 0 0 2024-04-26T12:28:45.349 INFO:tasks.workunit.client.0.smithi046.stdout:3/112: symlink d2/d16/d11/d1b/l28 0 2024-04-26T12:28:45.350 INFO:tasks.workunit.client.0.smithi046.stdout:0/109: dwrite d9/dc/dd/f13 [0,4194304] 0 2024-04-26T12:28:45.350 INFO:tasks.workunit.client.0.smithi046.stdout:1/48: mknod d7/d12/c13 0 2024-04-26T12:28:45.350 INFO:tasks.workunit.client.0.smithi046.stdout:5/75: dread d9/da/dd/ff [0,4194304] 0 2024-04-26T12:28:45.350 INFO:tasks.workunit.client.0.smithi046.stdout:9/29: dwrite d0/f9 [0,4194304] 0 2024-04-26T12:28:45.351 INFO:tasks.workunit.client.0.smithi046.stdout:5/76: readlink d9/da/d15/l1f 0 2024-04-26T12:28:45.351 INFO:tasks.workunit.client.0.smithi046.stdout:1/49: read d7/d9/fa [4743443,56618] 0 2024-04-26T12:28:45.351 INFO:tasks.workunit.client.0.smithi046.stdout:5/77: stat c7 0 2024-04-26T12:28:45.352 INFO:tasks.workunit.client.0.smithi046.stdout:0/110: dread - d9/dc/f1a zero size 2024-04-26T12:28:45.352 INFO:tasks.workunit.client.0.smithi046.stdout:8/46: truncate f4 12270612 0 2024-04-26T12:28:45.352 INFO:tasks.workunit.client.0.smithi046.stdout:3/113: write d2/db/fe [1417227,27474] 0 2024-04-26T12:28:45.352 INFO:tasks.workunit.client.0.smithi046.stdout:5/78: write d9/f1c [421934,37267] 0 2024-04-26T12:28:45.353 INFO:tasks.workunit.client.0.smithi046.stdout:8/47: mkdir d7 0 2024-04-26T12:28:45.354 INFO:tasks.workunit.client.0.smithi046.stdout:1/50: unlink d7/db/ld 0 2024-04-26T12:28:45.355 INFO:tasks.workunit.client.0.smithi046.stdout:9/30: link d0/la d0/d6/lb 0 2024-04-26T12:28:45.355 INFO:tasks.workunit.client.0.smithi046.stdout:0/111: write d9/dc/dd/f13 [4792471,42139] 0 2024-04-26T12:28:45.355 INFO:tasks.workunit.client.0.smithi046.stdout:1/51: mkdir d7/d14 0 2024-04-26T12:28:45.355 INFO:tasks.workunit.client.0.smithi046.stdout:7/95: dread f3 [0,4194304] 0 2024-04-26T12:28:45.355 INFO:tasks.workunit.client.0.smithi046.stdout:9/31: write d0/f4 [3980106,18544] 0 2024-04-26T12:28:45.355 INFO:tasks.workunit.client.0.smithi046.stdout:9/32: mknod d0/cc 0 2024-04-26T12:28:45.357 INFO:tasks.workunit.client.0.smithi046.stdout:1/52: truncate d7/d9/f11 220442 0 2024-04-26T12:28:45.358 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:45.361 INFO:tasks.workunit.client.0.smithi046.stdout:1/53: write d7/d9/fa [8394080,47414] 0 2024-04-26T12:28:45.363 INFO:tasks.workunit.client.0.smithi046.stdout:1/54: truncate d7/d9/fa 8934073 0 2024-04-26T12:28:45.364 INFO:tasks.workunit.client.0.smithi046.stdout:3/114: dwrite d2/db/f25 [0,4194304] 0 2024-04-26T12:28:45.364 INFO:tasks.workunit.client.0.smithi046.stdout:9/33: dread d0/f9 [0,4194304] 0 2024-04-26T12:28:45.364 INFO:tasks.workunit.client.0.smithi046.stdout:1/55: mknod d7/d9/c15 0 2024-04-26T12:28:45.365 INFO:tasks.workunit.client.0.smithi046.stdout:9/34: stat d0/f4 0 2024-04-26T12:28:45.365 INFO:tasks.workunit.client.0.smithi046.stdout:7/96: dwrite f14 [0,4194304] 0 2024-04-26T12:28:45.366 INFO:tasks.workunit.client.0.smithi046.stdout:3/115: write d2/d16/d11/f20 [748249,84479] 0 2024-04-26T12:28:45.366 INFO:tasks.workunit.client.0.smithi046.stdout:1/56: mknod d7/d12/c16 0 2024-04-26T12:28:45.366 INFO:tasks.workunit.client.0.smithi046.stdout:3/116: rmdir d2/d16/d11/d1b 39 2024-04-26T12:28:45.367 INFO:tasks.workunit.client.0.smithi046.stdout:1/57: write d7/db/f10 [346295,16922] 0 2024-04-26T12:28:45.367 INFO:tasks.workunit.client.0.smithi046.stdout:0/112: truncate d9/dc/dd/f13 2583521 0 2024-04-26T12:28:45.367 INFO:tasks.workunit.client.0.smithi046.stdout:5/79: truncate d9/da/dd/ff 508719 0 2024-04-26T12:28:45.368 INFO:tasks.workunit.client.0.smithi046.stdout:5/80: readlink d9/l11 0 2024-04-26T12:28:45.368 INFO:tasks.workunit.client.0.smithi046.stdout:3/117: read d2/f7 [4800036,52005] 0 2024-04-26T12:28:45.368 INFO:tasks.workunit.client.0.smithi046.stdout:9/35: link d0/la d0/d6/ld 0 2024-04-26T12:28:45.370 INFO:tasks.workunit.client.0.smithi046.stdout:8/48: truncate f4 7936960 0 2024-04-26T12:28:45.370 INFO:tasks.workunit.client.0.smithi046.stdout:1/58: chown d7/db/lc 1568220 1 2024-04-26T12:28:45.370 INFO:tasks.workunit.client.0.smithi046.stdout:5/81: creat d9/da/f20 x:0 0 0 2024-04-26T12:28:45.371 INFO:tasks.workunit.client.0.smithi046.stdout:9/36: mknod d0/ce 0 2024-04-26T12:28:45.371 INFO:tasks.workunit.client.0.smithi046.stdout:5/82: stat d9/da/f20 0 2024-04-26T12:28:45.371 INFO:tasks.workunit.client.0.smithi046.stdout:3/118: unlink d2/d16/d11/f20 0 2024-04-26T12:28:45.371 INFO:tasks.workunit.client.0.smithi046.stdout:0/113: truncate d9/f12 3253407 0 2024-04-26T12:28:45.372 INFO:tasks.workunit.client.0.smithi046.stdout:1/59: creat d7/d9/f17 x:0 0 0 2024-04-26T12:28:45.372 INFO:tasks.workunit.client.0.smithi046.stdout:8/49: creat d7/f8 x:0 0 0 2024-04-26T12:28:45.372 INFO:tasks.workunit.client.0.smithi046.stdout:5/83: write f2 [819888,120920] 0 2024-04-26T12:28:45.374 INFO:tasks.workunit.client.0.smithi046.stdout:0/114: creat d9/dc/dd/f24 x:0 0 0 2024-04-26T12:28:45.374 INFO:tasks.workunit.client.0.smithi046.stdout:7/97: dwrite f4 [0,4194304] 0 2024-04-26T12:28:45.374 INFO:tasks.workunit.client.0.smithi046.stdout:1/60: write d7/db/ff [539651,35777] 0 2024-04-26T12:28:45.374 INFO:tasks.workunit.client.0.smithi046.stdout:3/119: mknod d2/d16/d11/d1b/c29 0 2024-04-26T12:28:45.374 INFO:tasks.workunit.client.0.smithi046.stdout:5/84: rmdir d9 39 2024-04-26T12:28:45.375 INFO:tasks.workunit.client.0.smithi046.stdout:3/120: readlink d2/d16/l12 0 2024-04-26T12:28:45.375 INFO:tasks.workunit.client.0.smithi046.stdout:0/115: rmdir d9/d1d 39 2024-04-26T12:28:45.377 INFO:tasks.workunit.client.0.smithi046.stdout:1/61: creat d7/d9/f18 x:0 0 0 2024-04-26T12:28:45.377 INFO:tasks.workunit.client.0.smithi046.stdout:5/85: dread - d9/da/f20 zero size 2024-04-26T12:28:45.377 INFO:tasks.workunit.client.0.smithi046.stdout:3/121: read d2/f8 [454936,73753] 0 2024-04-26T12:28:45.378 INFO:tasks.workunit.client.0.smithi046.stdout:0/116: dread - d9/dc/dd/f24 zero size 2024-04-26T12:28:45.378 INFO:tasks.workunit.client.0.smithi046.stdout:7/98: link l7 d16/l21 0 2024-04-26T12:28:45.380 INFO:tasks.workunit.client.0.smithi046.stdout:1/62: write d7/d9/fa [4315800,30986] 0 2024-04-26T12:28:45.380 INFO:tasks.workunit.client.0.smithi046.stdout:5/86: dread - d9/da/d15/f1a zero size 2024-04-26T12:28:45.380 INFO:tasks.workunit.client.0.smithi046.stdout:8/50: dwrite d7/f8 [0,4194304] 0 2024-04-26T12:28:45.381 INFO:tasks.workunit.client.0.smithi046.stdout:0/117: unlink d9/dc/c1f 0 2024-04-26T12:28:45.381 INFO:tasks.workunit.client.0.smithi046.stdout:9/37: dwrite d0/f9 [4194304,4194304] 0 2024-04-26T12:28:45.381 INFO:tasks.workunit.client.0.smithi046.stdout:8/51: stat f4 0 2024-04-26T12:28:45.381 INFO:tasks.workunit.client.0.smithi046.stdout:3/122: write d2/db/fe [3081445,126163] 0 2024-04-26T12:28:45.382 INFO:tasks.workunit.client.0.smithi046.stdout:0/118: readlink d9/dc/lf 0 2024-04-26T12:28:45.382 INFO:tasks.workunit.client.0.smithi046.stdout:1/63: write d7/d9/f17 [224088,129526] 0 2024-04-26T12:28:45.383 INFO:tasks.workunit.client.0.smithi046.stdout:9/38: creat d0/d6/ff x:0 0 0 2024-04-26T12:28:45.383 INFO:tasks.workunit.client.0.smithi046.stdout:8/52: link l3 d7/l9 0 2024-04-26T12:28:45.383 INFO:tasks.workunit.client.0.smithi046.stdout:3/123: chown d2/db/f10 731323 1 2024-04-26T12:28:45.385 INFO:tasks.workunit.client.0.smithi046.stdout:5/87: truncate d9/f1c 285626 0 2024-04-26T12:28:45.385 INFO:tasks.workunit.client.0.smithi046.stdout:0/119: creat d9/dc/dd/f25 x:0 0 0 2024-04-26T12:28:45.385 INFO:tasks.workunit.client.0.smithi046.stdout:1/64: creat d7/d14/f19 x:0 0 0 2024-04-26T12:28:45.385 INFO:tasks.workunit.client.0.smithi046.stdout:3/124: truncate d2/f1d 1491743 0 2024-04-26T12:28:45.385 INFO:tasks.workunit.client.0.smithi046.stdout:9/39: creat d0/f10 x:0 0 0 2024-04-26T12:28:45.385 INFO:tasks.workunit.client.0.smithi046.stdout:8/53: mkdir d7/da 0 2024-04-26T12:28:45.386 INFO:tasks.workunit.client.0.smithi046.stdout:7/99: dread f3 [0,4194304] 0 2024-04-26T12:28:45.386 INFO:tasks.workunit.client.0.smithi046.stdout:0/120: creat d9/dc/f26 x:0 0 0 2024-04-26T12:28:45.387 INFO:tasks.workunit.client.0.smithi046.stdout:9/40: write d0/f10 [974280,101063] 0 2024-04-26T12:28:45.387 INFO:tasks.workunit.client.0.smithi046.stdout:8/54: chown d7/da 1 1 2024-04-26T12:28:45.387 INFO:tasks.workunit.client.0.smithi046.stdout:1/65: creat d7/d9/f1a x:0 0 0 2024-04-26T12:28:45.388 INFO:tasks.workunit.client.0.smithi046.stdout:0/121: dread - d9/dc/f26 zero size 2024-04-26T12:28:45.388 INFO:tasks.workunit.client.0.smithi046.stdout:3/125: rename d2/d16/d11/f21 to d2/d16/d11/d23/f2a 0 2024-04-26T12:28:45.388 INFO:tasks.workunit.client.0.smithi046.stdout:8/55: write f4 [2887300,34427] 0 2024-04-26T12:28:45.388 INFO:tasks.workunit.client.0.smithi046.stdout:8/56: stat d7 0 2024-04-26T12:28:45.389 INFO:tasks.workunit.client.0.smithi046.stdout:9/41: symlink d0/l11 0 2024-04-26T12:28:45.389 INFO:tasks.workunit.client.0.smithi046.stdout:7/100: mknod d16/d1c/c22 0 2024-04-26T12:28:45.392 INFO:tasks.workunit.client.0.smithi046.stdout:0/122: rename d9/dc/dd/f1e to d9/dc/dd/f27 0 2024-04-26T12:28:45.394 INFO:tasks.workunit.client.0.smithi046.stdout:6/70: sync 2024-04-26T12:28:45.394 INFO:tasks.workunit.client.0.smithi046.stdout:2/99: sync 2024-04-26T12:28:45.399 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:45.393+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:45.400 INFO:tasks.workunit.client.0.smithi046.stdout:5/88: dread d9/da/f1b [0,4194304] 0 2024-04-26T12:28:45.400 INFO:tasks.workunit.client.0.smithi046.stdout:0/123: write d9/fa [2790000,76536] 0 2024-04-26T12:28:45.400 INFO:tasks.workunit.client.0.smithi046.stdout:7/101: rename d16/d1a/f1d to d16/f23 0 2024-04-26T12:28:45.400 INFO:tasks.workunit.client.0.smithi046.stdout:6/71: mknod d7/d16/c17 0 2024-04-26T12:28:45.400 INFO:tasks.workunit.client.0.smithi046.stdout:2/100: write d1/d13/f1d [726735,73805] 0 2024-04-26T12:28:45.400 INFO:tasks.workunit.client.0.smithi046.stdout:5/89: chown d9/da/d15/l1f 20331 1 2024-04-26T12:28:45.400 INFO:tasks.workunit.client.0.smithi046.stdout:1/66: dwrite d7/d9/f18 [0,4194304] 0 2024-04-26T12:28:45.401 INFO:tasks.workunit.client.0.smithi046.stdout:3/126: dwrite d2/db/fe [0,4194304] 0 2024-04-26T12:28:45.402 INFO:tasks.workunit.client.0.smithi046.stdout:8/57: dwrite d7/f8 [0,4194304] 0 2024-04-26T12:28:45.403 INFO:tasks.workunit.client.0.smithi046.stdout:0/124: fdatasync d9/dc/dd/f13 0 2024-04-26T12:28:45.403 INFO:tasks.workunit.client.0.smithi046.stdout:6/72: symlink d7/d16/l18 0 2024-04-26T12:28:45.403 INFO:tasks.workunit.client.0.smithi046.stdout:7/102: rmdir d16 39 2024-04-26T12:28:45.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/42: dwrite d0/d6/ff [0,4194304] 0 2024-04-26T12:28:45.405 INFO:tasks.workunit.client.0.smithi046.stdout:6/73: chown d7/fe 739078810 1 2024-04-26T12:28:45.406 INFO:tasks.workunit.client.0.smithi046.stdout:7/103: unlink lf 0 2024-04-26T12:28:45.407 INFO:tasks.workunit.client.0.smithi046.stdout:0/125: read d9/f12 [2818872,40328] 0 2024-04-26T12:28:45.407 INFO:tasks.workunit.client.0.smithi046.stdout:2/101: link d1/de/c20 d1/de/d15/c21 0 2024-04-26T12:28:45.408 INFO:tasks.workunit.client.0.smithi046.stdout:6/74: mkdir d7/d19 0 2024-04-26T12:28:45.410 INFO:tasks.workunit.client.0.smithi046.stdout:2/102: mknod d1/d13/c22 0 2024-04-26T12:28:45.412 INFO:tasks.workunit.client.0.smithi046.stdout:7/104: chown l1 480 1 2024-04-26T12:28:45.416 INFO:tasks.workunit.client.0.smithi046.stdout:4/108: sync 2024-04-26T12:28:45.416 INFO:tasks.workunit.client.0.smithi046.stdout:2/103: mknod d1/de/d15/d18/c23 0 2024-04-26T12:28:45.417 INFO:tasks.workunit.client.0.smithi046.stdout:1/67: dwrite d7/db/f10 [0,4194304] 0 2024-04-26T12:28:45.420 INFO:tasks.workunit.client.0.smithi046.stdout:9/43: dread d0/f9 [0,4194304] 0 2024-04-26T12:28:45.421 INFO:tasks.workunit.client.0.smithi046.stdout:7/105: dread f12 [0,4194304] 0 2024-04-26T12:28:45.422 INFO:tasks.workunit.client.0.smithi046.stdout:2/104: truncate d1/f4 5094868 0 2024-04-26T12:28:45.422 INFO:tasks.workunit.client.0.smithi046.stdout:1/68: symlink d7/d12/l1b 0 2024-04-26T12:28:45.423 INFO:tasks.workunit.client.0.smithi046.stdout:3/127: dwrite d2/d16/d11/d23/f26 [0,4194304] 0 2024-04-26T12:28:45.423 INFO:tasks.workunit.client.0.smithi046.stdout:0/126: dread d9/dc/dd/f14 [0,4194304] 0 2024-04-26T12:28:45.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/58: dwrite f4 [0,4194304] 0 2024-04-26T12:28:45.424 INFO:tasks.workunit.client.0.smithi046.stdout:8/59: chown d7/da 1175617 1 2024-04-26T12:28:45.424 INFO:tasks.workunit.client.0.smithi046.stdout:9/44: rename d0/c7 to d0/c12 0 2024-04-26T12:28:45.425 INFO:tasks.workunit.client.0.smithi046.stdout:5/90: dwrite d9/f1c [0,4194304] 0 2024-04-26T12:28:45.425 INFO:tasks.workunit.client.0.smithi046.stdout:7/106: creat d16/d1c/f24 x:0 0 0 2024-04-26T12:28:45.425 INFO:tasks.workunit.client.0.smithi046.stdout:3/128: creat d2/db/f2b x:0 0 0 2024-04-26T12:28:45.425 INFO:tasks.workunit.client.0.smithi046.stdout:1/69: mkdir d7/d14/d1c 0 2024-04-26T12:28:45.426 INFO:tasks.workunit.client.0.smithi046.stdout:2/105: creat d1/d13/d1b/f24 x:0 0 0 2024-04-26T12:28:45.426 INFO:tasks.workunit.client.0.smithi046.stdout:7/107: unlink d16/l18 0 2024-04-26T12:28:45.426 INFO:tasks.workunit.client.0.smithi046.stdout:8/60: creat d7/fb x:0 0 0 2024-04-26T12:28:45.427 INFO:tasks.workunit.client.0.smithi046.stdout:3/129: read d2/f4 [2390581,99564] 0 2024-04-26T12:28:45.427 INFO:tasks.workunit.client.0.smithi046.stdout:1/70: symlink d7/d12/l1d 0 2024-04-26T12:28:45.428 INFO:tasks.workunit.client.0.smithi046.stdout:9/45: creat d0/d6/f13 x:0 0 0 2024-04-26T12:28:45.428 INFO:tasks.workunit.client.0.smithi046.stdout:2/106: write d1/de/ff [4196614,85193] 0 2024-04-26T12:28:45.428 INFO:tasks.workunit.client.0.smithi046.stdout:5/91: write d9/da/f1b [1692968,25080] 0 2024-04-26T12:28:45.428 INFO:tasks.workunit.client.0.smithi046.stdout:6/75: dwrite d7/f13 [0,4194304] 0 2024-04-26T12:28:45.428 INFO:tasks.workunit.client.0.smithi046.stdout:4/109: dread d0/da/fd [0,4194304] 0 2024-04-26T12:28:45.429 INFO:tasks.workunit.client.0.smithi046.stdout:7/108: mknod d16/d1a/c25 0 2024-04-26T12:28:45.429 INFO:tasks.workunit.client.0.smithi046.stdout:3/130: mkdir d2/d16/d2c 0 2024-04-26T12:28:45.430 INFO:tasks.workunit.client.0.smithi046.stdout:8/61: rmdir d7 39 2024-04-26T12:28:45.431 INFO:tasks.workunit.client.0.smithi046.stdout:9/46: truncate d0/f10 1129668 0 2024-04-26T12:28:45.431 INFO:tasks.workunit.client.0.smithi046.stdout:2/107: rmdir d1/de 39 2024-04-26T12:28:45.431 INFO:tasks.workunit.client.0.smithi046.stdout:5/92: creat d9/da/d15/f21 x:0 0 0 2024-04-26T12:28:45.433 INFO:tasks.workunit.client.0.smithi046.stdout:4/110: mknod d0/d1/d29/c2c 0 2024-04-26T12:28:45.433 INFO:tasks.workunit.client.0.smithi046.stdout:2/108: mknod d1/d13/c25 0 2024-04-26T12:28:45.433 INFO:tasks.workunit.client.0.smithi046.stdout:9/47: symlink d0/d6/l14 0 2024-04-26T12:28:45.434 INFO:tasks.workunit.client.0.smithi046.stdout:6/76: rmdir d7/d19 0 2024-04-26T12:28:45.435 INFO:tasks.workunit.client.0.smithi046.stdout:5/93: stat d9/da/dd/ff 0 2024-04-26T12:28:45.435 INFO:tasks.workunit.client.0.smithi046.stdout:1/71: getdents d7/d14 0 2024-04-26T12:28:45.435 INFO:tasks.workunit.client.0.smithi046.stdout:7/109: rename d16/d1a/f1b to d16/d1c/f26 0 2024-04-26T12:28:45.435 INFO:tasks.workunit.client.0.smithi046.stdout:6/77: rename d7 to d7/d16/d1a 22 2024-04-26T12:28:45.436 INFO:tasks.workunit.client.0.smithi046.stdout:9/48: creat d0/f15 x:0 0 0 2024-04-26T12:28:45.436 INFO:tasks.workunit.client.0.smithi046.stdout:4/111: symlink d0/da/d17/d20/d25/l2d 0 2024-04-26T12:28:45.437 INFO:tasks.workunit.client.0.smithi046.stdout:0/127: dwrite d9/dc/dd/f14 [0,4194304] 0 2024-04-26T12:28:45.437 INFO:tasks.workunit.client.0.smithi046.stdout:2/109: write d1/de/f11 [428027,47881] 0 2024-04-26T12:28:45.437 INFO:tasks.workunit.client.0.smithi046.stdout:7/110: write f9 [1101365,125120] 0 2024-04-26T12:28:45.437 INFO:tasks.workunit.client.0.smithi046.stdout:5/94: write d9/da/dd/f1e [69239,127963] 0 2024-04-26T12:28:45.438 INFO:tasks.workunit.client.0.smithi046.stdout:5/95: chown d9/da/dd/f1e 1 1 2024-04-26T12:28:45.439 INFO:tasks.workunit.client.0.smithi046.stdout:6/78: mkdir d7/d1b 0 2024-04-26T12:28:45.439 INFO:tasks.workunit.client.0.smithi046.stdout:3/131: truncate d2/d16/d11/d1b/f22 1874552 0 2024-04-26T12:28:45.443 INFO:tasks.workunit.client.0.smithi046.stdout:8/62: truncate d7/f8 3584311 0 2024-04-26T12:28:45.443 INFO:tasks.workunit.client.0.smithi046.stdout:1/72: getdents d7/d14 0 2024-04-26T12:28:45.444 INFO:tasks.workunit.client.0.smithi046.stdout:4/112: sync 2024-04-26T12:28:45.444 INFO:tasks.workunit.client.0.smithi046.stdout:5/96: symlink d9/da/d15/l22 0 2024-04-26T12:28:45.444 INFO:tasks.workunit.client.0.smithi046.stdout:6/79: rename d7/fc to d7/d16/f1c 0 2024-04-26T12:28:45.444 INFO:tasks.workunit.client.0.smithi046.stdout:1/73: readlink l5 0 2024-04-26T12:28:45.444 INFO:tasks.workunit.client.0.smithi046.stdout:8/63: mkdir d7/dc 0 2024-04-26T12:28:45.444 INFO:tasks.workunit.client.0.smithi046.stdout:4/113: fdatasync d0/d1/d9/f13 0 2024-04-26T12:28:45.444 INFO:tasks.workunit.client.0.smithi046.stdout:7/111: getdents d16 0 2024-04-26T12:28:45.445 INFO:tasks.workunit.client.0.smithi046.stdout:8/64: fsync d7/fb 0 2024-04-26T12:28:45.445 INFO:tasks.workunit.client.0.smithi046.stdout:5/97: symlink d9/da/l23 0 2024-04-26T12:28:45.448 INFO:tasks.workunit.client.0.smithi046.stdout:6/80: mknod d7/d1b/c1d 0 2024-04-26T12:28:45.448 INFO:tasks.workunit.client.0.smithi046.stdout:7/112: mkdir d16/d27 0 2024-04-26T12:28:45.448 INFO:tasks.workunit.client.0.smithi046.stdout:8/65: mknod d7/cd 0 2024-04-26T12:28:45.448 INFO:tasks.workunit.client.0.smithi046.stdout:2/110: dread d1/de/ff [0,4194304] 0 2024-04-26T12:28:45.448 INFO:tasks.workunit.client.0.smithi046.stdout:0/128: dread d9/dc/f1c [0,4194304] 0 2024-04-26T12:28:45.448 INFO:tasks.workunit.client.0.smithi046.stdout:9/49: dwrite d0/f10 [0,4194304] 0 2024-04-26T12:28:45.449 INFO:tasks.workunit.client.0.smithi046.stdout:6/81: write f5 [1986648,36708] 0 2024-04-26T12:28:45.449 INFO:tasks.workunit.client.0.smithi046.stdout:5/98: creat d9/da/d18/f24 x:0 0 0 2024-04-26T12:28:45.449 INFO:tasks.workunit.client.0.smithi046.stdout:4/114: truncate d0/d1/d9/f13 1638435 0 2024-04-26T12:28:45.449 INFO:tasks.workunit.client.0.smithi046.stdout:8/66: write d7/fb [415572,72966] 0 2024-04-26T12:28:45.449 INFO:tasks.workunit.client.0.smithi046.stdout:6/82: dread - d7/fa zero size 2024-04-26T12:28:45.449 INFO:tasks.workunit.client.0.smithi046.stdout:0/129: mknod d9/dc/dd/c28 0 2024-04-26T12:28:45.449 INFO:tasks.workunit.client.0.smithi046.stdout:6/83: dread - d7/f15 zero size 2024-04-26T12:28:45.449 INFO:tasks.workunit.client.0.smithi046.stdout:0/130: read f3 [1309528,11276] 0 2024-04-26T12:28:45.451 INFO:tasks.workunit.client.0.smithi046.stdout:9/50: truncate d0/f5 4977403 0 2024-04-26T12:28:45.451 INFO:tasks.workunit.client.0.smithi046.stdout:2/111: mknod d1/c26 0 2024-04-26T12:28:45.451 INFO:tasks.workunit.client.0.smithi046.stdout:2/112: sync 2024-04-26T12:28:45.451 INFO:tasks.workunit.client.0.smithi046.stdout:5/99: unlink d9/da/dd/c16 0 2024-04-26T12:28:45.451 INFO:tasks.workunit.client.0.smithi046.stdout:6/84: fdatasync d7/f8 0 2024-04-26T12:28:45.451 INFO:tasks.workunit.client.0.smithi046.stdout:3/132: dread d2/db/f13 [0,4194304] 0 2024-04-26T12:28:45.453 INFO:tasks.workunit.client.0.smithi046.stdout:9/51: unlink d0/cc 0 2024-04-26T12:28:45.453 INFO:tasks.workunit.client.0.smithi046.stdout:2/113: chown d1/f2 80582 1 2024-04-26T12:28:45.453 INFO:tasks.workunit.client.0.smithi046.stdout:1/74: dwrite d7/d9/f18 [0,4194304] 0 2024-04-26T12:28:45.453 INFO:tasks.workunit.client.0.smithi046.stdout:6/85: creat d7/f1e x:0 0 0 2024-04-26T12:28:45.454 INFO:tasks.workunit.client.0.smithi046.stdout:3/133: mkdir d2/d16/d11/d1b/d2d 0 2024-04-26T12:28:45.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/52: dread - d0/d6/f13 zero size 2024-04-26T12:28:45.455 INFO:tasks.workunit.client.0.smithi046.stdout:2/114: creat d1/de/f27 x:0 0 0 2024-04-26T12:28:45.455 INFO:tasks.workunit.client.0.smithi046.stdout:0/131: truncate d9/dc/f1a 587446 0 2024-04-26T12:28:45.455 INFO:tasks.workunit.client.0.smithi046.stdout:1/75: mknod d7/d12/c1e 0 2024-04-26T12:28:45.455 INFO:tasks.workunit.client.0.smithi046.stdout:6/86: dread - d7/fa zero size 2024-04-26T12:28:45.456 INFO:tasks.workunit.client.0.smithi046.stdout:6/87: write d7/fb [214099,14833] 0 2024-04-26T12:28:45.456 INFO:tasks.workunit.client.0.smithi046.stdout:1/76: creat d7/d12/f1f x:0 0 0 2024-04-26T12:28:45.456 INFO:tasks.workunit.client.0.smithi046.stdout:1/77: sync 2024-04-26T12:28:45.457 INFO:tasks.workunit.client.0.smithi046.stdout:0/132: creat d9/f29 x:0 0 0 2024-04-26T12:28:45.457 INFO:tasks.workunit.client.0.smithi046.stdout:0/133: sync 2024-04-26T12:28:45.457 INFO:tasks.workunit.client.0.smithi046.stdout:6/88: mknod d7/c1f 0 2024-04-26T12:28:45.458 INFO:tasks.workunit.client.0.smithi046.stdout:2/115: getdents d1/de/d15/d18 0 2024-04-26T12:28:45.458 INFO:tasks.workunit.client.0.smithi046.stdout:4/115: dwrite d0/d1/f15 [0,4194304] 0 2024-04-26T12:28:45.459 INFO:tasks.workunit.client.0.smithi046.stdout:1/78: write d7/d9/f17 [550412,124126] 0 2024-04-26T12:28:45.460 INFO:tasks.workunit.client.0.smithi046.stdout:6/89: creat d7/f20 x:0 0 0 2024-04-26T12:28:45.460 INFO:tasks.workunit.client.0.smithi046.stdout:2/116: fdatasync d1/f4 0 2024-04-26T12:28:45.460 INFO:tasks.workunit.client.0.smithi046.stdout:4/116: stat d0/d1/d5/c8 0 2024-04-26T12:28:45.461 INFO:tasks.workunit.client.0.smithi046.stdout:5/100: dwrite f8 [0,4194304] 0 2024-04-26T12:28:45.461 INFO:tasks.workunit.client.0.smithi046.stdout:4/117: fsync d0/d1/d5/f11 0 2024-04-26T12:28:45.462 INFO:tasks.workunit.client.0.smithi046.stdout:9/53: dread d0/f10 [0,4194304] 0 2024-04-26T12:28:45.463 INFO:tasks.workunit.client.0.smithi046.stdout:3/134: write d2/f8 [1318186,86468] 0 2024-04-26T12:28:45.463 INFO:tasks.workunit.client.0.smithi046.stdout:7/113: mknod d16/d27/c28 0 2024-04-26T12:28:45.463 INFO:tasks.workunit.client.0.smithi046.stdout:1/79: mknod d7/c20 0 2024-04-26T12:28:45.463 INFO:tasks.workunit.client.0.smithi046.stdout:6/90: truncate d7/f15 399247 0 2024-04-26T12:28:45.466 INFO:tasks.workunit.client.0.smithi046.stdout:2/117: fdatasync d1/de/ff 0 2024-04-26T12:28:45.466 INFO:tasks.workunit.client.0.smithi046.stdout:8/67: write d7/f8 [1492067,121663] 0 2024-04-26T12:28:45.466 INFO:tasks.workunit.client.0.smithi046.stdout:1/80: read d7/d9/f18 [3518169,16747] 0 2024-04-26T12:28:45.466 INFO:tasks.workunit.client.0.smithi046.stdout:9/54: read d0/f9 [7725991,123669] 0 2024-04-26T12:28:45.466 INFO:tasks.workunit.client.0.smithi046.stdout:4/118: mknod d0/d1/d5/db/c2e 0 2024-04-26T12:28:45.467 INFO:tasks.workunit.client.0.smithi046.stdout:6/91: symlink d7/d16/l21 0 2024-04-26T12:28:45.467 INFO:tasks.workunit.client.0.smithi046.stdout:7/114: symlink d16/d27/l29 0 2024-04-26T12:28:45.467 INFO:tasks.workunit.client.0.smithi046.stdout:4/119: read d0/da/fd [1216518,123068] 0 2024-04-26T12:28:45.467 INFO:tasks.workunit.client.0.smithi046.stdout:1/81: creat d7/d12/f21 x:0 0 0 2024-04-26T12:28:45.468 INFO:tasks.workunit.client.0.smithi046.stdout:8/68: write d7/fb [963129,93175] 0 2024-04-26T12:28:45.468 INFO:tasks.workunit.client.0.smithi046.stdout:0/134: dwrite f3 [0,4194304] 0 2024-04-26T12:28:45.469 INFO:tasks.workunit.client.0.smithi046.stdout:2/118: write d1/de/d15/d18/f1c [117498,116769] 0 2024-04-26T12:28:45.470 INFO:tasks.workunit.client.0.smithi046.stdout:4/120: creat d0/d1/d5/db/f2f x:0 0 0 2024-04-26T12:28:45.471 INFO:tasks.workunit.client.0.smithi046.stdout:7/115: read d16/d1c/f26 [925030,123473] 0 2024-04-26T12:28:45.471 INFO:tasks.workunit.client.0.smithi046.stdout:3/135: dread d2/d16/d11/d1b/f22 [0,4194304] 0 2024-04-26T12:28:45.471 INFO:tasks.workunit.client.0.smithi046.stdout:0/135: fdatasync d9/dc/dd/f24 0 2024-04-26T12:28:45.471 INFO:tasks.workunit.client.0.smithi046.stdout:1/82: truncate d7/d12/f21 1032233 0 2024-04-26T12:28:45.471 INFO:tasks.workunit.client.0.smithi046.stdout:2/119: unlink d1/d13/f1d 0 2024-04-26T12:28:45.473 INFO:tasks.workunit.client.0.smithi046.stdout:0/136: fsync d9/f10 0 2024-04-26T12:28:45.473 INFO:tasks.workunit.client.0.smithi046.stdout:8/69: mknod d7/dc/ce 0 2024-04-26T12:28:45.474 INFO:tasks.workunit.client.0.smithi046.stdout:6/92: getdents d7/d16 0 2024-04-26T12:28:45.474 INFO:tasks.workunit.client.0.smithi046.stdout:3/136: symlink d2/db/l2e 0 2024-04-26T12:28:45.475 INFO:tasks.workunit.client.0.smithi046.stdout:4/121: unlink d0/f2 0 2024-04-26T12:28:45.475 INFO:tasks.workunit.client.0.smithi046.stdout:2/120: chown d1/f4 327135 1 2024-04-26T12:28:45.475 INFO:tasks.workunit.client.0.smithi046.stdout:8/70: stat d7/cd 0 2024-04-26T12:28:45.475 INFO:tasks.workunit.client.0.smithi046.stdout:7/116: creat d16/d1c/f2a x:0 0 0 2024-04-26T12:28:45.475 INFO:tasks.workunit.client.0.smithi046.stdout:5/101: dwrite d9/da/f20 [0,4194304] 0 2024-04-26T12:28:45.475 INFO:tasks.workunit.client.0.smithi046.stdout:1/83: creat d7/d12/f22 x:0 0 0 2024-04-26T12:28:45.476 INFO:tasks.workunit.client.0.smithi046.stdout:6/93: mkdir d7/d1b/d22 0 2024-04-26T12:28:45.476 INFO:tasks.workunit.client.0.smithi046.stdout:9/55: dwrite d0/d6/f8 [0,4194304] 0 2024-04-26T12:28:45.477 INFO:tasks.workunit.client.0.smithi046.stdout:8/71: truncate d7/fb 1641162 0 2024-04-26T12:28:45.477 INFO:tasks.workunit.client.0.smithi046.stdout:1/84: read d7/db/f10 [332664,96674] 0 2024-04-26T12:28:45.478 INFO:tasks.workunit.client.0.smithi046.stdout:5/102: rename d9/fb to d9/da/d18/f25 0 2024-04-26T12:28:45.479 INFO:tasks.workunit.client.0.smithi046.stdout:9/56: mkdir d0/d16 0 2024-04-26T12:28:45.480 INFO:tasks.workunit.client.0.smithi046.stdout:1/85: creat d7/d14/f23 x:0 0 0 2024-04-26T12:28:45.481 INFO:tasks.workunit.client.0.smithi046.stdout:8/72: mkdir d7/da/df 0 2024-04-26T12:28:45.481 INFO:tasks.workunit.client.0.smithi046.stdout:2/121: link d1/c26 d1/c28 0 2024-04-26T12:28:45.483 INFO:tasks.workunit.client.0.smithi046.stdout:5/103: write d9/da/f20 [2565287,64728] 0 2024-04-26T12:28:45.484 INFO:tasks.workunit.client.0.smithi046.stdout:6/94: rmdir d7 39 2024-04-26T12:28:45.484 INFO:tasks.workunit.client.0.smithi046.stdout:1/86: fsync d7/d12/f21 0 2024-04-26T12:28:45.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/104: stat d9/f1c 0 2024-04-26T12:28:45.486 INFO:tasks.workunit.client.0.smithi046.stdout:2/122: write d1/de/ff [4777036,113151] 0 2024-04-26T12:28:45.487 INFO:tasks.workunit.client.0.smithi046.stdout:9/57: unlink d0/f9 0 2024-04-26T12:28:45.487 INFO:tasks.workunit.client.0.smithi046.stdout:2/123: sync 2024-04-26T12:28:45.487 INFO:tasks.workunit.client.0.smithi046.stdout:0/137: dwrite d9/dc/dd/f13 [0,4194304] 0 2024-04-26T12:28:45.487 INFO:tasks.workunit.client.0.smithi046.stdout:9/58: sync 2024-04-26T12:28:45.487 INFO:tasks.workunit.client.0.smithi046.stdout:3/137: dwrite d2/db/f2b [0,4194304] 0 2024-04-26T12:28:45.490 INFO:tasks.workunit.client.0.smithi046.stdout:4/122: dwrite d0/da/f22 [0,4194304] 0 2024-04-26T12:28:45.490 INFO:tasks.workunit.client.0.smithi046.stdout:3/138: fdatasync d2/db/f10 0 2024-04-26T12:28:45.491 INFO:tasks.workunit.client.0.smithi046.stdout:9/59: truncate d0/f15 529961 0 2024-04-26T12:28:45.492 INFO:tasks.workunit.client.0.smithi046.stdout:7/117: dwrite d16/d1c/f26 [0,4194304] 0 2024-04-26T12:28:45.493 INFO:tasks.workunit.client.0.smithi046.stdout:1/87: getdents d7/d9 0 2024-04-26T12:28:45.494 INFO:tasks.workunit.client.0.smithi046.stdout:2/124: rename d1/c10 to d1/de/d15/c29 0 2024-04-26T12:28:45.494 INFO:tasks.workunit.client.0.smithi046.stdout:3/139: write d2/f17 [80855,43014] 0 2024-04-26T12:28:45.494 INFO:tasks.workunit.client.0.smithi046.stdout:9/60: symlink d0/d6/l17 0 2024-04-26T12:28:45.495 INFO:tasks.workunit.client.0.smithi046.stdout:6/95: truncate d7/f14 190793 0 2024-04-26T12:28:45.495 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:45.493+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:45.495 INFO:tasks.workunit.client.0.smithi046.stdout:2/125: chown d1/de/c14 536654366 1 2024-04-26T12:28:45.497 INFO:tasks.workunit.client.0.smithi046.stdout:6/96: readlink l6 0 2024-04-26T12:28:45.497 INFO:tasks.workunit.client.0.smithi046.stdout:3/140: mknod d2/d16/d11/d1f/c2f 0 2024-04-26T12:28:45.499 INFO:tasks.workunit.client.0.smithi046.stdout:1/88: write d7/db/f10 [1229392,28216] 0 2024-04-26T12:28:45.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/141: mkdir d2/d16/d11/d30 0 2024-04-26T12:28:45.500 INFO:tasks.workunit.client.0.smithi046.stdout:6/97: unlink d7/d1b/c1d 0 2024-04-26T12:28:45.501 INFO:tasks.workunit.client.0.smithi046.stdout:2/126: rename d1/de/d15/d18/f1c to d1/de/d15/d18/f2a 0 2024-04-26T12:28:45.501 INFO:tasks.workunit.client.0.smithi046.stdout:1/89: fdatasync d7/d14/f19 0 2024-04-26T12:28:45.501 INFO:tasks.workunit.client.0.smithi046.stdout:5/105: dwrite d9/da/d15/f1a [0,4194304] 0 2024-04-26T12:28:45.502 INFO:tasks.workunit.client.0.smithi046.stdout:0/138: dwrite d9/dc/dd/f13 [0,4194304] 0 2024-04-26T12:28:45.502 INFO:tasks.workunit.client.0.smithi046.stdout:4/123: dread d0/da/f22 [0,4194304] 0 2024-04-26T12:28:45.502 INFO:tasks.workunit.client.0.smithi046.stdout:7/118: truncate d16/d1c/f26 54743 0 2024-04-26T12:28:45.503 INFO:tasks.workunit.client.0.smithi046.stdout:8/73: dread d7/fb [0,4194304] 0 2024-04-26T12:28:45.503 INFO:tasks.workunit.client.0.smithi046.stdout:9/61: dread d0/f4 [0,4194304] 0 2024-04-26T12:28:45.504 INFO:tasks.workunit.client.0.smithi046.stdout:4/124: rmdir d0/d1/d9/d19 39 2024-04-26T12:28:45.504 INFO:tasks.workunit.client.0.smithi046.stdout:5/106: write d9/da/f10 [695408,121242] 0 2024-04-26T12:28:45.506 INFO:tasks.workunit.client.0.smithi046.stdout:1/90: mkdir d7/d14/d1c/d24 0 2024-04-26T12:28:45.506 INFO:tasks.workunit.client.0.smithi046.stdout:0/139: mkdir d9/dc/d2a 0 2024-04-26T12:28:45.509 INFO:tasks.workunit.client.0.smithi046.stdout:5/107: write d9/da/dd/f13 [404105,21505] 0 2024-04-26T12:28:45.509 INFO:tasks.workunit.client.0.smithi046.stdout:3/142: dread d2/db/f2b [0,4194304] 0 2024-04-26T12:28:45.509 INFO:tasks.workunit.client.0.smithi046.stdout:8/74: write d7/fb [2601975,28609] 0 2024-04-26T12:28:45.509 INFO:tasks.workunit.client.0.smithi046.stdout:1/91: symlink d7/db/l25 0 2024-04-26T12:28:45.513 INFO:tasks.workunit.client.0.smithi046.stdout:0/140: chown d9/dc/dd/f27 555378 1 2024-04-26T12:28:45.513 INFO:tasks.workunit.client.0.smithi046.stdout:4/125: getdents d0/da/d17/d20/d25 0 2024-04-26T12:28:45.513 INFO:tasks.workunit.client.0.smithi046.stdout:1/92: unlink d7/d12/c1e 0 2024-04-26T12:28:45.514 INFO:tasks.workunit.client.0.smithi046.stdout:3/143: symlink d2/db/l31 0 2024-04-26T12:28:45.514 INFO:tasks.workunit.client.0.smithi046.stdout:1/93: sync 2024-04-26T12:28:45.514 INFO:tasks.workunit.client.0.smithi046.stdout:8/75: write f4 [3758657,57169] 0 2024-04-26T12:28:45.514 INFO:tasks.workunit.client.0.smithi046.stdout:9/62: dread d0/d6/f8 [0,4194304] 0 2024-04-26T12:28:45.514 INFO:tasks.workunit.client.0.smithi046.stdout:7/119: dwrite f5 [0,4194304] 0 2024-04-26T12:28:45.514 INFO:tasks.workunit.client.0.smithi046.stdout:6/98: link d7/f14 d7/d1b/f23 0 2024-04-26T12:28:45.514 INFO:tasks.workunit.client.0.smithi046.stdout:8/76: sync 2024-04-26T12:28:45.515 INFO:tasks.workunit.client.0.smithi046.stdout:0/141: rename d9/dc to d9/dc/d2a/d2b 22 2024-04-26T12:28:45.515 INFO:tasks.workunit.client.0.smithi046.stdout:2/127: dwrite d1/de/f11 [0,4194304] 0 2024-04-26T12:28:45.515 INFO:tasks.workunit.client.0.smithi046.stdout:2/128: chown d1/de/d15 3 1 2024-04-26T12:28:45.515 INFO:tasks.workunit.client.0.smithi046.stdout:1/94: symlink d7/l26 0 2024-04-26T12:28:45.515 INFO:tasks.workunit.client.0.smithi046.stdout:1/95: readlink l6 0 2024-04-26T12:28:45.516 INFO:tasks.workunit.client.0.smithi046.stdout:5/108: getdents d9/da 0 2024-04-26T12:28:45.516 INFO:tasks.workunit.client.0.smithi046.stdout:4/126: rename d0/da/f22 to d0/d1/d29/f30 0 2024-04-26T12:28:45.516 INFO:tasks.workunit.client.0.smithi046.stdout:8/77: write d7/fb [3196804,2400] 0 2024-04-26T12:28:45.516 INFO:tasks.workunit.client.0.smithi046.stdout:4/127: sync 2024-04-26T12:28:45.516 INFO:tasks.workunit.client.0.smithi046.stdout:3/144: write d2/d16/d11/d23/f2a [145485,59063] 0 2024-04-26T12:28:45.517 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:45.517 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:45.520 INFO:tasks.workunit.client.0.smithi046.stdout:7/120: truncate d16/d1c/f24 317592 0 2024-04-26T12:28:45.520 INFO:tasks.workunit.client.0.smithi046.stdout:0/142: write d9/dc/dd/f24 [513552,110393] 0 2024-04-26T12:28:45.520 INFO:tasks.workunit.client.0.smithi046.stdout:2/129: getdents d1/de/d15 0 2024-04-26T12:28:45.520 INFO:tasks.workunit.client.0.smithi046.stdout:3/145: chown d2/db/cd 47 1 2024-04-26T12:28:45.520 INFO:tasks.workunit.client.0.smithi046.stdout:6/99: write d7/f14 [1193059,22134] 0 2024-04-26T12:28:45.520 INFO:tasks.workunit.client.0.smithi046.stdout:4/128: mknod d0/d1d/c31 0 2024-04-26T12:28:45.520 INFO:tasks.workunit.client.0.smithi046.stdout:5/109: creat d9/da/d15/f26 x:0 0 0 2024-04-26T12:28:45.521 INFO:tasks.workunit.client.0.smithi046.stdout:8/78: creat d7/da/df/f10 x:0 0 0 2024-04-26T12:28:45.521 INFO:tasks.workunit.client.0.smithi046.stdout:1/96: rmdir d7/d14/d1c/d24 0 2024-04-26T12:28:45.521 INFO:tasks.workunit.client.0.smithi046.stdout:5/110: fsync f8 0 2024-04-26T12:28:45.521 INFO:tasks.workunit.client.0.smithi046.stdout:7/121: creat d16/d1a/f2b x:0 0 0 2024-04-26T12:28:45.521 INFO:tasks.workunit.client.0.smithi046.stdout:8/79: fdatasync d7/da/df/f10 0 2024-04-26T12:28:45.521 INFO:tasks.workunit.client.0.smithi046.stdout:0/143: creat d9/dc/d2a/f2c x:0 0 0 2024-04-26T12:28:45.521 INFO:tasks.workunit.client.0.smithi046.stdout:7/122: unlink f12 0 2024-04-26T12:28:45.521 INFO:tasks.workunit.client.0.smithi046.stdout:1/97: creat d7/d12/f27 x:0 0 0 2024-04-26T12:28:45.522 INFO:tasks.workunit.client.0.smithi046.stdout:6/100: truncate d7/d16/f1c 4593330 0 2024-04-26T12:28:45.522 INFO:tasks.workunit.client.0.smithi046.stdout:5/111: symlink d9/da/dd/l27 0 2024-04-26T12:28:45.522 INFO:tasks.workunit.client.0.smithi046.stdout:2/130: read d1/f2 [2353756,40541] 0 2024-04-26T12:28:45.522 INFO:tasks.workunit.client.0.smithi046.stdout:7/123: write f6 [168302,46933] 0 2024-04-26T12:28:45.522 INFO:tasks.workunit.client.0.smithi046.stdout:0/144: creat d9/dc/f2d x:0 0 0 2024-04-26T12:28:45.522 INFO:tasks.workunit.client.0.smithi046.stdout:8/80: rmdir d7/dc 39 2024-04-26T12:28:45.522 INFO:tasks.workunit.client.0.smithi046.stdout:9/63: dwrite d0/f15 [0,4194304] 0 2024-04-26T12:28:45.523 INFO:tasks.workunit.client.0.smithi046.stdout:7/124: rmdir d16 39 2024-04-26T12:28:45.525 INFO:tasks.workunit.client.0.smithi046.stdout:0/145: fdatasync d9/f12 0 2024-04-26T12:28:45.525 INFO:tasks.workunit.client.0.smithi046.stdout:9/64: sync 2024-04-26T12:28:45.525 INFO:tasks.workunit.client.0.smithi046.stdout:4/129: truncate d0/d1/d5/f11 75056 0 2024-04-26T12:28:45.525 INFO:tasks.workunit.client.0.smithi046.stdout:0/146: write f7 [8168619,65286] 0 2024-04-26T12:28:45.526 INFO:tasks.workunit.client.0.smithi046.stdout:8/81: symlink d7/l11 0 2024-04-26T12:28:45.526 INFO:tasks.workunit.client.0.smithi046.stdout:3/146: dread d2/db/f13 [0,4194304] 0 2024-04-26T12:28:45.526 INFO:tasks.workunit.client.0.smithi046.stdout:9/65: creat d0/f18 x:0 0 0 2024-04-26T12:28:45.526 INFO:tasks.workunit.client.0.smithi046.stdout:5/112: rmdir d9/da/dd 39 2024-04-26T12:28:45.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/130: mknod d0/d1/d5/c32 0 2024-04-26T12:28:45.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/131: sync 2024-04-26T12:28:45.526 INFO:tasks.workunit.client.0.smithi046.stdout:6/101: truncate d7/f13 2135908 0 2024-04-26T12:28:45.529 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:45.530 INFO:tasks.workunit.client.0.smithi046.stdout:8/82: chown d7/dc/ce 150530 1 2024-04-26T12:28:45.530 INFO:tasks.workunit.client.0.smithi046.stdout:5/113: chown d9/da/d15/f21 1432365982 1 2024-04-26T12:28:45.531 INFO:tasks.workunit.client.0.smithi046.stdout:3/147: mknod d2/d16/d11/d1f/c32 0 2024-04-26T12:28:45.531 INFO:tasks.workunit.client.0.smithi046.stdout:7/125: rename la to d16/d1a/l2c 0 2024-04-26T12:28:45.531 INFO:tasks.workunit.client.0.smithi046.stdout:2/131: truncate d1/f2 1891565 0 2024-04-26T12:28:45.531 INFO:tasks.workunit.client.0.smithi046.stdout:5/114: rmdir d9/da/d18 39 2024-04-26T12:28:45.531 INFO:tasks.workunit.client.0.smithi046.stdout:7/126: write f4 [5153598,120922] 0 2024-04-26T12:28:45.531 INFO:tasks.workunit.client.0.smithi046.stdout:1/98: dwrite d7/db/f10 [4194304,4194304] 0 2024-04-26T12:28:45.531 INFO:tasks.workunit.client.0.smithi046.stdout:3/148: symlink d2/d16/d11/l33 0 2024-04-26T12:28:45.532 INFO:tasks.workunit.client.0.smithi046.stdout:5/115: write f8 [4266668,58746] 0 2024-04-26T12:28:45.532 INFO:tasks.workunit.client.0.smithi046.stdout:1/99: dread - d7/d14/f23 zero size 2024-04-26T12:28:45.533 INFO:tasks.workunit.client.0.smithi046.stdout:9/66: dread d0/f10 [0,4194304] 0 2024-04-26T12:28:45.534 INFO:tasks.workunit.client.0.smithi046.stdout:0/147: dwrite d9/dc/f2d [0,4194304] 0 2024-04-26T12:28:45.535 INFO:tasks.workunit.client.0.smithi046.stdout:7/127: link f4 d16/f2d 0 2024-04-26T12:28:45.537 INFO:tasks.workunit.client.0.smithi046.stdout:6/102: dread d7/d1b/f23 [0,4194304] 0 2024-04-26T12:28:45.537 INFO:tasks.workunit.client.0.smithi046.stdout:5/116: write d9/f1c [3954901,130387] 0 2024-04-26T12:28:45.537 INFO:tasks.workunit.client.0.smithi046.stdout:1/100: unlink l5 0 2024-04-26T12:28:45.540 INFO:tasks.workunit.client.0.smithi046.stdout:8/83: dwrite d7/fb [0,4194304] 0 2024-04-26T12:28:45.540 INFO:tasks.workunit.client.0.smithi046.stdout:8/84: sync 2024-04-26T12:28:45.540 INFO:tasks.workunit.client.0.smithi046.stdout:9/67: getdents d0/d16 0 2024-04-26T12:28:45.541 INFO:tasks.workunit.client.0.smithi046.stdout:5/117: fsync d9/da/d15/f26 0 2024-04-26T12:28:45.541 INFO:tasks.workunit.client.0.smithi046.stdout:6/103: creat d7/d1b/f24 x:0 0 0 2024-04-26T12:28:45.542 INFO:tasks.workunit.client.0.smithi046.stdout:4/132: dwrite d0/d1/d5/f2b [0,4194304] 0 2024-04-26T12:28:45.542 INFO:tasks.workunit.client.0.smithi046.stdout:0/148: symlink d9/d1d/l2e 0 2024-04-26T12:28:45.542 INFO:tasks.workunit.client.0.smithi046.stdout:9/68: fsync d0/d6/f13 0 2024-04-26T12:28:45.542 INFO:tasks.workunit.client.0.smithi046.stdout:2/132: dwrite d1/d13/d1b/f24 [0,4194304] 0 2024-04-26T12:28:45.543 INFO:tasks.workunit.client.0.smithi046.stdout:1/101: mknod d7/db/c28 0 2024-04-26T12:28:45.543 INFO:tasks.workunit.client.0.smithi046.stdout:8/85: write d7/fb [4923358,77204] 0 2024-04-26T12:28:45.543 INFO:tasks.workunit.client.0.smithi046.stdout:7/128: symlink d16/d27/l2e 0 2024-04-26T12:28:45.544 INFO:tasks.workunit.client.0.smithi046.stdout:4/133: readlink d0/d1d/l2a 0 2024-04-26T12:28:45.544 INFO:tasks.workunit.client.0.smithi046.stdout:2/133: chown d1/d13/d1b 732 1 2024-04-26T12:28:45.545 INFO:tasks.workunit.client.0.smithi046.stdout:7/129: read f5 [715330,53007] 0 2024-04-26T12:28:45.545 INFO:tasks.workunit.client.0.smithi046.stdout:3/149: dwrite d2/d16/d11/d23/f2a [0,4194304] 0 2024-04-26T12:28:45.547 INFO:tasks.workunit.client.0.smithi046.stdout:6/104: rmdir d7/d1b/d22 0 2024-04-26T12:28:45.547 INFO:tasks.workunit.client.0.smithi046.stdout:8/86: write d7/da/df/f10 [770917,114576] 0 2024-04-26T12:28:45.547 INFO:tasks.workunit.client.0.smithi046.stdout:0/149: truncate d9/dc/dd/f25 630763 0 2024-04-26T12:28:45.548 INFO:tasks.workunit.client.0.smithi046.stdout:4/134: creat d0/da/d17/d20/d25/f33 x:0 0 0 2024-04-26T12:28:45.549 INFO:tasks.workunit.client.0.smithi046.stdout:6/105: mkdir d7/d1b/d25 0 2024-04-26T12:28:45.549 INFO:tasks.workunit.client.0.smithi046.stdout:8/87: fsync d7/f8 0 2024-04-26T12:28:45.551 INFO:tasks.workunit.client.0.smithi046.stdout:3/150: creat d2/d16/f34 x:0 0 0 2024-04-26T12:28:45.551 INFO:tasks.workunit.client.0.smithi046.stdout:4/135: creat d0/d1/d29/f34 x:0 0 0 2024-04-26T12:28:45.551 INFO:tasks.workunit.client.0.smithi046.stdout:6/106: creat d7/d1b/f26 x:0 0 0 2024-04-26T12:28:45.552 INFO:tasks.workunit.client.0.smithi046.stdout:8/88: write f4 [2442564,47339] 0 2024-04-26T12:28:45.552 INFO:tasks.workunit.client.0.smithi046.stdout:0/150: link d9/dc/dd/f27 d9/dc/dd/f2f 0 2024-04-26T12:28:45.553 INFO:tasks.workunit.client.0.smithi046.stdout:4/136: unlink d0/f6 0 2024-04-26T12:28:45.553 INFO:tasks.workunit.client.0.smithi046.stdout:6/107: mknod d7/c27 0 2024-04-26T12:28:45.554 INFO:tasks.workunit.client.0.smithi046.stdout:8/89: chown d7/da 616948 1 2024-04-26T12:28:45.554 INFO:tasks.workunit.client.0.smithi046.stdout:5/118: dwrite d9/da/d15/f21 [0,4194304] 0 2024-04-26T12:28:45.554 INFO:tasks.workunit.client.0.smithi046.stdout:6/108: stat d7/f15 0 2024-04-26T12:28:45.555 INFO:tasks.workunit.client.0.smithi046.stdout:7/130: write f4 [6088098,92161] 0 2024-04-26T12:28:45.555 INFO:tasks.workunit.client.0.smithi046.stdout:9/69: dwrite d0/d6/f8 [0,4194304] 0 2024-04-26T12:28:45.555 INFO:tasks.workunit.client.0.smithi046.stdout:6/109: chown d7/d16 406 1 2024-04-26T12:28:45.557 INFO:tasks.workunit.client.0.smithi046.stdout:3/151: rmdir d2/d16/d11/d30 0 2024-04-26T12:28:45.557 INFO:tasks.workunit.client.0.smithi046.stdout:1/102: fdatasync d7/db/ff 0 2024-04-26T12:28:45.559 INFO:tasks.workunit.client.0.smithi046.stdout:2/134: dwrite d1/d13/d1b/f24 [4194304,4194304] 0 2024-04-26T12:28:45.559 INFO:tasks.workunit.client.0.smithi046.stdout:9/70: mkdir d0/d19 0 2024-04-26T12:28:45.559 INFO:tasks.workunit.client.0.smithi046.stdout:6/110: write d7/fa [262306,75947] 0 2024-04-26T12:28:45.559 INFO:tasks.workunit.client.0.smithi046.stdout:5/119: chown d9/da/d15/f21 1 1 2024-04-26T12:28:45.559 INFO:tasks.workunit.client.0.smithi046.stdout:0/151: link f8 d9/d1d/f30 0 2024-04-26T12:28:45.559 INFO:tasks.workunit.client.0.smithi046.stdout:7/131: mknod d16/d1a/c2f 0 2024-04-26T12:28:45.560 INFO:tasks.workunit.client.0.smithi046.stdout:3/152: write d2/f17 [282747,44111] 0 2024-04-26T12:28:45.561 INFO:tasks.workunit.client.0.smithi046.stdout:6/111: symlink d7/d1b/l28 0 2024-04-26T12:28:45.561 INFO:tasks.workunit.client.0.smithi046.stdout:6/112: sync 2024-04-26T12:28:45.561 INFO:tasks.workunit.client.0.smithi046.stdout:2/135: write d1/f4 [1437763,24213] 0 2024-04-26T12:28:45.561 INFO:tasks.workunit.client.0.smithi046.stdout:9/71: write d0/f4 [3517732,46990] 0 2024-04-26T12:28:45.561 INFO:tasks.workunit.client.0.smithi046.stdout:1/103: write d7/db/ff [3126958,63080] 0 2024-04-26T12:28:45.561 INFO:tasks.workunit.client.0.smithi046.stdout:0/152: link f5 d9/dc/d2a/f31 0 2024-04-26T12:28:45.562 INFO:tasks.workunit.client.0.smithi046.stdout:7/132: symlink d16/d27/l30 0 2024-04-26T12:28:45.562 INFO:tasks.workunit.client.0.smithi046.stdout:8/90: dread d7/fb [4194304,4194304] 0 2024-04-26T12:28:45.562 INFO:tasks.workunit.client.0.smithi046.stdout:2/136: mkdir d1/de/d2b 0 2024-04-26T12:28:45.563 INFO:tasks.workunit.client.0.smithi046.stdout:0/153: truncate d9/dc/f26 209756 0 2024-04-26T12:28:45.564 INFO:tasks.workunit.client.0.smithi046.stdout:5/120: rename d9/da/d15/f21 to d9/da/f28 0 2024-04-26T12:28:45.564 INFO:tasks.workunit.client.0.smithi046.stdout:4/137: dwrite d0/da/fd [0,4194304] 0 2024-04-26T12:28:45.565 INFO:tasks.workunit.client.0.smithi046.stdout:1/104: getdents d7/d14 0 2024-04-26T12:28:45.565 INFO:tasks.workunit.client.0.smithi046.stdout:2/137: creat d1/de/d15/d18/f2c x:0 0 0 2024-04-26T12:28:45.566 INFO:tasks.workunit.client.0.smithi046.stdout:6/113: rename f5 to d7/f29 0 2024-04-26T12:28:45.566 INFO:tasks.workunit.client.0.smithi046.stdout:4/138: dread - d0/d1/d29/f34 zero size 2024-04-26T12:28:45.567 INFO:tasks.workunit.client.0.smithi046.stdout:2/138: symlink d1/de/l2d 0 2024-04-26T12:28:45.567 INFO:tasks.workunit.client.0.smithi046.stdout:9/72: rename d0/f4 to d0/d6/f1a 0 2024-04-26T12:28:45.567 INFO:tasks.workunit.client.0.smithi046.stdout:1/105: link d7/d12/l1d d7/l29 0 2024-04-26T12:28:45.568 INFO:tasks.workunit.client.0.smithi046.stdout:8/91: rename d7/da to d7/da/d12 22 2024-04-26T12:28:45.568 INFO:tasks.workunit.client.0.smithi046.stdout:4/139: mkdir d0/da/d17/d20/d25/d35 0 2024-04-26T12:28:45.569 INFO:tasks.workunit.client.0.smithi046.stdout:1/106: dread - d7/d14/f19 zero size 2024-04-26T12:28:45.569 INFO:tasks.workunit.client.0.smithi046.stdout:2/139: creat d1/de/d15/d18/f2e x:0 0 0 2024-04-26T12:28:45.569 INFO:tasks.workunit.client.0.smithi046.stdout:9/73: write d0/f18 [363040,64031] 0 2024-04-26T12:28:45.569 INFO:tasks.workunit.client.0.smithi046.stdout:6/114: dread d7/d1b/f23 [0,4194304] 0 2024-04-26T12:28:45.570 INFO:tasks.workunit.client.0.smithi046.stdout:3/153: dwrite d2/f17 [0,4194304] 0 2024-04-26T12:28:45.570 INFO:tasks.workunit.client.0.smithi046.stdout:7/133: getdents d16/d27 0 2024-04-26T12:28:45.571 INFO:tasks.workunit.client.0.smithi046.stdout:4/140: mknod d0/d1/d5/c36 0 2024-04-26T12:28:45.571 INFO:tasks.workunit.client.0.smithi046.stdout:8/92: creat d7/dc/f13 x:0 0 0 2024-04-26T12:28:45.571 INFO:tasks.workunit.client.0.smithi046.stdout:0/154: rmdir d9/dc 39 2024-04-26T12:28:45.571 INFO:tasks.workunit.client.0.smithi046.stdout:1/107: mknod d7/d12/c2a 0 2024-04-26T12:28:45.572 INFO:tasks.workunit.client.0.smithi046.stdout:3/154: mkdir d2/d16/d35 0 2024-04-26T12:28:45.572 INFO:tasks.workunit.client.0.smithi046.stdout:9/74: mknod d0/d6/c1b 0 2024-04-26T12:28:45.572 INFO:tasks.workunit.client.0.smithi046.stdout:2/140: write d1/de/d15/d18/f2a [159923,62095] 0 2024-04-26T12:28:45.573 INFO:tasks.workunit.client.0.smithi046.stdout:1/108: mkdir d7/d9/d2b 0 2024-04-26T12:28:45.573 INFO:tasks.workunit.client.0.smithi046.stdout:5/121: dread d9/da/f28 [0,4194304] 0 2024-04-26T12:28:45.573 INFO:tasks.workunit.client.0.smithi046.stdout:2/141: dread - d1/de/f27 zero size 2024-04-26T12:28:45.573 INFO:tasks.workunit.client.0.smithi046.stdout:0/155: link f3 d9/dc/f32 0 2024-04-26T12:28:45.574 INFO:tasks.workunit.client.0.smithi046.stdout:8/93: rename d7/dc/ce to d7/da/df/c14 0 2024-04-26T12:28:45.574 INFO:tasks.workunit.client.0.smithi046.stdout:2/142: dread - d1/de/f27 zero size 2024-04-26T12:28:45.574 INFO:tasks.workunit.client.0.smithi046.stdout:3/155: creat d2/d16/d2c/f36 x:0 0 0 2024-04-26T12:28:45.574 INFO:tasks.workunit.client.0.smithi046.stdout:4/141: rename d0/d1/d5/c8 to d0/da/d17/c37 0 2024-04-26T12:28:45.575 INFO:tasks.workunit.client.0.smithi046.stdout:5/122: creat d9/f29 x:0 0 0 2024-04-26T12:28:45.575 INFO:tasks.workunit.client.0.smithi046.stdout:8/94: creat d7/dc/f15 x:0 0 0 2024-04-26T12:28:45.575 INFO:tasks.workunit.client.0.smithi046.stdout:4/142: dread - d0/da/f26 zero size 2024-04-26T12:28:45.576 INFO:tasks.workunit.client.0.smithi046.stdout:9/75: rename d0/l11 to d0/d16/l1c 0 2024-04-26T12:28:45.576 INFO:tasks.workunit.client.0.smithi046.stdout:4/143: mknod d0/d1/c38 0 2024-04-26T12:28:45.578 INFO:tasks.workunit.client.0.smithi046.stdout:5/123: truncate d9/da/d15/f26 903587 0 2024-04-26T12:28:45.578 INFO:tasks.workunit.client.0.smithi046.stdout:1/109: rename d7/ce to d7/d9/c2c 0 2024-04-26T12:28:45.578 INFO:tasks.workunit.client.0.smithi046.stdout:9/76: creat d0/f1d x:0 0 0 2024-04-26T12:28:45.579 INFO:tasks.workunit.client.0.smithi046.stdout:4/144: dread - d0/da/f26 zero size 2024-04-26T12:28:45.580 INFO:tasks.workunit.client.0.smithi046.stdout:6/115: truncate d7/d16/f1c 424377 0 2024-04-26T12:28:45.580 INFO:tasks.workunit.client.0.smithi046.stdout:7/134: truncate d16/f19 491678 0 2024-04-26T12:28:45.581 INFO:tasks.workunit.client.0.smithi046.stdout:8/95: dread f4 [0,4194304] 0 2024-04-26T12:28:45.582 INFO:tasks.workunit.client.0.smithi046.stdout:0/156: dwrite d9/dc/dd/f14 [4194304,4194304] 0 2024-04-26T12:28:45.583 INFO:tasks.workunit.client.0.smithi046.stdout:7/135: rmdir d16 39 2024-04-26T12:28:45.583 INFO:tasks.workunit.client.0.smithi046.stdout:6/116: rename d7/f14 to d7/f2a 0 2024-04-26T12:28:45.583 INFO:tasks.workunit.client.0.smithi046.stdout:3/156: dwrite d2/d16/d11/d23/f2a [0,4194304] 0 2024-04-26T12:28:45.584 INFO:tasks.workunit.client.0.smithi046.stdout:4/145: truncate d0/d1/d29/f34 776935 0 2024-04-26T12:28:45.584 INFO:tasks.workunit.client.0.smithi046.stdout:8/96: mknod d7/dc/c16 0 2024-04-26T12:28:45.585 INFO:tasks.workunit.client.0.smithi046.stdout:6/117: fsync d7/f13 0 2024-04-26T12:28:45.586 INFO:tasks.workunit.client.0.smithi046.stdout:8/97: chown d7/da/df/f10 2 1 2024-04-26T12:28:45.586 INFO:tasks.workunit.client.0.smithi046.stdout:0/157: getdents d9/dc/dd 0 2024-04-26T12:28:45.587 INFO:tasks.workunit.client.0.smithi046.stdout:7/136: write d16/d1c/f26 [860652,95764] 0 2024-04-26T12:28:45.589 INFO:tasks.workunit.client.0.smithi046.stdout:2/143: dwrite d1/f8 [0,4194304] 0 2024-04-26T12:28:45.589 INFO:tasks.workunit.client.0.smithi046.stdout:7/137: mkdir d16/d1a/d31 0 2024-04-26T12:28:45.590 INFO:tasks.workunit.client.0.smithi046.stdout:0/158: fdatasync d9/dc/d2a/f31 0 2024-04-26T12:28:45.591 INFO:tasks.workunit.client.0.smithi046.stdout:6/118: getdents d7/d1b 0 2024-04-26T12:28:45.591 INFO:tasks.workunit.client.0.smithi046.stdout:1/110: dwrite d7/db/f10 [0,4194304] 0 2024-04-26T12:28:45.592 INFO:tasks.workunit.client.0.smithi046.stdout:5/124: truncate d9/da/f28 1666778 0 2024-04-26T12:28:45.593 INFO:tasks.workunit.client.0.smithi046.stdout:1/111: chown d7/db 203526721 1 2024-04-26T12:28:45.593 INFO:tasks.workunit.client.0.smithi046.stdout:6/119: mkdir d7/d2b 0 2024-04-26T12:28:45.597 INFO:tasks.workunit.client.0.smithi046.stdout:9/77: truncate d0/d6/f1a 1820625 0 2024-04-26T12:28:45.597 INFO:tasks.workunit.client.0.smithi046.stdout:9/78: sync 2024-04-26T12:28:45.597 INFO:tasks.workunit.client.0.smithi046.stdout:3/157: dwrite d2/f8 [0,4194304] 0 2024-04-26T12:28:45.598 INFO:tasks.workunit.client.0.smithi046.stdout:6/120: rmdir d7 39 2024-04-26T12:28:45.598 INFO:tasks.workunit.client.0.smithi046.stdout:0/159: chown d9/dc/dd/f2f 23 1 2024-04-26T12:28:45.598 INFO:tasks.workunit.client.0.smithi046.stdout:9/79: chown d0 6615 1 2024-04-26T12:28:45.598 INFO:tasks.workunit.client.0.smithi046.stdout:1/112: readlink d7/l29 0 2024-04-26T12:28:45.598 INFO:tasks.workunit.client.0.smithi046.stdout:5/125: rmdir d9/da/d18 39 2024-04-26T12:28:45.598 INFO:tasks.workunit.client.0.smithi046.stdout:7/138: link c15 d16/d1a/d31/c32 0 2024-04-26T12:28:45.599 INFO:tasks.workunit.client.0.smithi046.stdout:7/139: fdatasync f6 0 2024-04-26T12:28:45.599 INFO:tasks.workunit.client.0.smithi046.stdout:0/160: rename d9 to d9/d33 22 2024-04-26T12:28:45.599 INFO:tasks.workunit.client.0.smithi046.stdout:1/113: fsync d7/d14/f23 0 2024-04-26T12:28:45.599 INFO:tasks.workunit.client.0.smithi046.stdout:5/126: write f8 [1427104,66675] 0 2024-04-26T12:28:45.599 INFO:tasks.workunit.client.0.smithi046.stdout:8/98: dwrite d7/dc/f15 [0,4194304] 0 2024-04-26T12:28:45.599 INFO:tasks.workunit.client.0.smithi046.stdout:3/158: creat d2/d16/f37 x:0 0 0 2024-04-26T12:28:45.599 INFO:tasks.workunit.client.0.smithi046.stdout:0/161: truncate d9/f20 595993 0 2024-04-26T12:28:45.599 INFO:tasks.workunit.client.0.smithi046.stdout:0/162: readlink d9/dc/lf 0 2024-04-26T12:28:45.599 INFO:tasks.workunit.client.0.smithi046.stdout:1/114: fdatasync d7/d9/fa 0 2024-04-26T12:28:45.599 INFO:tasks.workunit.client.0.smithi046.stdout:3/159: write d2/f17 [1804601,121059] 0 2024-04-26T12:28:45.600 INFO:tasks.workunit.client.0.smithi046.stdout:1/115: stat d7/db/f10 0 2024-04-26T12:28:45.605 INFO:tasks.workunit.client.0.smithi046.stdout:0/163: write d9/fa [1825089,32209] 0 2024-04-26T12:28:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:3/160: dread - d2/db/f10 zero size 2024-04-26T12:28:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:6/121: symlink d7/d2b/l2c 0 2024-04-26T12:28:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:0/164: readlink d9/l21 0 2024-04-26T12:28:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:7/140: rename f14 to d16/f33 0 2024-04-26T12:28:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:0/165: write d9/f20 [942521,3255] 0 2024-04-26T12:28:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:8/99: getdents d7 0 2024-04-26T12:28:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:1/116: getdents d7/d9 0 2024-04-26T12:28:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:8/100: stat d7/f8 0 2024-04-26T12:28:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:0/166: chown d9/dc/c19 4204819 1 2024-04-26T12:28:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:1/117: write d7/d9/fa [116718,41205] 0 2024-04-26T12:28:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:2/144: fdatasync d1/f8 0 2024-04-26T12:28:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:9/80: dread d0/d6/f8 [0,4194304] 0 2024-04-26T12:28:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:0/167: symlink d9/d1d/l34 0 2024-04-26T12:28:45.607 INFO:tasks.workunit.client.0.smithi046.stdout:4/146: truncate d0/d1/d9/f13 123434 0 2024-04-26T12:28:45.607 INFO:tasks.workunit.client.0.smithi046.stdout:8/101: rename d7/fb to d7/dc/f17 0 2024-04-26T12:28:45.607 INFO:tasks.workunit.client.0.smithi046.stdout:9/81: symlink d0/d6/l1e 0 2024-04-26T12:28:45.607 INFO:tasks.workunit.client.0.smithi046.stdout:0/168: rmdir d9/dc 39 2024-04-26T12:28:45.607 INFO:tasks.workunit.client.0.smithi046.stdout:4/147: creat d0/da/d17/d20/f39 x:0 0 0 2024-04-26T12:28:45.607 INFO:tasks.workunit.client.0.smithi046.stdout:7/141: dread d16/f33 [0,4194304] 0 2024-04-26T12:28:45.607 INFO:tasks.workunit.client.0.smithi046.stdout:5/127: truncate d9/da/f20 2258867 0 2024-04-26T12:28:45.607 INFO:tasks.workunit.client.0.smithi046.stdout:0/169: chown d9/f20 2250113 1 2024-04-26T12:28:45.607 INFO:tasks.workunit.client.0.smithi046.stdout:7/142: chown d16/d27 2 1 2024-04-26T12:28:45.607 INFO:tasks.workunit.client.0.smithi046.stdout:9/82: write d0/f5 [2223524,27665] 0 2024-04-26T12:28:45.607 INFO:tasks.workunit.client.0.smithi046.stdout:4/148: write d0/da/f26 [219209,89305] 0 2024-04-26T12:28:45.608 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:45.601+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:45.609 INFO:tasks.workunit.client.0.smithi046.stdout:5/128: symlink d9/da/d15/l2a 0 2024-04-26T12:28:45.609 INFO:tasks.workunit.client.0.smithi046.stdout:4/149: chown d0/da 47898 1 2024-04-26T12:28:45.609 INFO:tasks.workunit.client.0.smithi046.stdout:7/143: rename d16/f33 to d16/d27/f34 0 2024-04-26T12:28:45.609 INFO:tasks.workunit.client.0.smithi046.stdout:9/83: truncate d0/d6/f13 951431 0 2024-04-26T12:28:45.609 INFO:tasks.workunit.client.0.smithi046.stdout:7/144: chown d16/d1c/f26 8190520 1 2024-04-26T12:28:45.609 INFO:tasks.workunit.client.0.smithi046.stdout:5/129: mkdir d9/da/dd/d2b 0 2024-04-26T12:28:45.609 INFO:tasks.workunit.client.0.smithi046.stdout:4/150: dread - d0/d1/d9/d19/f1a zero size 2024-04-26T12:28:45.609 INFO:tasks.workunit.client.0.smithi046.stdout:2/145: dwrite d1/f4 [0,4194304] 0 2024-04-26T12:28:45.609 INFO:tasks.workunit.client.0.smithi046.stdout:7/145: chown d16/d1a/f2b 54094247 1 2024-04-26T12:28:45.610 INFO:tasks.workunit.client.0.smithi046.stdout:7/146: write f4 [2978737,13703] 0 2024-04-26T12:28:45.610 INFO:tasks.workunit.client.0.smithi046.stdout:2/146: dread - d1/de/f27 zero size 2024-04-26T12:28:45.610 INFO:tasks.workunit.client.0.smithi046.stdout:5/130: creat d9/f2c x:0 0 0 2024-04-26T12:28:45.611 INFO:tasks.workunit.client.0.smithi046.stdout:4/151: read d0/d1/d9/f23 [8386,120162] 0 2024-04-26T12:28:45.611 INFO:tasks.workunit.client.0.smithi046.stdout:5/131: dread - d9/f29 zero size 2024-04-26T12:28:45.611 INFO:tasks.workunit.client.0.smithi046.stdout:7/147: write d16/d1c/f26 [1910780,28531] 0 2024-04-26T12:28:45.611 INFO:tasks.workunit.client.0.smithi046.stdout:2/147: mknod d1/de/d2b/c2f 0 2024-04-26T12:28:45.611 INFO:tasks.workunit.client.0.smithi046.stdout:5/132: creat d9/da/d18/f2d x:0 0 0 2024-04-26T12:28:45.613 INFO:tasks.workunit.client.0.smithi046.stdout:0/170: write d9/dc/f32 [1813422,36033] 0 2024-04-26T12:28:45.613 INFO:tasks.workunit.client.0.smithi046.stdout:2/148: link d1/de/d15/d18/f2c d1/d13/d1b/f30 0 2024-04-26T12:28:45.615 INFO:tasks.workunit.client.0.smithi046.stdout:9/84: truncate d0/d6/f8 1144999 0 2024-04-26T12:28:45.615 INFO:tasks.workunit.client.0.smithi046.stdout:4/152: link d0/da/d17/d20/d25/l2d d0/d1/l3a 0 2024-04-26T12:28:45.616 INFO:tasks.workunit.client.0.smithi046.stdout:9/85: read d0/f15 [2663771,58848] 0 2024-04-26T12:28:45.616 INFO:tasks.workunit.client.0.smithi046.stdout:2/149: readlink d1/de/d15/l19 0 2024-04-26T12:28:45.618 INFO:tasks.workunit.client.0.smithi046.stdout:4/153: fsync d0/da/d17/d20/d25/f33 0 2024-04-26T12:28:45.618 INFO:tasks.workunit.client.0.smithi046.stdout:7/148: dwrite d16/d1c/f2a [0,4194304] 0 2024-04-26T12:28:45.618 INFO:tasks.workunit.client.0.smithi046.stdout:9/86: creat d0/d6/f1f x:0 0 0 2024-04-26T12:28:45.620 INFO:tasks.workunit.client.0.smithi046.stdout:7/149: mkdir d16/d35 0 2024-04-26T12:28:45.621 INFO:tasks.workunit.client.0.smithi046.stdout:8/102: dwrite d7/da/df/f10 [0,4194304] 0 2024-04-26T12:28:45.621 INFO:tasks.workunit.client.0.smithi046.stdout:6/122: dread d7/fb [0,4194304] 0 2024-04-26T12:28:45.622 INFO:tasks.workunit.client.0.smithi046.stdout:9/87: rename d0/d6/lb to d0/d19/l20 0 2024-04-26T12:28:45.622 INFO:tasks.workunit.client.0.smithi046.stdout:7/150: write d16/d1a/f2b [779697,118012] 0 2024-04-26T12:28:45.623 INFO:tasks.workunit.client.0.smithi046.stdout:5/133: dwrite d9/f1c [0,4194304] 0 2024-04-26T12:28:45.623 INFO:tasks.workunit.client.0.smithi046.stdout:0/171: write d9/dc/dd/f2f [586066,10965] 0 2024-04-26T12:28:45.624 INFO:tasks.workunit.client.0.smithi046.stdout:9/88: write d0/d6/f13 [1281582,11774] 0 2024-04-26T12:28:45.624 INFO:tasks.workunit.client.0.smithi046.stdout:5/134: readlink d9/l14 0 2024-04-26T12:28:45.625 INFO:tasks.workunit.client.0.smithi046.stdout:2/150: dread d1/f4 [0,4194304] 0 2024-04-26T12:28:45.625 INFO:tasks.workunit.client.0.smithi046.stdout:9/89: mkdir d0/d19/d21 0 2024-04-26T12:28:45.626 INFO:tasks.workunit.client.0.smithi046.stdout:7/151: rename d16/d1a/l2c to d16/d35/l36 0 2024-04-26T12:28:45.626 INFO:tasks.workunit.client.0.smithi046.stdout:5/135: mkdir d9/da/d15/d2e 0 2024-04-26T12:28:45.626 INFO:tasks.workunit.client.0.smithi046.stdout:0/172: unlink d9/d1d/f30 0 2024-04-26T12:28:45.626 INFO:tasks.workunit.client.0.smithi046.stdout:2/151: creat d1/de/f31 x:0 0 0 2024-04-26T12:28:45.626 INFO:tasks.workunit.client.0.smithi046.stdout:5/136: unlink c3 0 2024-04-26T12:28:45.627 INFO:tasks.workunit.client.0.smithi046.stdout:9/90: symlink d0/d16/l22 0 2024-04-26T12:28:45.628 INFO:tasks.workunit.client.0.smithi046.stdout:7/152: mknod d16/d35/c37 0 2024-04-26T12:28:45.628 INFO:tasks.workunit.client.0.smithi046.stdout:4/154: fsync d0/d1/d9/f13 0 2024-04-26T12:28:45.629 INFO:tasks.workunit.client.0.smithi046.stdout:0/173: mknod d9/c35 0 2024-04-26T12:28:45.630 INFO:tasks.workunit.client.0.smithi046.stdout:8/103: dread d7/f8 [0,4194304] 0 2024-04-26T12:28:45.630 INFO:tasks.workunit.client.0.smithi046.stdout:2/152: stat d1/de/d15/c29 0 2024-04-26T12:28:45.630 INFO:tasks.workunit.client.0.smithi046.stdout:6/123: read d7/fa [181010,96783] 0 2024-04-26T12:28:45.631 INFO:tasks.workunit.client.0.smithi046.stdout:7/153: truncate d16/f20 811427 0 2024-04-26T12:28:45.632 INFO:tasks.workunit.client.0.smithi046.stdout:6/124: write d7/f15 [39628,32911] 0 2024-04-26T12:28:45.632 INFO:tasks.workunit.client.0.smithi046.stdout:3/161: dread d2/f1d [0,4194304] 0 2024-04-26T12:28:45.633 INFO:tasks.workunit.client.0.smithi046.stdout:2/153: truncate d1/d13/d1b/f30 349929 0 2024-04-26T12:28:45.633 INFO:tasks.workunit.client.0.smithi046.stdout:9/91: dread d0/d6/f1a [0,4194304] 0 2024-04-26T12:28:45.633 INFO:tasks.workunit.client.0.smithi046.stdout:0/174: write f5 [4190322,21080] 0 2024-04-26T12:28:45.634 INFO:tasks.workunit.client.0.smithi046.stdout:6/125: creat d7/f2d x:0 0 0 2024-04-26T12:28:45.634 INFO:tasks.workunit.client.0.smithi046.stdout:3/162: chown d2/db/f18 254 1 2024-04-26T12:28:45.635 INFO:tasks.workunit.client.0.smithi046.stdout:5/137: dwrite f8 [0,4194304] 0 2024-04-26T12:28:45.636 INFO:tasks.workunit.client.0.smithi046.stdout:0/175: rename d9/f1b to d9/dc/f36 0 2024-04-26T12:28:45.636 INFO:tasks.workunit.client.0.smithi046.stdout:8/104: dread f4 [4194304,4194304] 0 2024-04-26T12:28:45.637 INFO:tasks.workunit.client.0.smithi046.stdout:5/138: symlink d9/da/l2f 0 2024-04-26T12:28:45.638 INFO:tasks.workunit.client.0.smithi046.stdout:6/126: rename d7/f2a to d7/d1b/d25/f2e 0 2024-04-26T12:28:45.639 INFO:tasks.workunit.client.0.smithi046.stdout:5/139: chown d9/f29 47750994 1 2024-04-26T12:28:45.642 INFO:tasks.workunit.client.0.smithi046.stdout:4/155: dwrite d0/d1/d5/f11 [0,4194304] 0 2024-04-26T12:28:45.643 INFO:tasks.workunit.client.0.smithi046.stdout:3/163: dread d2/db/f18 [0,4194304] 0 2024-04-26T12:28:45.643 INFO:tasks.workunit.client.0.smithi046.stdout:5/140: symlink d9/da/d18/l30 0 2024-04-26T12:28:45.644 INFO:tasks.workunit.client.0.smithi046.stdout:9/92: dwrite d0/f15 [0,4194304] 0 2024-04-26T12:28:45.644 INFO:tasks.workunit.client.0.smithi046.stdout:2/154: dwrite d1/de/d15/d18/f2a [0,4194304] 0 2024-04-26T12:28:45.645 INFO:tasks.workunit.client.0.smithi046.stdout:5/141: chown d9/da/dd/ff 613888525 1 2024-04-26T12:28:45.646 INFO:tasks.workunit.client.0.smithi046.stdout:3/164: creat d2/d16/d11/d1f/f38 x:0 0 0 2024-04-26T12:28:45.646 INFO:tasks.workunit.client.0.smithi046.stdout:9/93: rmdir d0/d19 39 2024-04-26T12:28:45.647 INFO:tasks.workunit.client.0.smithi046.stdout:0/176: dread f3 [0,4194304] 0 2024-04-26T12:28:45.648 INFO:tasks.workunit.client.0.smithi046.stdout:9/94: creat d0/d6/f23 x:0 0 0 2024-04-26T12:28:45.649 INFO:tasks.workunit.client.0.smithi046.stdout:8/105: dwrite f4 [4194304,4194304] 0 2024-04-26T12:28:45.649 INFO:tasks.workunit.client.0.smithi046.stdout:3/165: fsync d2/db/f13 0 2024-04-26T12:28:45.649 INFO:tasks.workunit.client.0.smithi046.stdout:5/142: truncate d9/da/d18/f25 1032708 0 2024-04-26T12:28:45.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/118: sync 2024-04-26T12:28:45.650 INFO:tasks.workunit.client.0.smithi046.stdout:0/177: sync 2024-04-26T12:28:45.650 INFO:tasks.workunit.client.0.smithi046.stdout:6/127: sync 2024-04-26T12:28:45.650 INFO:tasks.workunit.client.0.smithi046.stdout:7/154: sync 2024-04-26T12:28:45.651 INFO:tasks.workunit.client.0.smithi046.stdout:9/95: read d0/f15 [1994007,106973] 0 2024-04-26T12:28:45.651 INFO:tasks.workunit.client.0.smithi046.stdout:1/119: creat d7/d14/f2d x:0 0 0 2024-04-26T12:28:45.652 INFO:tasks.workunit.client.0.smithi046.stdout:5/143: creat d9/da/d15/f31 x:0 0 0 2024-04-26T12:28:45.652 INFO:tasks.workunit.client.0.smithi046.stdout:0/178: fdatasync d9/dc/dd/f25 0 2024-04-26T12:28:45.652 INFO:tasks.workunit.client.0.smithi046.stdout:3/166: mkdir d2/d16/d11/d39 0 2024-04-26T12:28:45.653 INFO:tasks.workunit.client.0.smithi046.stdout:9/96: chown d0/d6/f1a 58 1 2024-04-26T12:28:45.653 INFO:tasks.workunit.client.0.smithi046.stdout:8/106: chown d7/cd 23397442 1 2024-04-26T12:28:45.653 INFO:tasks.workunit.client.0.smithi046.stdout:6/128: creat d7/d1b/d25/f2f x:0 0 0 2024-04-26T12:28:45.654 INFO:tasks.workunit.client.0.smithi046.stdout:0/179: write d9/fa [5048723,127016] 0 2024-04-26T12:28:45.655 INFO:tasks.workunit.client.0.smithi046.stdout:4/156: dwrite d0/d1/d5/db/f10 [4194304,4194304] 0 2024-04-26T12:28:45.655 INFO:tasks.workunit.client.0.smithi046.stdout:7/155: truncate d16/d1a/f2b 1354641 0 2024-04-26T12:28:45.655 INFO:tasks.workunit.client.0.smithi046.stdout:2/155: dwrite d1/f8 [0,4194304] 0 2024-04-26T12:28:45.655 INFO:tasks.workunit.client.0.smithi046.stdout:9/97: creat d0/f24 x:0 0 0 2024-04-26T12:28:45.656 INFO:tasks.workunit.client.0.smithi046.stdout:6/129: creat d7/d2b/f30 x:0 0 0 2024-04-26T12:28:45.657 INFO:tasks.workunit.client.0.smithi046.stdout:4/157: creat d0/d1/f3b x:0 0 0 2024-04-26T12:28:45.659 INFO:tasks.workunit.client.0.smithi046.stdout:7/156: link c15 d16/d1c/c38 0 2024-04-26T12:28:45.660 INFO:tasks.workunit.client.0.smithi046.stdout:5/144: dread d9/da/f28 [0,4194304] 0 2024-04-26T12:28:45.660 INFO:tasks.workunit.client.0.smithi046.stdout:2/156: rename d1/lb to d1/d13/l32 0 2024-04-26T12:28:45.662 INFO:tasks.workunit.client.0.smithi046.stdout:5/145: chown d9/da/dd/c12 7 1 2024-04-26T12:28:45.664 INFO:tasks.workunit.client.0.smithi046.stdout:1/120: truncate d7/d9/fa 4593679 0 2024-04-26T12:28:45.664 INFO:tasks.workunit.client.0.smithi046.stdout:3/167: dwrite d2/db/f2b [0,4194304] 0 2024-04-26T12:28:45.665 INFO:tasks.workunit.client.0.smithi046.stdout:8/107: dwrite f4 [8388608,4194304] 0 2024-04-26T12:28:45.665 INFO:tasks.workunit.client.0.smithi046.stdout:1/121: fsync d7/db/ff 0 2024-04-26T12:28:45.666 INFO:tasks.workunit.client.0.smithi046.stdout:2/157: unlink d1/de/l2d 0 2024-04-26T12:28:45.666 INFO:tasks.workunit.client.0.smithi046.stdout:3/168: dread - d2/d16/f37 zero size 2024-04-26T12:28:45.666 INFO:tasks.workunit.client.0.smithi046.stdout:7/157: creat d16/d1a/d31/f39 x:0 0 0 2024-04-26T12:28:45.667 INFO:tasks.workunit.client.0.smithi046.stdout:5/146: creat d9/da/dd/f32 x:0 0 0 2024-04-26T12:28:45.667 INFO:tasks.workunit.client.0.smithi046.stdout:9/98: dwrite d0/d6/f23 [0,4194304] 0 2024-04-26T12:28:45.668 INFO:tasks.workunit.client.0.smithi046.stdout:2/158: symlink d1/de/d15/d18/l33 0 2024-04-26T12:28:45.668 INFO:tasks.workunit.client.0.smithi046.stdout:8/108: creat d7/dc/f18 x:0 0 0 2024-04-26T12:28:45.669 INFO:tasks.workunit.client.0.smithi046.stdout:7/158: chown d16/c17 16 1 2024-04-26T12:28:45.670 INFO:tasks.workunit.client.0.smithi046.stdout:3/169: creat d2/d16/d11/f3a x:0 0 0 2024-04-26T12:28:45.671 INFO:tasks.workunit.client.0.smithi046.stdout:4/158: dread d0/d1/d29/f34 [0,4194304] 0 2024-04-26T12:28:45.671 INFO:tasks.workunit.client.0.smithi046.stdout:9/99: link d0/ce d0/d16/c25 0 2024-04-26T12:28:45.671 INFO:tasks.workunit.client.0.smithi046.stdout:6/130: dwrite d7/f13 [0,4194304] 0 2024-04-26T12:28:45.671 INFO:tasks.workunit.client.0.smithi046.stdout:9/100: sync 2024-04-26T12:28:45.671 INFO:tasks.workunit.client.0.smithi046.stdout:5/147: getdents d9/da/dd/d2b 0 2024-04-26T12:28:45.673 INFO:tasks.workunit.client.0.smithi046.stdout:2/159: write d1/de/ff [1881369,17419] 0 2024-04-26T12:28:45.673 INFO:tasks.workunit.client.0.smithi046.stdout:3/170: write d2/d16/d11/d23/f26 [549705,89486] 0 2024-04-26T12:28:45.673 INFO:tasks.workunit.client.0.smithi046.stdout:4/159: write d0/d1/d5/f2b [2055715,105784] 0 2024-04-26T12:28:45.673 INFO:tasks.workunit.client.0.smithi046.stdout:5/148: fdatasync d9/da/dd/f1e 0 2024-04-26T12:28:45.673 INFO:tasks.workunit.client.0.smithi046.stdout:7/159: creat d16/d35/f3a x:0 0 0 2024-04-26T12:28:45.673 INFO:tasks.workunit.client.0.smithi046.stdout:2/160: chown d1/de 64102 1 2024-04-26T12:28:45.674 INFO:tasks.workunit.client.0.smithi046.stdout:4/160: chown d0/d1/c1e 8209758 1 2024-04-26T12:28:45.674 INFO:tasks.workunit.client.0.smithi046.stdout:5/149: write d9/da/d18/f2d [519630,19591] 0 2024-04-26T12:28:45.675 INFO:tasks.workunit.client.0.smithi046.stdout:9/101: dread d0/d6/f8 [0,4194304] 0 2024-04-26T12:28:45.675 INFO:tasks.workunit.client.0.smithi046.stdout:6/131: rename d7/d1b/d25 to d7/d2b/d31 0 2024-04-26T12:28:45.676 INFO:tasks.workunit.client.0.smithi046.stdout:7/160: creat d16/d35/f3b x:0 0 0 2024-04-26T12:28:45.676 INFO:tasks.workunit.client.0.smithi046.stdout:4/161: stat d0/c18 0 2024-04-26T12:28:45.676 INFO:tasks.workunit.client.0.smithi046.stdout:2/161: symlink d1/d13/d1b/l34 0 2024-04-26T12:28:45.677 INFO:tasks.workunit.client.0.smithi046.stdout:7/161: creat d16/d1a/d31/f3c x:0 0 0 2024-04-26T12:28:45.677 INFO:tasks.workunit.client.0.smithi046.stdout:5/150: rename d9/da/ce to d9/da/c33 0 2024-04-26T12:28:45.678 INFO:tasks.workunit.client.0.smithi046.stdout:6/132: link l3 d7/d2b/l32 0 2024-04-26T12:28:45.678 INFO:tasks.workunit.client.0.smithi046.stdout:2/162: chown d1/d13/d1b/l1e 3802321 1 2024-04-26T12:28:45.679 INFO:tasks.workunit.client.0.smithi046.stdout:8/109: dwrite f4 [0,4194304] 0 2024-04-26T12:28:45.679 INFO:tasks.workunit.client.0.smithi046.stdout:1/122: dread d7/d9/f11 [0,4194304] 0 2024-04-26T12:28:45.680 INFO:tasks.workunit.client.0.smithi046.stdout:4/162: truncate d0/da/d17/d20/f39 843082 0 2024-04-26T12:28:45.680 INFO:tasks.workunit.client.0.smithi046.stdout:8/110: symlink d7/da/l19 0 2024-04-26T12:28:45.680 INFO:tasks.workunit.client.0.smithi046.stdout:6/133: mknod d7/d2b/d31/c33 0 2024-04-26T12:28:45.680 INFO:tasks.workunit.client.0.smithi046.stdout:3/171: dwrite d2/db/f15 [0,4194304] 0 2024-04-26T12:28:45.681 INFO:tasks.workunit.client.0.smithi046.stdout:1/123: chown d7/d12/l1d 421280 1 2024-04-26T12:28:45.681 INFO:tasks.workunit.client.0.smithi046.stdout:5/151: chown d9/da/f28 1021316112 1 2024-04-26T12:28:45.682 INFO:tasks.workunit.client.0.smithi046.stdout:2/163: unlink d1/d13/d1b/l1e 0 2024-04-26T12:28:45.682 INFO:tasks.workunit.client.0.smithi046.stdout:8/111: rmdir d7/dc 39 2024-04-26T12:28:45.682 INFO:tasks.workunit.client.0.smithi046.stdout:9/102: write d0/d6/f8 [757475,76859] 0 2024-04-26T12:28:45.682 INFO:tasks.workunit.client.0.smithi046.stdout:3/172: read d2/d16/d11/d23/f26 [991979,19388] 0 2024-04-26T12:28:45.683 INFO:tasks.workunit.client.0.smithi046.stdout:5/152: write d9/da/dd/f13 [645395,65980] 0 2024-04-26T12:28:45.683 INFO:tasks.workunit.client.0.smithi046.stdout:1/124: rename d7/l29 to d7/d12/l2e 0 2024-04-26T12:28:45.683 INFO:tasks.workunit.client.0.smithi046.stdout:6/134: write d7/d1b/f23 [797232,75941] 0 2024-04-26T12:28:45.683 INFO:tasks.workunit.client.0.smithi046.stdout:6/135: readlink l6 0 2024-04-26T12:28:45.684 INFO:tasks.workunit.client.0.smithi046.stdout:1/125: creat d7/d14/f2f x:0 0 0 2024-04-26T12:28:45.685 INFO:tasks.workunit.client.0.smithi046.stdout:2/164: getdents d1/de 0 2024-04-26T12:28:45.685 INFO:tasks.workunit.client.0.smithi046.stdout:3/173: creat d2/d16/d11/d39/f3b x:0 0 0 2024-04-26T12:28:45.685 INFO:tasks.workunit.client.0.smithi046.stdout:5/153: rename d9/da/dd/d2b to d9/da/dd/d34 0 2024-04-26T12:28:45.686 INFO:tasks.workunit.client.0.smithi046.stdout:6/136: creat d7/d2b/d31/f34 x:0 0 0 2024-04-26T12:28:45.686 INFO:tasks.workunit.client.0.smithi046.stdout:4/163: link d0/da/d17/c37 d0/d1/d5/db/c3c 0 2024-04-26T12:28:45.686 INFO:tasks.workunit.client.0.smithi046.stdout:1/126: read d7/d9/f18 [2106809,65064] 0 2024-04-26T12:28:45.686 INFO:tasks.workunit.client.0.smithi046.stdout:6/137: chown d7/d2b 1 1 2024-04-26T12:28:45.686 INFO:tasks.workunit.client.0.smithi046.stdout:5/154: readlink d9/da/d15/l1f 0 2024-04-26T12:28:45.686 INFO:tasks.workunit.client.0.smithi046.stdout:8/112: getdents d7/da/df 0 2024-04-26T12:28:45.687 INFO:tasks.workunit.client.0.smithi046.stdout:1/127: dread - d7/d12/f22 zero size 2024-04-26T12:28:45.687 INFO:tasks.workunit.client.0.smithi046.stdout:9/103: dread d0/f15 [0,4194304] 0 2024-04-26T12:28:45.687 INFO:tasks.workunit.client.0.smithi046.stdout:1/128: truncate d7/d9/f1a 614031 0 2024-04-26T12:28:45.688 INFO:tasks.workunit.client.0.smithi046.stdout:7/162: truncate d16/d27/f34 3897297 0 2024-04-26T12:28:45.688 INFO:tasks.workunit.client.0.smithi046.stdout:2/165: creat d1/f35 x:0 0 0 2024-04-26T12:28:45.689 INFO:tasks.workunit.client.0.smithi046.stdout:5/155: mkdir d9/da/d15/d2e/d35 0 2024-04-26T12:28:45.689 INFO:tasks.workunit.client.0.smithi046.stdout:3/174: write d2/f1d [638308,57012] 0 2024-04-26T12:28:45.689 INFO:tasks.workunit.client.0.smithi046.stdout:3/175: sync 2024-04-26T12:28:45.690 INFO:tasks.workunit.client.0.smithi046.stdout:5/156: write d9/da/dd/f1e [718968,47164] 0 2024-04-26T12:28:45.690 INFO:tasks.workunit.client.0.smithi046.stdout:2/166: truncate d1/de/f27 544847 0 2024-04-26T12:28:45.691 INFO:tasks.workunit.client.0.smithi046.stdout:9/104: dread d0/d6/f1a [0,4194304] 0 2024-04-26T12:28:45.691 INFO:tasks.workunit.client.0.smithi046.stdout:3/176: mknod d2/d16/d35/c3c 0 2024-04-26T12:28:45.692 INFO:tasks.workunit.client.0.smithi046.stdout:0/180: dread d9/f20 [0,4194304] 0 2024-04-26T12:28:45.692 INFO:tasks.workunit.client.0.smithi046.stdout:2/167: chown d1/de/d15/d18 0 1 2024-04-26T12:28:45.692 INFO:tasks.workunit.client.0.smithi046.stdout:5/157: creat d9/da/dd/f36 x:0 0 0 2024-04-26T12:28:45.693 INFO:tasks.workunit.client.0.smithi046.stdout:9/105: creat d0/d6/f26 x:0 0 0 2024-04-26T12:28:45.694 INFO:tasks.workunit.client.0.smithi046.stdout:0/181: creat d9/dc/f37 x:0 0 0 2024-04-26T12:28:45.694 INFO:tasks.workunit.client.0.smithi046.stdout:2/168: rmdir d1/de/d2b 39 2024-04-26T12:28:45.694 INFO:tasks.workunit.client.0.smithi046.stdout:5/158: readlink d9/da/d15/l1f 0 2024-04-26T12:28:45.695 INFO:tasks.workunit.client.0.smithi046.stdout:4/164: dwrite d0/d1/d5/db/f2f [0,4194304] 0 2024-04-26T12:28:45.695 INFO:tasks.workunit.client.0.smithi046.stdout:1/129: dread d7/d9/f18 [0,4194304] 0 2024-04-26T12:28:45.697 INFO:tasks.workunit.client.0.smithi046.stdout:3/177: rename d2/f8 to d2/d16/d11/f3d 0 2024-04-26T12:28:45.697 INFO:tasks.workunit.client.0.smithi046.stdout:7/163: dwrite f3 [4194304,4194304] 0 2024-04-26T12:28:45.697 INFO:tasks.workunit.client.0.smithi046.stdout:8/113: truncate f4 2519687 0 2024-04-26T12:28:45.698 INFO:tasks.workunit.client.0.smithi046.stdout:1/130: chown d7/d9/c2c 0 1 2024-04-26T12:28:45.698 INFO:tasks.workunit.client.0.smithi046.stdout:9/106: symlink d0/d19/d21/l27 0 2024-04-26T12:28:45.699 INFO:tasks.workunit.client.0.smithi046.stdout:9/107: write d0/d6/f1f [29592,21641] 0 2024-04-26T12:28:45.700 INFO:tasks.workunit.client.0.smithi046.stdout:4/165: creat d0/d1/d9/d19/f3d x:0 0 0 2024-04-26T12:28:45.701 INFO:tasks.workunit.client.0.smithi046.stdout:3/178: mknod d2/d16/d11/d1b/c3e 0 2024-04-26T12:28:45.701 INFO:tasks.workunit.client.0.smithi046.stdout:2/169: getdents d1/de/d15 0 2024-04-26T12:28:45.701 INFO:tasks.workunit.client.0.smithi046.stdout:7/164: truncate f5 3742784 0 2024-04-26T12:28:45.703 INFO:tasks.workunit.client.0.smithi046.stdout:1/131: creat d7/d14/d1c/f30 x:0 0 0 2024-04-26T12:28:45.703 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:45.702+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:45.704 INFO:tasks.workunit.client.0.smithi046.stdout:0/182: dwrite d9/f10 [4194304,4194304] 0 2024-04-26T12:28:45.704 INFO:tasks.workunit.client.0.smithi046.stdout:5/159: rename d9/da/c33 to d9/da/d15/c37 0 2024-04-26T12:28:45.704 INFO:tasks.workunit.client.0.smithi046.stdout:4/166: write d0/d1/d5/db/f2f [2214633,79853] 0 2024-04-26T12:28:45.705 INFO:tasks.workunit.client.0.smithi046.stdout:9/108: mknod d0/d16/c28 0 2024-04-26T12:28:45.706 INFO:tasks.workunit.client.0.smithi046.stdout:6/138: dwrite d7/d16/f1c [0,4194304] 0 2024-04-26T12:28:45.706 INFO:tasks.workunit.client.0.smithi046.stdout:3/179: stat d2/d16/d11/d1b/d2d 0 2024-04-26T12:28:45.707 INFO:tasks.workunit.client.0.smithi046.stdout:4/167: chown d0/d1/d29 1390400142 1 2024-04-26T12:28:45.707 INFO:tasks.workunit.client.0.smithi046.stdout:7/165: write d16/d1c/f24 [638723,130020] 0 2024-04-26T12:28:45.707 INFO:tasks.workunit.client.0.smithi046.stdout:8/114: rename d7/dc/f15 to d7/da/f1a 0 2024-04-26T12:28:45.707 INFO:tasks.workunit.client.0.smithi046.stdout:5/160: chown d9/da/d15/l1f 24137 1 2024-04-26T12:28:45.707 INFO:tasks.workunit.client.0.smithi046.stdout:6/139: dread - d7/d1b/f26 zero size 2024-04-26T12:28:45.708 INFO:tasks.workunit.client.0.smithi046.stdout:5/161: stat d9/da/dd/f13 0 2024-04-26T12:28:45.708 INFO:tasks.workunit.client.0.smithi046.stdout:8/115: mkdir d7/dc/d1b 0 2024-04-26T12:28:45.709 INFO:tasks.workunit.client.0.smithi046.stdout:4/168: write d0/d1/d29/f30 [3928464,46372] 0 2024-04-26T12:28:45.709 INFO:tasks.workunit.client.0.smithi046.stdout:6/140: rename d7/fb to d7/d2b/d31/f35 0 2024-04-26T12:28:45.710 INFO:tasks.workunit.client.0.smithi046.stdout:4/169: sync 2024-04-26T12:28:45.711 INFO:tasks.workunit.client.0.smithi046.stdout:6/141: chown d7/d2b/d31 12199 1 2024-04-26T12:28:45.712 INFO:tasks.workunit.client.0.smithi046.stdout:2/170: dread d1/d13/d1b/f24 [0,4194304] 0 2024-04-26T12:28:45.712 INFO:tasks.workunit.client.0.smithi046.stdout:9/109: dread d0/f10 [0,4194304] 0 2024-04-26T12:28:45.713 INFO:tasks.workunit.client.0.smithi046.stdout:6/142: unlink d7/f2d 0 2024-04-26T12:28:45.713 INFO:tasks.workunit.client.0.smithi046.stdout:4/170: dread - d0/da/d17/d20/d25/f33 zero size 2024-04-26T12:28:45.714 INFO:tasks.workunit.client.0.smithi046.stdout:1/132: dwrite d7/d9/f17 [0,4194304] 0 2024-04-26T12:28:45.715 INFO:tasks.workunit.client.0.smithi046.stdout:6/143: symlink d7/d1b/l36 0 2024-04-26T12:28:45.716 INFO:tasks.workunit.client.0.smithi046.stdout:0/183: dread d9/dc/f2d [0,4194304] 0 2024-04-26T12:28:45.716 INFO:tasks.workunit.client.0.smithi046.stdout:2/171: readlink d1/de/d15/d18/l1a 0 2024-04-26T12:28:45.716 INFO:tasks.workunit.client.0.smithi046.stdout:3/180: dwrite d2/db/f25 [0,4194304] 0 2024-04-26T12:28:45.716 INFO:tasks.workunit.client.0.smithi046.stdout:8/116: dread d7/dc/f17 [0,4194304] 0 2024-04-26T12:28:45.717 INFO:tasks.workunit.client.0.smithi046.stdout:4/171: rmdir d0/d1/d5 39 2024-04-26T12:28:45.719 INFO:tasks.workunit.client.0.smithi046.stdout:6/144: mkdir d7/d1b/d37 0 2024-04-26T12:28:45.720 INFO:tasks.workunit.client.0.smithi046.stdout:7/166: fdatasync f5 0 2024-04-26T12:28:45.720 INFO:tasks.workunit.client.0.smithi046.stdout:0/184: mknod d9/dc/c38 0 2024-04-26T12:28:45.720 INFO:tasks.workunit.client.0.smithi046.stdout:1/133: mkdir d7/d9/d2b/d31 0 2024-04-26T12:28:45.720 INFO:tasks.workunit.client.0.smithi046.stdout:9/110: dread d0/d6/f1a [0,4194304] 0 2024-04-26T12:28:45.720 INFO:tasks.workunit.client.0.smithi046.stdout:5/162: dwrite d9/da/dd/f32 [0,4194304] 0 2024-04-26T12:28:45.720 INFO:tasks.workunit.client.0.smithi046.stdout:6/145: readlink d7/d2b/l2c 0 2024-04-26T12:28:45.720 INFO:tasks.workunit.client.0.smithi046.stdout:0/185: rmdir d9/d1d 39 2024-04-26T12:28:45.720 INFO:tasks.workunit.client.0.smithi046.stdout:8/117: mkdir d7/d1c 0 2024-04-26T12:28:45.720 INFO:tasks.workunit.client.0.smithi046.stdout:9/111: chown d0/c12 16 1 2024-04-26T12:28:45.721 INFO:tasks.workunit.client.0.smithi046.stdout:1/134: mkdir d7/d14/d1c/d32 0 2024-04-26T12:28:45.721 INFO:tasks.workunit.client.0.smithi046.stdout:3/181: rmdir d2/d16/d11/d1f/d24 0 2024-04-26T12:28:45.722 INFO:tasks.workunit.client.0.smithi046.stdout:0/186: mknod d9/dc/c39 0 2024-04-26T12:28:45.723 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:45.724 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:45.725 INFO:tasks.workunit.client.0.smithi046.stdout:9/112: mkdir d0/d29 0 2024-04-26T12:28:45.725 INFO:tasks.workunit.client.0.smithi046.stdout:6/146: write d7/d2b/d31/f35 [614141,78079] 0 2024-04-26T12:28:45.725 INFO:tasks.workunit.client.0.smithi046.stdout:8/118: mkdir d7/d1c/d1d 0 2024-04-26T12:28:45.726 INFO:tasks.workunit.client.0.smithi046.stdout:8/119: stat f4 0 2024-04-26T12:28:45.726 INFO:tasks.workunit.client.0.smithi046.stdout:4/172: dread d0/da/fd [0,4194304] 0 2024-04-26T12:28:45.726 INFO:tasks.workunit.client.0.smithi046.stdout:7/167: truncate d16/d1c/f24 1080646 0 2024-04-26T12:28:45.727 INFO:tasks.workunit.client.0.smithi046.stdout:0/187: creat d9/dc/dd/f3a x:0 0 0 2024-04-26T12:28:45.727 INFO:tasks.workunit.client.0.smithi046.stdout:6/147: creat d7/d1b/d37/f38 x:0 0 0 2024-04-26T12:28:45.728 INFO:tasks.workunit.client.0.smithi046.stdout:5/163: dwrite f2 [0,4194304] 0 2024-04-26T12:28:45.729 INFO:tasks.workunit.client.0.smithi046.stdout:2/172: truncate d1/de/ff 134353 0 2024-04-26T12:28:45.731 INFO:tasks.workunit.client.0.smithi046.stdout:6/148: creat d7/d2b/d31/f39 x:0 0 0 2024-04-26T12:28:45.735 INFO:tasks.workunit.client.0.smithi046.stdout:0/188: dread f8 [0,4194304] 0 2024-04-26T12:28:45.737 INFO:tasks.workunit.client.0.smithi046.stdout:3/182: dwrite d2/f1d [0,4194304] 0 2024-04-26T12:28:45.738 INFO:tasks.workunit.client.0.smithi046.stdout:6/149: mknod d7/d1b/c3a 0 2024-04-26T12:28:45.738 INFO:tasks.workunit.client.0.smithi046.stdout:2/173: mknod d1/d13/d1b/c36 0 2024-04-26T12:28:45.738 INFO:tasks.workunit.client.0.smithi046.stdout:9/113: dwrite d0/d6/f26 [0,4194304] 0 2024-04-26T12:28:45.738 INFO:tasks.workunit.client.0.smithi046.stdout:1/135: write d7/d9/fa [4259369,121464] 0 2024-04-26T12:28:45.740 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:45.741 INFO:tasks.workunit.client.0.smithi046.stdout:7/168: dwrite f6 [0,4194304] 0 2024-04-26T12:28:45.741 INFO:tasks.workunit.client.0.smithi046.stdout:5/164: symlink d9/da/dd/l38 0 2024-04-26T12:28:45.741 INFO:tasks.workunit.client.0.smithi046.stdout:8/120: dwrite d7/dc/f17 [0,4194304] 0 2024-04-26T12:28:45.742 INFO:tasks.workunit.client.0.smithi046.stdout:2/174: write d1/de/f31 [694686,72439] 0 2024-04-26T12:28:45.743 INFO:tasks.workunit.client.0.smithi046.stdout:7/169: write d16/f20 [1230454,116496] 0 2024-04-26T12:28:45.743 INFO:tasks.workunit.client.0.smithi046.stdout:4/173: dwrite d0/da/d17/d20/d25/f33 [0,4194304] 0 2024-04-26T12:28:45.743 INFO:tasks.workunit.client.0.smithi046.stdout:3/183: mknod d2/d16/d35/c3f 0 2024-04-26T12:28:45.744 INFO:tasks.workunit.client.0.smithi046.stdout:1/136: mkdir d7/d9/d33 0 2024-04-26T12:28:45.744 INFO:tasks.workunit.client.0.smithi046.stdout:8/121: stat d7/f8 0 2024-04-26T12:28:45.744 INFO:tasks.workunit.client.0.smithi046.stdout:4/174: chown d0/d1d/l2a 113 1 2024-04-26T12:28:45.745 INFO:tasks.workunit.client.0.smithi046.stdout:5/165: rename d9/f1c to d9/da/d18/f39 0 2024-04-26T12:28:45.745 INFO:tasks.workunit.client.0.smithi046.stdout:7/170: creat d16/d1c/f3d x:0 0 0 2024-04-26T12:28:45.745 INFO:tasks.workunit.client.0.smithi046.stdout:3/184: creat d2/d16/d11/d39/f40 x:0 0 0 2024-04-26T12:28:45.747 INFO:tasks.workunit.client.0.smithi046.stdout:4/175: write d0/f14 [787482,36589] 0 2024-04-26T12:28:45.748 INFO:tasks.workunit.client.0.smithi046.stdout:8/122: creat d7/d1c/f1e x:0 0 0 2024-04-26T12:28:45.748 INFO:tasks.workunit.client.0.smithi046.stdout:9/114: dwrite d0/f5 [4194304,4194304] 0 2024-04-26T12:28:45.748 INFO:tasks.workunit.client.0.smithi046.stdout:7/171: chown d16/f23 1 1 2024-04-26T12:28:45.748 INFO:tasks.workunit.client.0.smithi046.stdout:1/137: truncate d7/d12/f21 1450765 0 2024-04-26T12:28:45.748 INFO:tasks.workunit.client.0.smithi046.stdout:5/166: symlink d9/da/l3a 0 2024-04-26T12:28:45.748 INFO:tasks.workunit.client.0.smithi046.stdout:3/185: creat d2/d16/d11/d1b/d2d/f41 x:0 0 0 2024-04-26T12:28:45.749 INFO:tasks.workunit.client.0.smithi046.stdout:6/150: dwrite d7/d2b/d31/f34 [0,4194304] 0 2024-04-26T12:28:45.749 INFO:tasks.workunit.client.0.smithi046.stdout:1/138: dread - d7/d14/f2f zero size 2024-04-26T12:28:45.749 INFO:tasks.workunit.client.0.smithi046.stdout:5/167: dread - d9/f29 zero size 2024-04-26T12:28:45.750 INFO:tasks.workunit.client.0.smithi046.stdout:6/151: stat d7/lf 0 2024-04-26T12:28:45.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/123: symlink d7/da/l1f 0 2024-04-26T12:28:45.750 INFO:tasks.workunit.client.0.smithi046.stdout:7/172: truncate d16/d1c/f3d 283756 0 2024-04-26T12:28:45.750 INFO:tasks.workunit.client.0.smithi046.stdout:3/186: fsync d2/db/fe 0 2024-04-26T12:28:45.751 INFO:tasks.workunit.client.0.smithi046.stdout:9/115: creat d0/d29/f2a x:0 0 0 2024-04-26T12:28:45.751 INFO:tasks.workunit.client.0.smithi046.stdout:4/176: rename d0/d1/c38 to d0/da/d17/d20/d25/c3e 0 2024-04-26T12:28:45.751 INFO:tasks.workunit.client.0.smithi046.stdout:7/173: rmdir d16 39 2024-04-26T12:28:45.751 INFO:tasks.workunit.client.0.smithi046.stdout:8/124: write f4 [515252,120068] 0 2024-04-26T12:28:45.751 INFO:tasks.workunit.client.0.smithi046.stdout:9/116: chown d0/d16/l22 1124518 1 2024-04-26T12:28:45.751 INFO:tasks.workunit.client.0.smithi046.stdout:1/139: symlink d7/d9/d2b/d31/l34 0 2024-04-26T12:28:45.752 INFO:tasks.workunit.client.0.smithi046.stdout:9/117: truncate d0/d29/f2a 105132 0 2024-04-26T12:28:45.752 INFO:tasks.workunit.client.0.smithi046.stdout:9/118: sync 2024-04-26T12:28:45.752 INFO:tasks.workunit.client.0.smithi046.stdout:8/125: chown d7/da/df/c14 16247217 1 2024-04-26T12:28:45.753 INFO:tasks.workunit.client.0.smithi046.stdout:4/177: truncate d0/d1/d5/db/f2f 4724902 0 2024-04-26T12:28:45.754 INFO:tasks.workunit.client.0.smithi046.stdout:0/189: dread d9/dc/f26 [0,4194304] 0 2024-04-26T12:28:45.754 INFO:tasks.workunit.client.0.smithi046.stdout:4/178: fdatasync d0/da/f26 0 2024-04-26T12:28:45.754 INFO:tasks.workunit.client.0.smithi046.stdout:2/175: truncate d1/de/f11 633043 0 2024-04-26T12:28:45.754 INFO:tasks.workunit.client.0.smithi046.stdout:6/152: link d7/d2b/f30 d7/d1b/d37/f3b 0 2024-04-26T12:28:45.754 INFO:tasks.workunit.client.0.smithi046.stdout:8/126: symlink d7/dc/l20 0 2024-04-26T12:28:45.755 INFO:tasks.workunit.client.0.smithi046.stdout:5/168: rename d9/da/d15/d2e to d9/da/d3b 0 2024-04-26T12:28:45.755 INFO:tasks.workunit.client.0.smithi046.stdout:3/187: getdents d2/d16/d11/d39 0 2024-04-26T12:28:45.755 INFO:tasks.workunit.client.0.smithi046.stdout:0/190: dread - d9/dc/f37 zero size 2024-04-26T12:28:45.755 INFO:tasks.workunit.client.0.smithi046.stdout:3/188: chown d2 236 1 2024-04-26T12:28:45.755 INFO:tasks.workunit.client.0.smithi046.stdout:9/119: link d0/f15 d0/f2b 0 2024-04-26T12:28:45.756 INFO:tasks.workunit.client.0.smithi046.stdout:0/191: write d9/dc/dd/f14 [7216876,10683] 0 2024-04-26T12:28:45.756 INFO:tasks.workunit.client.0.smithi046.stdout:3/189: creat d2/d16/d11/d1f/f42 x:0 0 0 2024-04-26T12:28:45.756 INFO:tasks.workunit.client.0.smithi046.stdout:1/140: link d7/d12/l2e d7/d14/d1c/d32/l35 0 2024-04-26T12:28:45.757 INFO:tasks.workunit.client.0.smithi046.stdout:6/153: write d7/d1b/d37/f3b [654585,61372] 0 2024-04-26T12:28:45.758 INFO:tasks.workunit.client.0.smithi046.stdout:5/169: link d9/da/dd/f36 d9/da/f3c 0 2024-04-26T12:28:45.758 INFO:tasks.workunit.client.0.smithi046.stdout:5/170: stat c6 0 2024-04-26T12:28:45.758 INFO:tasks.workunit.client.0.smithi046.stdout:3/190: symlink d2/d16/d11/d1f/l43 0 2024-04-26T12:28:45.758 INFO:tasks.workunit.client.0.smithi046.stdout:3/191: sync 2024-04-26T12:28:45.759 INFO:tasks.workunit.client.0.smithi046.stdout:0/192: write d9/f20 [654199,86951] 0 2024-04-26T12:28:45.759 INFO:tasks.workunit.client.0.smithi046.stdout:6/154: read - d7/d1b/f26 zero size 2024-04-26T12:28:45.760 INFO:tasks.workunit.client.0.smithi046.stdout:4/179: write d0/d1/d9/f13 [218596,79228] 0 2024-04-26T12:28:45.762 INFO:tasks.workunit.client.0.smithi046.stdout:8/127: dwrite d7/dc/f18 [0,4194304] 0 2024-04-26T12:28:45.762 INFO:tasks.workunit.client.0.smithi046.stdout:0/193: creat d9/f3b x:0 0 0 2024-04-26T12:28:45.764 INFO:tasks.workunit.client.0.smithi046.stdout:8/128: mknod d7/da/c21 0 2024-04-26T12:28:45.764 INFO:tasks.workunit.client.0.smithi046.stdout:5/171: rmdir d9/da/dd 39 2024-04-26T12:28:45.765 INFO:tasks.workunit.client.0.smithi046.stdout:1/141: truncate d7/d9/f17 3728584 0 2024-04-26T12:28:45.765 INFO:tasks.workunit.client.0.smithi046.stdout:8/129: chown d7/da/l19 11570 1 2024-04-26T12:28:45.768 INFO:tasks.workunit.client.0.smithi046.stdout:7/174: dread d16/d1c/f3d [0,4194304] 0 2024-04-26T12:28:45.768 INFO:tasks.workunit.client.0.smithi046.stdout:2/176: dwrite d1/f2 [0,4194304] 0 2024-04-26T12:28:45.769 INFO:tasks.workunit.client.0.smithi046.stdout:1/142: dread - d7/d14/f2d zero size 2024-04-26T12:28:45.769 INFO:tasks.workunit.client.0.smithi046.stdout:0/194: creat d9/d1d/f3c x:0 0 0 2024-04-26T12:28:45.769 INFO:tasks.workunit.client.0.smithi046.stdout:5/172: mknod d9/da/d3b/d35/c3d 0 2024-04-26T12:28:45.769 INFO:tasks.workunit.client.0.smithi046.stdout:3/192: dwrite d2/d16/d11/f3d [0,4194304] 0 2024-04-26T12:28:45.769 INFO:tasks.workunit.client.0.smithi046.stdout:8/130: write d7/dc/f18 [4154182,51002] 0 2024-04-26T12:28:45.769 INFO:tasks.workunit.client.0.smithi046.stdout:3/193: sync 2024-04-26T12:28:45.770 INFO:tasks.workunit.client.0.smithi046.stdout:6/155: dwrite d7/f15 [0,4194304] 0 2024-04-26T12:28:45.770 INFO:tasks.workunit.client.0.smithi046.stdout:7/175: write d16/d35/f3b [763294,47584] 0 2024-04-26T12:28:45.770 INFO:tasks.workunit.client.0.smithi046.stdout:0/195: symlink d9/dc/dd/l3d 0 2024-04-26T12:28:45.770 INFO:tasks.workunit.client.0.smithi046.stdout:8/131: write d7/dc/f13 [15749,83198] 0 2024-04-26T12:28:45.771 INFO:tasks.workunit.client.0.smithi046.stdout:2/177: creat d1/de/d2b/f37 x:0 0 0 2024-04-26T12:28:45.771 INFO:tasks.workunit.client.0.smithi046.stdout:7/176: mkdir d16/d1a/d3e 0 2024-04-26T12:28:45.771 INFO:tasks.workunit.client.0.smithi046.stdout:6/156: chown d7/d2b/l32 59855 1 2024-04-26T12:28:45.771 INFO:tasks.workunit.client.0.smithi046.stdout:0/196: rename d9/dc/dd/c28 to d9/dc/d2a/c3e 0 2024-04-26T12:28:45.771 INFO:tasks.workunit.client.0.smithi046.stdout:7/177: read f5 [427849,2282] 0 2024-04-26T12:28:45.772 INFO:tasks.workunit.client.0.smithi046.stdout:5/173: mkdir d9/da/dd/d34/d3e 0 2024-04-26T12:28:45.773 INFO:tasks.workunit.client.0.smithi046.stdout:2/178: chown d1/de/d15/d18/l1a 40948768 1 2024-04-26T12:28:45.773 INFO:tasks.workunit.client.0.smithi046.stdout:6/157: fdatasync d7/f20 0 2024-04-26T12:28:45.773 INFO:tasks.workunit.client.0.smithi046.stdout:2/179: write d1/de/f31 [436450,84289] 0 2024-04-26T12:28:45.773 INFO:tasks.workunit.client.0.smithi046.stdout:3/194: link d2/db/c27 d2/d16/d11/d23/c44 0 2024-04-26T12:28:45.773 INFO:tasks.workunit.client.0.smithi046.stdout:7/178: write d16/d1a/f2b [65073,64268] 0 2024-04-26T12:28:45.773 INFO:tasks.workunit.client.0.smithi046.stdout:8/132: creat d7/dc/f22 x:0 0 0 2024-04-26T12:28:45.773 INFO:tasks.workunit.client.0.smithi046.stdout:8/133: chown d7/f8 99469 1 2024-04-26T12:28:45.775 INFO:tasks.workunit.client.0.smithi046.stdout:8/134: write f4 [1331101,112951] 0 2024-04-26T12:28:45.775 INFO:tasks.workunit.client.0.smithi046.stdout:2/180: truncate d1/de/d15/d18/f2c 1270151 0 2024-04-26T12:28:45.775 INFO:tasks.workunit.client.0.smithi046.stdout:1/143: getdents d7/d14/d1c/d32 0 2024-04-26T12:28:45.775 INFO:tasks.workunit.client.0.smithi046.stdout:3/195: symlink d2/d16/d11/d1f/l45 0 2024-04-26T12:28:45.776 INFO:tasks.workunit.client.0.smithi046.stdout:6/158: dread d7/f15 [0,4194304] 0 2024-04-26T12:28:45.776 INFO:tasks.workunit.client.0.smithi046.stdout:3/196: chown d2/d16/d11/d1f/l45 17078 1 2024-04-26T12:28:45.776 INFO:tasks.workunit.client.0.smithi046.stdout:6/159: sync 2024-04-26T12:28:45.776 INFO:tasks.workunit.client.0.smithi046.stdout:8/135: unlink d7/d1c/f1e 0 2024-04-26T12:28:45.777 INFO:tasks.workunit.client.0.smithi046.stdout:7/179: mkdir d16/d3f 0 2024-04-26T12:28:45.777 INFO:tasks.workunit.client.0.smithi046.stdout:5/174: getdents d9/da/d3b 0 2024-04-26T12:28:45.778 INFO:tasks.workunit.client.0.smithi046.stdout:7/180: mknod d16/d1a/d31/c40 0 2024-04-26T12:28:45.779 INFO:tasks.workunit.client.0.smithi046.stdout:8/136: write d7/dc/f17 [317053,94857] 0 2024-04-26T12:28:45.779 INFO:tasks.workunit.client.0.smithi046.stdout:3/197: truncate d2/d16/d11/d1b/d2d/f41 450015 0 2024-04-26T12:28:45.779 INFO:tasks.workunit.client.0.smithi046.stdout:5/175: mkdir d9/da/dd/d34/d3e/d3f 0 2024-04-26T12:28:45.780 INFO:tasks.workunit.client.0.smithi046.stdout:8/137: write d7/dc/f17 [2182855,16464] 0 2024-04-26T12:28:45.780 INFO:tasks.workunit.client.0.smithi046.stdout:7/181: rename cc to d16/d1a/c41 0 2024-04-26T12:28:45.780 INFO:tasks.workunit.client.0.smithi046.stdout:3/198: write d2/db/f15 [767077,125236] 0 2024-04-26T12:28:45.780 INFO:tasks.workunit.client.0.smithi046.stdout:5/176: mkdir d9/da/d40 0 2024-04-26T12:28:45.781 INFO:tasks.workunit.client.0.smithi046.stdout:7/182: chown d16/d1c 652400 1 2024-04-26T12:28:45.781 INFO:tasks.workunit.client.0.smithi046.stdout:2/181: dwrite d1/f2 [0,4194304] 0 2024-04-26T12:28:45.781 INFO:tasks.workunit.client.0.smithi046.stdout:8/138: creat d7/da/f23 x:0 0 0 2024-04-26T12:28:45.782 INFO:tasks.workunit.client.0.smithi046.stdout:7/183: write d16/d1c/f2a [4858379,118801] 0 2024-04-26T12:28:45.782 INFO:tasks.workunit.client.0.smithi046.stdout:6/160: dread d7/d2b/d31/f34 [0,4194304] 0 2024-04-26T12:28:45.782 INFO:tasks.workunit.client.0.smithi046.stdout:3/199: unlink d2/c9 0 2024-04-26T12:28:45.782 INFO:tasks.workunit.client.0.smithi046.stdout:4/180: dread d0/da/f26 [0,4194304] 0 2024-04-26T12:28:45.783 INFO:tasks.workunit.client.0.smithi046.stdout:0/197: getdents d9/dc/d2a 0 2024-04-26T12:28:45.783 INFO:tasks.workunit.client.0.smithi046.stdout:3/200: write d2/db/fe [234752,120624] 0 2024-04-26T12:28:45.783 INFO:tasks.workunit.client.0.smithi046.stdout:0/198: fsync d9/fa 0 2024-04-26T12:28:45.785 INFO:tasks.workunit.client.0.smithi046.stdout:4/181: mkdir d0/d1d/d3f 0 2024-04-26T12:28:45.785 INFO:tasks.workunit.client.0.smithi046.stdout:5/177: link d9/da/d18/f2d d9/f41 0 2024-04-26T12:28:45.785 INFO:tasks.workunit.client.0.smithi046.stdout:0/199: rmdir d9/dc/dd 39 2024-04-26T12:28:45.786 INFO:tasks.workunit.client.0.smithi046.stdout:4/182: symlink d0/d1/d12/l40 0 2024-04-26T12:28:45.786 INFO:tasks.workunit.client.0.smithi046.stdout:3/201: write d2/d16/d11/d1b/d2d/f41 [901169,59883] 0 2024-04-26T12:28:45.787 INFO:tasks.workunit.client.0.smithi046.stdout:5/178: unlink d9/da/d15/f31 0 2024-04-26T12:28:45.787 INFO:tasks.workunit.client.0.smithi046.stdout:0/200: creat d9/f3f x:0 0 0 2024-04-26T12:28:45.788 INFO:tasks.workunit.client.0.smithi046.stdout:8/139: dwrite d7/dc/f18 [0,4194304] 0 2024-04-26T12:28:45.788 INFO:tasks.workunit.client.0.smithi046.stdout:5/179: readlink d9/da/d18/l30 0 2024-04-26T12:28:45.789 INFO:tasks.workunit.client.0.smithi046.stdout:6/161: dwrite d7/d2b/d31/f39 [0,4194304] 0 2024-04-26T12:28:45.789 INFO:tasks.workunit.client.0.smithi046.stdout:3/202: mknod d2/d16/d11/d1b/c46 0 2024-04-26T12:28:45.790 INFO:tasks.workunit.client.0.smithi046.stdout:5/180: creat d9/da/d18/f42 x:0 0 0 2024-04-26T12:28:45.791 INFO:tasks.workunit.client.0.smithi046.stdout:3/203: symlink d2/d16/d11/d1f/l47 0 2024-04-26T12:28:45.791 INFO:tasks.workunit.client.0.smithi046.stdout:6/162: symlink d7/d2b/l3c 0 2024-04-26T12:28:45.791 INFO:tasks.workunit.client.0.smithi046.stdout:1/144: dread d7/d9/fa [0,4194304] 0 2024-04-26T12:28:45.791 INFO:tasks.workunit.client.0.smithi046.stdout:5/181: read - d9/f2c zero size 2024-04-26T12:28:45.792 INFO:tasks.workunit.client.0.smithi046.stdout:0/201: getdents d9/dc/dd 0 2024-04-26T12:28:45.792 INFO:tasks.workunit.client.0.smithi046.stdout:3/204: mknod d2/d16/c48 0 2024-04-26T12:28:45.792 INFO:tasks.workunit.client.0.smithi046.stdout:6/163: symlink d7/d16/l3d 0 2024-04-26T12:28:45.793 INFO:tasks.workunit.client.0.smithi046.stdout:5/182: mknod d9/c43 0 2024-04-26T12:28:45.793 INFO:tasks.workunit.client.0.smithi046.stdout:0/202: mkdir d9/d1d/d40 0 2024-04-26T12:28:45.793 INFO:tasks.workunit.client.0.smithi046.stdout:3/205: read d2/db/f18 [359921,100560] 0 2024-04-26T12:28:45.795 INFO:tasks.workunit.client.0.smithi046.stdout:0/203: chown d9/d1d/f3c 5 1 2024-04-26T12:28:45.795 INFO:tasks.workunit.client.0.smithi046.stdout:6/164: getdents d7 0 2024-04-26T12:28:45.796 INFO:tasks.workunit.client.0.smithi046.stdout:3/206: fdatasync d2/d16/d11/d1f/f38 0 2024-04-26T12:28:45.796 INFO:tasks.workunit.client.0.smithi046.stdout:8/140: dwrite d7/da/f23 [0,4194304] 0 2024-04-26T12:28:45.796 INFO:tasks.workunit.client.0.smithi046.stdout:0/204: mkdir d9/d1d/d40/d41 0 2024-04-26T12:28:45.796 INFO:tasks.workunit.client.0.smithi046.stdout:6/165: write d7/f29 [391095,76496] 0 2024-04-26T12:28:45.797 INFO:tasks.workunit.client.0.smithi046.stdout:0/205: dread - d9/f3f zero size 2024-04-26T12:28:45.798 INFO:tasks.workunit.client.0.smithi046.stdout:6/166: dread - d7/d1b/d37/f38 zero size 2024-04-26T12:28:45.798 INFO:tasks.workunit.client.0.smithi046.stdout:3/207: creat d2/d16/d11/d23/f49 x:0 0 0 2024-04-26T12:28:45.798 INFO:tasks.workunit.client.0.smithi046.stdout:1/145: dwrite d7/d14/f19 [0,4194304] 0 2024-04-26T12:28:45.798 INFO:tasks.workunit.client.0.smithi046.stdout:8/141: rename d7/d1c/d1d to d7/d24 0 2024-04-26T12:28:45.799 INFO:tasks.workunit.client.0.smithi046.stdout:0/206: creat d9/dc/f42 x:0 0 0 2024-04-26T12:28:45.799 INFO:tasks.workunit.client.0.smithi046.stdout:3/208: unlink d2/db/f13 0 2024-04-26T12:28:45.800 INFO:tasks.workunit.client.0.smithi046.stdout:6/167: rename d7/d2b/d31/c33 to d7/d16/c3e 0 2024-04-26T12:28:45.800 INFO:tasks.workunit.client.0.smithi046.stdout:1/146: rename d7/d12/f1f to d7/d12/f36 0 2024-04-26T12:28:45.800 INFO:tasks.workunit.client.0.smithi046.stdout:3/209: dread - d2/d16/d11/d1f/f38 zero size 2024-04-26T12:28:45.800 INFO:tasks.workunit.client.0.smithi046.stdout:0/207: mkdir d9/d1d/d40/d41/d43 0 2024-04-26T12:28:45.800 INFO:tasks.workunit.client.0.smithi046.stdout:8/142: rename d7/cd to d7/c25 0 2024-04-26T12:28:45.800 INFO:tasks.workunit.client.0.smithi046.stdout:6/168: creat d7/d2b/d31/f3f x:0 0 0 2024-04-26T12:28:45.801 INFO:tasks.workunit.client.0.smithi046.stdout:0/208: symlink d9/dc/dd/l44 0 2024-04-26T12:28:45.801 INFO:tasks.workunit.client.0.smithi046.stdout:8/143: write d7/dc/f22 [603088,24819] 0 2024-04-26T12:28:45.803 INFO:tasks.workunit.client.0.smithi046.stdout:6/169: mknod d7/d2b/d31/c40 0 2024-04-26T12:28:45.803 INFO:tasks.workunit.client.0.smithi046.stdout:7/184: truncate f3 1413110 0 2024-04-26T12:28:45.803 INFO:tasks.workunit.client.0.smithi046.stdout:3/210: rename d2/d16/d11/d39 to d2/db/d4a 0 2024-04-26T12:28:45.803 INFO:tasks.workunit.client.0.smithi046.stdout:2/182: write d1/de/ff [945005,119057] 0 2024-04-26T12:28:45.804 INFO:tasks.workunit.client.0.smithi046.stdout:0/209: mkdir d9/dc/dd/d45 0 2024-04-26T12:28:45.804 INFO:tasks.workunit.client.0.smithi046.stdout:8/144: write d7/da/df/f10 [2180237,80233] 0 2024-04-26T12:28:45.804 INFO:tasks.workunit.client.0.smithi046.stdout:2/183: unlink d1/f8 0 2024-04-26T12:28:45.805 INFO:tasks.workunit.client.0.smithi046.stdout:8/145: read d7/f8 [1206646,12751] 0 2024-04-26T12:28:45.805 INFO:tasks.workunit.client.0.smithi046.stdout:1/147: dread d7/db/f10 [0,4194304] 0 2024-04-26T12:28:45.805 INFO:tasks.workunit.client.0.smithi046.stdout:8/146: symlink d7/d24/l26 0 2024-04-26T12:28:45.805 INFO:tasks.workunit.client.0.smithi046.stdout:3/211: creat d2/d16/d11/f4b x:0 0 0 2024-04-26T12:28:45.805 INFO:tasks.workunit.client.0.smithi046.stdout:0/210: symlink d9/dc/l46 0 2024-04-26T12:28:45.806 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:45.804+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:45.807 INFO:tasks.workunit.client.0.smithi046.stdout:1/148: fdatasync d7/d12/f36 0 2024-04-26T12:28:45.807 INFO:tasks.workunit.client.0.smithi046.stdout:6/170: dread d7/fe [0,4194304] 0 2024-04-26T12:28:45.807 INFO:tasks.workunit.client.0.smithi046.stdout:3/212: chown d2/d16/d11/l33 0 1 2024-04-26T12:28:45.807 INFO:tasks.workunit.client.0.smithi046.stdout:6/171: sync 2024-04-26T12:28:45.807 INFO:tasks.workunit.client.0.smithi046.stdout:8/147: write d7/da/f1a [5064320,46249] 0 2024-04-26T12:28:45.808 INFO:tasks.workunit.client.0.smithi046.stdout:0/211: mkdir d9/d1d/d40/d41/d47 0 2024-04-26T12:28:45.808 INFO:tasks.workunit.client.0.smithi046.stdout:1/149: symlink d7/d14/d1c/d32/l37 0 2024-04-26T12:28:45.808 INFO:tasks.workunit.client.0.smithi046.stdout:6/172: symlink d7/d1b/l41 0 2024-04-26T12:28:45.808 INFO:tasks.workunit.client.0.smithi046.stdout:1/150: read d7/d14/f19 [3365128,62927] 0 2024-04-26T12:28:45.808 INFO:tasks.workunit.client.0.smithi046.stdout:8/148: mkdir d7/dc/d27 0 2024-04-26T12:28:45.809 INFO:tasks.workunit.client.0.smithi046.stdout:0/212: getdents d9/dc/dd/d45 0 2024-04-26T12:28:45.809 INFO:tasks.workunit.client.0.smithi046.stdout:6/173: truncate d7/f20 155348 0 2024-04-26T12:28:45.809 INFO:tasks.workunit.client.0.smithi046.stdout:8/149: mkdir d7/d24/d28 0 2024-04-26T12:28:45.810 INFO:tasks.workunit.client.0.smithi046.stdout:1/151: readlink d7/d12/l2e 0 2024-04-26T12:28:45.810 INFO:tasks.workunit.client.0.smithi046.stdout:2/184: dwrite d1/de/f31 [0,4194304] 0 2024-04-26T12:28:45.814 INFO:tasks.workunit.client.0.smithi046.stdout:4/183: rename d0/d1d to d0/d41 0 2024-04-26T12:28:45.815 INFO:tasks.workunit.client.0.smithi046.stdout:1/152: mkdir d7/d38 0 2024-04-26T12:28:45.816 INFO:tasks.workunit.client.0.smithi046.stdout:2/185: mkdir d1/d13/d1b/d38 0 2024-04-26T12:28:45.816 INFO:tasks.workunit.client.0.smithi046.stdout:7/185: dread d16/d1c/f2a [4194304,4194304] 0 2024-04-26T12:28:45.816 INFO:tasks.workunit.client.0.smithi046.stdout:3/213: dwrite d2/d16/d11/d23/f26 [0,4194304] 0 2024-04-26T12:28:45.816 INFO:tasks.workunit.client.0.smithi046.stdout:8/150: creat d7/d1c/f29 x:0 0 0 2024-04-26T12:28:45.816 INFO:tasks.workunit.client.0.smithi046.stdout:4/184: write d0/da/d17/d20/f39 [1681425,7120] 0 2024-04-26T12:28:45.817 INFO:tasks.workunit.client.0.smithi046.stdout:0/213: dwrite d9/f20 [0,4194304] 0 2024-04-26T12:28:45.817 INFO:tasks.workunit.client.0.smithi046.stdout:6/174: dread d7/d2b/d31/f34 [0,4194304] 0 2024-04-26T12:28:45.818 INFO:tasks.workunit.client.0.smithi046.stdout:4/185: truncate d0/da/f26 358110 0 2024-04-26T12:28:45.819 INFO:tasks.workunit.client.0.smithi046.stdout:0/214: readlink d9/dc/l46 0 2024-04-26T12:28:45.821 INFO:tasks.workunit.client.0.smithi046.stdout:4/186: write d0/d1/d5/f11 [3431301,121619] 0 2024-04-26T12:28:45.821 INFO:tasks.workunit.client.0.smithi046.stdout:0/215: fsync d9/dc/f1a 0 2024-04-26T12:28:45.821 INFO:tasks.workunit.client.0.smithi046.stdout:2/186: symlink d1/de/d2b/l39 0 2024-04-26T12:28:45.822 INFO:tasks.workunit.client.0.smithi046.stdout:8/151: mkdir d7/d24/d28/d2a 0 2024-04-26T12:28:45.823 INFO:tasks.workunit.client.0.smithi046.stdout:7/186: rename d16/d1c/c38 to d16/d27/c42 0 2024-04-26T12:28:45.824 INFO:tasks.workunit.client.0.smithi046.stdout:0/216: write d9/dc/f26 [673989,87065] 0 2024-04-26T12:28:45.825 INFO:tasks.workunit.client.0.smithi046.stdout:3/214: dwrite d2/db/f18 [0,4194304] 0 2024-04-26T12:28:45.825 INFO:tasks.workunit.client.0.smithi046.stdout:7/187: unlink d16/d1c/f26 0 2024-04-26T12:28:45.825 INFO:tasks.workunit.client.0.smithi046.stdout:2/187: rename d1/de/d15/d18/f2e to d1/de/d2b/f3a 0 2024-04-26T12:28:45.827 INFO:tasks.workunit.client.0.smithi046.stdout:0/217: write d9/dc/f1c [1782361,60428] 0 2024-04-26T12:28:45.827 INFO:tasks.workunit.client.0.smithi046.stdout:7/188: rmdir d16/d1a/d31 39 2024-04-26T12:28:45.827 INFO:tasks.workunit.client.0.smithi046.stdout:2/188: write d1/de/d2b/f37 [1022287,107785] 0 2024-04-26T12:28:45.827 INFO:tasks.workunit.client.0.smithi046.stdout:7/189: symlink d16/d27/l43 0 2024-04-26T12:28:45.828 INFO:tasks.workunit.client.0.smithi046.stdout:3/215: getdents d2/d16/d35 0 2024-04-26T12:28:45.828 INFO:tasks.workunit.client.0.smithi046.stdout:6/175: creat d7/d1b/d37/f42 x:0 0 0 2024-04-26T12:28:45.828 INFO:tasks.workunit.client.0.smithi046.stdout:4/187: read d0/d1/f15 [3505277,7089] 0 2024-04-26T12:28:45.832 INFO:tasks.workunit.client.0.smithi046.stdout:7/190: fdatasync d16/f19 0 2024-04-26T12:28:45.832 INFO:tasks.workunit.client.0.smithi046.stdout:3/216: creat d2/d16/d11/d1b/d2d/f4c x:0 0 0 2024-04-26T12:28:45.832 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2024-04-26T12:28:45.833 INFO:tasks.workunit.client.0.smithi046.stdout:2/189: creat d1/d13/d1b/d38/f3b x:0 0 0 2024-04-26T12:28:45.833 INFO:tasks.workunit.client.0.smithi046.stdout:9/120: dread d0/d6/ff [0,4194304] 0 2024-04-26T12:28:45.833 INFO:tasks.workunit.client.0.smithi046.stdout:5/183: dread d9/da/f1b [0,4194304] 0 2024-04-26T12:28:45.835 INFO:tasks.workunit.client.0.smithi046.stdout:5/184: readlink d9/l14 0 2024-04-26T12:28:45.835 INFO:tasks.workunit.client.0.smithi046.stdout:3/217: write d2/d16/d11/f3d [3574584,57058] 0 2024-04-26T12:28:45.835 INFO:tasks.workunit.client.0.smithi046.stdout:9/121: mkdir d0/d2c 0 2024-04-26T12:28:45.836 INFO:tasks.workunit.client.0.smithi046.stdout:0/218: dwrite d9/f10 [0,4194304] 0 2024-04-26T12:28:45.836 INFO:tasks.workunit.client.0.smithi046.stdout:7/191: creat d16/d1a/d3e/f44 x:0 0 0 2024-04-26T12:28:45.836 INFO:tasks.workunit.client.0.smithi046.stdout:2/190: creat d1/de/f3c x:0 0 0 2024-04-26T12:28:45.836 INFO:tasks.workunit.client.0.smithi046.stdout:8/152: truncate d7/da/f23 1883134 0 2024-04-26T12:28:45.837 INFO:tasks.workunit.client.0.smithi046.stdout:9/122: creat d0/d6/f2d x:0 0 0 2024-04-26T12:28:45.837 INFO:tasks.workunit.client.0.smithi046.stdout:3/218: mknod d2/d16/d11/d1b/c4d 0 2024-04-26T12:28:45.838 INFO:tasks.workunit.client.0.smithi046.stdout:7/192: mkdir d16/d1c/d45 0 2024-04-26T12:28:45.838 INFO:tasks.workunit.client.0.smithi046.stdout:0/219: write d9/dc/f42 [297090,18590] 0 2024-04-26T12:28:45.838 INFO:tasks.workunit.client.0.smithi046.stdout:4/188: dwrite d0/d1/d29/f30 [4194304,4194304] 0 2024-04-26T12:28:45.838 INFO:tasks.workunit.client.0.smithi046.stdout:9/123: fsync d0/f1d 0 2024-04-26T12:28:45.839 INFO:tasks.workunit.client.0.smithi046.stdout:8/153: link d7/dc/f13 d7/da/df/f2b 0 2024-04-26T12:28:45.839 INFO:tasks.workunit.client.0.smithi046.stdout:3/219: write d2/d16/d11/d1b/d2d/f41 [690748,127743] 0 2024-04-26T12:28:45.839 INFO:tasks.workunit.client.0.smithi046.stdout:7/193: symlink d16/d3f/l46 0 2024-04-26T12:28:45.840 INFO:tasks.workunit.client.0.smithi046.stdout:8/154: creat d7/d24/d28/f2c x:0 0 0 2024-04-26T12:28:45.840 INFO:tasks.workunit.client.0.smithi046.stdout:7/194: creat d16/d3f/f47 x:0 0 0 2024-04-26T12:28:45.841 INFO:tasks.workunit.client.0.smithi046.stdout:3/220: truncate d2/db/f15 4203062 0 2024-04-26T12:28:45.841 INFO:tasks.workunit.client.0.smithi046.stdout:7/195: chown d16/f19 116972 1 2024-04-26T12:28:45.842 INFO:tasks.workunit.client.0.smithi046.stdout:8/155: rename d7/d1c/f29 to d7/d1c/f2d 0 2024-04-26T12:28:45.842 INFO:tasks.workunit.client.0.smithi046.stdout:3/221: readlink d2/d16/d11/d1f/l47 0 2024-04-26T12:28:45.842 INFO:tasks.workunit.client.0.smithi046.stdout:7/196: chown l2 0 1 2024-04-26T12:28:45.843 INFO:tasks.workunit.client.0.smithi046.stdout:6/176: dwrite d7/fe [0,4194304] 0 2024-04-26T12:28:45.843 INFO:tasks.workunit.client.0.smithi046.stdout:2/191: dread d1/de/f11 [0,4194304] 0 2024-04-26T12:28:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:9/124: dread d0/d6/ff [0,4194304] 0 2024-04-26T12:28:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:7/197: chown d16/f19 0 1 2024-04-26T12:28:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:3/222: creat d2/d16/d35/f4e x:0 0 0 2024-04-26T12:28:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:6/177: read d7/f15 [280962,82386] 0 2024-04-26T12:28:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:8/156: getdents d7 0 2024-04-26T12:28:45.844 INFO:tasks.workunit.client.0.smithi046.stdout:7/198: fdatasync f3 0 2024-04-26T12:28:45.845 INFO:tasks.workunit.client.0.smithi046.stdout:7/199: chown d16/d1c/f24 264943901 1 2024-04-26T12:28:45.845 INFO:tasks.workunit.client.0.smithi046.stdout:2/192: getdents d1/d13 0 2024-04-26T12:28:45.846 INFO:tasks.workunit.client.0.smithi046.stdout:7/200: fdatasync f4 0 2024-04-26T12:28:45.847 INFO:tasks.workunit.client.0.smithi046.stdout:6/178: write d7/f15 [2048643,41245] 0 2024-04-26T12:28:45.847 INFO:tasks.workunit.client.0.smithi046.stdout:2/193: chown d1/cc 3 1 2024-04-26T12:28:45.848 INFO:tasks.workunit.client.0.smithi046.stdout:6/179: creat d7/d2b/d31/f43 x:0 0 0 2024-04-26T12:28:45.848 INFO:tasks.workunit.client.0.smithi046.stdout:2/194: rename d1 to d1/de/d15/d18/d3d 22 2024-04-26T12:28:45.848 INFO:tasks.workunit.client.0.smithi046.stdout:9/125: dread d0/d6/f26 [0,4194304] 0 2024-04-26T12:28:45.849 INFO:tasks.workunit.client.0.smithi046.stdout:6/180: read d7/fa [125695,67557] 0 2024-04-26T12:28:45.850 INFO:tasks.workunit.client.0.smithi046.stdout:9/126: write d0/f24 [261011,6136] 0 2024-04-26T12:28:45.850 INFO:tasks.workunit.client.0.smithi046.stdout:6/181: creat d7/d2b/d31/f44 x:0 0 0 2024-04-26T12:28:45.851 INFO:tasks.workunit.client.0.smithi046.stdout:3/223: dwrite d2/d16/d11/d1b/d2d/f4c [0,4194304] 0 2024-04-26T12:28:45.852 INFO:tasks.workunit.client.0.smithi046.stdout:6/182: mknod d7/d2b/d31/c45 0 2024-04-26T12:28:45.853 INFO:tasks.workunit.client.0.smithi046.stdout:3/224: creat d2/d16/f4f x:0 0 0 2024-04-26T12:28:45.853 INFO:tasks.workunit.client.0.smithi046.stdout:6/183: mknod d7/d1b/c46 0 2024-04-26T12:28:45.854 INFO:tasks.workunit.client.0.smithi046.stdout:5/185: fsync d9/da/d18/f25 0 2024-04-26T12:28:45.855 INFO:tasks.workunit.client.0.smithi046.stdout:8/157: rmdir d7/d1c 39 2024-04-26T12:28:45.855 INFO:tasks.workunit.client.0.smithi046.stdout:6/184: mkdir d7/d1b/d47 0 2024-04-26T12:28:45.856 INFO:tasks.workunit.client.0.smithi046.stdout:3/225: truncate d2/db/d4a/f3b 341816 0 2024-04-26T12:28:45.856 INFO:tasks.workunit.client.0.smithi046.stdout:7/201: write d16/f19 [1323626,120761] 0 2024-04-26T12:28:45.856 INFO:tasks.workunit.client.0.smithi046.stdout:9/127: dwrite d0/d29/f2a [0,4194304] 0 2024-04-26T12:28:45.857 INFO:tasks.workunit.client.0.smithi046.stdout:2/195: truncate d1/d13/d1b/f24 2626611 0 2024-04-26T12:28:45.857 INFO:tasks.workunit.client.0.smithi046.stdout:9/128: chown d0/d6/f1a 182738 1 2024-04-26T12:28:45.858 INFO:tasks.workunit.client.0.smithi046.stdout:3/226: mkdir d2/d16/d2c/d50 0 2024-04-26T12:28:45.859 INFO:tasks.workunit.client.0.smithi046.stdout:9/129: unlink d0/f2b 0 2024-04-26T12:28:45.859 INFO:tasks.workunit.client.0.smithi046.stdout:2/196: rmdir d1/d13/d1b/d38 39 2024-04-26T12:28:45.859 INFO:tasks.workunit.client.0.smithi046.stdout:3/227: mknod d2/d16/c51 0 2024-04-26T12:28:45.859 INFO:tasks.workunit.client.0.smithi046.stdout:9/130: write d0/f1d [742700,104902] 0 2024-04-26T12:28:45.859 INFO:tasks.workunit.client.0.smithi046.stdout:9/131: creat d0/d6/f2e x:0 0 0 2024-04-26T12:28:45.860 INFO:tasks.workunit.client.0.smithi046.stdout:3/228: rename d2/d16/d11/d1f/c32 to d2/db/c52 0 2024-04-26T12:28:45.860 INFO:tasks.workunit.client.0.smithi046.stdout:9/132: chown d0/la 0 1 2024-04-26T12:28:45.861 INFO:tasks.workunit.client.0.smithi046.stdout:9/133: chown d0/f5 7463126 1 2024-04-26T12:28:45.861 INFO:tasks.workunit.client.0.smithi046.stdout:9/134: stat d0/f1d 0 2024-04-26T12:28:45.862 INFO:tasks.workunit.client.0.smithi046.stdout:9/135: creat d0/d19/f2f x:0 0 0 2024-04-26T12:28:45.863 INFO:tasks.workunit.client.0.smithi046.stdout:6/185: read d7/d2b/d31/f2e [949337,10475] 0 2024-04-26T12:28:45.863 INFO:tasks.workunit.client.0.smithi046.stdout:4/189: dread d0/d1/f15 [0,4194304] 0 2024-04-26T12:28:45.864 INFO:tasks.workunit.client.0.smithi046.stdout:4/190: fdatasync d0/d1/d29/f30 0 2024-04-26T12:28:45.864 INFO:tasks.workunit.client.0.smithi046.stdout:6/186: creat d7/d2b/f48 x:0 0 0 2024-04-26T12:28:45.865 INFO:tasks.workunit.client.0.smithi046.stdout:4/191: chown d0/d1/d5/f11 1 1 2024-04-26T12:28:45.865 INFO:tasks.workunit.client.0.smithi046.stdout:3/229: dwrite d2/d16/d11/d1b/d2d/f41 [0,4194304] 0 2024-04-26T12:28:45.866 INFO:tasks.workunit.client.0.smithi046.stdout:1/153: sync 2024-04-26T12:28:45.866 INFO:tasks.workunit.client.0.smithi046.stdout:5/186: dread d9/f41 [0,4194304] 0 2024-04-26T12:28:45.867 INFO:tasks.workunit.client.0.smithi046.stdout:4/192: dread - d0/d1/d9/d19/f3d zero size 2024-04-26T12:28:45.867 INFO:tasks.workunit.client.0.smithi046.stdout:9/136: dread d0/f15 [0,4194304] 0 2024-04-26T12:28:45.867 INFO:tasks.workunit.client.0.smithi046.stdout:8/158: truncate f4 1688129 0 2024-04-26T12:28:45.868 INFO:tasks.workunit.client.0.smithi046.stdout:3/230: creat d2/f53 x:0 0 0 2024-04-26T12:28:45.868 INFO:tasks.workunit.client.0.smithi046.stdout:4/193: unlink d0/d1/c1e 0 2024-04-26T12:28:45.868 INFO:tasks.workunit.client.0.smithi046.stdout:1/154: write d7/d14/d1c/f30 [134125,6588] 0 2024-04-26T12:28:45.870 INFO:tasks.workunit.client.0.smithi046.stdout:3/231: creat d2/d16/d2c/f54 x:0 0 0 2024-04-26T12:28:45.870 INFO:tasks.workunit.client.0.smithi046.stdout:5/187: read d9/da/d15/f1a [113706,127721] 0 2024-04-26T12:28:45.870 INFO:tasks.workunit.client.0.smithi046.stdout:9/137: creat d0/d19/d21/f30 x:0 0 0 2024-04-26T12:28:45.871 INFO:tasks.workunit.client.0.smithi046.stdout:3/232: readlink d2/db/l2e 0 2024-04-26T12:28:45.871 INFO:tasks.workunit.client.0.smithi046.stdout:9/138: symlink d0/d29/l31 0 2024-04-26T12:28:45.871 INFO:tasks.workunit.client.0.smithi046.stdout:6/187: dwrite d7/d2b/d31/f2f [0,4194304] 0 2024-04-26T12:28:45.872 INFO:tasks.workunit.client.0.smithi046.stdout:3/233: creat d2/db/f55 x:0 0 0 2024-04-26T12:28:45.873 INFO:tasks.workunit.client.0.smithi046.stdout:5/188: truncate d9/da/d18/f24 813263 0 2024-04-26T12:28:45.873 INFO:tasks.workunit.client.0.smithi046.stdout:5/189: stat c7 0 2024-04-26T12:28:45.874 INFO:tasks.workunit.client.0.smithi046.stdout:6/188: creat d7/d1b/d47/f49 x:0 0 0 2024-04-26T12:28:45.875 INFO:tasks.workunit.client.0.smithi046.stdout:5/190: truncate f2 4393575 0 2024-04-26T12:28:45.875 INFO:tasks.workunit.client.0.smithi046.stdout:3/234: creat d2/d16/d11/d1b/d2d/f56 x:0 0 0 2024-04-26T12:28:45.877 INFO:tasks.workunit.client.0.smithi046.stdout:1/155: dwrite d7/d14/d1c/f30 [0,4194304] 0 2024-04-26T12:28:45.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/191: unlink d9/da/dd/ff 0 2024-04-26T12:28:45.878 INFO:tasks.workunit.client.0.smithi046.stdout:3/235: symlink d2/d16/d2c/d50/l57 0 2024-04-26T12:28:45.879 INFO:tasks.workunit.client.0.smithi046.stdout:8/159: dwrite d7/da/f1a [0,4194304] 0 2024-04-26T12:28:45.880 INFO:tasks.workunit.client.0.smithi046.stdout:5/192: fsync d9/da/d18/f42 0 2024-04-26T12:28:45.882 INFO:tasks.workunit.client.0.smithi046.stdout:9/139: dwrite d0/d6/ff [0,4194304] 0 2024-04-26T12:28:45.884 INFO:tasks.workunit.client.0.smithi046.stdout:5/193: write d9/da/d18/f24 [1805124,69825] 0 2024-04-26T12:28:45.884 INFO:tasks.workunit.client.0.smithi046.stdout:4/194: truncate d0/d1/d5/f11 2172019 0 2024-04-26T12:28:45.884 INFO:tasks.workunit.client.0.smithi046.stdout:7/202: dread f4 [0,4194304] 0 2024-04-26T12:28:45.886 INFO:tasks.workunit.client.0.smithi046.stdout:5/194: mkdir d9/da/dd/d34/d44 0 2024-04-26T12:28:45.886 INFO:tasks.workunit.client.0.smithi046.stdout:6/189: dwrite d7/d16/f1c [0,4194304] 0 2024-04-26T12:28:45.886 INFO:tasks.workunit.client.0.smithi046.stdout:4/195: read d0/d1/d5/db/f2f [2846717,127659] 0 2024-04-26T12:28:45.888 INFO:tasks.workunit.client.0.smithi046.stdout:5/195: readlink d9/da/l2f 0 2024-04-26T12:28:45.888 INFO:tasks.workunit.client.0.smithi046.stdout:1/156: dwrite d7/db/ff [0,4194304] 0 2024-04-26T12:28:45.888 INFO:tasks.workunit.client.0.smithi046.stdout:3/236: read d2/db/fe [1697330,36874] 0 2024-04-26T12:28:45.889 INFO:tasks.workunit.client.0.smithi046.stdout:8/160: dread d7/da/f1a [4194304,4194304] 0 2024-04-26T12:28:45.889 INFO:tasks.workunit.client.0.smithi046.stdout:4/196: write d0/da/d17/d20/d25/f33 [1149521,105654] 0 2024-04-26T12:28:45.890 INFO:tasks.workunit.client.0.smithi046.stdout:1/157: mkdir d7/d9/d2b/d39 0 2024-04-26T12:28:45.891 INFO:tasks.workunit.client.0.smithi046.stdout:3/237: write d2/d16/f37 [384734,89449] 0 2024-04-26T12:28:45.891 INFO:tasks.workunit.client.0.smithi046.stdout:9/140: dwrite d0/f24 [0,4194304] 0 2024-04-26T12:28:45.892 INFO:tasks.workunit.client.0.smithi046.stdout:1/158: chown l6 68 1 2024-04-26T12:28:45.893 INFO:tasks.workunit.client.0.smithi046.stdout:7/203: dwrite d16/d1a/d3e/f44 [0,4194304] 0 2024-04-26T12:28:45.894 INFO:tasks.workunit.client.0.smithi046.stdout:4/197: chown d0/da/d17/d20/d25/c3e 1028840683 1 2024-04-26T12:28:45.895 INFO:tasks.workunit.client.0.smithi046.stdout:3/238: creat d2/d16/d11/f58 x:0 0 0 2024-04-26T12:28:45.896 INFO:tasks.workunit.client.0.smithi046.stdout:7/204: creat d16/d1c/d45/f48 x:0 0 0 2024-04-26T12:28:45.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/190: dread d7/f15 [0,4194304] 0 2024-04-26T12:28:45.896 INFO:tasks.workunit.client.0.smithi046.stdout:3/239: fdatasync d2/d16/f4f 0 2024-04-26T12:28:45.896 INFO:tasks.workunit.client.0.smithi046.stdout:8/161: dread d7/f8 [0,4194304] 0 2024-04-26T12:28:45.897 INFO:tasks.workunit.client.0.smithi046.stdout:3/240: write d2/d16/d11/f58 [556489,116224] 0 2024-04-26T12:28:45.898 INFO:tasks.workunit.client.0.smithi046.stdout:7/205: rmdir d16/d1a/d3e 39 2024-04-26T12:28:45.900 INFO:tasks.workunit.client.0.smithi046.stdout:4/198: creat d0/d1/f42 x:0 0 0 2024-04-26T12:28:45.900 INFO:tasks.workunit.client.0.smithi046.stdout:7/206: rmdir d16 39 2024-04-26T12:28:45.901 INFO:tasks.workunit.client.0.smithi046.stdout:3/241: rename d2/d16/d11/d23/c44 to d2/d16/d35/c59 0 2024-04-26T12:28:45.901 INFO:tasks.workunit.client.0.smithi046.stdout:1/159: dwrite d7/d12/f21 [0,4194304] 0 2024-04-26T12:28:45.902 INFO:tasks.workunit.client.0.smithi046.stdout:6/191: dwrite d7/d1b/d37/f3b [0,4194304] 0 2024-04-26T12:28:45.902 INFO:tasks.workunit.client.0.smithi046.stdout:7/207: creat d16/d1a/d31/f49 x:0 0 0 2024-04-26T12:28:45.902 INFO:tasks.workunit.client.0.smithi046.stdout:4/199: write d0/d1/d5/db/f2f [5015620,106324] 0 2024-04-26T12:28:45.903 INFO:tasks.workunit.client.0.smithi046.stdout:3/242: write d2/d16/d35/f4e [523568,20088] 0 2024-04-26T12:28:45.903 INFO:tasks.workunit.client.0.smithi046.stdout:4/200: chown d0/da/d17/d20/d25 63273399 1 2024-04-26T12:28:45.905 INFO:tasks.workunit.client.0.smithi046.stdout:6/192: creat d7/d16/f4a x:0 0 0 2024-04-26T12:28:45.905 INFO:tasks.workunit.client.0.smithi046.stdout:3/243: creat d2/db/d4a/f5a x:0 0 0 2024-04-26T12:28:45.905 INFO:tasks.workunit.client.0.smithi046.stdout:6/193: write d7/fa [980359,9899] 0 2024-04-26T12:28:45.905 INFO:tasks.workunit.client.0.smithi046.stdout:3/244: fsync d2/d16/d2c/f36 0 2024-04-26T12:28:45.905 INFO:tasks.workunit.client.0.smithi046.stdout:6/194: fdatasync d7/f8 0 2024-04-26T12:28:45.907 INFO:tasks.workunit.client.0.smithi046.stdout:6/195: truncate d7/d16/f4a 100562 0 2024-04-26T12:28:45.907 INFO:tasks.workunit.client.0.smithi046.stdout:3/245: creat d2/d16/d11/d1b/d2d/f5b x:0 0 0 2024-04-26T12:28:45.907 INFO:tasks.workunit.client.0.smithi046.stdout:6/196: chown d7/d2b/l32 288280 1 2024-04-26T12:28:45.907 INFO:tasks.workunit.client.0.smithi046.stdout:3/246: rmdir d2/d16/d2c 39 2024-04-26T12:28:45.907 INFO:tasks.workunit.client.0.smithi046.stdout:6/197: creat d7/d1b/f4b x:0 0 0 2024-04-26T12:28:45.908 INFO:tasks.workunit.client.0.smithi046.stdout:3/247: chown d2/d16/d11/d1b/c29 1921893 1 2024-04-26T12:28:45.908 INFO:tasks.workunit.client.0.smithi046.stdout:6/198: write d7/d2b/d31/f39 [3379103,40093] 0 2024-04-26T12:28:45.908 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:45.905+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:45.909 INFO:tasks.workunit.client.0.smithi046.stdout:6/199: write d7/d1b/f24 [42769,21145] 0 2024-04-26T12:28:45.909 INFO:tasks.workunit.client.0.smithi046.stdout:3/248: truncate d2/d16/d11/d1f/f42 953314 0 2024-04-26T12:28:45.909 INFO:tasks.workunit.client.0.smithi046.stdout:3/249: readlink d2/l5 0 2024-04-26T12:28:45.909 INFO:tasks.workunit.client.0.smithi046.stdout:6/200: dread - d7/f1e zero size 2024-04-26T12:28:45.910 INFO:tasks.workunit.client.0.smithi046.stdout:6/201: write d7/d1b/f23 [574003,108995] 0 2024-04-26T12:28:45.910 INFO:tasks.workunit.client.0.smithi046.stdout:3/250: truncate d2/d16/d11/f3a 394759 0 2024-04-26T12:28:45.910 INFO:tasks.workunit.client.0.smithi046.stdout:9/141: truncate d0/f24 3797480 0 2024-04-26T12:28:45.910 INFO:tasks.workunit.client.0.smithi046.stdout:8/162: write d7/dc/f13 [609949,46877] 0 2024-04-26T12:28:45.911 INFO:tasks.workunit.client.0.smithi046.stdout:9/142: mknod d0/d6/c32 0 2024-04-26T12:28:45.912 INFO:tasks.workunit.client.0.smithi046.stdout:6/202: write d7/d2b/f48 [453662,19003] 0 2024-04-26T12:28:45.912 INFO:tasks.workunit.client.0.smithi046.stdout:8/163: rename d7/dc/f22 to d7/da/df/f2e 0 2024-04-26T12:28:45.912 INFO:tasks.workunit.client.0.smithi046.stdout:9/143: write d0/f10 [1043620,111306] 0 2024-04-26T12:28:45.913 INFO:tasks.workunit.client.0.smithi046.stdout:6/203: mknod d7/d2b/c4c 0 2024-04-26T12:28:45.913 INFO:tasks.workunit.client.0.smithi046.stdout:8/164: truncate d7/d24/d28/f2c 433367 0 2024-04-26T12:28:45.914 INFO:tasks.workunit.client.0.smithi046.stdout:6/204: fdatasync d7/f15 0 2024-04-26T12:28:45.914 INFO:tasks.workunit.client.0.smithi046.stdout:8/165: read d7/f8 [2252012,7629] 0 2024-04-26T12:28:45.915 INFO:tasks.workunit.client.0.smithi046.stdout:6/205: mkdir d7/d2b/d31/d4d 0 2024-04-26T12:28:45.915 INFO:tasks.workunit.client.0.smithi046.stdout:8/166: creat d7/d24/f2f x:0 0 0 2024-04-26T12:28:45.915 INFO:tasks.workunit.client.0.smithi046.stdout:6/206: fdatasync d7/f13 0 2024-04-26T12:28:45.916 INFO:tasks.workunit.client.0.smithi046.stdout:8/167: write d7/da/f1a [774817,54088] 0 2024-04-26T12:28:45.916 INFO:tasks.workunit.client.0.smithi046.stdout:6/207: dread - d7/d2b/d31/f43 zero size 2024-04-26T12:28:45.917 INFO:tasks.workunit.client.0.smithi046.stdout:8/168: creat d7/d24/f30 x:0 0 0 2024-04-26T12:28:45.917 INFO:tasks.workunit.client.0.smithi046.stdout:9/144: dwrite d0/d29/f2a [0,4194304] 0 2024-04-26T12:28:45.918 INFO:tasks.workunit.client.0.smithi046.stdout:6/208: write d7/fe [2874593,34486] 0 2024-04-26T12:28:45.918 INFO:tasks.workunit.client.0.smithi046.stdout:9/145: mkdir d0/d33 0 2024-04-26T12:28:45.919 INFO:tasks.workunit.client.0.smithi046.stdout:6/209: creat d7/d1b/d47/f4e x:0 0 0 2024-04-26T12:28:45.919 INFO:tasks.workunit.client.0.smithi046.stdout:9/146: fsync d0/d6/f13 0 2024-04-26T12:28:45.920 INFO:tasks.workunit.client.0.smithi046.stdout:9/147: chown d0/d6/f2d 126992 1 2024-04-26T12:28:45.920 INFO:tasks.workunit.client.0.smithi046.stdout:3/251: truncate d2/d16/d11/d1b/d2d/f41 1121699 0 2024-04-26T12:28:45.920 INFO:tasks.workunit.client.0.smithi046.stdout:9/148: mknod d0/d2c/c34 0 2024-04-26T12:28:45.921 INFO:tasks.workunit.client.0.smithi046.stdout:3/252: creat d2/d16/d11/d1b/f5c x:0 0 0 2024-04-26T12:28:45.921 INFO:tasks.workunit.client.0.smithi046.stdout:9/149: rmdir d0/d19/d21 39 2024-04-26T12:28:45.922 INFO:tasks.workunit.client.0.smithi046.stdout:3/253: symlink d2/d16/l5d 0 2024-04-26T12:28:45.923 INFO:tasks.workunit.client.0.smithi046.stdout:7/208: dread d16/f20 [0,4194304] 0 2024-04-26T12:28:45.923 INFO:tasks.workunit.client.0.smithi046.stdout:7/209: fdatasync d16/f2d 0 2024-04-26T12:28:45.924 INFO:tasks.workunit.client.0.smithi046.stdout:7/210: chown l13 104593 1 2024-04-26T12:28:45.925 INFO:tasks.workunit.client.0.smithi046.stdout:0/220: sync 2024-04-26T12:28:45.925 INFO:tasks.workunit.client.0.smithi046.stdout:2/197: sync 2024-04-26T12:28:45.925 INFO:tasks.workunit.client.0.smithi046.stdout:4/201: dread d0/d1/d29/f30 [0,4194304] 0 2024-04-26T12:28:45.926 INFO:tasks.workunit.client.0.smithi046.stdout:0/221: write d9/dc/f26 [1672171,85628] 0 2024-04-26T12:28:45.926 INFO:tasks.workunit.client.0.smithi046.stdout:4/202: creat d0/da/d17/d20/d25/f43 x:0 0 0 2024-04-26T12:28:45.926 INFO:tasks.workunit.client.0.smithi046.stdout:0/222: truncate d9/f29 234599 0 2024-04-26T12:28:45.927 INFO:tasks.workunit.client.0.smithi046.stdout:4/203: write d0/d1/d9/d19/f3d [875945,64659] 0 2024-04-26T12:28:45.927 INFO:tasks.workunit.client.0.smithi046.stdout:0/223: creat d9/dc/dd/f48 x:0 0 0 2024-04-26T12:28:45.928 INFO:tasks.workunit.client.0.smithi046.stdout:6/210: truncate d7/d1b/f23 707283 0 2024-04-26T12:28:45.928 INFO:tasks.workunit.client.0.smithi046.stdout:4/204: mknod d0/da/d17/d20/d25/c44 0 2024-04-26T12:28:45.929 INFO:tasks.workunit.client.0.smithi046.stdout:0/224: creat d9/dc/dd/d45/f49 x:0 0 0 2024-04-26T12:28:45.929 INFO:tasks.workunit.client.0.smithi046.stdout:6/211: write d7/d1b/d37/f42 [349722,4992] 0 2024-04-26T12:28:45.929 INFO:tasks.workunit.client.0.smithi046.stdout:0/225: stat d9/f17 0 2024-04-26T12:28:45.930 INFO:tasks.workunit.client.0.smithi046.stdout:4/205: creat d0/da/d17/d20/d25/f45 x:0 0 0 2024-04-26T12:28:45.930 INFO:tasks.workunit.client.0.smithi046.stdout:6/212: write d7/fe [493716,46010] 0 2024-04-26T12:28:45.930 INFO:tasks.workunit.client.0.smithi046.stdout:0/226: write d9/dc/dd/f48 [353278,80220] 0 2024-04-26T12:28:45.930 INFO:tasks.workunit.client.0.smithi046.stdout:4/206: readlink d0/d1/d12/l27 0 2024-04-26T12:28:45.930 INFO:tasks.workunit.client.0.smithi046.stdout:6/213: symlink d7/d2b/l4f 0 2024-04-26T12:28:45.931 INFO:tasks.workunit.client.0.smithi046.stdout:6/214: chown d7/d1b/f24 5029867 1 2024-04-26T12:28:45.932 INFO:tasks.workunit.client.0.smithi046.stdout:6/215: write d7/d1b/d37/f3b [2758759,18780] 0 2024-04-26T12:28:45.932 INFO:tasks.workunit.client.0.smithi046.stdout:8/169: dread f4 [0,4194304] 0 2024-04-26T12:28:45.932 INFO:tasks.workunit.client.0.smithi046.stdout:6/216: symlink d7/d16/l50 0 2024-04-26T12:28:45.933 INFO:tasks.workunit.client.0.smithi046.stdout:6/217: read d7/d2b/d31/f34 [1283726,126253] 0 2024-04-26T12:28:45.933 INFO:tasks.workunit.client.0.smithi046.stdout:8/170: write d7/dc/f18 [3270838,42302] 0 2024-04-26T12:28:45.933 INFO:tasks.workunit.client.0.smithi046.stdout:9/150: truncate d0/d6/f23 3552082 0 2024-04-26T12:28:45.933 INFO:tasks.workunit.client.0.smithi046.stdout:3/254: truncate d2/db/f2b 4086555 0 2024-04-26T12:28:45.934 INFO:tasks.workunit.client.0.smithi046.stdout:6/218: unlink d7/f1e 0 2024-04-26T12:28:45.934 INFO:tasks.workunit.client.0.smithi046.stdout:9/151: mknod d0/d16/c35 0 2024-04-26T12:28:45.934 INFO:tasks.workunit.client.0.smithi046.stdout:8/171: chown d7/c25 3239096 1 2024-04-26T12:28:45.935 INFO:tasks.workunit.client.0.smithi046.stdout:8/172: chown l3 105615 1 2024-04-26T12:28:45.935 INFO:tasks.workunit.client.0.smithi046.stdout:3/255: getdents d2/d16/d2c 0 2024-04-26T12:28:45.935 INFO:tasks.workunit.client.0.smithi046.stdout:9/152: symlink d0/d19/l36 0 2024-04-26T12:28:45.936 INFO:tasks.workunit.client.0.smithi046.stdout:9/153: stat d0/d33 0 2024-04-26T12:28:45.936 INFO:tasks.workunit.client.0.smithi046.stdout:8/173: mknod d7/d24/d28/c31 0 2024-04-26T12:28:45.937 INFO:tasks.workunit.client.0.smithi046.stdout:3/256: write d2/d16/d2c/f54 [815403,18651] 0 2024-04-26T12:28:45.937 INFO:tasks.workunit.client.0.smithi046.stdout:8/174: mknod d7/dc/d27/c32 0 2024-04-26T12:28:45.938 INFO:tasks.workunit.client.0.smithi046.stdout:3/257: stat d2/c19 0 2024-04-26T12:28:45.938 INFO:tasks.workunit.client.0.smithi046.stdout:3/258: stat d2/d16/d11/d1b/c46 0 2024-04-26T12:28:45.939 INFO:tasks.workunit.client.0.smithi046.stdout:6/219: dwrite d7/d1b/d37/f38 [0,4194304] 0 2024-04-26T12:28:45.939 INFO:tasks.workunit.client.0.smithi046.stdout:3/259: symlink d2/d16/d11/l5e 0 2024-04-26T12:28:45.939 INFO:tasks.workunit.client.0.smithi046.stdout:6/220: readlink d7/d1b/l28 0 2024-04-26T12:28:45.940 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:45.940 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:45.940 INFO:tasks.workunit.client.0.smithi046.stdout:3/260: mknod d2/d16/d11/d23/c5f 0 2024-04-26T12:28:45.941 INFO:tasks.workunit.client.0.smithi046.stdout:6/221: mkdir d7/d51 0 2024-04-26T12:28:45.941 INFO:tasks.workunit.client.0.smithi046.stdout:6/222: mkdir d7/d1b/d47/d52 0 2024-04-26T12:28:45.942 INFO:tasks.workunit.client.0.smithi046.stdout:3/261: symlink d2/d16/l60 0 2024-04-26T12:28:45.942 INFO:tasks.workunit.client.0.smithi046.stdout:8/175: dwrite d7/d24/f2f [0,4194304] 0 2024-04-26T12:28:45.943 INFO:tasks.workunit.client.0.smithi046.stdout:2/198: dread d1/de/d15/d18/f2a [0,4194304] 0 2024-04-26T12:28:45.943 INFO:tasks.workunit.client.0.smithi046.stdout:6/223: creat d7/d2b/f53 x:0 0 0 2024-04-26T12:28:45.943 INFO:tasks.workunit.client.0.smithi046.stdout:8/176: read d7/da/df/f2e [185654,91684] 0 2024-04-26T12:28:45.944 INFO:tasks.workunit.client.0.smithi046.stdout:3/262: unlink d2/d16/d2c/d50/l57 0 2024-04-26T12:28:45.944 INFO:tasks.workunit.client.0.smithi046.stdout:2/199: creat d1/f3e x:0 0 0 2024-04-26T12:28:45.945 INFO:tasks.workunit.client.0.smithi046.stdout:2/200: getdents d1/d13 0 2024-04-26T12:28:45.946 INFO:tasks.workunit.client.0.smithi046.stdout:2/201: mknod d1/d13/c3f 0 2024-04-26T12:28:45.947 INFO:tasks.workunit.client.0.smithi046.stdout:2/202: rename d1/d13/d1b/f30 to d1/de/f40 0 2024-04-26T12:28:45.947 INFO:tasks.workunit.client.0.smithi046.stdout:8/177: getdents d7/dc/d27 0 2024-04-26T12:28:45.949 INFO:tasks.workunit.client.0.smithi046.stdout:2/203: creat d1/de/d2b/f41 x:0 0 0 2024-04-26T12:28:45.949 INFO:tasks.workunit.client.0.smithi046.stdout:6/224: dread d7/f20 [0,4194304] 0 2024-04-26T12:28:45.949 INFO:tasks.workunit.client.0.smithi046.stdout:8/178: symlink d7/d1c/l33 0 2024-04-26T12:28:45.949 INFO:tasks.workunit.client.0.smithi046.stdout:6/225: readlink d7/d1b/l41 0 2024-04-26T12:28:45.949 INFO:tasks.workunit.client.0.smithi046.stdout:2/204: mkdir d1/d42 0 2024-04-26T12:28:45.949 INFO:tasks.workunit.client.0.smithi046.stdout:8/179: dread - d7/d1c/f2d zero size 2024-04-26T12:28:45.949 INFO:tasks.workunit.client.0.smithi046.stdout:6/226: dread - d7/d2b/d31/f43 zero size 2024-04-26T12:28:45.950 INFO:tasks.workunit.client.0.smithi046.stdout:6/227: readlink d7/lf 0 2024-04-26T12:28:45.950 INFO:tasks.workunit.client.0.smithi046.stdout:6/228: stat d7/d2b/f48 0 2024-04-26T12:28:45.950 INFO:tasks.workunit.client.0.smithi046.stdout:6/229: stat d7/c11 0 2024-04-26T12:28:45.951 INFO:tasks.workunit.client.0.smithi046.stdout:8/180: dread d7/da/f23 [0,4194304] 0 2024-04-26T12:28:45.951 INFO:tasks.workunit.client.0.smithi046.stdout:6/230: rmdir d7/d1b/d47/d52 0 2024-04-26T12:28:45.951 INFO:tasks.workunit.client.0.smithi046.stdout:8/181: fdatasync f4 0 2024-04-26T12:28:45.952 INFO:tasks.workunit.client.0.smithi046.stdout:6/231: creat d7/f54 x:0 0 0 2024-04-26T12:28:45.954 INFO:tasks.workunit.client.0.smithi046.stdout:2/205: dwrite d1/de/d2b/f41 [0,4194304] 0 2024-04-26T12:28:45.954 INFO:tasks.workunit.client.0.smithi046.stdout:6/232: link d7/d16/l21 d7/d51/l55 0 2024-04-26T12:28:45.955 INFO:tasks.workunit.client.0.smithi046.stdout:2/206: mknod d1/c43 0 2024-04-26T12:28:45.957 INFO:tasks.workunit.client.0.smithi046.stdout:2/207: write d1/f35 [946574,79864] 0 2024-04-26T12:28:45.958 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:45.959 INFO:tasks.workunit.client.0.smithi046.stdout:0/227: dread f7 [0,4194304] 0 2024-04-26T12:28:45.959 INFO:tasks.workunit.client.0.smithi046.stdout:2/208: fdatasync d1/de/d2b/f3a 0 2024-04-26T12:28:45.959 INFO:tasks.workunit.client.0.smithi046.stdout:0/228: write f3 [1484822,18813] 0 2024-04-26T12:28:45.959 INFO:tasks.workunit.client.0.smithi046.stdout:3/263: dwrite d2/d16/d11/d1b/d2d/f41 [0,4194304] 0 2024-04-26T12:28:45.959 INFO:tasks.workunit.client.0.smithi046.stdout:6/233: dread d7/d1b/f24 [0,4194304] 0 2024-04-26T12:28:45.959 INFO:tasks.workunit.client.0.smithi046.stdout:2/209: creat d1/d42/f44 x:0 0 0 2024-04-26T12:28:45.960 INFO:tasks.workunit.client.0.smithi046.stdout:6/234: chown d7/d2b/l32 404 1 2024-04-26T12:28:45.960 INFO:tasks.workunit.client.0.smithi046.stdout:0/229: creat d9/dc/d2a/f4a x:0 0 0 2024-04-26T12:28:45.960 INFO:tasks.workunit.client.0.smithi046.stdout:3/264: mknod d2/d16/d11/d1b/c61 0 2024-04-26T12:28:45.960 INFO:tasks.workunit.client.0.smithi046.stdout:2/210: mknod d1/d13/d1b/d38/c45 0 2024-04-26T12:28:45.961 INFO:tasks.workunit.client.0.smithi046.stdout:6/235: readlink d7/d16/l21 0 2024-04-26T12:28:45.961 INFO:tasks.workunit.client.0.smithi046.stdout:6/236: stat d7/d1b/f4b 0 2024-04-26T12:28:45.961 INFO:tasks.workunit.client.0.smithi046.stdout:3/265: write d2/d16/d11/d23/f49 [654672,101714] 0 2024-04-26T12:28:45.962 INFO:tasks.workunit.client.0.smithi046.stdout:2/211: creat d1/de/d15/f46 x:0 0 0 2024-04-26T12:28:45.962 INFO:tasks.workunit.client.0.smithi046.stdout:0/230: rmdir d9/d1d/d40/d41/d47 0 2024-04-26T12:28:45.962 INFO:tasks.workunit.client.0.smithi046.stdout:3/266: readlink d2/d16/d11/l33 0 2024-04-26T12:28:45.962 INFO:tasks.workunit.client.0.smithi046.stdout:6/237: write d7/d2b/f53 [528420,6152] 0 2024-04-26T12:28:45.963 INFO:tasks.workunit.client.0.smithi046.stdout:0/231: creat d9/dc/dd/d45/f4b x:0 0 0 2024-04-26T12:28:45.963 INFO:tasks.workunit.client.0.smithi046.stdout:6/238: unlink d7/d2b/f48 0 2024-04-26T12:28:45.963 INFO:tasks.workunit.client.0.smithi046.stdout:2/212: rename d1/de/d15/d18/f2a to d1/de/d15/d18/f47 0 2024-04-26T12:28:45.964 INFO:tasks.workunit.client.0.smithi046.stdout:0/232: write d9/dc/dd/f25 [578136,95141] 0 2024-04-26T12:28:45.964 INFO:tasks.workunit.client.0.smithi046.stdout:3/267: getdents d2/d16/d2c/d50 0 2024-04-26T12:28:45.964 INFO:tasks.workunit.client.0.smithi046.stdout:6/239: unlink d7/d16/l21 0 2024-04-26T12:28:45.964 INFO:tasks.workunit.client.0.smithi046.stdout:3/268: chown d2/d16/d11/d1b 130 1 2024-04-26T12:28:45.964 INFO:tasks.workunit.client.0.smithi046.stdout:0/233: chown d9/d1d/f3c 13100 1 2024-04-26T12:28:45.965 INFO:tasks.workunit.client.0.smithi046.stdout:6/240: creat d7/d16/f56 x:0 0 0 2024-04-26T12:28:45.965 INFO:tasks.workunit.client.0.smithi046.stdout:0/234: mkdir d9/dc/d4c 0 2024-04-26T12:28:45.965 INFO:tasks.workunit.client.0.smithi046.stdout:3/269: dread - d2/d16/d11/d1b/d2d/f56 zero size 2024-04-26T12:28:45.966 INFO:tasks.workunit.client.0.smithi046.stdout:1/160: sync 2024-04-26T12:28:45.966 INFO:tasks.workunit.client.0.smithi046.stdout:5/196: sync 2024-04-26T12:28:45.966 INFO:tasks.workunit.client.0.smithi046.stdout:4/207: sync 2024-04-26T12:28:45.966 INFO:tasks.workunit.client.0.smithi046.stdout:7/211: sync 2024-04-26T12:28:45.966 INFO:tasks.workunit.client.0.smithi046.stdout:9/154: dread d0/f5 [0,4194304] 0 2024-04-26T12:28:45.966 INFO:tasks.workunit.client.0.smithi046.stdout:5/197: chown d9/da/f3c 1827 1 2024-04-26T12:28:45.967 INFO:tasks.workunit.client.0.smithi046.stdout:1/161: mkdir d7/d12/d3a 0 2024-04-26T12:28:45.967 INFO:tasks.workunit.client.0.smithi046.stdout:0/235: link d9/f10 d9/d1d/f4d 0 2024-04-26T12:28:45.968 INFO:tasks.workunit.client.0.smithi046.stdout:9/155: creat d0/d29/f37 x:0 0 0 2024-04-26T12:28:45.968 INFO:tasks.workunit.client.0.smithi046.stdout:4/208: getdents d0/d41/d3f 0 2024-04-26T12:28:45.968 INFO:tasks.workunit.client.0.smithi046.stdout:8/182: dread d7/dc/f13 [0,4194304] 0 2024-04-26T12:28:45.968 INFO:tasks.workunit.client.0.smithi046.stdout:1/162: chown d7/d9/d2b/d31/l34 1184972592 1 2024-04-26T12:28:45.969 INFO:tasks.workunit.client.0.smithi046.stdout:3/270: dread d2/d16/f37 [0,4194304] 0 2024-04-26T12:28:45.969 INFO:tasks.workunit.client.0.smithi046.stdout:9/156: mkdir d0/d19/d38 0 2024-04-26T12:28:45.970 INFO:tasks.workunit.client.0.smithi046.stdout:2/213: rmdir d1/de/d15 39 2024-04-26T12:28:45.970 INFO:tasks.workunit.client.0.smithi046.stdout:1/163: dread - d7/d14/f23 zero size 2024-04-26T12:28:45.971 INFO:tasks.workunit.client.0.smithi046.stdout:5/198: read d9/da/d18/f24 [1065998,59068] 0 2024-04-26T12:28:45.971 INFO:tasks.workunit.client.0.smithi046.stdout:8/183: creat d7/d24/d28/f34 x:0 0 0 2024-04-26T12:28:45.972 INFO:tasks.workunit.client.0.smithi046.stdout:1/164: chown d7/d12/f36 12 1 2024-04-26T12:28:45.972 INFO:tasks.workunit.client.0.smithi046.stdout:2/214: readlink d1/de/d15/d18/l33 0 2024-04-26T12:28:45.973 INFO:tasks.workunit.client.0.smithi046.stdout:8/184: creat d7/da/df/f35 x:0 0 0 2024-04-26T12:28:45.973 INFO:tasks.workunit.client.0.smithi046.stdout:6/241: dwrite d7/d1b/d47/f4e [0,4194304] 0 2024-04-26T12:28:45.974 INFO:tasks.workunit.client.0.smithi046.stdout:2/215: write d1/d42/f44 [154227,19560] 0 2024-04-26T12:28:45.974 INFO:tasks.workunit.client.0.smithi046.stdout:7/212: dwrite d16/d1c/d45/f48 [0,4194304] 0 2024-04-26T12:28:45.975 INFO:tasks.workunit.client.0.smithi046.stdout:8/185: mknod d7/da/c36 0 2024-04-26T12:28:45.975 INFO:tasks.workunit.client.0.smithi046.stdout:6/242: write d7/d1b/d47/f4e [2029295,60876] 0 2024-04-26T12:28:45.975 INFO:tasks.workunit.client.0.smithi046.stdout:1/165: link d7/db/l25 d7/d38/l3b 0 2024-04-26T12:28:45.975 INFO:tasks.workunit.client.0.smithi046.stdout:5/199: truncate d9/da/d18/f25 1352287 0 2024-04-26T12:28:45.975 INFO:tasks.workunit.client.0.smithi046.stdout:7/213: creat d16/d1c/f4a x:0 0 0 2024-04-26T12:28:45.976 INFO:tasks.workunit.client.0.smithi046.stdout:2/216: rmdir d1/d13/d1b 39 2024-04-26T12:28:45.976 INFO:tasks.workunit.client.0.smithi046.stdout:8/186: readlink d7/d24/l26 0 2024-04-26T12:28:45.977 INFO:tasks.workunit.client.0.smithi046.stdout:5/200: mkdir d9/da/dd/d34/d45 0 2024-04-26T12:28:45.977 INFO:tasks.workunit.client.0.smithi046.stdout:7/214: write f4 [256903,18523] 0 2024-04-26T12:28:45.977 INFO:tasks.workunit.client.0.smithi046.stdout:1/166: truncate d7/d14/f2f 458559 0 2024-04-26T12:28:45.978 INFO:tasks.workunit.client.0.smithi046.stdout:7/215: write f5 [3743290,63149] 0 2024-04-26T12:28:45.978 INFO:tasks.workunit.client.0.smithi046.stdout:8/187: rename d7/l11 to d7/dc/d27/l37 0 2024-04-26T12:28:45.978 INFO:tasks.workunit.client.0.smithi046.stdout:2/217: getdents d1/de/d15 0 2024-04-26T12:28:45.979 INFO:tasks.workunit.client.0.smithi046.stdout:1/167: write d7/d14/f23 [868461,127763] 0 2024-04-26T12:28:45.979 INFO:tasks.workunit.client.0.smithi046.stdout:7/216: dread - d16/d35/f3a zero size 2024-04-26T12:28:45.979 INFO:tasks.workunit.client.0.smithi046.stdout:8/188: mknod d7/d24/c38 0 2024-04-26T12:28:45.980 INFO:tasks.workunit.client.0.smithi046.stdout:5/201: rename d9/da/d15/l22 to d9/l46 0 2024-04-26T12:28:45.980 INFO:tasks.workunit.client.0.smithi046.stdout:1/168: mkdir d7/d9/d2b/d39/d3c 0 2024-04-26T12:28:45.980 INFO:tasks.workunit.client.0.smithi046.stdout:8/189: read f4 [1171204,101564] 0 2024-04-26T12:28:45.980 INFO:tasks.workunit.client.0.smithi046.stdout:5/202: chown d9/da/d3b/d35 1 1 2024-04-26T12:28:45.980 INFO:tasks.workunit.client.0.smithi046.stdout:1/169: chown d7 849 1 2024-04-26T12:28:45.981 INFO:tasks.workunit.client.0.smithi046.stdout:1/170: readlink l6 0 2024-04-26T12:28:45.981 INFO:tasks.workunit.client.0.smithi046.stdout:1/171: unlink l6 0 2024-04-26T12:28:45.982 INFO:tasks.workunit.client.0.smithi046.stdout:8/190: write d7/d1c/f2d [957830,30444] 0 2024-04-26T12:28:45.982 INFO:tasks.workunit.client.0.smithi046.stdout:1/172: rmdir d7/db 39 2024-04-26T12:28:45.983 INFO:tasks.workunit.client.0.smithi046.stdout:7/217: read d16/d1c/f3d [257579,6561] 0 2024-04-26T12:28:45.983 INFO:tasks.workunit.client.0.smithi046.stdout:6/243: dwrite d7/d1b/d37/f38 [4194304,4194304] 0 2024-04-26T12:28:45.985 INFO:tasks.workunit.client.0.smithi046.stdout:6/244: mkdir d7/d51/d57 0 2024-04-26T12:28:45.987 INFO:tasks.workunit.client.0.smithi046.stdout:2/218: dread d1/f4 [4194304,4194304] 0 2024-04-26T12:28:45.987 INFO:tasks.workunit.client.0.smithi046.stdout:8/191: dread d7/d24/d28/f2c [0,4194304] 0 2024-04-26T12:28:45.987 INFO:tasks.workunit.client.0.smithi046.stdout:6/245: truncate d7/fa 1727123 0 2024-04-26T12:28:45.987 INFO:tasks.workunit.client.0.smithi046.stdout:5/203: dwrite f2 [0,4194304] 0 2024-04-26T12:28:45.988 INFO:tasks.workunit.client.0.smithi046.stdout:8/192: chown d7/da/c21 2759 1 2024-04-26T12:28:45.988 INFO:tasks.workunit.client.0.smithi046.stdout:5/204: rmdir d9/da 39 2024-04-26T12:28:45.988 INFO:tasks.workunit.client.0.smithi046.stdout:6/246: write d7/d2b/d31/f2e [64471,113682] 0 2024-04-26T12:28:45.989 INFO:tasks.workunit.client.0.smithi046.stdout:8/193: chown l3 8473465 1 2024-04-26T12:28:45.989 INFO:tasks.workunit.client.0.smithi046.stdout:8/194: fsync d7/da/f23 0 2024-04-26T12:28:45.992 INFO:tasks.workunit.client.0.smithi046.stdout:8/195: getdents d7/dc/d27 0 2024-04-26T12:28:45.992 INFO:tasks.workunit.client.0.smithi046.stdout:5/205: dwrite d9/da/d18/f42 [0,4194304] 0 2024-04-26T12:28:45.993 INFO:tasks.workunit.client.0.smithi046.stdout:5/206: fdatasync d9/da/dd/f13 0 2024-04-26T12:28:45.993 INFO:tasks.workunit.client.0.smithi046.stdout:8/196: mkdir d7/d24/d28/d2a/d39 0 2024-04-26T12:28:45.994 INFO:tasks.workunit.client.0.smithi046.stdout:5/207: fsync d9/da/d18/f2d 0 2024-04-26T12:28:45.995 INFO:tasks.workunit.client.0.smithi046.stdout:5/208: rmdir d9/da/d3b 39 2024-04-26T12:28:45.995 INFO:tasks.workunit.client.0.smithi046.stdout:6/247: chown d7/d51 307 1 2024-04-26T12:28:45.996 INFO:tasks.workunit.client.0.smithi046.stdout:7/218: dwrite d16/d27/f34 [0,4194304] 0 2024-04-26T12:28:45.997 INFO:tasks.workunit.client.0.smithi046.stdout:6/248: write d7/f13 [1205455,129241] 0 2024-04-26T12:28:45.999 INFO:tasks.workunit.client.0.smithi046.stdout:5/209: creat d9/da/dd/d34/d3e/f47 x:0 0 0 2024-04-26T12:28:45.999 INFO:tasks.workunit.client.0.smithi046.stdout:5/210: chown d9/f41 0 1 2024-04-26T12:28:45.999 INFO:tasks.workunit.client.0.smithi046.stdout:6/249: mkdir d7/d2b/d31/d4d/d58 0 2024-04-26T12:28:45.999 INFO:tasks.workunit.client.0.smithi046.stdout:2/219: dwrite d1/de/f40 [0,4194304] 0 2024-04-26T12:28:46.000 INFO:tasks.workunit.client.0.smithi046.stdout:6/250: write d7/fe [1260150,93629] 0 2024-04-26T12:28:46.000 INFO:tasks.workunit.client.0.smithi046.stdout:7/219: getdents d16/d1a/d3e 0 2024-04-26T12:28:46.000 INFO:tasks.workunit.client.0.smithi046.stdout:8/197: dwrite d7/da/df/f10 [0,4194304] 0 2024-04-26T12:28:46.001 INFO:tasks.workunit.client.0.smithi046.stdout:5/211: creat d9/da/d15/f48 x:0 0 0 2024-04-26T12:28:46.001 INFO:tasks.workunit.client.0.smithi046.stdout:2/220: unlink d1/d13/c25 0 2024-04-26T12:28:46.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/251: write d7/d1b/d37/f38 [1072366,7946] 0 2024-04-26T12:28:46.002 INFO:tasks.workunit.client.0.smithi046.stdout:7/220: chown d16/d1a/d31/f3c 681 1 2024-04-26T12:28:46.002 INFO:tasks.workunit.client.0.smithi046.stdout:8/198: readlink d7/d24/l26 0 2024-04-26T12:28:46.005 INFO:tasks.workunit.client.0.smithi046.stdout:8/199: creat d7/dc/d27/f3a x:0 0 0 2024-04-26T12:28:46.006 INFO:tasks.workunit.client.0.smithi046.stdout:8/200: unlink d7/da/df/c14 0 2024-04-26T12:28:46.006 INFO:tasks.workunit.client.0.smithi046.stdout:6/252: dread d7/d2b/d31/f2f [0,4194304] 0 2024-04-26T12:28:46.007 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:46.005+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:46.012 INFO:tasks.workunit.client.0.smithi046.stdout:6/253: creat d7/f59 x:0 0 0 2024-04-26T12:28:46.012 INFO:tasks.workunit.client.0.smithi046.stdout:0/236: sync 2024-04-26T12:28:46.012 INFO:tasks.workunit.client.0.smithi046.stdout:7/221: dwrite d16/d1c/f4a [0,4194304] 0 2024-04-26T12:28:46.012 INFO:tasks.workunit.client.0.smithi046.stdout:8/201: rename d7/d24/c38 to d7/dc/c3b 0 2024-04-26T12:28:46.012 INFO:tasks.workunit.client.0.smithi046.stdout:6/254: dread - d7/d16/f56 zero size 2024-04-26T12:28:46.012 INFO:tasks.workunit.client.0.smithi046.stdout:9/157: sync 2024-04-26T12:28:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:0/237: creat d9/dc/dd/d45/f4e x:0 0 0 2024-04-26T12:28:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:8/202: creat d7/dc/d1b/f3c x:0 0 0 2024-04-26T12:28:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:9/158: write d0/f24 [4768901,15819] 0 2024-04-26T12:28:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:6/255: creat d7/d51/f5a x:0 0 0 2024-04-26T12:28:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:8/203: stat d7/dc/f13 0 2024-04-26T12:28:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:9/159: fdatasync d0/d6/ff 0 2024-04-26T12:28:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:0/238: creat d9/d1d/d40/d41/d43/f4f x:0 0 0 2024-04-26T12:28:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:8/204: creat d7/dc/d1b/f3d x:0 0 0 2024-04-26T12:28:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:0/239: creat d9/dc/d2a/f50 x:0 0 0 2024-04-26T12:28:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:7/222: dread d16/f2d [0,4194304] 0 2024-04-26T12:28:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:8/205: fdatasync d7/da/f1a 0 2024-04-26T12:28:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:6/256: write d7/d16/f56 [776341,100304] 0 2024-04-26T12:28:46.013 INFO:tasks.workunit.client.0.smithi046.stdout:7/223: readlink l2 0 2024-04-26T12:28:46.014 INFO:tasks.workunit.client.0.smithi046.stdout:6/257: chown d7/d2b/d31/d4d/d58 706838695 1 2024-04-26T12:28:46.015 INFO:tasks.workunit.client.0.smithi046.stdout:3/271: dread d2/f17 [0,4194304] 0 2024-04-26T12:28:46.015 INFO:tasks.workunit.client.0.smithi046.stdout:8/206: rename d7/d1c/l33 to d7/da/l3e 0 2024-04-26T12:28:46.015 INFO:tasks.workunit.client.0.smithi046.stdout:7/224: write d16/d1c/d45/f48 [270615,37047] 0 2024-04-26T12:28:46.015 INFO:tasks.workunit.client.0.smithi046.stdout:6/258: chown d7/d2b/l3c 37186 1 2024-04-26T12:28:46.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/212: truncate f8 49130 0 2024-04-26T12:28:46.015 INFO:tasks.workunit.client.0.smithi046.stdout:8/207: creat d7/da/df/f3f x:0 0 0 2024-04-26T12:28:46.015 INFO:tasks.workunit.client.0.smithi046.stdout:3/272: read d2/d16/d11/d1b/d2d/f41 [1181705,57602] 0 2024-04-26T12:28:46.016 INFO:tasks.workunit.client.0.smithi046.stdout:6/259: mknod d7/d2b/d31/d4d/c5b 0 2024-04-26T12:28:46.016 INFO:tasks.workunit.client.0.smithi046.stdout:7/225: write d16/f23 [361721,118792] 0 2024-04-26T12:28:46.016 INFO:tasks.workunit.client.0.smithi046.stdout:4/209: sync 2024-04-26T12:28:46.016 INFO:tasks.workunit.client.0.smithi046.stdout:8/208: mknod d7/da/df/c40 0 2024-04-26T12:28:46.017 INFO:tasks.workunit.client.0.smithi046.stdout:3/273: mkdir d2/db/d62 0 2024-04-26T12:28:46.017 INFO:tasks.workunit.client.0.smithi046.stdout:8/209: chown d7/dc/f13 155059 1 2024-04-26T12:28:46.017 INFO:tasks.workunit.client.0.smithi046.stdout:9/160: dwrite d0/d19/f2f [0,4194304] 0 2024-04-26T12:28:46.018 INFO:tasks.workunit.client.0.smithi046.stdout:2/221: dread d1/f35 [0,4194304] 0 2024-04-26T12:28:46.018 INFO:tasks.workunit.client.0.smithi046.stdout:3/274: symlink d2/d16/d35/l63 0 2024-04-26T12:28:46.019 INFO:tasks.workunit.client.0.smithi046.stdout:9/161: readlink d0/d6/l14 0 2024-04-26T12:28:46.020 INFO:tasks.workunit.client.0.smithi046.stdout:3/275: chown d2/db/f55 47 1 2024-04-26T12:28:46.020 INFO:tasks.workunit.client.0.smithi046.stdout:9/162: fsync d0/d6/f2d 0 2024-04-26T12:28:46.021 INFO:tasks.workunit.client.0.smithi046.stdout:0/240: getdents d9/dc/dd/d45 0 2024-04-26T12:28:46.022 INFO:tasks.workunit.client.0.smithi046.stdout:2/222: creat d1/f48 x:0 0 0 2024-04-26T12:28:46.023 INFO:tasks.workunit.client.0.smithi046.stdout:5/213: dwrite d9/da/d15/f26 [0,4194304] 0 2024-04-26T12:28:46.023 INFO:tasks.workunit.client.0.smithi046.stdout:3/276: dread - d2/d16/d11/d1b/d2d/f56 zero size 2024-04-26T12:28:46.024 INFO:tasks.workunit.client.0.smithi046.stdout:7/226: dwrite d16/d1c/f2a [4194304,4194304] 0 2024-04-26T12:28:46.024 INFO:tasks.workunit.client.0.smithi046.stdout:2/223: write d1/d13/d1b/d38/f3b [951378,62000] 0 2024-04-26T12:28:46.025 INFO:tasks.workunit.client.0.smithi046.stdout:6/260: dread d7/fa [0,4194304] 0 2024-04-26T12:28:46.025 INFO:tasks.workunit.client.0.smithi046.stdout:5/214: fsync d9/da/dd/f32 0 2024-04-26T12:28:46.025 INFO:tasks.workunit.client.0.smithi046.stdout:3/277: chown d2/l5 2975767 1 2024-04-26T12:28:46.025 INFO:tasks.workunit.client.0.smithi046.stdout:7/227: write d16/f19 [497546,27021] 0 2024-04-26T12:28:46.026 INFO:tasks.workunit.client.0.smithi046.stdout:2/224: mknod d1/de/c49 0 2024-04-26T12:28:46.027 INFO:tasks.workunit.client.0.smithi046.stdout:6/261: write d7/f13 [1188349,90823] 0 2024-04-26T12:28:46.027 INFO:tasks.workunit.client.0.smithi046.stdout:2/225: chown d1 584 1 2024-04-26T12:28:46.027 INFO:tasks.workunit.client.0.smithi046.stdout:7/228: mknod d16/d1c/c4b 0 2024-04-26T12:28:46.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/278: mknod d2/d16/d11/d1b/c64 0 2024-04-26T12:28:46.027 INFO:tasks.workunit.client.0.smithi046.stdout:7/229: write d16/d35/f3b [706359,75230] 0 2024-04-26T12:28:46.028 INFO:tasks.workunit.client.0.smithi046.stdout:2/226: rmdir d1/d13/d1b 39 2024-04-26T12:28:46.028 INFO:tasks.workunit.client.0.smithi046.stdout:3/279: mknod d2/d16/d11/d23/c65 0 2024-04-26T12:28:46.028 INFO:tasks.workunit.client.0.smithi046.stdout:7/230: chown d16/d3f/l46 31159763 1 2024-04-26T12:28:46.029 INFO:tasks.workunit.client.0.smithi046.stdout:2/227: mkdir d1/d13/d4a 0 2024-04-26T12:28:46.029 INFO:tasks.workunit.client.0.smithi046.stdout:3/280: creat d2/d16/d35/f66 x:0 0 0 2024-04-26T12:28:46.029 INFO:tasks.workunit.client.0.smithi046.stdout:2/228: chown d1/d13/d4a 3095 1 2024-04-26T12:28:46.031 INFO:tasks.workunit.client.0.smithi046.stdout:3/281: creat d2/d16/d11/d23/f67 x:0 0 0 2024-04-26T12:28:46.031 INFO:tasks.workunit.client.0.smithi046.stdout:2/229: creat d1/d13/f4b x:0 0 0 2024-04-26T12:28:46.032 INFO:tasks.workunit.client.0.smithi046.stdout:9/163: truncate d0/d19/f2f 1134154 0 2024-04-26T12:28:46.032 INFO:tasks.workunit.client.0.smithi046.stdout:1/173: sync 2024-04-26T12:28:46.033 INFO:tasks.workunit.client.0.smithi046.stdout:0/241: truncate d9/f17 447573 0 2024-04-26T12:28:46.033 INFO:tasks.workunit.client.0.smithi046.stdout:6/262: dwrite d7/d2b/d31/f43 [0,4194304] 0 2024-04-26T12:28:46.033 INFO:tasks.workunit.client.0.smithi046.stdout:1/174: readlink d7/l26 0 2024-04-26T12:28:46.034 INFO:tasks.workunit.client.0.smithi046.stdout:3/282: fdatasync d2/d16/d11/d1b/f5c 0 2024-04-26T12:28:46.035 INFO:tasks.workunit.client.0.smithi046.stdout:5/215: dwrite d9/da/dd/f13 [0,4194304] 0 2024-04-26T12:28:46.037 INFO:tasks.workunit.client.0.smithi046.stdout:6/263: creat d7/d51/d57/f5c x:0 0 0 2024-04-26T12:28:46.037 INFO:tasks.workunit.client.0.smithi046.stdout:5/216: chown d9/da/d15 24 1 2024-04-26T12:28:46.038 INFO:tasks.workunit.client.0.smithi046.stdout:1/175: symlink d7/d14/d1c/d32/l3d 0 2024-04-26T12:28:46.039 INFO:tasks.workunit.client.0.smithi046.stdout:7/231: dwrite d16/d3f/f47 [0,4194304] 0 2024-04-26T12:28:46.039 INFO:tasks.workunit.client.0.smithi046.stdout:1/176: dread - d7/d12/f36 zero size 2024-04-26T12:28:46.041 INFO:tasks.workunit.client.0.smithi046.stdout:5/217: creat d9/da/dd/d34/f49 x:0 0 0 2024-04-26T12:28:46.042 INFO:tasks.workunit.client.0.smithi046.stdout:7/232: mknod d16/d1c/c4c 0 2024-04-26T12:28:46.042 INFO:tasks.workunit.client.0.smithi046.stdout:2/230: dwrite d1/de/d15/f46 [0,4194304] 0 2024-04-26T12:28:46.043 INFO:tasks.workunit.client.0.smithi046.stdout:5/218: chown d9/da/dd/d34/d44 10869 1 2024-04-26T12:28:46.043 INFO:tasks.workunit.client.0.smithi046.stdout:3/283: dread d2/d16/d11/d1b/d2d/f4c [0,4194304] 0 2024-04-26T12:28:46.043 INFO:tasks.workunit.client.0.smithi046.stdout:1/177: rmdir d7/d9/d33 0 2024-04-26T12:28:46.043 INFO:tasks.workunit.client.0.smithi046.stdout:3/284: stat d2/l3 0 2024-04-26T12:28:46.044 INFO:tasks.workunit.client.0.smithi046.stdout:5/219: stat d9/da/dd/d34/d3e 0 2024-04-26T12:28:46.047 INFO:tasks.workunit.client.0.smithi046.stdout:6/264: dwrite d7/d2b/d31/f44 [0,4194304] 0 2024-04-26T12:28:46.047 INFO:tasks.workunit.client.0.smithi046.stdout:2/231: write d1/f35 [658752,37602] 0 2024-04-26T12:28:46.048 INFO:tasks.workunit.client.0.smithi046.stdout:3/285: unlink d2/d16/d11/d1f/f38 0 2024-04-26T12:28:46.049 INFO:tasks.workunit.client.0.smithi046.stdout:0/242: dwrite d9/f20 [4194304,4194304] 0 2024-04-26T12:28:46.049 INFO:tasks.workunit.client.0.smithi046.stdout:9/164: dread d0/f1d [0,4194304] 0 2024-04-26T12:28:46.051 INFO:tasks.workunit.client.0.smithi046.stdout:4/210: sync 2024-04-26T12:28:46.051 INFO:tasks.workunit.client.0.smithi046.stdout:2/232: chown d1/de/f40 7 1 2024-04-26T12:28:46.051 INFO:tasks.workunit.client.0.smithi046.stdout:3/286: mknod d2/db/d4a/c68 0 2024-04-26T12:28:46.051 INFO:tasks.workunit.client.0.smithi046.stdout:6/265: symlink d7/d2b/d31/d4d/l5d 0 2024-04-26T12:28:46.053 INFO:tasks.workunit.client.0.smithi046.stdout:0/243: symlink d9/d1d/d40/d41/d43/l51 0 2024-04-26T12:28:46.053 INFO:tasks.workunit.client.0.smithi046.stdout:6/266: symlink d7/d2b/d31/d4d/l5e 0 2024-04-26T12:28:46.054 INFO:tasks.workunit.client.0.smithi046.stdout:7/233: dwrite d16/f2d [0,4194304] 0 2024-04-26T12:28:46.054 INFO:tasks.workunit.client.0.smithi046.stdout:2/233: creat d1/de/d15/d18/f4c x:0 0 0 2024-04-26T12:28:46.055 INFO:tasks.workunit.client.0.smithi046.stdout:0/244: symlink d9/d1d/l52 0 2024-04-26T12:28:46.055 INFO:tasks.workunit.client.0.smithi046.stdout:2/234: dread - d1/d13/f4b zero size 2024-04-26T12:28:46.055 INFO:tasks.workunit.client.0.smithi046.stdout:7/234: write d16/d35/f3a [513196,79792] 0 2024-04-26T12:28:46.056 INFO:tasks.workunit.client.0.smithi046.stdout:1/178: dwrite d7/db/ff [0,4194304] 0 2024-04-26T12:28:46.056 INFO:tasks.workunit.client.0.smithi046.stdout:3/287: link d2/db/d4a/f3b d2/d16/d35/f69 0 2024-04-26T12:28:46.056 INFO:tasks.workunit.client.0.smithi046.stdout:5/220: read d9/da/d18/f24 [1172533,63701] 0 2024-04-26T12:28:46.056 INFO:tasks.workunit.client.0.smithi046.stdout:9/165: dread d0/d6/f26 [0,4194304] 0 2024-04-26T12:28:46.057 INFO:tasks.workunit.client.0.smithi046.stdout:0/245: dread - d9/dc/dd/d45/f4e zero size 2024-04-26T12:28:46.057 INFO:tasks.workunit.client.0.smithi046.stdout:6/267: creat d7/d51/f5f x:0 0 0 2024-04-26T12:28:46.059 INFO:tasks.workunit.client.0.smithi046.stdout:2/235: rename d1/d13/d1b/f24 to d1/d13/d4a/f4d 0 2024-04-26T12:28:46.059 INFO:tasks.workunit.client.0.smithi046.stdout:0/246: link c4 d9/dc/dd/c53 0 2024-04-26T12:28:46.059 INFO:tasks.workunit.client.0.smithi046.stdout:2/236: creat d1/de/d15/f4e x:0 0 0 2024-04-26T12:28:46.060 INFO:tasks.workunit.client.0.smithi046.stdout:0/247: getdents d9/dc/d4c 0 2024-04-26T12:28:46.060 INFO:tasks.workunit.client.0.smithi046.stdout:6/268: rmdir d7/d2b/d31/d4d/d58 0 2024-04-26T12:28:46.061 INFO:tasks.workunit.client.0.smithi046.stdout:2/237: mknod d1/d13/d1b/c4f 0 2024-04-26T12:28:46.061 INFO:tasks.workunit.client.0.smithi046.stdout:0/248: creat d9/d1d/d40/d41/f54 x:0 0 0 2024-04-26T12:28:46.062 INFO:tasks.workunit.client.0.smithi046.stdout:6/269: truncate d7/d1b/d37/f42 1131573 0 2024-04-26T12:28:46.062 INFO:tasks.workunit.client.0.smithi046.stdout:3/288: dwrite d2/d16/d11/d1b/d2d/f5b [0,4194304] 0 2024-04-26T12:28:46.063 INFO:tasks.workunit.client.0.smithi046.stdout:2/238: unlink d1/de/f40 0 2024-04-26T12:28:46.063 INFO:tasks.workunit.client.0.smithi046.stdout:6/270: write d7/d2b/d31/f43 [1017087,23035] 0 2024-04-26T12:28:46.064 INFO:tasks.workunit.client.0.smithi046.stdout:2/239: readlink d1/d13/d1b/l34 0 2024-04-26T12:28:46.064 INFO:tasks.workunit.client.0.smithi046.stdout:3/289: symlink d2/d16/d11/l6a 0 2024-04-26T12:28:46.064 INFO:tasks.workunit.client.0.smithi046.stdout:6/271: write d7/f15 [2065980,39734] 0 2024-04-26T12:28:46.065 INFO:tasks.workunit.client.0.smithi046.stdout:3/290: mknod d2/c6b 0 2024-04-26T12:28:46.066 INFO:tasks.workunit.client.0.smithi046.stdout:1/179: read d7/d9/f17 [1043447,52155] 0 2024-04-26T12:28:46.067 INFO:tasks.workunit.client.0.smithi046.stdout:1/180: stat d7/d14/d1c/d32/l35 0 2024-04-26T12:28:46.068 INFO:tasks.workunit.client.0.smithi046.stdout:8/210: dread d7/dc/f17 [0,4194304] 0 2024-04-26T12:28:46.068 INFO:tasks.workunit.client.0.smithi046.stdout:0/249: dwrite d9/dc/dd/f14 [0,4194304] 0 2024-04-26T12:28:46.069 INFO:tasks.workunit.client.0.smithi046.stdout:7/235: write f3 [643027,48585] 0 2024-04-26T12:28:46.070 INFO:tasks.workunit.client.0.smithi046.stdout:8/211: stat d7/da/f23 0 2024-04-26T12:28:46.071 INFO:tasks.workunit.client.0.smithi046.stdout:7/236: mkdir d16/d1a/d31/d4d 0 2024-04-26T12:28:46.071 INFO:tasks.workunit.client.0.smithi046.stdout:1/181: truncate d7/d12/f27 114001 0 2024-04-26T12:28:46.072 INFO:tasks.workunit.client.0.smithi046.stdout:2/240: dwrite d1/de/d15/f46 [4194304,4194304] 0 2024-04-26T12:28:46.073 INFO:tasks.workunit.client.0.smithi046.stdout:8/212: link f4 d7/dc/f41 0 2024-04-26T12:28:46.074 INFO:tasks.workunit.client.0.smithi046.stdout:6/272: dwrite d7/d2b/d31/f39 [0,4194304] 0 2024-04-26T12:28:46.075 INFO:tasks.workunit.client.0.smithi046.stdout:7/237: mkdir d16/d4e 0 2024-04-26T12:28:46.075 INFO:tasks.workunit.client.0.smithi046.stdout:1/182: write d7/d12/f21 [2802245,98799] 0 2024-04-26T12:28:46.075 INFO:tasks.workunit.client.0.smithi046.stdout:8/213: dread - d7/d24/f30 zero size 2024-04-26T12:28:46.076 INFO:tasks.workunit.client.0.smithi046.stdout:4/211: dread d0/d1/d5/db/f2f [4194304,4194304] 0 2024-04-26T12:28:46.076 INFO:tasks.workunit.client.0.smithi046.stdout:2/241: write d1/d13/d1b/d38/f3b [1424591,60508] 0 2024-04-26T12:28:46.076 INFO:tasks.workunit.client.0.smithi046.stdout:5/221: dwrite d9/da/f20 [0,4194304] 0 2024-04-26T12:28:46.077 INFO:tasks.workunit.client.0.smithi046.stdout:1/183: creat d7/d14/d1c/f3e x:0 0 0 2024-04-26T12:28:46.078 INFO:tasks.workunit.client.0.smithi046.stdout:8/214: fsync d7/da/df/f10 0 2024-04-26T12:28:46.079 INFO:tasks.workunit.client.0.smithi046.stdout:7/238: rename d16/d1c/d45 to d16/d1a/d3e/d4f 0 2024-04-26T12:28:46.079 INFO:tasks.workunit.client.0.smithi046.stdout:5/222: fsync d9/f41 0 2024-04-26T12:28:46.079 INFO:tasks.workunit.client.0.smithi046.stdout:6/273: write d7/d51/f5a [552946,47162] 0 2024-04-26T12:28:46.079 INFO:tasks.workunit.client.0.smithi046.stdout:8/215: fdatasync d7/d24/f2f 0 2024-04-26T12:28:46.079 INFO:tasks.workunit.client.0.smithi046.stdout:0/250: dread f7 [4194304,4194304] 0 2024-04-26T12:28:46.080 INFO:tasks.workunit.client.0.smithi046.stdout:7/239: chown d16/d35 1 1 2024-04-26T12:28:46.080 INFO:tasks.workunit.client.0.smithi046.stdout:1/184: chown d7/db/ff 657 1 2024-04-26T12:28:46.080 INFO:tasks.workunit.client.0.smithi046.stdout:1/185: chown d7/d9/f11 2347 1 2024-04-26T12:28:46.080 INFO:tasks.workunit.client.0.smithi046.stdout:4/212: link d0/d1/f42 d0/da/d17/f46 0 2024-04-26T12:28:46.081 INFO:tasks.workunit.client.0.smithi046.stdout:0/251: mknod d9/d1d/d40/d41/c55 0 2024-04-26T12:28:46.081 INFO:tasks.workunit.client.0.smithi046.stdout:2/242: link d1/de/d2b/f37 d1/de/d2b/f50 0 2024-04-26T12:28:46.081 INFO:tasks.workunit.client.0.smithi046.stdout:7/240: creat d16/d1c/f50 x:0 0 0 2024-04-26T12:28:46.081 INFO:tasks.workunit.client.0.smithi046.stdout:6/274: symlink d7/d16/l60 0 2024-04-26T12:28:46.081 INFO:tasks.workunit.client.0.smithi046.stdout:4/213: dread - d0/da/d17/d20/d25/f43 zero size 2024-04-26T12:28:46.082 INFO:tasks.workunit.client.0.smithi046.stdout:5/223: rename d9/l11 to d9/da/dd/d34/d3e/d3f/l4a 0 2024-04-26T12:28:46.082 INFO:tasks.workunit.client.0.smithi046.stdout:0/252: symlink d9/dc/d4c/l56 0 2024-04-26T12:28:46.082 INFO:tasks.workunit.client.0.smithi046.stdout:4/214: creat d0/d1/d12/f47 x:0 0 0 2024-04-26T12:28:46.084 INFO:tasks.workunit.client.0.smithi046.stdout:4/215: read d0/d1/d5/db/f2f [2507386,54689] 0 2024-04-26T12:28:46.084 INFO:tasks.workunit.client.0.smithi046.stdout:7/241: chown d16/d27 54841 1 2024-04-26T12:28:46.085 INFO:tasks.workunit.client.0.smithi046.stdout:5/224: creat d9/da/f4b x:0 0 0 2024-04-26T12:28:46.085 INFO:tasks.workunit.client.0.smithi046.stdout:4/216: mkdir d0/da/d17/d20/d25/d35/d48 0 2024-04-26T12:28:46.085 INFO:tasks.workunit.client.0.smithi046.stdout:5/225: getdents d9/da/dd/d34 0 2024-04-26T12:28:46.086 INFO:tasks.workunit.client.0.smithi046.stdout:5/226: creat d9/da/d15/f4c x:0 0 0 2024-04-26T12:28:46.087 INFO:tasks.workunit.client.0.smithi046.stdout:5/227: write d9/da/f4b [883673,109553] 0 2024-04-26T12:28:46.088 INFO:tasks.workunit.client.0.smithi046.stdout:7/242: read f3 [1080228,71039] 0 2024-04-26T12:28:46.089 INFO:tasks.workunit.client.0.smithi046.stdout:5/228: getdents d9/da/dd/d34/d3e 0 2024-04-26T12:28:46.089 INFO:tasks.workunit.client.0.smithi046.stdout:7/243: mkdir d16/d27/d51 0 2024-04-26T12:28:46.090 INFO:tasks.workunit.client.0.smithi046.stdout:5/229: dread - d9/da/dd/d34/d3e/f47 zero size 2024-04-26T12:28:46.090 INFO:tasks.workunit.client.0.smithi046.stdout:4/217: dwrite d0/d1/d5/db/f2f [0,4194304] 0 2024-04-26T12:28:46.091 INFO:tasks.workunit.client.0.smithi046.stdout:5/230: fdatasync d9/da/f10 0 2024-04-26T12:28:46.092 INFO:tasks.workunit.client.0.smithi046.stdout:6/275: truncate d7/d16/f1c 1106832 0 2024-04-26T12:28:46.096 INFO:tasks.workunit.client.0.smithi046.stdout:3/291: dread d2/f7 [0,4194304] 0 2024-04-26T12:28:46.098 INFO:tasks.workunit.client.0.smithi046.stdout:8/216: dwrite d7/dc/f41 [0,4194304] 0 2024-04-26T12:28:46.099 INFO:tasks.workunit.client.0.smithi046.stdout:3/292: readlink d2/d16/d11/d1f/l43 0 2024-04-26T12:28:46.099 INFO:tasks.workunit.client.0.smithi046.stdout:7/244: dwrite d16/d1c/f4a [0,4194304] 0 2024-04-26T12:28:46.100 INFO:tasks.workunit.client.0.smithi046.stdout:3/293: dread - d2/d16/d35/f66 zero size 2024-04-26T12:28:46.100 INFO:tasks.workunit.client.0.smithi046.stdout:4/218: dwrite d0/da/d17/d20/d25/f43 [0,4194304] 0 2024-04-26T12:28:46.101 INFO:tasks.workunit.client.0.smithi046.stdout:8/217: creat d7/d24/d28/d2a/f42 x:0 0 0 2024-04-26T12:28:46.101 INFO:tasks.workunit.client.0.smithi046.stdout:5/231: dread d9/da/f4b [0,4194304] 0 2024-04-26T12:28:46.101 INFO:tasks.workunit.client.0.smithi046.stdout:6/276: dread d7/d2b/d31/f43 [0,4194304] 0 2024-04-26T12:28:46.102 INFO:tasks.workunit.client.0.smithi046.stdout:6/277: write d7/d1b/d37/f38 [1369712,24769] 0 2024-04-26T12:28:46.102 INFO:tasks.workunit.client.0.smithi046.stdout:7/245: creat d16/d4e/f52 x:0 0 0 2024-04-26T12:28:46.103 INFO:tasks.workunit.client.0.smithi046.stdout:8/218: creat d7/d24/f43 x:0 0 0 2024-04-26T12:28:46.103 INFO:tasks.workunit.client.0.smithi046.stdout:4/219: creat d0/da/d17/d20/d25/d35/f49 x:0 0 0 2024-04-26T12:28:46.103 INFO:tasks.workunit.client.0.smithi046.stdout:7/246: write f4 [5903396,6556] 0 2024-04-26T12:28:46.103 INFO:tasks.workunit.client.0.smithi046.stdout:6/278: write d7/d1b/d37/f3b [2747025,96111] 0 2024-04-26T12:28:46.104 INFO:tasks.workunit.client.0.smithi046.stdout:3/294: getdents d2/d16/d11/d1b 0 2024-04-26T12:28:46.104 INFO:tasks.workunit.client.0.smithi046.stdout:8/219: mknod d7/d24/c44 0 2024-04-26T12:28:46.106 INFO:tasks.workunit.client.0.smithi046.stdout:7/247: rename d16/d1a/d31/f3c to d16/d1a/f53 0 2024-04-26T12:28:46.106 INFO:tasks.workunit.client.0.smithi046.stdout:8/220: creat d7/dc/f45 x:0 0 0 2024-04-26T12:28:46.107 INFO:tasks.workunit.client.0.smithi046.stdout:1/186: dread d7/db/f10 [4194304,4194304] 0 2024-04-26T12:28:46.107 INFO:tasks.workunit.client.0.smithi046.stdout:8/221: chown d7/da/df 564233 1 2024-04-26T12:28:46.107 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:46.106+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:46.108 INFO:tasks.workunit.client.0.smithi046.stdout:7/248: chown d16/d27/l2e 626 1 2024-04-26T12:28:46.108 INFO:tasks.workunit.client.0.smithi046.stdout:1/187: readlink d7/d9/d2b/d31/l34 0 2024-04-26T12:28:46.108 INFO:tasks.workunit.client.0.smithi046.stdout:7/249: chown d16/d27/d51 11 1 2024-04-26T12:28:46.108 INFO:tasks.workunit.client.0.smithi046.stdout:9/166: sync 2024-04-26T12:28:46.108 INFO:tasks.workunit.client.0.smithi046.stdout:2/243: sync 2024-04-26T12:28:46.109 INFO:tasks.workunit.client.0.smithi046.stdout:7/250: stat d16/d35/c37 0 2024-04-26T12:28:46.109 INFO:tasks.workunit.client.0.smithi046.stdout:8/222: rename d7/dc/d27/c32 to d7/d24/c46 0 2024-04-26T12:28:46.110 INFO:tasks.workunit.client.0.smithi046.stdout:9/167: chown d0/d19/l20 27159 1 2024-04-26T12:28:46.111 INFO:tasks.workunit.client.0.smithi046.stdout:1/188: getdents d7/d14 0 2024-04-26T12:28:46.111 INFO:tasks.workunit.client.0.smithi046.stdout:3/295: dwrite d2/db/f55 [0,4194304] 0 2024-04-26T12:28:46.111 INFO:tasks.workunit.client.0.smithi046.stdout:6/279: dwrite d7/f29 [0,4194304] 0 2024-04-26T12:28:46.111 INFO:tasks.workunit.client.0.smithi046.stdout:8/223: creat d7/dc/d1b/f47 x:0 0 0 2024-04-26T12:28:46.111 INFO:tasks.workunit.client.0.smithi046.stdout:0/253: dread d9/fa [0,4194304] 0 2024-04-26T12:28:46.112 INFO:tasks.workunit.client.0.smithi046.stdout:7/251: write d16/d1a/d31/f39 [75934,22244] 0 2024-04-26T12:28:46.113 INFO:tasks.workunit.client.0.smithi046.stdout:2/244: rename d1/de/c49 to d1/c51 0 2024-04-26T12:28:46.113 INFO:tasks.workunit.client.0.smithi046.stdout:6/280: readlink d7/d16/l18 0 2024-04-26T12:28:46.113 INFO:tasks.workunit.client.0.smithi046.stdout:3/296: stat d2/db/d4a/f5a 0 2024-04-26T12:28:46.114 INFO:tasks.workunit.client.0.smithi046.stdout:9/168: chown d0/d19/d21/f30 30671 1 2024-04-26T12:28:46.114 INFO:tasks.workunit.client.0.smithi046.stdout:6/281: chown d7/d1b/d37 751 1 2024-04-26T12:28:46.115 INFO:tasks.workunit.client.0.smithi046.stdout:7/252: symlink d16/d4e/l54 0 2024-04-26T12:28:46.115 INFO:tasks.workunit.client.0.smithi046.stdout:7/253: readlink l1 0 2024-04-26T12:28:46.115 INFO:tasks.workunit.client.0.smithi046.stdout:3/297: mknod d2/d16/d11/d23/c6c 0 2024-04-26T12:28:46.115 INFO:tasks.workunit.client.0.smithi046.stdout:2/245: mknod d1/d13/d1b/c52 0 2024-04-26T12:28:46.115 INFO:tasks.workunit.client.0.smithi046.stdout:8/224: creat d7/d24/d28/d2a/d39/f48 x:0 0 0 2024-04-26T12:28:46.116 INFO:tasks.workunit.client.0.smithi046.stdout:2/246: truncate d1/de/f3c 360034 0 2024-04-26T12:28:46.116 INFO:tasks.workunit.client.0.smithi046.stdout:6/282: mknod d7/d1b/c61 0 2024-04-26T12:28:46.116 INFO:tasks.workunit.client.0.smithi046.stdout:7/254: mkdir d16/d1a/d31/d55 0 2024-04-26T12:28:46.117 INFO:tasks.workunit.client.0.smithi046.stdout:8/225: write d7/dc/f13 [1056987,73176] 0 2024-04-26T12:28:46.117 INFO:tasks.workunit.client.0.smithi046.stdout:7/255: dread - d16/d1c/f50 zero size 2024-04-26T12:28:46.117 INFO:tasks.workunit.client.0.smithi046.stdout:3/298: getdents d2/db/d4a 0 2024-04-26T12:28:46.119 INFO:tasks.workunit.client.0.smithi046.stdout:4/220: fsync d0/da/d17/d20/d25/f43 0 2024-04-26T12:28:46.119 INFO:tasks.workunit.client.0.smithi046.stdout:8/226: dread - d7/d24/d28/f34 zero size 2024-04-26T12:28:46.119 INFO:tasks.workunit.client.0.smithi046.stdout:3/299: mkdir d2/d16/d11/d6d 0 2024-04-26T12:28:46.120 INFO:tasks.workunit.client.0.smithi046.stdout:4/221: rmdir d0/da 39 2024-04-26T12:28:46.122 INFO:tasks.workunit.client.0.smithi046.stdout:4/222: creat d0/d1/d9/d19/f4a x:0 0 0 2024-04-26T12:28:46.122 INFO:tasks.workunit.client.0.smithi046.stdout:1/189: read d7/d14/f23 [293870,108515] 0 2024-04-26T12:28:46.122 INFO:tasks.workunit.client.0.smithi046.stdout:8/227: getdents d7/d24 0 2024-04-26T12:28:46.124 INFO:tasks.workunit.client.0.smithi046.stdout:6/283: dwrite d7/d2b/d31/f43 [4194304,4194304] 0 2024-04-26T12:28:46.124 INFO:tasks.workunit.client.0.smithi046.stdout:5/232: dread d9/da/f1b [0,4194304] 0 2024-04-26T12:28:46.124 INFO:tasks.workunit.client.0.smithi046.stdout:2/247: dwrite d1/de/d15/d18/f4c [0,4194304] 0 2024-04-26T12:28:46.124 INFO:tasks.workunit.client.0.smithi046.stdout:0/254: read d9/dc/dd/f24 [552855,128267] 0 2024-04-26T12:28:46.125 INFO:tasks.workunit.client.0.smithi046.stdout:1/190: symlink d7/d9/d2b/l3f 0 2024-04-26T12:28:46.125 INFO:tasks.workunit.client.0.smithi046.stdout:5/233: stat d9/da/dd/d34/d45 0 2024-04-26T12:28:46.125 INFO:tasks.workunit.client.0.smithi046.stdout:4/223: chown d0/da/d17/d20/f39 137703856 1 2024-04-26T12:28:46.126 INFO:tasks.workunit.client.0.smithi046.stdout:8/228: unlink d7/dc/d1b/f3d 0 2024-04-26T12:28:46.127 INFO:tasks.workunit.client.0.smithi046.stdout:0/255: rename f7 to d9/dc/dd/f57 0 2024-04-26T12:28:46.127 INFO:tasks.workunit.client.0.smithi046.stdout:2/248: symlink d1/de/d15/d18/l53 0 2024-04-26T12:28:46.127 INFO:tasks.workunit.client.0.smithi046.stdout:7/256: dwrite d16/d1c/f2a [4194304,4194304] 0 2024-04-26T12:28:46.127 INFO:tasks.workunit.client.0.smithi046.stdout:4/224: creat d0/d1/d12/f4b x:0 0 0 2024-04-26T12:28:46.129 INFO:tasks.workunit.client.0.smithi046.stdout:5/234: creat d9/da/dd/d34/d44/f4d x:0 0 0 2024-04-26T12:28:46.130 INFO:tasks.workunit.client.0.smithi046.stdout:8/229: write d7/dc/d1b/f47 [979667,15920] 0 2024-04-26T12:28:46.130 INFO:tasks.workunit.client.0.smithi046.stdout:7/257: mknod d16/d1a/d3e/c56 0 2024-04-26T12:28:46.130 INFO:tasks.workunit.client.0.smithi046.stdout:0/256: write d9/d1d/f3c [275617,6448] 0 2024-04-26T12:28:46.131 INFO:tasks.workunit.client.0.smithi046.stdout:4/225: rmdir d0/da/d17 39 2024-04-26T12:28:46.131 INFO:tasks.workunit.client.0.smithi046.stdout:3/300: dwrite d2/d16/d2c/f36 [0,4194304] 0 2024-04-26T12:28:46.132 INFO:tasks.workunit.client.0.smithi046.stdout:8/230: read - d7/d24/d28/d2a/d39/f48 zero size 2024-04-26T12:28:46.132 INFO:tasks.workunit.client.0.smithi046.stdout:7/258: symlink d16/d3f/l57 0 2024-04-26T12:28:46.133 INFO:tasks.workunit.client.0.smithi046.stdout:8/231: fsync d7/da/f1a 0 2024-04-26T12:28:46.133 INFO:tasks.workunit.client.0.smithi046.stdout:5/235: rmdir d9/da/dd/d34/d3e 39 2024-04-26T12:28:46.133 INFO:tasks.workunit.client.0.smithi046.stdout:7/259: read d16/d27/f34 [378796,75986] 0 2024-04-26T12:28:46.133 INFO:tasks.workunit.client.0.smithi046.stdout:6/284: dwrite d7/d1b/d37/f42 [0,4194304] 0 2024-04-26T12:28:46.134 INFO:tasks.workunit.client.0.smithi046.stdout:3/301: symlink d2/d16/d11/d6d/l6e 0 2024-04-26T12:28:46.134 INFO:tasks.workunit.client.0.smithi046.stdout:8/232: write d7/d24/f43 [831672,3898] 0 2024-04-26T12:28:46.135 INFO:tasks.workunit.client.0.smithi046.stdout:4/226: getdents d0/d1/d5 0 2024-04-26T12:28:46.136 INFO:tasks.workunit.client.0.smithi046.stdout:6/285: dread - d7/d2b/d31/f3f zero size 2024-04-26T12:28:46.136 INFO:tasks.workunit.client.0.smithi046.stdout:8/233: readlink d7/dc/d27/l37 0 2024-04-26T12:28:46.136 INFO:tasks.workunit.client.0.smithi046.stdout:4/227: dread - d0/d1/d9/d19/f4a zero size 2024-04-26T12:28:46.137 INFO:tasks.workunit.client.0.smithi046.stdout:5/236: symlink d9/da/dd/d34/d3e/d3f/l4e 0 2024-04-26T12:28:46.137 INFO:tasks.workunit.client.0.smithi046.stdout:6/286: rename d7/d1b/f26 to d7/f62 0 2024-04-26T12:28:46.137 INFO:tasks.workunit.client.0.smithi046.stdout:8/234: fdatasync d7/da/df/f10 0 2024-04-26T12:28:46.138 INFO:tasks.workunit.client.0.smithi046.stdout:6/287: mknod d7/d2b/c63 0 2024-04-26T12:28:46.138 INFO:tasks.workunit.client.0.smithi046.stdout:0/257: dwrite d9/f3f [0,4194304] 0 2024-04-26T12:28:46.139 INFO:tasks.workunit.client.0.smithi046.stdout:5/237: truncate d9/da/d15/f1a 4268543 0 2024-04-26T12:28:46.139 INFO:tasks.workunit.client.0.smithi046.stdout:8/235: write d7/d24/d28/d2a/d39/f48 [101566,24530] 0 2024-04-26T12:28:46.139 INFO:tasks.workunit.client.0.smithi046.stdout:0/258: creat d9/d1d/f58 x:0 0 0 2024-04-26T12:28:46.142 INFO:tasks.workunit.client.0.smithi046.stdout:8/236: rename d7/da/f1a to d7/d24/f49 0 2024-04-26T12:28:46.143 INFO:tasks.workunit.client.0.smithi046.stdout:2/249: truncate d1/de/d2b/f41 2916744 0 2024-04-26T12:28:46.144 INFO:tasks.workunit.client.0.smithi046.stdout:8/237: fdatasync d7/dc/d27/f3a 0 2024-04-26T12:28:46.146 INFO:tasks.workunit.client.0.smithi046.stdout:4/228: dwrite d0/da/d17/d20/d25/d35/f49 [0,4194304] 0 2024-04-26T12:28:46.148 INFO:tasks.workunit.client.0.smithi046.stdout:8/238: creat d7/f4a x:0 0 0 2024-04-26T12:28:46.149 INFO:tasks.workunit.client.0.smithi046.stdout:5/238: dwrite d9/da/dd/f1e [0,4194304] 0 2024-04-26T12:28:46.149 INFO:tasks.workunit.client.0.smithi046.stdout:6/288: dwrite d7/d2b/d31/f2f [0,4194304] 0 2024-04-26T12:28:46.149 INFO:tasks.workunit.client.0.smithi046.stdout:0/259: dwrite d9/dc/f1a [0,4194304] 0 2024-04-26T12:28:46.149 INFO:tasks.workunit.client.0.smithi046.stdout:8/239: write d7/dc/f13 [1485715,63054] 0 2024-04-26T12:28:46.150 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:46.150 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:46.151 INFO:tasks.workunit.client.0.smithi046.stdout:0/260: stat d9/dc/dd/c53 0 2024-04-26T12:28:46.151 INFO:tasks.workunit.client.0.smithi046.stdout:5/239: truncate d9/f2c 63972 0 2024-04-26T12:28:46.151 INFO:tasks.workunit.client.0.smithi046.stdout:6/289: getdents d7/d16 0 2024-04-26T12:28:46.151 INFO:tasks.workunit.client.0.smithi046.stdout:8/240: chown d7/l9 190 1 2024-04-26T12:28:46.152 INFO:tasks.workunit.client.0.smithi046.stdout:0/261: stat d9/d1d/d40/d41/d43/f4f 0 2024-04-26T12:28:46.152 INFO:tasks.workunit.client.0.smithi046.stdout:5/240: rmdir d9/da/dd/d34/d44 39 2024-04-26T12:28:46.152 INFO:tasks.workunit.client.0.smithi046.stdout:6/290: symlink d7/d16/l64 0 2024-04-26T12:28:46.152 INFO:tasks.workunit.client.0.smithi046.stdout:0/262: chown d9/d1d/c23 7698 1 2024-04-26T12:28:46.152 INFO:tasks.workunit.client.0.smithi046.stdout:6/291: mkdir d7/d1b/d47/d65 0 2024-04-26T12:28:46.154 INFO:tasks.workunit.client.0.smithi046.stdout:6/292: getdents d7/d51/d57 0 2024-04-26T12:28:46.155 INFO:tasks.workunit.client.0.smithi046.stdout:6/293: creat d7/d1b/d37/f66 x:0 0 0 2024-04-26T12:28:46.156 INFO:tasks.workunit.client.0.smithi046.stdout:6/294: fdatasync d7/d16/f56 0 2024-04-26T12:28:46.158 INFO:tasks.workunit.client.0.smithi046.stdout:0/263: dwrite d9/d1d/d40/d41/d43/f4f [0,4194304] 0 2024-04-26T12:28:46.158 INFO:tasks.workunit.client.0.smithi046.stdout:0/264: rmdir d9/dc/dd/d45 39 2024-04-26T12:28:46.160 INFO:tasks.workunit.client.0.smithi046.stdout:8/241: dread d7/dc/f13 [0,4194304] 0 2024-04-26T12:28:46.161 INFO:tasks.workunit.client.0.smithi046.stdout:3/302: dread d2/db/f25 [0,4194304] 0 2024-04-26T12:28:46.161 INFO:tasks.workunit.client.0.smithi046.stdout:0/265: link d9/dc/d2a/c3e d9/dc/d2a/c59 0 2024-04-26T12:28:46.163 INFO:tasks.workunit.client.0.smithi046.stdout:8/242: creat d7/d24/d28/d2a/f4b x:0 0 0 2024-04-26T12:28:46.163 INFO:tasks.workunit.client.0.smithi046.stdout:0/266: creat d9/dc/d2a/f5a x:0 0 0 2024-04-26T12:28:46.163 INFO:tasks.workunit.client.0.smithi046.stdout:8/243: mknod d7/d1c/c4c 0 2024-04-26T12:28:46.165 INFO:tasks.workunit.client.0.smithi046.stdout:3/303: dread d2/d16/d11/d1b/d2d/f4c [0,4194304] 0 2024-04-26T12:28:46.165 INFO:tasks.workunit.client.0.smithi046.stdout:8/244: creat d7/da/df/f4d x:0 0 0 2024-04-26T12:28:46.166 INFO:tasks.workunit.client.0.smithi046.stdout:0/267: write d9/d1d/f4d [6038530,30477] 0 2024-04-26T12:28:46.166 INFO:tasks.workunit.client.0.smithi046.stdout:3/304: symlink d2/db/l6f 0 2024-04-26T12:28:46.166 INFO:tasks.workunit.client.0.smithi046.stdout:8/245: symlink d7/d24/d28/d2a/d39/l4e 0 2024-04-26T12:28:46.166 INFO:tasks.workunit.client.0.smithi046.stdout:4/229: read d0/d1/d5/f2b [2268014,96184] 0 2024-04-26T12:28:46.166 INFO:tasks.workunit.client.0.smithi046.stdout:3/305: rmdir d2/d16/d11 39 2024-04-26T12:28:46.167 INFO:tasks.workunit.client.0.smithi046.stdout:3/306: write d2/f7 [2250170,125591] 0 2024-04-26T12:28:46.168 INFO:tasks.workunit.client.0.smithi046.stdout:3/307: unlink d2/db/d4a/f5a 0 2024-04-26T12:28:46.168 INFO:tasks.workunit.client.0.smithi046.stdout:8/246: truncate d7/da/df/f2b 1557626 0 2024-04-26T12:28:46.169 INFO:tasks.workunit.client.0.smithi046.stdout:3/308: symlink d2/db/d4a/l70 0 2024-04-26T12:28:46.170 INFO:tasks.workunit.client.0.smithi046.stdout:8/247: getdents d7/da/df 0 2024-04-26T12:28:46.171 INFO:tasks.workunit.client.0.smithi046.stdout:7/260: dread d16/d35/f3b [0,4194304] 0 2024-04-26T12:28:46.173 INFO:tasks.workunit.client.0.smithi046.stdout:7/261: symlink d16/d1a/l58 0 2024-04-26T12:28:46.174 INFO:tasks.workunit.client.0.smithi046.stdout:3/309: dwrite d2/db/d4a/f40 [0,4194304] 0 2024-04-26T12:28:46.174 INFO:tasks.workunit.client.0.smithi046.stdout:7/262: truncate d16/f23 573488 0 2024-04-26T12:28:46.174 INFO:tasks.workunit.client.0.smithi046.stdout:8/248: dwrite d7/d24/d28/f34 [0,4194304] 0 2024-04-26T12:28:46.175 INFO:tasks.workunit.client.0.smithi046.stdout:7/263: rmdir d16/d1a/d3e/d4f 39 2024-04-26T12:28:46.175 INFO:tasks.workunit.client.0.smithi046.stdout:8/249: mkdir d7/da/d4f 0 2024-04-26T12:28:46.176 INFO:tasks.workunit.client.0.smithi046.stdout:5/241: dread d9/f41 [0,4194304] 0 2024-04-26T12:28:46.176 INFO:tasks.workunit.client.0.smithi046.stdout:7/264: write f4 [1445391,82252] 0 2024-04-26T12:28:46.176 INFO:tasks.workunit.client.0.smithi046.stdout:7/265: unlink d16/f19 0 2024-04-26T12:28:46.177 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:46.179 INFO:tasks.workunit.client.0.smithi046.stdout:4/230: truncate d0/da/d17/d20/d25/d35/f49 1143713 0 2024-04-26T12:28:46.179 INFO:tasks.workunit.client.0.smithi046.stdout:7/266: chown d16/d27/c28 740836 1 2024-04-26T12:28:46.179 INFO:tasks.workunit.client.0.smithi046.stdout:8/250: truncate d7/d24/f2f 3354370 0 2024-04-26T12:28:46.179 INFO:tasks.workunit.client.0.smithi046.stdout:5/242: link d9/da/d15/f26 d9/f4f 0 2024-04-26T12:28:46.180 INFO:tasks.workunit.client.0.smithi046.stdout:8/251: write d7/d24/d28/d2a/d39/f48 [413120,49252] 0 2024-04-26T12:28:46.181 INFO:tasks.workunit.client.0.smithi046.stdout:5/243: creat d9/da/d40/f50 x:0 0 0 2024-04-26T12:28:46.182 INFO:tasks.workunit.client.0.smithi046.stdout:8/252: rename d7/d24/d28 to d7/d24/d50 0 2024-04-26T12:28:46.182 INFO:tasks.workunit.client.0.smithi046.stdout:5/244: chown d9/da/d40 1741761 1 2024-04-26T12:28:46.183 INFO:tasks.workunit.client.0.smithi046.stdout:8/253: creat d7/dc/d27/f51 x:0 0 0 2024-04-26T12:28:46.183 INFO:tasks.workunit.client.0.smithi046.stdout:5/245: creat d9/da/dd/d34/d3e/f51 x:0 0 0 2024-04-26T12:28:46.185 INFO:tasks.workunit.client.0.smithi046.stdout:5/246: rename d9/lc to d9/da/dd/d34/d3e/d3f/l52 0 2024-04-26T12:28:46.185 INFO:tasks.workunit.client.0.smithi046.stdout:4/231: dwrite d0/da/f26 [0,4194304] 0 2024-04-26T12:28:46.187 INFO:tasks.workunit.client.0.smithi046.stdout:5/247: link d9/da/dd/f1e d9/da/dd/d34/d45/f53 0 2024-04-26T12:28:46.187 INFO:tasks.workunit.client.0.smithi046.stdout:5/248: fsync d9/da/d18/f24 0 2024-04-26T12:28:46.188 INFO:tasks.workunit.client.0.smithi046.stdout:5/249: readlink d9/da/d18/l30 0 2024-04-26T12:28:46.188 INFO:tasks.workunit.client.0.smithi046.stdout:8/254: dwrite d7/da/df/f10 [0,4194304] 0 2024-04-26T12:28:46.188 INFO:tasks.workunit.client.0.smithi046.stdout:5/250: fsync d9/da/f20 0 2024-04-26T12:28:46.189 INFO:tasks.workunit.client.0.smithi046.stdout:8/255: readlink d7/d24/d50/d2a/d39/l4e 0 2024-04-26T12:28:46.189 INFO:tasks.workunit.client.0.smithi046.stdout:5/251: chown d9/da/dd/f13 1 1 2024-04-26T12:28:46.190 INFO:tasks.workunit.client.0.smithi046.stdout:5/252: write f2 [3849202,9850] 0 2024-04-26T12:28:46.190 INFO:tasks.workunit.client.0.smithi046.stdout:8/256: write d7/d24/d50/d2a/d39/f48 [1093525,2363] 0 2024-04-26T12:28:46.190 INFO:tasks.workunit.client.0.smithi046.stdout:7/267: truncate d16/d1c/f2a 4969948 0 2024-04-26T12:28:46.190 INFO:tasks.workunit.client.0.smithi046.stdout:7/268: read - d16/d1a/f53 zero size 2024-04-26T12:28:46.191 INFO:tasks.workunit.client.0.smithi046.stdout:5/253: write d9/da/f4b [1032924,58981] 0 2024-04-26T12:28:46.192 INFO:tasks.workunit.client.0.smithi046.stdout:8/257: truncate d7/da/df/f4d 213429 0 2024-04-26T12:28:46.192 INFO:tasks.workunit.client.0.smithi046.stdout:7/269: mkdir d16/d1a/d3e/d59 0 2024-04-26T12:28:46.193 INFO:tasks.workunit.client.0.smithi046.stdout:5/254: rename d9/da/dd/d34/d3e/d3f/l4e to d9/da/d18/l54 0 2024-04-26T12:28:46.194 INFO:tasks.workunit.client.0.smithi046.stdout:1/191: dread d7/d14/d1c/f30 [0,4194304] 0 2024-04-26T12:28:46.194 INFO:tasks.workunit.client.0.smithi046.stdout:5/255: symlink d9/l55 0 2024-04-26T12:28:46.194 INFO:tasks.workunit.client.0.smithi046.stdout:1/192: creat d7/d9/d2b/f40 x:0 0 0 2024-04-26T12:28:46.195 INFO:tasks.workunit.client.0.smithi046.stdout:5/256: creat d9/da/dd/d34/d45/f56 x:0 0 0 2024-04-26T12:28:46.195 INFO:tasks.workunit.client.0.smithi046.stdout:1/193: mkdir d7/d14/d1c/d32/d41 0 2024-04-26T12:28:46.196 INFO:tasks.workunit.client.0.smithi046.stdout:5/257: write d9/f2c [276484,63053] 0 2024-04-26T12:28:46.196 INFO:tasks.workunit.client.0.smithi046.stdout:1/194: symlink d7/d14/d1c/d32/l42 0 2024-04-26T12:28:46.197 INFO:tasks.workunit.client.0.smithi046.stdout:1/195: getdents d7/d38 0 2024-04-26T12:28:46.197 INFO:tasks.workunit.client.0.smithi046.stdout:1/196: creat d7/d12/d3a/f43 x:0 0 0 2024-04-26T12:28:46.198 INFO:tasks.workunit.client.0.smithi046.stdout:8/258: dread d7/d1c/f2d [0,4194304] 0 2024-04-26T12:28:46.198 INFO:tasks.workunit.client.0.smithi046.stdout:9/169: sync 2024-04-26T12:28:46.198 INFO:tasks.workunit.client.0.smithi046.stdout:1/197: mkdir d7/d12/d44 0 2024-04-26T12:28:46.199 INFO:tasks.workunit.client.0.smithi046.stdout:9/170: readlink d0/d6/l1e 0 2024-04-26T12:28:46.199 INFO:tasks.workunit.client.0.smithi046.stdout:9/171: symlink d0/d6/l39 0 2024-04-26T12:28:46.199 INFO:tasks.workunit.client.0.smithi046.stdout:1/198: link d7/d12/c13 d7/d12/d44/c45 0 2024-04-26T12:28:46.200 INFO:tasks.workunit.client.0.smithi046.stdout:9/172: read d0/f24 [2079200,1135] 0 2024-04-26T12:28:46.200 INFO:tasks.workunit.client.0.smithi046.stdout:1/199: write d7/d14/f19 [4316959,42525] 0 2024-04-26T12:28:46.201 INFO:tasks.workunit.client.0.smithi046.stdout:9/173: symlink d0/d2c/l3a 0 2024-04-26T12:28:46.201 INFO:tasks.workunit.client.0.smithi046.stdout:1/200: mknod d7/d9/d2b/d31/c46 0 2024-04-26T12:28:46.201 INFO:tasks.workunit.client.0.smithi046.stdout:7/270: rename d16/d1c to d16/d1a/d31/d5a 0 2024-04-26T12:28:46.201 INFO:tasks.workunit.client.0.smithi046.stdout:9/174: fsync d0/f5 0 2024-04-26T12:28:46.202 INFO:tasks.workunit.client.0.smithi046.stdout:1/201: dread - d7/d9/d2b/f40 zero size 2024-04-26T12:28:46.202 INFO:tasks.workunit.client.0.smithi046.stdout:7/271: creat d16/d1a/d31/d5a/f5b x:0 0 0 2024-04-26T12:28:46.202 INFO:tasks.workunit.client.0.smithi046.stdout:5/258: write d9/da/dd/f36 [684584,14578] 0 2024-04-26T12:28:46.203 INFO:tasks.workunit.client.0.smithi046.stdout:1/202: mknod d7/db/c47 0 2024-04-26T12:28:46.203 INFO:tasks.workunit.client.0.smithi046.stdout:7/272: write d16/d4e/f52 [572493,2485] 0 2024-04-26T12:28:46.204 INFO:tasks.workunit.client.0.smithi046.stdout:7/273: write f4 [4158994,33774] 0 2024-04-26T12:28:46.204 INFO:tasks.workunit.client.0.smithi046.stdout:7/274: write f4 [128507,75454] 0 2024-04-26T12:28:46.205 INFO:tasks.workunit.client.0.smithi046.stdout:4/232: dread d0/d1/d5/f11 [0,4194304] 0 2024-04-26T12:28:46.206 INFO:tasks.workunit.client.0.smithi046.stdout:8/259: truncate d7/d24/d50/f34 2022145 0 2024-04-26T12:28:46.206 INFO:tasks.workunit.client.0.smithi046.stdout:4/233: creat d0/d41/d3f/f4c x:0 0 0 2024-04-26T12:28:46.207 INFO:tasks.workunit.client.0.smithi046.stdout:8/260: mkdir d7/d24/d50/d2a/d39/d52 0 2024-04-26T12:28:46.207 INFO:tasks.workunit.client.0.smithi046.stdout:4/234: mkdir d0/d4d 0 2024-04-26T12:28:46.208 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:46.206+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:46.208 INFO:tasks.workunit.client.0.smithi046.stdout:4/235: chown d0/d41/d3f/f4c 111685837 1 2024-04-26T12:28:46.209 INFO:tasks.workunit.client.0.smithi046.stdout:8/261: fdatasync d7/d24/d50/f34 0 2024-04-26T12:28:46.209 INFO:tasks.workunit.client.0.smithi046.stdout:4/236: stat d0/da 0 2024-04-26T12:28:46.209 INFO:tasks.workunit.client.0.smithi046.stdout:7/275: dwrite f5 [0,4194304] 0 2024-04-26T12:28:46.209 INFO:tasks.workunit.client.0.smithi046.stdout:4/237: rmdir d0/d41 39 2024-04-26T12:28:46.210 INFO:tasks.workunit.client.0.smithi046.stdout:4/238: fsync d0/da/d17/d20/f39 0 2024-04-26T12:28:46.215 INFO:tasks.workunit.client.0.smithi046.stdout:7/276: unlink d16/d1a/d31/d5a/f24 0 2024-04-26T12:28:46.215 INFO:tasks.workunit.client.0.smithi046.stdout:8/262: getdents d7/d24/d50 0 2024-04-26T12:28:46.215 INFO:tasks.workunit.client.0.smithi046.stdout:4/239: rmdir d0/d1 39 2024-04-26T12:28:46.215 INFO:tasks.workunit.client.0.smithi046.stdout:4/240: write d0/f14 [1142481,10051] 0 2024-04-26T12:28:46.216 INFO:tasks.workunit.client.0.smithi046.stdout:7/277: write d16/d1a/d31/f39 [827863,117921] 0 2024-04-26T12:28:46.216 INFO:tasks.workunit.client.0.smithi046.stdout:8/263: rename d7/dc/d27/f51 to d7/d24/f53 0 2024-04-26T12:28:46.216 INFO:tasks.workunit.client.0.smithi046.stdout:7/278: stat d16/d1a/c41 0 2024-04-26T12:28:46.216 INFO:tasks.workunit.client.0.smithi046.stdout:8/264: readlink d7/d24/l26 0 2024-04-26T12:28:46.216 INFO:tasks.workunit.client.0.smithi046.stdout:7/279: rename d16/d1a to d16/d1a/d31/d5a/d5c 22 2024-04-26T12:28:46.217 INFO:tasks.workunit.client.0.smithi046.stdout:1/203: dwrite d7/d9/f18 [0,4194304] 0 2024-04-26T12:28:46.217 INFO:tasks.workunit.client.0.smithi046.stdout:7/280: dwrite d16/d35/f3b [0,4194304] 0 2024-04-26T12:28:46.218 INFO:tasks.workunit.client.0.smithi046.stdout:7/281: truncate d16/d1a/f2b 1429214 0 2024-04-26T12:28:46.218 INFO:tasks.workunit.client.0.smithi046.stdout:1/204: creat d7/d14/d1c/f48 x:0 0 0 2024-04-26T12:28:46.219 INFO:tasks.workunit.client.0.smithi046.stdout:4/241: rmdir d0/d41/d3f 39 2024-04-26T12:28:46.220 INFO:tasks.workunit.client.0.smithi046.stdout:4/242: write d0/f14 [1173939,65558] 0 2024-04-26T12:28:46.220 INFO:tasks.workunit.client.0.smithi046.stdout:4/243: chown d0 2157 1 2024-04-26T12:28:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:5/259: dread d9/da/d18/f42 [0,4194304] 0 2024-04-26T12:28:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:4/244: rmdir d0/d1/d9 39 2024-04-26T12:28:46.223 INFO:tasks.workunit.client.0.smithi046.stdout:4/245: link d0/d41/c31 d0/d1/d12/c4e 0 2024-04-26T12:28:46.223 INFO:tasks.workunit.client.0.smithi046.stdout:7/282: dread d16/d3f/f47 [0,4194304] 0 2024-04-26T12:28:46.223 INFO:tasks.workunit.client.0.smithi046.stdout:4/246: fsync d0/d1/d12/f47 0 2024-04-26T12:28:46.227 INFO:tasks.workunit.client.0.smithi046.stdout:4/247: read - d0/da/d17/f46 zero size 2024-04-26T12:28:46.228 INFO:tasks.workunit.client.0.smithi046.stdout:7/283: read d16/d1a/d31/f39 [122068,108016] 0 2024-04-26T12:28:46.228 INFO:tasks.workunit.client.0.smithi046.stdout:9/175: dread d0/f10 [0,4194304] 0 2024-04-26T12:28:46.230 INFO:tasks.workunit.client.0.smithi046.stdout:5/260: dwrite d9/da/d15/f1a [0,4194304] 0 2024-04-26T12:28:46.231 INFO:tasks.workunit.client.0.smithi046.stdout:7/284: dread d16/d1a/d31/d5a/f3d [0,4194304] 0 2024-04-26T12:28:46.231 INFO:tasks.workunit.client.0.smithi046.stdout:7/285: write d16/d35/f3a [112908,6514] 0 2024-04-26T12:28:46.233 INFO:tasks.workunit.client.0.smithi046.stdout:1/205: dread d7/d14/f23 [0,4194304] 0 2024-04-26T12:28:46.240 INFO:tasks.workunit.client.0.smithi046.stdout:5/261: mknod d9/da/dd/d34/d3e/d3f/c57 0 2024-04-26T12:28:46.240 INFO:tasks.workunit.client.0.smithi046.stdout:1/206: mkdir d7/d12/d3a/d49 0 2024-04-26T12:28:46.241 INFO:tasks.workunit.client.0.smithi046.stdout:4/248: mknod d0/d1/d9/d19/c4f 0 2024-04-26T12:28:46.241 INFO:tasks.workunit.client.0.smithi046.stdout:5/262: chown d9/da/f10 110262 1 2024-04-26T12:28:46.241 INFO:tasks.workunit.client.0.smithi046.stdout:5/263: stat d9/da/d18/f39 0 2024-04-26T12:28:46.243 INFO:tasks.workunit.client.0.smithi046.stdout:4/249: rename d0/d41/d3f/f4c to d0/d1/d9/d19/f50 0 2024-04-26T12:28:46.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/207: link d7/db/f10 d7/d12/d3a/f4a 0 2024-04-26T12:28:46.245 INFO:tasks.workunit.client.0.smithi046.stdout:4/250: mkdir d0/d1/d9/d51 0 2024-04-26T12:28:46.245 INFO:tasks.workunit.client.0.smithi046.stdout:1/208: write d7/d12/f36 [889770,11614] 0 2024-04-26T12:28:46.245 INFO:tasks.workunit.client.0.smithi046.stdout:7/286: dwrite d16/d1a/f53 [0,4194304] 0 2024-04-26T12:28:46.246 INFO:tasks.workunit.client.0.smithi046.stdout:7/287: chown l1 5655 1 2024-04-26T12:28:46.247 INFO:tasks.workunit.client.0.smithi046.stdout:4/251: creat d0/f52 x:0 0 0 2024-04-26T12:28:46.247 INFO:tasks.workunit.client.0.smithi046.stdout:1/209: write d7/db/f10 [3529192,63947] 0 2024-04-26T12:28:46.247 INFO:tasks.workunit.client.0.smithi046.stdout:5/264: dwrite d9/da/d18/f2d [0,4194304] 0 2024-04-26T12:28:46.247 INFO:tasks.workunit.client.0.smithi046.stdout:1/210: dread - d7/d12/f22 zero size 2024-04-26T12:28:46.248 INFO:tasks.workunit.client.0.smithi046.stdout:7/288: link d16/d1a/f53 d16/d35/f5d 0 2024-04-26T12:28:46.248 INFO:tasks.workunit.client.0.smithi046.stdout:1/211: fdatasync d7/d12/f22 0 2024-04-26T12:28:46.249 INFO:tasks.workunit.client.0.smithi046.stdout:4/252: truncate d0/d1/d9/d19/f4a 229731 0 2024-04-26T12:28:46.249 INFO:tasks.workunit.client.0.smithi046.stdout:5/265: symlink d9/da/l58 0 2024-04-26T12:28:46.249 INFO:tasks.workunit.client.0.smithi046.stdout:7/289: rename d16/d4e to d16/d4e/d5e 22 2024-04-26T12:28:46.249 INFO:tasks.workunit.client.0.smithi046.stdout:5/266: stat d9/da/d15/l1f 0 2024-04-26T12:28:46.249 INFO:tasks.workunit.client.0.smithi046.stdout:4/253: mkdir d0/d1/d9/d19/d53 0 2024-04-26T12:28:46.250 INFO:tasks.workunit.client.0.smithi046.stdout:7/290: write d16/d4e/f52 [1411372,115282] 0 2024-04-26T12:28:46.250 INFO:tasks.workunit.client.0.smithi046.stdout:5/267: unlink d9/f2c 0 2024-04-26T12:28:46.250 INFO:tasks.workunit.client.0.smithi046.stdout:1/212: symlink d7/d14/d1c/d32/d41/l4b 0 2024-04-26T12:28:46.250 INFO:tasks.workunit.client.0.smithi046.stdout:7/291: creat d16/d1a/d31/d4d/f5f x:0 0 0 2024-04-26T12:28:46.251 INFO:tasks.workunit.client.0.smithi046.stdout:2/250: sync 2024-04-26T12:28:46.251 INFO:tasks.workunit.client.0.smithi046.stdout:0/268: sync 2024-04-26T12:28:46.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/295: sync 2024-04-26T12:28:46.252 INFO:tasks.workunit.client.0.smithi046.stdout:8/265: sync 2024-04-26T12:28:46.252 INFO:tasks.workunit.client.0.smithi046.stdout:5/268: getdents d9/da/d3b/d35 0 2024-04-26T12:28:46.252 INFO:tasks.workunit.client.0.smithi046.stdout:1/213: mknod d7/d9/d2b/d39/d3c/c4c 0 2024-04-26T12:28:46.253 INFO:tasks.workunit.client.0.smithi046.stdout:4/254: rename d0/da/d17/d20/d25/c3e to d0/da/d17/d20/c54 0 2024-04-26T12:28:46.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/266: mkdir d7/d24/d50/d2a/d54 0 2024-04-26T12:28:46.254 INFO:tasks.workunit.client.0.smithi046.stdout:6/296: mknod d7/d51/c67 0 2024-04-26T12:28:46.254 INFO:tasks.workunit.client.0.smithi046.stdout:1/214: fsync d7/d9/fa 0 2024-04-26T12:28:46.255 INFO:tasks.workunit.client.0.smithi046.stdout:5/269: link c7 d9/c59 0 2024-04-26T12:28:46.257 INFO:tasks.workunit.client.0.smithi046.stdout:7/292: dwrite d16/d1a/d31/d5a/f3d [0,4194304] 0 2024-04-26T12:28:46.257 INFO:tasks.workunit.client.0.smithi046.stdout:0/269: dwrite d9/dc/f37 [0,4194304] 0 2024-04-26T12:28:46.259 INFO:tasks.workunit.client.0.smithi046.stdout:2/251: truncate d1/de/d15/d18/f2c 4519597 0 2024-04-26T12:28:46.259 INFO:tasks.workunit.client.0.smithi046.stdout:1/215: symlink d7/d12/d3a/l4d 0 2024-04-26T12:28:46.259 INFO:tasks.workunit.client.0.smithi046.stdout:4/255: rename d0/d4d to d0/d1/d9/d19/d55 0 2024-04-26T12:28:46.263 INFO:tasks.workunit.client.0.smithi046.stdout:0/270: chown d9/dc/dd/d45/f49 8006281 1 2024-04-26T12:28:46.264 INFO:tasks.workunit.client.0.smithi046.stdout:0/271: chown d9/dc/lf 517 1 2024-04-26T12:28:46.264 INFO:tasks.workunit.client.0.smithi046.stdout:0/272: chown d9/l16 2295264 1 2024-04-26T12:28:46.265 INFO:tasks.workunit.client.0.smithi046.stdout:1/216: unlink d7/d12/f27 0 2024-04-26T12:28:46.266 INFO:tasks.workunit.client.0.smithi046.stdout:2/252: creat d1/d42/f54 x:0 0 0 2024-04-26T12:28:46.266 INFO:tasks.workunit.client.0.smithi046.stdout:4/256: mknod d0/d1/d9/d19/c56 0 2024-04-26T12:28:46.266 INFO:tasks.workunit.client.0.smithi046.stdout:7/293: rename d16/f2d to d16/d1a/d31/d5a/f60 0 2024-04-26T12:28:46.270 INFO:tasks.workunit.client.0.smithi046.stdout:3/310: sync 2024-04-26T12:28:46.271 INFO:tasks.workunit.client.0.smithi046.stdout:0/273: dwrite d9/dc/dd/f25 [0,4194304] 0 2024-04-26T12:28:46.272 INFO:tasks.workunit.client.0.smithi046.stdout:7/294: dwrite f5 [0,4194304] 0 2024-04-26T12:28:46.272 INFO:tasks.workunit.client.0.smithi046.stdout:1/217: dwrite d7/d14/d1c/f48 [0,4194304] 0 2024-04-26T12:28:46.274 INFO:tasks.workunit.client.0.smithi046.stdout:7/295: chown d16/d1a/l58 1 1 2024-04-26T12:28:46.274 INFO:tasks.workunit.client.0.smithi046.stdout:1/218: write d7/d9/fa [749132,111422] 0 2024-04-26T12:28:46.274 INFO:tasks.workunit.client.0.smithi046.stdout:8/267: link d7/da/df/f35 d7/f55 0 2024-04-26T12:28:46.281 INFO:tasks.workunit.client.0.smithi046.stdout:6/297: write d7/fa [72826,73557] 0 2024-04-26T12:28:46.282 INFO:tasks.workunit.client.0.smithi046.stdout:3/311: mkdir d2/d16/d2c/d50/d71 0 2024-04-26T12:28:46.282 INFO:tasks.workunit.client.0.smithi046.stdout:0/274: creat d9/d1d/d40/d41/d43/f5b x:0 0 0 2024-04-26T12:28:46.282 INFO:tasks.workunit.client.0.smithi046.stdout:1/219: fsync d7/d9/f11 0 2024-04-26T12:28:46.282 INFO:tasks.workunit.client.0.smithi046.stdout:5/270: creat d9/da/dd/d34/f5a x:0 0 0 2024-04-26T12:28:46.282 INFO:tasks.workunit.client.0.smithi046.stdout:7/296: rename l13 to d16/d27/d51/l61 0 2024-04-26T12:28:46.283 INFO:tasks.workunit.client.0.smithi046.stdout:6/298: stat d7/d1b/d37/f3b 0 2024-04-26T12:28:46.283 INFO:tasks.workunit.client.0.smithi046.stdout:8/268: chown d7/da/l3e 191 1 2024-04-26T12:28:46.283 INFO:tasks.workunit.client.0.smithi046.stdout:2/253: truncate d1/de/f27 512101 0 2024-04-26T12:28:46.283 INFO:tasks.workunit.client.0.smithi046.stdout:4/257: getdents d0/da 0 2024-04-26T12:28:46.284 INFO:tasks.workunit.client.0.smithi046.stdout:3/312: write d2/db/f15 [773491,26080] 0 2024-04-26T12:28:46.284 INFO:tasks.workunit.client.0.smithi046.stdout:6/299: symlink d7/d1b/l68 0 2024-04-26T12:28:46.284 INFO:tasks.workunit.client.0.smithi046.stdout:1/220: write d7/d14/f2f [435539,53910] 0 2024-04-26T12:28:46.284 INFO:tasks.workunit.client.0.smithi046.stdout:5/271: symlink d9/da/d3b/l5b 0 2024-04-26T12:28:46.284 INFO:tasks.workunit.client.0.smithi046.stdout:2/254: symlink d1/de/d15/d18/l55 0 2024-04-26T12:28:46.285 INFO:tasks.workunit.client.0.smithi046.stdout:9/176: dwrite d0/d6/f23 [0,4194304] 0 2024-04-26T12:28:46.285 INFO:tasks.workunit.client.0.smithi046.stdout:1/221: read d7/d14/f23 [739051,49037] 0 2024-04-26T12:28:46.286 INFO:tasks.workunit.client.0.smithi046.stdout:7/297: write d16/d1a/f53 [3286521,43383] 0 2024-04-26T12:28:46.287 INFO:tasks.workunit.client.0.smithi046.stdout:1/222: creat d7/d14/f4e x:0 0 0 2024-04-26T12:28:46.288 INFO:tasks.workunit.client.0.smithi046.stdout:7/298: fdatasync d16/d1a/d31/d5a/f60 0 2024-04-26T12:28:46.288 INFO:tasks.workunit.client.0.smithi046.stdout:6/300: rename d7/d51/l55 to d7/d1b/d47/d65/l69 0 2024-04-26T12:28:46.289 INFO:tasks.workunit.client.0.smithi046.stdout:5/272: link d9/da/d15/f48 d9/da/f5c 0 2024-04-26T12:28:46.289 INFO:tasks.workunit.client.0.smithi046.stdout:1/223: chown d7/d12/f36 637554137 1 2024-04-26T12:28:46.290 INFO:tasks.workunit.client.0.smithi046.stdout:4/258: truncate d0/d1/d29/f34 668403 0 2024-04-26T12:28:46.290 INFO:tasks.workunit.client.0.smithi046.stdout:6/301: truncate d7/d1b/f24 414682 0 2024-04-26T12:28:46.291 INFO:tasks.workunit.client.0.smithi046.stdout:8/269: dread d7/da/df/f4d [0,4194304] 0 2024-04-26T12:28:46.291 INFO:tasks.workunit.client.0.smithi046.stdout:5/273: mkdir d9/da/dd/d5d 0 2024-04-26T12:28:46.291 INFO:tasks.workunit.client.0.smithi046.stdout:7/299: truncate d16/d1a/d31/d4d/f5f 383455 0 2024-04-26T12:28:46.291 INFO:tasks.workunit.client.0.smithi046.stdout:0/275: dread d9/d1d/d40/d41/d43/f4f [0,4194304] 0 2024-04-26T12:28:46.293 INFO:tasks.workunit.client.0.smithi046.stdout:3/313: dwrite d2/db/d4a/f40 [0,4194304] 0 2024-04-26T12:28:46.293 INFO:tasks.workunit.client.0.smithi046.stdout:8/270: mkdir d7/d24/d56 0 2024-04-26T12:28:46.293 INFO:tasks.workunit.client.0.smithi046.stdout:4/259: write d0/d1/f3b [95097,62881] 0 2024-04-26T12:28:46.293 INFO:tasks.workunit.client.0.smithi046.stdout:7/300: write d16/d4e/f52 [2373664,69784] 0 2024-04-26T12:28:46.293 INFO:tasks.workunit.client.0.smithi046.stdout:0/276: write d9/dc/f1c [3268768,84370] 0 2024-04-26T12:28:46.294 INFO:tasks.workunit.client.0.smithi046.stdout:6/302: truncate d7/d16/f1c 103345 0 2024-04-26T12:28:46.294 INFO:tasks.workunit.client.0.smithi046.stdout:3/314: symlink d2/d16/d2c/d50/l72 0 2024-04-26T12:28:46.294 INFO:tasks.workunit.client.0.smithi046.stdout:4/260: fdatasync d0/d1/f15 0 2024-04-26T12:28:46.295 INFO:tasks.workunit.client.0.smithi046.stdout:0/277: read - d9/d1d/d40/d41/f54 zero size 2024-04-26T12:28:46.295 INFO:tasks.workunit.client.0.smithi046.stdout:7/301: mkdir d16/d1a/d31/d62 0 2024-04-26T12:28:46.296 INFO:tasks.workunit.client.0.smithi046.stdout:8/271: fsync d7/da/df/f2e 0 2024-04-26T12:28:46.296 INFO:tasks.workunit.client.0.smithi046.stdout:2/255: dwrite d1/de/d2b/f50 [0,4194304] 0 2024-04-26T12:28:46.296 INFO:tasks.workunit.client.0.smithi046.stdout:6/303: fsync d7/d2b/d31/f35 0 2024-04-26T12:28:46.296 INFO:tasks.workunit.client.0.smithi046.stdout:5/274: getdents d9/da/dd/d34/d3e 0 2024-04-26T12:28:46.297 INFO:tasks.workunit.client.0.smithi046.stdout:7/302: creat d16/d27/d51/f63 x:0 0 0 2024-04-26T12:28:46.297 INFO:tasks.workunit.client.0.smithi046.stdout:8/272: creat d7/d24/d50/d2a/f57 x:0 0 0 2024-04-26T12:28:46.298 INFO:tasks.workunit.client.0.smithi046.stdout:8/273: truncate d7/f55 816699 0 2024-04-26T12:28:46.298 INFO:tasks.workunit.client.0.smithi046.stdout:4/261: dread d0/da/d17/d20/d25/d35/f49 [0,4194304] 0 2024-04-26T12:28:46.298 INFO:tasks.workunit.client.0.smithi046.stdout:3/315: creat d2/d16/f73 x:0 0 0 2024-04-26T12:28:46.298 INFO:tasks.workunit.client.0.smithi046.stdout:0/278: symlink d9/d1d/d40/d41/l5c 0 2024-04-26T12:28:46.298 INFO:tasks.workunit.client.0.smithi046.stdout:7/303: mknod d16/d35/c64 0 2024-04-26T12:28:46.300 INFO:tasks.workunit.client.0.smithi046.stdout:7/304: truncate d16/f23 1504813 0 2024-04-26T12:28:46.300 INFO:tasks.workunit.client.0.smithi046.stdout:8/274: truncate d7/da/df/f3f 986234 0 2024-04-26T12:28:46.300 INFO:tasks.workunit.client.0.smithi046.stdout:6/304: rmdir d7 39 2024-04-26T12:28:46.300 INFO:tasks.workunit.client.0.smithi046.stdout:5/275: creat d9/da/dd/d34/d45/f5e x:0 0 0 2024-04-26T12:28:46.301 INFO:tasks.workunit.client.0.smithi046.stdout:2/256: creat d1/d13/f56 x:0 0 0 2024-04-26T12:28:46.301 INFO:tasks.workunit.client.0.smithi046.stdout:0/279: mkdir d9/d1d/d5d 0 2024-04-26T12:28:46.301 INFO:tasks.workunit.client.0.smithi046.stdout:3/316: mkdir d2/d16/d11/d1f/d74 0 2024-04-26T12:28:46.302 INFO:tasks.workunit.client.0.smithi046.stdout:5/276: rename d9/da/dd/d34/d45/f5e to d9/da/dd/d5d/f5f 0 2024-04-26T12:28:46.302 INFO:tasks.workunit.client.0.smithi046.stdout:6/305: chown d7/d2b/d31 230744 1 2024-04-26T12:28:46.304 INFO:tasks.workunit.client.0.smithi046.stdout:6/306: rename d7/d51 to d7/d1b/d6a 0 2024-04-26T12:28:46.304 INFO:tasks.workunit.client.0.smithi046.stdout:3/317: creat d2/d16/d11/f75 x:0 0 0 2024-04-26T12:28:46.304 INFO:tasks.workunit.client.0.smithi046.stdout:4/262: dwrite d0/f52 [0,4194304] 0 2024-04-26T12:28:46.304 INFO:tasks.workunit.client.0.smithi046.stdout:2/257: truncate d1/de/d2b/f37 3416201 0 2024-04-26T12:28:46.305 INFO:tasks.workunit.client.0.smithi046.stdout:5/277: rename d9/da/dd/d34/f5a to d9/da/dd/f60 0 2024-04-26T12:28:46.306 INFO:tasks.workunit.client.0.smithi046.stdout:2/258: rmdir d1/de/d15/d18 39 2024-04-26T12:28:46.306 INFO:tasks.workunit.client.0.smithi046.stdout:3/318: rename d2/d16/d11/d1f/l47 to d2/d16/d11/d1f/l76 0 2024-04-26T12:28:46.307 INFO:tasks.workunit.client.0.smithi046.stdout:5/278: chown d9/da/d15/c37 29723 1 2024-04-26T12:28:46.307 INFO:tasks.workunit.client.0.smithi046.stdout:2/259: creat d1/de/d15/d18/f57 x:0 0 0 2024-04-26T12:28:46.308 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:46.306+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:46.308 INFO:tasks.workunit.client.0.smithi046.stdout:5/279: mknod d9/da/d40/c61 0 2024-04-26T12:28:46.309 INFO:tasks.workunit.client.0.smithi046.stdout:5/280: read d9/da/d15/f1a [2394244,78205] 0 2024-04-26T12:28:46.310 INFO:tasks.workunit.client.0.smithi046.stdout:3/319: rename d2/d16/d11/d23/c65 to d2/d16/d11/d1f/c77 0 2024-04-26T12:28:46.310 INFO:tasks.workunit.client.0.smithi046.stdout:2/260: write d1/de/d2b/f50 [1215138,103630] 0 2024-04-26T12:28:46.311 INFO:tasks.workunit.client.0.smithi046.stdout:3/320: fsync d2/d16/d35/f66 0 2024-04-26T12:28:46.311 INFO:tasks.workunit.client.0.smithi046.stdout:4/263: dwrite d0/d1/d12/f4b [0,4194304] 0 2024-04-26T12:28:46.312 INFO:tasks.workunit.client.0.smithi046.stdout:2/261: mkdir d1/d13/d4a/d58 0 2024-04-26T12:28:46.312 INFO:tasks.workunit.client.0.smithi046.stdout:4/264: unlink d0/d1/d9/d19/c56 0 2024-04-26T12:28:46.313 INFO:tasks.workunit.client.0.smithi046.stdout:3/321: getdents d2/d16/d11/d6d 0 2024-04-26T12:28:46.313 INFO:tasks.workunit.client.0.smithi046.stdout:4/265: mknod d0/d1/d9/d19/c57 0 2024-04-26T12:28:46.313 INFO:tasks.workunit.client.0.smithi046.stdout:5/281: dread d9/da/d18/f42 [0,4194304] 0 2024-04-26T12:28:46.315 INFO:tasks.workunit.client.0.smithi046.stdout:3/322: creat d2/d16/f78 x:0 0 0 2024-04-26T12:28:46.315 INFO:tasks.workunit.client.0.smithi046.stdout:4/266: symlink d0/d1/d9/d19/d55/l58 0 2024-04-26T12:28:46.316 INFO:tasks.workunit.client.0.smithi046.stdout:3/323: chown d2/d16/d11/d1f/d74 18 1 2024-04-26T12:28:46.316 INFO:tasks.workunit.client.0.smithi046.stdout:9/177: sync 2024-04-26T12:28:46.316 INFO:tasks.workunit.client.0.smithi046.stdout:4/267: write d0/d1/d9/f13 [307458,126853] 0 2024-04-26T12:28:46.316 INFO:tasks.workunit.client.0.smithi046.stdout:8/275: sync 2024-04-26T12:28:46.317 INFO:tasks.workunit.client.0.smithi046.stdout:9/178: write d0/d29/f2a [2540081,95759] 0 2024-04-26T12:28:46.318 INFO:tasks.workunit.client.0.smithi046.stdout:4/268: creat d0/d1/d12/f59 x:0 0 0 2024-04-26T12:28:46.319 INFO:tasks.workunit.client.0.smithi046.stdout:2/262: dread d1/f4 [4194304,4194304] 0 2024-04-26T12:28:46.319 INFO:tasks.workunit.client.0.smithi046.stdout:8/276: rename d7/dc/c3b to d7/dc/c58 0 2024-04-26T12:28:46.319 INFO:tasks.workunit.client.0.smithi046.stdout:9/179: creat d0/d29/f3b x:0 0 0 2024-04-26T12:28:46.319 INFO:tasks.workunit.client.0.smithi046.stdout:4/269: rmdir d0/d1 39 2024-04-26T12:28:46.321 INFO:tasks.workunit.client.0.smithi046.stdout:4/270: chown d0/da/d21 460 1 2024-04-26T12:28:46.322 INFO:tasks.workunit.client.0.smithi046.stdout:1/224: dread d7/d9/fa [0,4194304] 0 2024-04-26T12:28:46.322 INFO:tasks.workunit.client.0.smithi046.stdout:2/263: unlink d1/de/d2b/l39 0 2024-04-26T12:28:46.322 INFO:tasks.workunit.client.0.smithi046.stdout:5/282: dwrite d9/f29 [0,4194304] 0 2024-04-26T12:28:46.322 INFO:tasks.workunit.client.0.smithi046.stdout:0/280: dread d9/f10 [0,4194304] 0 2024-04-26T12:28:46.323 INFO:tasks.workunit.client.0.smithi046.stdout:9/180: read d0/f15 [443348,97393] 0 2024-04-26T12:28:46.324 INFO:tasks.workunit.client.0.smithi046.stdout:4/271: mknod d0/da/d17/c5a 0 2024-04-26T12:28:46.324 INFO:tasks.workunit.client.0.smithi046.stdout:2/264: write d1/d13/f56 [353255,33658] 0 2024-04-26T12:28:46.325 INFO:tasks.workunit.client.0.smithi046.stdout:9/181: chown d0/d6/l39 2627 1 2024-04-26T12:28:46.325 INFO:tasks.workunit.client.0.smithi046.stdout:7/305: dread d16/d1a/d31/d5a/f60 [0,4194304] 0 2024-04-26T12:28:46.327 INFO:tasks.workunit.client.0.smithi046.stdout:3/324: dwrite d2/db/fe [0,4194304] 0 2024-04-26T12:28:46.327 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:46.327 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:46.327 INFO:tasks.workunit.client.0.smithi046.stdout:2/265: creat d1/d13/d4a/f59 x:0 0 0 2024-04-26T12:28:46.328 INFO:tasks.workunit.client.0.smithi046.stdout:8/277: truncate d7/da/df/f35 65973 0 2024-04-26T12:28:46.329 INFO:tasks.workunit.client.0.smithi046.stdout:1/225: dread d7/d9/f18 [0,4194304] 0 2024-04-26T12:28:46.329 INFO:tasks.workunit.client.0.smithi046.stdout:9/182: symlink d0/d19/d21/l3c 0 2024-04-26T12:28:46.329 INFO:tasks.workunit.client.0.smithi046.stdout:3/325: write d2/d16/f73 [816511,92955] 0 2024-04-26T12:28:46.330 INFO:tasks.workunit.client.0.smithi046.stdout:7/306: creat d16/d1a/d31/d55/f65 x:0 0 0 2024-04-26T12:28:46.331 INFO:tasks.workunit.client.0.smithi046.stdout:2/266: getdents d1/d13/d1b 0 2024-04-26T12:28:46.332 INFO:tasks.workunit.client.0.smithi046.stdout:8/278: mknod d7/d24/d56/c59 0 2024-04-26T12:28:46.332 INFO:tasks.workunit.client.0.smithi046.stdout:9/183: rmdir d0/d33 0 2024-04-26T12:28:46.333 INFO:tasks.workunit.client.0.smithi046.stdout:1/226: rename d7/d14/f23 to d7/d14/f4f 0 2024-04-26T12:28:46.333 INFO:tasks.workunit.client.0.smithi046.stdout:2/267: rmdir d1/d13/d1b/d38 39 2024-04-26T12:28:46.335 INFO:tasks.workunit.client.0.smithi046.stdout:8/279: write d7/f4a [340779,113968] 0 2024-04-26T12:28:46.335 INFO:tasks.workunit.client.0.smithi046.stdout:9/184: mkdir d0/d2c/d3d 0 2024-04-26T12:28:46.336 INFO:tasks.workunit.client.0.smithi046.stdout:0/281: dwrite d9/f17 [0,4194304] 0 2024-04-26T12:28:46.337 INFO:tasks.workunit.client.0.smithi046.stdout:0/282: chown d9/d1d 59 1 2024-04-26T12:28:46.337 INFO:tasks.workunit.client.0.smithi046.stdout:5/283: dwrite d9/da/dd/d34/d45/f53 [4194304,4194304] 0 2024-04-26T12:28:46.338 INFO:tasks.workunit.client.0.smithi046.stdout:6/307: dread d7/fe [0,4194304] 0 2024-04-26T12:28:46.339 INFO:tasks.workunit.client.0.smithi046.stdout:0/283: fsync f5 0 2024-04-26T12:28:46.339 INFO:tasks.workunit.client.0.smithi046.stdout:2/268: symlink d1/d13/l5a 0 2024-04-26T12:28:46.339 INFO:tasks.workunit.client.0.smithi046.stdout:3/326: write d2/d16/d35/f69 [1218789,92468] 0 2024-04-26T12:28:46.339 INFO:tasks.workunit.client.0.smithi046.stdout:4/272: dwrite d0/d1/d9/d19/f50 [0,4194304] 0 2024-04-26T12:28:46.339 INFO:tasks.workunit.client.0.smithi046.stdout:8/280: rmdir d7/d24/d50/d2a/d39 39 2024-04-26T12:28:46.340 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:46.341 INFO:tasks.workunit.client.0.smithi046.stdout:5/284: write d9/da/d18/f24 [2493530,95224] 0 2024-04-26T12:28:46.342 INFO:tasks.workunit.client.0.smithi046.stdout:7/307: dwrite d16/d1a/d31/d5a/f3d [0,4194304] 0 2024-04-26T12:28:46.342 INFO:tasks.workunit.client.0.smithi046.stdout:3/327: creat d2/d16/f79 x:0 0 0 2024-04-26T12:28:46.342 INFO:tasks.workunit.client.0.smithi046.stdout:0/284: rename d9/d1d/f4d to d9/d1d/d5d/f5e 0 2024-04-26T12:28:46.343 INFO:tasks.workunit.client.0.smithi046.stdout:5/285: chown d9/da/d15/c19 80275474 1 2024-04-26T12:28:46.344 INFO:tasks.workunit.client.0.smithi046.stdout:3/328: getdents d2/db/d62 0 2024-04-26T12:28:46.344 INFO:tasks.workunit.client.0.smithi046.stdout:0/285: rename d9/dc/c38 to d9/d1d/c5f 0 2024-04-26T12:28:46.345 INFO:tasks.workunit.client.0.smithi046.stdout:5/286: symlink d9/da/dd/l62 0 2024-04-26T12:28:46.345 INFO:tasks.workunit.client.0.smithi046.stdout:3/329: dread - d2/d16/d11/f75 zero size 2024-04-26T12:28:46.346 INFO:tasks.workunit.client.0.smithi046.stdout:9/185: dwrite d0/d6/f26 [4194304,4194304] 0 2024-04-26T12:28:46.346 INFO:tasks.workunit.client.0.smithi046.stdout:0/286: truncate d9/f3f 4251790 0 2024-04-26T12:28:46.347 INFO:tasks.workunit.client.0.smithi046.stdout:4/273: dread d0/f52 [0,4194304] 0 2024-04-26T12:28:46.347 INFO:tasks.workunit.client.0.smithi046.stdout:9/186: rmdir d0/d19/d21 39 2024-04-26T12:28:46.348 INFO:tasks.workunit.client.0.smithi046.stdout:0/287: rename d9/f17 to d9/dc/f60 0 2024-04-26T12:28:46.349 INFO:tasks.workunit.client.0.smithi046.stdout:9/187: rmdir d0/d19/d38 0 2024-04-26T12:28:46.349 INFO:tasks.workunit.client.0.smithi046.stdout:7/308: dwrite d16/d1a/d31/d5a/f60 [0,4194304] 0 2024-04-26T12:28:46.351 INFO:tasks.workunit.client.0.smithi046.stdout:0/288: creat d9/f61 x:0 0 0 2024-04-26T12:28:46.351 INFO:tasks.workunit.client.0.smithi046.stdout:7/309: mknod d16/c66 0 2024-04-26T12:28:46.351 INFO:tasks.workunit.client.0.smithi046.stdout:9/188: creat d0/d19/d21/f3e x:0 0 0 2024-04-26T12:28:46.352 INFO:tasks.workunit.client.0.smithi046.stdout:7/310: dread - d16/d1a/d31/f49 zero size 2024-04-26T12:28:46.352 INFO:tasks.workunit.client.0.smithi046.stdout:5/287: dread d9/da/d15/f1a [0,4194304] 0 2024-04-26T12:28:46.353 INFO:tasks.workunit.client.0.smithi046.stdout:9/189: chown d0/d19/d21/f3e 0 1 2024-04-26T12:28:46.353 INFO:tasks.workunit.client.0.smithi046.stdout:7/311: truncate d16/d27/f34 5207247 0 2024-04-26T12:28:46.353 INFO:tasks.workunit.client.0.smithi046.stdout:5/288: creat d9/da/dd/d34/d3e/d3f/f63 x:0 0 0 2024-04-26T12:28:46.358 INFO:tasks.workunit.client.0.smithi046.stdout:1/227: sync 2024-04-26T12:28:46.358 INFO:tasks.workunit.client.0.smithi046.stdout:0/289: dwrite d9/d1d/d40/d41/f54 [0,4194304] 0 2024-04-26T12:28:46.358 INFO:tasks.workunit.client.0.smithi046.stdout:8/281: sync 2024-04-26T12:28:46.358 INFO:tasks.workunit.client.0.smithi046.stdout:6/308: sync 2024-04-26T12:28:46.359 INFO:tasks.workunit.client.0.smithi046.stdout:5/289: dwrite d9/da/d18/f2d [0,4194304] 0 2024-04-26T12:28:46.359 INFO:tasks.workunit.client.0.smithi046.stdout:1/228: mknod d7/d14/c50 0 2024-04-26T12:28:46.359 INFO:tasks.workunit.client.0.smithi046.stdout:0/290: mkdir d9/dc/d4c/d62 0 2024-04-26T12:28:46.360 INFO:tasks.workunit.client.0.smithi046.stdout:0/291: chown d9/lb 693246 1 2024-04-26T12:28:46.360 INFO:tasks.workunit.client.0.smithi046.stdout:4/274: dread d0/d1/d9/d19/f4a [0,4194304] 0 2024-04-26T12:28:46.360 INFO:tasks.workunit.client.0.smithi046.stdout:8/282: mknod d7/da/d4f/c5a 0 2024-04-26T12:28:46.362 INFO:tasks.workunit.client.0.smithi046.stdout:6/309: unlink d7/d2b/d31/f34 0 2024-04-26T12:28:46.362 INFO:tasks.workunit.client.0.smithi046.stdout:4/275: read d0/f52 [2845350,14657] 0 2024-04-26T12:28:46.362 INFO:tasks.workunit.client.0.smithi046.stdout:6/310: dread - d7/d1b/d6a/f5f zero size 2024-04-26T12:28:46.362 INFO:tasks.workunit.client.0.smithi046.stdout:5/290: creat d9/da/dd/f64 x:0 0 0 2024-04-26T12:28:46.363 INFO:tasks.workunit.client.0.smithi046.stdout:4/276: write d0/da/d17/d20/f39 [2651349,5320] 0 2024-04-26T12:28:46.363 INFO:tasks.workunit.client.0.smithi046.stdout:8/283: mknod d7/d24/d50/d2a/d39/c5b 0 2024-04-26T12:28:46.363 INFO:tasks.workunit.client.0.smithi046.stdout:6/311: creat d7/d1b/d37/f6b x:0 0 0 2024-04-26T12:28:46.363 INFO:tasks.workunit.client.0.smithi046.stdout:5/291: mknod d9/c65 0 2024-04-26T12:28:46.364 INFO:tasks.workunit.client.0.smithi046.stdout:5/292: dread - d9/da/dd/f60 zero size 2024-04-26T12:28:46.364 INFO:tasks.workunit.client.0.smithi046.stdout:1/229: dwrite d7/d12/d3a/f4a [4194304,4194304] 0 2024-04-26T12:28:46.364 INFO:tasks.workunit.client.0.smithi046.stdout:4/277: creat d0/d1/d29/f5b x:0 0 0 2024-04-26T12:28:46.365 INFO:tasks.workunit.client.0.smithi046.stdout:1/230: write d7/d14/d1c/f3e [962914,36953] 0 2024-04-26T12:28:46.367 INFO:tasks.workunit.client.0.smithi046.stdout:6/312: dread d7/d16/f4a [0,4194304] 0 2024-04-26T12:28:46.368 INFO:tasks.workunit.client.0.smithi046.stdout:8/284: symlink d7/l5c 0 2024-04-26T12:28:46.369 INFO:tasks.workunit.client.0.smithi046.stdout:8/285: mknod d7/d24/d56/c5d 0 2024-04-26T12:28:46.369 INFO:tasks.workunit.client.0.smithi046.stdout:6/313: rename d7/d2b/d31/d4d/l5d to d7/d1b/d6a/l6c 0 2024-04-26T12:28:46.372 INFO:tasks.workunit.client.0.smithi046.stdout:5/293: dwrite d9/da/dd/d34/d3e/f47 [0,4194304] 0 2024-04-26T12:28:46.373 INFO:tasks.workunit.client.0.smithi046.stdout:5/294: rmdir d9/da/d3b/d35 39 2024-04-26T12:28:46.373 INFO:tasks.workunit.client.0.smithi046.stdout:7/312: dread d16/d35/f3a [0,4194304] 0 2024-04-26T12:28:46.374 INFO:tasks.workunit.client.0.smithi046.stdout:3/330: dread d2/d16/d2c/f54 [0,4194304] 0 2024-04-26T12:28:46.375 INFO:tasks.workunit.client.0.smithi046.stdout:7/313: creat d16/d27/d51/f67 x:0 0 0 2024-04-26T12:28:46.375 INFO:tasks.workunit.client.0.smithi046.stdout:6/314: dwrite d7/d2b/d31/f3f [0,4194304] 0 2024-04-26T12:28:46.377 INFO:tasks.workunit.client.0.smithi046.stdout:3/331: rename d2/d16/d11/d1f/c77 to d2/d16/d11/c7a 0 2024-04-26T12:28:46.377 INFO:tasks.workunit.client.0.smithi046.stdout:7/314: getdents d16 0 2024-04-26T12:28:46.380 INFO:tasks.workunit.client.0.smithi046.stdout:7/315: link d16/d3f/l46 d16/d1a/d31/d62/l68 0 2024-04-26T12:28:46.380 INFO:tasks.workunit.client.0.smithi046.stdout:3/332: link d2/d16/d35/c3f d2/d16/d11/d1b/d2d/c7b 0 2024-04-26T12:28:46.380 INFO:tasks.workunit.client.0.smithi046.stdout:6/315: dwrite d7/f15 [4194304,4194304] 0 2024-04-26T12:28:46.383 INFO:tasks.workunit.client.0.smithi046.stdout:7/316: fdatasync d16/d3f/f47 0 2024-04-26T12:28:46.383 INFO:tasks.workunit.client.0.smithi046.stdout:5/295: write d9/da/f28 [1127562,104135] 0 2024-04-26T12:28:46.383 INFO:tasks.workunit.client.0.smithi046.stdout:8/286: dwrite d7/d24/d50/f2c [0,4194304] 0 2024-04-26T12:28:46.383 INFO:tasks.workunit.client.0.smithi046.stdout:8/287: stat d7/d24/f49 0 2024-04-26T12:28:46.383 INFO:tasks.workunit.client.0.smithi046.stdout:7/317: dread - d16/d1a/d31/d5a/f50 zero size 2024-04-26T12:28:46.383 INFO:tasks.workunit.client.0.smithi046.stdout:3/333: truncate d2/db/f2b 802111 0 2024-04-26T12:28:46.383 INFO:tasks.workunit.client.0.smithi046.stdout:3/334: chown d2 1274 1 2024-04-26T12:28:46.383 INFO:tasks.workunit.client.0.smithi046.stdout:5/296: creat d9/da/dd/f66 x:0 0 0 2024-04-26T12:28:46.384 INFO:tasks.workunit.client.0.smithi046.stdout:0/292: sync 2024-04-26T12:28:46.384 INFO:tasks.workunit.client.0.smithi046.stdout:5/297: unlink d9/da/d15/f1a 0 2024-04-26T12:28:46.384 INFO:tasks.workunit.client.0.smithi046.stdout:0/293: chown d9/dc/dd/l44 164708 1 2024-04-26T12:28:46.386 INFO:tasks.workunit.client.0.smithi046.stdout:8/288: dread d7/d24/d50/f34 [0,4194304] 0 2024-04-26T12:28:46.386 INFO:tasks.workunit.client.0.smithi046.stdout:0/294: symlink d9/dc/dd/d45/l63 0 2024-04-26T12:28:46.387 INFO:tasks.workunit.client.0.smithi046.stdout:8/289: rename d7/dc/d1b/f3c to d7/da/df/f5e 0 2024-04-26T12:28:46.388 INFO:tasks.workunit.client.0.smithi046.stdout:7/318: truncate d16/d1a/f2b 326926 0 2024-04-26T12:28:46.389 INFO:tasks.workunit.client.0.smithi046.stdout:7/319: mkdir d16/d1a/d69 0 2024-04-26T12:28:46.389 INFO:tasks.workunit.client.0.smithi046.stdout:8/290: truncate d7/d24/d50/d2a/f42 280577 0 2024-04-26T12:28:46.389 INFO:tasks.workunit.client.0.smithi046.stdout:7/320: stat d16/d1a/d31/f39 0 2024-04-26T12:28:46.390 INFO:tasks.workunit.client.0.smithi046.stdout:7/321: write d16/d1a/d31/d5a/f50 [470616,17524] 0 2024-04-26T12:28:46.390 INFO:tasks.workunit.client.0.smithi046.stdout:8/291: link l3 d7/d24/d50/d2a/d54/l5f 0 2024-04-26T12:28:46.390 INFO:tasks.workunit.client.0.smithi046.stdout:6/316: sync 2024-04-26T12:28:46.391 INFO:tasks.workunit.client.0.smithi046.stdout:8/292: chown d7/d24/f49 1 1 2024-04-26T12:28:46.391 INFO:tasks.workunit.client.0.smithi046.stdout:7/322: chown d16/d1a/d31/d5a/f50 388561396 1 2024-04-26T12:28:46.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/317: creat d7/d2b/f6d x:0 0 0 2024-04-26T12:28:46.391 INFO:tasks.workunit.client.0.smithi046.stdout:8/293: symlink d7/d1c/l60 0 2024-04-26T12:28:46.392 INFO:tasks.workunit.client.0.smithi046.stdout:6/318: symlink d7/d1b/d6a/d57/l6e 0 2024-04-26T12:28:46.392 INFO:tasks.workunit.client.0.smithi046.stdout:7/323: dread d16/d35/f3a [0,4194304] 0 2024-04-26T12:28:46.394 INFO:tasks.workunit.client.0.smithi046.stdout:9/190: dread d0/d6/f26 [0,4194304] 0 2024-04-26T12:28:46.395 INFO:tasks.workunit.client.0.smithi046.stdout:9/191: rmdir d0/d2c 39 2024-04-26T12:28:46.396 INFO:tasks.workunit.client.0.smithi046.stdout:9/192: dread - d0/d19/d21/f30 zero size 2024-04-26T12:28:46.397 INFO:tasks.workunit.client.0.smithi046.stdout:8/294: dwrite d7/dc/f13 [0,4194304] 0 2024-04-26T12:28:46.397 INFO:tasks.workunit.client.0.smithi046.stdout:9/193: mknod d0/c3f 0 2024-04-26T12:28:46.397 INFO:tasks.workunit.client.0.smithi046.stdout:6/319: dwrite d7/f54 [0,4194304] 0 2024-04-26T12:28:46.398 INFO:tasks.workunit.client.0.smithi046.stdout:8/295: readlink d7/da/l3e 0 2024-04-26T12:28:46.398 INFO:tasks.workunit.client.0.smithi046.stdout:7/324: fsync d16/d1a/f2b 0 2024-04-26T12:28:46.400 INFO:tasks.workunit.client.0.smithi046.stdout:8/296: creat d7/d24/d50/d2a/d39/f61 x:0 0 0 2024-04-26T12:28:46.400 INFO:tasks.workunit.client.0.smithi046.stdout:6/320: write d7/d1b/f24 [557907,90115] 0 2024-04-26T12:28:46.400 INFO:tasks.workunit.client.0.smithi046.stdout:4/278: dread d0/d1/f15 [0,4194304] 0 2024-04-26T12:28:46.401 INFO:tasks.workunit.client.0.smithi046.stdout:7/325: mknod d16/d1a/d31/d62/c6a 0 2024-04-26T12:28:46.404 INFO:tasks.workunit.client.0.smithi046.stdout:6/321: write d7/d1b/d6a/f5a [210616,46955] 0 2024-04-26T12:28:46.404 INFO:tasks.workunit.client.0.smithi046.stdout:7/326: mkdir d16/d1a/d31/d5a/d6b 0 2024-04-26T12:28:46.404 INFO:tasks.workunit.client.0.smithi046.stdout:4/279: write d0/d1/d29/f30 [7453163,98089] 0 2024-04-26T12:28:46.405 INFO:tasks.workunit.client.0.smithi046.stdout:0/295: dread d9/d1d/f3c [0,4194304] 0 2024-04-26T12:28:46.406 INFO:tasks.workunit.client.0.smithi046.stdout:6/322: chown d7/d2b/d31/c45 1662 1 2024-04-26T12:28:46.406 INFO:tasks.workunit.client.0.smithi046.stdout:4/280: write d0/da/f26 [4861347,117223] 0 2024-04-26T12:28:46.407 INFO:tasks.workunit.client.0.smithi046.stdout:9/194: dwrite d0/d19/f2f [0,4194304] 0 2024-04-26T12:28:46.408 INFO:tasks.workunit.client.0.smithi046.stdout:6/323: dread - d7/f8 zero size 2024-04-26T12:28:46.408 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:46.407+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:46.410 INFO:tasks.workunit.client.0.smithi046.stdout:6/324: unlink d7/d2b/d31/c45 0 2024-04-26T12:28:46.410 INFO:tasks.workunit.client.0.smithi046.stdout:8/297: dwrite d7/dc/f45 [0,4194304] 0 2024-04-26T12:28:46.410 INFO:tasks.workunit.client.0.smithi046.stdout:9/195: chown d0/d16/l1c 731569450 1 2024-04-26T12:28:46.410 INFO:tasks.workunit.client.0.smithi046.stdout:3/335: dread d2/f4 [0,4194304] 0 2024-04-26T12:28:46.411 INFO:tasks.workunit.client.0.smithi046.stdout:9/196: stat d0/d16 0 2024-04-26T12:28:46.413 INFO:tasks.workunit.client.0.smithi046.stdout:7/327: dwrite f6 [0,4194304] 0 2024-04-26T12:28:46.413 INFO:tasks.workunit.client.0.smithi046.stdout:0/296: dread d9/dc/f1a [0,4194304] 0 2024-04-26T12:28:46.414 INFO:tasks.workunit.client.0.smithi046.stdout:8/298: mkdir d7/d24/d50/d62 0 2024-04-26T12:28:46.414 INFO:tasks.workunit.client.0.smithi046.stdout:9/197: rename d0/la to d0/d16/l40 0 2024-04-26T12:28:46.418 INFO:tasks.workunit.client.0.smithi046.stdout:8/299: chown d7/da/l1f 878707173 1 2024-04-26T12:28:46.419 INFO:tasks.workunit.client.0.smithi046.stdout:8/300: write f4 [589461,106976] 0 2024-04-26T12:28:46.419 INFO:tasks.workunit.client.0.smithi046.stdout:4/281: dwrite d0/d1/d9/d19/f1a [0,4194304] 0 2024-04-26T12:28:46.419 INFO:tasks.workunit.client.0.smithi046.stdout:2/269: dread d1/f4 [0,4194304] 0 2024-04-26T12:28:46.419 INFO:tasks.workunit.client.0.smithi046.stdout:9/198: link d0/d29/f2a d0/d19/f41 0 2024-04-26T12:28:46.419 INFO:tasks.workunit.client.0.smithi046.stdout:9/199: creat d0/d29/f42 x:0 0 0 2024-04-26T12:28:46.419 INFO:tasks.workunit.client.0.smithi046.stdout:2/270: mknod d1/d13/d4a/d58/c5b 0 2024-04-26T12:28:46.420 INFO:tasks.workunit.client.0.smithi046.stdout:8/301: getdents d7/dc/d27 0 2024-04-26T12:28:46.420 INFO:tasks.workunit.client.0.smithi046.stdout:3/336: dwrite d2/d16/d11/d1b/d2d/f56 [0,4194304] 0 2024-04-26T12:28:46.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/302: write d7/dc/f17 [2431801,77273] 0 2024-04-26T12:28:46.423 INFO:tasks.workunit.client.0.smithi046.stdout:7/328: dwrite d16/d1a/d31/d55/f65 [0,4194304] 0 2024-04-26T12:28:46.423 INFO:tasks.workunit.client.0.smithi046.stdout:4/282: truncate d0/f14 812769 0 2024-04-26T12:28:46.424 INFO:tasks.workunit.client.0.smithi046.stdout:2/271: rmdir d1/d13/d1b/d38 39 2024-04-26T12:28:46.424 INFO:tasks.workunit.client.0.smithi046.stdout:1/231: dread d7/db/ff [0,4194304] 0 2024-04-26T12:28:46.424 INFO:tasks.workunit.client.0.smithi046.stdout:3/337: chown d2/d16/d11/d1b/d2d/f56 13 1 2024-04-26T12:28:46.425 INFO:tasks.workunit.client.0.smithi046.stdout:7/329: mkdir d16/d4e/d6c 0 2024-04-26T12:28:46.426 INFO:tasks.workunit.client.0.smithi046.stdout:8/303: mknod d7/dc/d1b/c63 0 2024-04-26T12:28:46.426 INFO:tasks.workunit.client.0.smithi046.stdout:4/283: symlink d0/da/d17/l5c 0 2024-04-26T12:28:46.426 INFO:tasks.workunit.client.0.smithi046.stdout:2/272: creat d1/d13/d4a/d58/f5c x:0 0 0 2024-04-26T12:28:46.426 INFO:tasks.workunit.client.0.smithi046.stdout:7/330: write d16/f23 [2204566,5058] 0 2024-04-26T12:28:46.426 INFO:tasks.workunit.client.0.smithi046.stdout:2/273: fsync d1/de/d2b/f3a 0 2024-04-26T12:28:46.429 INFO:tasks.workunit.client.0.smithi046.stdout:4/284: creat d0/da/d17/d20/d25/d35/f5d x:0 0 0 2024-04-26T12:28:46.429 INFO:tasks.workunit.client.0.smithi046.stdout:9/200: dwrite d0/d6/f23 [0,4194304] 0 2024-04-26T12:28:46.429 INFO:tasks.workunit.client.0.smithi046.stdout:2/274: fsync d1/de/d15/f4e 0 2024-04-26T12:28:46.429 INFO:tasks.workunit.client.0.smithi046.stdout:7/331: mkdir d16/d1a/d31/d55/d6d 0 2024-04-26T12:28:46.430 INFO:tasks.workunit.client.0.smithi046.stdout:9/201: fdatasync d0/f1d 0 2024-04-26T12:28:46.430 INFO:tasks.workunit.client.0.smithi046.stdout:2/275: creat d1/d13/f5d x:0 0 0 2024-04-26T12:28:46.431 INFO:tasks.workunit.client.0.smithi046.stdout:4/285: rename d0/d1/d12/f59 to d0/d1/d9/d19/d53/f5e 0 2024-04-26T12:28:46.432 INFO:tasks.workunit.client.0.smithi046.stdout:1/232: dwrite d7/d12/d3a/f4a [0,4194304] 0 2024-04-26T12:28:46.432 INFO:tasks.workunit.client.0.smithi046.stdout:8/304: dwrite d7/da/f23 [0,4194304] 0 2024-04-26T12:28:46.433 INFO:tasks.workunit.client.0.smithi046.stdout:2/276: write d1/d42/f44 [814421,104896] 0 2024-04-26T12:28:46.434 INFO:tasks.workunit.client.0.smithi046.stdout:9/202: link d0/c12 d0/d2c/d3d/c43 0 2024-04-26T12:28:46.434 INFO:tasks.workunit.client.0.smithi046.stdout:9/203: stat d0/d6/l39 0 2024-04-26T12:28:46.435 INFO:tasks.workunit.client.0.smithi046.stdout:1/233: mknod d7/d9/d2b/d39/c51 0 2024-04-26T12:28:46.436 INFO:tasks.workunit.client.0.smithi046.stdout:9/204: mknod d0/d29/c44 0 2024-04-26T12:28:46.436 INFO:tasks.workunit.client.0.smithi046.stdout:7/332: dwrite f3 [0,4194304] 0 2024-04-26T12:28:46.437 INFO:tasks.workunit.client.0.smithi046.stdout:8/305: write d7/d1c/f2d [1923407,107474] 0 2024-04-26T12:28:46.438 INFO:tasks.workunit.client.0.smithi046.stdout:1/234: creat d7/d14/d1c/d32/f52 x:0 0 0 2024-04-26T12:28:46.439 INFO:tasks.workunit.client.0.smithi046.stdout:7/333: mknod d16/d3f/c6e 0 2024-04-26T12:28:46.440 INFO:tasks.workunit.client.0.smithi046.stdout:5/298: dread d9/da/f28 [0,4194304] 0 2024-04-26T12:28:46.440 INFO:tasks.workunit.client.0.smithi046.stdout:1/235: creat d7/d14/f53 x:0 0 0 2024-04-26T12:28:46.440 INFO:tasks.workunit.client.0.smithi046.stdout:8/306: link c2 d7/da/df/c64 0 2024-04-26T12:28:46.441 INFO:tasks.workunit.client.0.smithi046.stdout:1/236: chown d7/db 4889905 1 2024-04-26T12:28:46.441 INFO:tasks.workunit.client.0.smithi046.stdout:5/299: chown d9/da/dd/d34/f49 27556478 1 2024-04-26T12:28:46.442 INFO:tasks.workunit.client.0.smithi046.stdout:2/277: dwrite d1/d13/f4b [0,4194304] 0 2024-04-26T12:28:46.442 INFO:tasks.workunit.client.0.smithi046.stdout:4/286: dwrite d0/d1/d9/d19/f4a [0,4194304] 0 2024-04-26T12:28:46.443 INFO:tasks.workunit.client.0.smithi046.stdout:1/237: creat d7/d12/d3a/f54 x:0 0 0 2024-04-26T12:28:46.443 INFO:tasks.workunit.client.0.smithi046.stdout:2/278: fdatasync d1/d42/f54 0 2024-04-26T12:28:46.443 INFO:tasks.workunit.client.0.smithi046.stdout:5/300: link d9/da/dd/f36 d9/da/d3b/d35/f67 0 2024-04-26T12:28:46.444 INFO:tasks.workunit.client.0.smithi046.stdout:4/287: mknod d0/da/d21/c5f 0 2024-04-26T12:28:46.444 INFO:tasks.workunit.client.0.smithi046.stdout:2/279: creat d1/de/f5e x:0 0 0 2024-04-26T12:28:46.444 INFO:tasks.workunit.client.0.smithi046.stdout:4/288: mknod d0/d1/d9/d19/c60 0 2024-04-26T12:28:46.444 INFO:tasks.workunit.client.0.smithi046.stdout:2/280: chown d1/d42/f44 618654 1 2024-04-26T12:28:46.445 INFO:tasks.workunit.client.0.smithi046.stdout:4/289: readlink d0/d1/d12/l27 0 2024-04-26T12:28:46.446 INFO:tasks.workunit.client.0.smithi046.stdout:4/290: truncate d0/d1/d9/d19/f3d 1091232 0 2024-04-26T12:28:46.446 INFO:tasks.workunit.client.0.smithi046.stdout:4/291: fsync d0/da/d17/d20/d25/f45 0 2024-04-26T12:28:46.447 INFO:tasks.workunit.client.0.smithi046.stdout:8/307: dread d7/d24/f43 [0,4194304] 0 2024-04-26T12:28:46.448 INFO:tasks.workunit.client.0.smithi046.stdout:8/308: creat d7/da/df/f65 x:0 0 0 2024-04-26T12:28:46.449 INFO:tasks.workunit.client.0.smithi046.stdout:8/309: fdatasync d7/dc/f17 0 2024-04-26T12:28:46.450 INFO:tasks.workunit.client.0.smithi046.stdout:8/310: mknod d7/c66 0 2024-04-26T12:28:46.450 INFO:tasks.workunit.client.0.smithi046.stdout:4/292: dread d0/d1/d12/f4b [0,4194304] 0 2024-04-26T12:28:46.451 INFO:tasks.workunit.client.0.smithi046.stdout:8/311: mkdir d7/d24/d50/d2a/d54/d67 0 2024-04-26T12:28:46.452 INFO:tasks.workunit.client.0.smithi046.stdout:8/312: creat d7/d24/d50/d62/f68 x:0 0 0 2024-04-26T12:28:46.452 INFO:tasks.workunit.client.0.smithi046.stdout:8/313: symlink d7/d24/d50/d2a/d39/l69 0 2024-04-26T12:28:46.453 INFO:tasks.workunit.client.0.smithi046.stdout:8/314: chown d7/dc/f45 2 1 2024-04-26T12:28:46.453 INFO:tasks.workunit.client.0.smithi046.stdout:8/315: rename d7/d24/d50 to d7/d24/d50/d6a 22 2024-04-26T12:28:46.454 INFO:tasks.workunit.client.0.smithi046.stdout:8/316: symlink d7/d1c/l6b 0 2024-04-26T12:28:46.454 INFO:tasks.workunit.client.0.smithi046.stdout:4/293: write d0/d1/d29/f34 [884006,22000] 0 2024-04-26T12:28:46.455 INFO:tasks.workunit.client.0.smithi046.stdout:8/317: write d7/da/df/f2e [947039,106740] 0 2024-04-26T12:28:46.455 INFO:tasks.workunit.client.0.smithi046.stdout:4/294: mkdir d0/da/d17/d20/d25/d35/d61 0 2024-04-26T12:28:46.456 INFO:tasks.workunit.client.0.smithi046.stdout:4/295: stat d0/d1/d5/c7 0 2024-04-26T12:28:46.457 INFO:tasks.workunit.client.0.smithi046.stdout:2/281: dread d1/d13/d4a/f4d [0,4194304] 0 2024-04-26T12:28:46.458 INFO:tasks.workunit.client.0.smithi046.stdout:2/282: symlink d1/de/d15/l5f 0 2024-04-26T12:28:46.459 INFO:tasks.workunit.client.0.smithi046.stdout:2/283: write d1/de/d15/f46 [6685446,7492] 0 2024-04-26T12:28:46.460 INFO:tasks.workunit.client.0.smithi046.stdout:8/318: dwrite d7/da/df/f2b [0,4194304] 0 2024-04-26T12:28:46.461 INFO:tasks.workunit.client.0.smithi046.stdout:2/284: fdatasync d1/d13/d4a/f4d 0 2024-04-26T12:28:46.461 INFO:tasks.workunit.client.0.smithi046.stdout:4/296: dwrite d0/d1/d12/f47 [0,4194304] 0 2024-04-26T12:28:46.462 INFO:tasks.workunit.client.0.smithi046.stdout:2/285: truncate d1/de/f11 1497950 0 2024-04-26T12:28:46.463 INFO:tasks.workunit.client.0.smithi046.stdout:2/286: creat d1/d42/f60 x:0 0 0 2024-04-26T12:28:46.464 INFO:tasks.workunit.client.0.smithi046.stdout:2/287: write d1/de/d15/d18/f57 [588522,48542] 0 2024-04-26T12:28:46.464 INFO:tasks.workunit.client.0.smithi046.stdout:2/288: dread - d1/d13/f5d zero size 2024-04-26T12:28:46.465 INFO:tasks.workunit.client.0.smithi046.stdout:4/297: dread d0/d1/d9/d19/f1a [0,4194304] 0 2024-04-26T12:28:46.465 INFO:tasks.workunit.client.0.smithi046.stdout:2/289: creat d1/d13/d1b/f61 x:0 0 0 2024-04-26T12:28:46.466 INFO:tasks.workunit.client.0.smithi046.stdout:4/298: creat d0/d1/d9/d19/d53/f62 x:0 0 0 2024-04-26T12:28:46.466 INFO:tasks.workunit.client.0.smithi046.stdout:2/290: creat d1/d13/d4a/d58/f62 x:0 0 0 2024-04-26T12:28:46.467 INFO:tasks.workunit.client.0.smithi046.stdout:4/299: truncate d0/f14 1351182 0 2024-04-26T12:28:46.467 INFO:tasks.workunit.client.0.smithi046.stdout:0/297: sync 2024-04-26T12:28:46.467 INFO:tasks.workunit.client.0.smithi046.stdout:1/238: sync 2024-04-26T12:28:46.468 INFO:tasks.workunit.client.0.smithi046.stdout:4/300: chown d0/d1/d5/db 1 1 2024-04-26T12:28:46.468 INFO:tasks.workunit.client.0.smithi046.stdout:0/298: chown d9/d1d/d40/d41/f54 12 1 2024-04-26T12:28:46.469 INFO:tasks.workunit.client.0.smithi046.stdout:4/301: chown d0/d1/d9/d19/c60 10 1 2024-04-26T12:28:46.470 INFO:tasks.workunit.client.0.smithi046.stdout:4/302: rename d0/d1/d9/lf to d0/d41/l63 0 2024-04-26T12:28:46.471 INFO:tasks.workunit.client.0.smithi046.stdout:2/291: dwrite d1/de/ff [0,4194304] 0 2024-04-26T12:28:46.472 INFO:tasks.workunit.client.0.smithi046.stdout:0/299: dread d9/dc/f60 [0,4194304] 0 2024-04-26T12:28:46.472 INFO:tasks.workunit.client.0.smithi046.stdout:1/239: truncate d7/d12/f21 125304 0 2024-04-26T12:28:46.472 INFO:tasks.workunit.client.0.smithi046.stdout:1/240: stat d7/d14/f4f 0 2024-04-26T12:28:46.473 INFO:tasks.workunit.client.0.smithi046.stdout:2/292: getdents d1/d13/d4a 0 2024-04-26T12:28:46.474 INFO:tasks.workunit.client.0.smithi046.stdout:1/241: write d7/d9/f1a [151195,47326] 0 2024-04-26T12:28:46.474 INFO:tasks.workunit.client.0.smithi046.stdout:0/300: rename d9/f3b to d9/dc/dd/f64 0 2024-04-26T12:28:46.474 INFO:tasks.workunit.client.0.smithi046.stdout:7/334: sync 2024-04-26T12:28:46.474 INFO:tasks.workunit.client.0.smithi046.stdout:8/319: sync 2024-04-26T12:28:46.474 INFO:tasks.workunit.client.0.smithi046.stdout:9/205: sync 2024-04-26T12:28:46.475 INFO:tasks.workunit.client.0.smithi046.stdout:3/338: sync 2024-04-26T12:28:46.475 INFO:tasks.workunit.client.0.smithi046.stdout:0/301: fsync f5 0 2024-04-26T12:28:46.475 INFO:tasks.workunit.client.0.smithi046.stdout:9/206: chown d0/f15 225562 1 2024-04-26T12:28:46.475 INFO:tasks.workunit.client.0.smithi046.stdout:3/339: chown d2/d16/d2c/d50/d71 93564 1 2024-04-26T12:28:46.475 INFO:tasks.workunit.client.0.smithi046.stdout:2/293: link d1/d13/d4a/d58/f5c d1/d13/d4a/d58/f63 0 2024-04-26T12:28:46.476 INFO:tasks.workunit.client.0.smithi046.stdout:7/335: write d16/d1a/d31/d4d/f5f [78952,46783] 0 2024-04-26T12:28:46.476 INFO:tasks.workunit.client.0.smithi046.stdout:0/302: link d9/c15 d9/dc/d2a/c65 0 2024-04-26T12:28:46.477 INFO:tasks.workunit.client.0.smithi046.stdout:7/336: write d16/d4e/f52 [567473,81723] 0 2024-04-26T12:28:46.478 INFO:tasks.workunit.client.0.smithi046.stdout:3/340: rename d2/d16/d11/c7a to d2/d16/d2c/d50/c7c 0 2024-04-26T12:28:46.478 INFO:tasks.workunit.client.0.smithi046.stdout:7/337: write d16/d1a/d31/d5a/f5b [68458,66200] 0 2024-04-26T12:28:46.480 INFO:tasks.workunit.client.0.smithi046.stdout:3/341: mkdir d2/d16/d11/d1b/d2d/d7d 0 2024-04-26T12:28:46.480 INFO:tasks.workunit.client.0.smithi046.stdout:7/338: read d16/d1a/d31/d5a/f60 [4028214,8427] 0 2024-04-26T12:28:46.481 INFO:tasks.workunit.client.0.smithi046.stdout:7/339: fsync f3 0 2024-04-26T12:28:46.481 INFO:tasks.workunit.client.0.smithi046.stdout:9/207: dwrite d0/d6/ff [0,4194304] 0 2024-04-26T12:28:46.482 INFO:tasks.workunit.client.0.smithi046.stdout:0/303: dwrite d9/dc/f37 [0,4194304] 0 2024-04-26T12:28:46.482 INFO:tasks.workunit.client.0.smithi046.stdout:9/208: mknod d0/d16/c45 0 2024-04-26T12:28:46.483 INFO:tasks.workunit.client.0.smithi046.stdout:3/342: link d2/d16/d11/d6d/l6e d2/d16/d11/d1b/l7e 0 2024-04-26T12:28:46.483 INFO:tasks.workunit.client.0.smithi046.stdout:9/209: creat d0/d6/f46 x:0 0 0 2024-04-26T12:28:46.483 INFO:tasks.workunit.client.0.smithi046.stdout:9/210: chown d0/d19/d21 2254 1 2024-04-26T12:28:46.485 INFO:tasks.workunit.client.0.smithi046.stdout:3/343: symlink d2/d16/d11/d6d/l7f 0 2024-04-26T12:28:46.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/301: dread d9/da/f4b [0,4194304] 0 2024-04-26T12:28:46.486 INFO:tasks.workunit.client.0.smithi046.stdout:1/242: truncate d7/db/f10 5151877 0 2024-04-26T12:28:46.486 INFO:tasks.workunit.client.0.smithi046.stdout:0/304: dread d9/f10 [0,4194304] 0 2024-04-26T12:28:46.486 INFO:tasks.workunit.client.0.smithi046.stdout:1/243: sync 2024-04-26T12:28:46.487 INFO:tasks.workunit.client.0.smithi046.stdout:5/302: chown d9/da/d15/l2a 502 1 2024-04-26T12:28:46.487 INFO:tasks.workunit.client.0.smithi046.stdout:6/325: dread d7/f13 [0,4194304] 0 2024-04-26T12:28:46.490 INFO:tasks.workunit.client.0.smithi046.stdout:3/344: chown d2/d16/d11/d1b/d2d/c7b 504 1 2024-04-26T12:28:46.490 INFO:tasks.workunit.client.0.smithi046.stdout:1/244: write d7/d14/f53 [645935,64842] 0 2024-04-26T12:28:46.490 INFO:tasks.workunit.client.0.smithi046.stdout:0/305: chown d9/d1d/d5d/f5e 7010108 1 2024-04-26T12:28:46.490 INFO:tasks.workunit.client.0.smithi046.stdout:1/245: sync 2024-04-26T12:28:46.490 INFO:tasks.workunit.client.0.smithi046.stdout:7/340: write d16/d1a/d31/f39 [359831,79586] 0 2024-04-26T12:28:46.490 INFO:tasks.workunit.client.0.smithi046.stdout:9/211: rename d0/d6 to d0/d2c/d47 0 2024-04-26T12:28:46.492 INFO:tasks.workunit.client.0.smithi046.stdout:0/306: truncate d9/f61 570539 0 2024-04-26T12:28:46.492 INFO:tasks.workunit.client.0.smithi046.stdout:1/246: unlink d7/d14/d1c/d32/f52 0 2024-04-26T12:28:46.493 INFO:tasks.workunit.client.0.smithi046.stdout:9/212: symlink d0/d2c/d47/l48 0 2024-04-26T12:28:46.493 INFO:tasks.workunit.client.0.smithi046.stdout:9/213: sync 2024-04-26T12:28:46.494 INFO:tasks.workunit.client.0.smithi046.stdout:8/320: dread d7/dc/d1b/f47 [0,4194304] 0 2024-04-26T12:28:46.494 INFO:tasks.workunit.client.0.smithi046.stdout:2/294: dread d1/d42/f44 [0,4194304] 0 2024-04-26T12:28:46.494 INFO:tasks.workunit.client.0.smithi046.stdout:1/247: fdatasync d7/d12/d3a/f54 0 2024-04-26T12:28:46.494 INFO:tasks.workunit.client.0.smithi046.stdout:9/214: fdatasync d0/f18 0 2024-04-26T12:28:46.494 INFO:tasks.workunit.client.0.smithi046.stdout:6/326: dread d7/f15 [4194304,4194304] 0 2024-04-26T12:28:46.495 INFO:tasks.workunit.client.0.smithi046.stdout:0/307: mkdir d9/dc/d4c/d66 0 2024-04-26T12:28:46.496 INFO:tasks.workunit.client.0.smithi046.stdout:9/215: mknod d0/d29/c49 0 2024-04-26T12:28:46.496 INFO:tasks.workunit.client.0.smithi046.stdout:6/327: unlink d7/d1b/d37/f66 0 2024-04-26T12:28:46.496 INFO:tasks.workunit.client.0.smithi046.stdout:2/295: truncate d1/d42/f60 715621 0 2024-04-26T12:28:46.496 INFO:tasks.workunit.client.0.smithi046.stdout:1/248: chown d7/d12/d44/c45 60 1 2024-04-26T12:28:46.496 INFO:tasks.workunit.client.0.smithi046.stdout:5/303: dwrite d9/da/dd/d34/d45/f56 [0,4194304] 0 2024-04-26T12:28:46.497 INFO:tasks.workunit.client.0.smithi046.stdout:0/308: creat d9/dc/d4c/d66/f67 x:0 0 0 2024-04-26T12:28:46.497 INFO:tasks.workunit.client.0.smithi046.stdout:9/216: stat d0/d19/f2f 0 2024-04-26T12:28:46.498 INFO:tasks.workunit.client.0.smithi046.stdout:1/249: mkdir d7/d9/d55 0 2024-04-26T12:28:46.499 INFO:tasks.workunit.client.0.smithi046.stdout:7/341: dwrite d16/d27/d51/f67 [0,4194304] 0 2024-04-26T12:28:46.499 INFO:tasks.workunit.client.0.smithi046.stdout:5/304: chown d9/da/d18/f42 60603866 1 2024-04-26T12:28:46.499 INFO:tasks.workunit.client.0.smithi046.stdout:6/328: chown l6 222 1 2024-04-26T12:28:46.499 INFO:tasks.workunit.client.0.smithi046.stdout:2/296: fdatasync d1/d13/d4a/d58/f63 0 2024-04-26T12:28:46.499 INFO:tasks.workunit.client.0.smithi046.stdout:1/250: stat d7/db/ff 0 2024-04-26T12:28:46.500 INFO:tasks.workunit.client.0.smithi046.stdout:6/329: readlink l4 0 2024-04-26T12:28:46.500 INFO:tasks.workunit.client.0.smithi046.stdout:9/217: creat d0/d19/d21/f4a x:0 0 0 2024-04-26T12:28:46.501 INFO:tasks.workunit.client.0.smithi046.stdout:3/345: truncate d2/f7 2264521 0 2024-04-26T12:28:46.501 INFO:tasks.workunit.client.0.smithi046.stdout:1/251: chown d7/d12/l2e 11954 1 2024-04-26T12:28:46.503 INFO:tasks.workunit.client.0.smithi046.stdout:3/346: read - d2/d16/f79 zero size 2024-04-26T12:28:46.503 INFO:tasks.workunit.client.0.smithi046.stdout:8/321: dwrite d7/da/df/f4d [0,4194304] 0 2024-04-26T12:28:46.505 INFO:tasks.workunit.client.0.smithi046.stdout:4/303: dread d0/d1/d29/f30 [0,4194304] 0 2024-04-26T12:28:46.505 INFO:tasks.workunit.client.0.smithi046.stdout:3/347: fsync d2/d16/d35/f66 0 2024-04-26T12:28:46.506 INFO:tasks.workunit.client.0.smithi046.stdout:5/305: symlink d9/da/d3b/l68 0 2024-04-26T12:28:46.506 INFO:tasks.workunit.client.0.smithi046.stdout:0/309: dwrite d9/dc/dd/f2f [0,4194304] 0 2024-04-26T12:28:46.506 INFO:tasks.workunit.client.0.smithi046.stdout:2/297: creat d1/de/d15/f64 x:0 0 0 2024-04-26T12:28:46.507 INFO:tasks.workunit.client.0.smithi046.stdout:1/252: rmdir d7/d9/d55 0 2024-04-26T12:28:46.507 INFO:tasks.workunit.client.0.smithi046.stdout:8/322: rename d7/f8 to d7/da/d4f/f6c 0 2024-04-26T12:28:46.507 INFO:tasks.workunit.client.0.smithi046.stdout:5/306: mkdir d9/da/dd/d69 0 2024-04-26T12:28:46.508 INFO:tasks.workunit.client.0.smithi046.stdout:0/310: dread - d9/d1d/d40/d41/d43/f5b zero size 2024-04-26T12:28:46.509 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:46.507+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:46.509 INFO:tasks.workunit.client.0.smithi046.stdout:6/330: dwrite d7/d2b/d31/f2e [0,4194304] 0 2024-04-26T12:28:46.511 INFO:tasks.workunit.client.0.smithi046.stdout:5/307: mknod d9/da/dd/d34/d44/c6a 0 2024-04-26T12:28:46.511 INFO:tasks.workunit.client.0.smithi046.stdout:4/304: truncate d0/d1/d9/d19/d53/f62 3416 0 2024-04-26T12:28:46.511 INFO:tasks.workunit.client.0.smithi046.stdout:6/331: rename d7/d2b/l2c to d7/d2b/l6f 0 2024-04-26T12:28:46.511 INFO:tasks.workunit.client.0.smithi046.stdout:2/298: rename d1/d13 to d1/de/d65 0 2024-04-26T12:28:46.512 INFO:tasks.workunit.client.0.smithi046.stdout:5/308: mkdir d9/da/dd/d34/d6b 0 2024-04-26T12:28:46.512 INFO:tasks.workunit.client.0.smithi046.stdout:6/332: rename d7/d1b/d6a/c67 to d7/c70 0 2024-04-26T12:28:46.513 INFO:tasks.workunit.client.0.smithi046.stdout:2/299: write d1/d42/f54 [259551,109243] 0 2024-04-26T12:28:46.513 INFO:tasks.workunit.client.0.smithi046.stdout:5/309: creat d9/da/dd/d69/f6c x:0 0 0 2024-04-26T12:28:46.514 INFO:tasks.workunit.client.0.smithi046.stdout:6/333: mknod d7/d1b/d47/d65/c71 0 2024-04-26T12:28:46.515 INFO:tasks.workunit.client.0.smithi046.stdout:1/253: write d7/db/f10 [5258815,81660] 0 2024-04-26T12:28:46.516 INFO:tasks.workunit.client.0.smithi046.stdout:3/348: link d2/d16/d2c/f36 d2/d16/d11/d1b/d2d/d7d/f80 0 2024-04-26T12:28:46.516 INFO:tasks.workunit.client.0.smithi046.stdout:8/323: dwrite d7/d24/f49 [0,4194304] 0 2024-04-26T12:28:46.516 INFO:tasks.workunit.client.0.smithi046.stdout:0/311: symlink d9/d1d/d5d/l68 0 2024-04-26T12:28:46.516 INFO:tasks.workunit.client.0.smithi046.stdout:4/305: truncate d0/d1/d5/db/f10 7281360 0 2024-04-26T12:28:46.518 INFO:tasks.workunit.client.0.smithi046.stdout:0/312: rmdir d9/d1d/d5d 39 2024-04-26T12:28:46.518 INFO:tasks.workunit.client.0.smithi046.stdout:1/254: truncate d7/d14/d1c/f3e 1755387 0 2024-04-26T12:28:46.518 INFO:tasks.workunit.client.0.smithi046.stdout:4/306: mkdir d0/d64 0 2024-04-26T12:28:46.518 INFO:tasks.workunit.client.0.smithi046.stdout:4/307: sync 2024-04-26T12:28:46.519 INFO:tasks.workunit.client.0.smithi046.stdout:3/349: creat d2/d16/d11/f81 x:0 0 0 2024-04-26T12:28:46.519 INFO:tasks.workunit.client.0.smithi046.stdout:1/255: write d7/d14/f4f [430245,109309] 0 2024-04-26T12:28:46.520 INFO:tasks.workunit.client.0.smithi046.stdout:0/313: mkdir d9/dc/dd/d45/d69 0 2024-04-26T12:28:46.520 INFO:tasks.workunit.client.0.smithi046.stdout:8/324: symlink d7/l6d 0 2024-04-26T12:28:46.521 INFO:tasks.workunit.client.0.smithi046.stdout:1/256: creat d7/d14/d1c/d32/f56 x:0 0 0 2024-04-26T12:28:46.521 INFO:tasks.workunit.client.0.smithi046.stdout:0/314: creat d9/d1d/d40/d41/f6a x:0 0 0 2024-04-26T12:28:46.522 INFO:tasks.workunit.client.0.smithi046.stdout:8/325: write d7/d24/d50/f2c [1505556,94242] 0 2024-04-26T12:28:46.522 INFO:tasks.workunit.client.0.smithi046.stdout:3/350: truncate d2/d16/d11/d23/f67 715799 0 2024-04-26T12:28:46.522 INFO:tasks.workunit.client.0.smithi046.stdout:5/310: dwrite d9/f29 [0,4194304] 0 2024-04-26T12:28:46.522 INFO:tasks.workunit.client.0.smithi046.stdout:1/257: write d7/d14/f4f [660150,41747] 0 2024-04-26T12:28:46.523 INFO:tasks.workunit.client.0.smithi046.stdout:8/326: write d7/d24/f49 [3832054,79021] 0 2024-04-26T12:28:46.524 INFO:tasks.workunit.client.0.smithi046.stdout:3/351: chown d2/db/c52 4632 1 2024-04-26T12:28:46.524 INFO:tasks.workunit.client.0.smithi046.stdout:8/327: stat d7/da/l3e 0 2024-04-26T12:28:46.524 INFO:tasks.workunit.client.0.smithi046.stdout:5/311: fsync d9/da/dd/d5d/f5f 0 2024-04-26T12:28:46.526 INFO:tasks.workunit.client.0.smithi046.stdout:2/300: write d1/de/d15/d18/f2c [1455013,100723] 0 2024-04-26T12:28:46.526 INFO:tasks.workunit.client.0.smithi046.stdout:3/352: mkdir d2/d16/d11/d82 0 2024-04-26T12:28:46.527 INFO:tasks.workunit.client.0.smithi046.stdout:5/312: creat d9/da/d40/f6d x:0 0 0 2024-04-26T12:28:46.528 INFO:tasks.workunit.client.0.smithi046.stdout:2/301: write d1/de/f31 [252364,60520] 0 2024-04-26T12:28:46.528 INFO:tasks.workunit.client.0.smithi046.stdout:8/328: getdents d7/d24/d50 0 2024-04-26T12:28:46.528 INFO:tasks.workunit.client.0.smithi046.stdout:3/353: unlink d2/d16/d11/d1b/d2d/f41 0 2024-04-26T12:28:46.529 INFO:tasks.workunit.client.0.smithi046.stdout:0/315: dwrite d9/dc/f2d [0,4194304] 0 2024-04-26T12:28:46.530 INFO:tasks.workunit.client.0.smithi046.stdout:2/302: chown d1/de/c14 1500 1 2024-04-26T12:28:46.530 INFO:tasks.workunit.client.0.smithi046.stdout:3/354: mknod d2/d16/d11/d1b/c83 0 2024-04-26T12:28:46.530 INFO:tasks.workunit.client.0.smithi046.stdout:3/355: chown l1 2438 1 2024-04-26T12:28:46.531 INFO:tasks.workunit.client.0.smithi046.stdout:1/258: truncate d7/d9/f1a 146786 0 2024-04-26T12:28:46.531 INFO:tasks.workunit.client.0.smithi046.stdout:0/316: mkdir d9/d1d/d5d/d6b 0 2024-04-26T12:28:46.533 INFO:tasks.workunit.client.0.smithi046.stdout:4/308: dwrite d0/da/d17/f46 [0,4194304] 0 2024-04-26T12:28:46.533 INFO:tasks.workunit.client.0.smithi046.stdout:2/303: creat d1/de/d65/f66 x:0 0 0 2024-04-26T12:28:46.533 INFO:tasks.workunit.client.0.smithi046.stdout:5/313: write d9/da/d15/f26 [1931797,4937] 0 2024-04-26T12:28:46.534 INFO:tasks.workunit.client.0.smithi046.stdout:1/259: rmdir d7/d12/d44 39 2024-04-26T12:28:46.534 INFO:tasks.workunit.client.0.smithi046.stdout:0/317: dread d9/d1d/f3c [0,4194304] 0 2024-04-26T12:28:46.534 INFO:tasks.workunit.client.0.smithi046.stdout:3/356: rmdir d2/d16/d11/d1b/d2d/d7d 39 2024-04-26T12:28:46.536 INFO:tasks.workunit.client.0.smithi046.stdout:7/342: dread d16/d4e/f52 [0,4194304] 0 2024-04-26T12:28:46.537 INFO:tasks.workunit.client.0.smithi046.stdout:2/304: chown d1/de/d65/d4a/f4d 941682 1 2024-04-26T12:28:46.537 INFO:tasks.workunit.client.0.smithi046.stdout:3/357: readlink d2/d16/d11/d1f/l76 0 2024-04-26T12:28:46.537 INFO:tasks.workunit.client.0.smithi046.stdout:8/329: dwrite d7/d24/d50/d2a/f42 [0,4194304] 0 2024-04-26T12:28:46.537 INFO:tasks.workunit.client.0.smithi046.stdout:5/314: write d9/da/dd/f1e [3601449,115318] 0 2024-04-26T12:28:46.538 INFO:tasks.workunit.client.0.smithi046.stdout:1/260: creat d7/d12/f57 x:0 0 0 2024-04-26T12:28:46.538 INFO:tasks.workunit.client.0.smithi046.stdout:7/343: read d16/d35/f3a [399946,3302] 0 2024-04-26T12:28:46.538 INFO:tasks.workunit.client.0.smithi046.stdout:2/305: write d1/d42/f54 [193179,15059] 0 2024-04-26T12:28:46.538 INFO:tasks.workunit.client.0.smithi046.stdout:4/309: creat d0/da/d17/d20/d25/d35/f65 x:0 0 0 2024-04-26T12:28:46.539 INFO:tasks.workunit.client.0.smithi046.stdout:3/358: fsync d2/d16/f37 0 2024-04-26T12:28:46.539 INFO:tasks.workunit.client.0.smithi046.stdout:0/318: creat d9/d1d/f6c x:0 0 0 2024-04-26T12:28:46.539 INFO:tasks.workunit.client.0.smithi046.stdout:5/315: write d9/da/dd/d34/f49 [907325,49554] 0 2024-04-26T12:28:46.539 INFO:tasks.workunit.client.0.smithi046.stdout:7/344: unlink l11 0 2024-04-26T12:28:46.540 INFO:tasks.workunit.client.0.smithi046.stdout:5/316: dread - d9/da/d40/f6d zero size 2024-04-26T12:28:46.541 INFO:tasks.workunit.client.0.smithi046.stdout:3/359: mkdir d2/db/d84 0 2024-04-26T12:28:46.541 INFO:tasks.workunit.client.0.smithi046.stdout:2/306: mkdir d1/de/d67 0 2024-04-26T12:28:46.541 INFO:tasks.workunit.client.0.smithi046.stdout:7/345: rename le to d16/d1a/d31/l6f 0 2024-04-26T12:28:46.541 INFO:tasks.workunit.client.0.smithi046.stdout:8/330: getdents d7/d24/d50/d62 0 2024-04-26T12:28:46.541 INFO:tasks.workunit.client.0.smithi046.stdout:5/317: chown d9/f29 7 1 2024-04-26T12:28:46.541 INFO:tasks.workunit.client.0.smithi046.stdout:4/310: link d0/d41/l63 d0/d1/d12/l66 0 2024-04-26T12:28:46.541 INFO:tasks.workunit.client.0.smithi046.stdout:2/307: write d1/f48 [541856,116359] 0 2024-04-26T12:28:46.542 INFO:tasks.workunit.client.0.smithi046.stdout:3/360: write d2/d16/d11/d1f/f42 [88166,129619] 0 2024-04-26T12:28:46.542 INFO:tasks.workunit.client.0.smithi046.stdout:7/346: write d16/d1a/d31/d5a/f60 [3192264,21190] 0 2024-04-26T12:28:46.543 INFO:tasks.workunit.client.0.smithi046.stdout:5/318: creat d9/da/dd/d5d/f6e x:0 0 0 2024-04-26T12:28:46.544 INFO:tasks.workunit.client.0.smithi046.stdout:0/319: write f8 [929731,23218] 0 2024-04-26T12:28:46.544 INFO:tasks.workunit.client.0.smithi046.stdout:1/261: write d7/d9/f11 [841898,25916] 0 2024-04-26T12:28:46.545 INFO:tasks.workunit.client.0.smithi046.stdout:3/361: creat d2/d16/d11/d1b/d2d/d7d/f85 x:0 0 0 2024-04-26T12:28:46.545 INFO:tasks.workunit.client.0.smithi046.stdout:8/331: getdents d7/d24/d50 0 2024-04-26T12:28:46.545 INFO:tasks.workunit.client.0.smithi046.stdout:3/362: sync 2024-04-26T12:28:46.546 INFO:tasks.workunit.client.0.smithi046.stdout:7/347: write d16/d35/f3a [36119,124948] 0 2024-04-26T12:28:46.546 INFO:tasks.workunit.client.0.smithi046.stdout:0/320: mknod d9/d1d/d5d/d6b/c6d 0 2024-04-26T12:28:46.547 INFO:tasks.workunit.client.0.smithi046.stdout:1/262: creat d7/d9/f58 x:0 0 0 2024-04-26T12:28:46.547 INFO:tasks.workunit.client.0.smithi046.stdout:5/319: truncate d9/da/d15/f4c 929872 0 2024-04-26T12:28:46.547 INFO:tasks.workunit.client.0.smithi046.stdout:4/311: fdatasync d0/d1/f42 0 2024-04-26T12:28:46.547 INFO:tasks.workunit.client.0.smithi046.stdout:8/332: mknod d7/da/df/c6e 0 2024-04-26T12:28:46.548 INFO:tasks.workunit.client.0.smithi046.stdout:7/348: write d16/d1a/d31/d5a/f3d [71224,34506] 0 2024-04-26T12:28:46.549 INFO:tasks.workunit.client.0.smithi046.stdout:2/308: dwrite d1/de/d2b/f3a [0,4194304] 0 2024-04-26T12:28:46.549 INFO:tasks.workunit.client.0.smithi046.stdout:3/363: truncate d2/d16/d35/f4e 774037 0 2024-04-26T12:28:46.550 INFO:tasks.workunit.client.0.smithi046.stdout:4/312: read - d0/da/d17/d20/d25/d35/f5d zero size 2024-04-26T12:28:46.550 INFO:tasks.workunit.client.0.smithi046.stdout:9/218: dread d0/f24 [0,4194304] 0 2024-04-26T12:28:46.550 INFO:tasks.workunit.client.0.smithi046.stdout:5/320: link d9/da/f4b d9/da/dd/d34/f6f 0 2024-04-26T12:28:46.551 INFO:tasks.workunit.client.0.smithi046.stdout:0/321: write d9/dc/d4c/d66/f67 [580701,76782] 0 2024-04-26T12:28:46.551 INFO:tasks.workunit.client.0.smithi046.stdout:8/333: truncate d7/d24/d50/f2c 4776602 0 2024-04-26T12:28:46.552 INFO:tasks.workunit.client.0.smithi046.stdout:6/334: dread d7/d2b/d31/f43 [0,4194304] 0 2024-04-26T12:28:46.552 INFO:tasks.workunit.client.0.smithi046.stdout:7/349: write d16/d1a/d3e/d4f/f48 [2436185,13560] 0 2024-04-26T12:28:46.553 INFO:tasks.workunit.client.0.smithi046.stdout:2/309: fdatasync d1/de/d65/d4a/d58/f5c 0 2024-04-26T12:28:46.553 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:46.553 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:46.554 INFO:tasks.workunit.client.0.smithi046.stdout:3/364: creat d2/db/d4a/f86 x:0 0 0 2024-04-26T12:28:46.554 INFO:tasks.workunit.client.0.smithi046.stdout:8/334: symlink d7/d1c/l6f 0 2024-04-26T12:28:46.554 INFO:tasks.workunit.client.0.smithi046.stdout:3/365: readlink d2/d16/l60 0 2024-04-26T12:28:46.554 INFO:tasks.workunit.client.0.smithi046.stdout:5/321: creat d9/da/dd/d69/f70 x:0 0 0 2024-04-26T12:28:46.555 INFO:tasks.workunit.client.0.smithi046.stdout:0/322: creat d9/d1d/d40/f6e x:0 0 0 2024-04-26T12:28:46.555 INFO:tasks.workunit.client.0.smithi046.stdout:6/335: symlink d7/d2b/d31/d4d/l72 0 2024-04-26T12:28:46.555 INFO:tasks.workunit.client.0.smithi046.stdout:7/350: creat d16/d1a/d31/f70 x:0 0 0 2024-04-26T12:28:46.555 INFO:tasks.workunit.client.0.smithi046.stdout:0/323: readlink d9/d1d/l2e 0 2024-04-26T12:28:46.556 INFO:tasks.workunit.client.0.smithi046.stdout:8/335: creat d7/dc/f70 x:0 0 0 2024-04-26T12:28:46.556 INFO:tasks.workunit.client.0.smithi046.stdout:4/313: write d0/d1/d5/f11 [2776738,31634] 0 2024-04-26T12:28:46.556 INFO:tasks.workunit.client.0.smithi046.stdout:5/322: symlink d9/da/dd/l71 0 2024-04-26T12:28:46.559 INFO:tasks.workunit.client.0.smithi046.stdout:9/219: dwrite d0/d2c/d47/f13 [0,4194304] 0 2024-04-26T12:28:46.559 INFO:tasks.workunit.client.0.smithi046.stdout:5/323: fsync d9/da/dd/d34/d3e/d3f/f63 0 2024-04-26T12:28:46.560 INFO:tasks.workunit.client.0.smithi046.stdout:7/351: creat d16/d1a/d3e/d4f/f71 x:0 0 0 2024-04-26T12:28:46.560 INFO:tasks.workunit.client.0.smithi046.stdout:0/324: symlink d9/d1d/l6f 0 2024-04-26T12:28:46.562 INFO:tasks.workunit.client.0.smithi046.stdout:8/336: truncate d7/d24/f2f 2385250 0 2024-04-26T12:28:46.562 INFO:tasks.workunit.client.0.smithi046.stdout:4/314: rmdir d0/da/d17/d20/d25/d35/d48 0 2024-04-26T12:28:46.562 INFO:tasks.workunit.client.0.smithi046.stdout:7/352: symlink d16/d1a/l72 0 2024-04-26T12:28:46.564 INFO:tasks.workunit.client.0.smithi046.stdout:2/310: dwrite d1/de/f27 [0,4194304] 0 2024-04-26T12:28:46.564 INFO:tasks.workunit.client.0.smithi046.stdout:7/353: dread - d16/d1a/d31/f49 zero size 2024-04-26T12:28:46.565 INFO:tasks.workunit.client.0.smithi046.stdout:7/354: sync 2024-04-26T12:28:46.566 INFO:tasks.workunit.client.0.smithi046.stdout:5/324: mknod d9/da/dd/d34/c72 0 2024-04-26T12:28:46.566 INFO:tasks.workunit.client.0.smithi046.stdout:6/336: dwrite d7/d1b/d47/f49 [0,4194304] 0 2024-04-26T12:28:46.566 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:46.569 INFO:tasks.workunit.client.0.smithi046.stdout:6/337: creat d7/d1b/d47/d65/f73 x:0 0 0 2024-04-26T12:28:46.569 INFO:tasks.workunit.client.0.smithi046.stdout:6/338: sync 2024-04-26T12:28:46.569 INFO:tasks.workunit.client.0.smithi046.stdout:5/325: chown d9/da/dd/d34/d44/f4d 724 1 2024-04-26T12:28:46.569 INFO:tasks.workunit.client.0.smithi046.stdout:7/355: mknod d16/d1a/d31/d55/d6d/c73 0 2024-04-26T12:28:46.570 INFO:tasks.workunit.client.0.smithi046.stdout:9/220: dwrite d0/d29/f37 [0,4194304] 0 2024-04-26T12:28:46.572 INFO:tasks.workunit.client.0.smithi046.stdout:0/325: dwrite d9/dc/f60 [0,4194304] 0 2024-04-26T12:28:46.572 INFO:tasks.workunit.client.0.smithi046.stdout:5/326: fdatasync d9/da/f5c 0 2024-04-26T12:28:46.572 INFO:tasks.workunit.client.0.smithi046.stdout:4/315: dread d0/d1/f42 [0,4194304] 0 2024-04-26T12:28:46.572 INFO:tasks.workunit.client.0.smithi046.stdout:9/221: fdatasync d0/d29/f2a 0 2024-04-26T12:28:46.573 INFO:tasks.workunit.client.0.smithi046.stdout:4/316: write d0/d1/f42 [2418444,29563] 0 2024-04-26T12:28:46.573 INFO:tasks.workunit.client.0.smithi046.stdout:9/222: dread - d0/d2c/d47/f2d zero size 2024-04-26T12:28:46.573 INFO:tasks.workunit.client.0.smithi046.stdout:0/326: stat d9/dc/f42 0 2024-04-26T12:28:46.574 INFO:tasks.workunit.client.0.smithi046.stdout:9/223: dread - d0/d29/f42 zero size 2024-04-26T12:28:46.574 INFO:tasks.workunit.client.0.smithi046.stdout:0/327: chown d9/dc/d4c/d62 10831 1 2024-04-26T12:28:46.575 INFO:tasks.workunit.client.0.smithi046.stdout:5/327: creat d9/f73 x:0 0 0 2024-04-26T12:28:46.575 INFO:tasks.workunit.client.0.smithi046.stdout:9/224: rename d0/d2c/d47/c32 to d0/c4b 0 2024-04-26T12:28:46.578 INFO:tasks.workunit.client.0.smithi046.stdout:0/328: rmdir d9/d1d/d40/d41 39 2024-04-26T12:28:46.578 INFO:tasks.workunit.client.0.smithi046.stdout:7/356: dwrite d16/d35/f3b [4194304,4194304] 0 2024-04-26T12:28:46.578 INFO:tasks.workunit.client.0.smithi046.stdout:0/329: chown d9/d1d/d40/d41/d43 61023631 1 2024-04-26T12:28:46.579 INFO:tasks.workunit.client.0.smithi046.stdout:7/357: symlink d16/d27/l74 0 2024-04-26T12:28:46.579 INFO:tasks.workunit.client.0.smithi046.stdout:0/330: write d9/d1d/d5d/f5e [9018663,32091] 0 2024-04-26T12:28:46.580 INFO:tasks.workunit.client.0.smithi046.stdout:0/331: sync 2024-04-26T12:28:46.580 INFO:tasks.workunit.client.0.smithi046.stdout:0/332: unlink d9/f3f 0 2024-04-26T12:28:46.581 INFO:tasks.workunit.client.0.smithi046.stdout:7/358: link d16/l21 d16/d27/l75 0 2024-04-26T12:28:46.581 INFO:tasks.workunit.client.0.smithi046.stdout:1/263: dread d7/d9/f17 [0,4194304] 0 2024-04-26T12:28:46.581 INFO:tasks.workunit.client.0.smithi046.stdout:0/333: fdatasync d9/dc/f36 0 2024-04-26T12:28:46.582 INFO:tasks.workunit.client.0.smithi046.stdout:1/264: creat d7/d9/f59 x:0 0 0 2024-04-26T12:28:46.583 INFO:tasks.workunit.client.0.smithi046.stdout:9/225: read d0/d2c/d47/f1a [1120680,68541] 0 2024-04-26T12:28:46.584 INFO:tasks.workunit.client.0.smithi046.stdout:0/334: link d9/dc/d2a/c3e d9/d1d/d5d/d6b/c70 0 2024-04-26T12:28:46.584 INFO:tasks.workunit.client.0.smithi046.stdout:1/265: getdents d7/d9/d2b/d39/d3c 0 2024-04-26T12:28:46.585 INFO:tasks.workunit.client.0.smithi046.stdout:1/266: symlink d7/d14/d1c/l5a 0 2024-04-26T12:28:46.585 INFO:tasks.workunit.client.0.smithi046.stdout:0/335: mknod d9/dc/d4c/d62/c71 0 2024-04-26T12:28:46.586 INFO:tasks.workunit.client.0.smithi046.stdout:9/226: truncate d0/d2c/d47/f8 1536354 0 2024-04-26T12:28:46.586 INFO:tasks.workunit.client.0.smithi046.stdout:7/359: dwrite f5 [0,4194304] 0 2024-04-26T12:28:46.587 INFO:tasks.workunit.client.0.smithi046.stdout:1/267: rename d7/c20 to d7/d9/d2b/d39/d3c/c5b 0 2024-04-26T12:28:46.587 INFO:tasks.workunit.client.0.smithi046.stdout:9/227: read - d0/d19/d21/f30 zero size 2024-04-26T12:28:46.587 INFO:tasks.workunit.client.0.smithi046.stdout:0/336: getdents d9/d1d/d40 0 2024-04-26T12:28:46.587 INFO:tasks.workunit.client.0.smithi046.stdout:7/360: truncate d16/d1a/d3e/d4f/f71 459675 0 2024-04-26T12:28:46.588 INFO:tasks.workunit.client.0.smithi046.stdout:9/228: creat d0/d29/f4c x:0 0 0 2024-04-26T12:28:46.589 INFO:tasks.workunit.client.0.smithi046.stdout:0/337: rename d9/dc/d2a/f2c to d9/dc/d4c/d62/f72 0 2024-04-26T12:28:46.589 INFO:tasks.workunit.client.0.smithi046.stdout:7/361: write d16/d1a/d31/f39 [1204270,42217] 0 2024-04-26T12:28:46.589 INFO:tasks.workunit.client.0.smithi046.stdout:7/362: sync 2024-04-26T12:28:46.590 INFO:tasks.workunit.client.0.smithi046.stdout:7/363: chown d16/d35/l36 644745 1 2024-04-26T12:28:46.590 INFO:tasks.workunit.client.0.smithi046.stdout:0/338: rename d9/c22 to d9/dc/c73 0 2024-04-26T12:28:46.591 INFO:tasks.workunit.client.0.smithi046.stdout:7/364: mknod d16/d1a/d3e/d59/c76 0 2024-04-26T12:28:46.591 INFO:tasks.workunit.client.0.smithi046.stdout:0/339: mkdir d9/d1d/d40/d41/d74 0 2024-04-26T12:28:46.592 INFO:tasks.workunit.client.0.smithi046.stdout:0/340: mknod d9/dc/c75 0 2024-04-26T12:28:46.593 INFO:tasks.workunit.client.0.smithi046.stdout:0/341: rename d9/d1d/d5d/d6b/c70 to d9/dc/d4c/d62/c76 0 2024-04-26T12:28:46.595 INFO:tasks.workunit.client.0.smithi046.stdout:1/268: truncate d7/d14/d1c/f3e 497253 0 2024-04-26T12:28:46.595 INFO:tasks.workunit.client.0.smithi046.stdout:7/365: dwrite d16/f23 [0,4194304] 0 2024-04-26T12:28:46.596 INFO:tasks.workunit.client.0.smithi046.stdout:7/366: sync 2024-04-26T12:28:46.596 INFO:tasks.workunit.client.0.smithi046.stdout:1/269: write d7/d12/d3a/f4a [2564813,35462] 0 2024-04-26T12:28:46.597 INFO:tasks.workunit.client.0.smithi046.stdout:1/270: rmdir d7 39 2024-04-26T12:28:46.598 INFO:tasks.workunit.client.0.smithi046.stdout:7/367: link d16/d1a/d31/d5a/f5b d16/d1a/d31/d4d/f77 0 2024-04-26T12:28:46.599 INFO:tasks.workunit.client.0.smithi046.stdout:7/368: mkdir d16/d1a/d31/d5a/d78 0 2024-04-26T12:28:46.600 INFO:tasks.workunit.client.0.smithi046.stdout:0/342: dwrite d9/dc/f37 [0,4194304] 0 2024-04-26T12:28:46.601 INFO:tasks.workunit.client.0.smithi046.stdout:0/343: rmdir d9/dc/dd/d45 39 2024-04-26T12:28:46.603 INFO:tasks.workunit.client.0.smithi046.stdout:0/344: symlink d9/l77 0 2024-04-26T12:28:46.603 INFO:tasks.workunit.client.0.smithi046.stdout:5/328: dread d9/f4f [0,4194304] 0 2024-04-26T12:28:46.603 INFO:tasks.workunit.client.0.smithi046.stdout:0/345: fdatasync d9/d1d/d40/d41/f6a 0 2024-04-26T12:28:46.604 INFO:tasks.workunit.client.0.smithi046.stdout:0/346: write d9/dc/f60 [1524397,127586] 0 2024-04-26T12:28:46.605 INFO:tasks.workunit.client.0.smithi046.stdout:7/369: dwrite d16/d27/d51/f63 [0,4194304] 0 2024-04-26T12:28:46.605 INFO:tasks.workunit.client.0.smithi046.stdout:7/370: chown d16/d1a/d3e/c56 276163 1 2024-04-26T12:28:46.605 INFO:tasks.workunit.client.0.smithi046.stdout:0/347: rename d9/fa to d9/d1d/d40/d41/f78 0 2024-04-26T12:28:46.606 INFO:tasks.workunit.client.0.smithi046.stdout:7/371: symlink d16/d1a/d31/d5a/d6b/l79 0 2024-04-26T12:28:46.607 INFO:tasks.workunit.client.0.smithi046.stdout:0/348: read d9/dc/dd/f13 [1731231,13836] 0 2024-04-26T12:28:46.607 INFO:tasks.workunit.client.0.smithi046.stdout:0/349: chown d9/f10 102732 1 2024-04-26T12:28:46.609 INFO:tasks.workunit.client.0.smithi046.stdout:5/329: write d9/da/f3c [677797,93016] 0 2024-04-26T12:28:46.609 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:46.608+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:46.610 INFO:tasks.workunit.client.0.smithi046.stdout:5/330: mknod d9/da/d40/c74 0 2024-04-26T12:28:46.610 INFO:tasks.workunit.client.0.smithi046.stdout:7/372: dwrite d16/d1a/d31/d4d/f5f [0,4194304] 0 2024-04-26T12:28:46.611 INFO:tasks.workunit.client.0.smithi046.stdout:5/331: creat d9/da/d15/f75 x:0 0 0 2024-04-26T12:28:46.611 INFO:tasks.workunit.client.0.smithi046.stdout:5/332: chown d9/da/dd/f60 347482620 1 2024-04-26T12:28:46.611 INFO:tasks.workunit.client.0.smithi046.stdout:5/333: sync 2024-04-26T12:28:46.612 INFO:tasks.workunit.client.0.smithi046.stdout:5/334: chown f8 0 1 2024-04-26T12:28:46.612 INFO:tasks.workunit.client.0.smithi046.stdout:5/335: creat d9/da/dd/d34/d3e/f76 x:0 0 0 2024-04-26T12:28:46.616 INFO:tasks.workunit.client.0.smithi046.stdout:7/373: write d16/d1a/d31/d4d/f77 [1043064,31065] 0 2024-04-26T12:28:46.616 INFO:tasks.workunit.client.0.smithi046.stdout:7/374: write d16/d35/f5d [4199065,69793] 0 2024-04-26T12:28:46.617 INFO:tasks.workunit.client.0.smithi046.stdout:7/375: stat f4 0 2024-04-26T12:28:46.617 INFO:tasks.workunit.client.0.smithi046.stdout:5/336: dwrite d9/f4f [0,4194304] 0 2024-04-26T12:28:46.619 INFO:tasks.workunit.client.0.smithi046.stdout:0/350: fdatasync d9/f10 0 2024-04-26T12:28:46.619 INFO:tasks.workunit.client.0.smithi046.stdout:7/376: getdents d16/d1a 0 2024-04-26T12:28:46.620 INFO:tasks.workunit.client.0.smithi046.stdout:7/377: mknod d16/d1a/d31/d4d/c7a 0 2024-04-26T12:28:46.620 INFO:tasks.workunit.client.0.smithi046.stdout:3/366: dread d2/db/f55 [0,4194304] 0 2024-04-26T12:28:46.620 INFO:tasks.workunit.client.0.smithi046.stdout:7/378: chown d16/d27/d51/f63 58963 1 2024-04-26T12:28:46.621 INFO:tasks.workunit.client.0.smithi046.stdout:0/351: getdents d9/dc/dd/d45 0 2024-04-26T12:28:46.621 INFO:tasks.workunit.client.0.smithi046.stdout:3/367: creat d2/db/d62/f87 x:0 0 0 2024-04-26T12:28:46.621 INFO:tasks.workunit.client.0.smithi046.stdout:0/352: dread - d9/dc/d2a/f4a zero size 2024-04-26T12:28:46.622 INFO:tasks.workunit.client.0.smithi046.stdout:3/368: mkdir d2/d16/d11/d1f/d74/d88 0 2024-04-26T12:28:46.626 INFO:tasks.workunit.client.0.smithi046.stdout:0/353: rename d9/d1d/d40/d41/c55 to d9/dc/d4c/d62/c79 0 2024-04-26T12:28:46.626 INFO:tasks.workunit.client.0.smithi046.stdout:3/369: write d2/db/d4a/f40 [5053973,40011] 0 2024-04-26T12:28:46.626 INFO:tasks.workunit.client.0.smithi046.stdout:0/354: fsync d9/dc/dd/d45/f49 0 2024-04-26T12:28:46.626 INFO:tasks.workunit.client.0.smithi046.stdout:3/370: mkdir d2/d16/d2c/d50/d71/d89 0 2024-04-26T12:28:46.626 INFO:tasks.workunit.client.0.smithi046.stdout:0/355: dread - d9/dc/d4c/d62/f72 zero size 2024-04-26T12:28:46.626 INFO:tasks.workunit.client.0.smithi046.stdout:3/371: mkdir d2/db/d84/d8a 0 2024-04-26T12:28:46.626 INFO:tasks.workunit.client.0.smithi046.stdout:0/356: creat d9/dc/dd/d45/d69/f7a x:0 0 0 2024-04-26T12:28:46.626 INFO:tasks.workunit.client.0.smithi046.stdout:3/372: creat d2/d16/d11/d1b/d2d/f8b x:0 0 0 2024-04-26T12:28:46.627 INFO:tasks.workunit.client.0.smithi046.stdout:3/373: creat d2/db/d84/d8a/f8c x:0 0 0 2024-04-26T12:28:46.627 INFO:tasks.workunit.client.0.smithi046.stdout:3/374: chown d2/d16/d11/d1f/l76 7563641 1 2024-04-26T12:28:46.627 INFO:tasks.workunit.client.0.smithi046.stdout:3/375: fdatasync d2/d16/d11/f4b 0 2024-04-26T12:28:46.630 INFO:tasks.workunit.client.0.smithi046.stdout:0/357: dwrite d9/f61 [0,4194304] 0 2024-04-26T12:28:46.630 INFO:tasks.workunit.client.0.smithi046.stdout:4/317: dread d0/d1/d29/f34 [0,4194304] 0 2024-04-26T12:28:46.631 INFO:tasks.workunit.client.0.smithi046.stdout:0/358: write d9/dc/dd/d45/f4b [704760,62240] 0 2024-04-26T12:28:46.631 INFO:tasks.workunit.client.0.smithi046.stdout:4/318: getdents d0/d1/d9/d19/d55 0 2024-04-26T12:28:46.632 INFO:tasks.workunit.client.0.smithi046.stdout:4/319: mknod d0/da/d17/d20/d25/c67 0 2024-04-26T12:28:46.633 INFO:tasks.workunit.client.0.smithi046.stdout:4/320: symlink d0/d1/d5/db/l68 0 2024-04-26T12:28:46.634 INFO:tasks.workunit.client.0.smithi046.stdout:4/321: creat d0/da/d17/d20/f69 x:0 0 0 2024-04-26T12:28:46.637 INFO:tasks.workunit.client.0.smithi046.stdout:4/322: truncate d0/d1/d29/f34 401390 0 2024-04-26T12:28:46.638 INFO:tasks.workunit.client.0.smithi046.stdout:4/323: chown d0/da/d17/d20/d25/c67 23461846 1 2024-04-26T12:28:46.639 INFO:tasks.workunit.client.0.smithi046.stdout:8/337: dread d7/da/df/f10 [0,4194304] 0 2024-04-26T12:28:46.640 INFO:tasks.workunit.client.0.smithi046.stdout:4/324: chown d0/d1/d5/db/l68 13934 1 2024-04-26T12:28:46.641 INFO:tasks.workunit.client.0.smithi046.stdout:8/338: write f4 [1163067,6464] 0 2024-04-26T12:28:46.641 INFO:tasks.workunit.client.0.smithi046.stdout:4/325: creat d0/d64/f6a x:0 0 0 2024-04-26T12:28:46.641 INFO:tasks.workunit.client.0.smithi046.stdout:3/376: dwrite d2/f4 [0,4194304] 0 2024-04-26T12:28:46.642 INFO:tasks.workunit.client.0.smithi046.stdout:8/339: write d7/f4a [1012625,119824] 0 2024-04-26T12:28:46.643 INFO:tasks.workunit.client.0.smithi046.stdout:1/271: dread d7/d14/d1c/f3e [0,4194304] 0 2024-04-26T12:28:46.643 INFO:tasks.workunit.client.0.smithi046.stdout:3/377: mknod d2/d16/d11/d1f/d74/d88/c8d 0 2024-04-26T12:28:46.643 INFO:tasks.workunit.client.0.smithi046.stdout:7/379: dread d16/d1a/d31/d5a/f50 [0,4194304] 0 2024-04-26T12:28:46.644 INFO:tasks.workunit.client.0.smithi046.stdout:2/311: dread d1/de/d15/d18/f47 [0,4194304] 0 2024-04-26T12:28:46.645 INFO:tasks.workunit.client.0.smithi046.stdout:3/378: unlink d2/d16/d11/d6d/l6e 0 2024-04-26T12:28:46.645 INFO:tasks.workunit.client.0.smithi046.stdout:7/380: write d16/d1a/d31/d5a/f50 [107246,67597] 0 2024-04-26T12:28:46.647 INFO:tasks.workunit.client.0.smithi046.stdout:7/381: mknod d16/d1a/d31/d62/c7b 0 2024-04-26T12:28:46.648 INFO:tasks.workunit.client.0.smithi046.stdout:4/326: read d0/d1/d5/f2b [4097386,64985] 0 2024-04-26T12:28:46.648 INFO:tasks.workunit.client.0.smithi046.stdout:8/340: dwrite d7/dc/d1b/f47 [0,4194304] 0 2024-04-26T12:28:46.648 INFO:tasks.workunit.client.0.smithi046.stdout:7/382: unlink d16/d1a/d31/d5a/f4a 0 2024-04-26T12:28:46.649 INFO:tasks.workunit.client.0.smithi046.stdout:4/327: creat d0/d1/d5/f6b x:0 0 0 2024-04-26T12:28:46.649 INFO:tasks.workunit.client.0.smithi046.stdout:6/339: dread d7/d2b/d31/f44 [0,4194304] 0 2024-04-26T12:28:46.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/272: read d7/d9/f11 [531489,16113] 0 2024-04-26T12:28:46.651 INFO:tasks.workunit.client.0.smithi046.stdout:2/312: read d1/de/f11 [1181929,60581] 0 2024-04-26T12:28:46.651 INFO:tasks.workunit.client.0.smithi046.stdout:4/328: rmdir d0/da/d17 39 2024-04-26T12:28:46.651 INFO:tasks.workunit.client.0.smithi046.stdout:7/383: fdatasync d16/d1a/d31/d4d/f77 0 2024-04-26T12:28:46.651 INFO:tasks.workunit.client.0.smithi046.stdout:0/359: dread d9/f10 [8388608,4194304] 0 2024-04-26T12:28:46.651 INFO:tasks.workunit.client.0.smithi046.stdout:9/229: dread d0/d2c/d47/f8 [0,4194304] 0 2024-04-26T12:28:46.653 INFO:tasks.workunit.client.0.smithi046.stdout:6/340: rename d7/d2b/d31/f39 to d7/d1b/f74 0 2024-04-26T12:28:46.653 INFO:tasks.workunit.client.0.smithi046.stdout:9/230: rmdir d0 39 2024-04-26T12:28:46.653 INFO:tasks.workunit.client.0.smithi046.stdout:0/360: write f3 [5014340,21339] 0 2024-04-26T12:28:46.653 INFO:tasks.workunit.client.0.smithi046.stdout:7/384: read d16/d1a/d3e/f44 [801287,75827] 0 2024-04-26T12:28:46.654 INFO:tasks.workunit.client.0.smithi046.stdout:6/341: read d7/f29 [1542265,10361] 0 2024-04-26T12:28:46.654 INFO:tasks.workunit.client.0.smithi046.stdout:9/231: creat d0/d2c/f4d x:0 0 0 2024-04-26T12:28:46.654 INFO:tasks.workunit.client.0.smithi046.stdout:0/361: mknod d9/d1d/d40/d41/c7b 0 2024-04-26T12:28:46.655 INFO:tasks.workunit.client.0.smithi046.stdout:7/385: chown d16/d27/l30 131337881 1 2024-04-26T12:28:46.655 INFO:tasks.workunit.client.0.smithi046.stdout:1/273: getdents d7/d14 0 2024-04-26T12:28:46.655 INFO:tasks.workunit.client.0.smithi046.stdout:8/341: dread d7/dc/f13 [0,4194304] 0 2024-04-26T12:28:46.657 INFO:tasks.workunit.client.0.smithi046.stdout:6/342: read - d7/d1b/d37/f6b zero size 2024-04-26T12:28:46.658 INFO:tasks.workunit.client.0.smithi046.stdout:8/342: symlink d7/d24/d50/d2a/l71 0 2024-04-26T12:28:46.660 INFO:tasks.workunit.client.0.smithi046.stdout:1/274: write d7/d9/f18 [1701170,124690] 0 2024-04-26T12:28:46.660 INFO:tasks.workunit.client.0.smithi046.stdout:4/329: dread d0/da/d17/f46 [0,4194304] 0 2024-04-26T12:28:46.661 INFO:tasks.workunit.client.0.smithi046.stdout:6/343: creat d7/d1b/d6a/d57/f75 x:0 0 0 2024-04-26T12:28:46.662 INFO:tasks.workunit.client.0.smithi046.stdout:2/313: dwrite d1/de/d15/f4e [0,4194304] 0 2024-04-26T12:28:46.665 INFO:tasks.workunit.client.0.smithi046.stdout:1/275: write d7/d12/d3a/f4a [5783769,53919] 0 2024-04-26T12:28:46.665 INFO:tasks.workunit.client.0.smithi046.stdout:6/344: fsync d7/d2b/f53 0 2024-04-26T12:28:46.665 INFO:tasks.workunit.client.0.smithi046.stdout:4/330: chown d0/d1/d9/l28 6526639 1 2024-04-26T12:28:46.665 INFO:tasks.workunit.client.0.smithi046.stdout:0/362: dwrite d9/f10 [8388608,4194304] 0 2024-04-26T12:28:46.665 INFO:tasks.workunit.client.0.smithi046.stdout:7/386: dwrite d16/f20 [0,4194304] 0 2024-04-26T12:28:46.666 INFO:tasks.workunit.client.0.smithi046.stdout:9/232: dwrite d0/d2c/d47/f2d [0,4194304] 0 2024-04-26T12:28:46.666 INFO:tasks.workunit.client.0.smithi046.stdout:8/343: link d7/d24/f2f d7/d24/d50/f72 0 2024-04-26T12:28:46.666 INFO:tasks.workunit.client.0.smithi046.stdout:7/387: fsync d16/d1a/d31/d5a/f3d 0 2024-04-26T12:28:46.667 INFO:tasks.workunit.client.0.smithi046.stdout:4/331: chown d0/da/d17/d20/d25/f33 5 1 2024-04-26T12:28:46.667 INFO:tasks.workunit.client.0.smithi046.stdout:5/337: dread d9/f41 [0,4194304] 0 2024-04-26T12:28:46.667 INFO:tasks.workunit.client.0.smithi046.stdout:1/276: write d7/d9/f58 [301230,48003] 0 2024-04-26T12:28:46.667 INFO:tasks.workunit.client.0.smithi046.stdout:9/233: creat d0/d2c/f4e x:0 0 0 2024-04-26T12:28:46.667 INFO:tasks.workunit.client.0.smithi046.stdout:6/345: creat d7/d1b/d37/f76 x:0 0 0 2024-04-26T12:28:46.668 INFO:tasks.workunit.client.0.smithi046.stdout:2/314: mkdir d1/de/d2b/d68 0 2024-04-26T12:28:46.668 INFO:tasks.workunit.client.0.smithi046.stdout:5/338: write d9/da/d18/f24 [2199455,76552] 0 2024-04-26T12:28:46.668 INFO:tasks.workunit.client.0.smithi046.stdout:8/344: rmdir d7/d24/d50/d2a/d54/d67 0 2024-04-26T12:28:46.668 INFO:tasks.workunit.client.0.smithi046.stdout:7/388: creat d16/d1a/d31/d5a/f7c x:0 0 0 2024-04-26T12:28:46.669 INFO:tasks.workunit.client.0.smithi046.stdout:1/277: unlink d7/d9/d2b/d31/c46 0 2024-04-26T12:28:46.669 INFO:tasks.workunit.client.0.smithi046.stdout:4/332: creat d0/d1/d9/d19/f6c x:0 0 0 2024-04-26T12:28:46.669 INFO:tasks.workunit.client.0.smithi046.stdout:6/346: mkdir d7/d1b/d47/d65/d77 0 2024-04-26T12:28:46.670 INFO:tasks.workunit.client.0.smithi046.stdout:6/347: chown d7/d1b/d6a 2 1 2024-04-26T12:28:46.670 INFO:tasks.workunit.client.0.smithi046.stdout:4/333: chown d0/da/d17/d20/f39 26147 1 2024-04-26T12:28:46.670 INFO:tasks.workunit.client.0.smithi046.stdout:1/278: mkdir d7/d9/d2b/d39/d5c 0 2024-04-26T12:28:46.670 INFO:tasks.workunit.client.0.smithi046.stdout:6/348: readlink l4 0 2024-04-26T12:28:46.671 INFO:tasks.workunit.client.0.smithi046.stdout:8/345: mknod d7/dc/d27/c73 0 2024-04-26T12:28:46.671 INFO:tasks.workunit.client.0.smithi046.stdout:7/389: symlink d16/d1a/d31/l7d 0 2024-04-26T12:28:46.671 INFO:tasks.workunit.client.0.smithi046.stdout:8/346: chown d7/d24/d50/f2c 35972366 1 2024-04-26T12:28:46.672 INFO:tasks.workunit.client.0.smithi046.stdout:9/234: getdents d0/d2c/d3d 0 2024-04-26T12:28:46.672 INFO:tasks.workunit.client.0.smithi046.stdout:6/349: symlink d7/d1b/d6a/d57/l78 0 2024-04-26T12:28:46.672 INFO:tasks.workunit.client.0.smithi046.stdout:7/390: mkdir d16/d27/d7e 0 2024-04-26T12:28:46.672 INFO:tasks.workunit.client.0.smithi046.stdout:2/315: getdents d1/de/d2b 0 2024-04-26T12:28:46.672 INFO:tasks.workunit.client.0.smithi046.stdout:6/350: read - d7/d1b/d6a/d57/f5c zero size 2024-04-26T12:28:46.674 INFO:tasks.workunit.client.0.smithi046.stdout:9/235: creat d0/d2c/d3d/f4f x:0 0 0 2024-04-26T12:28:46.674 INFO:tasks.workunit.client.0.smithi046.stdout:4/334: rename d0/d1/d9 to d0/da/d17/d20/d25/d35/d6d 0 2024-04-26T12:28:46.675 INFO:tasks.workunit.client.0.smithi046.stdout:8/347: rename d7/d24/d50/d2a/d39/d52 to d7/d1c/d74 0 2024-04-26T12:28:46.676 INFO:tasks.workunit.client.0.smithi046.stdout:9/236: creat d0/d19/f50 x:0 0 0 2024-04-26T12:28:46.676 INFO:tasks.workunit.client.0.smithi046.stdout:0/363: sync 2024-04-26T12:28:46.677 INFO:tasks.workunit.client.0.smithi046.stdout:4/335: write d0/da/d17/d20/f39 [1245894,59867] 0 2024-04-26T12:28:46.678 INFO:tasks.workunit.client.0.smithi046.stdout:9/237: mkdir d0/d19/d51 0 2024-04-26T12:28:46.678 INFO:tasks.workunit.client.0.smithi046.stdout:0/364: creat d9/d1d/d40/d41/f7c x:0 0 0 2024-04-26T12:28:46.679 INFO:tasks.workunit.client.0.smithi046.stdout:4/336: chown d0/da/d17/d20/d25/d35/d61 4852691 1 2024-04-26T12:28:46.679 INFO:tasks.workunit.client.0.smithi046.stdout:0/365: chown d9/d1d/d40/d41/d74 17 1 2024-04-26T12:28:46.679 INFO:tasks.workunit.client.0.smithi046.stdout:1/279: dwrite d7/db/ff [0,4194304] 0 2024-04-26T12:28:46.681 INFO:tasks.workunit.client.0.smithi046.stdout:6/351: dwrite d7/d1b/d37/f76 [0,4194304] 0 2024-04-26T12:28:46.681 INFO:tasks.workunit.client.0.smithi046.stdout:4/337: dread - d0/da/d17/d20/f69 zero size 2024-04-26T12:28:46.681 INFO:tasks.workunit.client.0.smithi046.stdout:0/366: dread - d9/dc/d4c/d62/f72 zero size 2024-04-26T12:28:46.683 INFO:tasks.workunit.client.0.smithi046.stdout:8/348: dread d7/da/df/f2b [0,4194304] 0 2024-04-26T12:28:46.683 INFO:tasks.workunit.client.0.smithi046.stdout:7/391: read d16/d35/f3b [2401133,101949] 0 2024-04-26T12:28:46.683 INFO:tasks.workunit.client.0.smithi046.stdout:0/367: rename d9/f20 to d9/d1d/d5d/d6b/f7d 0 2024-04-26T12:28:46.684 INFO:tasks.workunit.client.0.smithi046.stdout:4/338: link d0/d1/d5/db/f10 d0/d1/d29/f6e 0 2024-04-26T12:28:46.685 INFO:tasks.workunit.client.0.smithi046.stdout:0/368: fsync d9/d1d/d40/d41/f78 0 2024-04-26T12:28:46.685 INFO:tasks.workunit.client.0.smithi046.stdout:8/349: rename d7/d24/d56/c59 to d7/c75 0 2024-04-26T12:28:46.685 INFO:tasks.workunit.client.0.smithi046.stdout:7/392: link d16/d1a/d31/d55/d6d/c73 d16/d1a/d3e/d4f/c7f 0 2024-04-26T12:28:46.687 INFO:tasks.workunit.client.0.smithi046.stdout:6/352: dwrite d7/d1b/d6a/d57/f5c [0,4194304] 0 2024-04-26T12:28:46.687 INFO:tasks.workunit.client.0.smithi046.stdout:6/353: fsync d7/d1b/f4b 0 2024-04-26T12:28:46.688 INFO:tasks.workunit.client.0.smithi046.stdout:8/350: mknod d7/d24/d50/d2a/d39/c76 0 2024-04-26T12:28:46.688 INFO:tasks.workunit.client.0.smithi046.stdout:6/354: chown l4 61296799 1 2024-04-26T12:28:46.689 INFO:tasks.workunit.client.0.smithi046.stdout:0/369: truncate d9/f10 9297920 0 2024-04-26T12:28:46.690 INFO:tasks.workunit.client.0.smithi046.stdout:3/379: dread d2/db/fe [0,4194304] 0 2024-04-26T12:28:46.691 INFO:tasks.workunit.client.0.smithi046.stdout:0/370: rename d9/d1d/d40/d41/d74 to d9/d1d/d40/d41/d7e 0 2024-04-26T12:28:46.692 INFO:tasks.workunit.client.0.smithi046.stdout:3/380: write d2/db/f15 [1728011,83072] 0 2024-04-26T12:28:46.692 INFO:tasks.workunit.client.0.smithi046.stdout:1/280: dread d7/d9/f58 [0,4194304] 0 2024-04-26T12:28:46.693 INFO:tasks.workunit.client.0.smithi046.stdout:8/351: dread d7/d24/f49 [0,4194304] 0 2024-04-26T12:28:46.693 INFO:tasks.workunit.client.0.smithi046.stdout:0/371: symlink d9/dc/l7f 0 2024-04-26T12:28:46.694 INFO:tasks.workunit.client.0.smithi046.stdout:3/381: creat d2/f8e x:0 0 0 2024-04-26T12:28:46.694 INFO:tasks.workunit.client.0.smithi046.stdout:1/281: rmdir d7/d9/d2b/d39 39 2024-04-26T12:28:46.694 INFO:tasks.workunit.client.0.smithi046.stdout:8/352: dread - d7/dc/f70 zero size 2024-04-26T12:28:46.694 INFO:tasks.workunit.client.0.smithi046.stdout:0/372: creat d9/dc/d4c/d62/f80 x:0 0 0 2024-04-26T12:28:46.695 INFO:tasks.workunit.client.0.smithi046.stdout:6/355: dwrite d7/d16/f4a [0,4194304] 0 2024-04-26T12:28:46.695 INFO:tasks.workunit.client.0.smithi046.stdout:3/382: mknod d2/db/d84/d8a/c8f 0 2024-04-26T12:28:46.696 INFO:tasks.workunit.client.0.smithi046.stdout:8/353: write d7/dc/f13 [2242468,119536] 0 2024-04-26T12:28:46.696 INFO:tasks.workunit.client.0.smithi046.stdout:3/383: readlink d2/d16/d35/l63 0 2024-04-26T12:28:46.696 INFO:tasks.workunit.client.0.smithi046.stdout:0/373: chown d9/d1d/d5d/d6b/c6d 25 1 2024-04-26T12:28:46.697 INFO:tasks.workunit.client.0.smithi046.stdout:6/356: truncate d7/f8 835646 0 2024-04-26T12:28:46.697 INFO:tasks.workunit.client.0.smithi046.stdout:3/384: read - d2/d16/d11/f4b zero size 2024-04-26T12:28:46.697 INFO:tasks.workunit.client.0.smithi046.stdout:8/354: fdatasync d7/d24/f2f 0 2024-04-26T12:28:46.698 INFO:tasks.workunit.client.0.smithi046.stdout:6/357: creat d7/f79 x:0 0 0 2024-04-26T12:28:46.702 INFO:tasks.workunit.client.0.smithi046.stdout:8/355: read d7/da/f23 [2222009,16499] 0 2024-04-26T12:28:46.702 INFO:tasks.workunit.client.0.smithi046.stdout:5/339: dread d9/da/d18/f24 [0,4194304] 0 2024-04-26T12:28:46.703 INFO:tasks.workunit.client.0.smithi046.stdout:1/282: dwrite d7/d12/d3a/f43 [0,4194304] 0 2024-04-26T12:28:46.704 INFO:tasks.workunit.client.0.smithi046.stdout:9/238: dread d0/f15 [0,4194304] 0 2024-04-26T12:28:46.705 INFO:tasks.workunit.client.0.smithi046.stdout:5/340: creat d9/da/d18/f77 x:0 0 0 2024-04-26T12:28:46.706 INFO:tasks.workunit.client.0.smithi046.stdout:4/339: dread d0/da/d17/d20/d25/d35/f49 [0,4194304] 0 2024-04-26T12:28:46.706 INFO:tasks.workunit.client.0.smithi046.stdout:1/283: rename d7/d14/d1c to d7/d14/d5d 0 2024-04-26T12:28:46.707 INFO:tasks.workunit.client.0.smithi046.stdout:9/239: mkdir d0/d2c/d3d/d52 0 2024-04-26T12:28:46.707 INFO:tasks.workunit.client.0.smithi046.stdout:6/358: dwrite d7/d1b/f24 [0,4194304] 0 2024-04-26T12:28:46.708 INFO:tasks.workunit.client.0.smithi046.stdout:5/341: creat d9/da/dd/d34/d3e/d3f/f78 x:0 0 0 2024-04-26T12:28:46.708 INFO:tasks.workunit.client.0.smithi046.stdout:6/359: rmdir d7/d16 39 2024-04-26T12:28:46.708 INFO:tasks.workunit.client.0.smithi046.stdout:3/385: dwrite d2/d16/d2c/f36 [0,4194304] 0 2024-04-26T12:28:46.709 INFO:tasks.workunit.client.0.smithi046.stdout:9/240: creat d0/d19/d21/f53 x:0 0 0 2024-04-26T12:28:46.709 INFO:tasks.workunit.client.0.smithi046.stdout:4/340: symlink d0/da/d17/d20/d25/d35/d6d/d19/d55/l6f 0 2024-04-26T12:28:46.709 INFO:tasks.workunit.client.0.smithi046.stdout:5/342: write d9/da/dd/d5d/f6e [979541,69466] 0 2024-04-26T12:28:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:6/360: write d7/d1b/d37/f76 [4507837,44772] 0 2024-04-26T12:28:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:3/386: creat d2/d16/d2c/d50/f90 x:0 0 0 2024-04-26T12:28:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:9/241: rename d0/d19/d21/l3c to d0/d2c/d47/l54 0 2024-04-26T12:28:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:6/361: fsync d7/f54 0 2024-04-26T12:28:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:5/343: mknod d9/da/dd/d5d/c79 0 2024-04-26T12:28:46.711 INFO:tasks.workunit.client.0.smithi046.stdout:9/242: creat d0/d2c/f55 x:0 0 0 2024-04-26T12:28:46.712 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:46.709+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:46.712 INFO:tasks.workunit.client.0.smithi046.stdout:3/387: getdents d2/d16/d11/d1b 0 2024-04-26T12:28:46.713 INFO:tasks.workunit.client.0.smithi046.stdout:4/341: rename d0/da/d17/d20/d25/d35/d6d/d51 to d0/da/d70 0 2024-04-26T12:28:46.713 INFO:tasks.workunit.client.0.smithi046.stdout:5/344: rename d9/da/l23 to d9/da/d3b/l7a 0 2024-04-26T12:28:46.713 INFO:tasks.workunit.client.0.smithi046.stdout:3/388: write d2/db/d4a/f86 [463602,8898] 0 2024-04-26T12:28:46.714 INFO:tasks.workunit.client.0.smithi046.stdout:5/345: unlink d9/da/d18/f42 0 2024-04-26T12:28:46.715 INFO:tasks.workunit.client.0.smithi046.stdout:5/346: chown d9/da/d18/l54 18 1 2024-04-26T12:28:46.716 INFO:tasks.workunit.client.0.smithi046.stdout:5/347: write d9/da/f10 [1366819,36545] 0 2024-04-26T12:28:46.718 INFO:tasks.workunit.client.0.smithi046.stdout:9/243: dread d0/d29/f37 [0,4194304] 0 2024-04-26T12:28:46.718 INFO:tasks.workunit.client.0.smithi046.stdout:5/348: rename d9/da/f28 to d9/da/f7b 0 2024-04-26T12:28:46.719 INFO:tasks.workunit.client.0.smithi046.stdout:3/389: dwrite d2/db/d4a/f3b [0,4194304] 0 2024-04-26T12:28:46.719 INFO:tasks.workunit.client.0.smithi046.stdout:9/244: creat d0/d2c/d47/f56 x:0 0 0 2024-04-26T12:28:46.720 INFO:tasks.workunit.client.0.smithi046.stdout:5/349: dread - d9/da/d18/f77 zero size 2024-04-26T12:28:46.720 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:46.720 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:46.721 INFO:tasks.workunit.client.0.smithi046.stdout:9/245: write d0/d2c/d3d/f4f [654205,3236] 0 2024-04-26T12:28:46.721 INFO:tasks.workunit.client.0.smithi046.stdout:5/350: dread - d9/da/dd/d69/f70 zero size 2024-04-26T12:28:46.722 INFO:tasks.workunit.client.0.smithi046.stdout:6/362: dread d7/d1b/d6a/f5a [0,4194304] 0 2024-04-26T12:28:46.723 INFO:tasks.workunit.client.0.smithi046.stdout:1/284: dread d7/d9/f11 [0,4194304] 0 2024-04-26T12:28:46.723 INFO:tasks.workunit.client.0.smithi046.stdout:9/246: write d0/d19/d21/f4a [260884,106585] 0 2024-04-26T12:28:46.723 INFO:tasks.workunit.client.0.smithi046.stdout:4/342: truncate d0/da/d17/d20/d25/d35/d6d/d19/f1a 1761219 0 2024-04-26T12:28:46.723 INFO:tasks.workunit.client.0.smithi046.stdout:0/374: dread d9/dc/f32 [0,4194304] 0 2024-04-26T12:28:46.725 INFO:tasks.workunit.client.0.smithi046.stdout:9/247: creat d0/d19/d51/f57 x:0 0 0 2024-04-26T12:28:46.725 INFO:tasks.workunit.client.0.smithi046.stdout:1/285: mknod d7/d14/d5d/c5e 0 2024-04-26T12:28:46.726 INFO:tasks.workunit.client.0.smithi046.stdout:2/316: sync 2024-04-26T12:28:46.726 INFO:tasks.workunit.client.0.smithi046.stdout:7/393: sync 2024-04-26T12:28:46.726 INFO:tasks.workunit.client.0.smithi046.stdout:4/343: unlink d0/da/d17/d20/d25/f45 0 2024-04-26T12:28:46.726 INFO:tasks.workunit.client.0.smithi046.stdout:3/390: dwrite d2/f4 [0,4194304] 0 2024-04-26T12:28:46.726 INFO:tasks.workunit.client.0.smithi046.stdout:0/375: link d9/dc/c75 d9/dc/dd/d45/c81 0 2024-04-26T12:28:46.727 INFO:tasks.workunit.client.0.smithi046.stdout:1/286: truncate d7/d12/f22 486413 0 2024-04-26T12:28:46.727 INFO:tasks.workunit.client.0.smithi046.stdout:9/248: truncate d0/d19/d21/f3e 947778 0 2024-04-26T12:28:46.727 INFO:tasks.workunit.client.0.smithi046.stdout:7/394: creat d16/d1a/d31/d62/f80 x:0 0 0 2024-04-26T12:28:46.728 INFO:tasks.workunit.client.0.smithi046.stdout:7/395: mkdir d16/d3f/d81 0 2024-04-26T12:28:46.729 INFO:tasks.workunit.client.0.smithi046.stdout:9/249: dread - d0/d2c/d47/f56 zero size 2024-04-26T12:28:46.729 INFO:tasks.workunit.client.0.smithi046.stdout:4/344: link d0/d1/d5/c32 d0/da/d17/d20/d25/d35/d6d/d19/d55/c71 0 2024-04-26T12:28:46.731 INFO:tasks.workunit.client.0.smithi046.stdout:1/287: getdents d7/d9/d2b/d31 0 2024-04-26T12:28:46.731 INFO:tasks.workunit.client.0.smithi046.stdout:9/250: creat d0/d2c/d47/f58 x:0 0 0 2024-04-26T12:28:46.731 INFO:tasks.workunit.client.0.smithi046.stdout:7/396: symlink d16/d1a/d69/l82 0 2024-04-26T12:28:46.732 INFO:tasks.workunit.client.0.smithi046.stdout:9/251: chown d0/c3f 53 1 2024-04-26T12:28:46.732 INFO:tasks.workunit.client.0.smithi046.stdout:7/397: symlink d16/d1a/d31/l83 0 2024-04-26T12:28:46.733 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:46.734 INFO:tasks.workunit.client.0.smithi046.stdout:4/345: rename d0/d1/d5/f11 to d0/d41/d3f/f72 0 2024-04-26T12:28:46.734 INFO:tasks.workunit.client.0.smithi046.stdout:3/391: truncate d2/d16/d11/f3d 1800962 0 2024-04-26T12:28:46.735 INFO:tasks.workunit.client.0.smithi046.stdout:7/398: mknod d16/d1a/d69/c84 0 2024-04-26T12:28:46.735 INFO:tasks.workunit.client.0.smithi046.stdout:6/363: dread d7/d16/f56 [0,4194304] 0 2024-04-26T12:28:46.736 INFO:tasks.workunit.client.0.smithi046.stdout:0/376: dwrite d9/dc/dd/f24 [0,4194304] 0 2024-04-26T12:28:46.736 INFO:tasks.workunit.client.0.smithi046.stdout:2/317: dwrite d1/de/d2b/f37 [0,4194304] 0 2024-04-26T12:28:46.738 INFO:tasks.workunit.client.0.smithi046.stdout:3/392: write d2/db/f25 [2247597,46337] 0 2024-04-26T12:28:46.738 INFO:tasks.workunit.client.0.smithi046.stdout:4/346: write d0/d1/d29/f30 [2689247,56257] 0 2024-04-26T12:28:46.738 INFO:tasks.workunit.client.0.smithi046.stdout:4/347: stat d0 0 2024-04-26T12:28:46.738 INFO:tasks.workunit.client.0.smithi046.stdout:7/399: fdatasync f9 0 2024-04-26T12:28:46.738 INFO:tasks.workunit.client.0.smithi046.stdout:1/288: getdents d7/d9/d2b/d39 0 2024-04-26T12:28:46.738 INFO:tasks.workunit.client.0.smithi046.stdout:3/393: write d2/db/d84/d8a/f8c [106995,77867] 0 2024-04-26T12:28:46.739 INFO:tasks.workunit.client.0.smithi046.stdout:6/364: rename d7/d1b/d6a/d57/l78 to d7/l7a 0 2024-04-26T12:28:46.739 INFO:tasks.workunit.client.0.smithi046.stdout:2/318: getdents d1/d42 0 2024-04-26T12:28:46.739 INFO:tasks.workunit.client.0.smithi046.stdout:4/348: creat d0/da/d21/f73 x:0 0 0 2024-04-26T12:28:46.740 INFO:tasks.workunit.client.0.smithi046.stdout:0/377: link d9/d1d/c23 d9/d1d/d40/d41/d7e/c82 0 2024-04-26T12:28:46.740 INFO:tasks.workunit.client.0.smithi046.stdout:1/289: mkdir d7/d14/d5d/d32/d5f 0 2024-04-26T12:28:46.741 INFO:tasks.workunit.client.0.smithi046.stdout:9/252: dread d0/d2c/d47/f13 [0,4194304] 0 2024-04-26T12:28:46.741 INFO:tasks.workunit.client.0.smithi046.stdout:7/400: sync 2024-04-26T12:28:46.741 INFO:tasks.workunit.client.0.smithi046.stdout:1/290: read d7/d14/d5d/f3e [412908,62925] 0 2024-04-26T12:28:46.741 INFO:tasks.workunit.client.0.smithi046.stdout:6/365: chown d7/d16/l18 84 1 2024-04-26T12:28:46.742 INFO:tasks.workunit.client.0.smithi046.stdout:0/378: getdents d9 0 2024-04-26T12:28:46.742 INFO:tasks.workunit.client.0.smithi046.stdout:7/401: symlink d16/d35/l85 0 2024-04-26T12:28:46.744 INFO:tasks.workunit.client.0.smithi046.stdout:2/319: truncate d1/de/f27 3268867 0 2024-04-26T12:28:46.744 INFO:tasks.workunit.client.0.smithi046.stdout:1/291: rename d7/d14/d5d/f3e to d7/d12/f60 0 2024-04-26T12:28:46.744 INFO:tasks.workunit.client.0.smithi046.stdout:9/253: write d0/d29/f2a [4259326,4433] 0 2024-04-26T12:28:46.744 INFO:tasks.workunit.client.0.smithi046.stdout:6/366: creat d7/d1b/d47/f7b x:0 0 0 2024-04-26T12:28:46.746 INFO:tasks.workunit.client.0.smithi046.stdout:6/367: fsync d7/d2b/d31/f2f 0 2024-04-26T12:28:46.746 INFO:tasks.workunit.client.0.smithi046.stdout:2/320: mknod d1/de/d67/c69 0 2024-04-26T12:28:46.746 INFO:tasks.workunit.client.0.smithi046.stdout:0/379: link d9/dc/f2d d9/d1d/d40/d41/d43/f83 0 2024-04-26T12:28:46.747 INFO:tasks.workunit.client.0.smithi046.stdout:7/402: dread d16/d1a/d3e/d4f/f71 [0,4194304] 0 2024-04-26T12:28:46.747 INFO:tasks.workunit.client.0.smithi046.stdout:4/349: dwrite d0/d1/d29/f30 [4194304,4194304] 0 2024-04-26T12:28:46.747 INFO:tasks.workunit.client.0.smithi046.stdout:5/351: dread d9/da/dd/f13 [0,4194304] 0 2024-04-26T12:28:46.748 INFO:tasks.workunit.client.0.smithi046.stdout:2/321: mknod d1/d42/c6a 0 2024-04-26T12:28:46.748 INFO:tasks.workunit.client.0.smithi046.stdout:8/356: dread d7/dc/f18 [0,4194304] 0 2024-04-26T12:28:46.748 INFO:tasks.workunit.client.0.smithi046.stdout:7/403: mknod d16/d27/d51/c86 0 2024-04-26T12:28:46.749 INFO:tasks.workunit.client.0.smithi046.stdout:0/380: symlink d9/d1d/d40/l84 0 2024-04-26T12:28:46.750 INFO:tasks.workunit.client.0.smithi046.stdout:8/357: creat d7/d24/d50/f77 x:0 0 0 2024-04-26T12:28:46.751 INFO:tasks.workunit.client.0.smithi046.stdout:5/352: creat d9/da/dd/d34/d44/f7c x:0 0 0 2024-04-26T12:28:46.751 INFO:tasks.workunit.client.0.smithi046.stdout:4/350: write d0/d1/f3b [950,14169] 0 2024-04-26T12:28:46.752 INFO:tasks.workunit.client.0.smithi046.stdout:7/404: creat d16/d1a/d31/d5a/d78/f87 x:0 0 0 2024-04-26T12:28:46.753 INFO:tasks.workunit.client.0.smithi046.stdout:8/358: getdents d7/d1c/d74 0 2024-04-26T12:28:46.753 INFO:tasks.workunit.client.0.smithi046.stdout:1/292: dwrite d7/d12/d3a/f4a [4194304,4194304] 0 2024-04-26T12:28:46.755 INFO:tasks.workunit.client.0.smithi046.stdout:0/381: read d9/f12 [3959706,50038] 0 2024-04-26T12:28:46.756 INFO:tasks.workunit.client.0.smithi046.stdout:8/359: write d7/d24/d50/d2a/f57 [421785,124896] 0 2024-04-26T12:28:46.756 INFO:tasks.workunit.client.0.smithi046.stdout:7/405: truncate d16/d1a/f53 4410468 0 2024-04-26T12:28:46.756 INFO:tasks.workunit.client.0.smithi046.stdout:2/322: write d1/de/d65/d4a/d58/f5c [631054,41513] 0 2024-04-26T12:28:46.757 INFO:tasks.workunit.client.0.smithi046.stdout:2/323: sync 2024-04-26T12:28:46.757 INFO:tasks.workunit.client.0.smithi046.stdout:6/368: dwrite d7/d2b/d31/f2f [0,4194304] 0 2024-04-26T12:28:46.757 INFO:tasks.workunit.client.0.smithi046.stdout:5/353: getdents d9/da/d40 0 2024-04-26T12:28:46.760 INFO:tasks.workunit.client.0.smithi046.stdout:0/382: mknod d9/d1d/d40/d41/d7e/c85 0 2024-04-26T12:28:46.760 INFO:tasks.workunit.client.0.smithi046.stdout:8/360: dread - d7/d24/d50/d2a/d39/f61 zero size 2024-04-26T12:28:46.761 INFO:tasks.workunit.client.0.smithi046.stdout:7/406: write d16/d1a/d31/f70 [143246,123003] 0 2024-04-26T12:28:46.761 INFO:tasks.workunit.client.0.smithi046.stdout:6/369: mknod d7/d1b/d6a/d57/c7c 0 2024-04-26T12:28:46.762 INFO:tasks.workunit.client.0.smithi046.stdout:8/361: rmdir d7/dc 39 2024-04-26T12:28:46.762 INFO:tasks.workunit.client.0.smithi046.stdout:4/351: dwrite d0/d1/d29/f5b [0,4194304] 0 2024-04-26T12:28:46.762 INFO:tasks.workunit.client.0.smithi046.stdout:6/370: read - d7/d1b/d6a/f5f zero size 2024-04-26T12:28:46.763 INFO:tasks.workunit.client.0.smithi046.stdout:5/354: rename d9/da/dd/d34/d3e/d3f to d9/da/d18/d7d 0 2024-04-26T12:28:46.763 INFO:tasks.workunit.client.0.smithi046.stdout:0/383: stat d9/dc/d2a/c65 0 2024-04-26T12:28:46.763 INFO:tasks.workunit.client.0.smithi046.stdout:3/394: dread d2/db/f25 [0,4194304] 0 2024-04-26T12:28:46.763 INFO:tasks.workunit.client.0.smithi046.stdout:0/384: sync 2024-04-26T12:28:46.763 INFO:tasks.workunit.client.0.smithi046.stdout:4/352: readlink d0/d41/l2a 0 2024-04-26T12:28:46.763 INFO:tasks.workunit.client.0.smithi046.stdout:0/385: stat d9/f29 0 2024-04-26T12:28:46.764 INFO:tasks.workunit.client.0.smithi046.stdout:7/407: creat d16/d1a/d31/d62/f88 x:0 0 0 2024-04-26T12:28:46.764 INFO:tasks.workunit.client.0.smithi046.stdout:8/362: symlink d7/d1c/d74/l78 0 2024-04-26T12:28:46.765 INFO:tasks.workunit.client.0.smithi046.stdout:4/353: mkdir d0/da/d17/d20/d74 0 2024-04-26T12:28:46.765 INFO:tasks.workunit.client.0.smithi046.stdout:1/293: dread d7/d12/f36 [0,4194304] 0 2024-04-26T12:28:46.765 INFO:tasks.workunit.client.0.smithi046.stdout:5/355: mkdir d9/da/dd/d69/d7e 0 2024-04-26T12:28:46.765 INFO:tasks.workunit.client.0.smithi046.stdout:8/363: readlink d7/d24/l26 0 2024-04-26T12:28:46.766 INFO:tasks.workunit.client.0.smithi046.stdout:7/408: mkdir d16/d1a/d31/d55/d6d/d89 0 2024-04-26T12:28:46.766 INFO:tasks.workunit.client.0.smithi046.stdout:7/409: stat d16/d4e 0 2024-04-26T12:28:46.767 INFO:tasks.workunit.client.0.smithi046.stdout:5/356: creat d9/da/d3b/d35/f7f x:0 0 0 2024-04-26T12:28:46.769 INFO:tasks.workunit.client.0.smithi046.stdout:8/364: creat d7/dc/d1b/f79 x:0 0 0 2024-04-26T12:28:46.770 INFO:tasks.workunit.client.0.smithi046.stdout:5/357: write d9/da/f20 [2480242,59571] 0 2024-04-26T12:28:46.771 INFO:tasks.workunit.client.0.smithi046.stdout:4/354: getdents d0/d1 0 2024-04-26T12:28:46.771 INFO:tasks.workunit.client.0.smithi046.stdout:8/365: readlink l3 0 2024-04-26T12:28:46.771 INFO:tasks.workunit.client.0.smithi046.stdout:9/254: dread d0/d19/f41 [0,4194304] 0 2024-04-26T12:28:46.772 INFO:tasks.workunit.client.0.smithi046.stdout:3/395: dwrite d2/d16/f73 [0,4194304] 0 2024-04-26T12:28:46.773 INFO:tasks.workunit.client.0.smithi046.stdout:6/371: dwrite d7/d2b/d31/f43 [4194304,4194304] 0 2024-04-26T12:28:46.774 INFO:tasks.workunit.client.0.smithi046.stdout:9/255: creat d0/d2c/d3d/d52/f59 x:0 0 0 2024-04-26T12:28:46.774 INFO:tasks.workunit.client.0.smithi046.stdout:1/294: dwrite d7/db/ff [0,4194304] 0 2024-04-26T12:28:46.775 INFO:tasks.workunit.client.0.smithi046.stdout:3/396: write d2/d16/d11/d23/f26 [895894,106338] 0 2024-04-26T12:28:46.776 INFO:tasks.workunit.client.0.smithi046.stdout:5/358: mknod d9/da/dd/d34/d44/c80 0 2024-04-26T12:28:46.777 INFO:tasks.workunit.client.0.smithi046.stdout:6/372: creat d7/d1b/d37/f7d x:0 0 0 2024-04-26T12:28:46.777 INFO:tasks.workunit.client.0.smithi046.stdout:0/386: truncate d9/dc/dd/f27 2957755 0 2024-04-26T12:28:46.778 INFO:tasks.workunit.client.0.smithi046.stdout:6/373: stat l6 0 2024-04-26T12:28:46.778 INFO:tasks.workunit.client.0.smithi046.stdout:3/397: fdatasync d2/d16/d35/f66 0 2024-04-26T12:28:46.778 INFO:tasks.workunit.client.0.smithi046.stdout:9/256: link d0/f5 d0/d2c/d3d/d52/f5a 0 2024-04-26T12:28:46.779 INFO:tasks.workunit.client.0.smithi046.stdout:3/398: creat d2/db/d4a/f91 x:0 0 0 2024-04-26T12:28:46.779 INFO:tasks.workunit.client.0.smithi046.stdout:6/374: chown d7/c12 76 1 2024-04-26T12:28:46.780 INFO:tasks.workunit.client.0.smithi046.stdout:1/295: chown d7/d14/d5d/d32/l37 2755475 1 2024-04-26T12:28:46.780 INFO:tasks.workunit.client.0.smithi046.stdout:9/257: mknod d0/d2c/d47/c5b 0 2024-04-26T12:28:46.780 INFO:tasks.workunit.client.0.smithi046.stdout:8/366: dwrite d7/da/df/f2b [0,4194304] 0 2024-04-26T12:28:46.782 INFO:tasks.workunit.client.0.smithi046.stdout:1/296: creat d7/d9/d2b/d39/f61 x:0 0 0 2024-04-26T12:28:46.783 INFO:tasks.workunit.client.0.smithi046.stdout:9/258: creat d0/d2c/d3d/f5c x:0 0 0 2024-04-26T12:28:46.784 INFO:tasks.workunit.client.0.smithi046.stdout:1/297: creat d7/f62 x:0 0 0 2024-04-26T12:28:46.785 INFO:tasks.workunit.client.0.smithi046.stdout:9/259: dread - d0/d29/f4c zero size 2024-04-26T12:28:46.785 INFO:tasks.workunit.client.0.smithi046.stdout:5/359: dwrite d9/da/f10 [0,4194304] 0 2024-04-26T12:28:46.789 INFO:tasks.workunit.client.0.smithi046.stdout:1/298: write d7/d14/d5d/f48 [4478638,115098] 0 2024-04-26T12:28:46.790 INFO:tasks.workunit.client.0.smithi046.stdout:4/355: dwrite d0/da/d17/d20/d25/d35/f49 [0,4194304] 0 2024-04-26T12:28:46.790 INFO:tasks.workunit.client.0.smithi046.stdout:9/260: fsync d0/f15 0 2024-04-26T12:28:46.791 INFO:tasks.workunit.client.0.smithi046.stdout:8/367: dread d7/dc/d1b/f47 [0,4194304] 0 2024-04-26T12:28:46.791 INFO:tasks.workunit.client.0.smithi046.stdout:3/399: dwrite d2/d16/d2c/f36 [0,4194304] 0 2024-04-26T12:28:46.791 INFO:tasks.workunit.client.0.smithi046.stdout:6/375: dwrite d7/d2b/d31/f3f [0,4194304] 0 2024-04-26T12:28:46.792 INFO:tasks.workunit.client.0.smithi046.stdout:3/400: chown d2/d16/d35 1 1 2024-04-26T12:28:46.792 INFO:tasks.workunit.client.0.smithi046.stdout:5/360: mknod d9/da/dd/d69/d7e/c81 0 2024-04-26T12:28:46.792 INFO:tasks.workunit.client.0.smithi046.stdout:9/261: creat d0/d2c/f5d x:0 0 0 2024-04-26T12:28:46.792 INFO:tasks.workunit.client.0.smithi046.stdout:1/299: symlink d7/d14/d5d/d32/l63 0 2024-04-26T12:28:46.793 INFO:tasks.workunit.client.0.smithi046.stdout:9/262: symlink d0/d2c/l5e 0 2024-04-26T12:28:46.794 INFO:tasks.workunit.client.0.smithi046.stdout:8/368: creat d7/da/d4f/f7a x:0 0 0 2024-04-26T12:28:46.794 INFO:tasks.workunit.client.0.smithi046.stdout:1/300: creat d7/db/f64 x:0 0 0 2024-04-26T12:28:46.794 INFO:tasks.workunit.client.0.smithi046.stdout:9/263: mkdir d0/d16/d5f 0 2024-04-26T12:28:46.795 INFO:tasks.workunit.client.0.smithi046.stdout:6/376: link d7/d1b/d47/f49 d7/d1b/d6a/f7e 0 2024-04-26T12:28:46.795 INFO:tasks.workunit.client.0.smithi046.stdout:8/369: dread - d7/da/df/f65 zero size 2024-04-26T12:28:46.796 INFO:tasks.workunit.client.0.smithi046.stdout:9/264: fdatasync d0/d19/d21/f30 0 2024-04-26T12:28:46.796 INFO:tasks.workunit.client.0.smithi046.stdout:8/370: creat d7/da/df/f7b x:0 0 0 2024-04-26T12:28:46.797 INFO:tasks.workunit.client.0.smithi046.stdout:6/377: creat d7/f7f x:0 0 0 2024-04-26T12:28:46.797 INFO:tasks.workunit.client.0.smithi046.stdout:1/301: creat d7/d14/d5d/d32/d5f/f65 x:0 0 0 2024-04-26T12:28:46.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/265: write d0/d2c/f4d [169102,19056] 0 2024-04-26T12:28:46.798 INFO:tasks.workunit.client.0.smithi046.stdout:0/387: dread d9/dc/f26 [0,4194304] 0 2024-04-26T12:28:46.798 INFO:tasks.workunit.client.0.smithi046.stdout:8/371: symlink d7/da/df/l7c 0 2024-04-26T12:28:46.799 INFO:tasks.workunit.client.0.smithi046.stdout:8/372: sync 2024-04-26T12:28:46.799 INFO:tasks.workunit.client.0.smithi046.stdout:6/378: write d7/f29 [2791314,100936] 0 2024-04-26T12:28:46.799 INFO:tasks.workunit.client.0.smithi046.stdout:5/361: dwrite d9/f29 [0,4194304] 0 2024-04-26T12:28:46.800 INFO:tasks.workunit.client.0.smithi046.stdout:1/302: write d7/d12/d3a/f54 [450409,110067] 0 2024-04-26T12:28:46.801 INFO:tasks.workunit.client.0.smithi046.stdout:1/303: chown d7/db/c47 295269996 1 2024-04-26T12:28:46.801 INFO:tasks.workunit.client.0.smithi046.stdout:6/379: chown d7/d1b/d47/f4e 1764903975 1 2024-04-26T12:28:46.801 INFO:tasks.workunit.client.0.smithi046.stdout:0/388: rename d9/dc/dd/c53 to d9/dc/d2a/c86 0 2024-04-26T12:28:46.801 INFO:tasks.workunit.client.0.smithi046.stdout:8/373: mkdir d7/dc/d1b/d7d 0 2024-04-26T12:28:46.803 INFO:tasks.workunit.client.0.smithi046.stdout:0/389: truncate d9/dc/f36 1553764 0 2024-04-26T12:28:46.803 INFO:tasks.workunit.client.0.smithi046.stdout:1/304: fdatasync d7/d14/d5d/f30 0 2024-04-26T12:28:46.804 INFO:tasks.workunit.client.0.smithi046.stdout:5/362: link f8 d9/da/dd/f82 0 2024-04-26T12:28:46.804 INFO:tasks.workunit.client.0.smithi046.stdout:8/374: creat d7/d24/d50/d62/f7e x:0 0 0 2024-04-26T12:28:46.804 INFO:tasks.workunit.client.0.smithi046.stdout:7/410: dread d16/d27/d51/f67 [0,4194304] 0 2024-04-26T12:28:46.805 INFO:tasks.workunit.client.0.smithi046.stdout:0/390: read - d9/d1d/d40/f6e zero size 2024-04-26T12:28:46.805 INFO:tasks.workunit.client.0.smithi046.stdout:1/305: creat d7/d9/f66 x:0 0 0 2024-04-26T12:28:46.805 INFO:tasks.workunit.client.0.smithi046.stdout:5/363: readlink d9/da/l58 0 2024-04-26T12:28:46.807 INFO:tasks.workunit.client.0.smithi046.stdout:9/266: dwrite d0/d2c/d3d/f5c [0,4194304] 0 2024-04-26T12:28:46.807 INFO:tasks.workunit.client.0.smithi046.stdout:0/391: unlink d9/dc/d2a/f5a 0 2024-04-26T12:28:46.807 INFO:tasks.workunit.client.0.smithi046.stdout:1/306: mknod d7/d12/d3a/d49/c67 0 2024-04-26T12:28:46.808 INFO:tasks.workunit.client.0.smithi046.stdout:8/375: write d7/d24/d50/d62/f7e [741468,95896] 0 2024-04-26T12:28:46.808 INFO:tasks.workunit.client.0.smithi046.stdout:5/364: mknod d9/c83 0 2024-04-26T12:28:46.808 INFO:tasks.workunit.client.0.smithi046.stdout:0/392: readlink d9/d1d/l34 0 2024-04-26T12:28:46.809 INFO:tasks.workunit.client.0.smithi046.stdout:6/380: dwrite d7/d2b/f53 [0,4194304] 0 2024-04-26T12:28:46.811 INFO:tasks.workunit.client.0.smithi046.stdout:9/267: creat d0/d16/f60 x:0 0 0 2024-04-26T12:28:46.811 INFO:tasks.workunit.client.0.smithi046.stdout:9/268: sync 2024-04-26T12:28:46.811 INFO:tasks.workunit.client.0.smithi046.stdout:2/324: dread d1/de/d15/d18/f2c [0,4194304] 0 2024-04-26T12:28:46.811 INFO:tasks.workunit.client.0.smithi046.stdout:1/307: creat d7/d12/d44/f68 x:0 0 0 2024-04-26T12:28:46.811 INFO:tasks.workunit.client.0.smithi046.stdout:8/376: mkdir d7/da/d4f/d7f 0 2024-04-26T12:28:46.812 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:46.810+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:46.813 INFO:tasks.workunit.client.0.smithi046.stdout:5/365: truncate d9/da/d18/d7d/f78 110392 0 2024-04-26T12:28:46.813 INFO:tasks.workunit.client.0.smithi046.stdout:6/381: write d7/f62 [96120,102721] 0 2024-04-26T12:28:46.813 INFO:tasks.workunit.client.0.smithi046.stdout:7/411: dwrite f5 [0,4194304] 0 2024-04-26T12:28:46.813 INFO:tasks.workunit.client.0.smithi046.stdout:1/308: write d7/db/f64 [408208,33868] 0 2024-04-26T12:28:46.813 INFO:tasks.workunit.client.0.smithi046.stdout:5/366: chown d9/da/d3b/l5b 21890 1 2024-04-26T12:28:46.813 INFO:tasks.workunit.client.0.smithi046.stdout:5/367: stat d9/c43 0 2024-04-26T12:28:46.814 INFO:tasks.workunit.client.0.smithi046.stdout:8/377: dread - d7/da/df/f5e zero size 2024-04-26T12:28:46.814 INFO:tasks.workunit.client.0.smithi046.stdout:7/412: unlink d16/d1a/d31/d62/c6a 0 2024-04-26T12:28:46.814 INFO:tasks.workunit.client.0.smithi046.stdout:1/309: mkdir d7/d14/d5d/d32/d5f/d69 0 2024-04-26T12:28:46.814 INFO:tasks.workunit.client.0.smithi046.stdout:9/269: link d0/d2c/d47/l39 d0/d19/d51/l61 0 2024-04-26T12:28:46.816 INFO:tasks.workunit.client.0.smithi046.stdout:0/393: link d9/dc/c73 d9/d1d/d40/c87 0 2024-04-26T12:28:46.816 INFO:tasks.workunit.client.0.smithi046.stdout:9/270: write d0/d2c/f4d [549095,25368] 0 2024-04-26T12:28:46.816 INFO:tasks.workunit.client.0.smithi046.stdout:2/325: link d1/de/d15/d18/c23 d1/de/d65/d4a/d58/c6b 0 2024-04-26T12:28:46.816 INFO:tasks.workunit.client.0.smithi046.stdout:7/413: symlink d16/d1a/d3e/l8a 0 2024-04-26T12:28:46.816 INFO:tasks.workunit.client.0.smithi046.stdout:9/271: stat d0/f5 0 2024-04-26T12:28:46.817 INFO:tasks.workunit.client.0.smithi046.stdout:1/310: creat d7/d9/d2b/f6a x:0 0 0 2024-04-26T12:28:46.817 INFO:tasks.workunit.client.0.smithi046.stdout:0/394: dread - d9/dc/dd/d45/f4e zero size 2024-04-26T12:28:46.817 INFO:tasks.workunit.client.0.smithi046.stdout:9/272: dread - d0/d29/f42 zero size 2024-04-26T12:28:46.817 INFO:tasks.workunit.client.0.smithi046.stdout:1/311: readlink d7/l26 0 2024-04-26T12:28:46.818 INFO:tasks.workunit.client.0.smithi046.stdout:7/414: chown d16/d1a/d31/d4d/f5f 10193 1 2024-04-26T12:28:46.820 INFO:tasks.workunit.client.0.smithi046.stdout:0/395: rename d9/l16 to d9/d1d/d40/l88 0 2024-04-26T12:28:46.821 INFO:tasks.workunit.client.0.smithi046.stdout:6/382: dwrite d7/d16/f4a [0,4194304] 0 2024-04-26T12:28:46.822 INFO:tasks.workunit.client.0.smithi046.stdout:5/368: dread d9/da/dd/f82 [0,4194304] 0 2024-04-26T12:28:46.825 INFO:tasks.workunit.client.0.smithi046.stdout:5/369: creat d9/da/dd/d34/d6b/f84 x:0 0 0 2024-04-26T12:28:46.825 INFO:tasks.workunit.client.0.smithi046.stdout:7/415: dwrite d16/d1a/d31/d5a/f3d [4194304,4194304] 0 2024-04-26T12:28:46.825 INFO:tasks.workunit.client.0.smithi046.stdout:0/396: rename d9/dc/dd/f57 to d9/d1d/d5d/d6b/f89 0 2024-04-26T12:28:46.826 INFO:tasks.workunit.client.0.smithi046.stdout:9/273: dread d0/d29/f2a [0,4194304] 0 2024-04-26T12:28:46.826 INFO:tasks.workunit.client.0.smithi046.stdout:5/370: unlink d9/da/d3b/d35/f7f 0 2024-04-26T12:28:46.827 INFO:tasks.workunit.client.0.smithi046.stdout:0/397: stat d9/d1d/d40/d41/d43/f83 0 2024-04-26T12:28:46.828 INFO:tasks.workunit.client.0.smithi046.stdout:7/416: truncate d16/d1a/d31/d5a/f7c 49465 0 2024-04-26T12:28:46.829 INFO:tasks.workunit.client.0.smithi046.stdout:5/371: rename d9/da/dd/f36 to d9/da/dd/f85 0 2024-04-26T12:28:46.829 INFO:tasks.workunit.client.0.smithi046.stdout:0/398: rename d9/dc/d4c/d66 to d9/d1d/d5d/d6b/d8a 0 2024-04-26T12:28:46.829 INFO:tasks.workunit.client.0.smithi046.stdout:7/417: creat d16/d1a/d3e/d59/f8b x:0 0 0 2024-04-26T12:28:46.830 INFO:tasks.workunit.client.0.smithi046.stdout:0/399: chown d9/dc/dd/d45/f49 6 1 2024-04-26T12:28:46.830 INFO:tasks.workunit.client.0.smithi046.stdout:0/400: creat d9/dc/dd/d45/d69/f8b x:0 0 0 2024-04-26T12:28:46.830 INFO:tasks.workunit.client.0.smithi046.stdout:9/274: write d0/d2c/d3d/d52/f5a [2587291,125308] 0 2024-04-26T12:28:46.831 INFO:tasks.workunit.client.0.smithi046.stdout:0/401: read - d9/dc/dd/f3a zero size 2024-04-26T12:28:46.831 INFO:tasks.workunit.client.0.smithi046.stdout:9/275: symlink d0/d2c/d3d/l62 0 2024-04-26T12:28:46.832 INFO:tasks.workunit.client.0.smithi046.stdout:0/402: write d9/d1d/d5d/f5e [3174934,29145] 0 2024-04-26T12:28:46.833 INFO:tasks.workunit.client.0.smithi046.stdout:5/372: dwrite d9/f29 [4194304,4194304] 0 2024-04-26T12:28:46.834 INFO:tasks.workunit.client.0.smithi046.stdout:0/403: write d9/d1d/f3c [99898,44195] 0 2024-04-26T12:28:46.835 INFO:tasks.workunit.client.0.smithi046.stdout:5/373: unlink d9/da/d15/f48 0 2024-04-26T12:28:46.835 INFO:tasks.workunit.client.0.smithi046.stdout:0/404: chown d9/dc/dd/d45/d69/f8b 3390 1 2024-04-26T12:28:46.835 INFO:tasks.workunit.client.0.smithi046.stdout:5/374: chown d9/da 664555545 1 2024-04-26T12:28:46.835 INFO:tasks.workunit.client.0.smithi046.stdout:0/405: write d9/f10 [328980,46011] 0 2024-04-26T12:28:46.836 INFO:tasks.workunit.client.0.smithi046.stdout:0/406: read - d9/dc/d2a/f50 zero size 2024-04-26T12:28:46.837 INFO:tasks.workunit.client.0.smithi046.stdout:9/276: dread d0/d2c/d47/f1f [0,4194304] 0 2024-04-26T12:28:46.838 INFO:tasks.workunit.client.0.smithi046.stdout:3/401: dread d2/d16/d11/f3d [0,4194304] 0 2024-04-26T12:28:46.838 INFO:tasks.workunit.client.0.smithi046.stdout:9/277: write d0/d29/f4c [163491,130068] 0 2024-04-26T12:28:46.839 INFO:tasks.workunit.client.0.smithi046.stdout:9/278: readlink d0/d16/l40 0 2024-04-26T12:28:46.839 INFO:tasks.workunit.client.0.smithi046.stdout:5/375: dread d9/f41 [0,4194304] 0 2024-04-26T12:28:46.840 INFO:tasks.workunit.client.0.smithi046.stdout:2/326: dread d1/f48 [0,4194304] 0 2024-04-26T12:28:46.841 INFO:tasks.workunit.client.0.smithi046.stdout:5/376: link d9/da/d3b/l68 d9/da/d15/l86 0 2024-04-26T12:28:46.841 INFO:tasks.workunit.client.0.smithi046.stdout:9/279: rename d0/ce to d0/d19/c63 0 2024-04-26T12:28:46.842 INFO:tasks.workunit.client.0.smithi046.stdout:9/280: truncate d0/d2c/f4e 647165 0 2024-04-26T12:28:46.843 INFO:tasks.workunit.client.0.smithi046.stdout:3/402: dwrite d2/d16/d11/d1b/f5c [0,4194304] 0 2024-04-26T12:28:46.844 INFO:tasks.workunit.client.0.smithi046.stdout:5/377: rename d9/da/d18/l30 to d9/da/dd/d34/l87 0 2024-04-26T12:28:46.844 INFO:tasks.workunit.client.0.smithi046.stdout:9/281: write d0/f5 [5718961,20280] 0 2024-04-26T12:28:46.845 INFO:tasks.workunit.client.0.smithi046.stdout:5/378: mkdir d9/da/dd/d34/d44/d88 0 2024-04-26T12:28:46.845 INFO:tasks.workunit.client.0.smithi046.stdout:3/403: symlink d2/db/d62/l92 0 2024-04-26T12:28:46.846 INFO:tasks.workunit.client.0.smithi046.stdout:9/282: truncate d0/f15 3982263 0 2024-04-26T12:28:46.847 INFO:tasks.workunit.client.0.smithi046.stdout:0/407: truncate f3 2250360 0 2024-04-26T12:28:46.848 INFO:tasks.workunit.client.0.smithi046.stdout:0/408: readlink d9/d1d/l34 0 2024-04-26T12:28:46.848 INFO:tasks.workunit.client.0.smithi046.stdout:2/327: dwrite d1/de/d15/f4e [0,4194304] 0 2024-04-26T12:28:46.850 INFO:tasks.workunit.client.0.smithi046.stdout:0/409: mkdir d9/d1d/d5d/d6b/d8a/d8c 0 2024-04-26T12:28:46.850 INFO:tasks.workunit.client.0.smithi046.stdout:4/356: dread d0/da/d17/d20/d25/d35/d6d/d19/f50 [0,4194304] 0 2024-04-26T12:28:46.851 INFO:tasks.workunit.client.0.smithi046.stdout:9/283: rename d0/d2c/d3d/d52/f59 to d0/d16/d5f/f64 0 2024-04-26T12:28:46.851 INFO:tasks.workunit.client.0.smithi046.stdout:2/328: creat d1/de/d15/d18/f6c x:0 0 0 2024-04-26T12:28:46.852 INFO:tasks.workunit.client.0.smithi046.stdout:0/410: stat d9/dc/dd/f48 0 2024-04-26T12:28:46.853 INFO:tasks.workunit.client.0.smithi046.stdout:5/379: dread d9/da/f10 [0,4194304] 0 2024-04-26T12:28:46.853 INFO:tasks.workunit.client.0.smithi046.stdout:2/329: chown d1/de/d65/d4a/f4d 51229848 1 2024-04-26T12:28:46.853 INFO:tasks.workunit.client.0.smithi046.stdout:9/284: truncate d0/d2c/d3d/f4f 902248 0 2024-04-26T12:28:46.855 INFO:tasks.workunit.client.0.smithi046.stdout:3/404: dwrite d2/d16/d11/f3a [0,4194304] 0 2024-04-26T12:28:46.856 INFO:tasks.workunit.client.0.smithi046.stdout:8/378: dread d7/d24/f2f [0,4194304] 0 2024-04-26T12:28:46.856 INFO:tasks.workunit.client.0.smithi046.stdout:9/285: creat d0/f65 x:0 0 0 2024-04-26T12:28:46.856 INFO:tasks.workunit.client.0.smithi046.stdout:0/411: rename d9/dc/d2a/c59 to d9/dc/dd/c8d 0 2024-04-26T12:28:46.857 INFO:tasks.workunit.client.0.smithi046.stdout:1/312: dread d7/d14/d5d/f30 [0,4194304] 0 2024-04-26T12:28:46.857 INFO:tasks.workunit.client.0.smithi046.stdout:5/380: creat d9/da/d3b/f89 x:0 0 0 2024-04-26T12:28:46.858 INFO:tasks.workunit.client.0.smithi046.stdout:9/286: stat d0/f18 0 2024-04-26T12:28:46.859 INFO:tasks.workunit.client.0.smithi046.stdout:8/379: write d7/dc/f18 [3053291,88857] 0 2024-04-26T12:28:46.859 INFO:tasks.workunit.client.0.smithi046.stdout:4/357: dwrite d0/d1/f15 [0,4194304] 0 2024-04-26T12:28:46.861 INFO:tasks.workunit.client.0.smithi046.stdout:5/381: write d9/da/dd/f32 [1734243,87961] 0 2024-04-26T12:28:46.862 INFO:tasks.workunit.client.0.smithi046.stdout:2/330: dwrite d1/f35 [0,4194304] 0 2024-04-26T12:28:46.862 INFO:tasks.workunit.client.0.smithi046.stdout:8/380: write d7/da/df/f2b [1638335,658] 0 2024-04-26T12:28:46.863 INFO:tasks.workunit.client.0.smithi046.stdout:2/331: readlink d1/de/d15/d18/l53 0 2024-04-26T12:28:46.863 INFO:tasks.workunit.client.0.smithi046.stdout:4/358: read d0/d1/d5/db/f2f [2457448,43866] 0 2024-04-26T12:28:46.864 INFO:tasks.workunit.client.0.smithi046.stdout:2/332: stat d1/f3e 0 2024-04-26T12:28:46.864 INFO:tasks.workunit.client.0.smithi046.stdout:2/333: dread - d1/de/d65/f66 zero size 2024-04-26T12:28:46.864 INFO:tasks.workunit.client.0.smithi046.stdout:3/405: dread d2/d16/d35/f69 [0,4194304] 0 2024-04-26T12:28:46.865 INFO:tasks.workunit.client.0.smithi046.stdout:9/287: rename d0/d29/f42 to d0/d2c/d47/f66 0 2024-04-26T12:28:46.865 INFO:tasks.workunit.client.0.smithi046.stdout:3/406: stat d2/d16/f73 0 2024-04-26T12:28:46.865 INFO:tasks.workunit.client.0.smithi046.stdout:4/359: creat d0/da/d17/d20/d25/d35/d61/f75 x:0 0 0 2024-04-26T12:28:46.865 INFO:tasks.workunit.client.0.smithi046.stdout:5/382: creat d9/da/dd/d34/f8a x:0 0 0 2024-04-26T12:28:46.866 INFO:tasks.workunit.client.0.smithi046.stdout:2/334: write d1/de/d2b/f3a [1660358,71876] 0 2024-04-26T12:28:46.866 INFO:tasks.workunit.client.0.smithi046.stdout:5/383: stat d9/da/dd/d34/f8a 0 2024-04-26T12:28:46.869 INFO:tasks.workunit.client.0.smithi046.stdout:9/288: truncate d0/d2c/d47/f1a 140918 0 2024-04-26T12:28:46.870 INFO:tasks.workunit.client.0.smithi046.stdout:7/418: dread d16/d1a/d31/d55/f65 [0,4194304] 0 2024-04-26T12:28:46.871 INFO:tasks.workunit.client.0.smithi046.stdout:9/289: write d0/d2c/d47/f2e [498666,120223] 0 2024-04-26T12:28:46.872 INFO:tasks.workunit.client.0.smithi046.stdout:8/381: dwrite d7/d24/d50/d2a/d39/f48 [0,4194304] 0 2024-04-26T12:28:46.874 INFO:tasks.workunit.client.0.smithi046.stdout:7/419: write d16/d1a/d31/f70 [883340,31138] 0 2024-04-26T12:28:46.874 INFO:tasks.workunit.client.0.smithi046.stdout:0/412: dread d9/dc/dd/f27 [0,4194304] 0 2024-04-26T12:28:46.874 INFO:tasks.workunit.client.0.smithi046.stdout:5/384: truncate d9/da/f1b 1199206 0 2024-04-26T12:28:46.874 INFO:tasks.workunit.client.0.smithi046.stdout:9/290: chown d0/f24 72016 1 2024-04-26T12:28:46.875 INFO:tasks.workunit.client.0.smithi046.stdout:6/383: dread d7/d2b/f30 [0,4194304] 0 2024-04-26T12:28:46.875 INFO:tasks.workunit.client.0.smithi046.stdout:2/335: dwrite d1/d42/f44 [0,4194304] 0 2024-04-26T12:28:46.875 INFO:tasks.workunit.client.0.smithi046.stdout:0/413: fsync d9/dc/d2a/f31 0 2024-04-26T12:28:46.876 INFO:tasks.workunit.client.0.smithi046.stdout:5/385: fdatasync d9/da/dd/d34/d3e/f51 0 2024-04-26T12:28:46.876 INFO:tasks.workunit.client.0.smithi046.stdout:8/382: unlink d7/d24/d50/d2a/d39/l69 0 2024-04-26T12:28:46.876 INFO:tasks.workunit.client.0.smithi046.stdout:9/291: truncate d0/d2c/f4d 1069901 0 2024-04-26T12:28:46.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/420: mknod d16/d1a/d31/d55/c8c 0 2024-04-26T12:28:46.877 INFO:tasks.workunit.client.0.smithi046.stdout:4/360: dwrite d0/da/d17/d20/d25/d35/d61/f75 [0,4194304] 0 2024-04-26T12:28:46.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/384: write d7/f15 [402201,106600] 0 2024-04-26T12:28:46.877 INFO:tasks.workunit.client.0.smithi046.stdout:7/421: readlink l7 0 2024-04-26T12:28:46.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/386: mkdir d9/da/d18/d8b 0 2024-04-26T12:28:46.878 INFO:tasks.workunit.client.0.smithi046.stdout:9/292: rename d0/f24 to d0/d2c/d47/f67 0 2024-04-26T12:28:46.879 INFO:tasks.workunit.client.0.smithi046.stdout:5/387: dread - d9/da/d3b/f89 zero size 2024-04-26T12:28:46.879 INFO:tasks.workunit.client.0.smithi046.stdout:8/383: truncate d7/da/d4f/f7a 865139 0 2024-04-26T12:28:46.880 INFO:tasks.workunit.client.0.smithi046.stdout:6/385: creat d7/d2b/d31/f80 x:0 0 0 2024-04-26T12:28:46.880 INFO:tasks.workunit.client.0.smithi046.stdout:4/361: symlink d0/da/d17/d20/d74/l76 0 2024-04-26T12:28:46.880 INFO:tasks.workunit.client.0.smithi046.stdout:2/336: unlink d1/de/d65/d1b/c4f 0 2024-04-26T12:28:46.880 INFO:tasks.workunit.client.0.smithi046.stdout:8/384: dread - d7/dc/d27/f3a zero size 2024-04-26T12:28:46.880 INFO:tasks.workunit.client.0.smithi046.stdout:5/388: dread - d9/da/dd/d34/d6b/f84 zero size 2024-04-26T12:28:46.881 INFO:tasks.workunit.client.0.smithi046.stdout:8/385: readlink d7/d24/d50/d2a/d54/l5f 0 2024-04-26T12:28:46.881 INFO:tasks.workunit.client.0.smithi046.stdout:1/313: dread d7/d14/f4f [0,4194304] 0 2024-04-26T12:28:46.882 INFO:tasks.workunit.client.0.smithi046.stdout:5/389: rename d9/da/dd/d34 to d9/da/dd/d34/d6b/d8c 22 2024-04-26T12:28:46.882 INFO:tasks.workunit.client.0.smithi046.stdout:6/386: truncate d7/d1b/d47/d65/f73 439207 0 2024-04-26T12:28:46.882 INFO:tasks.workunit.client.0.smithi046.stdout:5/390: write d9/f73 [801905,6964] 0 2024-04-26T12:28:46.884 INFO:tasks.workunit.client.0.smithi046.stdout:8/386: link d7/da/df/c6e d7/d24/d50/c80 0 2024-04-26T12:28:46.884 INFO:tasks.workunit.client.0.smithi046.stdout:6/387: dread d7/d16/f56 [0,4194304] 0 2024-04-26T12:28:46.884 INFO:tasks.workunit.client.0.smithi046.stdout:5/391: symlink d9/da/dd/d34/d6b/l8d 0 2024-04-26T12:28:46.884 INFO:tasks.workunit.client.0.smithi046.stdout:6/388: chown d7/f15 291838066 1 2024-04-26T12:28:46.885 INFO:tasks.workunit.client.0.smithi046.stdout:8/387: symlink d7/da/l81 0 2024-04-26T12:28:46.885 INFO:tasks.workunit.client.0.smithi046.stdout:6/389: stat d7/d16/c3e 0 2024-04-26T12:28:46.886 INFO:tasks.workunit.client.0.smithi046.stdout:8/388: symlink d7/dc/d27/l82 0 2024-04-26T12:28:46.886 INFO:tasks.workunit.client.0.smithi046.stdout:8/389: unlink d7/l5c 0 2024-04-26T12:28:46.886 INFO:tasks.workunit.client.0.smithi046.stdout:8/390: creat d7/f83 x:0 0 0 2024-04-26T12:28:46.887 INFO:tasks.workunit.client.0.smithi046.stdout:1/314: dwrite d7/db/ff [0,4194304] 0 2024-04-26T12:28:46.887 INFO:tasks.workunit.client.0.smithi046.stdout:4/362: dread d0/da/d17/d20/d25/d35/d6d/d19/d53/f62 [0,4194304] 0 2024-04-26T12:28:46.888 INFO:tasks.workunit.client.0.smithi046.stdout:3/407: dread d2/d16/d35/f4e [0,4194304] 0 2024-04-26T12:28:46.889 INFO:tasks.workunit.client.0.smithi046.stdout:8/391: write d7/dc/d1b/f79 [671155,73252] 0 2024-04-26T12:28:46.889 INFO:tasks.workunit.client.0.smithi046.stdout:5/392: dread d9/da/d15/f4c [0,4194304] 0 2024-04-26T12:28:46.889 INFO:tasks.workunit.client.0.smithi046.stdout:4/363: symlink d0/d1/d29/l77 0 2024-04-26T12:28:46.889 INFO:tasks.workunit.client.0.smithi046.stdout:6/390: write d7/d16/f1c [766327,99303] 0 2024-04-26T12:28:46.890 INFO:tasks.workunit.client.0.smithi046.stdout:5/393: write d9/da/d18/f77 [712988,75107] 0 2024-04-26T12:28:46.890 INFO:tasks.workunit.client.0.smithi046.stdout:3/408: symlink d2/db/d62/l93 0 2024-04-26T12:28:46.891 INFO:tasks.workunit.client.0.smithi046.stdout:4/364: symlink d0/da/d17/l78 0 2024-04-26T12:28:46.891 INFO:tasks.workunit.client.0.smithi046.stdout:8/392: unlink d7/d24/d50/c31 0 2024-04-26T12:28:46.891 INFO:tasks.workunit.client.0.smithi046.stdout:6/391: creat d7/d2b/d31/d4d/f81 x:0 0 0 2024-04-26T12:28:46.892 INFO:tasks.workunit.client.0.smithi046.stdout:4/365: creat d0/d41/d3f/f79 x:0 0 0 2024-04-26T12:28:46.892 INFO:tasks.workunit.client.0.smithi046.stdout:8/393: creat d7/d24/d50/d62/f84 x:0 0 0 2024-04-26T12:28:46.892 INFO:tasks.workunit.client.0.smithi046.stdout:6/392: creat d7/d1b/d47/d65/f82 x:0 0 0 2024-04-26T12:28:46.892 INFO:tasks.workunit.client.0.smithi046.stdout:3/409: symlink d2/d16/d11/d82/l94 0 2024-04-26T12:28:46.893 INFO:tasks.workunit.client.0.smithi046.stdout:6/393: readlink l4 0 2024-04-26T12:28:46.893 INFO:tasks.workunit.client.0.smithi046.stdout:5/394: truncate d9/da/f4b 258875 0 2024-04-26T12:28:46.893 INFO:tasks.workunit.client.0.smithi046.stdout:8/394: chown d7/d1c/l6f 217349375 1 2024-04-26T12:28:46.893 INFO:tasks.workunit.client.0.smithi046.stdout:4/366: creat d0/da/d17/d20/f7a x:0 0 0 2024-04-26T12:28:46.893 INFO:tasks.workunit.client.0.smithi046.stdout:3/410: symlink d2/l95 0 2024-04-26T12:28:46.895 INFO:tasks.workunit.client.0.smithi046.stdout:8/395: write d7/dc/f17 [1971328,59938] 0 2024-04-26T12:28:46.895 INFO:tasks.workunit.client.0.smithi046.stdout:5/395: dread d9/da/dd/f82 [0,4194304] 0 2024-04-26T12:28:46.895 INFO:tasks.workunit.client.0.smithi046.stdout:6/394: getdents d7/d16 0 2024-04-26T12:28:46.895 INFO:tasks.workunit.client.0.smithi046.stdout:4/367: write d0/d1/f3b [1021054,79832] 0 2024-04-26T12:28:46.895 INFO:tasks.workunit.client.0.smithi046.stdout:3/411: fdatasync d2/d16/d11/f3d 0 2024-04-26T12:28:46.895 INFO:tasks.workunit.client.0.smithi046.stdout:7/422: read d16/d4e/f52 [1472005,89832] 0 2024-04-26T12:28:46.895 INFO:tasks.workunit.client.0.smithi046.stdout:8/396: fsync d7/d24/d50/d2a/d39/f61 0 2024-04-26T12:28:46.895 INFO:tasks.workunit.client.0.smithi046.stdout:4/368: readlink d0/d1/d12/l66 0 2024-04-26T12:28:46.897 INFO:tasks.workunit.client.0.smithi046.stdout:8/397: truncate f4 4955894 0 2024-04-26T12:28:46.897 INFO:tasks.workunit.client.0.smithi046.stdout:4/369: readlink d0/d41/l2a 0 2024-04-26T12:28:46.897 INFO:tasks.workunit.client.0.smithi046.stdout:2/337: dread d1/de/d65/d4a/d58/f63 [0,4194304] 0 2024-04-26T12:28:46.897 INFO:tasks.workunit.client.0.smithi046.stdout:2/338: stat d1/f3e 0 2024-04-26T12:28:46.897 INFO:tasks.workunit.client.0.smithi046.stdout:3/412: mknod d2/d16/d11/c96 0 2024-04-26T12:28:46.897 INFO:tasks.workunit.client.0.smithi046.stdout:7/423: symlink d16/d1a/d69/l8d 0 2024-04-26T12:28:46.898 INFO:tasks.workunit.client.0.smithi046.stdout:6/395: unlink d7/d1b/d47/d65/l69 0 2024-04-26T12:28:46.899 INFO:tasks.workunit.client.0.smithi046.stdout:2/339: chown d1/de/d15/d18 469015965 1 2024-04-26T12:28:46.899 INFO:tasks.workunit.client.0.smithi046.stdout:1/315: truncate d7/d12/d3a/f43 3839941 0 2024-04-26T12:28:46.899 INFO:tasks.workunit.client.0.smithi046.stdout:4/370: creat d0/da/d17/d20/d25/d35/d61/f7b x:0 0 0 2024-04-26T12:28:46.899 INFO:tasks.workunit.client.0.smithi046.stdout:3/413: mkdir d2/d97 0 2024-04-26T12:28:46.899 INFO:tasks.workunit.client.0.smithi046.stdout:6/396: chown d7/d1b/c3a 21101 1 2024-04-26T12:28:46.899 INFO:tasks.workunit.client.0.smithi046.stdout:8/398: rename d7/d24/f49 to d7/f85 0 2024-04-26T12:28:46.899 INFO:tasks.workunit.client.0.smithi046.stdout:4/371: rmdir d0/da/d17/d20/d25/d35/d6d 39 2024-04-26T12:28:46.900 INFO:tasks.workunit.client.0.smithi046.stdout:3/414: mkdir d2/d16/d2c/d50/d71/d89/d98 0 2024-04-26T12:28:46.901 INFO:tasks.workunit.client.0.smithi046.stdout:7/424: getdents d16 0 2024-04-26T12:28:46.902 INFO:tasks.workunit.client.0.smithi046.stdout:3/415: mknod d2/d16/d11/c99 0 2024-04-26T12:28:46.903 INFO:tasks.workunit.client.0.smithi046.stdout:8/399: dread d7/d24/f2f [0,4194304] 0 2024-04-26T12:28:46.904 INFO:tasks.workunit.client.0.smithi046.stdout:9/293: dread d0/d2c/d47/f67 [0,4194304] 0 2024-04-26T12:28:46.905 INFO:tasks.workunit.client.0.smithi046.stdout:2/340: dwrite d1/de/d15/f4e [0,4194304] 0 2024-04-26T12:28:46.906 INFO:tasks.workunit.client.0.smithi046.stdout:9/294: rmdir d0/d19 39 2024-04-26T12:28:46.906 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:46.906 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:46.907 INFO:tasks.workunit.client.0.smithi046.stdout:3/416: link d2/d16/d11/d1b/d2d/f8b d2/db/f9a 0 2024-04-26T12:28:46.907 INFO:tasks.workunit.client.0.smithi046.stdout:6/397: dwrite d7/d1b/d47/d65/f73 [0,4194304] 0 2024-04-26T12:28:46.907 INFO:tasks.workunit.client.0.smithi046.stdout:7/425: read d16/d1a/d31/d5a/f2a [884199,21523] 0 2024-04-26T12:28:46.907 INFO:tasks.workunit.client.0.smithi046.stdout:2/341: mknod d1/de/d65/d4a/c6d 0 2024-04-26T12:28:46.908 INFO:tasks.workunit.client.0.smithi046.stdout:4/372: dwrite d0/da/d17/d20/d25/f43 [0,4194304] 0 2024-04-26T12:28:46.908 INFO:tasks.workunit.client.0.smithi046.stdout:6/398: unlink d7/f54 0 2024-04-26T12:28:46.908 INFO:tasks.workunit.client.0.smithi046.stdout:3/417: symlink d2/d16/l9b 0 2024-04-26T12:28:46.909 INFO:tasks.workunit.client.0.smithi046.stdout:5/396: sync 2024-04-26T12:28:46.909 INFO:tasks.workunit.client.0.smithi046.stdout:0/414: sync 2024-04-26T12:28:46.909 INFO:tasks.workunit.client.0.smithi046.stdout:1/316: sync 2024-04-26T12:28:46.910 INFO:tasks.workunit.client.0.smithi046.stdout:4/373: rmdir d0/da/d17/d20/d25/d35/d6d/d19/d55 39 2024-04-26T12:28:46.910 INFO:tasks.workunit.client.0.smithi046.stdout:8/400: truncate d7/da/d4f/f6c 3305766 0 2024-04-26T12:28:46.911 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:46.910+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:46.912 INFO:tasks.workunit.client.0.smithi046.stdout:3/418: truncate d2/d16/f37 1213881 0 2024-04-26T12:28:46.912 INFO:tasks.workunit.client.0.smithi046.stdout:1/317: write d7/d14/f2d [668900,24792] 0 2024-04-26T12:28:46.912 INFO:tasks.workunit.client.0.smithi046.stdout:0/415: symlink d9/dc/d4c/d62/l8e 0 2024-04-26T12:28:46.915 INFO:tasks.workunit.client.0.smithi046.stdout:8/401: symlink d7/d24/d50/d62/l86 0 2024-04-26T12:28:46.915 INFO:tasks.workunit.client.0.smithi046.stdout:4/374: chown d0/da/d17/d20/d25/d35/d6d/d19/c57 1138 1 2024-04-26T12:28:46.917 INFO:tasks.workunit.client.0.smithi046.stdout:7/426: dwrite d16/d1a/d31/d5a/f50 [0,4194304] 0 2024-04-26T12:28:46.917 INFO:tasks.workunit.client.0.smithi046.stdout:3/419: unlink d2/d16/d11/d1b/f5c 0 2024-04-26T12:28:46.917 INFO:tasks.workunit.client.0.smithi046.stdout:8/402: dread - d7/d24/f53 zero size 2024-04-26T12:28:46.919 INFO:tasks.workunit.client.0.smithi046.stdout:6/399: dwrite d7/d1b/d37/f76 [4194304,4194304] 0 2024-04-26T12:28:46.919 INFO:tasks.workunit.client.0.smithi046.stdout:0/416: creat d9/d1d/d5d/d6b/d8a/d8c/f8f x:0 0 0 2024-04-26T12:28:46.919 INFO:tasks.workunit.client.0.smithi046.stdout:3/420: chown d2/d16/d11/d1f 10437 1 2024-04-26T12:28:46.920 INFO:tasks.workunit.client.0.smithi046.stdout:1/318: getdents d7 0 2024-04-26T12:28:46.920 INFO:tasks.workunit.client.0.smithi046.stdout:2/342: dwrite d1/de/d2b/f41 [0,4194304] 0 2024-04-26T12:28:46.920 INFO:tasks.workunit.client.0.smithi046.stdout:8/403: symlink d7/dc/d27/l87 0 2024-04-26T12:28:46.920 INFO:tasks.workunit.client.0.smithi046.stdout:7/427: rmdir d16/d1a/d31/d5a 39 2024-04-26T12:28:46.921 INFO:tasks.workunit.client.0.smithi046.stdout:4/375: write d0/da/d17/d20/d25/d35/d61/f7b [590418,39526] 0 2024-04-26T12:28:46.921 INFO:tasks.workunit.client.0.smithi046.stdout:3/421: write d2/db/f15 [3147771,126792] 0 2024-04-26T12:28:46.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/417: mkdir d9/dc/dd/d90 0 2024-04-26T12:28:46.922 INFO:tasks.workunit.client.0.smithi046.stdout:8/404: fdatasync d7/d24/d50/f72 0 2024-04-26T12:28:46.923 INFO:tasks.workunit.client.0.smithi046.stdout:6/400: write d7/d2b/d31/f3f [3234387,5595] 0 2024-04-26T12:28:46.923 INFO:tasks.workunit.client.0.smithi046.stdout:1/319: chown d7/d14/d5d/d32/d41/l4b 61383697 1 2024-04-26T12:28:46.924 INFO:tasks.workunit.client.0.smithi046.stdout:8/405: readlink d7/l9 0 2024-04-26T12:28:46.924 INFO:tasks.workunit.client.0.smithi046.stdout:3/422: fsync d2/f1d 0 2024-04-26T12:28:46.924 INFO:tasks.workunit.client.0.smithi046.stdout:7/428: mkdir d16/d1a/d31/d8e 0 2024-04-26T12:28:46.924 INFO:tasks.workunit.client.0.smithi046.stdout:0/418: rmdir d9/d1d/d5d/d6b 39 2024-04-26T12:28:46.925 INFO:tasks.workunit.client.0.smithi046.stdout:5/397: dwrite d9/da/dd/d34/f6f [0,4194304] 0 2024-04-26T12:28:46.926 INFO:tasks.workunit.client.0.smithi046.stdout:6/401: creat d7/d2b/f83 x:0 0 0 2024-04-26T12:28:46.926 INFO:tasks.workunit.client.0.smithi046.stdout:8/406: unlink d7/f85 0 2024-04-26T12:28:46.926 INFO:tasks.workunit.client.0.smithi046.stdout:6/402: chown d7/d16 71 1 2024-04-26T12:28:46.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:46.927 INFO:tasks.workunit.client.0.smithi046.stdout:3/423: read - d2/d16/d2c/d50/f90 zero size 2024-04-26T12:28:46.927 INFO:tasks.workunit.client.0.smithi046.stdout:0/419: symlink d9/dc/dd/d45/l91 0 2024-04-26T12:28:46.927 INFO:tasks.workunit.client.0.smithi046.stdout:7/429: symlink d16/d1a/d3e/d4f/l8f 0 2024-04-26T12:28:46.928 INFO:tasks.workunit.client.0.smithi046.stdout:4/376: read d0/d1/d12/f4b [1266503,38969] 0 2024-04-26T12:28:46.928 INFO:tasks.workunit.client.0.smithi046.stdout:3/424: chown l1 0 1 2024-04-26T12:28:46.928 INFO:tasks.workunit.client.0.smithi046.stdout:8/407: mkdir d7/da/d88 0 2024-04-26T12:28:46.928 INFO:tasks.workunit.client.0.smithi046.stdout:5/398: rename d9/da/d3b/f89 to d9/da/dd/d34/d44/f8e 0 2024-04-26T12:28:46.929 INFO:tasks.workunit.client.0.smithi046.stdout:7/430: chown c15 475146791 1 2024-04-26T12:28:46.929 INFO:tasks.workunit.client.0.smithi046.stdout:2/343: dwrite d1/de/d65/f5d [0,4194304] 0 2024-04-26T12:28:46.931 INFO:tasks.workunit.client.0.smithi046.stdout:8/408: write d7/d1c/f2d [2157039,57125] 0 2024-04-26T12:28:46.932 INFO:tasks.workunit.client.0.smithi046.stdout:7/431: rmdir d16/d35 39 2024-04-26T12:28:46.932 INFO:tasks.workunit.client.0.smithi046.stdout:3/425: sync 2024-04-26T12:28:46.935 INFO:tasks.workunit.client.0.smithi046.stdout:8/409: creat d7/d24/d50/f89 x:0 0 0 2024-04-26T12:28:46.935 INFO:tasks.workunit.client.0.smithi046.stdout:6/403: dwrite d7/fe [0,4194304] 0 2024-04-26T12:28:46.935 INFO:tasks.workunit.client.0.smithi046.stdout:5/399: dwrite d9/f4f [0,4194304] 0 2024-04-26T12:28:46.936 INFO:tasks.workunit.client.0.smithi046.stdout:5/400: dread - d9/da/d18/d7d/f63 zero size 2024-04-26T12:28:46.937 INFO:tasks.workunit.client.0.smithi046.stdout:3/426: symlink d2/d16/l9c 0 2024-04-26T12:28:46.937 INFO:tasks.workunit.client.0.smithi046.stdout:2/344: symlink d1/de/d65/l6e 0 2024-04-26T12:28:46.937 INFO:tasks.workunit.client.0.smithi046.stdout:6/404: creat d7/d16/f84 x:0 0 0 2024-04-26T12:28:46.937 INFO:tasks.workunit.client.0.smithi046.stdout:8/410: mknod d7/da/d4f/d7f/c8a 0 2024-04-26T12:28:46.937 INFO:tasks.workunit.client.0.smithi046.stdout:3/427: dread - d2/f8e zero size 2024-04-26T12:28:46.938 INFO:tasks.workunit.client.0.smithi046.stdout:6/405: truncate d7/f7f 954624 0 2024-04-26T12:28:46.938 INFO:tasks.workunit.client.0.smithi046.stdout:8/411: rmdir d7/d24/d50/d62 39 2024-04-26T12:28:46.939 INFO:tasks.workunit.client.0.smithi046.stdout:6/406: chown d7/d1b/d6a/f7e 7126673 1 2024-04-26T12:28:46.939 INFO:tasks.workunit.client.0.smithi046.stdout:3/428: truncate d2/db/d84/d8a/f8c 1229390 0 2024-04-26T12:28:46.939 INFO:tasks.workunit.client.0.smithi046.stdout:5/401: dread d9/da/dd/f13 [0,4194304] 0 2024-04-26T12:28:46.940 INFO:tasks.workunit.client.0.smithi046.stdout:3/429: creat d2/db/f9d x:0 0 0 2024-04-26T12:28:46.940 INFO:tasks.workunit.client.0.smithi046.stdout:6/407: rename d7/d1b/d47/d65/c71 to d7/d16/c85 0 2024-04-26T12:28:46.941 INFO:tasks.workunit.client.0.smithi046.stdout:6/408: fdatasync d7/d2b/d31/f35 0 2024-04-26T12:28:46.942 INFO:tasks.workunit.client.0.smithi046.stdout:0/420: truncate d9/dc/dd/f24 95146 0 2024-04-26T12:28:46.942 INFO:tasks.workunit.client.0.smithi046.stdout:5/402: write d9/da/dd/f13 [848879,51603] 0 2024-04-26T12:28:46.942 INFO:tasks.workunit.client.0.smithi046.stdout:6/409: unlink d7/c27 0 2024-04-26T12:28:46.943 INFO:tasks.workunit.client.0.smithi046.stdout:4/377: write d0/d1/d29/f34 [1150312,8833] 0 2024-04-26T12:28:46.943 INFO:tasks.workunit.client.0.smithi046.stdout:3/430: dread d2/d16/d11/f3d [0,4194304] 0 2024-04-26T12:28:46.944 INFO:tasks.workunit.client.0.smithi046.stdout:0/421: mknod d9/d1d/d40/c92 0 2024-04-26T12:28:46.944 INFO:tasks.workunit.client.0.smithi046.stdout:5/403: mkdir d9/da/dd/d34/d45/d8f 0 2024-04-26T12:28:46.944 INFO:tasks.workunit.client.0.smithi046.stdout:4/378: chown d0/da/d17/d20/d25/d35/d6d/d19/d53 13007810 1 2024-04-26T12:28:46.944 INFO:tasks.workunit.client.0.smithi046.stdout:8/412: dwrite d7/dc/f13 [0,4194304] 0 2024-04-26T12:28:46.945 INFO:tasks.workunit.client.0.smithi046.stdout:7/432: truncate d16/d27/d51/f67 1949468 0 2024-04-26T12:28:46.945 INFO:tasks.workunit.client.0.smithi046.stdout:6/410: rename d7/d2b/l3c to d7/d1b/d6a/d57/l86 0 2024-04-26T12:28:46.945 INFO:tasks.workunit.client.0.smithi046.stdout:2/345: write d1/de/f11 [1139127,118953] 0 2024-04-26T12:28:46.946 INFO:tasks.workunit.client.0.smithi046.stdout:9/295: dread d0/d29/f37 [0,4194304] 0 2024-04-26T12:28:46.946 INFO:tasks.workunit.client.0.smithi046.stdout:4/379: mkdir d0/d41/d3f/d7c 0 2024-04-26T12:28:46.946 INFO:tasks.workunit.client.0.smithi046.stdout:0/422: fsync d9/d1d/d5d/d6b/d8a/d8c/f8f 0 2024-04-26T12:28:46.946 INFO:tasks.workunit.client.0.smithi046.stdout:9/296: stat d0/d2c/d3d/f4f 0 2024-04-26T12:28:46.947 INFO:tasks.workunit.client.0.smithi046.stdout:5/404: mkdir d9/da/dd/d34/d44/d88/d90 0 2024-04-26T12:28:46.947 INFO:tasks.workunit.client.0.smithi046.stdout:6/411: symlink d7/d2b/d31/l87 0 2024-04-26T12:28:46.947 INFO:tasks.workunit.client.0.smithi046.stdout:2/346: mknod d1/de/d15/d18/c6f 0 2024-04-26T12:28:46.948 INFO:tasks.workunit.client.0.smithi046.stdout:4/380: rmdir d0/da/d17/d20 39 2024-04-26T12:28:46.950 INFO:tasks.workunit.client.0.smithi046.stdout:0/423: rename d9/dc/c73 to d9/d1d/d5d/d6b/d8a/c93 0 2024-04-26T12:28:46.950 INFO:tasks.workunit.client.0.smithi046.stdout:9/297: getdents d0/d2c/d3d 0 2024-04-26T12:28:46.950 INFO:tasks.workunit.client.0.smithi046.stdout:2/347: link d1/c43 d1/c70 0 2024-04-26T12:28:46.950 INFO:tasks.workunit.client.0.smithi046.stdout:4/381: mknod d0/da/d17/d20/d25/c7d 0 2024-04-26T12:28:46.952 INFO:tasks.workunit.client.0.smithi046.stdout:5/405: truncate d9/da/dd/d34/d3e/f51 390220 0 2024-04-26T12:28:46.952 INFO:tasks.workunit.client.0.smithi046.stdout:4/382: fsync d0/d1/f15 0 2024-04-26T12:28:46.953 INFO:tasks.workunit.client.0.smithi046.stdout:2/348: chown d1/de/d65/d4a/c6d 5 1 2024-04-26T12:28:46.954 INFO:tasks.workunit.client.0.smithi046.stdout:2/349: stat d1/cc 0 2024-04-26T12:28:46.954 INFO:tasks.workunit.client.0.smithi046.stdout:8/413: dwrite d7/da/f23 [0,4194304] 0 2024-04-26T12:28:46.955 INFO:tasks.workunit.client.0.smithi046.stdout:5/406: symlink d9/da/d3b/d35/l91 0 2024-04-26T12:28:46.955 INFO:tasks.workunit.client.0.smithi046.stdout:6/412: dwrite d7/f7f [0,4194304] 0 2024-04-26T12:28:46.956 INFO:tasks.workunit.client.0.smithi046.stdout:1/320: dread d7/d14/d5d/f48 [0,4194304] 0 2024-04-26T12:28:46.956 INFO:tasks.workunit.client.0.smithi046.stdout:4/383: read d0/d1/f3b [184786,29130] 0 2024-04-26T12:28:46.956 INFO:tasks.workunit.client.0.smithi046.stdout:2/350: mkdir d1/d71 0 2024-04-26T12:28:46.957 INFO:tasks.workunit.client.0.smithi046.stdout:2/351: write d1/de/f5e [714153,57700] 0 2024-04-26T12:28:46.957 INFO:tasks.workunit.client.0.smithi046.stdout:0/424: rename d9/f29 to d9/d1d/d40/f94 0 2024-04-26T12:28:46.958 INFO:tasks.workunit.client.0.smithi046.stdout:8/414: rename d7/da/df/f2e to d7/d1c/f8b 0 2024-04-26T12:28:46.960 INFO:tasks.workunit.client.0.smithi046.stdout:9/298: truncate d0/d19/f2f 1085495 0 2024-04-26T12:28:46.960 INFO:tasks.workunit.client.0.smithi046.stdout:1/321: rename d7/d14/d5d/d32/d5f/d69 to d7/d14/d5d/d6b 0 2024-04-26T12:28:46.960 INFO:tasks.workunit.client.0.smithi046.stdout:8/415: chown d7/d24/d50/d2a/d39/l4e 1 1 2024-04-26T12:28:46.961 INFO:tasks.workunit.client.0.smithi046.stdout:1/322: chown d7/d9/d2b/d39/d5c 361627540 1 2024-04-26T12:28:46.962 INFO:tasks.workunit.client.0.smithi046.stdout:5/407: getdents d9/da/d18 0 2024-04-26T12:28:46.962 INFO:tasks.workunit.client.0.smithi046.stdout:1/323: creat d7/d14/d5d/d6b/f6c x:0 0 0 2024-04-26T12:28:46.963 INFO:tasks.workunit.client.0.smithi046.stdout:4/384: read d0/d1/d29/f6e [5782253,63151] 0 2024-04-26T12:28:46.963 INFO:tasks.workunit.client.0.smithi046.stdout:0/425: getdents d9/d1d/d5d/d6b 0 2024-04-26T12:28:46.964 INFO:tasks.workunit.client.0.smithi046.stdout:1/324: fdatasync d7/d9/f1a 0 2024-04-26T12:28:46.966 INFO:tasks.workunit.client.0.smithi046.stdout:2/352: dwrite d1/de/d65/d4a/d58/f63 [0,4194304] 0 2024-04-26T12:28:46.967 INFO:tasks.workunit.client.0.smithi046.stdout:1/325: creat d7/d12/d44/f6d x:0 0 0 2024-04-26T12:28:46.967 INFO:tasks.workunit.client.0.smithi046.stdout:5/408: dread d9/da/d18/f25 [0,4194304] 0 2024-04-26T12:28:46.967 INFO:tasks.workunit.client.0.smithi046.stdout:0/426: creat d9/dc/dd/d45/d69/f95 x:0 0 0 2024-04-26T12:28:46.968 INFO:tasks.workunit.client.0.smithi046.stdout:8/416: dread d7/da/f23 [0,4194304] 0 2024-04-26T12:28:46.968 INFO:tasks.workunit.client.0.smithi046.stdout:9/299: dwrite d0/d29/f4c [0,4194304] 0 2024-04-26T12:28:46.969 INFO:tasks.workunit.client.0.smithi046.stdout:8/417: truncate d7/d1c/f8b 1681033 0 2024-04-26T12:28:46.970 INFO:tasks.workunit.client.0.smithi046.stdout:5/409: chown d9/da/d15/f26 0 1 2024-04-26T12:28:46.971 INFO:tasks.workunit.client.0.smithi046.stdout:4/385: link d0/da/d17/d20/d25/d35/d61/f75 d0/da/d17/d20/d25/d35/d6d/f7e 0 2024-04-26T12:28:46.971 INFO:tasks.workunit.client.0.smithi046.stdout:9/300: getdents d0/d19/d51 0 2024-04-26T12:28:46.971 INFO:tasks.workunit.client.0.smithi046.stdout:8/418: creat d7/dc/d1b/f8c x:0 0 0 2024-04-26T12:28:46.972 INFO:tasks.workunit.client.0.smithi046.stdout:4/386: dread - d0/da/d17/d20/f7a zero size 2024-04-26T12:28:46.972 INFO:tasks.workunit.client.0.smithi046.stdout:9/301: readlink d0/d2c/d47/l1e 0 2024-04-26T12:28:46.972 INFO:tasks.workunit.client.0.smithi046.stdout:8/419: creat d7/da/df/f8d x:0 0 0 2024-04-26T12:28:46.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/302: rmdir d0/d19/d21 39 2024-04-26T12:28:46.974 INFO:tasks.workunit.client.0.smithi046.stdout:8/420: chown d7/da/df/f5e 47446 1 2024-04-26T12:28:46.974 INFO:tasks.workunit.client.0.smithi046.stdout:2/353: dwrite d1/de/d15/f4e [0,4194304] 0 2024-04-26T12:28:46.974 INFO:tasks.workunit.client.0.smithi046.stdout:9/303: chown d0/d19/l36 202 1 2024-04-26T12:28:46.975 INFO:tasks.workunit.client.0.smithi046.stdout:4/387: truncate d0/d1/f15 1374100 0 2024-04-26T12:28:46.975 INFO:tasks.workunit.client.0.smithi046.stdout:8/421: creat d7/dc/d1b/f8e x:0 0 0 2024-04-26T12:28:46.975 INFO:tasks.workunit.client.0.smithi046.stdout:9/304: mkdir d0/d16/d5f/d68 0 2024-04-26T12:28:46.975 INFO:tasks.workunit.client.0.smithi046.stdout:4/388: chown d0/d1/d12/f4b 0 1 2024-04-26T12:28:46.976 INFO:tasks.workunit.client.0.smithi046.stdout:2/354: mkdir d1/de/d65/d4a/d58/d72 0 2024-04-26T12:28:46.978 INFO:tasks.workunit.client.0.smithi046.stdout:4/389: creat d0/da/d17/d20/f7f x:0 0 0 2024-04-26T12:28:46.978 INFO:tasks.workunit.client.0.smithi046.stdout:2/355: creat d1/de/d65/d4a/d58/f73 x:0 0 0 2024-04-26T12:28:46.979 INFO:tasks.workunit.client.0.smithi046.stdout:2/356: stat d1/de/d65/l5a 0 2024-04-26T12:28:46.980 INFO:tasks.workunit.client.0.smithi046.stdout:4/390: write d0/da/f26 [1868703,129643] 0 2024-04-26T12:28:46.981 INFO:tasks.workunit.client.0.smithi046.stdout:2/357: fsync d1/de/f3c 0 2024-04-26T12:28:46.982 INFO:tasks.workunit.client.0.smithi046.stdout:8/422: dwrite d7/f4a [0,4194304] 0 2024-04-26T12:28:46.982 INFO:tasks.workunit.client.0.smithi046.stdout:9/305: dwrite d0/d29/f3b [0,4194304] 0 2024-04-26T12:28:46.983 INFO:tasks.workunit.client.0.smithi046.stdout:4/391: rename d0/d1/d5/c36 to d0/c80 0 2024-04-26T12:28:46.984 INFO:tasks.workunit.client.0.smithi046.stdout:8/423: truncate d7/dc/d27/f3a 910948 0 2024-04-26T12:28:46.985 INFO:tasks.workunit.client.0.smithi046.stdout:4/392: symlink d0/da/d17/d20/d25/d35/d6d/d19/l81 0 2024-04-26T12:28:46.988 INFO:tasks.workunit.client.0.smithi046.stdout:9/306: dwrite d0/d2c/d3d/f4f [0,4194304] 0 2024-04-26T12:28:46.991 INFO:tasks.workunit.client.0.smithi046.stdout:8/424: dwrite d7/dc/d1b/f79 [0,4194304] 0 2024-04-26T12:28:46.991 INFO:tasks.workunit.client.0.smithi046.stdout:2/358: read d1/de/d65/d4a/f4d [2614948,103949] 0 2024-04-26T12:28:46.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/410: dread d9/da/d18/f77 [0,4194304] 0 2024-04-26T12:28:46.991 INFO:tasks.workunit.client.0.smithi046.stdout:4/393: dwrite d0/da/d17/f46 [4194304,4194304] 0 2024-04-26T12:28:46.992 INFO:tasks.workunit.client.0.smithi046.stdout:8/425: mknod d7/dc/d27/c8f 0 2024-04-26T12:28:46.993 INFO:tasks.workunit.client.0.smithi046.stdout:5/411: truncate d9/da/dd/f82 4256 0 2024-04-26T12:28:46.994 INFO:tasks.workunit.client.0.smithi046.stdout:8/426: link d7/da/c36 d7/dc/c90 0 2024-04-26T12:28:46.994 INFO:tasks.workunit.client.0.smithi046.stdout:6/413: dread d7/d1b/d37/f38 [0,4194304] 0 2024-04-26T12:28:46.994 INFO:tasks.workunit.client.0.smithi046.stdout:5/412: chown d9/da/dd/f82 1612 1 2024-04-26T12:28:46.995 INFO:tasks.workunit.client.0.smithi046.stdout:8/427: creat d7/da/d4f/d7f/f91 x:0 0 0 2024-04-26T12:28:46.995 INFO:tasks.workunit.client.0.smithi046.stdout:6/414: mknod d7/d2b/c88 0 2024-04-26T12:28:46.995 INFO:tasks.workunit.client.0.smithi046.stdout:9/307: write d0/d19/f2f [2091386,6690] 0 2024-04-26T12:28:46.996 INFO:tasks.workunit.client.0.smithi046.stdout:6/415: symlink d7/d1b/d47/l89 0 2024-04-26T12:28:46.996 INFO:tasks.workunit.client.0.smithi046.stdout:5/413: truncate d9/da/dd/f85 1644128 0 2024-04-26T12:28:46.996 INFO:tasks.workunit.client.0.smithi046.stdout:8/428: mkdir d7/d24/d50/d2a/d92 0 2024-04-26T12:28:46.997 INFO:tasks.workunit.client.0.smithi046.stdout:9/308: mkdir d0/d29/d69 0 2024-04-26T12:28:46.997 INFO:tasks.workunit.client.0.smithi046.stdout:6/416: creat d7/d2b/f8a x:0 0 0 2024-04-26T12:28:46.997 INFO:tasks.workunit.client.0.smithi046.stdout:9/309: unlink d0/d2c/d47/f56 0 2024-04-26T12:28:46.999 INFO:tasks.workunit.client.0.smithi046.stdout:6/417: rename d7/d2b/f6d to d7/f8b 0 2024-04-26T12:28:46.999 INFO:tasks.workunit.client.0.smithi046.stdout:9/310: rename d0/d29/f2a to d0/d16/f6a 0 2024-04-26T12:28:46.999 INFO:tasks.workunit.client.0.smithi046.stdout:6/418: readlink d7/d2b/l6f 0 2024-04-26T12:28:47.001 INFO:tasks.workunit.client.0.smithi046.stdout:7/433: sync 2024-04-26T12:28:47.001 INFO:tasks.workunit.client.0.smithi046.stdout:3/431: sync 2024-04-26T12:28:47.001 INFO:tasks.workunit.client.0.smithi046.stdout:8/429: dwrite d7/d24/d50/f77 [0,4194304] 0 2024-04-26T12:28:47.001 INFO:tasks.workunit.client.0.smithi046.stdout:6/419: chown d7/d2b/d31/c40 184170963 1 2024-04-26T12:28:47.001 INFO:tasks.workunit.client.0.smithi046.stdout:8/430: fsync d7/dc/f45 0 2024-04-26T12:28:47.002 INFO:tasks.workunit.client.0.smithi046.stdout:7/434: symlink d16/d27/d7e/l90 0 2024-04-26T12:28:47.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/420: stat d7/d1b/d6a/l6c 0 2024-04-26T12:28:47.003 INFO:tasks.workunit.client.0.smithi046.stdout:9/311: dread d0/d2c/d47/f1a [0,4194304] 0 2024-04-26T12:28:47.003 INFO:tasks.workunit.client.0.smithi046.stdout:4/394: read d0/d1/d5/f2b [1846768,76961] 0 2024-04-26T12:28:47.004 INFO:tasks.workunit.client.0.smithi046.stdout:8/431: creat d7/dc/d1b/f93 x:0 0 0 2024-04-26T12:28:47.004 INFO:tasks.workunit.client.0.smithi046.stdout:7/435: symlink d16/d1a/l91 0 2024-04-26T12:28:47.004 INFO:tasks.workunit.client.0.smithi046.stdout:3/432: link d2/d16/d11/f58 d2/d16/d2c/d50/d71/d89/f9e 0 2024-04-26T12:28:47.005 INFO:tasks.workunit.client.0.smithi046.stdout:4/395: write d0/da/d17/d20/d25/d35/d6d/d19/f3d [1511175,50103] 0 2024-04-26T12:28:47.006 INFO:tasks.workunit.client.0.smithi046.stdout:9/312: write d0/d2c/d47/f1a [5699,39439] 0 2024-04-26T12:28:47.006 INFO:tasks.workunit.client.0.smithi046.stdout:8/432: write d7/f55 [462010,78078] 0 2024-04-26T12:28:47.007 INFO:tasks.workunit.client.0.smithi046.stdout:3/433: unlink d2/d16/d11/d1b/d2d/f8b 0 2024-04-26T12:28:47.007 INFO:tasks.workunit.client.0.smithi046.stdout:6/421: truncate d7/d2b/d31/f2e 5182685 0 2024-04-26T12:28:47.007 INFO:tasks.workunit.client.0.smithi046.stdout:4/396: fsync d0/da/f26 0 2024-04-26T12:28:47.007 INFO:tasks.workunit.client.0.smithi046.stdout:8/433: creat d7/d24/d50/f94 x:0 0 0 2024-04-26T12:28:47.008 INFO:tasks.workunit.client.0.smithi046.stdout:4/397: creat d0/da/d17/d20/d25/d35/d6d/d19/d55/f82 x:0 0 0 2024-04-26T12:28:47.008 INFO:tasks.workunit.client.0.smithi046.stdout:3/434: creat d2/d16/d11/d1f/d74/f9f x:0 0 0 2024-04-26T12:28:47.008 INFO:tasks.workunit.client.0.smithi046.stdout:8/434: creat d7/dc/f95 x:0 0 0 2024-04-26T12:28:47.009 INFO:tasks.workunit.client.0.smithi046.stdout:4/398: readlink d0/d1/d12/l66 0 2024-04-26T12:28:47.009 INFO:tasks.workunit.client.0.smithi046.stdout:3/435: dread - d2/d16/d11/f75 zero size 2024-04-26T12:28:47.010 INFO:tasks.workunit.client.0.smithi046.stdout:4/399: creat d0/da/d21/f83 x:0 0 0 2024-04-26T12:28:47.011 INFO:tasks.workunit.client.0.smithi046.stdout:4/400: chown d0/d64 910 1 2024-04-26T12:28:47.011 INFO:tasks.workunit.client.0.smithi046.stdout:3/436: write d2/d16/d35/f66 [247169,126270] 0 2024-04-26T12:28:47.012 INFO:tasks.workunit.client.0.smithi046.stdout:9/313: dwrite d0/d29/f37 [0,4194304] 0 2024-04-26T12:28:47.012 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:47.011+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:47.013 INFO:tasks.workunit.client.0.smithi046.stdout:6/422: dwrite d7/d1b/d6a/f7e [0,4194304] 0 2024-04-26T12:28:47.013 INFO:tasks.workunit.client.0.smithi046.stdout:8/435: rmdir d7/d24/d50 39 2024-04-26T12:28:47.014 INFO:tasks.workunit.client.0.smithi046.stdout:0/427: dread d9/dc/f37 [0,4194304] 0 2024-04-26T12:28:47.014 INFO:tasks.workunit.client.0.smithi046.stdout:3/437: truncate d2/d16/d11/f3d 2084814 0 2024-04-26T12:28:47.014 INFO:tasks.workunit.client.0.smithi046.stdout:6/423: rename d7/d2b/c63 to d7/d1b/d47/d65/c8c 0 2024-04-26T12:28:47.015 INFO:tasks.workunit.client.0.smithi046.stdout:9/314: truncate d0/d2c/d47/f46 304295 0 2024-04-26T12:28:47.015 INFO:tasks.workunit.client.0.smithi046.stdout:3/438: fdatasync d2/db/d4a/f40 0 2024-04-26T12:28:47.016 INFO:tasks.workunit.client.0.smithi046.stdout:0/428: creat d9/d1d/d40/d41/f96 x:0 0 0 2024-04-26T12:28:47.016 INFO:tasks.workunit.client.0.smithi046.stdout:1/326: sync 2024-04-26T12:28:47.017 INFO:tasks.workunit.client.0.smithi046.stdout:9/315: chown d0/d2c/d47 2 1 2024-04-26T12:28:47.019 INFO:tasks.workunit.client.0.smithi046.stdout:0/429: fdatasync d9/d1d/d40/f94 0 2024-04-26T12:28:47.019 INFO:tasks.workunit.client.0.smithi046.stdout:1/327: symlink d7/d12/d3a/d49/l6e 0 2024-04-26T12:28:47.019 INFO:tasks.workunit.client.0.smithi046.stdout:8/436: creat d7/d24/d50/f96 x:0 0 0 2024-04-26T12:28:47.019 INFO:tasks.workunit.client.0.smithi046.stdout:3/439: mkdir d2/db/d84/d8a/da0 0 2024-04-26T12:28:47.020 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:28:47.021 INFO:tasks.workunit.client.0.smithi046.stdout:0/430: creat d9/dc/d4c/f97 x:0 0 0 2024-04-26T12:28:47.021 INFO:tasks.workunit.client.0.smithi046.stdout:1/328: creat d7/f6f x:0 0 0 2024-04-26T12:28:47.021 INFO:tasks.workunit.client.0.smithi046.stdout:6/424: truncate d7/d2b/d31/f35 731279 0 2024-04-26T12:28:47.021 INFO:tasks.workunit.client.0.smithi046.stdout:0/431: rmdir d9/dc/dd/d45/d69 39 2024-04-26T12:28:47.021 INFO:tasks.workunit.client.0.smithi046.stdout:3/440: chown d2/d16/d11/f3d 269 1 2024-04-26T12:28:47.022 INFO:tasks.workunit.client.0.smithi046.stdout:7/436: read d16/d1a/d31/f39 [428204,53827] 0 2024-04-26T12:28:47.023 INFO:tasks.workunit.client.0.smithi046.stdout:3/441: chown d2/db/f15 26646923 1 2024-04-26T12:28:47.023 INFO:tasks.workunit.client.0.smithi046.stdout:0/432: rename d9/dc/f2d to d9/d1d/d5d/d6b/f98 0 2024-04-26T12:28:47.023 INFO:tasks.workunit.client.0.smithi046.stdout:5/414: dread d9/da/dd/d34/f49 [0,4194304] 0 2024-04-26T12:28:47.024 INFO:tasks.workunit.client.0.smithi046.stdout:5/415: fdatasync f2 0 2024-04-26T12:28:47.024 INFO:tasks.workunit.client.0.smithi046.stdout:9/316: dwrite d0/d29/f4c [0,4194304] 0 2024-04-26T12:28:47.024 INFO:tasks.workunit.client.0.smithi046.stdout:7/437: link d16/d1a/d31/d62/f88 d16/d1a/d3e/d59/f92 0 2024-04-26T12:28:47.025 INFO:tasks.workunit.client.0.smithi046.stdout:0/433: stat d9/d1d/c23 0 2024-04-26T12:28:47.026 INFO:tasks.workunit.client.0.smithi046.stdout:9/317: write d0/d2c/f55 [382082,35719] 0 2024-04-26T12:28:47.026 INFO:tasks.workunit.client.0.smithi046.stdout:7/438: write d16/f20 [4040837,79642] 0 2024-04-26T12:28:47.027 INFO:tasks.workunit.client.0.smithi046.stdout:0/434: creat d9/dc/dd/f99 x:0 0 0 2024-04-26T12:28:47.028 INFO:tasks.workunit.client.0.smithi046.stdout:8/437: write d7/d24/f2f [686634,44024] 0 2024-04-26T12:28:47.029 INFO:tasks.workunit.client.0.smithi046.stdout:5/416: creat d9/da/d3b/f92 x:0 0 0 2024-04-26T12:28:47.029 INFO:tasks.workunit.client.0.smithi046.stdout:9/318: unlink d0/d2c/d47/l1e 0 2024-04-26T12:28:47.029 INFO:tasks.workunit.client.0.smithi046.stdout:8/438: dread - d7/da/df/f65 zero size 2024-04-26T12:28:47.030 INFO:tasks.workunit.client.0.smithi046.stdout:3/442: dwrite d2/d16/d2c/d50/f90 [0,4194304] 0 2024-04-26T12:28:47.030 INFO:tasks.workunit.client.0.smithi046.stdout:5/417: write d9/da/dd/d34/d3e/f76 [107467,43746] 0 2024-04-26T12:28:47.031 INFO:tasks.workunit.client.0.smithi046.stdout:1/329: mknod d7/d14/d5d/d32/c70 0 2024-04-26T12:28:47.032 INFO:tasks.workunit.client.0.smithi046.stdout:0/435: link d9/f10 d9/f9a 0 2024-04-26T12:28:47.033 INFO:tasks.workunit.client.0.smithi046.stdout:3/443: stat d2/d16/d11/d1b/d2d/d7d 0 2024-04-26T12:28:47.034 INFO:tasks.workunit.client.0.smithi046.stdout:9/319: rename d0/d2c/d3d/c43 to d0/d16/d5f/d68/c6b 0 2024-04-26T12:28:47.034 INFO:tasks.workunit.client.0.smithi046.stdout:5/418: mknod d9/da/dd/d34/d44/d88/c93 0 2024-04-26T12:28:47.034 INFO:tasks.workunit.client.0.smithi046.stdout:3/444: readlink d2/l1c 0 2024-04-26T12:28:47.034 INFO:tasks.workunit.client.0.smithi046.stdout:0/436: readlink d9/dc/dd/d45/l91 0 2024-04-26T12:28:47.034 INFO:tasks.workunit.client.0.smithi046.stdout:1/330: mknod d7/db/c71 0 2024-04-26T12:28:47.034 INFO:tasks.workunit.client.0.smithi046.stdout:9/320: mknod d0/d19/d21/c6c 0 2024-04-26T12:28:47.035 INFO:tasks.workunit.client.0.smithi046.stdout:3/445: write d2/d16/d11/f75 [503467,119796] 0 2024-04-26T12:28:47.036 INFO:tasks.workunit.client.0.smithi046.stdout:0/437: rename d9/c15 to d9/d1d/d5d/d6b/c9b 0 2024-04-26T12:28:47.037 INFO:tasks.workunit.client.0.smithi046.stdout:8/439: dread d7/dc/f13 [0,4194304] 0 2024-04-26T12:28:47.037 INFO:tasks.workunit.client.0.smithi046.stdout:3/446: creat d2/db/d62/fa1 x:0 0 0 2024-04-26T12:28:47.038 INFO:tasks.workunit.client.0.smithi046.stdout:5/419: dwrite d9/f4f [0,4194304] 0 2024-04-26T12:28:47.039 INFO:tasks.workunit.client.0.smithi046.stdout:0/438: mkdir d9/dc/dd/d90/d9c 0 2024-04-26T12:28:47.039 INFO:tasks.workunit.client.0.smithi046.stdout:8/440: symlink d7/d24/d50/d2a/d39/l97 0 2024-04-26T12:28:47.039 INFO:tasks.workunit.client.0.smithi046.stdout:3/447: symlink d2/d16/d11/d1f/d74/d88/la2 0 2024-04-26T12:28:47.040 INFO:tasks.workunit.client.0.smithi046.stdout:9/321: dread d0/d2c/d3d/f4f [0,4194304] 0 2024-04-26T12:28:47.040 INFO:tasks.workunit.client.0.smithi046.stdout:3/448: dread - d2/db/f10 zero size 2024-04-26T12:28:47.042 INFO:tasks.workunit.client.0.smithi046.stdout:8/441: symlink d7/dc/d1b/d7d/l98 0 2024-04-26T12:28:47.042 INFO:tasks.workunit.client.0.smithi046.stdout:1/331: getdents d7/db 0 2024-04-26T12:28:47.043 INFO:tasks.workunit.client.0.smithi046.stdout:3/449: chown d2/db/l2e 757658 1 2024-04-26T12:28:47.043 INFO:tasks.workunit.client.0.smithi046.stdout:9/322: creat d0/d19/f6d x:0 0 0 2024-04-26T12:28:47.044 INFO:tasks.workunit.client.0.smithi046.stdout:1/332: read d7/d14/f2f [195404,21798] 0 2024-04-26T12:28:47.044 INFO:tasks.workunit.client.0.smithi046.stdout:3/450: mknod d2/d16/ca3 0 2024-04-26T12:28:47.044 INFO:tasks.workunit.client.0.smithi046.stdout:8/442: rename d7/dc/d1b/f47 to d7/f99 0 2024-04-26T12:28:47.045 INFO:tasks.workunit.client.0.smithi046.stdout:0/439: dwrite d9/dc/d2a/f50 [0,4194304] 0 2024-04-26T12:28:47.046 INFO:tasks.workunit.client.0.smithi046.stdout:9/323: dread - d0/d19/d21/f53 zero size 2024-04-26T12:28:47.047 INFO:tasks.workunit.client.0.smithi046.stdout:0/440: truncate d9/d1d/d40/f94 1279944 0 2024-04-26T12:28:47.047 INFO:tasks.workunit.client.0.smithi046.stdout:8/443: symlink d7/d24/d50/d2a/d39/l9a 0 2024-04-26T12:28:47.048 INFO:tasks.workunit.client.0.smithi046.stdout:3/451: rename d2/f1d to d2/db/fa4 0 2024-04-26T12:28:47.048 INFO:tasks.workunit.client.0.smithi046.stdout:0/441: chown d9/l77 351171429 1 2024-04-26T12:28:47.049 INFO:tasks.workunit.client.0.smithi046.stdout:1/333: rename d7/d14/f2d to d7/d9/d2b/d39/d3c/f72 0 2024-04-26T12:28:47.049 INFO:tasks.workunit.client.0.smithi046.stdout:8/444: unlink d7/da/df/f7b 0 2024-04-26T12:28:47.050 INFO:tasks.workunit.client.0.smithi046.stdout:3/452: unlink d2/d16/d11/d23/f2a 0 2024-04-26T12:28:47.050 INFO:tasks.workunit.client.0.smithi046.stdout:0/442: mkdir d9/d1d/d40/d41/d7e/d9d 0 2024-04-26T12:28:47.051 INFO:tasks.workunit.client.0.smithi046.stdout:1/334: fdatasync d7/d9/d2b/d39/d3c/f72 0 2024-04-26T12:28:47.052 INFO:tasks.workunit.client.0.smithi046.stdout:8/445: link d7/dc/f17 d7/d24/d50/f9b 0 2024-04-26T12:28:47.052 INFO:tasks.workunit.client.0.smithi046.stdout:5/420: dwrite d9/da/f1b [0,4194304] 0 2024-04-26T12:28:47.054 INFO:tasks.workunit.client.0.smithi046.stdout:8/446: mknod d7/dc/c9c 0 2024-04-26T12:28:47.054 INFO:tasks.workunit.client.0.smithi046.stdout:6/425: dread d7/d1b/f23 [0,4194304] 0 2024-04-26T12:28:47.054 INFO:tasks.workunit.client.0.smithi046.stdout:1/335: truncate d7/d9/f1a 487332 0 2024-04-26T12:28:47.054 INFO:tasks.workunit.client.0.smithi046.stdout:0/443: link d9/dc/dd/f13 d9/d1d/d40/d41/d43/f9e 0 2024-04-26T12:28:47.054 INFO:tasks.workunit.client.0.smithi046.stdout:3/453: truncate d2/db/f55 1251343 0 2024-04-26T12:28:47.055 INFO:tasks.workunit.client.0.smithi046.stdout:1/336: chown d7/d14/f2f 3 1 2024-04-26T12:28:47.055 INFO:tasks.workunit.client.0.smithi046.stdout:6/426: dread - d7/d2b/d31/f80 zero size 2024-04-26T12:28:47.055 INFO:tasks.workunit.client.0.smithi046.stdout:5/421: creat d9/da/d40/f94 x:0 0 0 2024-04-26T12:28:47.055 INFO:tasks.workunit.client.0.smithi046.stdout:0/444: write d9/dc/f42 [863847,77814] 0 2024-04-26T12:28:47.055 INFO:tasks.workunit.client.0.smithi046.stdout:8/447: mkdir d7/d24/d50/d2a/d39/d9d 0 2024-04-26T12:28:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:6/427: fsync d7/fe 0 2024-04-26T12:28:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:1/337: chown d7/d14/d5d/d6b 11314 1 2024-04-26T12:28:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:5/422: readlink d9/da/d15/l2a 0 2024-04-26T12:28:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:2/359: dread d1/de/d15/f46 [4194304,4194304] 0 2024-04-26T12:28:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:1/338: truncate d7/d9/f66 327652 0 2024-04-26T12:28:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:3/454: truncate d2/d16/d11/f58 639451 0 2024-04-26T12:28:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:1/339: fsync d7/d9/f66 0 2024-04-26T12:28:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:6/428: rename d7/d2b/d31/f44 to d7/d1b/d6a/d57/f8d 0 2024-04-26T12:28:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:2/360: mknod d1/de/d65/d1b/d38/c74 0 2024-04-26T12:28:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:2/361: chown d1/de/d15 68037498 1 2024-04-26T12:28:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:3/455: mkdir d2/db/d84/da5 0 2024-04-26T12:28:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:6/429: symlink d7/d2b/l8e 0 2024-04-26T12:28:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:2/362: stat d1/de/d65/f5d 0 2024-04-26T12:28:47.060 INFO:tasks.workunit.client.0.smithi046.stdout:1/340: symlink d7/d14/d5d/l73 0 2024-04-26T12:28:47.061 INFO:tasks.workunit.client.0.smithi046.stdout:4/401: dread d0/d1/d12/f4b [0,4194304] 0 2024-04-26T12:28:47.063 INFO:tasks.workunit.client.0.smithi046.stdout:4/402: stat d0/da/d17/c5a 0 2024-04-26T12:28:47.063 INFO:tasks.workunit.client.0.smithi046.stdout:6/430: read d7/f62 [134647,94075] 0 2024-04-26T12:28:47.063 INFO:tasks.workunit.client.0.smithi046.stdout:3/456: truncate d2/d16/d35/f4e 1325621 0 2024-04-26T12:28:47.063 INFO:tasks.workunit.client.0.smithi046.stdout:2/363: mknod d1/de/d2b/c75 0 2024-04-26T12:28:47.064 INFO:tasks.workunit.client.0.smithi046.stdout:8/448: dread d7/da/df/f35 [0,4194304] 0 2024-04-26T12:28:47.064 INFO:tasks.workunit.client.0.smithi046.stdout:4/403: rmdir d0/d1/d12 39 2024-04-26T12:28:47.064 INFO:tasks.workunit.client.0.smithi046.stdout:1/341: creat d7/d14/d5d/f74 x:0 0 0 2024-04-26T12:28:47.064 INFO:tasks.workunit.client.0.smithi046.stdout:2/364: symlink d1/l76 0 2024-04-26T12:28:47.065 INFO:tasks.workunit.client.0.smithi046.stdout:6/431: write d7/d1b/f74 [682426,89725] 0 2024-04-26T12:28:47.065 INFO:tasks.workunit.client.0.smithi046.stdout:4/404: stat d0/da/d21/c5f 0 2024-04-26T12:28:47.065 INFO:tasks.workunit.client.0.smithi046.stdout:0/445: dwrite d9/dc/f37 [0,4194304] 0 2024-04-26T12:28:47.066 INFO:tasks.workunit.client.0.smithi046.stdout:3/457: chown d2/d16/d11/d1b/d2d/f5b 11563097 1 2024-04-26T12:28:47.066 INFO:tasks.workunit.client.0.smithi046.stdout:6/432: stat d7/fa 0 2024-04-26T12:28:47.067 INFO:tasks.workunit.client.0.smithi046.stdout:8/449: mknod d7/da/d4f/d7f/c9e 0 2024-04-26T12:28:47.067 INFO:tasks.workunit.client.0.smithi046.stdout:8/450: readlink l3 0 2024-04-26T12:28:47.067 INFO:tasks.workunit.client.0.smithi046.stdout:4/405: chown d0/da/d17/d20/d25/d35/d6d/d19/f3d 754563 1 2024-04-26T12:28:47.070 INFO:tasks.workunit.client.0.smithi046.stdout:4/406: symlink d0/da/d17/d20/d74/l84 0 2024-04-26T12:28:47.070 INFO:tasks.workunit.client.0.smithi046.stdout:3/458: write d2/db/f25 [3206660,53883] 0 2024-04-26T12:28:47.071 INFO:tasks.workunit.client.0.smithi046.stdout:6/433: rename d7/d16/l3d to d7/d1b/d6a/l8f 0 2024-04-26T12:28:47.071 INFO:tasks.workunit.client.0.smithi046.stdout:8/451: write d7/dc/d1b/f8c [375265,109557] 0 2024-04-26T12:28:47.072 INFO:tasks.workunit.client.0.smithi046.stdout:7/439: dread f3 [0,4194304] 0 2024-04-26T12:28:47.073 INFO:tasks.workunit.client.0.smithi046.stdout:4/407: chown d0/d41/l2a 1370 1 2024-04-26T12:28:47.073 INFO:tasks.workunit.client.0.smithi046.stdout:6/434: write d7/f79 [629557,97866] 0 2024-04-26T12:28:47.073 INFO:tasks.workunit.client.0.smithi046.stdout:7/440: chown d16/d35 3 1 2024-04-26T12:28:47.075 INFO:tasks.workunit.client.0.smithi046.stdout:2/365: dwrite d1/de/d65/d4a/d58/f73 [0,4194304] 0 2024-04-26T12:28:47.076 INFO:tasks.workunit.client.0.smithi046.stdout:1/342: dwrite d7/d9/d2b/d39/d3c/f72 [0,4194304] 0 2024-04-26T12:28:47.076 INFO:tasks.workunit.client.0.smithi046.stdout:9/324: sync 2024-04-26T12:28:47.076 INFO:tasks.workunit.client.0.smithi046.stdout:0/446: dwrite d9/dc/dd/f48 [0,4194304] 0 2024-04-26T12:28:47.077 INFO:tasks.workunit.client.0.smithi046.stdout:8/452: creat d7/d24/d50/d2a/d39/d9d/f9f x:0 0 0 2024-04-26T12:28:47.078 INFO:tasks.workunit.client.0.smithi046.stdout:2/366: fsync d1/de/d15/d18/f47 0 2024-04-26T12:28:47.079 INFO:tasks.workunit.client.0.smithi046.stdout:0/447: unlink d9/d1d/f6c 0 2024-04-26T12:28:47.080 INFO:tasks.workunit.client.0.smithi046.stdout:7/441: getdents d16/d27/d7e 0 2024-04-26T12:28:47.081 INFO:tasks.workunit.client.0.smithi046.stdout:8/453: mkdir d7/dc/d1b/da0 0 2024-04-26T12:28:47.083 INFO:tasks.workunit.client.0.smithi046.stdout:2/367: creat d1/d71/f77 x:0 0 0 2024-04-26T12:28:47.083 INFO:tasks.workunit.client.0.smithi046.stdout:4/408: rename d0/da/d17/l5c to d0/d1/l85 0 2024-04-26T12:28:47.083 INFO:tasks.workunit.client.0.smithi046.stdout:3/459: write d2/f7 [2349166,72769] 0 2024-04-26T12:28:47.083 INFO:tasks.workunit.client.0.smithi046.stdout:6/435: dwrite d7/f79 [0,4194304] 0 2024-04-26T12:28:47.084 INFO:tasks.workunit.client.0.smithi046.stdout:1/343: rename d7/d14/d5d/d6b/f6c to d7/d14/d5d/d32/f75 0 2024-04-26T12:28:47.086 INFO:tasks.workunit.client.0.smithi046.stdout:9/325: dwrite d0/d16/f60 [0,4194304] 0 2024-04-26T12:28:47.087 INFO:tasks.workunit.client.0.smithi046.stdout:4/409: truncate d0/da/d17/d20/f69 269969 0 2024-04-26T12:28:47.088 INFO:tasks.workunit.client.0.smithi046.stdout:1/344: mkdir d7/d12/d3a/d76 0 2024-04-26T12:28:47.089 INFO:tasks.workunit.client.0.smithi046.stdout:8/454: dread d7/da/d4f/f7a [0,4194304] 0 2024-04-26T12:28:47.090 INFO:tasks.workunit.client.0.smithi046.stdout:9/326: readlink d0/d2c/d47/ld 0 2024-04-26T12:28:47.091 INFO:tasks.workunit.client.0.smithi046.stdout:8/455: chown c2 0 1 2024-04-26T12:28:47.091 INFO:tasks.workunit.client.0.smithi046.stdout:0/448: dread d9/dc/d2a/f50 [0,4194304] 0 2024-04-26T12:28:47.093 INFO:tasks.workunit.client.0.smithi046.stdout:5/423: dread d9/da/dd/d34/d3e/f47 [0,4194304] 0 2024-04-26T12:28:47.093 INFO:tasks.workunit.client.0.smithi046.stdout:2/368: dwrite d1/de/d15/f4e [0,4194304] 0 2024-04-26T12:28:47.094 INFO:tasks.workunit.client.0.smithi046.stdout:7/442: dwrite f3 [0,4194304] 0 2024-04-26T12:28:47.094 INFO:tasks.workunit.client.0.smithi046.stdout:8/456: write d7/dc/d27/f3a [536044,81709] 0 2024-04-26T12:28:47.095 INFO:tasks.workunit.client.0.smithi046.stdout:2/369: mkdir d1/de/d65/d1b/d38/d78 0 2024-04-26T12:28:47.096 INFO:tasks.workunit.client.0.smithi046.stdout:8/457: creat d7/fa1 x:0 0 0 2024-04-26T12:28:47.097 INFO:tasks.workunit.client.0.smithi046.stdout:5/424: write d9/da/dd/f13 [4455816,50986] 0 2024-04-26T12:28:47.099 INFO:tasks.workunit.client.0.smithi046.stdout:2/370: mknod d1/de/d67/c79 0 2024-04-26T12:28:47.099 INFO:tasks.workunit.client.0.smithi046.stdout:1/345: dwrite d7/d9/fa [4194304,4194304] 0 2024-04-26T12:28:47.099 INFO:tasks.workunit.client.0.smithi046.stdout:8/458: truncate d7/f4a 4721712 0 2024-04-26T12:28:47.100 INFO:tasks.workunit.client.0.smithi046.stdout:5/425: creat d9/da/dd/d34/d45/f95 x:0 0 0 2024-04-26T12:28:47.100 INFO:tasks.workunit.client.0.smithi046.stdout:1/346: fdatasync d7/d14/f4f 0 2024-04-26T12:28:47.102 INFO:tasks.workunit.client.0.smithi046.stdout:2/371: rename d1/de/d15/d18/f47 to d1/d42/f7a 0 2024-04-26T12:28:47.103 INFO:tasks.workunit.client.0.smithi046.stdout:1/347: symlink d7/d9/l77 0 2024-04-26T12:28:47.103 INFO:tasks.workunit.client.0.smithi046.stdout:0/449: dwrite d9/d1d/d40/f6e [0,4194304] 0 2024-04-26T12:28:47.103 INFO:tasks.workunit.client.0.smithi046.stdout:6/436: truncate d7/d2b/f30 1103022 0 2024-04-26T12:28:47.103 INFO:tasks.workunit.client.0.smithi046.stdout:5/426: creat d9/da/d18/d8b/f96 x:0 0 0 2024-04-26T12:28:47.104 INFO:tasks.workunit.client.0.smithi046.stdout:8/459: link d7/d1c/f8b d7/d24/d50/d62/fa2 0 2024-04-26T12:28:47.104 INFO:tasks.workunit.client.0.smithi046.stdout:1/348: read d7/db/ff [1719512,102555] 0 2024-04-26T12:28:47.104 INFO:tasks.workunit.client.0.smithi046.stdout:4/410: symlink d0/d1/d29/l86 0 2024-04-26T12:28:47.107 INFO:tasks.workunit.client.0.smithi046.stdout:1/349: mknod d7/d12/d44/c78 0 2024-04-26T12:28:47.107 INFO:tasks.workunit.client.0.smithi046.stdout:5/427: write d9/da/dd/d34/d44/f7c [376097,29810] 0 2024-04-26T12:28:47.107 INFO:tasks.workunit.client.0.smithi046.stdout:9/327: truncate d0/d2c/d47/f23 91908 0 2024-04-26T12:28:47.108 INFO:tasks.workunit.client.0.smithi046.stdout:6/437: rename d7/c12 to d7/d1b/d47/d65/c90 0 2024-04-26T12:28:47.108 INFO:tasks.workunit.client.0.smithi046.stdout:8/460: mknod d7/d24/d50/d2a/d92/ca3 0 2024-04-26T12:28:47.108 INFO:tasks.workunit.client.0.smithi046.stdout:5/428: fdatasync d9/f41 0 2024-04-26T12:28:47.108 INFO:tasks.workunit.client.0.smithi046.stdout:1/350: dread - d7/f62 zero size 2024-04-26T12:28:47.110 INFO:tasks.workunit.client.0.smithi046.stdout:3/460: dread d2/d16/d2c/d50/d71/d89/f9e [0,4194304] 0 2024-04-26T12:28:47.110 INFO:tasks.workunit.client.0.smithi046.stdout:2/372: dwrite d1/de/d65/f4b [0,4194304] 0 2024-04-26T12:28:47.111 INFO:tasks.workunit.client.0.smithi046.stdout:8/461: chown d7/da/c21 185065908 1 2024-04-26T12:28:47.112 INFO:tasks.workunit.client.0.smithi046.stdout:5/429: dread - d9/da/dd/d69/f6c zero size 2024-04-26T12:28:47.112 INFO:tasks.workunit.client.0.smithi046.stdout:2/373: stat d1/d42/c6a 0 2024-04-26T12:28:47.112 INFO:tasks.workunit.client.0.smithi046.stdout:5/430: chown d9/da 16316 1 2024-04-26T12:28:47.112 INFO:tasks.workunit.client.0.smithi046.stdout:0/450: write d9/d1d/d5d/f5e [10210518,117320] 0 2024-04-26T12:28:47.113 INFO:tasks.workunit.client.0.smithi046.stdout:9/328: getdents d0/d2c/d3d 0 2024-04-26T12:28:47.113 INFO:tasks.workunit.client.0.smithi046.stdout:3/461: mknod d2/d16/d11/d6d/ca6 0 2024-04-26T12:28:47.113 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:47.112+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:47.115 INFO:tasks.workunit.client.0.smithi046.stdout:9/329: write d0/d19/d21/f53 [592116,117852] 0 2024-04-26T12:28:47.115 INFO:tasks.workunit.client.0.smithi046.stdout:4/411: dwrite d0/f52 [0,4194304] 0 2024-04-26T12:28:47.116 INFO:tasks.workunit.client.0.smithi046.stdout:8/462: readlink d7/d24/d50/d2a/d39/l4e 0 2024-04-26T12:28:47.116 INFO:tasks.workunit.client.0.smithi046.stdout:2/374: creat d1/de/d65/d1b/d38/d78/f7b x:0 0 0 2024-04-26T12:28:47.117 INFO:tasks.workunit.client.0.smithi046.stdout:5/431: write d9/da/d18/f39 [3295824,88147] 0 2024-04-26T12:28:47.118 INFO:tasks.workunit.client.0.smithi046.stdout:3/462: creat d2/d16/d11/d1f/d74/fa7 x:0 0 0 2024-04-26T12:28:47.118 INFO:tasks.workunit.client.0.smithi046.stdout:9/330: chown d0/f5 64225 1 2024-04-26T12:28:47.119 INFO:tasks.workunit.client.0.smithi046.stdout:6/438: dread d7/d1b/d47/f49 [0,4194304] 0 2024-04-26T12:28:47.120 INFO:tasks.workunit.client.0.smithi046.stdout:4/412: creat d0/d1/f87 x:0 0 0 2024-04-26T12:28:47.121 INFO:tasks.workunit.client.0.smithi046.stdout:1/351: dwrite d7/d14/f4f [0,4194304] 0 2024-04-26T12:28:47.121 INFO:tasks.workunit.client.0.smithi046.stdout:2/375: write d1/de/f31 [2667506,28174] 0 2024-04-26T12:28:47.121 INFO:tasks.workunit.client.0.smithi046.stdout:9/331: creat d0/d16/f6e x:0 0 0 2024-04-26T12:28:47.121 INFO:tasks.workunit.client.0.smithi046.stdout:0/451: dwrite f5 [0,4194304] 0 2024-04-26T12:28:47.124 INFO:tasks.workunit.client.0.smithi046.stdout:7/443: dread d16/d1a/d31/f70 [0,4194304] 0 2024-04-26T12:28:47.124 INFO:tasks.workunit.client.0.smithi046.stdout:2/376: dread - d1/de/d15/d18/f6c zero size 2024-04-26T12:28:47.125 INFO:tasks.workunit.client.0.smithi046.stdout:0/452: write d9/dc/dd/d45/f49 [19138,58861] 0 2024-04-26T12:28:47.125 INFO:tasks.workunit.client.0.smithi046.stdout:5/432: mkdir d9/da/dd/d34/d44/d97 0 2024-04-26T12:28:47.126 INFO:tasks.workunit.client.0.smithi046.stdout:6/439: write d7/d1b/d6a/d57/f8d [2331974,124089] 0 2024-04-26T12:28:47.126 INFO:tasks.workunit.client.0.smithi046.stdout:8/463: dwrite d7/fa1 [0,4194304] 0 2024-04-26T12:28:47.130 INFO:tasks.workunit.client.0.smithi046.stdout:9/332: rename d0/c12 to d0/d29/c6f 0 2024-04-26T12:28:47.130 INFO:tasks.workunit.client.0.smithi046.stdout:0/453: rmdir d9/dc/dd/d45 39 2024-04-26T12:28:47.130 INFO:tasks.workunit.client.0.smithi046.stdout:2/377: fsync d1/de/d65/d1b/d38/d78/f7b 0 2024-04-26T12:28:47.130 INFO:tasks.workunit.client.0.smithi046.stdout:6/440: dread - d7/d2b/f8a zero size 2024-04-26T12:28:47.130 INFO:tasks.workunit.client.0.smithi046.stdout:5/433: mknod d9/da/d3b/d35/c98 0 2024-04-26T12:28:47.130 INFO:tasks.workunit.client.0.smithi046.stdout:3/463: dwrite d2/db/d4a/f3b [0,4194304] 0 2024-04-26T12:28:47.131 INFO:tasks.workunit.client.0.smithi046.stdout:4/413: read d0/da/d17/d20/d25/d35/d6d/f23 [330891,83687] 0 2024-04-26T12:28:47.132 INFO:tasks.workunit.client.0.smithi046.stdout:0/454: creat d9/dc/f9f x:0 0 0 2024-04-26T12:28:47.132 INFO:tasks.workunit.client.0.smithi046.stdout:5/434: dread - d9/da/dd/d34/d45/f95 zero size 2024-04-26T12:28:47.133 INFO:tasks.workunit.client.0.smithi046.stdout:9/333: rename d0/d16/f6a to d0/d29/d69/f70 0 2024-04-26T12:28:47.135 INFO:tasks.workunit.client.0.smithi046.stdout:2/378: rename d1/de/d15/d18/f6c to d1/de/d2b/f7c 0 2024-04-26T12:28:47.135 INFO:tasks.workunit.client.0.smithi046.stdout:0/455: stat d9/dc/dd/f25 0 2024-04-26T12:28:47.136 INFO:tasks.workunit.client.0.smithi046.stdout:7/444: dwrite d16/d3f/f47 [4194304,4194304] 0 2024-04-26T12:28:47.137 INFO:tasks.workunit.client.0.smithi046.stdout:9/334: rename d0/d29/l31 to d0/d29/d69/l71 0 2024-04-26T12:28:47.137 INFO:tasks.workunit.client.0.smithi046.stdout:1/352: dwrite d7/d14/f4f [0,4194304] 0 2024-04-26T12:28:47.140 INFO:tasks.workunit.client.0.smithi046.stdout:4/414: rename d0/d1/d29/c2c to d0/d41/d3f/c88 0 2024-04-26T12:28:47.140 INFO:tasks.workunit.client.0.smithi046.stdout:8/464: dwrite d7/d24/d50/d62/f7e [0,4194304] 0 2024-04-26T12:28:47.141 INFO:tasks.workunit.client.0.smithi046.stdout:1/353: chown d7/db/ff 783053 1 2024-04-26T12:28:47.141 INFO:tasks.workunit.client.0.smithi046.stdout:9/335: write d0/f10 [413452,112779] 0 2024-04-26T12:28:47.142 INFO:tasks.workunit.client.0.smithi046.stdout:7/445: truncate d16/d1a/d3e/d4f/f48 4514141 0 2024-04-26T12:28:47.142 INFO:tasks.workunit.client.0.smithi046.stdout:0/456: mknod d9/d1d/d5d/d6b/d8a/d8c/ca0 0 2024-04-26T12:28:47.143 INFO:tasks.workunit.client.0.smithi046.stdout:8/465: write d7/dc/f45 [813740,68289] 0 2024-04-26T12:28:47.144 INFO:tasks.workunit.client.0.smithi046.stdout:9/336: mkdir d0/d16/d5f/d68/d72 0 2024-04-26T12:28:47.144 INFO:tasks.workunit.client.0.smithi046.stdout:4/415: readlink d0/d1/d12/l66 0 2024-04-26T12:28:47.145 INFO:tasks.workunit.client.0.smithi046.stdout:5/435: read d9/da/dd/d34/d3e/f51 [110333,96480] 0 2024-04-26T12:28:47.146 INFO:tasks.workunit.client.0.smithi046.stdout:3/464: dwrite d2/db/f25 [4194304,4194304] 0 2024-04-26T12:28:47.147 INFO:tasks.workunit.client.0.smithi046.stdout:6/441: dwrite d7/d1b/f4b [0,4194304] 0 2024-04-26T12:28:47.147 INFO:tasks.workunit.client.0.smithi046.stdout:2/379: dwrite d1/de/d2b/f37 [0,4194304] 0 2024-04-26T12:28:47.148 INFO:tasks.workunit.client.0.smithi046.stdout:7/446: mkdir d16/d1a/d31/d5a/d93 0 2024-04-26T12:28:47.150 INFO:tasks.workunit.client.0.smithi046.stdout:3/465: truncate d2/d16/f79 823940 0 2024-04-26T12:28:47.150 INFO:tasks.workunit.client.0.smithi046.stdout:7/447: fdatasync d16/d1a/d31/d5a/d78/f87 0 2024-04-26T12:28:47.151 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:47.151 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:47.151 INFO:tasks.workunit.client.0.smithi046.stdout:0/457: link d9/f10 d9/dc/d4c/d62/fa1 0 2024-04-26T12:28:47.152 INFO:tasks.workunit.client.0.smithi046.stdout:7/448: stat d16/d35/c64 0 2024-04-26T12:28:47.152 INFO:tasks.workunit.client.0.smithi046.stdout:4/416: write d0/da/d17/d20/d25/d35/d6d/d19/f3d [1689677,36926] 0 2024-04-26T12:28:47.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/466: symlink d2/db/d4a/la8 0 2024-04-26T12:28:47.156 INFO:tasks.workunit.client.0.smithi046.stdout:8/466: dwrite d7/f4a [0,4194304] 0 2024-04-26T12:28:47.157 INFO:tasks.workunit.client.0.smithi046.stdout:6/442: dwrite d7/f59 [0,4194304] 0 2024-04-26T12:28:47.157 INFO:tasks.workunit.client.0.smithi046.stdout:0/458: symlink d9/dc/dd/d45/la2 0 2024-04-26T12:28:47.157 INFO:tasks.workunit.client.0.smithi046.stdout:7/449: getdents d16/d1a/d31/d5a/d93 0 2024-04-26T12:28:47.158 INFO:tasks.workunit.client.0.smithi046.stdout:5/436: dwrite d9/da/d18/d7d/f63 [0,4194304] 0 2024-04-26T12:28:47.158 INFO:tasks.workunit.client.0.smithi046.stdout:8/467: chown d7/d24/f53 1 1 2024-04-26T12:28:47.158 INFO:tasks.workunit.client.0.smithi046.stdout:6/443: readlink d7/d2b/d31/d4d/l72 0 2024-04-26T12:28:47.158 INFO:tasks.workunit.client.0.smithi046.stdout:6/444: chown d7/d1b/d6a/d57/f75 0 1 2024-04-26T12:28:47.159 INFO:tasks.workunit.client.0.smithi046.stdout:8/468: chown d7/dc/d1b/f79 1150480841 1 2024-04-26T12:28:47.160 INFO:tasks.workunit.client.0.smithi046.stdout:7/450: creat d16/d1a/d31/d5a/d78/f94 x:0 0 0 2024-04-26T12:28:47.160 INFO:tasks.workunit.client.0.smithi046.stdout:3/467: getdents d2/d16/d2c/d50/d71 0 2024-04-26T12:28:47.160 INFO:tasks.workunit.client.0.smithi046.stdout:7/451: chown d16/d27/d7e 3757955 1 2024-04-26T12:28:47.161 INFO:tasks.workunit.client.0.smithi046.stdout:8/469: mknod d7/d24/d50/d62/ca4 0 2024-04-26T12:28:47.163 INFO:tasks.workunit.client.0.smithi046.stdout:8/470: write d7/d24/f2f [443945,103777] 0 2024-04-26T12:28:47.163 INFO:tasks.workunit.client.0.smithi046.stdout:3/468: write d2/d16/f37 [1908437,120042] 0 2024-04-26T12:28:47.163 INFO:tasks.workunit.client.0.smithi046.stdout:7/452: write d16/d35/f3b [509005,108955] 0 2024-04-26T12:28:47.165 INFO:tasks.workunit.client.0.smithi046.stdout:8/471: chown d7/d24/d50/d62/f7e 2050 1 2024-04-26T12:28:47.166 INFO:tasks.workunit.client.0.smithi046.stdout:5/437: dwrite d9/da/d40/f50 [0,4194304] 0 2024-04-26T12:28:47.166 INFO:tasks.workunit.client.0.smithi046.stdout:9/337: dread d0/d2c/f4e [0,4194304] 0 2024-04-26T12:28:47.166 INFO:tasks.workunit.client.0.smithi046.stdout:8/472: mknod d7/da/d4f/d7f/ca5 0 2024-04-26T12:28:47.166 INFO:tasks.workunit.client.0.smithi046.stdout:3/469: rename d2/d16/d11/d1f/d74/d88 to d2/db/d4a/da9 0 2024-04-26T12:28:47.166 INFO:tasks.workunit.client.0.smithi046.stdout:9/338: stat d0/d2c/d47/f2d 0 2024-04-26T12:28:47.166 INFO:tasks.workunit.client.0.smithi046.stdout:5/438: symlink d9/da/dd/d34/d44/l99 0 2024-04-26T12:28:47.167 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:47.168 INFO:tasks.workunit.client.0.smithi046.stdout:4/417: write d0/d1/d5/db/f10 [3732506,11300] 0 2024-04-26T12:28:47.168 INFO:tasks.workunit.client.0.smithi046.stdout:8/473: mkdir d7/d24/d50/d2a/d39/da6 0 2024-04-26T12:28:47.168 INFO:tasks.workunit.client.0.smithi046.stdout:5/439: mknod d9/da/dd/d69/d7e/c9a 0 2024-04-26T12:28:47.169 INFO:tasks.workunit.client.0.smithi046.stdout:2/380: read d1/de/d15/d18/f2c [1380540,30953] 0 2024-04-26T12:28:47.169 INFO:tasks.workunit.client.0.smithi046.stdout:4/418: write d0/da/d17/d20/d25/d35/d6d/d19/d55/f82 [691462,67235] 0 2024-04-26T12:28:47.170 INFO:tasks.workunit.client.0.smithi046.stdout:2/381: creat d1/de/d65/d4a/f7d x:0 0 0 2024-04-26T12:28:47.175 INFO:tasks.workunit.client.0.smithi046.stdout:0/459: read d9/dc/f26 [1586125,19664] 0 2024-04-26T12:28:47.175 INFO:tasks.workunit.client.0.smithi046.stdout:9/339: dwrite d0/d19/d21/f4a [0,4194304] 0 2024-04-26T12:28:47.175 INFO:tasks.workunit.client.0.smithi046.stdout:5/440: dread d9/da/dd/d34/d3e/f51 [0,4194304] 0 2024-04-26T12:28:47.177 INFO:tasks.workunit.client.0.smithi046.stdout:6/445: read d7/d1b/f24 [416088,92775] 0 2024-04-26T12:28:47.177 INFO:tasks.workunit.client.0.smithi046.stdout:1/354: sync 2024-04-26T12:28:47.178 INFO:tasks.workunit.client.0.smithi046.stdout:0/460: fsync d9/dc/d4c/d62/fa1 0 2024-04-26T12:28:47.179 INFO:tasks.workunit.client.0.smithi046.stdout:9/340: chown d0/d2c/d47/c5b 252748623 1 2024-04-26T12:28:47.179 INFO:tasks.workunit.client.0.smithi046.stdout:5/441: chown d9/da/dd/f85 1521301 1 2024-04-26T12:28:47.181 INFO:tasks.workunit.client.0.smithi046.stdout:8/474: dwrite d7/dc/f70 [0,4194304] 0 2024-04-26T12:28:47.182 INFO:tasks.workunit.client.0.smithi046.stdout:7/453: dwrite d16/d1a/d31/d4d/f5f [4194304,4194304] 0 2024-04-26T12:28:47.182 INFO:tasks.workunit.client.0.smithi046.stdout:6/446: stat d7/d1b/d37/f3b 0 2024-04-26T12:28:47.182 INFO:tasks.workunit.client.0.smithi046.stdout:1/355: mkdir d7/d38/d79 0 2024-04-26T12:28:47.182 INFO:tasks.workunit.client.0.smithi046.stdout:2/382: read d1/f35 [577806,22666] 0 2024-04-26T12:28:47.183 INFO:tasks.workunit.client.0.smithi046.stdout:4/419: dwrite d0/d1/d5/f2b [4194304,4194304] 0 2024-04-26T12:28:47.183 INFO:tasks.workunit.client.0.smithi046.stdout:5/442: dread - d9/da/d18/d8b/f96 zero size 2024-04-26T12:28:47.184 INFO:tasks.workunit.client.0.smithi046.stdout:6/447: mknod d7/d1b/d47/d65/c91 0 2024-04-26T12:28:47.184 INFO:tasks.workunit.client.0.smithi046.stdout:9/341: chown d0/d19/c63 14917816 1 2024-04-26T12:28:47.184 INFO:tasks.workunit.client.0.smithi046.stdout:2/383: truncate d1/de/f11 1643254 0 2024-04-26T12:28:47.185 INFO:tasks.workunit.client.0.smithi046.stdout:9/342: symlink d0/d2c/d3d/d52/l73 0 2024-04-26T12:28:47.186 INFO:tasks.workunit.client.0.smithi046.stdout:4/420: chown d0/da/d17/d20/d25/d35/d6d/d19/f6c 15523526 1 2024-04-26T12:28:47.186 INFO:tasks.workunit.client.0.smithi046.stdout:2/384: creat d1/de/d65/d1b/d38/f7e x:0 0 0 2024-04-26T12:28:47.188 INFO:tasks.workunit.client.0.smithi046.stdout:5/443: link d9/da/dd/f32 d9/da/dd/d5d/f9b 0 2024-04-26T12:28:47.188 INFO:tasks.workunit.client.0.smithi046.stdout:4/421: write d0/da/d17/d20/f39 [354101,94672] 0 2024-04-26T12:28:47.188 INFO:tasks.workunit.client.0.smithi046.stdout:2/385: unlink d1/de/d15/l19 0 2024-04-26T12:28:47.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/461: dwrite d9/d1d/d5d/d6b/d8a/f67 [0,4194304] 0 2024-04-26T12:28:47.190 INFO:tasks.workunit.client.0.smithi046.stdout:0/462: readlink d9/d1d/l2e 0 2024-04-26T12:28:47.190 INFO:tasks.workunit.client.0.smithi046.stdout:5/444: unlink d9/da/dd/f85 0 2024-04-26T12:28:47.190 INFO:tasks.workunit.client.0.smithi046.stdout:9/343: getdents d0/d29 0 2024-04-26T12:28:47.191 INFO:tasks.workunit.client.0.smithi046.stdout:8/475: dwrite d7/da/df/f10 [0,4194304] 0 2024-04-26T12:28:47.191 INFO:tasks.workunit.client.0.smithi046.stdout:1/356: write d7/d9/f17 [1682433,55917] 0 2024-04-26T12:28:47.191 INFO:tasks.workunit.client.0.smithi046.stdout:4/422: getdents d0/d1/d12 0 2024-04-26T12:28:47.193 INFO:tasks.workunit.client.0.smithi046.stdout:8/476: write d7/da/df/f4d [3840193,15663] 0 2024-04-26T12:28:47.193 INFO:tasks.workunit.client.0.smithi046.stdout:0/463: truncate f3 3294780 0 2024-04-26T12:28:47.195 INFO:tasks.workunit.client.0.smithi046.stdout:5/445: mknod d9/da/dd/d5d/c9c 0 2024-04-26T12:28:47.195 INFO:tasks.workunit.client.0.smithi046.stdout:9/344: symlink d0/d16/d5f/l74 0 2024-04-26T12:28:47.195 INFO:tasks.workunit.client.0.smithi046.stdout:1/357: symlink d7/d9/l7a 0 2024-04-26T12:28:47.195 INFO:tasks.workunit.client.0.smithi046.stdout:0/464: creat d9/dc/d4c/fa3 x:0 0 0 2024-04-26T12:28:47.195 INFO:tasks.workunit.client.0.smithi046.stdout:4/423: symlink d0/da/d17/d20/d25/d35/l89 0 2024-04-26T12:28:47.196 INFO:tasks.workunit.client.0.smithi046.stdout:1/358: fdatasync d7/d9/f58 0 2024-04-26T12:28:47.198 INFO:tasks.workunit.client.0.smithi046.stdout:2/386: dwrite d1/de/d65/f4b [0,4194304] 0 2024-04-26T12:28:47.198 INFO:tasks.workunit.client.0.smithi046.stdout:0/465: rename d9/dc/dd/d90/d9c to d9/d1d/d40/d41/d43/da4 0 2024-04-26T12:28:47.198 INFO:tasks.workunit.client.0.smithi046.stdout:5/446: mknod d9/da/dd/d34/d44/d88/d90/c9d 0 2024-04-26T12:28:47.199 INFO:tasks.workunit.client.0.smithi046.stdout:1/359: mknod d7/d14/c7b 0 2024-04-26T12:28:47.200 INFO:tasks.workunit.client.0.smithi046.stdout:3/470: dread d2/f7 [0,4194304] 0 2024-04-26T12:28:47.202 INFO:tasks.workunit.client.0.smithi046.stdout:0/466: dread - d9/dc/dd/f64 zero size 2024-04-26T12:28:47.202 INFO:tasks.workunit.client.0.smithi046.stdout:1/360: dread - d7/d12/f57 zero size 2024-04-26T12:28:47.203 INFO:tasks.workunit.client.0.smithi046.stdout:8/477: dwrite d7/f83 [0,4194304] 0 2024-04-26T12:28:47.203 INFO:tasks.workunit.client.0.smithi046.stdout:5/447: write d9/da/dd/f64 [840913,58697] 0 2024-04-26T12:28:47.205 INFO:tasks.workunit.client.0.smithi046.stdout:8/478: fdatasync d7/dc/d27/f3a 0 2024-04-26T12:28:47.206 INFO:tasks.workunit.client.0.smithi046.stdout:1/361: creat d7/d12/d3a/d76/f7c x:0 0 0 2024-04-26T12:28:47.206 INFO:tasks.workunit.client.0.smithi046.stdout:0/467: rmdir d9/dc/d4c/d62 39 2024-04-26T12:28:47.207 INFO:tasks.workunit.client.0.smithi046.stdout:3/471: write d2/db/fa4 [3920740,84832] 0 2024-04-26T12:28:47.207 INFO:tasks.workunit.client.0.smithi046.stdout:9/345: dwrite d0/d29/f4c [4194304,4194304] 0 2024-04-26T12:28:47.207 INFO:tasks.workunit.client.0.smithi046.stdout:8/479: creat d7/da/fa7 x:0 0 0 2024-04-26T12:28:47.207 INFO:tasks.workunit.client.0.smithi046.stdout:1/362: creat d7/d14/d5d/f7d x:0 0 0 2024-04-26T12:28:47.208 INFO:tasks.workunit.client.0.smithi046.stdout:4/424: dwrite d0/da/d17/d20/d25/d35/f5d [0,4194304] 0 2024-04-26T12:28:47.208 INFO:tasks.workunit.client.0.smithi046.stdout:9/346: mknod d0/d16/c75 0 2024-04-26T12:28:47.208 INFO:tasks.workunit.client.0.smithi046.stdout:8/480: creat d7/d24/d50/d2a/d39/fa8 x:0 0 0 2024-04-26T12:28:47.208 INFO:tasks.workunit.client.0.smithi046.stdout:9/347: mkdir d0/d16/d76 0 2024-04-26T12:28:47.209 INFO:tasks.workunit.client.0.smithi046.stdout:3/472: rename d2/d16/d11/d1b/c4d to d2/db/caa 0 2024-04-26T12:28:47.209 INFO:tasks.workunit.client.0.smithi046.stdout:9/348: creat d0/d29/d69/f77 x:0 0 0 2024-04-26T12:28:47.210 INFO:tasks.workunit.client.0.smithi046.stdout:5/448: chown d9/da/dd/d5d 25 1 2024-04-26T12:28:47.211 INFO:tasks.workunit.client.0.smithi046.stdout:4/425: link d0/da/d17/d20/c54 d0/d41/c8a 0 2024-04-26T12:28:47.211 INFO:tasks.workunit.client.0.smithi046.stdout:9/349: chown d0/d16/c45 134081281 1 2024-04-26T12:28:47.211 INFO:tasks.workunit.client.0.smithi046.stdout:5/449: symlink d9/da/dd/d34/d6b/l9e 0 2024-04-26T12:28:47.211 INFO:tasks.workunit.client.0.smithi046.stdout:9/350: stat d0/d2c/d47/f58 0 2024-04-26T12:28:47.212 INFO:tasks.workunit.client.0.smithi046.stdout:4/426: mknod d0/da/d17/d20/d25/d35/c8b 0 2024-04-26T12:28:47.212 INFO:tasks.workunit.client.0.smithi046.stdout:9/351: symlink d0/d2c/d47/l78 0 2024-04-26T12:28:47.213 INFO:tasks.workunit.client.0.smithi046.stdout:8/481: dwrite d7/fa1 [0,4194304] 0 2024-04-26T12:28:47.214 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:47.212+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:47.214 INFO:tasks.workunit.client.0.smithi046.stdout:4/427: write d0/da/d17/d20/d25/d35/f5d [5211759,40424] 0 2024-04-26T12:28:47.214 INFO:tasks.workunit.client.0.smithi046.stdout:2/387: truncate d1/de/d65/d4a/d58/f73 2374038 0 2024-04-26T12:28:47.214 INFO:tasks.workunit.client.0.smithi046.stdout:9/352: write d0/d2c/d47/ff [3281997,99931] 0 2024-04-26T12:28:47.215 INFO:tasks.workunit.client.0.smithi046.stdout:8/482: unlink d7/d1c/l6b 0 2024-04-26T12:28:47.216 INFO:tasks.workunit.client.0.smithi046.stdout:2/388: write d1/de/d65/d4a/f59 [811109,47030] 0 2024-04-26T12:28:47.216 INFO:tasks.workunit.client.0.smithi046.stdout:8/483: chown d7/d24/d50/f72 49314 1 2024-04-26T12:28:47.218 INFO:tasks.workunit.client.0.smithi046.stdout:4/428: mknod d0/c8c 0 2024-04-26T12:28:47.218 INFO:tasks.workunit.client.0.smithi046.stdout:9/353: creat d0/d16/d76/f79 x:0 0 0 2024-04-26T12:28:47.218 INFO:tasks.workunit.client.0.smithi046.stdout:9/354: write d0/d19/f2f [1861965,104100] 0 2024-04-26T12:28:47.219 INFO:tasks.workunit.client.0.smithi046.stdout:2/389: fdatasync d1/f35 0 2024-04-26T12:28:47.220 INFO:tasks.workunit.client.0.smithi046.stdout:5/450: dwrite d9/da/f4b [0,4194304] 0 2024-04-26T12:28:47.220 INFO:tasks.workunit.client.0.smithi046.stdout:8/484: link d7/dc/d1b/f8e d7/da/fa9 0 2024-04-26T12:28:47.221 INFO:tasks.workunit.client.0.smithi046.stdout:4/429: fsync d0/f14 0 2024-04-26T12:28:47.221 INFO:tasks.workunit.client.0.smithi046.stdout:3/473: link d2/f17 d2/d16/d11/d1b/fab 0 2024-04-26T12:28:47.221 INFO:tasks.workunit.client.0.smithi046.stdout:9/355: rmdir d0/d16/d5f/d68 39 2024-04-26T12:28:47.222 INFO:tasks.workunit.client.0.smithi046.stdout:8/485: unlink d7/da/df/f4d 0 2024-04-26T12:28:47.222 INFO:tasks.workunit.client.0.smithi046.stdout:4/430: read - d0/d1/f87 zero size 2024-04-26T12:28:47.222 INFO:tasks.workunit.client.0.smithi046.stdout:8/486: read d7/f83 [3253447,119439] 0 2024-04-26T12:28:47.223 INFO:tasks.workunit.client.0.smithi046.stdout:5/451: link d9/da/f1b d9/da/d15/f9f 0 2024-04-26T12:28:47.223 INFO:tasks.workunit.client.0.smithi046.stdout:2/390: write d1/de/d65/d4a/f59 [1777472,40447] 0 2024-04-26T12:28:47.224 INFO:tasks.workunit.client.0.smithi046.stdout:9/356: write d0/d16/d5f/f64 [502351,51435] 0 2024-04-26T12:28:47.224 INFO:tasks.workunit.client.0.smithi046.stdout:4/431: symlink d0/d1/d5/db/l8d 0 2024-04-26T12:28:47.226 INFO:tasks.workunit.client.0.smithi046.stdout:9/357: write d0/d2c/d47/f2e [1414980,73137] 0 2024-04-26T12:28:47.226 INFO:tasks.workunit.client.0.smithi046.stdout:4/432: chown d0/c8c 49503353 1 2024-04-26T12:28:47.226 INFO:tasks.workunit.client.0.smithi046.stdout:2/391: symlink d1/de/d15/d18/l7f 0 2024-04-26T12:28:47.227 INFO:tasks.workunit.client.0.smithi046.stdout:8/487: dread d7/da/d4f/f7a [0,4194304] 0 2024-04-26T12:28:47.227 INFO:tasks.workunit.client.0.smithi046.stdout:5/452: getdents d9/da/dd 0 2024-04-26T12:28:47.232 INFO:tasks.workunit.client.0.smithi046.stdout:9/358: mknod d0/d19/d21/c7a 0 2024-04-26T12:28:47.232 INFO:tasks.workunit.client.0.smithi046.stdout:8/488: chown d7/dc 73810088 1 2024-04-26T12:28:47.233 INFO:tasks.workunit.client.0.smithi046.stdout:3/474: dwrite d2/d16/d11/d1b/d2d/d7d/f80 [0,4194304] 0 2024-04-26T12:28:47.237 INFO:tasks.workunit.client.0.smithi046.stdout:4/433: dwrite d0/da/d17/d20/d25/d35/d6d/d19/f4a [0,4194304] 0 2024-04-26T12:28:47.255 INFO:tasks.workunit.client.0.smithi046.stdout:7/454: sync 2024-04-26T12:28:47.256 INFO:tasks.workunit.client.0.smithi046.stdout:7/455: stat d16/d1a/d31/f70 0 2024-04-26T12:28:47.258 INFO:tasks.workunit.client.0.smithi046.stdout:2/392: creat d1/de/d65/d4a/f80 x:0 0 0 2024-04-26T12:28:47.258 INFO:tasks.workunit.client.0.smithi046.stdout:7/456: write d16/d1a/d3e/d4f/f48 [2309046,126130] 0 2024-04-26T12:28:47.258 INFO:tasks.workunit.client.0.smithi046.stdout:5/453: creat d9/da/dd/d34/d44/d88/d90/fa0 x:0 0 0 2024-04-26T12:28:47.260 INFO:tasks.workunit.client.0.smithi046.stdout:4/434: mkdir d0/da/d17/d20/d8e 0 2024-04-26T12:28:47.261 INFO:tasks.workunit.client.0.smithi046.stdout:9/359: mknod d0/d19/c7b 0 2024-04-26T12:28:47.262 INFO:tasks.workunit.client.0.smithi046.stdout:9/360: read d0/d2c/d47/f26 [7662875,19532] 0 2024-04-26T12:28:47.263 INFO:tasks.workunit.client.0.smithi046.stdout:7/457: rename f3 to d16/d1a/d69/f95 0 2024-04-26T12:28:47.264 INFO:tasks.workunit.client.0.smithi046.stdout:7/458: write d16/d35/f3a [1137473,41448] 0 2024-04-26T12:28:47.266 INFO:tasks.workunit.client.0.smithi046.stdout:4/435: creat d0/d1/d5/db/f8f x:0 0 0 2024-04-26T12:28:47.268 INFO:tasks.workunit.client.0.smithi046.stdout:2/393: mknod d1/de/d15/c81 0 2024-04-26T12:28:47.268 INFO:tasks.workunit.client.0.smithi046.stdout:9/361: mknod d0/d19/d21/c7c 0 2024-04-26T12:28:47.268 INFO:tasks.workunit.client.0.smithi046.stdout:3/475: rmdir d2/db/d84/d8a/da0 0 2024-04-26T12:28:47.268 INFO:tasks.workunit.client.0.smithi046.stdout:5/454: link d9/da/d3b/f92 d9/da/dd/d69/d7e/fa1 0 2024-04-26T12:28:47.269 INFO:tasks.workunit.client.0.smithi046.stdout:2/394: write d1/de/f5e [662699,101843] 0 2024-04-26T12:28:47.270 INFO:tasks.workunit.client.0.smithi046.stdout:9/362: chown d0/d16/l1c 58084718 1 2024-04-26T12:28:47.270 INFO:tasks.workunit.client.0.smithi046.stdout:7/459: dwrite d16/d35/f5d [0,4194304] 0 2024-04-26T12:28:47.270 INFO:tasks.workunit.client.0.smithi046.stdout:3/476: rmdir d2/db/d4a/da9 39 2024-04-26T12:28:47.270 INFO:tasks.workunit.client.0.smithi046.stdout:5/455: chown d9/da/dd/d34/d44/f8e 126723 1 2024-04-26T12:28:47.270 INFO:tasks.workunit.client.0.smithi046.stdout:4/436: truncate d0/da/d17/d20/d25/d35/d6d/d19/d55/f82 1511520 0 2024-04-26T12:28:47.271 INFO:tasks.workunit.client.0.smithi046.stdout:7/460: dread - d16/d1a/d31/d5a/d78/f87 zero size 2024-04-26T12:28:47.274 INFO:tasks.workunit.client.0.smithi046.stdout:4/437: stat d0/d1/d5/f2b 0 2024-04-26T12:28:47.275 INFO:tasks.workunit.client.0.smithi046.stdout:9/363: dread d0/d19/d21/f4a [0,4194304] 0 2024-04-26T12:28:47.275 INFO:tasks.workunit.client.0.smithi046.stdout:4/438: write d0/d1/f87 [392022,11135] 0 2024-04-26T12:28:47.277 INFO:tasks.workunit.client.0.smithi046.stdout:3/477: dwrite d2/d16/d11/d1b/d2d/f56 [0,4194304] 0 2024-04-26T12:28:47.278 INFO:tasks.workunit.client.0.smithi046.stdout:6/448: sync 2024-04-26T12:28:47.282 INFO:tasks.workunit.client.0.smithi046.stdout:2/395: link d1/de/d2b/f50 d1/de/d65/d4a/f82 0 2024-04-26T12:28:47.282 INFO:tasks.workunit.client.0.smithi046.stdout:7/461: rename d16/d1a/d3e/d4f/f48 to d16/d1a/d31/d5a/f96 0 2024-04-26T12:28:47.283 INFO:tasks.workunit.client.0.smithi046.stdout:2/396: chown d1/de/d65/l32 74930 1 2024-04-26T12:28:47.284 INFO:tasks.workunit.client.0.smithi046.stdout:8/489: truncate d7/d24/f2f 2376088 0 2024-04-26T12:28:47.288 INFO:tasks.workunit.client.0.smithi046.stdout:1/363: sync 2024-04-26T12:28:47.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/468: sync 2024-04-26T12:28:47.288 INFO:tasks.workunit.client.0.smithi046.stdout:3/478: creat d2/db/d62/fac x:0 0 0 2024-04-26T12:28:47.289 INFO:tasks.workunit.client.0.smithi046.stdout:6/449: dread d7/d2b/f30 [0,4194304] 0 2024-04-26T12:28:47.289 INFO:tasks.workunit.client.0.smithi046.stdout:8/490: dread - d7/da/df/f8d zero size 2024-04-26T12:28:47.289 INFO:tasks.workunit.client.0.smithi046.stdout:5/456: truncate d9/da/f7b 1438001 0 2024-04-26T12:28:47.289 INFO:tasks.workunit.client.0.smithi046.stdout:3/479: chown d2/d16/l1a 0 1 2024-04-26T12:28:47.289 INFO:tasks.workunit.client.0.smithi046.stdout:9/364: rename d0/d16/d5f/d68 to d0/d16/d76/d7d 0 2024-04-26T12:28:47.290 INFO:tasks.workunit.client.0.smithi046.stdout:2/397: creat d1/f83 x:0 0 0 2024-04-26T12:28:47.290 INFO:tasks.workunit.client.0.smithi046.stdout:4/439: getdents d0/da/d17 0 2024-04-26T12:28:47.290 INFO:tasks.workunit.client.0.smithi046.stdout:0/469: dread - d9/d1d/d40/d41/d43/f5b zero size 2024-04-26T12:28:47.290 INFO:tasks.workunit.client.0.smithi046.stdout:1/364: chown d7/d14/d5d/d32/l35 16116 1 2024-04-26T12:28:47.290 INFO:tasks.workunit.client.0.smithi046.stdout:8/491: write d7/f55 [844332,78984] 0 2024-04-26T12:28:47.291 INFO:tasks.workunit.client.0.smithi046.stdout:5/457: symlink d9/da/dd/la2 0 2024-04-26T12:28:47.291 INFO:tasks.workunit.client.0.smithi046.stdout:9/365: mknod d0/d16/d5f/c7e 0 2024-04-26T12:28:47.291 INFO:tasks.workunit.client.0.smithi046.stdout:3/480: creat d2/d16/d11/d82/fad x:0 0 0 2024-04-26T12:28:47.291 INFO:tasks.workunit.client.0.smithi046.stdout:1/365: readlink d7/d14/d5d/d32/d41/l4b 0 2024-04-26T12:28:47.291 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:47.297 INFO:tasks.workunit.client.0.smithi046.stdout:2/398: read d1/de/d65/f56 [65363,7341] 0 2024-04-26T12:28:47.297 INFO:tasks.workunit.client.0.smithi046.stdout:3/481: chown d2/d16/d35/f69 2039 1 2024-04-26T12:28:47.298 INFO:tasks.workunit.client.0.smithi046.stdout:8/492: write d7/da/d4f/d7f/f91 [1000620,108003] 0 2024-04-26T12:28:47.298 INFO:tasks.workunit.client.0.smithi046.stdout:9/366: creat d0/d16/d76/d7d/d72/f7f x:0 0 0 2024-04-26T12:28:47.298 INFO:tasks.workunit.client.0.smithi046.stdout:2/399: stat d1/de/d15/d18/l55 0 2024-04-26T12:28:47.298 INFO:tasks.workunit.client.0.smithi046.stdout:3/482: rename d2/d16/d35/l63 to d2/d16/d11/d6d/lae 0 2024-04-26T12:28:47.298 INFO:tasks.workunit.client.0.smithi046.stdout:9/367: truncate d0/d2c/d47/f46 1156754 0 2024-04-26T12:28:47.298 INFO:tasks.workunit.client.0.smithi046.stdout:8/493: creat d7/d24/d50/d2a/d39/d9d/faa x:0 0 0 2024-04-26T12:28:47.299 INFO:tasks.workunit.client.0.smithi046.stdout:5/458: rmdir d9 39 2024-04-26T12:28:47.299 INFO:tasks.workunit.client.0.smithi046.stdout:6/450: truncate d7/d1b/d37/f76 3079213 0 2024-04-26T12:28:47.299 INFO:tasks.workunit.client.0.smithi046.stdout:9/368: mkdir d0/d16/d5f/d80 0 2024-04-26T12:28:47.299 INFO:tasks.workunit.client.0.smithi046.stdout:8/494: chown d7/d24/d50/d62/f7e 57168140 1 2024-04-26T12:28:47.299 INFO:tasks.workunit.client.0.smithi046.stdout:6/451: write d7/d1b/d37/f6b [115370,127605] 0 2024-04-26T12:28:47.299 INFO:tasks.workunit.client.0.smithi046.stdout:5/459: creat d9/da/d3b/fa3 x:0 0 0 2024-04-26T12:28:47.299 INFO:tasks.workunit.client.0.smithi046.stdout:3/483: truncate d2/d16/d11/d1b/d2d/f5b 4411244 0 2024-04-26T12:28:47.300 INFO:tasks.workunit.client.0.smithi046.stdout:8/495: stat d7/dc/d1b 0 2024-04-26T12:28:47.300 INFO:tasks.workunit.client.0.smithi046.stdout:9/369: write d0/f5 [2258491,100525] 0 2024-04-26T12:28:47.300 INFO:tasks.workunit.client.0.smithi046.stdout:3/484: stat d2/db/d62/l93 0 2024-04-26T12:28:47.300 INFO:tasks.workunit.client.0.smithi046.stdout:6/452: rmdir d7/d1b/d47/d65 39 2024-04-26T12:28:47.300 INFO:tasks.workunit.client.0.smithi046.stdout:9/370: chown d0/d29/d69 28640 1 2024-04-26T12:28:47.301 INFO:tasks.workunit.client.0.smithi046.stdout:8/496: write d7/d24/d50/f77 [4340910,100540] 0 2024-04-26T12:28:47.301 INFO:tasks.workunit.client.0.smithi046.stdout:4/440: dread d0/d1/f15 [0,4194304] 0 2024-04-26T12:28:47.301 INFO:tasks.workunit.client.0.smithi046.stdout:1/366: dwrite d7/d14/f19 [0,4194304] 0 2024-04-26T12:28:47.301 INFO:tasks.workunit.client.0.smithi046.stdout:3/485: dread - d2/db/d62/f87 zero size 2024-04-26T12:28:47.301 INFO:tasks.workunit.client.0.smithi046.stdout:5/460: write d9/da/dd/d34/d45/f95 [641871,32939] 0 2024-04-26T12:28:47.301 INFO:tasks.workunit.client.0.smithi046.stdout:9/371: unlink d0/d19/d21/c7a 0 2024-04-26T12:28:47.303 INFO:tasks.workunit.client.0.smithi046.stdout:1/367: symlink d7/d12/d3a/d76/l7e 0 2024-04-26T12:28:47.303 INFO:tasks.workunit.client.0.smithi046.stdout:1/368: fdatasync d7/d9/f58 0 2024-04-26T12:28:47.303 INFO:tasks.workunit.client.0.smithi046.stdout:8/497: fdatasync d7/da/d4f/f6c 0 2024-04-26T12:28:47.303 INFO:tasks.workunit.client.0.smithi046.stdout:8/498: symlink d7/dc/lab 0 2024-04-26T12:28:47.304 INFO:tasks.workunit.client.0.smithi046.stdout:8/499: unlink d7/da/d4f/f6c 0 2024-04-26T12:28:47.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/461: dwrite d9/da/dd/d5d/f6e [0,4194304] 0 2024-04-26T12:28:47.305 INFO:tasks.workunit.client.0.smithi046.stdout:7/462: dread d16/d35/f3b [4194304,4194304] 0 2024-04-26T12:28:47.305 INFO:tasks.workunit.client.0.smithi046.stdout:7/463: dread - d16/d1a/d31/f49 zero size 2024-04-26T12:28:47.308 INFO:tasks.workunit.client.0.smithi046.stdout:1/369: dwrite d7/f6f [0,4194304] 0 2024-04-26T12:28:47.309 INFO:tasks.workunit.client.0.smithi046.stdout:1/370: chown d7/d12/d3a/d49/c67 19840 1 2024-04-26T12:28:47.309 INFO:tasks.workunit.client.0.smithi046.stdout:4/441: truncate d0/da/d17/d20/d25/d35/f49 3809136 0 2024-04-26T12:28:47.310 INFO:tasks.workunit.client.0.smithi046.stdout:7/464: read d16/d27/f34 [1233392,58487] 0 2024-04-26T12:28:47.311 INFO:tasks.workunit.client.0.smithi046.stdout:3/486: dread d2/db/f25 [0,4194304] 0 2024-04-26T12:28:47.311 INFO:tasks.workunit.client.0.smithi046.stdout:1/371: unlink d7/d14/f19 0 2024-04-26T12:28:47.312 INFO:tasks.workunit.client.0.smithi046.stdout:4/442: unlink d0/da/d17/d20/d25/c44 0 2024-04-26T12:28:47.312 INFO:tasks.workunit.client.0.smithi046.stdout:8/500: dwrite d7/dc/f45 [0,4194304] 0 2024-04-26T12:28:47.313 INFO:tasks.workunit.client.0.smithi046.stdout:3/487: creat d2/db/d4a/da9/faf x:0 0 0 2024-04-26T12:28:47.313 INFO:tasks.workunit.client.0.smithi046.stdout:4/443: stat d0/da/d17/d20/d25/d35/d6d/d19/l81 0 2024-04-26T12:28:47.313 INFO:tasks.workunit.client.0.smithi046.stdout:8/501: mknod d7/cac 0 2024-04-26T12:28:47.314 INFO:tasks.workunit.client.0.smithi046.stdout:3/488: fdatasync d2/d16/d11/d82/fad 0 2024-04-26T12:28:47.315 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:47.313+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:47.315 INFO:tasks.workunit.client.0.smithi046.stdout:4/444: creat d0/d41/d3f/d7c/f90 x:0 0 0 2024-04-26T12:28:47.315 INFO:tasks.workunit.client.0.smithi046.stdout:3/489: write d2/f4 [3897616,8632] 0 2024-04-26T12:28:47.316 INFO:tasks.workunit.client.0.smithi046.stdout:8/502: write d7/d24/f43 [669658,118155] 0 2024-04-26T12:28:47.317 INFO:tasks.workunit.client.0.smithi046.stdout:8/503: dread - d7/d24/d50/d62/f84 zero size 2024-04-26T12:28:47.317 INFO:tasks.workunit.client.0.smithi046.stdout:1/372: dwrite d7/d9/f18 [0,4194304] 0 2024-04-26T12:28:47.319 INFO:tasks.workunit.client.0.smithi046.stdout:8/504: creat d7/d24/d50/d2a/d54/fad x:0 0 0 2024-04-26T12:28:47.320 INFO:tasks.workunit.client.0.smithi046.stdout:8/505: chown d7/dc/f45 3659969 1 2024-04-26T12:28:47.321 INFO:tasks.workunit.client.0.smithi046.stdout:4/445: rename d0/d41/d3f to d0/da/d17/d20/d25/d35/d6d/d19/d55/d91 0 2024-04-26T12:28:47.321 INFO:tasks.workunit.client.0.smithi046.stdout:8/506: mkdir d7/dc/d1b/dae 0 2024-04-26T12:28:47.323 INFO:tasks.workunit.client.0.smithi046.stdout:3/490: dwrite d2/db/d84/d8a/f8c [0,4194304] 0 2024-04-26T12:28:47.323 INFO:tasks.workunit.client.0.smithi046.stdout:1/373: rename d7/d14/d5d/l5a to d7/d9/l7f 0 2024-04-26T12:28:47.324 INFO:tasks.workunit.client.0.smithi046.stdout:3/491: mkdir d2/db0 0 2024-04-26T12:28:47.324 INFO:tasks.workunit.client.0.smithi046.stdout:5/462: dwrite d9/da/f7b [0,4194304] 0 2024-04-26T12:28:47.325 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:47.325 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:47.325 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:47.325 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:47.329 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:47.330 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:47.330 INFO:tasks.workunit.client.0.smithi046.stdout:8/507: rename d7/d24/d56/c5d to d7/dc/d1b/da0/caf 0 2024-04-26T12:28:47.330 INFO:tasks.workunit.client.0.smithi046.stdout:3/492: rmdir d2/d16/d11/d23 39 2024-04-26T12:28:47.330 INFO:tasks.workunit.client.0.smithi046.stdout:5/463: rename d9/da/d3b to d9/da/dd/d34/d44/d97/da4 0 2024-04-26T12:28:47.330 INFO:tasks.workunit.client.0.smithi046.stdout:8/508: unlink d7/da/df/f35 0 2024-04-26T12:28:47.331 INFO:tasks.workunit.client.0.smithi046.stdout:1/374: dwrite d7/db/f64 [0,4194304] 0 2024-04-26T12:28:47.334 INFO:tasks.workunit.client.0.smithi046.stdout:1/375: truncate d7/d9/d2b/f40 181483 0 2024-04-26T12:28:47.336 INFO:tasks.workunit.client.0.smithi046.stdout:1/376: chown d7/d9/f11 840909 1 2024-04-26T12:28:47.337 INFO:tasks.workunit.client.0.smithi046.stdout:8/509: dwrite d7/dc/f13 [0,4194304] 0 2024-04-26T12:28:47.338 INFO:tasks.workunit.client.0.smithi046.stdout:1/377: truncate d7/d9/f1a 1387189 0 2024-04-26T12:28:47.338 INFO:tasks.workunit.client.0.smithi046.stdout:3/493: dwrite d2/f7 [0,4194304] 0 2024-04-26T12:28:47.339 INFO:tasks.workunit.client.0.smithi046.stdout:5/464: dwrite d9/da/f7b [0,4194304] 0 2024-04-26T12:28:47.340 INFO:tasks.workunit.client.0.smithi046.stdout:3/494: fdatasync d2/db/d4a/f40 0 2024-04-26T12:28:47.340 INFO:tasks.workunit.client.0.smithi046.stdout:9/372: dread d0/d2c/d47/f67 [0,4194304] 0 2024-04-26T12:28:47.340 INFO:tasks.workunit.client.0.smithi046.stdout:1/378: write d7/d12/f57 [731800,33492] 0 2024-04-26T12:28:47.340 INFO:tasks.workunit.client.0.smithi046.stdout:9/373: fsync d0/d29/d69/f77 0 2024-04-26T12:28:47.342 INFO:tasks.workunit.client.0.smithi046.stdout:3/495: symlink d2/db/d4a/lb1 0 2024-04-26T12:28:47.342 INFO:tasks.workunit.client.0.smithi046.stdout:9/374: symlink d0/d29/d69/l81 0 2024-04-26T12:28:47.344 INFO:tasks.workunit.client.0.smithi046.stdout:5/465: rename c6 to d9/da/d18/ca5 0 2024-04-26T12:28:47.345 INFO:tasks.workunit.client.0.smithi046.stdout:3/496: creat d2/db/d84/da5/fb2 x:0 0 0 2024-04-26T12:28:47.346 INFO:tasks.workunit.client.0.smithi046.stdout:8/510: dwrite d7/d24/d50/d2a/d39/f61 [0,4194304] 0 2024-04-26T12:28:47.346 INFO:tasks.workunit.client.0.smithi046.stdout:5/466: chown d9/da/dd/d34/f49 2758 1 2024-04-26T12:28:47.346 INFO:tasks.workunit.client.0.smithi046.stdout:8/511: readlink l3 0 2024-04-26T12:28:47.347 INFO:tasks.workunit.client.0.smithi046.stdout:3/497: rmdir d2/d16/d2c/d50/d71/d89 39 2024-04-26T12:28:47.348 INFO:tasks.workunit.client.0.smithi046.stdout:4/446: dread d0/da/d17/d20/d25/d35/d6d/f23 [0,4194304] 0 2024-04-26T12:28:47.348 INFO:tasks.workunit.client.0.smithi046.stdout:8/512: chown d7/dc/d1b/da0 261 1 2024-04-26T12:28:47.349 INFO:tasks.workunit.client.0.smithi046.stdout:8/513: fsync d7/d24/d50/d2a/f42 0 2024-04-26T12:28:47.349 INFO:tasks.workunit.client.0.smithi046.stdout:9/375: dwrite d0/d19/f41 [0,4194304] 0 2024-04-26T12:28:47.350 INFO:tasks.workunit.client.0.smithi046.stdout:8/514: mkdir d7/dc/d27/db0 0 2024-04-26T12:28:47.352 INFO:tasks.workunit.client.0.smithi046.stdout:4/447: rename d0/da/d17/d20/f39 to d0/da/d17/d20/d25/d35/d6d/f92 0 2024-04-26T12:28:47.352 INFO:tasks.workunit.client.0.smithi046.stdout:0/470: sync 2024-04-26T12:28:47.353 INFO:tasks.workunit.client.0.smithi046.stdout:4/448: rmdir d0/da 39 2024-04-26T12:28:47.353 INFO:tasks.workunit.client.0.smithi046.stdout:8/515: rmdir d7/da/d4f/d7f 39 2024-04-26T12:28:47.354 INFO:tasks.workunit.client.0.smithi046.stdout:5/467: dwrite d9/da/d40/f94 [0,4194304] 0 2024-04-26T12:28:47.356 INFO:tasks.workunit.client.0.smithi046.stdout:8/516: readlink d7/d1c/d74/l78 0 2024-04-26T12:28:47.357 INFO:tasks.workunit.client.0.smithi046.stdout:4/449: getdents d0/da 0 2024-04-26T12:28:47.358 INFO:tasks.workunit.client.0.smithi046.stdout:9/376: dwrite d0/d2c/d47/f46 [0,4194304] 0 2024-04-26T12:28:47.361 INFO:tasks.workunit.client.0.smithi046.stdout:6/453: dread d7/f13 [0,4194304] 0 2024-04-26T12:28:47.361 INFO:tasks.workunit.client.0.smithi046.stdout:4/450: mknod d0/da/d17/d20/d25/d35/d6d/d19/d55/c93 0 2024-04-26T12:28:47.363 INFO:tasks.workunit.client.0.smithi046.stdout:4/451: readlink d0/da/d17/l78 0 2024-04-26T12:28:47.364 INFO:tasks.workunit.client.0.smithi046.stdout:5/468: dwrite d9/da/dd/d34/d6b/f84 [0,4194304] 0 2024-04-26T12:28:47.364 INFO:tasks.workunit.client.0.smithi046.stdout:0/471: dwrite d9/d1d/f58 [0,4194304] 0 2024-04-26T12:28:47.365 INFO:tasks.workunit.client.0.smithi046.stdout:6/454: mkdir d7/d1b/d47/d65/d77/d92 0 2024-04-26T12:28:47.366 INFO:tasks.workunit.client.0.smithi046.stdout:8/517: dwrite d7/d24/d50/d2a/d39/d9d/f9f [0,4194304] 0 2024-04-26T12:28:47.366 INFO:tasks.workunit.client.0.smithi046.stdout:6/455: chown d7/d2b/c4c 17 1 2024-04-26T12:28:47.366 INFO:tasks.workunit.client.0.smithi046.stdout:0/472: mkdir d9/d1d/d40/d41/d7e/da5 0 2024-04-26T12:28:47.367 INFO:tasks.workunit.client.0.smithi046.stdout:8/518: readlink d7/dc/lab 0 2024-04-26T12:28:47.367 INFO:tasks.workunit.client.0.smithi046.stdout:4/452: symlink d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/l94 0 2024-04-26T12:28:47.367 INFO:tasks.workunit.client.0.smithi046.stdout:6/456: fdatasync d7/d1b/d47/f4e 0 2024-04-26T12:28:47.368 INFO:tasks.workunit.client.0.smithi046.stdout:8/519: fsync d7/d24/d50/d62/fa2 0 2024-04-26T12:28:47.368 INFO:tasks.workunit.client.0.smithi046.stdout:6/457: write d7/d2b/d31/f80 [652557,59281] 0 2024-04-26T12:28:47.370 INFO:tasks.workunit.client.0.smithi046.stdout:5/469: dread d9/da/f4b [0,4194304] 0 2024-04-26T12:28:47.370 INFO:tasks.workunit.client.0.smithi046.stdout:8/520: mknod d7/dc/d1b/d7d/cb1 0 2024-04-26T12:28:47.371 INFO:tasks.workunit.client.0.smithi046.stdout:6/458: write d7/d1b/f24 [1864257,33569] 0 2024-04-26T12:28:47.371 INFO:tasks.workunit.client.0.smithi046.stdout:5/470: stat d9/da/dd/d34/f49 0 2024-04-26T12:28:47.372 INFO:tasks.workunit.client.0.smithi046.stdout:8/521: creat d7/da/d88/fb2 x:0 0 0 2024-04-26T12:28:47.374 INFO:tasks.workunit.client.0.smithi046.stdout:4/453: dwrite d0/da/d17/d20/d25/f33 [0,4194304] 0 2024-04-26T12:28:47.375 INFO:tasks.workunit.client.0.smithi046.stdout:0/473: dwrite d9/d1d/d40/d41/f7c [0,4194304] 0 2024-04-26T12:28:47.376 INFO:tasks.workunit.client.0.smithi046.stdout:4/454: symlink d0/da/d21/l95 0 2024-04-26T12:28:47.376 INFO:tasks.workunit.client.0.smithi046.stdout:5/471: link d9/da/d15/f4c d9/da/dd/d34/d44/d97/da4/d35/fa6 0 2024-04-26T12:28:47.377 INFO:tasks.workunit.client.0.smithi046.stdout:6/459: creat d7/d1b/d6a/f93 x:0 0 0 2024-04-26T12:28:47.377 INFO:tasks.workunit.client.0.smithi046.stdout:4/455: rmdir d0/d64 39 2024-04-26T12:28:47.378 INFO:tasks.workunit.client.0.smithi046.stdout:6/460: rmdir d7/d2b/d31/d4d 39 2024-04-26T12:28:47.378 INFO:tasks.workunit.client.0.smithi046.stdout:7/465: dread d16/d27/d51/f63 [0,4194304] 0 2024-04-26T12:28:47.379 INFO:tasks.workunit.client.0.smithi046.stdout:5/472: mkdir d9/da/d18/d7d/da7 0 2024-04-26T12:28:47.379 INFO:tasks.workunit.client.0.smithi046.stdout:6/461: write d7/f8 [958242,81440] 0 2024-04-26T12:28:47.382 INFO:tasks.workunit.client.0.smithi046.stdout:6/462: mkdir d7/d2b/d94 0 2024-04-26T12:28:47.382 INFO:tasks.workunit.client.0.smithi046.stdout:0/474: dwrite f8 [0,4194304] 0 2024-04-26T12:28:47.386 INFO:tasks.workunit.client.0.smithi046.stdout:1/379: dread d7/d14/f53 [0,4194304] 0 2024-04-26T12:28:47.386 INFO:tasks.workunit.client.0.smithi046.stdout:0/475: link d9/dc/f37 d9/dc/dd/fa6 0 2024-04-26T12:28:47.386 INFO:tasks.workunit.client.0.smithi046.stdout:3/498: sync 2024-04-26T12:28:47.386 INFO:tasks.workunit.client.0.smithi046.stdout:1/380: mknod d7/d9/d2b/d31/c80 0 2024-04-26T12:28:47.386 INFO:tasks.workunit.client.0.smithi046.stdout:2/400: sync 2024-04-26T12:28:47.388 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:47.388 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:47.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:47.388 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:47.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.388 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:47.388 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:47.388 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.13371852500001, 2024-04-26T12:28:47.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013944606999999999, 2024-04-26T12:28:47.389 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.389 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.389 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:47.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250830+0000", 2024-04-26T12:28:47.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250828+0000", 2024-04-26T12:28:47.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:47.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250839+0000", 2024-04-26T12:28:47.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0743e-05 2024-04-26T12:28:47.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.250861+0000", 2024-04-26T12:28:47.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1450999999999998e-05 2024-04-26T12:28:47.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251263+0000", 2024-04-26T12:28:47.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040257800000000001 2024-04-26T12:28:47.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251737+0000", 2024-04-26T12:28:47.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047353100000000002 2024-04-26T12:28:47.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251891+0000", 2024-04-26T12:28:47.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000154289 2024-04-26T12:28:47.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:47.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252032+0000", 2024-04-26T12:28:47.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014070099999999999 2024-04-26T12:28:47.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256175+0000", 2024-04-26T12:28:47.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041431230000000003 2024-04-26T12:28:47.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:47.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264686+0000", 2024-04-26T12:28:47.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085110870000000005 2024-04-26T12:28:47.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264736+0000", 2024-04-26T12:28:47.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9670999999999999e-05 2024-04-26T12:28:47.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264775+0000", 2024-04-26T12:28:47.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9057000000000002e-05 2024-04-26T12:28:47.394 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.394 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.394 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.394 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:47.394 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:47.395 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.132897606, 2024-04-26T12:28:47.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013261251999999999, 2024-04-26T12:28:47.395 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.395 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.395 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:47.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251651+0000", 2024-04-26T12:28:47.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251650+0000", 2024-04-26T12:28:47.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:47.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251657+0000", 2024-04-26T12:28:47.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.515e-06 2024-04-26T12:28:47.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251668+0000", 2024-04-26T12:28:47.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1066e-05 2024-04-26T12:28:47.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251676+0000", 2024-04-26T12:28:47.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2119999999999997e-06 2024-04-26T12:28:47.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252562+0000", 2024-04-26T12:28:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088638699999999998 2024-04-26T12:28:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252652+0000", 2024-04-26T12:28:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0016e-05 2024-04-26T12:28:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000146969 2024-04-26T12:28:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256302+0000", 2024-04-26T12:28:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035028559999999999 2024-04-26T12:28:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264817+0000", 2024-04-26T12:28:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085155749999999992 2024-04-26T12:28:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264875+0000", 2024-04-26T12:28:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7414000000000003e-05 2024-04-26T12:28:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264912+0000", 2024-04-26T12:28:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7404000000000003e-05 2024-04-26T12:28:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.132867516, 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013383021, 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251681+0000", 2024-04-26T12:28:47.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:47.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251691+0000", 2024-04-26T12:28:47.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0513000000000001e-05 2024-04-26T12:28:47.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251699+0000", 2024-04-26T12:28:47.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8960000000000003e-06 2024-04-26T12:28:47.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251706+0000", 2024-04-26T12:28:47.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2019999999999998e-06 2024-04-26T12:28:47.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252549+0000", 2024-04-26T12:28:47.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000842897 2024-04-26T12:28:47.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252672+0000", 2024-04-26T12:28:47.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012276999999999999 2024-04-26T12:28:47.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:47.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252799+0000", 2024-04-26T12:28:47.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012714099999999999 2024-04-26T12:28:47.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256323+0000", 2024-04-26T12:28:47.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035241529999999999 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264962+0000", 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086389540000000008 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265005+0000", 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2722999999999997e-05 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265064+0000", 2024-04-26T12:28:47.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9274000000000002e-05 2024-04-26T12:28:47.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.406 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.406 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:19 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:47.406 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:47.406 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.132813728, 2024-04-26T12:28:47.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013003264, 2024-04-26T12:28:47.406 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.406 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.406 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251735+0000", 2024-04-26T12:28:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251734+0000", 2024-04-26T12:28:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251742+0000", 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3040000000000005e-06 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251759+0000", 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6526999999999999e-05 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251769+0000", 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0009e-05 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251816+0000", 2024-04-26T12:28:47.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7423000000000003e-05 2024-04-26T12:28:47.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251965+0000", 2024-04-26T12:28:47.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014910499999999999 2024-04-26T12:28:47.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:47.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252116+0000", 2024-04-26T12:28:47.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150505 2024-04-26T12:28:47.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256269+0000", 2024-04-26T12:28:47.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041538089999999996 2024-04-26T12:28:47.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:47.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264631+0000", 2024-04-26T12:28:47.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083618789999999991 2024-04-26T12:28:47.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264684+0000", 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.312e-05 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264738+0000", 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3674999999999997e-05 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:26 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:47.411 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.132761171, 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013656082, 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251787+0000", 2024-04-26T12:28:47.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:47.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251800+0000", 2024-04-26T12:28:47.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3264999999999999e-05 2024-04-26T12:28:47.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251813+0000", 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.328e-05 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251820+0000", 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3900000000000004e-06 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253261+0000", 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014401100000000001 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253368+0000", 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107215 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253721+0000", 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035280199999999999 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256520+0000", 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027990459999999999 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:47.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265351+0000", 2024-04-26T12:28:47.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088309319999999997 2024-04-26T12:28:47.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265405+0000", 2024-04-26T12:28:47.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4345000000000002e-05 2024-04-26T12:28:47.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265444+0000", 2024-04-26T12:28:47.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8602000000000001e-05 2024-04-26T12:28:47.416 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.416 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.417 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:29 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:47.417 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:47.417 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.132720957, 2024-04-26T12:28:47.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013125144, 2024-04-26T12:28:47.417 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.417 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.417 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:47.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251828+0000", 2024-04-26T12:28:47.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251827+0000", 2024-04-26T12:28:47.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:47.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251831+0000", 2024-04-26T12:28:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3830000000000002e-06 2024-04-26T12:28:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251838+0000", 2024-04-26T12:28:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9489999999999999e-06 2024-04-26T12:28:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251846+0000", 2024-04-26T12:28:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.148e-06 2024-04-26T12:28:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252668+0000", 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082208200000000002 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252742+0000", 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4295000000000006e-05 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.252885+0000", 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014333299999999999 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256436+0000", 2024-04-26T12:28:47.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035511140000000002 2024-04-26T12:28:47.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:47.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264870+0000", 2024-04-26T12:28:47.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084332109999999995 2024-04-26T12:28:47.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264911+0000", 2024-04-26T12:28:47.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1700999999999999e-05 2024-04-26T12:28:47.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.264953+0000", 2024-04-26T12:28:47.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1548999999999998e-05 2024-04-26T12:28:47.422 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.422 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.422 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.422 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:24 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T12:28:47.422 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:47.422 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 114.132692796, 2024-04-26T12:28:47.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013305351999999999, 2024-04-26T12:28:47.422 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.423 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.423 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:47.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251856+0000", 2024-04-26T12:28:47.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251855+0000", 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251862+0000", 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0949999999999998e-06 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251867+0000", 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2560000000000002e-06 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.251881+0000", 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3332e-05 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253141+0000", 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012597839999999999 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253293+0000", 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015202099999999999 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:47.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.253444+0000", 2024-04-26T12:28:47.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015191299999999999 2024-04-26T12:28:47.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.256621+0000", 2024-04-26T12:28:47.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031762520000000001 2024-04-26T12:28:47.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:47.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265072+0000", 2024-04-26T12:28:47.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084508759999999995 2024-04-26T12:28:47.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265122+0000", 2024-04-26T12:28:47.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0500000000000001e-05 2024-04-26T12:28:47.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:26:53.265161+0000", 2024-04-26T12:28:47.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9088000000000003e-05 2024-04-26T12:28:47.427 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.427 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.427 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.427 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop(client.4519.0:4 4.32 e47/14 4:4def72d4:::10000000003.00000000:head v 47'2, mlcod=0'0)", 2024-04-26T12:28:47.428 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:47.428 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.097623838000001, 2024-04-26T12:28:47.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013679491, 2024-04-26T12:28:47.428 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.428 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.428 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:47.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286925+0000", 2024-04-26T12:28:47.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.286924+0000", 2024-04-26T12:28:47.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:47.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292324+0000", 2024-04-26T12:28:47.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054002099999999999 2024-04-26T12:28:47.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292346+0000", 2024-04-26T12:28:47.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1733e-05 2024-04-26T12:28:47.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292356+0000", 2024-04-26T12:28:47.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0220999999999999e-05 2024-04-26T12:28:47.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292409+0000", 2024-04-26T12:28:47.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3359000000000002e-05 2024-04-26T12:28:47.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.292430+0000", 2024-04-26T12:28:47.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0140999999999999e-05 2024-04-26T12:28:47.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300546+0000", 2024-04-26T12:28:47.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081164429999999992 2024-04-26T12:28:47.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.300604+0000", 2024-04-26T12:28:47.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8270000000000003e-05 2024-04-26T12:28:47.432 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.432 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.432 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.432 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:5 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:47.432 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:47.432 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 16.853445439000001, 2024-04-26T12:28:47.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015201111, 2024-04-26T12:28:47.432 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.433 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.433 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:47.433 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:47.433 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:47.433 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 5 2024-04-26T12:28:47.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.433 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:47.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531103+0000", 2024-04-26T12:28:47.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.531102+0000", 2024-04-26T12:28:47.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:47.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535869+0000", 2024-04-26T12:28:47.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047671199999999997 2024-04-26T12:28:47.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535886+0000", 2024-04-26T12:28:47.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6861e-05 2024-04-26T12:28:47.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535900+0000", 2024-04-26T12:28:47.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4457999999999999e-05 2024-04-26T12:28:47.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535985+0000", 2024-04-26T12:28:47.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4656999999999999e-05 2024-04-26T12:28:47.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.536103+0000", 2024-04-26T12:28:47.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118163 2024-04-26T12:28:47.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:47.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.536198+0000", 2024-04-26T12:28:47.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4840999999999995e-05 2024-04-26T12:28:47.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.539923+0000", 2024-04-26T12:28:47.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037246639999999999 2024-04-26T12:28:47.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:47.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546203+0000", 2024-04-26T12:28:47.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062805420000000001 2024-04-26T12:28:47.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546245+0000", 2024-04-26T12:28:47.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1270999999999998e-05 2024-04-26T12:28:47.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.546304+0000", 2024-04-26T12:28:47.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9769999999999999e-05 2024-04-26T12:28:47.438 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.438 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.439 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.439 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:6 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T12:28:47.439 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:47.439 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 16.848629584000001, 2024-04-26T12:28:47.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021621960999999999, 2024-04-26T12:28:47.439 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.439 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.439 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:47.439 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:47.439 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:47.439 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 6 2024-04-26T12:28:47.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.440 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:47.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535919+0000", 2024-04-26T12:28:47.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.535918+0000", 2024-04-26T12:28:47.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:47.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547051+0000", 2024-04-26T12:28:47.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011132853999999999 2024-04-26T12:28:47.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547063+0000", 2024-04-26T12:28:47.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2113000000000001e-05 2024-04-26T12:28:47.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547086+0000", 2024-04-26T12:28:47.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3538000000000001e-05 2024-04-26T12:28:47.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547144+0000", 2024-04-26T12:28:47.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7284000000000002e-05 2024-04-26T12:28:47.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.547289+0000", 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014546900000000001 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557445+0000", 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010155717 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557492+0000", 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6749999999999998e-05 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:30.557541+0000", 2024-04-26T12:28:47.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9440000000000001e-05 2024-04-26T12:28:47.444 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.444 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.444 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.444 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:65 3.1b 3:ddb4e4d7:::200.00000002:head [write 2912462~997814 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e49)", 2024-04-26T12:28:47.444 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:47.444 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.946599879000001, 2024-04-26T12:28:47.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014884231, 2024-04-26T12:28:47.444 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.444 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.445 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:47.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437949+0000", 2024-04-26T12:28:47.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.437948+0000", 2024-04-26T12:28:47.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:47.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440692+0000", 2024-04-26T12:28:47.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027439579999999999 2024-04-26T12:28:47.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440720+0000", 2024-04-26T12:28:47.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8209999999999999e-05 2024-04-26T12:28:47.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440735+0000", 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.554e-05 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440839+0000", 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0001038 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440895+0000", 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6221000000000003e-05 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.440982+0000", 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6556000000000003e-05 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.443471+0000", 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024888250000000001 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452760+0000", 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0092887869999999997 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452790+0000", 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0267e-05 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.452833+0000", 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3093999999999998e-05 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4057 4.10 4:0a22fc52:::1000000135a.00000000:head [write 0~124] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.539278963999999, 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021108387999999999, 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4057 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845270+0000", 2024-04-26T12:28:47.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845269+0000", 2024-04-26T12:28:47.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:47.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845276+0000", 2024-04-26T12:28:47.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6850000000000004e-06 2024-04-26T12:28:47.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845286+0000", 2024-04-26T12:28:47.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0219e-05 2024-04-26T12:28:47.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845291+0000", 2024-04-26T12:28:47.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5840000000000002e-06 2024-04-26T12:28:47.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845325+0000", 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3429000000000001e-05 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.845409+0000", 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4529000000000003e-05 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866264+0000", 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020854731000000001 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866305+0000", 2024-04-26T12:28:47.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0571000000000002e-05 2024-04-26T12:28:47.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.866378+0000", 2024-04-26T12:28:47.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3447000000000003e-05 2024-04-26T12:28:47.454 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.454 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.454 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.454 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4064 4.3b 4:de2f294e:::10000001361.00000000:head [write 0~127] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:47.454 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:47.455 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.533360921, 2024-04-26T12:28:47.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014714163000000001, 2024-04-26T12:28:47.455 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.455 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.455 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:47.455 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:47.455 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:47.455 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4064 2024-04-26T12:28:47.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.455 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:47.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851188+0000", 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851187+0000", 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851193+0000", 2024-04-26T12:28:47.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5999999999999997e-06 2024-04-26T12:28:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851204+0000", 2024-04-26T12:28:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1172000000000001e-05 2024-04-26T12:28:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851211+0000", 2024-04-26T12:28:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6750000000000002e-06 2024-04-26T12:28:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851254+0000", 2024-04-26T12:28:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2919e-05 2024-04-26T12:28:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.851384+0000", 2024-04-26T12:28:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130013 2024-04-26T12:28:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865803+0000", 2024-04-26T12:28:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014418343 2024-04-26T12:28:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865857+0000", 2024-04-26T12:28:47.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4567000000000001e-05 2024-04-26T12:28:47.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865902+0000", 2024-04-26T12:28:47.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4576999999999997e-05 2024-04-26T12:28:47.459 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.459 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.459 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.459 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4065 4.3f 4:fea32a34:::10000001362.00000000:head [write 0~290] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.53253372, 2024-04-26T12:28:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013949731, 2024-04-26T12:28:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4065 2024-04-26T12:28:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:47.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852015+0000", 2024-04-26T12:28:47.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852014+0000", 2024-04-26T12:28:47.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:47.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852018+0000", 2024-04-26T12:28:47.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7890000000000001e-06 2024-04-26T12:28:47.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852025+0000", 2024-04-26T12:28:47.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8750000000000002e-06 2024-04-26T12:28:47.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852029+0000", 2024-04-26T12:28:47.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0999999999999997e-06 2024-04-26T12:28:47.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852083+0000", 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4060000000000001e-05 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852161+0000", 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7577000000000006e-05 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865845+0000", 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013684405 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865890+0000", 2024-04-26T12:28:47.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5209e-05 2024-04-26T12:28:47.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865965+0000", 2024-04-26T12:28:47.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4345999999999996e-05 2024-04-26T12:28:47.464 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.464 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.464 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.464 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:4066 4.1d 4:b9ed4029:::10000001363.00000000:head [write 0~133] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.531736263999999, 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013115296, 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 4066 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:47.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852812+0000", 2024-04-26T12:28:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852816+0000", 2024-04-26T12:28:47.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2169999999999996e-06 2024-04-26T12:28:47.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852824+0000", 2024-04-26T12:28:47.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.994e-06 2024-04-26T12:28:47.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852831+0000", 2024-04-26T12:28:47.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0600000000000002e-06 2024-04-26T12:28:47.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852858+0000", 2024-04-26T12:28:47.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6605e-05 2024-04-26T12:28:47.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.852932+0000", 2024-04-26T12:28:47.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4052000000000002e-05 2024-04-26T12:28:47.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:47.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.853007+0000", 2024-04-26T12:28:47.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5580000000000005e-05 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.857934+0000", 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049264030000000002 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865834+0000", 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079004829999999998 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865883+0000", 2024-04-26T12:28:47.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8723000000000001e-05 2024-04-26T12:28:47.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:34.865928+0000", 2024-04-26T12:28:47.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4904999999999998e-05 2024-04-26T12:28:47.470 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.470 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.470 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.470 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:232 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:47.470 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:42.925026+0000", 2024-04-26T12:28:47.470 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.4595228799999997, 2024-04-26T12:28:47.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027270579999999999, 2024-04-26T12:28:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925026+0000", 2024-04-26T12:28:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925026+0000", 2024-04-26T12:28:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925024+0000", 2024-04-26T12:28:47.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999976 2024-04-26T12:28:47.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925406+0000", 2024-04-26T12:28:47.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038199600000000001 2024-04-26T12:28:47.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925417+0000", 2024-04-26T12:28:47.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1904e-05 2024-04-26T12:28:47.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925426+0000", 2024-04-26T12:28:47.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1820000000000006e-06 2024-04-26T12:28:47.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925464+0000", 2024-04-26T12:28:47.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689000000000002e-05 2024-04-26T12:28:47.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.925522+0000", 2024-04-26T12:28:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7370000000000001e-05 2024-04-26T12:28:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.934737+0000", 2024-04-26T12:28:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.009215361 2024-04-26T12:28:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.949281+0000", 2024-04-26T12:28:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014543762999999999 2024-04-26T12:28:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:47.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.952211+0000", 2024-04-26T12:28:47.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029305860000000002 2024-04-26T12:28:47.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.952245+0000", 2024-04-26T12:28:47.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3083000000000002e-05 2024-04-26T12:28:47.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:42.952296+0000", 2024-04-26T12:28:47.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1808999999999998e-05 2024-04-26T12:28:47.475 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.475 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.476 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.476 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:10716 4.3b 4:deb529c8:::100000030e1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:28:47.476 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:44.890912+0000", 2024-04-26T12:28:47.476 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.4936369219999999, 2024-04-26T12:28:47.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015569126000000001, 2024-04-26T12:28:47.476 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.476 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.476 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:47.476 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:47.476 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:47.476 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 10716 2024-04-26T12:28:47.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.477 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.890912+0000", 2024-04-26T12:28:47.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.890912+0000", 2024-04-26T12:28:47.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.890911+0000", 2024-04-26T12:28:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.896285+0000", 2024-04-26T12:28:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053745279999999999 2024-04-26T12:28:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.896295+0000", 2024-04-26T12:28:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8290000000000003e-06 2024-04-26T12:28:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.896303+0000", 2024-04-26T12:28:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8199999999999997e-06 2024-04-26T12:28:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.896348+0000", 2024-04-26T12:28:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5170999999999998e-05 2024-04-26T12:28:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.896408+0000", 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0479000000000002e-05 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.906338+0000", 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0099295670000000003 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.906403+0000", 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5306000000000001e-05 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.906481+0000", 2024-04-26T12:28:47.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7485999999999996e-05 2024-04-26T12:28:47.481 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.481 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.481 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.481 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:10717 4.3a 4:5e0e6c10:::100000030da.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:28:47.481 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:44.900381+0000", 2024-04-26T12:28:47.481 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.4841679160000001, 2024-04-26T12:28:47.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016854102999999999, 2024-04-26T12:28:47.481 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.481 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.482 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:47.482 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:47.482 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:47.482 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 10717 2024-04-26T12:28:47.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.482 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.900381+0000", 2024-04-26T12:28:47.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.900381+0000", 2024-04-26T12:28:47.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.900380+0000", 2024-04-26T12:28:47.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:47.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.904586+0000", 2024-04-26T12:28:47.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042063609999999996 2024-04-26T12:28:47.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.904596+0000", 2024-04-26T12:28:47.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7440000000000002e-06 2024-04-26T12:28:47.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.904601+0000", 2024-04-26T12:28:47.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6759999999999998e-06 2024-04-26T12:28:47.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.905805+0000", 2024-04-26T12:28:47.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001204201 2024-04-26T12:28:47.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.905861+0000", 2024-04-26T12:28:47.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6350000000000001e-05 2024-04-26T12:28:47.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:47.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.905945+0000", 2024-04-26T12:28:47.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4115000000000004e-05 2024-04-26T12:28:47.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:47.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.916154+0000", 2024-04-26T12:28:47.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010208511 2024-04-26T12:28:47.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.917168+0000", 2024-04-26T12:28:47.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010140520000000001 2024-04-26T12:28:47.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.917192+0000", 2024-04-26T12:28:47.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4105e-05 2024-04-26T12:28:47.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.917235+0000", 2024-04-26T12:28:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2778999999999998e-05 2024-04-26T12:28:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:10731 4.4 4:2235f7a0:::100000030ff.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:28:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:44.930993+0000", 2024-04-26T12:28:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.4535556629999999, 2024-04-26T12:28:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015833037000000001, 2024-04-26T12:28:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.487 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 10731 2024-04-26T12:28:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.930993+0000", 2024-04-26T12:28:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.930993+0000", 2024-04-26T12:28:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.930992+0000", 2024-04-26T12:28:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.937918+0000", 2024-04-26T12:28:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069264189999999996 2024-04-26T12:28:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.937933+0000", 2024-04-26T12:28:47.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5233e-05 2024-04-26T12:28:47.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.937943+0000", 2024-04-26T12:28:47.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0699999999999996e-06 2024-04-26T12:28:47.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.937981+0000", 2024-04-26T12:28:47.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8203e-05 2024-04-26T12:28:47.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.938042+0000", 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1107999999999998e-05 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.946724+0000", 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086819389999999996 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.946769+0000", 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5108999999999998e-05 2024-04-26T12:28:47.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.946826+0000", 2024-04-26T12:28:47.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7088e-05 2024-04-26T12:28:47.492 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.492 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.492 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.492 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:10733 4.a 4:5049c212:::100000030b7.00000000:head [write 0~4194304 [3@919666]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T12:28:47.492 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:44.938834+0000", 2024-04-26T12:28:47.492 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.4457141760000001, 2024-04-26T12:28:47.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014377083000000001, 2024-04-26T12:28:47.492 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 10733 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.938834+0000", 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:47.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.938834+0000", 2024-04-26T12:28:47.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:47.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:47.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.938834+0000", 2024-04-26T12:28:47.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:47.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:47.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.942719+0000", 2024-04-26T12:28:47.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003884991 2024-04-26T12:28:47.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.942732+0000", 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3441000000000001e-05 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.942740+0000", 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7440000000000007e-06 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.942777+0000", 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7299999999999999e-05 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:47.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.942847+0000", 2024-04-26T12:28:47.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9995999999999999e-05 2024-04-26T12:28:47.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:47.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.942945+0000", 2024-04-26T12:28:47.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7720000000000006e-05 2024-04-26T12:28:47.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:47.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.952571+0000", 2024-04-26T12:28:47.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096253669999999993 2024-04-26T12:28:47.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.953079+0000", 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00050858499999999998 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.953126+0000", 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7333000000000002e-05 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:44.953212+0000", 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5078000000000001e-05 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.497 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.498 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.498 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:47.498 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:47.498 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:47.502 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:47.499+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:47.502 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:47.524 INFO:tasks.workunit.client.0.smithi046.stdout:7/466: dwrite d16/d1a/d31/d62/f88 [0,4194304] 0 2024-04-26T12:28:47.524 INFO:tasks.workunit.client.0.smithi046.stdout:0/476: stat d9/dc/d4c/d62/c76 0 2024-04-26T12:28:47.524 INFO:tasks.workunit.client.0.smithi046.stdout:1/381: symlink d7/d12/d3a/l81 0 2024-04-26T12:28:47.524 INFO:tasks.workunit.client.0.smithi046.stdout:0/477: write d9/dc/f60 [1564656,129471] 0 2024-04-26T12:28:47.524 INFO:tasks.workunit.client.0.smithi046.stdout:3/499: creat d2/db/d84/fb3 x:0 0 0 2024-04-26T12:28:47.524 INFO:tasks.workunit.client.0.smithi046.stdout:1/382: mkdir d7/d9/d2b/d31/d82 0 2024-04-26T12:28:47.525 INFO:tasks.workunit.client.0.smithi046.stdout:7/467: creat d16/d1a/d31/d8e/f97 x:0 0 0 2024-04-26T12:28:47.525 INFO:tasks.workunit.client.0.smithi046.stdout:3/500: dread - d2/db/d62/fa1 zero size 2024-04-26T12:28:47.525 INFO:tasks.workunit.client.0.smithi046.stdout:3/501: creat d2/d97/fb4 x:0 0 0 2024-04-26T12:28:47.525 INFO:tasks.workunit.client.0.smithi046.stdout:7/468: link d16/d27/l29 d16/d1a/d31/d5a/l98 0 2024-04-26T12:28:47.525 INFO:tasks.workunit.client.0.smithi046.stdout:7/469: mknod d16/d1a/d3e/c99 0 2024-04-26T12:28:47.525 INFO:tasks.workunit.client.0.smithi046.stdout:5/473: dread f8 [0,4194304] 0 2024-04-26T12:28:47.525 INFO:tasks.workunit.client.0.smithi046.stdout:8/522: dread d7/dc/f41 [0,4194304] 0 2024-04-26T12:28:47.525 INFO:tasks.workunit.client.0.smithi046.stdout:7/470: mknod d16/d1a/d31/d55/d6d/d89/c9a 0 2024-04-26T12:28:47.525 INFO:tasks.workunit.client.0.smithi046.stdout:8/523: mkdir d7/d24/d50/db3 0 2024-04-26T12:28:47.525 INFO:tasks.workunit.client.0.smithi046.stdout:7/471: symlink d16/d1a/d31/d5a/d6b/l9b 0 2024-04-26T12:28:47.525 INFO:tasks.workunit.client.0.smithi046.stdout:7/472: stat d16/f20 0 2024-04-26T12:28:47.525 INFO:tasks.workunit.client.0.smithi046.stdout:7/473: getdents d16/d1a/d31/d4d 0 2024-04-26T12:28:47.525 INFO:tasks.workunit.client.0.smithi046.stdout:6/463: read d7/d16/f56 [593649,67738] 0 2024-04-26T12:28:47.525 INFO:tasks.workunit.client.0.smithi046.stdout:5/474: write d9/da/dd/d69/d7e/fa1 [307373,30975] 0 2024-04-26T12:28:47.526 INFO:tasks.workunit.client.0.smithi046.stdout:6/464: mkdir d7/d1b/d37/d95 0 2024-04-26T12:28:47.526 INFO:tasks.workunit.client.0.smithi046.stdout:8/524: truncate d7/d24/d50/f77 3637813 0 2024-04-26T12:28:47.526 INFO:tasks.workunit.client.0.smithi046.stdout:6/465: truncate d7/d16/f56 1072828 0 2024-04-26T12:28:47.526 INFO:tasks.workunit.client.0.smithi046.stdout:5/475: write d9/da/f10 [4827373,119788] 0 2024-04-26T12:28:47.526 INFO:tasks.workunit.client.0.smithi046.stdout:1/383: read d7/d9/f66 [38570,17541] 0 2024-04-26T12:28:47.526 INFO:tasks.workunit.client.0.smithi046.stdout:8/525: creat d7/d24/d50/d2a/d39/d9d/fb4 x:0 0 0 2024-04-26T12:28:47.526 INFO:tasks.workunit.client.0.smithi046.stdout:5/476: chown d9/da/dd/d34/f49 20650 1 2024-04-26T12:28:47.526 INFO:tasks.workunit.client.0.smithi046.stdout:6/466: link d7/d1b/d47/f4e d7/d1b/d37/d95/f96 0 2024-04-26T12:28:47.526 INFO:tasks.workunit.client.0.smithi046.stdout:5/477: unlink d9/da/dd/l62 0 2024-04-26T12:28:47.526 INFO:tasks.workunit.client.0.smithi046.stdout:1/384: mknod d7/d14/d5d/d32/d5f/c83 0 2024-04-26T12:28:47.526 INFO:tasks.workunit.client.0.smithi046.stdout:8/526: mknod d7/d24/cb5 0 2024-04-26T12:28:47.526 INFO:tasks.workunit.client.0.smithi046.stdout:6/467: creat d7/d1b/d47/f97 x:0 0 0 2024-04-26T12:28:47.526 INFO:tasks.workunit.client.0.smithi046.stdout:8/527: read - d7/da/df/f65 zero size 2024-04-26T12:28:47.527 INFO:tasks.workunit.client.0.smithi046.stdout:5/478: chown d9/da/d18/d7d/l52 380290 1 2024-04-26T12:28:47.527 INFO:tasks.workunit.client.0.smithi046.stdout:1/385: truncate d7/d14/f4e 320738 0 2024-04-26T12:28:47.527 INFO:tasks.workunit.client.0.smithi046.stdout:5/479: chown d9/da/dd/d34/d3e 26900 1 2024-04-26T12:28:47.527 INFO:tasks.workunit.client.0.smithi046.stdout:1/386: dread - d7/d14/d5d/d32/d5f/f65 zero size 2024-04-26T12:28:47.527 INFO:tasks.workunit.client.0.smithi046.stdout:5/480: symlink d9/da/dd/d34/d44/d88/d90/la8 0 2024-04-26T12:28:47.527 INFO:tasks.workunit.client.0.smithi046.stdout:9/377: dread d0/d2c/f4d [0,4194304] 0 2024-04-26T12:28:47.527 INFO:tasks.workunit.client.0.smithi046.stdout:5/481: truncate d9/da/dd/d69/f6c 430356 0 2024-04-26T12:28:47.527 INFO:tasks.workunit.client.0.smithi046.stdout:9/378: rmdir d0/d16/d5f/d80 0 2024-04-26T12:28:47.527 INFO:tasks.workunit.client.0.smithi046.stdout:2/401: dread d1/de/d65/d4a/d58/f73 [0,4194304] 0 2024-04-26T12:28:47.527 INFO:tasks.workunit.client.0.smithi046.stdout:0/478: dread d9/d1d/d40/d41/d43/f83 [0,4194304] 0 2024-04-26T12:28:47.527 INFO:tasks.workunit.client.0.smithi046.stdout:6/468: truncate d7/f8 174419 0 2024-04-26T12:28:47.527 INFO:tasks.workunit.client.0.smithi046.stdout:0/479: dread - d9/d1d/d40/d41/f96 zero size 2024-04-26T12:28:47.527 INFO:tasks.workunit.client.0.smithi046.stdout:9/379: dread d0/d29/d69/f70 [0,4194304] 0 2024-04-26T12:28:47.527 INFO:tasks.workunit.client.0.smithi046.stdout:5/482: dwrite d9/da/dd/f64 [0,4194304] 0 2024-04-26T12:28:47.528 INFO:tasks.workunit.client.0.smithi046.stdout:6/469: creat d7/d2b/d31/f98 x:0 0 0 2024-04-26T12:28:47.528 INFO:tasks.workunit.client.0.smithi046.stdout:2/402: truncate d1/de/d65/d4a/d58/f73 1978929 0 2024-04-26T12:28:47.528 INFO:tasks.workunit.client.0.smithi046.stdout:0/480: creat d9/dc/dd/d45/d69/fa7 x:0 0 0 2024-04-26T12:28:47.528 INFO:tasks.workunit.client.0.smithi046.stdout:2/403: mknod d1/de/d65/d1b/c84 0 2024-04-26T12:28:47.528 INFO:tasks.workunit.client.0.smithi046.stdout:9/380: link d0/d2c/l5e d0/d2c/l82 0 2024-04-26T12:28:47.528 INFO:tasks.workunit.client.0.smithi046.stdout:0/481: link d9/dc/dd/f27 d9/dc/d4c/fa8 0 2024-04-26T12:28:47.528 INFO:tasks.workunit.client.0.smithi046.stdout:2/404: symlink d1/de/d65/d1b/d38/l85 0 2024-04-26T12:28:47.528 INFO:tasks.workunit.client.0.smithi046.stdout:9/381: mknod d0/d16/d5f/c83 0 2024-04-26T12:28:47.528 INFO:tasks.workunit.client.0.smithi046.stdout:9/382: fdatasync d0/d19/f2f 0 2024-04-26T12:28:47.528 INFO:tasks.workunit.client.0.smithi046.stdout:0/482: creat d9/d1d/d40/d41/fa9 x:0 0 0 2024-04-26T12:28:47.528 INFO:tasks.workunit.client.0.smithi046.stdout:9/383: chown d0/d16/c45 1896756 1 2024-04-26T12:28:47.528 INFO:tasks.workunit.client.0.smithi046.stdout:9/384: dread - d0/f65 zero size 2024-04-26T12:28:47.528 INFO:tasks.workunit.client.0.smithi046.stdout:0/483: unlink d9/d1d/l52 0 2024-04-26T12:28:47.528 INFO:tasks.workunit.client.0.smithi046.stdout:9/385: write d0/f1d [1777013,60168] 0 2024-04-26T12:28:47.529 INFO:tasks.workunit.client.0.smithi046.stdout:9/386: symlink d0/d29/l84 0 2024-04-26T12:28:47.529 INFO:tasks.workunit.client.0.smithi046.stdout:0/484: truncate d9/dc/d4c/d62/f80 548380 0 2024-04-26T12:28:47.529 INFO:tasks.workunit.client.0.smithi046.stdout:5/483: dread d9/da/dd/d34/f49 [0,4194304] 0 2024-04-26T12:28:47.529 INFO:tasks.workunit.client.0.smithi046.stdout:9/387: mkdir d0/d16/d76/d7d/d72/d85 0 2024-04-26T12:28:47.529 INFO:tasks.workunit.client.0.smithi046.stdout:9/388: mknod d0/d2c/c86 0 2024-04-26T12:28:47.529 INFO:tasks.workunit.client.0.smithi046.stdout:5/484: rename d9/da/dd/d5d/c79 to d9/ca9 0 2024-04-26T12:28:47.529 INFO:tasks.workunit.client.0.smithi046.stdout:9/389: creat d0/d2c/d47/f87 x:0 0 0 2024-04-26T12:28:47.529 INFO:tasks.workunit.client.0.smithi046.stdout:5/485: rename d9/da/d40/c61 to d9/da/d18/d8b/caa 0 2024-04-26T12:28:47.529 INFO:tasks.workunit.client.0.smithi046.stdout:3/502: dread d2/d16/d11/d1b/d2d/f5b [0,4194304] 0 2024-04-26T12:28:47.529 INFO:tasks.workunit.client.0.smithi046.stdout:5/486: fsync d9/da/d15/f26 0 2024-04-26T12:28:47.529 INFO:tasks.workunit.client.0.smithi046.stdout:5/487: readlink d9/da/d18/l54 0 2024-04-26T12:28:47.529 INFO:tasks.workunit.client.0.smithi046.stdout:1/387: sync 2024-04-26T12:28:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:9/390: sync 2024-04-26T12:28:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:2/405: sync 2024-04-26T12:28:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:3/503: link d2/d16/d11/c96 d2/d97/cb5 0 2024-04-26T12:28:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:1/388: fdatasync d7/d14/d5d/f48 0 2024-04-26T12:28:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:2/406: unlink d1/de/d2b/f7c 0 2024-04-26T12:28:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:9/391: mkdir d0/d29/d69/d88 0 2024-04-26T12:28:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:1/389: chown d7/d9/d2b/d31/d82 1 1 2024-04-26T12:28:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:9/392: creat d0/d29/f89 x:0 0 0 2024-04-26T12:28:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:7/474: dread d16/f23 [0,4194304] 0 2024-04-26T12:28:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:1/390: dread - d7/d9/d2b/f6a zero size 2024-04-26T12:28:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:6/470: write d7/f8 [1102487,70274] 0 2024-04-26T12:28:47.530 INFO:tasks.workunit.client.0.smithi046.stdout:2/407: rename d1/de/d2b/d68 to d1/de/d65/d4a/d86 0 2024-04-26T12:28:47.531 INFO:tasks.workunit.client.0.smithi046.stdout:7/475: stat d16/d27/f34 0 2024-04-26T12:28:47.531 INFO:tasks.workunit.client.0.smithi046.stdout:9/393: creat d0/f8a x:0 0 0 2024-04-26T12:28:47.531 INFO:tasks.workunit.client.0.smithi046.stdout:4/456: dread d0/da/d17/d20/d25/d35/f49 [0,4194304] 0 2024-04-26T12:28:47.531 INFO:tasks.workunit.client.0.smithi046.stdout:9/394: write d0/d2c/d47/f2e [282196,62682] 0 2024-04-26T12:28:47.531 INFO:tasks.workunit.client.0.smithi046.stdout:6/471: write d7/d1b/f23 [2568936,130348] 0 2024-04-26T12:28:47.531 INFO:tasks.workunit.client.0.smithi046.stdout:1/391: link d7/d9/f66 d7/d14/d5d/d6b/f84 0 2024-04-26T12:28:47.531 INFO:tasks.workunit.client.0.smithi046.stdout:4/457: stat d0/da/d21/l95 0 2024-04-26T12:28:47.531 INFO:tasks.workunit.client.0.smithi046.stdout:6/472: unlink d7/f62 0 2024-04-26T12:28:47.531 INFO:tasks.workunit.client.0.smithi046.stdout:3/504: dwrite d2/d16/d11/d82/fad [0,4194304] 0 2024-04-26T12:28:47.531 INFO:tasks.workunit.client.0.smithi046.stdout:4/458: stat d0/d1/d12/l66 0 2024-04-26T12:28:47.531 INFO:tasks.workunit.client.0.smithi046.stdout:6/473: chown d7/f8 11025304 1 2024-04-26T12:28:47.531 INFO:tasks.workunit.client.0.smithi046.stdout:8/528: dread d7/dc/d1b/f79 [0,4194304] 0 2024-04-26T12:28:47.531 INFO:tasks.workunit.client.0.smithi046.stdout:5/488: truncate d9/da/dd/f64 880155 0 2024-04-26T12:28:47.531 INFO:tasks.workunit.client.0.smithi046.stdout:4/459: read - d0/da/d21/f83 zero size 2024-04-26T12:28:47.532 INFO:tasks.workunit.client.0.smithi046.stdout:6/474: fsync d7/d2b/f30 0 2024-04-26T12:28:47.532 INFO:tasks.workunit.client.0.smithi046.stdout:5/489: readlink d9/l55 0 2024-04-26T12:28:47.532 INFO:tasks.workunit.client.0.smithi046.stdout:9/395: creat d0/d16/d76/f8b x:0 0 0 2024-04-26T12:28:47.532 INFO:tasks.workunit.client.0.smithi046.stdout:3/505: creat d2/d97/fb6 x:0 0 0 2024-04-26T12:28:47.532 INFO:tasks.workunit.client.0.smithi046.stdout:8/529: mkdir d7/dc/d1b/da0/db6 0 2024-04-26T12:28:47.532 INFO:tasks.workunit.client.0.smithi046.stdout:3/506: dread - d2/f8e zero size 2024-04-26T12:28:47.532 INFO:tasks.workunit.client.0.smithi046.stdout:5/490: creat d9/da/dd/d69/d7e/fab x:0 0 0 2024-04-26T12:28:47.532 INFO:tasks.workunit.client.0.smithi046.stdout:1/392: dread d7/d9/f18 [0,4194304] 0 2024-04-26T12:28:47.532 INFO:tasks.workunit.client.0.smithi046.stdout:7/476: dwrite d16/d1a/d31/f70 [0,4194304] 0 2024-04-26T12:28:47.532 INFO:tasks.workunit.client.0.smithi046.stdout:4/460: write d0/d1/f42 [2409866,59741] 0 2024-04-26T12:28:47.532 INFO:tasks.workunit.client.0.smithi046.stdout:8/530: creat d7/dc/fb7 x:0 0 0 2024-04-26T12:28:47.532 INFO:tasks.workunit.client.0.smithi046.stdout:9/396: rename d0/d2c/d47/f66 to d0/d19/f8c 0 2024-04-26T12:28:47.532 INFO:tasks.workunit.client.0.smithi046.stdout:1/393: dread - d7/d9/d2b/f6a zero size 2024-04-26T12:28:47.532 INFO:tasks.workunit.client.0.smithi046.stdout:0/485: dread d9/dc/d4c/d62/fa1 [0,4194304] 0 2024-04-26T12:28:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:9/397: stat d0/d16/d76/f79 0 2024-04-26T12:28:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:7/477: write d16/d1a/d31/d5a/f5b [654245,2157] 0 2024-04-26T12:28:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:1/394: fdatasync d7/d9/d2b/d39/f61 0 2024-04-26T12:28:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/531: write d7/da/df/f5e [1019513,7678] 0 2024-04-26T12:28:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:5/491: rename d9/da/dd/l71 to d9/lac 0 2024-04-26T12:28:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:6/475: dwrite d7/d16/f84 [0,4194304] 0 2024-04-26T12:28:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:9/398: chown d0/d19/d21/f53 28076935 1 2024-04-26T12:28:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:7/478: chown d16/d1a/d31/d5a/f5b 13 1 2024-04-26T12:28:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:6/476: sync 2024-04-26T12:28:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:7/479: write f9 [1714138,106811] 0 2024-04-26T12:28:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/532: chown d7/d24/d50/d2a/d39/l9a 1518338 1 2024-04-26T12:28:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:9/399: stat d0/d2c/d3d/l62 0 2024-04-26T12:28:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:1/395: creat d7/d12/d3a/f85 x:0 0 0 2024-04-26T12:28:47.533 INFO:tasks.workunit.client.0.smithi046.stdout:5/492: rmdir d9/da/dd/d34/d44/d97/da4 39 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:1/396: symlink d7/d9/d2b/d39/d3c/l86 0 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:9/400: mknod d0/d16/d76/d7d/d72/c8d 0 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:7/480: mkdir d16/d27/d51/d9c 0 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:8/533: read d7/dc/f18 [2300860,95411] 0 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:6/477: link d7/d2b/d31/f80 d7/d1b/d6a/f99 0 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:5/493: creat d9/da/dd/d5d/fad x:0 0 0 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:5/494: chown d9/da/dd/d34/d6b 332513738 1 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:4/461: dwrite d0/d1/f15 [0,4194304] 0 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:6/478: symlink d7/d16/l9a 0 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:8/534: creat d7/d24/d50/d2a/d92/fb8 x:0 0 0 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:1/397: rename d7/db/c28 to d7/d9/d2b/c87 0 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:5/495: chown d9/f4f 48906217 1 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:7/481: link d16/d27/l29 d16/d27/d51/d9c/l9d 0 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:8/535: truncate d7/d24/d50/d2a/d39/d9d/faa 256434 0 2024-04-26T12:28:47.534 INFO:tasks.workunit.client.0.smithi046.stdout:3/507: truncate d2/d16/d11/d23/f26 51513 0 2024-04-26T12:28:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:2/408: dread d1/de/f31 [0,4194304] 0 2024-04-26T12:28:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:8/536: rmdir d7/da 39 2024-04-26T12:28:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:2/409: chown d1/cc 336 1 2024-04-26T12:28:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:1/398: getdents d7/d9/d2b/d39/d5c 0 2024-04-26T12:28:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:0/486: write d9/f10 [6750704,97002] 0 2024-04-26T12:28:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:8/537: readlink d7/d1c/l60 0 2024-04-26T12:28:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:2/410: write d1/de/d65/d4a/f7d [400796,64143] 0 2024-04-26T12:28:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:8/538: symlink d7/d24/d50/d2a/d39/lb9 0 2024-04-26T12:28:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:6/479: link d7/d1b/d6a/l6c d7/d1b/d47/l9b 0 2024-04-26T12:28:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:7/482: getdents d16/d1a/d31/d55/d6d/d89 0 2024-04-26T12:28:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:1/399: rename d7/d12/d3a/d76/l7e to d7/d14/d5d/d32/l88 0 2024-04-26T12:28:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:0/487: truncate d9/d1d/d40/d41/d43/f9e 4502483 0 2024-04-26T12:28:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:2/411: mkdir d1/de/d65/d4a/d58/d87 0 2024-04-26T12:28:47.535 INFO:tasks.workunit.client.0.smithi046.stdout:1/400: rmdir d7/d14/d5d/d32/d41 39 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:7/483: symlink d16/d27/d51/l9e 0 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:3/508: dwrite d2/db/fa4 [0,4194304] 0 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:8/539: chown d7/d24/d50/d2a/d92/ca3 297576194 1 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:0/488: write d9/d1d/f3c [1116699,1935] 0 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:2/412: write d1/de/d2b/f3a [2503450,112790] 0 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:7/484: mkdir d16/d4e/d6c/d9f 0 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:1/401: mkdir d7/d12/d89 0 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:7/485: fdatasync d16/f20 0 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:5/496: dwrite d9/da/dd/f32 [0,4194304] 0 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:8/540: creat d7/d24/d50/d2a/d39/da6/fba x:0 0 0 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:8/541: dread - d7/dc/d1b/f93 zero size 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:1/402: fdatasync d7/d9/f17 0 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:6/480: dwrite d7/d1b/d37/f38 [0,4194304] 0 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:5/497: creat d9/da/dd/d69/fae x:0 0 0 2024-04-26T12:28:47.536 INFO:tasks.workunit.client.0.smithi046.stdout:8/542: write d7/d24/d50/d62/f7e [2798711,32039] 0 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:1/403: symlink d7/d9/d2b/d31/l8a 0 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:6/481: rmdir d7/d1b/d6a/d57 39 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:1/404: stat d7/d12/f22 0 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:2/413: write d1/de/d65/d4a/f4d [488304,116227] 0 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:6/482: mknod d7/d2b/d31/c9c 0 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:3/509: dwrite d2/db/f15 [0,4194304] 0 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:5/498: rename d9/da/dd/d34/d6b/f84 to d9/da/dd/d34/faf 0 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:8/543: mknod d7/da/d88/cbb 0 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:6/483: read - d7/d2b/f83 zero size 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:7/486: dwrite d16/d1a/d31/f70 [4194304,4194304] 0 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:6/484: chown d7/f8 31971476 1 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:0/489: truncate d9/d1d/f58 459654 0 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:8/544: rename d7/c25 to d7/d24/d50/d2a/d54/cbc 0 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:6/485: readlink d7/d1b/d6a/d57/l86 0 2024-04-26T12:28:47.537 INFO:tasks.workunit.client.0.smithi046.stdout:1/405: getdents d7/d9/d2b/d31 0 2024-04-26T12:28:47.538 INFO:tasks.workunit.client.0.smithi046.stdout:0/490: truncate d9/dc/dd/f24 792898 0 2024-04-26T12:28:47.538 INFO:tasks.workunit.client.0.smithi046.stdout:6/486: dread - d7/d1b/d47/f7b zero size 2024-04-26T12:28:47.538 INFO:tasks.workunit.client.0.smithi046.stdout:6/487: sync 2024-04-26T12:28:47.538 INFO:tasks.workunit.client.0.smithi046.stdout:3/510: dwrite d2/db/f18 [0,4194304] 0 2024-04-26T12:28:47.538 INFO:tasks.workunit.client.0.smithi046.stdout:3/511: sync 2024-04-26T12:28:47.538 INFO:tasks.workunit.client.0.smithi046.stdout:8/545: truncate d7/d24/d50/f77 2817848 0 2024-04-26T12:28:47.538 INFO:tasks.workunit.client.0.smithi046.stdout:7/487: rename d16/d3f/l57 to d16/d1a/d3e/la0 0 2024-04-26T12:28:47.538 INFO:tasks.workunit.client.0.smithi046.stdout:6/488: getdents d7/d1b/d47/d65/d77/d92 0 2024-04-26T12:28:47.538 INFO:tasks.workunit.client.0.smithi046.stdout:5/499: dwrite d9/da/dd/d34/d3e/f47 [0,4194304] 0 2024-04-26T12:28:47.538 INFO:tasks.workunit.client.0.smithi046.stdout:7/488: fdatasync f4 0 2024-04-26T12:28:47.538 INFO:tasks.workunit.client.0.smithi046.stdout:1/406: rename d7/d14/d5d/f48 to d7/d12/d89/f8b 0 2024-04-26T12:28:47.538 INFO:tasks.workunit.client.0.smithi046.stdout:2/414: dwrite d1/de/d65/d1b/d38/f7e [0,4194304] 0 2024-04-26T12:28:47.538 INFO:tasks.workunit.client.0.smithi046.stdout:6/489: read - d7/d2b/f8a zero size 2024-04-26T12:28:47.538 INFO:tasks.workunit.client.0.smithi046.stdout:7/489: chown d16/d1a/d31/f49 324435 1 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:6/490: symlink d7/d1b/d6a/d57/l9d 0 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:2/415: fsync d1/de/d15/d18/f57 0 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:5/500: write d9/da/dd/d34/d44/d97/da4/fa3 [984288,101819] 0 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:1/407: creat d7/db/f8c x:0 0 0 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:2/416: rmdir d1/d42 39 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:3/512: truncate d2/d16/f73 2368696 0 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:1/408: chown d7/d12/f36 13 1 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:7/490: readlink d16/d1a/d31/d62/l68 0 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:1/409: fdatasync d7/d12/f22 0 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:3/513: rmdir d2/d16/d11/d23 39 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:7/491: symlink d16/d1a/d3e/d59/la1 0 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:8/546: dwrite d7/d24/d50/f94 [0,4194304] 0 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:2/417: getdents d1/d42 0 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:2/418: mknod d1/de/d65/d1b/c88 0 2024-04-26T12:28:47.539 INFO:tasks.workunit.client.0.smithi046.stdout:5/501: dwrite d9/da/d15/f26 [0,4194304] 0 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:8/547: write d7/dc/f17 [1183988,110229] 0 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:7/492: write d16/d1a/d3e/d4f/f71 [114805,105399] 0 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:5/502: dread - d9/da/dd/d5d/f5f zero size 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:8/548: write d7/f99 [3917688,8520] 0 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:7/493: creat d16/d1a/d31/d8e/fa2 x:0 0 0 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:3/514: dwrite d2/db/fa4 [4194304,4194304] 0 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:9/401: dread d0/d2c/d47/f8 [0,4194304] 0 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:8/549: mkdir d7/d1c/dbd 0 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:3/515: fdatasync d2/d16/f78 0 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:5/503: getdents d9/da/dd/d34/d44 0 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:1/410: dwrite d7/d12/f21 [0,4194304] 0 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:9/402: write d0/d16/d76/d7d/d72/f7f [303657,84704] 0 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:9/403: rmdir d0/d19 39 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:3/516: mknod d2/d16/d11/d82/cb7 0 2024-04-26T12:28:47.540 INFO:tasks.workunit.client.0.smithi046.stdout:2/419: dwrite d1/de/d15/f46 [0,4194304] 0 2024-04-26T12:28:47.541 INFO:tasks.workunit.client.0.smithi046.stdout:5/504: getdents d9/da 0 2024-04-26T12:28:47.541 INFO:tasks.workunit.client.0.smithi046.stdout:8/550: rename d7/da/c36 to d7/d24/d50/d2a/cbe 0 2024-04-26T12:28:47.541 INFO:tasks.workunit.client.0.smithi046.stdout:1/411: creat d7/db/f8d x:0 0 0 2024-04-26T12:28:47.541 INFO:tasks.workunit.client.0.smithi046.stdout:5/505: mkdir d9/da/dd/d69/db0 0 2024-04-26T12:28:47.541 INFO:tasks.workunit.client.0.smithi046.stdout:3/517: rename d2/db/f15 to d2/db/d4a/fb8 0 2024-04-26T12:28:47.541 INFO:tasks.workunit.client.0.smithi046.stdout:2/420: getdents d1/de/d65/d1b/d38/d78 0 2024-04-26T12:28:47.541 INFO:tasks.workunit.client.0.smithi046.stdout:2/421: write d1/de/d15/d18/f4c [3034607,19085] 0 2024-04-26T12:28:47.541 INFO:tasks.workunit.client.0.smithi046.stdout:8/551: read d7/d1c/f8b [1158748,87471] 0 2024-04-26T12:28:47.541 INFO:tasks.workunit.client.0.smithi046.stdout:3/518: symlink d2/d16/d2c/d50/d71/d89/lb9 0 2024-04-26T12:28:47.541 INFO:tasks.workunit.client.0.smithi046.stdout:8/552: chown d7/da/df/f8d 38263738 1 2024-04-26T12:28:47.541 INFO:tasks.workunit.client.0.smithi046.stdout:6/491: dread d7/f15 [0,4194304] 0 2024-04-26T12:28:47.541 INFO:tasks.workunit.client.0.smithi046.stdout:6/492: chown d7/d2b/l6f 3 1 2024-04-26T12:28:47.541 INFO:tasks.workunit.client.0.smithi046.stdout:2/422: rename d1/de/d65/d1b/c52 to d1/de/d65/d1b/d38/c89 0 2024-04-26T12:28:47.542 INFO:tasks.workunit.client.0.smithi046.stdout:2/423: dread - d1/d71/f77 zero size 2024-04-26T12:28:47.542 INFO:tasks.workunit.client.0.smithi046.stdout:6/493: creat d7/d1b/d47/d65/d77/f9e x:0 0 0 2024-04-26T12:28:47.542 INFO:tasks.workunit.client.0.smithi046.stdout:2/424: mkdir d1/de/d15/d18/d8a 0 2024-04-26T12:28:47.542 INFO:tasks.workunit.client.0.smithi046.stdout:6/494: read - d7/d1b/d47/f97 zero size 2024-04-26T12:28:47.542 INFO:tasks.workunit.client.0.smithi046.stdout:4/462: dread d0/da/fd [0,4194304] 0 2024-04-26T12:28:47.542 INFO:tasks.workunit.client.0.smithi046.stdout:1/412: read d7/d12/f36 [697179,22423] 0 2024-04-26T12:28:47.542 INFO:tasks.workunit.client.0.smithi046.stdout:6/495: rmdir d7/d2b/d94 0 2024-04-26T12:28:47.542 INFO:tasks.workunit.client.0.smithi046.stdout:4/463: read - d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/f90 zero size 2024-04-26T12:28:47.542 INFO:tasks.workunit.client.0.smithi046.stdout:1/413: write d7/db/f8c [54931,31183] 0 2024-04-26T12:28:47.542 INFO:tasks.workunit.client.0.smithi046.stdout:6/496: symlink d7/d2b/l9f 0 2024-04-26T12:28:47.542 INFO:tasks.workunit.client.0.smithi046.stdout:8/553: rmdir d7/d24/d50 39 2024-04-26T12:28:47.542 INFO:tasks.workunit.client.0.smithi046.stdout:4/464: stat d0/d64/f6a 0 2024-04-26T12:28:47.542 INFO:tasks.workunit.client.0.smithi046.stdout:5/506: write d9/da/d15/f4c [1018200,45868] 0 2024-04-26T12:28:47.542 INFO:tasks.workunit.client.0.smithi046.stdout:6/497: creat d7/d1b/d37/fa0 x:0 0 0 2024-04-26T12:28:47.543 INFO:tasks.workunit.client.0.smithi046.stdout:4/465: mknod d0/da/d17/d20/d74/c96 0 2024-04-26T12:28:47.543 INFO:tasks.workunit.client.0.smithi046.stdout:8/554: chown d7/d24/d50/d62/f7e 58252589 1 2024-04-26T12:28:47.543 INFO:tasks.workunit.client.0.smithi046.stdout:2/425: dwrite d1/de/d15/d18/f2c [4194304,4194304] 0 2024-04-26T12:28:47.543 INFO:tasks.workunit.client.0.smithi046.stdout:1/414: creat d7/d9/d2b/d39/d5c/f8e x:0 0 0 2024-04-26T12:28:47.543 INFO:tasks.workunit.client.0.smithi046.stdout:5/507: symlink d9/da/d18/d7d/da7/lb1 0 2024-04-26T12:28:47.543 INFO:tasks.workunit.client.0.smithi046.stdout:8/555: chown d7/dc/d1b/f8c 6 1 2024-04-26T12:28:47.543 INFO:tasks.workunit.client.0.smithi046.stdout:1/415: stat d7/d9/d2b/d39/d3c/c4c 0 2024-04-26T12:28:47.543 INFO:tasks.workunit.client.0.smithi046.stdout:2/426: symlink d1/de/d65/d4a/l8b 0 2024-04-26T12:28:47.543 INFO:tasks.workunit.client.0.smithi046.stdout:4/466: symlink d0/da/d17/d20/d25/d35/l97 0 2024-04-26T12:28:47.543 INFO:tasks.workunit.client.0.smithi046.stdout:2/427: write d1/f35 [4958296,26907] 0 2024-04-26T12:28:47.543 INFO:tasks.workunit.client.0.smithi046.stdout:5/508: creat d9/da/d18/d7d/fb2 x:0 0 0 2024-04-26T12:28:47.543 INFO:tasks.workunit.client.0.smithi046.stdout:8/556: creat d7/d24/d56/fbf x:0 0 0 2024-04-26T12:28:47.543 INFO:tasks.workunit.client.0.smithi046.stdout:1/416: write d7/d9/d2b/d39/d5c/f8e [127708,47828] 0 2024-04-26T12:28:47.543 INFO:tasks.workunit.client.0.smithi046.stdout:4/467: creat d0/da/d17/d20/d8e/f98 x:0 0 0 2024-04-26T12:28:47.544 INFO:tasks.workunit.client.0.smithi046.stdout:5/509: read d9/da/dd/d34/d3e/f47 [331052,10640] 0 2024-04-26T12:28:47.544 INFO:tasks.workunit.client.0.smithi046.stdout:1/417: chown d7/d14/d5d/d32/c70 2265592 1 2024-04-26T12:28:47.544 INFO:tasks.workunit.client.0.smithi046.stdout:2/428: symlink d1/de/d65/d4a/d86/l8c 0 2024-04-26T12:28:47.544 INFO:tasks.workunit.client.0.smithi046.stdout:1/418: chown d7/d9/d2b/l3f 235 1 2024-04-26T12:28:47.544 INFO:tasks.workunit.client.0.smithi046.stdout:5/510: mknod d9/da/d18/cb3 0 2024-04-26T12:28:47.544 INFO:tasks.workunit.client.0.smithi046.stdout:2/429: chown d1/de/d65/l5a 12092623 1 2024-04-26T12:28:47.544 INFO:tasks.workunit.client.0.smithi046.stdout:8/557: getdents d7/d24/d50/d2a/d39 0 2024-04-26T12:28:47.547 INFO:tasks.workunit.client.0.smithi046.stdout:2/430: symlink d1/de/d65/d1b/l8d 0 2024-04-26T12:28:47.547 INFO:tasks.workunit.client.0.smithi046.stdout:4/468: dwrite d0/da/d17/d20/d25/f43 [0,4194304] 0 2024-04-26T12:28:47.547 INFO:tasks.workunit.client.0.smithi046.stdout:2/431: creat d1/de/d65/d4a/d58/f8e x:0 0 0 2024-04-26T12:28:47.547 INFO:tasks.workunit.client.0.smithi046.stdout:2/432: readlink d1/de/d15/d18/l55 0 2024-04-26T12:28:47.547 INFO:tasks.workunit.client.0.smithi046.stdout:1/419: dwrite d7/d9/d2b/d39/d5c/f8e [0,4194304] 0 2024-04-26T12:28:47.547 INFO:tasks.workunit.client.0.smithi046.stdout:4/469: creat d0/f99 x:0 0 0 2024-04-26T12:28:47.547 INFO:tasks.workunit.client.0.smithi046.stdout:5/511: dwrite d9/f41 [0,4194304] 0 2024-04-26T12:28:47.547 INFO:tasks.workunit.client.0.smithi046.stdout:0/491: dread d9/dc/f1a [0,4194304] 0 2024-04-26T12:28:47.547 INFO:tasks.workunit.client.0.smithi046.stdout:4/470: stat d0/da/d21/l95 0 2024-04-26T12:28:47.547 INFO:tasks.workunit.client.0.smithi046.stdout:2/433: mkdir d1/de/d65/d8f 0 2024-04-26T12:28:47.547 INFO:tasks.workunit.client.0.smithi046.stdout:8/558: dwrite d7/dc/d1b/f8e [0,4194304] 0 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:2/434: chown d1 13 1 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:4/471: write d0/da/d17/d20/f7f [73270,44600] 0 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:4/472: stat d0/da 0 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:8/559: write d7/d24/d50/d2a/d39/f61 [515589,109177] 0 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:4/473: fdatasync d0/d1/d29/f5b 0 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:5/512: rename d9/da/dd/d69/d7e/fa1 to d9/da/dd/d34/fb4 0 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:5/513: creat d9/da/d40/fb5 x:0 0 0 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:4/474: creat d0/da/d17/d20/d25/d35/d6d/d19/d55/f9a x:0 0 0 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:4/475: unlink d0/d1/d5/f6b 0 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:4/476: rename d0/d1/d5/f2b to d0/d41/f9b 0 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:7/494: sync 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:9/404: sync 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:9/405: symlink d0/d19/d51/l8e 0 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:5/514: dwrite d9/da/dd/d34/d44/d97/da4/d35/f67 [0,4194304] 0 2024-04-26T12:28:47.548 INFO:tasks.workunit.client.0.smithi046.stdout:1/420: dwrite d7/d9/f66 [0,4194304] 0 2024-04-26T12:28:47.549 INFO:tasks.workunit.client.0.smithi046.stdout:2/435: dwrite d1/de/d2b/f50 [0,4194304] 0 2024-04-26T12:28:47.549 INFO:tasks.workunit.client.0.smithi046.stdout:5/515: mkdir d9/da/dd/d69/db0/db6 0 2024-04-26T12:28:47.549 INFO:tasks.workunit.client.0.smithi046.stdout:2/436: mkdir d1/de/d65/d4a/d90 0 2024-04-26T12:28:47.550 INFO:tasks.workunit.client.0.smithi046.stdout:5/516: creat d9/da/d15/fb7 x:0 0 0 2024-04-26T12:28:47.550 INFO:tasks.workunit.client.0.smithi046.stdout:7/495: truncate d16/d3f/f47 988066 0 2024-04-26T12:28:47.550 INFO:tasks.workunit.client.0.smithi046.stdout:6/498: sync 2024-04-26T12:28:47.550 INFO:tasks.workunit.client.0.smithi046.stdout:0/492: sync 2024-04-26T12:28:47.550 INFO:tasks.workunit.client.0.smithi046.stdout:3/519: sync 2024-04-26T12:28:47.550 INFO:tasks.workunit.client.0.smithi046.stdout:6/499: fsync d7/d1b/d37/f42 0 2024-04-26T12:28:47.551 INFO:tasks.workunit.client.0.smithi046.stdout:7/496: rename d16/d1a/d31/d5a to d16/d1a/d31/d5a/d6b/da3 22 2024-04-26T12:28:47.551 INFO:tasks.workunit.client.0.smithi046.stdout:8/560: dread d7/d24/d50/f9b [4194304,4194304] 0 2024-04-26T12:28:47.551 INFO:tasks.workunit.client.0.smithi046.stdout:5/517: getdents d9/da/dd/d34/d44/d97/da4 0 2024-04-26T12:28:47.551 INFO:tasks.workunit.client.0.smithi046.stdout:3/520: creat d2/d16/d2c/d50/d71/d89/fba x:0 0 0 2024-04-26T12:28:47.551 INFO:tasks.workunit.client.0.smithi046.stdout:0/493: creat d9/d1d/d40/d41/d7e/da5/faa x:0 0 0 2024-04-26T12:28:47.551 INFO:tasks.workunit.client.0.smithi046.stdout:8/561: stat d7/d24/d50/f9b 0 2024-04-26T12:28:47.551 INFO:tasks.workunit.client.0.smithi046.stdout:7/497: creat d16/d1a/d31/fa4 x:0 0 0 2024-04-26T12:28:47.552 INFO:tasks.workunit.client.0.smithi046.stdout:8/562: rmdir d7/dc/d1b 39 2024-04-26T12:28:47.552 INFO:tasks.workunit.client.0.smithi046.stdout:5/518: symlink d9/da/dd/d34/d44/d97/lb8 0 2024-04-26T12:28:47.552 INFO:tasks.workunit.client.0.smithi046.stdout:0/494: symlink d9/d1d/d40/d41/d43/da4/lab 0 2024-04-26T12:28:47.553 INFO:tasks.workunit.client.0.smithi046.stdout:3/521: truncate d2/db/d4a/f91 626861 0 2024-04-26T12:28:47.553 INFO:tasks.workunit.client.0.smithi046.stdout:7/498: fsync d16/d1a/d31/d5a/f60 0 2024-04-26T12:28:47.553 INFO:tasks.workunit.client.0.smithi046.stdout:0/495: stat d9/dc/d4c/fa3 0 2024-04-26T12:28:47.555 INFO:tasks.workunit.client.0.smithi046.stdout:3/522: chown d2/db/d4a/f86 1276 1 2024-04-26T12:28:47.555 INFO:tasks.workunit.client.0.smithi046.stdout:3/523: sync 2024-04-26T12:28:47.556 INFO:tasks.workunit.client.0.smithi046.stdout:6/500: dwrite d7/f29 [0,4194304] 0 2024-04-26T12:28:47.556 INFO:tasks.workunit.client.0.smithi046.stdout:7/499: creat d16/d1a/d31/d4d/fa5 x:0 0 0 2024-04-26T12:28:47.556 INFO:tasks.workunit.client.0.smithi046.stdout:0/496: dread - d9/d1d/d40/d41/d7e/da5/faa zero size 2024-04-26T12:28:47.557 INFO:tasks.workunit.client.0.smithi046.stdout:0/497: readlink d9/dc/l46 0 2024-04-26T12:28:47.557 INFO:tasks.workunit.client.0.smithi046.stdout:7/500: readlink d16/d27/l74 0 2024-04-26T12:28:47.558 INFO:tasks.workunit.client.0.smithi046.stdout:6/501: creat d7/d1b/d37/d95/fa1 x:0 0 0 2024-04-26T12:28:47.559 INFO:tasks.workunit.client.0.smithi046.stdout:7/501: link l1 d16/d27/d51/d9c/la6 0 2024-04-26T12:28:47.560 INFO:tasks.workunit.client.0.smithi046.stdout:5/519: dwrite d9/da/d15/fb7 [0,4194304] 0 2024-04-26T12:28:47.560 INFO:tasks.workunit.client.0.smithi046.stdout:6/502: creat d7/fa2 x:0 0 0 2024-04-26T12:28:47.561 INFO:tasks.workunit.client.0.smithi046.stdout:7/502: readlink d16/d1a/d3e/l8a 0 2024-04-26T12:28:47.563 INFO:tasks.workunit.client.0.smithi046.stdout:7/503: dread - d16/d1a/d31/d8e/fa2 zero size 2024-04-26T12:28:47.564 INFO:tasks.workunit.client.0.smithi046.stdout:5/520: rename d9/da/dd/f64 to d9/da/d15/fb9 0 2024-04-26T12:28:47.564 INFO:tasks.workunit.client.0.smithi046.stdout:3/524: dwrite d2/db/d4a/da9/faf [0,4194304] 0 2024-04-26T12:28:47.564 INFO:tasks.workunit.client.0.smithi046.stdout:0/498: dwrite d9/dc/d4c/fa3 [0,4194304] 0 2024-04-26T12:28:47.565 INFO:tasks.workunit.client.0.smithi046.stdout:7/504: write d16/d1a/d31/f49 [213909,67808] 0 2024-04-26T12:28:47.566 INFO:tasks.workunit.client.0.smithi046.stdout:0/499: chown d9/dc/dd/fa6 1112 1 2024-04-26T12:28:47.566 INFO:tasks.workunit.client.0.smithi046.stdout:3/525: write d2/d16/d11/f75 [940446,35053] 0 2024-04-26T12:28:47.566 INFO:tasks.workunit.client.0.smithi046.stdout:0/500: sync 2024-04-26T12:28:47.566 INFO:tasks.workunit.client.0.smithi046.stdout:7/505: creat d16/d4e/d6c/fa7 x:0 0 0 2024-04-26T12:28:47.567 INFO:tasks.workunit.client.0.smithi046.stdout:0/501: creat d9/d1d/d5d/d6b/d8a/d8c/fac x:0 0 0 2024-04-26T12:28:47.567 INFO:tasks.workunit.client.0.smithi046.stdout:7/506: write d16/d1a/d31/d62/f88 [2610585,62901] 0 2024-04-26T12:28:47.567 INFO:tasks.workunit.client.0.smithi046.stdout:3/526: readlink d2/d16/d11/l5e 0 2024-04-26T12:28:47.567 INFO:tasks.workunit.client.0.smithi046.stdout:0/502: dread - d9/d1d/d40/d41/f96 zero size 2024-04-26T12:28:47.570 INFO:tasks.workunit.client.0.smithi046.stdout:0/503: mkdir d9/d1d/d40/d41/d7e/da5/dad 0 2024-04-26T12:28:47.571 INFO:tasks.workunit.client.0.smithi046.stdout:7/507: getdents d16/d1a/d31/d5a 0 2024-04-26T12:28:47.571 INFO:tasks.workunit.client.0.smithi046.stdout:3/527: truncate d2/d16/d11/d1f/d74/fa7 878839 0 2024-04-26T12:28:47.572 INFO:tasks.workunit.client.0.smithi046.stdout:3/528: fdatasync d2/db/d62/f87 0 2024-04-26T12:28:47.572 INFO:tasks.workunit.client.0.smithi046.stdout:0/504: mkdir d9/d1d/d40/d41/d43/da4/dae 0 2024-04-26T12:28:47.575 INFO:tasks.workunit.client.0.smithi046.stdout:5/521: dwrite d9/da/f7b [0,4194304] 0 2024-04-26T12:28:47.575 INFO:tasks.workunit.client.0.smithi046.stdout:6/503: write d7/d1b/d37/d95/f96 [2303191,28907] 0 2024-04-26T12:28:47.575 INFO:tasks.workunit.client.0.smithi046.stdout:7/508: getdents d16/d1a/d3e 0 2024-04-26T12:28:47.576 INFO:tasks.workunit.client.0.smithi046.stdout:3/529: mkdir d2/d16/d2c/d50/d71/d89/d98/dbb 0 2024-04-26T12:28:47.576 INFO:tasks.workunit.client.0.smithi046.stdout:6/504: readlink d7/d16/l60 0 2024-04-26T12:28:47.576 INFO:tasks.workunit.client.0.smithi046.stdout:6/505: sync 2024-04-26T12:28:47.576 INFO:tasks.workunit.client.0.smithi046.stdout:5/522: dread - d9/da/dd/d69/d7e/fab zero size 2024-04-26T12:28:47.576 INFO:tasks.workunit.client.0.smithi046.stdout:0/505: creat d9/d1d/faf x:0 0 0 2024-04-26T12:28:47.576 INFO:tasks.workunit.client.0.smithi046.stdout:7/509: creat d16/d1a/d31/d5a/fa8 x:0 0 0 2024-04-26T12:28:47.576 INFO:tasks.workunit.client.0.smithi046.stdout:3/530: mkdir d2/d16/d35/dbc 0 2024-04-26T12:28:47.577 INFO:tasks.workunit.client.0.smithi046.stdout:6/506: mkdir d7/d1b/d47/d65/da3 0 2024-04-26T12:28:47.577 INFO:tasks.workunit.client.0.smithi046.stdout:0/506: write d9/dc/f60 [3518151,30254] 0 2024-04-26T12:28:47.577 INFO:tasks.workunit.client.0.smithi046.stdout:7/510: unlink d16/d1a/l91 0 2024-04-26T12:28:47.577 INFO:tasks.workunit.client.0.smithi046.stdout:5/523: mknod d9/da/dd/d34/d3e/cba 0 2024-04-26T12:28:47.578 INFO:tasks.workunit.client.0.smithi046.stdout:6/507: unlink d7/d1b/f23 0 2024-04-26T12:28:47.578 INFO:tasks.workunit.client.0.smithi046.stdout:0/507: dread - d9/d1d/d40/d41/f96 zero size 2024-04-26T12:28:47.578 INFO:tasks.workunit.client.0.smithi046.stdout:3/531: link d2/db/fe d2/db/d4a/da9/fbd 0 2024-04-26T12:28:47.578 INFO:tasks.workunit.client.0.smithi046.stdout:5/524: unlink d9/da/dd/d5d/c9c 0 2024-04-26T12:28:47.579 INFO:tasks.workunit.client.0.smithi046.stdout:6/508: symlink d7/d1b/la4 0 2024-04-26T12:28:47.580 INFO:tasks.workunit.client.0.smithi046.stdout:5/525: getdents d9/da/dd/d69/db0/db6 0 2024-04-26T12:28:47.581 INFO:tasks.workunit.client.0.smithi046.stdout:6/509: truncate d7/d1b/d37/f76 4023492 0 2024-04-26T12:28:47.582 INFO:tasks.workunit.client.0.smithi046.stdout:6/510: readlink d7/d2b/l8e 0 2024-04-26T12:28:47.582 INFO:tasks.workunit.client.0.smithi046.stdout:7/511: dwrite f5 [0,4194304] 0 2024-04-26T12:28:47.583 INFO:tasks.workunit.client.0.smithi046.stdout:6/511: chown d7/d2b/f30 947072331 1 2024-04-26T12:28:47.583 INFO:tasks.workunit.client.0.smithi046.stdout:0/508: rename d9/dc/f60 to d9/d1d/d40/fb0 0 2024-04-26T12:28:47.583 INFO:tasks.workunit.client.0.smithi046.stdout:8/563: dread d7/dc/f13 [0,4194304] 0 2024-04-26T12:28:47.584 INFO:tasks.workunit.client.0.smithi046.stdout:2/437: dread d1/de/d15/d18/f57 [0,4194304] 0 2024-04-26T12:28:47.584 INFO:tasks.workunit.client.0.smithi046.stdout:9/406: dread d0/d19/d21/f53 [0,4194304] 0 2024-04-26T12:28:47.584 INFO:tasks.workunit.client.0.smithi046.stdout:1/421: dread d7/d9/f11 [0,4194304] 0 2024-04-26T12:28:47.585 INFO:tasks.workunit.client.0.smithi046.stdout:2/438: unlink d1/de/d15/c29 0 2024-04-26T12:28:47.586 INFO:tasks.workunit.client.0.smithi046.stdout:8/564: creat d7/dc/d1b/dae/fc0 x:0 0 0 2024-04-26T12:28:47.586 INFO:tasks.workunit.client.0.smithi046.stdout:9/407: creat d0/d2c/d3d/d52/f8f x:0 0 0 2024-04-26T12:28:47.587 INFO:tasks.workunit.client.0.smithi046.stdout:2/439: mkdir d1/de/d15/d18/d91 0 2024-04-26T12:28:47.588 INFO:tasks.workunit.client.0.smithi046.stdout:7/512: dread d16/d1a/d3e/d4f/f71 [0,4194304] 0 2024-04-26T12:28:47.588 INFO:tasks.workunit.client.0.smithi046.stdout:8/565: mkdir d7/dc/d1b/d7d/dc1 0 2024-04-26T12:28:47.588 INFO:tasks.workunit.client.0.smithi046.stdout:5/526: dwrite d9/da/d15/f26 [0,4194304] 0 2024-04-26T12:28:47.589 INFO:tasks.workunit.client.0.smithi046.stdout:2/440: write d1/de/f11 [294878,20331] 0 2024-04-26T12:28:47.589 INFO:tasks.workunit.client.0.smithi046.stdout:3/532: dread d2/d16/d2c/d50/d71/d89/f9e [0,4194304] 0 2024-04-26T12:28:47.590 INFO:tasks.workunit.client.0.smithi046.stdout:0/509: rmdir d9/d1d/d40/d41 39 2024-04-26T12:28:47.590 INFO:tasks.workunit.client.0.smithi046.stdout:8/566: fsync d7/d24/d56/fbf 0 2024-04-26T12:28:47.590 INFO:tasks.workunit.client.0.smithi046.stdout:4/477: dread d0/da/d17/d20/d25/d35/d6d/f92 [0,4194304] 0 2024-04-26T12:28:47.590 INFO:tasks.workunit.client.0.smithi046.stdout:7/513: symlink d16/la9 0 2024-04-26T12:28:47.591 INFO:tasks.workunit.client.0.smithi046.stdout:9/408: rename d0/d2c/d47/f87 to d0/d19/d21/f90 0 2024-04-26T12:28:47.591 INFO:tasks.workunit.client.0.smithi046.stdout:4/478: sync 2024-04-26T12:28:47.592 INFO:tasks.workunit.client.0.smithi046.stdout:8/567: read - d7/d24/d56/fbf zero size 2024-04-26T12:28:47.592 INFO:tasks.workunit.client.0.smithi046.stdout:4/479: stat d0/da/d17/c5a 0 2024-04-26T12:28:47.593 INFO:tasks.workunit.client.0.smithi046.stdout:3/533: write d2/d16/d35/f69 [240536,74895] 0 2024-04-26T12:28:47.593 INFO:tasks.workunit.client.0.smithi046.stdout:7/514: mkdir d16/d3f/d81/daa 0 2024-04-26T12:28:47.593 INFO:tasks.workunit.client.0.smithi046.stdout:0/510: mknod d9/dc/d4c/d62/cb1 0 2024-04-26T12:28:47.593 INFO:tasks.workunit.client.0.smithi046.stdout:1/422: dwrite d7/db/f10 [0,4194304] 0 2024-04-26T12:28:47.594 INFO:tasks.workunit.client.0.smithi046.stdout:9/409: creat d0/d16/d76/d7d/d72/f91 x:0 0 0 2024-04-26T12:28:47.594 INFO:tasks.workunit.client.0.smithi046.stdout:2/441: creat d1/de/d65/d4a/d90/f92 x:0 0 0 2024-04-26T12:28:47.595 INFO:tasks.workunit.client.0.smithi046.stdout:9/410: fdatasync d0/d19/d51/f57 0 2024-04-26T12:28:47.596 INFO:tasks.workunit.client.0.smithi046.stdout:3/534: mknod d2/db/d4a/cbe 0 2024-04-26T12:28:47.596 INFO:tasks.workunit.client.0.smithi046.stdout:1/423: truncate d7/d12/d3a/f4a 9416085 0 2024-04-26T12:28:47.596 INFO:tasks.workunit.client.0.smithi046.stdout:2/442: symlink d1/de/d2b/l93 0 2024-04-26T12:28:47.596 INFO:tasks.workunit.client.0.smithi046.stdout:8/568: write d7/dc/d1b/f79 [4821996,72441] 0 2024-04-26T12:28:47.597 INFO:tasks.workunit.client.0.smithi046.stdout:1/424: write d7/d9/f18 [3600064,42964] 0 2024-04-26T12:28:47.598 INFO:tasks.workunit.client.0.smithi046.stdout:2/443: mknod d1/de/d67/c94 0 2024-04-26T12:28:47.598 INFO:tasks.workunit.client.0.smithi046.stdout:3/535: mkdir d2/d16/d11/d23/dbf 0 2024-04-26T12:28:47.601 INFO:tasks.workunit.client.0.smithi046.stdout:7/515: dread d16/f23 [0,4194304] 0 2024-04-26T12:28:47.601 INFO:tasks.workunit.client.0.smithi046.stdout:0/511: write d9/dc/dd/f27 [3762734,48597] 0 2024-04-26T12:28:47.601 INFO:tasks.workunit.client.0.smithi046.stdout:1/425: chown d7/d12/d3a/f43 1399470 1 2024-04-26T12:28:47.601 INFO:tasks.workunit.client.0.smithi046.stdout:2/444: creat d1/de/d15/d18/d8a/f95 x:0 0 0 2024-04-26T12:28:47.601 INFO:tasks.workunit.client.0.smithi046.stdout:1/426: sync 2024-04-26T12:28:47.601 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:47.600+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:47.602 INFO:tasks.workunit.client.0.smithi046.stdout:0/512: stat d9/d1d/l2e 0 2024-04-26T12:28:47.603 INFO:tasks.workunit.client.0.smithi046.stdout:2/445: dread - d1/f3e zero size 2024-04-26T12:28:47.603 INFO:tasks.workunit.client.0.smithi046.stdout:7/516: chown d16/d35/c64 1905 1 2024-04-26T12:28:47.604 INFO:tasks.workunit.client.0.smithi046.stdout:5/527: dwrite d9/da/f5c [0,4194304] 0 2024-04-26T12:28:47.604 INFO:tasks.workunit.client.0.smithi046.stdout:3/536: rename d2/d16/d11/c96 to d2/db/cc0 0 2024-04-26T12:28:47.604 INFO:tasks.workunit.client.0.smithi046.stdout:1/427: mkdir d7/d14/d5d/d32/d41/d8f 0 2024-04-26T12:28:47.605 INFO:tasks.workunit.client.0.smithi046.stdout:4/480: dwrite d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/f90 [0,4194304] 0 2024-04-26T12:28:47.606 INFO:tasks.workunit.client.0.smithi046.stdout:7/517: mknod d16/d1a/cab 0 2024-04-26T12:28:47.606 INFO:tasks.workunit.client.0.smithi046.stdout:0/513: write d9/dc/f42 [1277346,52444] 0 2024-04-26T12:28:47.606 INFO:tasks.workunit.client.0.smithi046.stdout:2/446: mkdir d1/de/d65/d4a/d86/d96 0 2024-04-26T12:28:47.606 INFO:tasks.workunit.client.0.smithi046.stdout:5/528: stat d9/da/dd/d34/d3e/cba 0 2024-04-26T12:28:47.607 INFO:tasks.workunit.client.0.smithi046.stdout:2/447: fsync d1/de/d15/d18/f4c 0 2024-04-26T12:28:47.607 INFO:tasks.workunit.client.0.smithi046.stdout:1/428: rename d7/d12/f57 to d7/d38/f90 0 2024-04-26T12:28:47.607 INFO:tasks.workunit.client.0.smithi046.stdout:3/537: symlink d2/d16/d2c/d50/d71/d89/lc1 0 2024-04-26T12:28:47.607 INFO:tasks.workunit.client.0.smithi046.stdout:9/411: dwrite d0/f1d [0,4194304] 0 2024-04-26T12:28:47.608 INFO:tasks.workunit.client.0.smithi046.stdout:0/514: rmdir d9/d1d/d5d/d6b 39 2024-04-26T12:28:47.609 INFO:tasks.workunit.client.0.smithi046.stdout:6/512: dread d7/d2b/f53 [0,4194304] 0 2024-04-26T12:28:47.609 INFO:tasks.workunit.client.0.smithi046.stdout:7/518: rename d16/d1a/d31/d5a/d78 to d16/d35/dac 0 2024-04-26T12:28:47.609 INFO:tasks.workunit.client.0.smithi046.stdout:9/412: mknod d0/d29/c92 0 2024-04-26T12:28:47.610 INFO:tasks.workunit.client.0.smithi046.stdout:5/529: mknod d9/da/dd/d34/d45/d8f/cbb 0 2024-04-26T12:28:47.610 INFO:tasks.workunit.client.0.smithi046.stdout:7/519: mknod d16/d4e/d6c/cad 0 2024-04-26T12:28:47.611 INFO:tasks.workunit.client.0.smithi046.stdout:9/413: creat d0/d19/f93 x:0 0 0 2024-04-26T12:28:47.612 INFO:tasks.workunit.client.0.smithi046.stdout:7/520: mknod d16/d4e/d6c/cae 0 2024-04-26T12:28:47.612 INFO:tasks.workunit.client.0.smithi046.stdout:5/530: write d9/da/dd/d34/faf [2261884,29913] 0 2024-04-26T12:28:47.612 INFO:tasks.workunit.client.0.smithi046.stdout:1/429: rename d7/d9/l7a to d7/d14/d5d/d32/d41/l91 0 2024-04-26T12:28:47.613 INFO:tasks.workunit.client.0.smithi046.stdout:9/414: creat d0/d29/d69/d88/f94 x:0 0 0 2024-04-26T12:28:47.614 INFO:tasks.workunit.client.0.smithi046.stdout:1/430: creat d7/d14/d5d/d32/d5f/f92 x:0 0 0 2024-04-26T12:28:47.614 INFO:tasks.workunit.client.0.smithi046.stdout:0/515: dwrite d9/dc/d4c/d62/f80 [0,4194304] 0 2024-04-26T12:28:47.615 INFO:tasks.workunit.client.0.smithi046.stdout:2/448: rmdir d1 39 2024-04-26T12:28:47.615 INFO:tasks.workunit.client.0.smithi046.stdout:1/431: write d7/d9/f17 [531709,38573] 0 2024-04-26T12:28:47.615 INFO:tasks.workunit.client.0.smithi046.stdout:3/538: dwrite d2/d16/d11/d1b/d2d/f5b [0,4194304] 0 2024-04-26T12:28:47.615 INFO:tasks.workunit.client.0.smithi046.stdout:7/521: getdents d16/d1a/d31/d8e 0 2024-04-26T12:28:47.616 INFO:tasks.workunit.client.0.smithi046.stdout:5/531: getdents d9/da/dd/d34/d44/d97/da4 0 2024-04-26T12:28:47.616 INFO:tasks.workunit.client.0.smithi046.stdout:0/516: fsync d9/dc/dd/f99 0 2024-04-26T12:28:47.616 INFO:tasks.workunit.client.0.smithi046.stdout:6/513: write d7/d2b/d31/f80 [1745616,48822] 0 2024-04-26T12:28:47.617 INFO:tasks.workunit.client.0.smithi046.stdout:4/481: read d0/da/d17/f46 [4070246,75943] 0 2024-04-26T12:28:47.617 INFO:tasks.workunit.client.0.smithi046.stdout:1/432: creat d7/d14/d5d/d32/d41/f93 x:0 0 0 2024-04-26T12:28:47.618 INFO:tasks.workunit.client.0.smithi046.stdout:4/482: fsync d0/d1/f87 0 2024-04-26T12:28:47.618 INFO:tasks.workunit.client.0.smithi046.stdout:5/532: dread - d9/da/dd/d34/d44/f8e zero size 2024-04-26T12:28:47.618 INFO:tasks.workunit.client.0.smithi046.stdout:9/415: truncate d0/d16/d76/d7d/d72/f7f 1057138 0 2024-04-26T12:28:47.619 INFO:tasks.workunit.client.0.smithi046.stdout:3/539: truncate d2/d16/d11/f4b 190711 0 2024-04-26T12:28:47.619 INFO:tasks.workunit.client.0.smithi046.stdout:0/517: mkdir d9/d1d/d40/d41/d43/db2 0 2024-04-26T12:28:47.619 INFO:tasks.workunit.client.0.smithi046.stdout:6/514: creat d7/d1b/d47/d65/fa5 x:0 0 0 2024-04-26T12:28:47.619 INFO:tasks.workunit.client.0.smithi046.stdout:7/522: truncate d16/d1a/d31/d5a/f96 2117338 0 2024-04-26T12:28:47.621 INFO:tasks.workunit.client.0.smithi046.stdout:0/518: fsync d9/d1d/d5d/d6b/d8a/d8c/fac 0 2024-04-26T12:28:47.621 INFO:tasks.workunit.client.0.smithi046.stdout:9/416: truncate d0/d2c/d47/f2e 1904839 0 2024-04-26T12:28:47.622 INFO:tasks.workunit.client.0.smithi046.stdout:3/540: creat d2/d16/d35/fc2 x:0 0 0 2024-04-26T12:28:47.622 INFO:tasks.workunit.client.0.smithi046.stdout:4/483: mkdir d0/da/d17/d20/d9c 0 2024-04-26T12:28:47.622 INFO:tasks.workunit.client.0.smithi046.stdout:7/523: rename d16/d3f/l46 to d16/d1a/d31/d4d/laf 0 2024-04-26T12:28:47.623 INFO:tasks.workunit.client.0.smithi046.stdout:9/417: link d0/f65 d0/d19/d51/f95 0 2024-04-26T12:28:47.623 INFO:tasks.workunit.client.0.smithi046.stdout:3/541: dread - d2/d16/d11/d1f/d74/f9f zero size 2024-04-26T12:28:47.625 INFO:tasks.workunit.client.0.smithi046.stdout:1/433: dwrite d7/d12/d3a/d76/f7c [0,4194304] 0 2024-04-26T12:28:47.626 INFO:tasks.workunit.client.0.smithi046.stdout:1/434: mknod d7/d12/d44/c94 0 2024-04-26T12:28:47.628 INFO:tasks.workunit.client.0.smithi046.stdout:1/435: chown d7/d12/d44/c94 701744 1 2024-04-26T12:28:47.629 INFO:tasks.workunit.client.0.smithi046.stdout:8/569: dread d7/d24/f2f [0,4194304] 0 2024-04-26T12:28:47.629 INFO:tasks.workunit.client.0.smithi046.stdout:0/519: write d9/dc/dd/fa6 [733509,114969] 0 2024-04-26T12:28:47.630 INFO:tasks.workunit.client.0.smithi046.stdout:1/436: mkdir d7/d9/d2b/d31/d82/d95 0 2024-04-26T12:28:47.631 INFO:tasks.workunit.client.0.smithi046.stdout:9/418: dwrite d0/d2c/d47/f46 [4194304,4194304] 0 2024-04-26T12:28:47.632 INFO:tasks.workunit.client.0.smithi046.stdout:3/542: dwrite d2/d16/f34 [0,4194304] 0 2024-04-26T12:28:47.632 INFO:tasks.workunit.client.0.smithi046.stdout:1/437: readlink d7/d14/d5d/d32/l3d 0 2024-04-26T12:28:47.633 INFO:tasks.workunit.client.0.smithi046.stdout:9/419: unlink d0/d19/d21/f90 0 2024-04-26T12:28:47.633 INFO:tasks.workunit.client.0.smithi046.stdout:0/520: truncate d9/d1d/f58 853740 0 2024-04-26T12:28:47.633 INFO:tasks.workunit.client.0.smithi046.stdout:3/543: symlink d2/db/lc3 0 2024-04-26T12:28:47.634 INFO:tasks.workunit.client.0.smithi046.stdout:1/438: truncate d7/db/f8d 202319 0 2024-04-26T12:28:47.634 INFO:tasks.workunit.client.0.smithi046.stdout:9/420: symlink d0/d19/l96 0 2024-04-26T12:28:47.634 INFO:tasks.workunit.client.0.smithi046.stdout:7/524: read d16/d1a/d31/d5a/f96 [1705717,97298] 0 2024-04-26T12:28:47.636 INFO:tasks.workunit.client.0.smithi046.stdout:8/570: dread d7/dc/f13 [0,4194304] 0 2024-04-26T12:28:47.638 INFO:tasks.workunit.client.0.smithi046.stdout:1/439: rename d7/d12/d44 to d7/d9/d2b/d96 0 2024-04-26T12:28:47.638 INFO:tasks.workunit.client.0.smithi046.stdout:3/544: chown d2/db/caa 39 1 2024-04-26T12:28:47.639 INFO:tasks.workunit.client.0.smithi046.stdout:9/421: mkdir d0/d16/d76/d7d/d72/d85/d97 0 2024-04-26T12:28:47.639 INFO:tasks.workunit.client.0.smithi046.stdout:8/571: rename d7/da/l19 to d7/d24/d56/lc2 0 2024-04-26T12:28:47.640 INFO:tasks.workunit.client.0.smithi046.stdout:7/525: chown d16/d1a/d31/d5a/l98 1491 1 2024-04-26T12:28:47.640 INFO:tasks.workunit.client.0.smithi046.stdout:9/422: write d0/d29/f3b [4421992,84578] 0 2024-04-26T12:28:47.640 INFO:tasks.workunit.client.0.smithi046.stdout:2/449: dread d1/de/d15/d18/f4c [0,4194304] 0 2024-04-26T12:28:47.641 INFO:tasks.workunit.client.0.smithi046.stdout:1/440: link d7/d9/f18 d7/d9/d2b/f97 0 2024-04-26T12:28:47.641 INFO:tasks.workunit.client.0.smithi046.stdout:0/521: dwrite d9/dc/dd/f25 [0,4194304] 0 2024-04-26T12:28:47.642 INFO:tasks.workunit.client.0.smithi046.stdout:7/526: mknod d16/d1a/d31/d62/cb0 0 2024-04-26T12:28:47.642 INFO:tasks.workunit.client.0.smithi046.stdout:3/545: dread d2/d16/f79 [0,4194304] 0 2024-04-26T12:28:47.643 INFO:tasks.workunit.client.0.smithi046.stdout:8/572: truncate d7/d24/d50/d2a/d92/fb8 393104 0 2024-04-26T12:28:47.643 INFO:tasks.workunit.client.0.smithi046.stdout:1/441: fdatasync d7/d14/d5d/d32/d41/f93 0 2024-04-26T12:28:47.643 INFO:tasks.workunit.client.0.smithi046.stdout:7/527: chown d16/d4e/d6c/cad 538 1 2024-04-26T12:28:47.644 INFO:tasks.workunit.client.0.smithi046.stdout:7/528: fsync f6 0 2024-04-26T12:28:47.644 INFO:tasks.workunit.client.0.smithi046.stdout:1/442: readlink d7/d9/d2b/d31/l34 0 2024-04-26T12:28:47.645 INFO:tasks.workunit.client.0.smithi046.stdout:3/546: rename d2/d16/d11/d1f to d2/db0/dc4 0 2024-04-26T12:28:47.646 INFO:tasks.workunit.client.0.smithi046.stdout:6/515: dread d7/d1b/d6a/d57/f5c [0,4194304] 0 2024-04-26T12:28:47.647 INFO:tasks.workunit.client.0.smithi046.stdout:2/450: dread d1/de/d15/d18/f4c [0,4194304] 0 2024-04-26T12:28:47.647 INFO:tasks.workunit.client.0.smithi046.stdout:9/423: truncate d0/d19/f41 3571865 0 2024-04-26T12:28:47.648 INFO:tasks.workunit.client.0.smithi046.stdout:3/547: dread d2/d16/f79 [0,4194304] 0 2024-04-26T12:28:47.648 INFO:tasks.workunit.client.0.smithi046.stdout:8/573: rename d7/d24/d50/f96 to d7/dc/d27/db0/fc3 0 2024-04-26T12:28:47.649 INFO:tasks.workunit.client.0.smithi046.stdout:1/443: mkdir d7/db/d98 0 2024-04-26T12:28:47.650 INFO:tasks.workunit.client.0.smithi046.stdout:3/548: readlink d2/d16/d2c/d50/l72 0 2024-04-26T12:28:47.650 INFO:tasks.workunit.client.0.smithi046.stdout:5/533: dread d9/da/f10 [0,4194304] 0 2024-04-26T12:28:47.650 INFO:tasks.workunit.client.0.smithi046.stdout:6/516: truncate d7/d1b/d37/f42 905575 0 2024-04-26T12:28:47.650 INFO:tasks.workunit.client.0.smithi046.stdout:0/522: dwrite d9/d1d/d40/d41/f96 [0,4194304] 0 2024-04-26T12:28:47.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/444: stat d7/d12/c16 0 2024-04-26T12:28:47.651 INFO:tasks.workunit.client.0.smithi046.stdout:9/424: rename d0/d2c/d47/l48 to d0/d19/d51/l98 0 2024-04-26T12:28:47.651 INFO:tasks.workunit.client.0.smithi046.stdout:8/574: write d7/d24/d50/f2c [3051819,79824] 0 2024-04-26T12:28:47.654 INFO:tasks.workunit.client.0.smithi046.stdout:2/451: rename d1/de/d67/c69 to d1/de/d65/d8f/c97 0 2024-04-26T12:28:47.654 INFO:tasks.workunit.client.0.smithi046.stdout:6/517: mknod d7/d1b/d47/d65/d77/ca6 0 2024-04-26T12:28:47.654 INFO:tasks.workunit.client.0.smithi046.stdout:5/534: creat d9/da/dd/d5d/fbc x:0 0 0 2024-04-26T12:28:47.655 INFO:tasks.workunit.client.0.smithi046.stdout:2/452: truncate d1/f3e 885111 0 2024-04-26T12:28:47.655 INFO:tasks.workunit.client.0.smithi046.stdout:3/549: unlink d2/d16/d2c/d50/d71/d89/lb9 0 2024-04-26T12:28:47.656 INFO:tasks.workunit.client.0.smithi046.stdout:8/575: dread - d7/d24/d50/d62/f68 zero size 2024-04-26T12:28:47.656 INFO:tasks.workunit.client.0.smithi046.stdout:4/484: dread d0/d1/d5/db/f10 [0,4194304] 0 2024-04-26T12:28:47.656 INFO:tasks.workunit.client.0.smithi046.stdout:1/445: read d7/d9/f1a [496258,94267] 0 2024-04-26T12:28:47.656 INFO:tasks.workunit.client.0.smithi046.stdout:6/518: unlink d7/d1b/d47/f49 0 2024-04-26T12:28:47.657 INFO:tasks.workunit.client.0.smithi046.stdout:7/529: dwrite d16/d3f/f47 [0,4194304] 0 2024-04-26T12:28:47.657 INFO:tasks.workunit.client.0.smithi046.stdout:3/550: dread - d2/db/d62/f87 zero size 2024-04-26T12:28:47.658 INFO:tasks.workunit.client.0.smithi046.stdout:8/576: write d7/d24/d50/d2a/d39/d9d/faa [360040,116104] 0 2024-04-26T12:28:47.658 INFO:tasks.workunit.client.0.smithi046.stdout:9/425: dread d0/d2c/d47/f46 [4194304,4194304] 0 2024-04-26T12:28:47.659 INFO:tasks.workunit.client.0.smithi046.stdout:2/453: read d1/f48 [347135,66708] 0 2024-04-26T12:28:47.660 INFO:tasks.workunit.client.0.smithi046.stdout:0/523: truncate f8 2991507 0 2024-04-26T12:28:47.661 INFO:tasks.workunit.client.0.smithi046.stdout:9/426: dread - d0/f65 zero size 2024-04-26T12:28:47.661 INFO:tasks.workunit.client.0.smithi046.stdout:3/551: unlink d2/d16/d11/l33 0 2024-04-26T12:28:47.661 INFO:tasks.workunit.client.0.smithi046.stdout:1/446: creat d7/d12/f99 x:0 0 0 2024-04-26T12:28:47.661 INFO:tasks.workunit.client.0.smithi046.stdout:2/454: dread - d1/de/d65/d1b/f61 zero size 2024-04-26T12:28:47.662 INFO:tasks.workunit.client.0.smithi046.stdout:5/535: truncate d9/f73 329281 0 2024-04-26T12:28:47.662 INFO:tasks.workunit.client.0.smithi046.stdout:8/577: creat d7/dc/d1b/dae/fc4 x:0 0 0 2024-04-26T12:28:47.662 INFO:tasks.workunit.client.0.smithi046.stdout:7/530: mkdir d16/db1 0 2024-04-26T12:28:47.662 INFO:tasks.workunit.client.0.smithi046.stdout:1/447: unlink d7/d12/f22 0 2024-04-26T12:28:47.662 INFO:tasks.workunit.client.0.smithi046.stdout:7/531: sync 2024-04-26T12:28:47.663 INFO:tasks.workunit.client.0.smithi046.stdout:0/524: chown d9/dc/d4c/d62/c76 66339314 1 2024-04-26T12:28:47.665 INFO:tasks.workunit.client.0.smithi046.stdout:2/455: chown d1/de/d15/d18/d8a/f95 3930 1 2024-04-26T12:28:47.665 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:47.665 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:47.666 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:47.666 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:47.666 INFO:tasks.workunit.client.0.smithi046.stdout:8/578: read d7/d24/d50/d2a/f57 [396983,3584] 0 2024-04-26T12:28:47.666 INFO:tasks.workunit.client.0.smithi046.stdout:4/485: dwrite d0/d1/d29/f5b [0,4194304] 0 2024-04-26T12:28:47.668 INFO:tasks.workunit.client.0.smithi046.stdout:1/448: write d7/d14/d5d/d32/f56 [736992,114334] 0 2024-04-26T12:28:47.668 INFO:tasks.workunit.client.0.smithi046.stdout:6/519: dwrite d7/d1b/d6a/f5f [0,4194304] 0 2024-04-26T12:28:47.669 INFO:tasks.workunit.client.0.smithi046.stdout:8/579: dread - d7/d24/f53 zero size 2024-04-26T12:28:47.669 INFO:tasks.workunit.client.0.smithi046.stdout:2/456: chown d1/de/d65/d4a/d90/f92 2 1 2024-04-26T12:28:47.671 INFO:tasks.workunit.client.0.smithi046.stdout:4/486: write d0/d1/d29/f34 [876889,128211] 0 2024-04-26T12:28:47.671 INFO:tasks.workunit.client.0.smithi046.stdout:6/520: mkdir d7/da7 0 2024-04-26T12:28:47.671 INFO:tasks.workunit.client.0.smithi046.stdout:3/552: dwrite d2/db/d62/fa1 [0,4194304] 0 2024-04-26T12:28:47.671 INFO:tasks.workunit.client.0.smithi046.stdout:1/449: unlink d7/d9/d2b/d39/d3c/l86 0 2024-04-26T12:28:47.672 INFO:tasks.workunit.client.0.smithi046.stdout:0/525: getdents d9/dc/dd/d45/d69 0 2024-04-26T12:28:47.673 INFO:tasks.workunit.client.0.smithi046.stdout:9/427: dwrite d0/d29/d69/d88/f94 [0,4194304] 0 2024-04-26T12:28:47.674 INFO:tasks.workunit.client.0.smithi046.stdout:2/457: truncate d1/de/d15/f4e 4871392 0 2024-04-26T12:28:47.675 INFO:tasks.workunit.client.0.smithi046.stdout:1/450: unlink d7/d9/f17 0 2024-04-26T12:28:47.675 INFO:tasks.workunit.client.0.smithi046.stdout:7/532: dwrite d16/d1a/d31/d5a/f96 [0,4194304] 0 2024-04-26T12:28:47.676 INFO:tasks.workunit.client.0.smithi046.stdout:3/553: read d2/db/d4a/da9/faf [557845,70559] 0 2024-04-26T12:28:47.676 INFO:tasks.workunit.client.0.smithi046.stdout:9/428: creat d0/d19/d51/f99 x:0 0 0 2024-04-26T12:28:47.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:47.678 INFO:tasks.workunit.client.0.smithi046.stdout:0/526: dread - d9/d1d/d5d/d6b/d8a/d8c/fac zero size 2024-04-26T12:28:47.679 INFO:tasks.workunit.client.0.smithi046.stdout:4/487: creat d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/f9d x:0 0 0 2024-04-26T12:28:47.680 INFO:tasks.workunit.client.0.smithi046.stdout:5/536: dwrite d9/da/d15/fb9 [0,4194304] 0 2024-04-26T12:28:47.680 INFO:tasks.workunit.client.0.smithi046.stdout:6/521: creat d7/d1b/d6a/fa8 x:0 0 0 2024-04-26T12:28:47.682 INFO:tasks.workunit.client.0.smithi046.stdout:3/554: fdatasync d2/d16/d2c/d50/d71/d89/fba 0 2024-04-26T12:28:47.682 INFO:tasks.workunit.client.0.smithi046.stdout:7/533: write d16/d1a/d3e/d59/f92 [2296355,11622] 0 2024-04-26T12:28:47.682 INFO:tasks.workunit.client.0.smithi046.stdout:6/522: chown d7/d1b/c3a 3679 1 2024-04-26T12:28:47.682 INFO:tasks.workunit.client.0.smithi046.stdout:9/429: truncate d0/d19/f50 769821 0 2024-04-26T12:28:47.683 INFO:tasks.workunit.client.0.smithi046.stdout:5/537: read d9/da/d15/fb9 [2762526,28736] 0 2024-04-26T12:28:47.684 INFO:tasks.workunit.client.0.smithi046.stdout:8/580: dwrite d7/d24/f53 [0,4194304] 0 2024-04-26T12:28:47.685 INFO:tasks.workunit.client.0.smithi046.stdout:7/534: symlink d16/d3f/lb2 0 2024-04-26T12:28:47.686 INFO:tasks.workunit.client.0.smithi046.stdout:2/458: dwrite d1/de/f3c [0,4194304] 0 2024-04-26T12:28:47.686 INFO:tasks.workunit.client.0.smithi046.stdout:8/581: mknod d7/dc/d1b/da0/db6/cc5 0 2024-04-26T12:28:47.687 INFO:tasks.workunit.client.0.smithi046.stdout:7/535: read d16/f23 [3618902,53424] 0 2024-04-26T12:28:47.687 INFO:tasks.workunit.client.0.smithi046.stdout:3/555: rename d2/d16/d11 to d2/d16/d2c/d50/d71/d89/dc5 0 2024-04-26T12:28:47.688 INFO:tasks.workunit.client.0.smithi046.stdout:8/582: rmdir d7/d24/d50 39 2024-04-26T12:28:47.688 INFO:tasks.workunit.client.0.smithi046.stdout:2/459: mkdir d1/de/d15/d18/d98 0 2024-04-26T12:28:47.689 INFO:tasks.workunit.client.0.smithi046.stdout:7/536: write d16/d35/f3b [8637389,63880] 0 2024-04-26T12:28:47.690 INFO:tasks.workunit.client.0.smithi046.stdout:8/583: symlink d7/d1c/d74/lc6 0 2024-04-26T12:28:47.690 INFO:tasks.workunit.client.0.smithi046.stdout:0/527: dwrite d9/d1d/d40/d41/d43/f9e [4194304,4194304] 0 2024-04-26T12:28:47.690 INFO:tasks.workunit.client.0.smithi046.stdout:2/460: chown d1/c43 58585 1 2024-04-26T12:28:47.690 INFO:tasks.workunit.client.0.smithi046.stdout:7/537: mknod d16/d3f/cb3 0 2024-04-26T12:28:47.691 INFO:tasks.workunit.client.0.smithi046.stdout:2/461: fdatasync d1/de/d15/d18/f57 0 2024-04-26T12:28:47.691 INFO:tasks.workunit.client.0.smithi046.stdout:3/556: creat d2/d16/d2c/d50/d71/d89/d98/dbb/fc6 x:0 0 0 2024-04-26T12:28:47.691 INFO:tasks.workunit.client.0.smithi046.stdout:0/528: mkdir d9/d1d/d40/db3 0 2024-04-26T12:28:47.692 INFO:tasks.workunit.client.0.smithi046.stdout:3/557: rename d2/db/d4a/f3b to d2/d16/d2c/d50/fc7 0 2024-04-26T12:28:47.693 INFO:tasks.workunit.client.0.smithi046.stdout:8/584: read d7/da/d4f/f7a [261694,116418] 0 2024-04-26T12:28:47.693 INFO:tasks.workunit.client.0.smithi046.stdout:3/558: write d2/db/d4a/f86 [147487,17584] 0 2024-04-26T12:28:47.694 INFO:tasks.workunit.client.0.smithi046.stdout:0/529: creat d9/dc/d4c/fb4 x:0 0 0 2024-04-26T12:28:47.694 INFO:tasks.workunit.client.0.smithi046.stdout:2/462: mkdir d1/de/d15/d18/d98/d99 0 2024-04-26T12:28:47.694 INFO:tasks.workunit.client.0.smithi046.stdout:8/585: write d7/da/df/f2b [3182237,27026] 0 2024-04-26T12:28:47.695 INFO:tasks.workunit.client.0.smithi046.stdout:3/559: link d2/d16/f73 d2/db/d4a/fc8 0 2024-04-26T12:28:47.695 INFO:tasks.workunit.client.0.smithi046.stdout:2/463: creat d1/de/f9a x:0 0 0 2024-04-26T12:28:47.695 INFO:tasks.workunit.client.0.smithi046.stdout:8/586: creat d7/d24/d50/d2a/fc7 x:0 0 0 2024-04-26T12:28:47.696 INFO:tasks.workunit.client.0.smithi046.stdout:3/560: mkdir d2/d16/d35/dbc/dc9 0 2024-04-26T12:28:47.697 INFO:tasks.workunit.client.0.smithi046.stdout:8/587: creat d7/d24/d50/db3/fc8 x:0 0 0 2024-04-26T12:28:47.697 INFO:tasks.workunit.client.0.smithi046.stdout:8/588: fsync d7/dc/d1b/f93 0 2024-04-26T12:28:47.697 INFO:tasks.workunit.client.0.smithi046.stdout:3/561: creat d2/d16/d2c/d50/d71/d89/d98/dbb/fca x:0 0 0 2024-04-26T12:28:47.698 INFO:tasks.workunit.client.0.smithi046.stdout:8/589: write d7/f4a [3436262,83616] 0 2024-04-26T12:28:47.698 INFO:tasks.workunit.client.0.smithi046.stdout:1/451: read d7/d9/d2b/f40 [95954,65568] 0 2024-04-26T12:28:47.699 INFO:tasks.workunit.client.0.smithi046.stdout:8/590: fsync d7/dc/d1b/dae/fc4 0 2024-04-26T12:28:47.700 INFO:tasks.workunit.client.0.smithi046.stdout:3/562: mknod d2/d16/d2c/d50/d71/d89/dc5/d82/ccb 0 2024-04-26T12:28:47.700 INFO:tasks.workunit.client.0.smithi046.stdout:8/591: dread - d7/d24/d50/db3/fc8 zero size 2024-04-26T12:28:47.700 INFO:tasks.workunit.client.0.smithi046.stdout:1/452: creat d7/d14/d5d/f9a x:0 0 0 2024-04-26T12:28:47.701 INFO:tasks.workunit.client.0.smithi046.stdout:3/563: creat d2/d16/d35/fcc x:0 0 0 2024-04-26T12:28:47.701 INFO:tasks.workunit.client.0.smithi046.stdout:8/592: write d7/d24/d50/d62/f84 [838884,37050] 0 2024-04-26T12:28:47.701 INFO:tasks.workunit.client.0.smithi046.stdout:5/538: fdatasync d9/da/d15/fb9 0 2024-04-26T12:28:47.702 INFO:tasks.workunit.client.0.smithi046.stdout:8/593: write d7/dc/d1b/f93 [919245,20129] 0 2024-04-26T12:28:47.703 INFO:tasks.workunit.client.0.smithi046.stdout:3/564: truncate d2/db/d4a/da9/fbd 2755689 0 2024-04-26T12:28:47.703 INFO:tasks.workunit.client.0.smithi046.stdout:5/539: creat d9/da/dd/d34/d44/d88/d90/fbd x:0 0 0 2024-04-26T12:28:47.703 INFO:tasks.workunit.client.0.smithi046.stdout:3/565: creat d2/db0/fcd x:0 0 0 2024-04-26T12:28:47.704 INFO:tasks.workunit.client.0.smithi046.stdout:8/594: write d7/d24/d50/d62/f7e [2717929,79131] 0 2024-04-26T12:28:47.704 INFO:tasks.workunit.client.0.smithi046.stdout:3/566: dread - d2/d16/f4f zero size 2024-04-26T12:28:47.705 INFO:tasks.workunit.client.0.smithi046.stdout:5/540: getdents d9/da/dd/d69/db0 0 2024-04-26T12:28:47.706 INFO:tasks.workunit.client.0.smithi046.stdout:3/567: mkdir d2/d16/d2c/d50/d71/d89/d98/dce 0 2024-04-26T12:28:47.707 INFO:tasks.workunit.client.0.smithi046.stdout:5/541: link d9/da/dd/c12 d9/da/dd/d69/db0/cbe 0 2024-04-26T12:28:47.708 INFO:tasks.workunit.client.0.smithi046.stdout:3/568: rename d2/d16/f79 to d2/d16/d2c/d50/d71/fcf 0 2024-04-26T12:28:47.709 INFO:tasks.workunit.client.0.smithi046.stdout:5/542: creat d9/da/d18/d7d/da7/fbf x:0 0 0 2024-04-26T12:28:47.709 INFO:tasks.workunit.client.0.smithi046.stdout:8/595: dwrite d7/dc/f45 [0,4194304] 0 2024-04-26T12:28:47.710 INFO:tasks.workunit.client.0.smithi046.stdout:3/569: rename d2/d97 to d2/d16/d35/dbc/dc9/dd0 0 2024-04-26T12:28:47.710 INFO:tasks.workunit.client.0.smithi046.stdout:5/543: fdatasync d9/da/d18/f77 0 2024-04-26T12:28:47.711 INFO:tasks.workunit.client.0.smithi046.stdout:8/596: mknod d7/d24/d50/d2a/d92/cc9 0 2024-04-26T12:28:47.712 INFO:tasks.workunit.client.0.smithi046.stdout:8/597: fsync d7/da/df/f8d 0 2024-04-26T12:28:47.712 INFO:tasks.workunit.client.0.smithi046.stdout:5/544: symlink d9/da/dd/d69/db0/lc0 0 2024-04-26T12:28:47.713 INFO:tasks.workunit.client.0.smithi046.stdout:3/570: symlink d2/d16/d2c/d50/d71/d89/dc5/d1b/ld1 0 2024-04-26T12:28:47.713 INFO:tasks.workunit.client.0.smithi046.stdout:8/598: chown d7/da/fa9 963 1 2024-04-26T12:28:47.715 INFO:tasks.workunit.client.0.smithi046.stdout:3/571: rename d2/d16/d2c/d50/d71/d89/dc5/d6d/ca6 to d2/d16/d2c/d50/cd2 0 2024-04-26T12:28:47.716 INFO:tasks.workunit.client.0.smithi046.stdout:2/464: dread d1/de/d65/d4a/f4d [0,4194304] 0 2024-04-26T12:28:47.716 INFO:tasks.workunit.client.0.smithi046.stdout:0/530: dread d9/dc/f1c [0,4194304] 0 2024-04-26T12:28:47.716 INFO:tasks.workunit.client.0.smithi046.stdout:3/572: mkdir d2/d16/d35/dbc/dc9/dd3 0 2024-04-26T12:28:47.717 INFO:tasks.workunit.client.0.smithi046.stdout:0/531: mkdir d9/db5 0 2024-04-26T12:28:47.718 INFO:tasks.workunit.client.0.smithi046.stdout:8/599: dread d7/d24/d50/d62/f84 [0,4194304] 0 2024-04-26T12:28:47.718 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:47.717+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:47.719 INFO:tasks.workunit.client.0.smithi046.stdout:0/532: symlink d9/d1d/d40/lb6 0 2024-04-26T12:28:47.719 INFO:tasks.workunit.client.0.smithi046.stdout:3/573: rename d2/d16/l5d to d2/d16/d2c/d50/d71/d89/dc5/d6d/ld4 0 2024-04-26T12:28:47.719 INFO:tasks.workunit.client.0.smithi046.stdout:5/545: dwrite d9/da/d18/f24 [0,4194304] 0 2024-04-26T12:28:47.719 INFO:tasks.workunit.client.0.smithi046.stdout:8/600: dread - d7/d24/d50/d2a/d39/fa8 zero size 2024-04-26T12:28:47.721 INFO:tasks.workunit.client.0.smithi046.stdout:5/546: creat d9/da/dd/d69/db0/fc1 x:0 0 0 2024-04-26T12:28:47.721 INFO:tasks.workunit.client.0.smithi046.stdout:8/601: mknod d7/da/d4f/d7f/cca 0 2024-04-26T12:28:47.721 INFO:tasks.workunit.client.0.smithi046.stdout:5/547: stat d9/da/d18/d7d/l52 0 2024-04-26T12:28:47.722 INFO:tasks.workunit.client.0.smithi046.stdout:8/602: creat d7/dc/d1b/da0/fcb x:0 0 0 2024-04-26T12:28:47.722 INFO:tasks.workunit.client.0.smithi046.stdout:4/488: dread d0/da/d17/d20/d25/f33 [0,4194304] 0 2024-04-26T12:28:47.722 INFO:tasks.workunit.client.0.smithi046.stdout:5/548: creat d9/da/dd/d34/d44/d97/da4/fc2 x:0 0 0 2024-04-26T12:28:47.722 INFO:tasks.workunit.client.0.smithi046.stdout:3/574: write d2/d16/f73 [2829043,48499] 0 2024-04-26T12:28:47.723 INFO:tasks.workunit.client.0.smithi046.stdout:8/603: write d7/dc/f17 [3994674,23208] 0 2024-04-26T12:28:47.724 INFO:tasks.workunit.client.0.smithi046.stdout:4/489: write d0/da/d17/f46 [6910909,38403] 0 2024-04-26T12:28:47.726 INFO:tasks.workunit.client.0.smithi046.stdout:9/430: dread d0/d19/d21/f4a [0,4194304] 0 2024-04-26T12:28:47.727 INFO:tasks.workunit.client.0.smithi046.stdout:9/431: readlink d0/d19/l96 0 2024-04-26T12:28:47.727 INFO:tasks.workunit.client.0.smithi046.stdout:0/533: dwrite d9/dc/dd/f27 [0,4194304] 0 2024-04-26T12:28:47.727 INFO:tasks.workunit.client.0.smithi046.stdout:3/575: getdents d2/d16/d35/dbc/dc9 0 2024-04-26T12:28:47.728 INFO:tasks.workunit.client.0.smithi046.stdout:8/604: getdents d7/d24/d50/d2a/d39/d9d 0 2024-04-26T12:28:47.729 INFO:tasks.workunit.client.0.smithi046.stdout:7/538: dread d16/f20 [0,4194304] 0 2024-04-26T12:28:47.730 INFO:tasks.workunit.client.0.smithi046.stdout:5/549: dwrite d9/da/dd/d34/d45/f53 [0,4194304] 0 2024-04-26T12:28:47.730 INFO:tasks.workunit.client.0.smithi046.stdout:3/576: write d2/d16/d35/dbc/dc9/dd0/fb4 [737539,103423] 0 2024-04-26T12:28:47.730 INFO:tasks.workunit.client.0.smithi046.stdout:8/605: creat d7/dc/d1b/da0/db6/fcc x:0 0 0 2024-04-26T12:28:47.730 INFO:tasks.workunit.client.0.smithi046.stdout:7/539: symlink d16/d1a/d69/lb4 0 2024-04-26T12:28:47.731 INFO:tasks.workunit.client.0.smithi046.stdout:5/550: fdatasync d9/da/dd/d34/faf 0 2024-04-26T12:28:47.732 INFO:tasks.workunit.client.0.smithi046.stdout:8/606: write d7/d24/d50/d2a/f42 [251761,28262] 0 2024-04-26T12:28:47.732 INFO:tasks.workunit.client.0.smithi046.stdout:3/577: creat d2/fd5 x:0 0 0 2024-04-26T12:28:47.733 INFO:tasks.workunit.client.0.smithi046.stdout:4/490: dwrite d0/da/d17/d20/d25/d35/f65 [0,4194304] 0 2024-04-26T12:28:47.734 INFO:tasks.workunit.client.0.smithi046.stdout:0/534: truncate d9/d1d/d5d/d6b/f89 4153751 0 2024-04-26T12:28:47.734 INFO:tasks.workunit.client.0.smithi046.stdout:8/607: mknod d7/dc/d1b/da0/db6/ccd 0 2024-04-26T12:28:47.736 INFO:tasks.workunit.client.0.smithi046.stdout:0/535: rmdir d9/dc/d2a 39 2024-04-26T12:28:47.736 INFO:tasks.workunit.client.0.smithi046.stdout:4/491: fdatasync d0/da/d17/d20/d25/d35/d6d/d19/f4a 0 2024-04-26T12:28:47.737 INFO:tasks.workunit.client.0.smithi046.stdout:4/492: readlink d0/d1/d29/l77 0 2024-04-26T12:28:47.738 INFO:tasks.workunit.client.0.smithi046.stdout:5/551: read d9/da/f1b [841408,77069] 0 2024-04-26T12:28:47.740 INFO:tasks.workunit.client.0.smithi046.stdout:7/540: dwrite d16/d1a/d3e/d59/f92 [0,4194304] 0 2024-04-26T12:28:47.741 INFO:tasks.workunit.client.0.smithi046.stdout:4/493: write d0/da/d17/d20/f7f [413203,86755] 0 2024-04-26T12:28:47.741 INFO:tasks.workunit.client.0.smithi046.stdout:5/552: chown d9/da/dd/d34/d6b 2073824080 1 2024-04-26T12:28:47.743 INFO:tasks.workunit.client.0.smithi046.stdout:7/541: creat d16/db1/fb5 x:0 0 0 2024-04-26T12:28:47.743 INFO:tasks.workunit.client.0.smithi046.stdout:4/494: chown d0/d1/d5/c7 25378 1 2024-04-26T12:28:47.743 INFO:tasks.workunit.client.0.smithi046.stdout:0/536: dwrite d9/dc/dd/d45/d69/fa7 [0,4194304] 0 2024-04-26T12:28:47.744 INFO:tasks.workunit.client.0.smithi046.stdout:8/608: dwrite d7/f55 [0,4194304] 0 2024-04-26T12:28:47.745 INFO:tasks.workunit.client.0.smithi046.stdout:7/542: fsync d16/d1a/d3e/d4f/f71 0 2024-04-26T12:28:47.745 INFO:tasks.workunit.client.0.smithi046.stdout:0/537: mknod d9/d1d/d40/d41/d43/cb7 0 2024-04-26T12:28:47.746 INFO:tasks.workunit.client.0.smithi046.stdout:5/553: rename d9/da/dd/d69/db0/cbe to d9/da/d15/cc3 0 2024-04-26T12:28:47.747 INFO:tasks.workunit.client.0.smithi046.stdout:8/609: truncate d7/d24/d50/d2a/f57 1225094 0 2024-04-26T12:28:47.747 INFO:tasks.workunit.client.0.smithi046.stdout:0/538: creat d9/d1d/d40/d41/d7e/fb8 x:0 0 0 2024-04-26T12:28:47.747 INFO:tasks.workunit.client.0.smithi046.stdout:7/543: rename d16/la9 to d16/d1a/d69/lb6 0 2024-04-26T12:28:47.748 INFO:tasks.workunit.client.0.smithi046.stdout:5/554: mknod d9/da/dd/d34/cc4 0 2024-04-26T12:28:47.748 INFO:tasks.workunit.client.0.smithi046.stdout:0/539: mkdir d9/dc/db9 0 2024-04-26T12:28:47.748 INFO:tasks.workunit.client.0.smithi046.stdout:5/555: dread - d9/da/d18/d8b/f96 zero size 2024-04-26T12:28:47.749 INFO:tasks.workunit.client.0.smithi046.stdout:8/610: rename d7/d24/d50/d2a/d92/ca3 to d7/dc/d27/db0/cce 0 2024-04-26T12:28:47.749 INFO:tasks.workunit.client.0.smithi046.stdout:5/556: creat d9/da/d18/d8b/fc5 x:0 0 0 2024-04-26T12:28:47.750 INFO:tasks.workunit.client.0.smithi046.stdout:7/544: rename d16/d1a/l72 to d16/d1a/d31/d55/d6d/d89/lb7 0 2024-04-26T12:28:47.750 INFO:tasks.workunit.client.0.smithi046.stdout:7/545: rmdir d16/d1a/d69 39 2024-04-26T12:28:47.752 INFO:tasks.workunit.client.0.smithi046.stdout:7/546: mknod d16/d27/d51/d9c/cb8 0 2024-04-26T12:28:47.752 INFO:tasks.workunit.client.0.smithi046.stdout:5/557: creat d9/da/dd/d34/d44/d97/da4/d35/fc6 x:0 0 0 2024-04-26T12:28:47.752 INFO:tasks.workunit.client.0.smithi046.stdout:7/547: write d16/d35/f5d [74715,32150] 0 2024-04-26T12:28:47.753 INFO:tasks.workunit.client.0.smithi046.stdout:7/548: stat d16/d1a/d31/d5a/c22 0 2024-04-26T12:28:47.754 INFO:tasks.workunit.client.0.smithi046.stdout:5/558: rename d9/da/d15/l1f to d9/da/dd/d34/d44/d88/lc7 0 2024-04-26T12:28:47.755 INFO:tasks.workunit.client.0.smithi046.stdout:5/559: rmdir d9/da/d40 39 2024-04-26T12:28:47.755 INFO:tasks.workunit.client.0.smithi046.stdout:8/611: dwrite d7/d24/d50/f77 [0,4194304] 0 2024-04-26T12:28:47.757 INFO:tasks.workunit.client.0.smithi046.stdout:5/560: creat d9/da/dd/d69/db0/db6/fc8 x:0 0 0 2024-04-26T12:28:47.757 INFO:tasks.workunit.client.0.smithi046.stdout:5/561: stat d9/da/dd/d34/d3e/f76 0 2024-04-26T12:28:47.759 INFO:tasks.workunit.client.0.smithi046.stdout:7/549: dwrite d16/d1a/d31/f70 [4194304,4194304] 0 2024-04-26T12:28:47.759 INFO:tasks.workunit.client.0.smithi046.stdout:5/562: fsync d9/da/f10 0 2024-04-26T12:28:47.761 INFO:tasks.workunit.client.0.smithi046.stdout:8/612: dwrite d7/dc/d1b/da0/fcb [0,4194304] 0 2024-04-26T12:28:47.765 INFO:tasks.workunit.client.0.smithi046.stdout:7/550: read d16/d1a/d31/d5a/f3d [5294010,19239] 0 2024-04-26T12:28:47.766 INFO:tasks.workunit.client.0.smithi046.stdout:7/551: mknod d16/d1a/d31/d55/d6d/d89/cb9 0 2024-04-26T12:28:47.768 INFO:tasks.workunit.client.0.smithi046.stdout:7/552: write d16/d27/d51/f63 [1116880,28457] 0 2024-04-26T12:28:47.768 INFO:tasks.workunit.client.0.smithi046.stdout:7/553: mkdir d16/dba 0 2024-04-26T12:28:47.769 INFO:tasks.workunit.client.0.smithi046.stdout:7/554: mkdir d16/d35/dac/dbb 0 2024-04-26T12:28:47.771 INFO:tasks.workunit.client.0.smithi046.stdout:6/523: sync 2024-04-26T12:28:47.771 INFO:tasks.workunit.client.0.smithi046.stdout:1/453: sync 2024-04-26T12:28:47.771 INFO:tasks.workunit.client.0.smithi046.stdout:2/465: sync 2024-04-26T12:28:47.771 INFO:tasks.workunit.client.0.smithi046.stdout:9/432: sync 2024-04-26T12:28:47.771 INFO:tasks.workunit.client.0.smithi046.stdout:7/555: read d16/d1a/d31/d5a/f3d [8184101,109605] 0 2024-04-26T12:28:47.771 INFO:tasks.workunit.client.0.smithi046.stdout:3/578: sync 2024-04-26T12:28:47.772 INFO:tasks.workunit.client.0.smithi046.stdout:6/524: readlink d7/l7a 0 2024-04-26T12:28:47.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/613: dread d7/dc/d1b/f8c [0,4194304] 0 2024-04-26T12:28:47.772 INFO:tasks.workunit.client.0.smithi046.stdout:9/433: readlink d0/d16/l1c 0 2024-04-26T12:28:47.772 INFO:tasks.workunit.client.0.smithi046.stdout:1/454: read d7/d9/f11 [789800,128594] 0 2024-04-26T12:28:47.773 INFO:tasks.workunit.client.0.smithi046.stdout:7/556: fdatasync d16/d1a/d31/d4d/f77 0 2024-04-26T12:28:47.773 INFO:tasks.workunit.client.0.smithi046.stdout:9/434: rmdir d0/d16/d5f 39 2024-04-26T12:28:47.773 INFO:tasks.workunit.client.0.smithi046.stdout:3/579: getdents d2/d16/d2c 0 2024-04-26T12:28:47.774 INFO:tasks.workunit.client.0.smithi046.stdout:1/455: readlink d7/d14/d5d/d32/l35 0 2024-04-26T12:28:47.774 INFO:tasks.workunit.client.0.smithi046.stdout:8/614: mkdir d7/dc/d1b/dae/dcf 0 2024-04-26T12:28:47.774 INFO:tasks.workunit.client.0.smithi046.stdout:9/435: fsync d0/d19/f6d 0 2024-04-26T12:28:47.774 INFO:tasks.workunit.client.0.smithi046.stdout:7/557: truncate d16/d1a/d3e/d4f/f71 773151 0 2024-04-26T12:28:47.775 INFO:tasks.workunit.client.0.smithi046.stdout:9/436: creat d0/f9a x:0 0 0 2024-04-26T12:28:47.775 INFO:tasks.workunit.client.0.smithi046.stdout:3/580: write d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/f56 [2858984,9612] 0 2024-04-26T12:28:47.776 INFO:tasks.workunit.client.0.smithi046.stdout:7/558: rename d16/d35/dac/f87 to d16/d27/d51/d9c/fbc 0 2024-04-26T12:28:47.777 INFO:tasks.workunit.client.0.smithi046.stdout:0/540: dread d9/d1d/d40/d41/f7c [0,4194304] 0 2024-04-26T12:28:47.777 INFO:tasks.workunit.client.0.smithi046.stdout:9/437: mkdir d0/d16/d5f/d9b 0 2024-04-26T12:28:47.778 INFO:tasks.workunit.client.0.smithi046.stdout:6/525: dwrite d7/fe [4194304,4194304] 0 2024-04-26T12:28:47.778 INFO:tasks.workunit.client.0.smithi046.stdout:7/559: symlink d16/d4e/lbd 0 2024-04-26T12:28:47.778 INFO:tasks.workunit.client.0.smithi046.stdout:9/438: write d0/f8a [409537,27587] 0 2024-04-26T12:28:47.780 INFO:tasks.workunit.client.0.smithi046.stdout:7/560: write d16/d1a/d31/d4d/f77 [661164,45954] 0 2024-04-26T12:28:47.780 INFO:tasks.workunit.client.0.smithi046.stdout:6/526: rmdir d7/d1b/d6a/d57 39 2024-04-26T12:28:47.781 INFO:tasks.workunit.client.0.smithi046.stdout:9/439: write d0/d2c/d3d/f5c [4135520,41400] 0 2024-04-26T12:28:47.782 INFO:tasks.workunit.client.0.smithi046.stdout:1/456: write d7/d12/d3a/f43 [2620426,114545] 0 2024-04-26T12:28:47.783 INFO:tasks.workunit.client.0.smithi046.stdout:3/581: dwrite d2/db/d62/fa1 [4194304,4194304] 0 2024-04-26T12:28:47.784 INFO:tasks.workunit.client.0.smithi046.stdout:3/582: stat d2/db/d62/fac 0 2024-04-26T12:28:47.784 INFO:tasks.workunit.client.0.smithi046.stdout:9/440: creat d0/d16/d76/d7d/d72/d85/d97/f9c x:0 0 0 2024-04-26T12:28:47.784 INFO:tasks.workunit.client.0.smithi046.stdout:8/615: dread d7/d1c/f8b [0,4194304] 0 2024-04-26T12:28:47.784 INFO:tasks.workunit.client.0.smithi046.stdout:1/457: fsync d7/d12/d3a/f4a 0 2024-04-26T12:28:47.785 INFO:tasks.workunit.client.0.smithi046.stdout:7/561: dread d16/d1a/d31/d62/f88 [0,4194304] 0 2024-04-26T12:28:47.786 INFO:tasks.workunit.client.0.smithi046.stdout:8/616: unlink d7/da/d4f/d7f/cca 0 2024-04-26T12:28:47.786 INFO:tasks.workunit.client.0.smithi046.stdout:9/441: rename d0/d2c/l82 to d0/d29/d69/l9d 0 2024-04-26T12:28:47.786 INFO:tasks.workunit.client.0.smithi046.stdout:7/562: chown d16/d1a/d3e/c56 0 1 2024-04-26T12:28:47.786 INFO:tasks.workunit.client.0.smithi046.stdout:3/583: rmdir d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d 39 2024-04-26T12:28:47.787 INFO:tasks.workunit.client.0.smithi046.stdout:9/442: chown d0/d2c/d47/f1a 0 1 2024-04-26T12:28:47.787 INFO:tasks.workunit.client.0.smithi046.stdout:3/584: dread - d2/d16/f4f zero size 2024-04-26T12:28:47.787 INFO:tasks.workunit.client.0.smithi046.stdout:9/443: unlink d0/d2c/f55 0 2024-04-26T12:28:47.788 INFO:tasks.workunit.client.0.smithi046.stdout:3/585: fsync d2/db/f2b 0 2024-04-26T12:28:47.789 INFO:tasks.workunit.client.0.smithi046.stdout:3/586: mknod d2/cd6 0 2024-04-26T12:28:47.789 INFO:tasks.workunit.client.0.smithi046.stdout:3/587: chown d2/db/d62/l93 102180 1 2024-04-26T12:28:47.789 INFO:tasks.workunit.client.0.smithi046.stdout:5/563: dread d9/f29 [0,4194304] 0 2024-04-26T12:28:47.790 INFO:tasks.workunit.client.0.smithi046.stdout:7/563: truncate d16/d1a/f53 1144210 0 2024-04-26T12:28:47.790 INFO:tasks.workunit.client.0.smithi046.stdout:5/564: chown d9/da/l2f 48953251 1 2024-04-26T12:28:47.790 INFO:tasks.workunit.client.0.smithi046.stdout:3/588: chown d2/d16/d2c/d50/d71/d89/dc5/d82/cb7 41937 1 2024-04-26T12:28:47.791 INFO:tasks.workunit.client.0.smithi046.stdout:7/564: rename d16/d27/l2e to d16/d4e/lbe 0 2024-04-26T12:28:47.791 INFO:tasks.workunit.client.0.smithi046.stdout:3/589: unlink d2/db/d62/fa1 0 2024-04-26T12:28:47.795 INFO:tasks.workunit.client.0.smithi046.stdout:5/565: dwrite d9/da/d18/f24 [4194304,4194304] 0 2024-04-26T12:28:47.796 INFO:tasks.workunit.client.0.smithi046.stdout:5/566: creat d9/da/dd/d69/db0/db6/fc9 x:0 0 0 2024-04-26T12:28:47.802 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:47.801+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:47.805 INFO:tasks.workunit.client.0.smithi046.stdout:6/527: dread d7/d2b/d31/f43 [0,4194304] 0 2024-04-26T12:28:47.806 INFO:tasks.workunit.client.0.smithi046.stdout:6/528: link d7/d2b/d31/c9c d7/d1b/d47/d65/d77/ca9 0 2024-04-26T12:28:47.807 INFO:tasks.workunit.client.0.smithi046.stdout:0/541: dread d9/d1d/d40/f6e [0,4194304] 0 2024-04-26T12:28:47.807 INFO:tasks.workunit.client.0.smithi046.stdout:9/444: dread d0/d19/d21/f53 [0,4194304] 0 2024-04-26T12:28:47.807 INFO:tasks.workunit.client.0.smithi046.stdout:6/529: mkdir d7/d1b/d37/daa 0 2024-04-26T12:28:47.808 INFO:tasks.workunit.client.0.smithi046.stdout:9/445: chown d0/d16 29086826 1 2024-04-26T12:28:47.808 INFO:tasks.workunit.client.0.smithi046.stdout:9/446: dread - d0/d19/f6d zero size 2024-04-26T12:28:47.808 INFO:tasks.workunit.client.0.smithi046.stdout:0/542: mknod d9/d1d/d5d/d6b/d8a/cba 0 2024-04-26T12:28:47.808 INFO:tasks.workunit.client.0.smithi046.stdout:6/530: rename l4 to d7/d1b/lab 0 2024-04-26T12:28:47.810 INFO:tasks.workunit.client.0.smithi046.stdout:6/531: write d7/d1b/d6a/f5a [537456,35833] 0 2024-04-26T12:28:47.811 INFO:tasks.workunit.client.0.smithi046.stdout:6/532: chown d7/d16/f1c 244 1 2024-04-26T12:28:47.812 INFO:tasks.workunit.client.0.smithi046.stdout:5/567: dread d9/da/dd/d34/d44/f7c [0,4194304] 0 2024-04-26T12:28:47.813 INFO:tasks.workunit.client.0.smithi046.stdout:5/568: readlink d9/da/l2f 0 2024-04-26T12:28:47.813 INFO:tasks.workunit.client.0.smithi046.stdout:0/543: dread d9/dc/dd/f27 [0,4194304] 0 2024-04-26T12:28:47.814 INFO:tasks.workunit.client.0.smithi046.stdout:8/617: dread d7/dc/f18 [0,4194304] 0 2024-04-26T12:28:47.814 INFO:tasks.workunit.client.0.smithi046.stdout:9/447: dwrite d0/d2c/d3d/d52/f5a [0,4194304] 0 2024-04-26T12:28:47.814 INFO:tasks.workunit.client.0.smithi046.stdout:5/569: fdatasync d9/da/d40/f6d 0 2024-04-26T12:28:47.815 INFO:tasks.workunit.client.0.smithi046.stdout:0/544: symlink d9/db5/lbb 0 2024-04-26T12:28:47.815 INFO:tasks.workunit.client.0.smithi046.stdout:8/618: fdatasync d7/dc/d1b/f79 0 2024-04-26T12:28:47.815 INFO:tasks.workunit.client.0.smithi046.stdout:9/448: symlink d0/d16/l9e 0 2024-04-26T12:28:47.816 INFO:tasks.workunit.client.0.smithi046.stdout:5/570: mkdir d9/da/dd/d69/d7e/dca 0 2024-04-26T12:28:47.816 INFO:tasks.workunit.client.0.smithi046.stdout:0/545: creat d9/fbc x:0 0 0 2024-04-26T12:28:47.816 INFO:tasks.workunit.client.0.smithi046.stdout:9/449: creat d0/d2c/f9f x:0 0 0 2024-04-26T12:28:47.817 INFO:tasks.workunit.client.0.smithi046.stdout:9/450: write d0/d16/d5f/f64 [104907,105007] 0 2024-04-26T12:28:47.819 INFO:tasks.workunit.client.0.smithi046.stdout:5/571: creat d9/da/dd/d34/fcb x:0 0 0 2024-04-26T12:28:47.819 INFO:tasks.workunit.client.0.smithi046.stdout:0/546: rename d9/dc/d4c to d9/d1d/d40/d41/d7e/da5/dad/dbd 0 2024-04-26T12:28:47.820 INFO:tasks.workunit.client.0.smithi046.stdout:9/451: link d0/d16/c25 d0/d29/d69/ca0 0 2024-04-26T12:28:47.820 INFO:tasks.workunit.client.0.smithi046.stdout:5/572: creat d9/da/dd/d34/d45/fcc x:0 0 0 2024-04-26T12:28:47.820 INFO:tasks.workunit.client.0.smithi046.stdout:0/547: write d9/d1d/d40/f94 [8906,45144] 0 2024-04-26T12:28:47.821 INFO:tasks.workunit.client.0.smithi046.stdout:6/533: dread d7/d1b/d37/f3b [0,4194304] 0 2024-04-26T12:28:47.822 INFO:tasks.workunit.client.0.smithi046.stdout:5/573: getdents d9/da/dd/d34/d44/d97/da4/d35 0 2024-04-26T12:28:47.823 INFO:tasks.workunit.client.0.smithi046.stdout:6/534: fdatasync d7/d1b/d6a/d57/f75 0 2024-04-26T12:28:47.825 INFO:tasks.workunit.client.0.smithi046.stdout:0/548: dread d9/d1d/d40/d41/f7c [0,4194304] 0 2024-04-26T12:28:47.828 INFO:tasks.workunit.client.0.smithi046.stdout:5/574: write d9/da/dd/d34/d44/d97/da4/f92 [1354178,3737] 0 2024-04-26T12:28:47.828 INFO:tasks.workunit.client.0.smithi046.stdout:7/565: dread d16/d1a/d31/d55/f65 [0,4194304] 0 2024-04-26T12:28:47.828 INFO:tasks.workunit.client.0.smithi046.stdout:5/575: stat d9/da/dd/d34/d3e 0 2024-04-26T12:28:47.829 INFO:tasks.workunit.client.0.smithi046.stdout:9/452: dwrite d0/d29/f3b [0,4194304] 0 2024-04-26T12:28:47.830 INFO:tasks.workunit.client.0.smithi046.stdout:5/576: write d9/da/dd/d34/d44/d97/da4/fc2 [824356,48894] 0 2024-04-26T12:28:47.831 INFO:tasks.workunit.client.0.smithi046.stdout:7/566: truncate d16/d1a/d31/d5a/f2a 4210346 0 2024-04-26T12:28:47.832 INFO:tasks.workunit.client.0.smithi046.stdout:9/453: mkdir d0/d16/d76/d7d/d72/da1 0 2024-04-26T12:28:47.832 INFO:tasks.workunit.client.0.smithi046.stdout:5/577: write d9/da/dd/d5d/fbc [67737,111493] 0 2024-04-26T12:28:47.833 INFO:tasks.workunit.client.0.smithi046.stdout:6/535: dwrite d7/d2b/d31/f80 [0,4194304] 0 2024-04-26T12:28:47.834 INFO:tasks.workunit.client.0.smithi046.stdout:7/567: write d16/d1a/d31/d5a/f5b [1319815,13693] 0 2024-04-26T12:28:47.835 INFO:tasks.workunit.client.0.smithi046.stdout:2/466: sync 2024-04-26T12:28:47.835 INFO:tasks.workunit.client.0.smithi046.stdout:4/495: sync 2024-04-26T12:28:47.835 INFO:tasks.workunit.client.0.smithi046.stdout:9/454: dread d0/d2c/d47/f1f [0,4194304] 0 2024-04-26T12:28:47.835 INFO:tasks.workunit.client.0.smithi046.stdout:5/578: truncate d9/da/dd/d34/f6f 5164808 0 2024-04-26T12:28:47.835 INFO:tasks.workunit.client.0.smithi046.stdout:0/549: dwrite d9/dc/f42 [0,4194304] 0 2024-04-26T12:28:47.837 INFO:tasks.workunit.client.0.smithi046.stdout:2/467: chown d1/c51 252 1 2024-04-26T12:28:47.837 INFO:tasks.workunit.client.0.smithi046.stdout:8/619: dread d7/dc/f17 [0,4194304] 0 2024-04-26T12:28:47.837 INFO:tasks.workunit.client.0.smithi046.stdout:9/455: read d0/d29/f3b [4076646,89785] 0 2024-04-26T12:28:47.837 INFO:tasks.workunit.client.0.smithi046.stdout:7/568: write d16/d3f/f47 [1568784,104714] 0 2024-04-26T12:28:47.837 INFO:tasks.workunit.client.0.smithi046.stdout:6/536: mknod d7/d1b/d47/d65/da3/cac 0 2024-04-26T12:28:47.837 INFO:tasks.workunit.client.0.smithi046.stdout:5/579: chown d9/da/l58 249515 1 2024-04-26T12:28:47.837 INFO:tasks.workunit.client.0.smithi046.stdout:0/550: stat d9/dc/dd/f25 0 2024-04-26T12:28:47.838 INFO:tasks.workunit.client.0.smithi046.stdout:8/620: fdatasync d7/dc/f13 0 2024-04-26T12:28:47.838 INFO:tasks.workunit.client.0.smithi046.stdout:7/569: mknod d16/d3f/cbf 0 2024-04-26T12:28:47.838 INFO:tasks.workunit.client.0.smithi046.stdout:2/468: creat d1/de/d15/d18/f9b x:0 0 0 2024-04-26T12:28:47.838 INFO:tasks.workunit.client.0.smithi046.stdout:4/496: fdatasync d0/da/d17/d20/d25/d35/d6d/d19/d53/f62 0 2024-04-26T12:28:47.839 INFO:tasks.workunit.client.0.smithi046.stdout:7/570: dread - d16/d1a/d31/d4d/fa5 zero size 2024-04-26T12:28:47.839 INFO:tasks.workunit.client.0.smithi046.stdout:5/580: rename d9/da/dd/f60 to d9/da/dd/d34/d44/fcd 0 2024-04-26T12:28:47.840 INFO:tasks.workunit.client.0.smithi046.stdout:4/497: creat d0/d1/d29/f9e x:0 0 0 2024-04-26T12:28:47.840 INFO:tasks.workunit.client.0.smithi046.stdout:7/571: mkdir d16/db1/dc0 0 2024-04-26T12:28:47.840 INFO:tasks.workunit.client.0.smithi046.stdout:6/537: truncate d7/d2b/d31/f2e 2335998 0 2024-04-26T12:28:47.841 INFO:tasks.workunit.client.0.smithi046.stdout:7/572: creat d16/d3f/d81/fc1 x:0 0 0 2024-04-26T12:28:47.842 INFO:tasks.workunit.client.0.smithi046.stdout:4/498: mknod d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/c9f 0 2024-04-26T12:28:47.843 INFO:tasks.workunit.client.0.smithi046.stdout:4/499: symlink d0/da/la0 0 2024-04-26T12:28:47.844 INFO:tasks.workunit.client.0.smithi046.stdout:7/573: link d16/d3f/cbf d16/d1a/d31/cc2 0 2024-04-26T12:28:47.844 INFO:tasks.workunit.client.0.smithi046.stdout:8/621: dwrite d7/d24/d50/d62/f84 [0,4194304] 0 2024-04-26T12:28:47.845 INFO:tasks.workunit.client.0.smithi046.stdout:8/622: mknod d7/dc/d1b/da0/cd0 0 2024-04-26T12:28:47.846 INFO:tasks.workunit.client.0.smithi046.stdout:7/574: rename d16/d1a/d31/d5a/c22 to d16/d1a/d69/cc3 0 2024-04-26T12:28:47.846 INFO:tasks.workunit.client.0.smithi046.stdout:5/581: dwrite d9/da/dd/d34/f6f [4194304,4194304] 0 2024-04-26T12:28:47.846 INFO:tasks.workunit.client.0.smithi046.stdout:7/575: chown d16/d1a/d69 0 1 2024-04-26T12:28:47.847 INFO:tasks.workunit.client.0.smithi046.stdout:7/576: chown d16/d1a/l58 384333491 1 2024-04-26T12:28:47.847 INFO:tasks.workunit.client.0.smithi046.stdout:5/582: chown d9/da/dd/d34/d44/d97/da4/d35/c98 29834946 1 2024-04-26T12:28:47.847 INFO:tasks.workunit.client.0.smithi046.stdout:7/577: fsync d16/d35/dac/f94 0 2024-04-26T12:28:47.848 INFO:tasks.workunit.client.0.smithi046.stdout:5/583: stat d9/da/dd/d34/cc4 0 2024-04-26T12:28:47.848 INFO:tasks.workunit.client.0.smithi046.stdout:7/578: unlink d16/d27/d51/l9e 0 2024-04-26T12:28:47.848 INFO:tasks.workunit.client.0.smithi046.stdout:5/584: readlink d9/da/dd/d34/d44/d97/da4/l7a 0 2024-04-26T12:28:47.849 INFO:tasks.workunit.client.0.smithi046.stdout:7/579: write d16/f23 [2678843,33402] 0 2024-04-26T12:28:47.850 INFO:tasks.workunit.client.0.smithi046.stdout:8/623: truncate d7/da/df/f3f 263912 0 2024-04-26T12:28:47.850 INFO:tasks.workunit.client.0.smithi046.stdout:4/500: rename d0/d1/d29 to d0/da/da1 0 2024-04-26T12:28:47.851 INFO:tasks.workunit.client.0.smithi046.stdout:8/624: rmdir d7/d24/d50/d62 39 2024-04-26T12:28:47.851 INFO:tasks.workunit.client.0.smithi046.stdout:7/580: symlink d16/d4e/d6c/d9f/lc4 0 2024-04-26T12:28:47.852 INFO:tasks.workunit.client.0.smithi046.stdout:8/625: stat d7/dc/d1b/da0/db6/ccd 0 2024-04-26T12:28:47.853 INFO:tasks.workunit.client.0.smithi046.stdout:7/581: write d16/d1a/d3e/d59/f92 [3463903,56528] 0 2024-04-26T12:28:47.853 INFO:tasks.workunit.client.0.smithi046.stdout:8/626: stat d7/dc/d1b/da0 0 2024-04-26T12:28:47.854 INFO:tasks.workunit.client.0.smithi046.stdout:4/501: link d0/da/d17/d20/d25/d35/d6d/d19/f3d d0/fa2 0 2024-04-26T12:28:47.854 INFO:tasks.workunit.client.0.smithi046.stdout:7/582: mkdir d16/d1a/d3e/dc5 0 2024-04-26T12:28:47.854 INFO:tasks.workunit.client.0.smithi046.stdout:8/627: write d7/da/df/f5e [911582,52779] 0 2024-04-26T12:28:47.855 INFO:tasks.workunit.client.0.smithi046.stdout:5/585: dread d9/da/dd/d34/d3e/f76 [0,4194304] 0 2024-04-26T12:28:47.855 INFO:tasks.workunit.client.0.smithi046.stdout:8/628: dread d7/dc/d1b/f8c [0,4194304] 0 2024-04-26T12:28:47.856 INFO:tasks.workunit.client.0.smithi046.stdout:5/586: creat d9/da/dd/d34/fce x:0 0 0 2024-04-26T12:28:47.856 INFO:tasks.workunit.client.0.smithi046.stdout:8/629: mknod d7/d1c/cd1 0 2024-04-26T12:28:47.857 INFO:tasks.workunit.client.0.smithi046.stdout:4/502: dread d0/d1/d5/db/f10 [4194304,4194304] 0 2024-04-26T12:28:47.857 INFO:tasks.workunit.client.0.smithi046.stdout:5/587: readlink d9/da/d18/d7d/da7/lb1 0 2024-04-26T12:28:47.858 INFO:tasks.workunit.client.0.smithi046.stdout:5/588: dread - d9/da/d15/f75 zero size 2024-04-26T12:28:47.858 INFO:tasks.workunit.client.0.smithi046.stdout:4/503: chown d0/d1/f3b 27417 1 2024-04-26T12:28:47.858 INFO:tasks.workunit.client.0.smithi046.stdout:7/583: write d16/d1a/d3e/f44 [1463811,100116] 0 2024-04-26T12:28:47.858 INFO:tasks.workunit.client.0.smithi046.stdout:8/630: link d7/dc/f70 d7/d24/d50/d2a/fd2 0 2024-04-26T12:28:47.859 INFO:tasks.workunit.client.0.smithi046.stdout:7/584: rename d16/d1a/d31/d4d/c7a to d16/d3f/cc6 0 2024-04-26T12:28:47.860 INFO:tasks.workunit.client.0.smithi046.stdout:8/631: truncate d7/d24/f43 1526141 0 2024-04-26T12:28:47.860 INFO:tasks.workunit.client.0.smithi046.stdout:5/589: link d9/da/d18/cb3 d9/ccf 0 2024-04-26T12:28:47.860 INFO:tasks.workunit.client.0.smithi046.stdout:8/632: chown d7/l9 1943977 1 2024-04-26T12:28:47.862 INFO:tasks.workunit.client.0.smithi046.stdout:8/633: chown d7/d24/d50/f72 9532 1 2024-04-26T12:28:47.862 INFO:tasks.workunit.client.0.smithi046.stdout:7/585: rename d16/d1a/d31/d8e to d16/d1a/d31/d55/d6d/d89/dc7 0 2024-04-26T12:28:47.863 INFO:tasks.workunit.client.0.smithi046.stdout:8/634: chown d7/d1c/f2d 0 1 2024-04-26T12:28:47.863 INFO:tasks.workunit.client.0.smithi046.stdout:5/590: rename d9/da/dd/d34/d44/d97/da4/d35/fa6 to d9/da/dd/d69/db0/fd0 0 2024-04-26T12:28:47.863 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:28:47.864 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:47.864 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:47.864 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:47.864 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:47.864 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:47.865 INFO:tasks.workunit.client.0.smithi046.stdout:4/504: dwrite d0/da/d17/d20/d25/f33 [0,4194304] 0 2024-04-26T12:28:47.865 INFO:tasks.workunit.client.0.smithi046.stdout:5/591: write d9/da/dd/d69/f6c [88349,63189] 0 2024-04-26T12:28:47.865 INFO:tasks.workunit.client.0.smithi046.stdout:2/469: dread d1/de/d2b/f50 [0,4194304] 0 2024-04-26T12:28:47.868 INFO:tasks.workunit.client.0.smithi046.stdout:4/505: symlink d0/da/d17/d20/d25/la3 0 2024-04-26T12:28:47.868 INFO:tasks.workunit.client.0.smithi046.stdout:4/506: mknod d0/d1/d5/db/ca4 0 2024-04-26T12:28:47.869 INFO:tasks.workunit.client.0.smithi046.stdout:7/586: dwrite d16/d4e/f52 [0,4194304] 0 2024-04-26T12:28:47.869 INFO:tasks.workunit.client.0.smithi046.stdout:4/507: chown d0/d1/d12/f4b 1 1 2024-04-26T12:28:47.869 INFO:tasks.workunit.client.0.smithi046.stdout:2/470: getdents d1/de/d65/d4a/d58 0 2024-04-26T12:28:47.870 INFO:tasks.workunit.client.0.smithi046.stdout:6/538: dread d7/d1b/d47/d65/f73 [0,4194304] 0 2024-04-26T12:28:47.871 INFO:tasks.workunit.client.0.smithi046.stdout:2/471: write d1/de/d65/f5d [2794793,95380] 0 2024-04-26T12:28:47.873 INFO:tasks.workunit.client.0.smithi046.stdout:5/592: dwrite d9/da/dd/d69/db0/db6/fc8 [0,4194304] 0 2024-04-26T12:28:47.874 INFO:tasks.workunit.client.0.smithi046.stdout:6/539: fdatasync d7/d2b/d31/f35 0 2024-04-26T12:28:47.875 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:47.877 INFO:tasks.workunit.client.0.smithi046.stdout:4/508: read d0/d1/f3b [1024853,88794] 0 2024-04-26T12:28:47.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/593: rmdir d9/da/d18/d7d/da7 39 2024-04-26T12:28:47.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/540: symlink d7/d1b/d37/daa/lad 0 2024-04-26T12:28:47.878 INFO:tasks.workunit.client.0.smithi046.stdout:7/587: dwrite d16/d1a/d31/d4d/f77 [0,4194304] 0 2024-04-26T12:28:47.881 INFO:tasks.workunit.client.0.smithi046.stdout:7/588: truncate d16/d27/d51/f67 1859109 0 2024-04-26T12:28:47.882 INFO:tasks.workunit.client.0.smithi046.stdout:7/589: readlink d16/d27/l43 0 2024-04-26T12:28:47.882 INFO:tasks.workunit.client.0.smithi046.stdout:8/635: dread d7/dc/f13 [0,4194304] 0 2024-04-26T12:28:47.883 INFO:tasks.workunit.client.0.smithi046.stdout:4/509: dwrite d0/d1/d12/f47 [4194304,4194304] 0 2024-04-26T12:28:47.883 INFO:tasks.workunit.client.0.smithi046.stdout:6/541: dwrite d7/d1b/d37/fa0 [0,4194304] 0 2024-04-26T12:28:47.884 INFO:tasks.workunit.client.0.smithi046.stdout:8/636: creat d7/d24/d50/d2a/d39/fd3 x:0 0 0 2024-04-26T12:28:47.885 INFO:tasks.workunit.client.0.smithi046.stdout:6/542: truncate d7/d2b/f53 5241455 0 2024-04-26T12:28:47.885 INFO:tasks.workunit.client.0.smithi046.stdout:4/510: getdents d0/da/d17/d20/d9c 0 2024-04-26T12:28:47.885 INFO:tasks.workunit.client.0.smithi046.stdout:3/590: sync 2024-04-26T12:28:47.886 INFO:tasks.workunit.client.0.smithi046.stdout:1/458: sync 2024-04-26T12:28:47.886 INFO:tasks.workunit.client.0.smithi046.stdout:8/637: rename c2 to d7/dc/d1b/d7d/dc1/cd4 0 2024-04-26T12:28:47.887 INFO:tasks.workunit.client.0.smithi046.stdout:6/543: mknod d7/d1b/d37/d95/cae 0 2024-04-26T12:28:47.888 INFO:tasks.workunit.client.0.smithi046.stdout:3/591: unlink d2/db/f55 0 2024-04-26T12:28:47.889 INFO:tasks.workunit.client.0.smithi046.stdout:8/638: write d7/d24/d50/d2a/d39/f48 [2925594,5606] 0 2024-04-26T12:28:47.889 INFO:tasks.workunit.client.0.smithi046.stdout:3/592: rmdir d2/db/d84/da5 39 2024-04-26T12:28:47.890 INFO:tasks.workunit.client.0.smithi046.stdout:8/639: truncate d7/d24/f43 2402416 0 2024-04-26T12:28:47.890 INFO:tasks.workunit.client.0.smithi046.stdout:8/640: chown d7/da/fa9 16 1 2024-04-26T12:28:47.892 INFO:tasks.workunit.client.0.smithi046.stdout:3/593: unlink d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d/f80 0 2024-04-26T12:28:47.892 INFO:tasks.workunit.client.0.smithi046.stdout:1/459: truncate d7/db/ff 579434 0 2024-04-26T12:28:47.892 INFO:tasks.workunit.client.0.smithi046.stdout:8/641: mkdir d7/dd5 0 2024-04-26T12:28:47.892 INFO:tasks.workunit.client.0.smithi046.stdout:1/460: readlink d7/d38/l3b 0 2024-04-26T12:28:47.893 INFO:tasks.workunit.client.0.smithi046.stdout:8/642: creat d7/dc/d1b/dae/dcf/fd6 x:0 0 0 2024-04-26T12:28:47.893 INFO:tasks.workunit.client.0.smithi046.stdout:1/461: rename d7/db/l25 to d7/d9/d2b/d31/d82/l9b 0 2024-04-26T12:28:47.894 INFO:tasks.workunit.client.0.smithi046.stdout:8/643: truncate d7/d24/d50/f72 2707099 0 2024-04-26T12:28:47.894 INFO:tasks.workunit.client.0.smithi046.stdout:8/644: fdatasync d7/dc/d1b/f93 0 2024-04-26T12:28:47.895 INFO:tasks.workunit.client.0.smithi046.stdout:8/645: creat d7/dc/d1b/fd7 x:0 0 0 2024-04-26T12:28:47.896 INFO:tasks.workunit.client.0.smithi046.stdout:8/646: write d7/d24/d50/d2a/d92/fb8 [82508,74361] 0 2024-04-26T12:28:47.898 INFO:tasks.workunit.client.0.smithi046.stdout:8/647: mknod d7/d24/d56/cd8 0 2024-04-26T12:28:47.898 INFO:tasks.workunit.client.0.smithi046.stdout:1/462: dwrite d7/d14/f53 [0,4194304] 0 2024-04-26T12:28:47.900 INFO:tasks.workunit.client.0.smithi046.stdout:6/544: dread d7/d2b/d31/f2e [0,4194304] 0 2024-04-26T12:28:47.904 INFO:tasks.workunit.client.0.smithi046.stdout:8/648: dwrite d7/dc/fb7 [0,4194304] 0 2024-04-26T12:28:47.905 INFO:tasks.workunit.client.0.smithi046.stdout:8/649: write d7/d24/d50/d2a/d39/d9d/f9f [263057,88150] 0 2024-04-26T12:28:47.907 INFO:tasks.workunit.client.0.smithi046.stdout:5/594: dread d9/da/dd/d34/faf [0,4194304] 0 2024-04-26T12:28:47.907 INFO:tasks.workunit.client.0.smithi046.stdout:5/595: chown d9/f41 33 1 2024-04-26T12:28:47.908 INFO:tasks.workunit.client.0.smithi046.stdout:8/650: rename d7/dc/c90 to d7/d1c/cd9 0 2024-04-26T12:28:47.908 INFO:tasks.workunit.client.0.smithi046.stdout:5/596: dread - d9/da/dd/d34/d44/f8e zero size 2024-04-26T12:28:47.909 INFO:tasks.workunit.client.0.smithi046.stdout:5/597: creat d9/da/d15/fd1 x:0 0 0 2024-04-26T12:28:47.909 INFO:tasks.workunit.client.0.smithi046.stdout:6/545: write d7/d1b/d37/f42 [1027489,60467] 0 2024-04-26T12:28:47.910 INFO:tasks.workunit.client.0.smithi046.stdout:8/651: stat d7/dc 0 2024-04-26T12:28:47.910 INFO:tasks.workunit.client.0.smithi046.stdout:8/652: chown d7/d24/c46 0 1 2024-04-26T12:28:47.910 INFO:tasks.workunit.client.0.smithi046.stdout:5/598: creat d9/da/dd/d34/fd2 x:0 0 0 2024-04-26T12:28:47.911 INFO:tasks.workunit.client.0.smithi046.stdout:8/653: mkdir d7/dc/d1b/da0/db6/dda 0 2024-04-26T12:28:47.912 INFO:tasks.workunit.client.0.smithi046.stdout:7/590: dread d16/d27/f34 [0,4194304] 0 2024-04-26T12:28:47.913 INFO:tasks.workunit.client.0.smithi046.stdout:7/591: stat d16/d4e/d6c/fa7 0 2024-04-26T12:28:47.914 INFO:tasks.workunit.client.0.smithi046.stdout:4/511: dread d0/f52 [0,4194304] 0 2024-04-26T12:28:47.914 INFO:tasks.workunit.client.0.smithi046.stdout:4/512: readlink d0/da/d17/l78 0 2024-04-26T12:28:47.916 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:47.915+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:47.916 INFO:tasks.workunit.client.0.smithi046.stdout:8/654: dwrite d7/d24/d50/d2a/d39/fa8 [0,4194304] 0 2024-04-26T12:28:47.918 INFO:tasks.workunit.client.0.smithi046.stdout:7/592: chown d16/d1a/d31/d55/d6d/d89/lb7 73 1 2024-04-26T12:28:47.919 INFO:tasks.workunit.client.0.smithi046.stdout:4/513: unlink d0/da/f26 0 2024-04-26T12:28:47.919 INFO:tasks.workunit.client.0.smithi046.stdout:8/655: creat d7/d24/d50/d62/fdb x:0 0 0 2024-04-26T12:28:47.920 INFO:tasks.workunit.client.0.smithi046.stdout:8/656: creat d7/dc/d1b/fdc x:0 0 0 2024-04-26T12:28:47.921 INFO:tasks.workunit.client.0.smithi046.stdout:4/514: write d0/da/d17/d20/d25/d35/d61/f7b [1671421,50557] 0 2024-04-26T12:28:47.922 INFO:tasks.workunit.client.0.smithi046.stdout:4/515: unlink d0/d1/d12/l27 0 2024-04-26T12:28:47.923 INFO:tasks.workunit.client.0.smithi046.stdout:0/551: sync 2024-04-26T12:28:47.923 INFO:tasks.workunit.client.0.smithi046.stdout:2/472: sync 2024-04-26T12:28:47.923 INFO:tasks.workunit.client.0.smithi046.stdout:9/456: sync 2024-04-26T12:28:47.923 INFO:tasks.workunit.client.0.smithi046.stdout:3/594: sync 2024-04-26T12:28:47.924 INFO:tasks.workunit.client.0.smithi046.stdout:7/593: dread d16/d1a/d31/f49 [0,4194304] 0 2024-04-26T12:28:47.924 INFO:tasks.workunit.client.0.smithi046.stdout:4/516: symlink d0/da/d17/d20/d74/la5 0 2024-04-26T12:28:47.924 INFO:tasks.workunit.client.0.smithi046.stdout:3/595: stat d2/d16/d2c/d50/d71/d89/lc1 0 2024-04-26T12:28:47.925 INFO:tasks.workunit.client.0.smithi046.stdout:9/457: link d0/d2c/d47/f2e d0/d16/d76/fa2 0 2024-04-26T12:28:47.925 INFO:tasks.workunit.client.0.smithi046.stdout:2/473: rename d1/de/d65/d1b/c88 to d1/de/d15/d18/d8a/c9c 0 2024-04-26T12:28:47.926 INFO:tasks.workunit.client.0.smithi046.stdout:2/474: chown d1/de/d65/d8f 190 1 2024-04-26T12:28:47.927 INFO:tasks.workunit.client.0.smithi046.stdout:7/594: getdents d16/d1a/d3e/d59 0 2024-04-26T12:28:47.928 INFO:tasks.workunit.client.0.smithi046.stdout:3/596: unlink d2/d16/d2c/d50/d71/d89/dc5/d1b/f22 0 2024-04-26T12:28:47.928 INFO:tasks.workunit.client.0.smithi046.stdout:7/595: chown d16/d1a 140666097 1 2024-04-26T12:28:47.928 INFO:tasks.workunit.client.0.smithi046.stdout:0/552: dread d9/dc/f42 [0,4194304] 0 2024-04-26T12:28:47.929 INFO:tasks.workunit.client.0.smithi046.stdout:6/546: dread d7/fe [0,4194304] 0 2024-04-26T12:28:47.929 INFO:tasks.workunit.client.0.smithi046.stdout:7/596: link d16/d27/f34 d16/d1a/d3e/d59/fc8 0 2024-04-26T12:28:47.930 INFO:tasks.workunit.client.0.smithi046.stdout:6/547: fdatasync d7/d2b/f83 0 2024-04-26T12:28:47.930 INFO:tasks.workunit.client.0.smithi046.stdout:9/458: dread d0/d2c/f4d [0,4194304] 0 2024-04-26T12:28:47.930 INFO:tasks.workunit.client.0.smithi046.stdout:7/597: chown d16/d1a/d69/l82 13000015 1 2024-04-26T12:28:47.930 INFO:tasks.workunit.client.0.smithi046.stdout:7/598: write f4 [67067,57767] 0 2024-04-26T12:28:47.931 INFO:tasks.workunit.client.0.smithi046.stdout:9/459: rename d0/d16/d76/f8b to d0/d16/d76/d7d/d72/d85/fa3 0 2024-04-26T12:28:47.931 INFO:tasks.workunit.client.0.smithi046.stdout:7/599: mkdir d16/d35/dc9 0 2024-04-26T12:28:47.931 INFO:tasks.workunit.client.0.smithi046.stdout:7/600: chown d16/l1e 105 1 2024-04-26T12:28:47.932 INFO:tasks.workunit.client.0.smithi046.stdout:7/601: symlink d16/d1a/d3e/d59/lca 0 2024-04-26T12:28:47.969 INFO:tasks.workunit.client.0.smithi046.stdout:1/463: sync 2024-04-26T12:28:47.969 INFO:tasks.workunit.client.0.smithi046.stdout:5/599: sync 2024-04-26T12:28:47.969 INFO:tasks.workunit.client.0.smithi046.stdout:9/460: sync 2024-04-26T12:28:47.969 INFO:tasks.workunit.client.0.smithi046.stdout:6/548: sync 2024-04-26T12:28:47.970 INFO:tasks.workunit.client.0.smithi046.stdout:1/464: readlink d7/d9/d2b/l3f 0 2024-04-26T12:28:47.970 INFO:tasks.workunit.client.0.smithi046.stdout:5/600: write d9/da/d40/f94 [1628013,117128] 0 2024-04-26T12:28:47.970 INFO:tasks.workunit.client.0.smithi046.stdout:6/549: mkdir d7/da7/daf 0 2024-04-26T12:28:47.970 INFO:tasks.workunit.client.0.smithi046.stdout:1/465: unlink d7/d14/f4e 0 2024-04-26T12:28:47.970 INFO:tasks.workunit.client.0.smithi046.stdout:6/550: unlink d7/cd 0 2024-04-26T12:28:47.970 INFO:tasks.workunit.client.0.smithi046.stdout:5/601: unlink d9/f73 0 2024-04-26T12:28:47.971 INFO:tasks.workunit.client.0.smithi046.stdout:6/551: fdatasync d7/d16/f4a 0 2024-04-26T12:28:47.972 INFO:tasks.workunit.client.0.smithi046.stdout:6/552: mknod d7/d1b/d47/d65/d77/d92/cb0 0 2024-04-26T12:28:47.973 INFO:tasks.workunit.client.0.smithi046.stdout:6/553: write d7/d1b/d6a/f93 [703059,127060] 0 2024-04-26T12:28:47.973 INFO:tasks.workunit.client.0.smithi046.stdout:6/554: fdatasync d7/d1b/f74 0 2024-04-26T12:28:47.973 INFO:tasks.workunit.client.0.smithi046.stdout:6/555: readlink d7/lf 0 2024-04-26T12:28:47.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/466: dwrite d7/d9/d2b/d39/d3c/f72 [0,4194304] 0 2024-04-26T12:28:47.974 INFO:tasks.workunit.client.0.smithi046.stdout:6/556: read - d7/d1b/d47/d65/f82 zero size 2024-04-26T12:28:47.975 INFO:tasks.workunit.client.0.smithi046.stdout:6/557: write d7/f15 [4415818,25980] 0 2024-04-26T12:28:47.976 INFO:tasks.workunit.client.0.smithi046.stdout:1/467: dread d7/d9/f11 [0,4194304] 0 2024-04-26T12:28:47.976 INFO:tasks.workunit.client.0.smithi046.stdout:6/558: mknod d7/d1b/d47/cb1 0 2024-04-26T12:28:47.977 INFO:tasks.workunit.client.0.smithi046.stdout:1/468: link d7/d12/c16 d7/d9/d2b/d96/c9c 0 2024-04-26T12:28:47.977 INFO:tasks.workunit.client.0.smithi046.stdout:6/559: link d7/c11 d7/d1b/cb2 0 2024-04-26T12:28:47.981 INFO:tasks.workunit.client.0.smithi046.stdout:6/560: dwrite d7/fe [8388608,4194304] 0 2024-04-26T12:28:47.981 INFO:tasks.workunit.client.0.smithi046.stdout:1/469: dwrite d7/db/f64 [0,4194304] 0 2024-04-26T12:28:47.983 INFO:tasks.workunit.client.0.smithi046.stdout:6/561: creat d7/d1b/d47/d65/d77/d92/fb3 x:0 0 0 2024-04-26T12:28:47.984 INFO:tasks.workunit.client.0.smithi046.stdout:9/461: sync 2024-04-26T12:28:47.985 INFO:tasks.workunit.client.0.smithi046.stdout:5/602: sync 2024-04-26T12:28:47.985 INFO:tasks.workunit.client.0.smithi046.stdout:9/462: chown d0/d2c/d47/f46 2241135 1 2024-04-26T12:28:47.986 INFO:tasks.workunit.client.0.smithi046.stdout:1/470: dwrite d7/d14/d5d/d32/f75 [0,4194304] 0 2024-04-26T12:28:47.987 INFO:tasks.workunit.client.0.smithi046.stdout:6/562: creat d7/d1b/d47/d65/d77/fb4 x:0 0 0 2024-04-26T12:28:47.988 INFO:tasks.workunit.client.0.smithi046.stdout:5/603: unlink d9/da/d18/cb3 0 2024-04-26T12:28:47.988 INFO:tasks.workunit.client.0.smithi046.stdout:6/563: creat d7/d16/fb5 x:0 0 0 2024-04-26T12:28:47.990 INFO:tasks.workunit.client.0.smithi046.stdout:2/475: rmdir d1/de/d15 39 2024-04-26T12:28:47.990 INFO:tasks.workunit.client.0.smithi046.stdout:6/564: creat d7/d1b/fb6 x:0 0 0 2024-04-26T12:28:47.990 INFO:tasks.workunit.client.0.smithi046.stdout:1/471: creat d7/f9d x:0 0 0 2024-04-26T12:28:47.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/604: write d9/da/dd/d34/f49 [77942,116651] 0 2024-04-26T12:28:47.991 INFO:tasks.workunit.client.0.smithi046.stdout:1/472: creat d7/d9/d2b/d96/f9e x:0 0 0 2024-04-26T12:28:47.992 INFO:tasks.workunit.client.0.smithi046.stdout:2/476: rename d1/d42/f44 to d1/de/d65/d4a/d58/f9d 0 2024-04-26T12:28:47.993 INFO:tasks.workunit.client.0.smithi046.stdout:6/565: write d7/d2b/d31/f98 [513525,77133] 0 2024-04-26T12:28:47.993 INFO:tasks.workunit.client.0.smithi046.stdout:6/566: write d7/f7f [2535825,23508] 0 2024-04-26T12:28:47.993 INFO:tasks.workunit.client.0.smithi046.stdout:2/477: chown d1/de/d65/d4a/d58/f73 144772051 1 2024-04-26T12:28:47.993 INFO:tasks.workunit.client.0.smithi046.stdout:6/567: write d7/d1b/d47/f7b [713699,113735] 0 2024-04-26T12:28:47.994 INFO:tasks.workunit.client.0.smithi046.stdout:2/478: mknod d1/de/d65/d4a/c9e 0 2024-04-26T12:28:47.994 INFO:tasks.workunit.client.0.smithi046.stdout:5/605: getdents d9/da/d18/d8b 0 2024-04-26T12:28:47.995 INFO:tasks.workunit.client.0.smithi046.stdout:2/479: chown d1/de/d2b/l93 492 1 2024-04-26T12:28:47.995 INFO:tasks.workunit.client.0.smithi046.stdout:1/473: rename d7/d12/d3a/d49 to d7/d9/d2b/d9f 0 2024-04-26T12:28:47.997 INFO:tasks.workunit.client.0.smithi046.stdout:1/474: creat d7/d12/d89/fa0 x:0 0 0 2024-04-26T12:28:47.998 INFO:tasks.workunit.client.0.smithi046.stdout:2/480: rename d1/de/d65/d4a/d58/d87 to d1/de/d15/d18/d91/d9f 0 2024-04-26T12:28:47.998 INFO:tasks.workunit.client.0.smithi046.stdout:4/517: dwrite d0/da/d17/d20/d25/d35/d61/f75 [0,4194304] 0 2024-04-26T12:28:47.998 INFO:tasks.workunit.client.0.smithi046.stdout:1/475: fdatasync d7/d14/d5d/d32/d5f/f65 0 2024-04-26T12:28:47.999 INFO:tasks.workunit.client.0.smithi046.stdout:7/602: getdents d16/d35 0 2024-04-26T12:28:48.000 INFO:tasks.workunit.client.0.smithi046.stdout:3/597: write d2/d16/d2c/d50/d71/d89/dc5/f3d [2622053,81445] 0 2024-04-26T12:28:48.001 INFO:tasks.workunit.client.0.smithi046.stdout:5/606: dwrite d9/da/dd/f32 [0,4194304] 0 2024-04-26T12:28:48.001 INFO:tasks.workunit.client.0.smithi046.stdout:7/603: creat d16/d1a/fcb x:0 0 0 2024-04-26T12:28:48.002 INFO:tasks.workunit.client.0.smithi046.stdout:1/476: truncate d7/d14/d5d/f30 439176 0 2024-04-26T12:28:48.002 INFO:tasks.workunit.client.0.smithi046.stdout:4/518: rename d0/da/d17/d20/d25/d35/d6d/d19/d55/c93 to d0/da/d17/d20/d25/ca6 0 2024-04-26T12:28:48.002 INFO:tasks.workunit.client.0.smithi046.stdout:1/477: read - d7/f9d zero size 2024-04-26T12:28:48.003 INFO:tasks.workunit.client.0.smithi046.stdout:5/607: chown d9/da/dd/l38 1411 1 2024-04-26T12:28:48.003 INFO:tasks.workunit.client.0.smithi046.stdout:3/598: creat d2/d16/d35/dbc/dc9/dd3/fd7 x:0 0 0 2024-04-26T12:28:48.003 INFO:tasks.workunit.client.0.smithi046.stdout:1/478: dread - d7/d14/d5d/d32/d5f/f92 zero size 2024-04-26T12:28:48.004 INFO:tasks.workunit.client.0.smithi046.stdout:5/608: write d9/da/d18/d7d/f78 [227874,6509] 0 2024-04-26T12:28:48.004 INFO:tasks.workunit.client.0.smithi046.stdout:5/609: chown d9/da/dd/f13 28889 1 2024-04-26T12:28:48.005 INFO:tasks.workunit.client.0.smithi046.stdout:1/479: symlink d7/d9/d2b/la1 0 2024-04-26T12:28:48.005 INFO:tasks.workunit.client.0.smithi046.stdout:5/610: readlink d9/da/dd/d34/d6b/l9e 0 2024-04-26T12:28:48.005 INFO:tasks.workunit.client.0.smithi046.stdout:1/480: chown d7/d9/c15 1607 1 2024-04-26T12:28:48.006 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:48.003+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:48.006 INFO:tasks.workunit.client.0.smithi046.stdout:5/611: chown d9/da/dd/d34/d45/fcc 0 1 2024-04-26T12:28:48.006 INFO:tasks.workunit.client.0.smithi046.stdout:5/612: fdatasync d9/da/dd/d34/d44/d97/da4/fa3 0 2024-04-26T12:28:48.009 INFO:tasks.workunit.client.0.smithi046.stdout:1/481: symlink d7/d9/d2b/d96/la2 0 2024-04-26T12:28:48.010 INFO:tasks.workunit.client.0.smithi046.stdout:3/599: dread d2/d16/d2c/d50/d71/d89/dc5/f4b [0,4194304] 0 2024-04-26T12:28:48.010 INFO:tasks.workunit.client.0.smithi046.stdout:1/482: fdatasync d7/d9/f11 0 2024-04-26T12:28:48.011 INFO:tasks.workunit.client.0.smithi046.stdout:7/604: read d16/d1a/d3e/d4f/f71 [73747,60272] 0 2024-04-26T12:28:48.011 INFO:tasks.workunit.client.0.smithi046.stdout:5/613: dwrite d9/da/d18/d8b/f96 [0,4194304] 0 2024-04-26T12:28:48.012 INFO:tasks.workunit.client.0.smithi046.stdout:5/614: symlink d9/da/dd/d34/d44/d97/da4/ld3 0 2024-04-26T12:28:48.012 INFO:tasks.workunit.client.0.smithi046.stdout:7/605: rename d16/d1a/d31/d5a/f5b to d16/d1a/d31/d55/d6d/fcc 0 2024-04-26T12:28:48.013 INFO:tasks.workunit.client.0.smithi046.stdout:3/600: getdents d2/d16/d2c/d50/d71/d89/d98/dce 0 2024-04-26T12:28:48.013 INFO:tasks.workunit.client.0.smithi046.stdout:1/483: rename d7/d14/d5d/d32/l63 to d7/d9/d2b/d31/d82/la3 0 2024-04-26T12:28:48.014 INFO:tasks.workunit.client.0.smithi046.stdout:7/606: write f9 [2309619,42737] 0 2024-04-26T12:28:48.014 INFO:tasks.workunit.client.0.smithi046.stdout:3/601: creat d2/d16/d2c/fd8 x:0 0 0 2024-04-26T12:28:48.014 INFO:tasks.workunit.client.0.smithi046.stdout:5/615: chown d9/da/dd/d34/d44/d97/da4/d35/c3d 108749 1 2024-04-26T12:28:48.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/616: mkdir d9/da/d18/dd4 0 2024-04-26T12:28:48.015 INFO:tasks.workunit.client.0.smithi046.stdout:7/607: rename d16/d1a/d3e/d4f/c7f to d16/d27/ccd 0 2024-04-26T12:28:48.016 INFO:tasks.workunit.client.0.smithi046.stdout:7/608: dread - d16/db1/fb5 zero size 2024-04-26T12:28:48.016 INFO:tasks.workunit.client.0.smithi046.stdout:1/484: dread - d7/d14/d5d/d32/d5f/f65 zero size 2024-04-26T12:28:48.016 INFO:tasks.workunit.client.0.smithi046.stdout:3/602: truncate d2/d16/d2c/d50/d71/d89/dc5/d23/f26 602308 0 2024-04-26T12:28:48.017 INFO:tasks.workunit.client.0.smithi046.stdout:7/609: truncate d16/d1a/d31/fa4 987541 0 2024-04-26T12:28:48.018 INFO:tasks.workunit.client.0.smithi046.stdout:9/463: dread d0/d29/d69/f70 [0,4194304] 0 2024-04-26T12:28:48.018 INFO:tasks.workunit.client.0.smithi046.stdout:5/617: link d9/da/dd/d5d/f6e d9/da/d18/d7d/da7/fd5 0 2024-04-26T12:28:48.018 INFO:tasks.workunit.client.0.smithi046.stdout:1/485: symlink d7/d9/d2b/d39/d5c/la4 0 2024-04-26T12:28:48.019 INFO:tasks.workunit.client.0.smithi046.stdout:3/603: creat d2/db/d84/fd9 x:0 0 0 2024-04-26T12:28:48.019 INFO:tasks.workunit.client.0.smithi046.stdout:6/568: sync 2024-04-26T12:28:48.019 INFO:tasks.workunit.client.0.smithi046.stdout:5/618: mknod d9/da/d18/d7d/cd6 0 2024-04-26T12:28:48.021 INFO:tasks.workunit.client.0.smithi046.stdout:3/604: creat d2/db/d4a/da9/fda x:0 0 0 2024-04-26T12:28:48.021 INFO:tasks.workunit.client.0.smithi046.stdout:6/569: rename d7/f20 to d7/d1b/d47/d65/d77/fb7 0 2024-04-26T12:28:48.023 INFO:tasks.workunit.client.0.smithi046.stdout:6/570: symlink d7/da7/lb8 0 2024-04-26T12:28:48.023 INFO:tasks.workunit.client.0.smithi046.stdout:3/605: mknod d2/db/d84/d8a/cdb 0 2024-04-26T12:28:48.025 INFO:tasks.workunit.client.0.smithi046.stdout:9/464: dwrite d0/d2c/d47/f46 [4194304,4194304] 0 2024-04-26T12:28:48.026 INFO:tasks.workunit.client.0.smithi046.stdout:1/486: dwrite d7/d14/d5d/f9a [0,4194304] 0 2024-04-26T12:28:48.026 INFO:tasks.workunit.client.0.smithi046.stdout:3/606: write d2/db/d4a/da9/faf [2663034,128729] 0 2024-04-26T12:28:48.026 INFO:tasks.workunit.client.0.smithi046.stdout:6/571: rename d7/d1b/d47/d65/da3/cac to d7/cb9 0 2024-04-26T12:28:48.026 INFO:tasks.workunit.client.0.smithi046.stdout:2/481: dread d1/de/f11 [0,4194304] 0 2024-04-26T12:28:48.027 INFO:tasks.workunit.client.0.smithi046.stdout:4/519: dread d0/d1/d12/f4b [0,4194304] 0 2024-04-26T12:28:48.027 INFO:tasks.workunit.client.0.smithi046.stdout:2/482: write d1/f2 [4168586,9827] 0 2024-04-26T12:28:48.029 INFO:tasks.workunit.client.0.smithi046.stdout:3/607: mknod d2/db/d62/cdc 0 2024-04-26T12:28:48.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/520: creat d0/da/d17/d20/d25/d35/fa7 x:0 0 0 2024-04-26T12:28:48.032 INFO:tasks.workunit.client.0.smithi046.stdout:3/608: chown d2/d16/d2c/d50/cd2 6896 1 2024-04-26T12:28:48.034 INFO:tasks.workunit.client.0.smithi046.stdout:0/553: rmdir d9 39 2024-04-26T12:28:48.035 INFO:tasks.workunit.client.0.smithi046.stdout:9/465: dwrite d0/d29/f89 [0,4194304] 0 2024-04-26T12:28:48.036 INFO:tasks.workunit.client.0.smithi046.stdout:1/487: dwrite d7/d12/d3a/f43 [0,4194304] 0 2024-04-26T12:28:48.036 INFO:tasks.workunit.client.0.smithi046.stdout:6/572: dwrite d7/d2b/d31/f2f [0,4194304] 0 2024-04-26T12:28:48.037 INFO:tasks.workunit.client.0.smithi046.stdout:6/573: fdatasync d7/d1b/d6a/f93 0 2024-04-26T12:28:48.037 INFO:tasks.workunit.client.0.smithi046.stdout:2/483: dwrite d1/de/d2b/f41 [0,4194304] 0 2024-04-26T12:28:48.038 INFO:tasks.workunit.client.0.smithi046.stdout:0/554: creat d9/d1d/fbe x:0 0 0 2024-04-26T12:28:48.039 INFO:tasks.workunit.client.0.smithi046.stdout:9/466: write d0/d16/d76/d7d/d72/d85/d97/f9c [665085,26955] 0 2024-04-26T12:28:48.039 INFO:tasks.workunit.client.0.smithi046.stdout:2/484: link d1/de/d65/d4a/d58/f63 d1/de/d2b/fa0 0 2024-04-26T12:28:48.040 INFO:tasks.workunit.client.0.smithi046.stdout:0/555: symlink d9/d1d/d40/d41/d43/lbf 0 2024-04-26T12:28:48.041 INFO:tasks.workunit.client.0.smithi046.stdout:6/574: mknod d7/da7/cba 0 2024-04-26T12:28:48.042 INFO:tasks.workunit.client.0.smithi046.stdout:4/521: link d0/d1/d12/f4b d0/da/d17/d20/d25/d35/d6d/d19/fa8 0 2024-04-26T12:28:48.043 INFO:tasks.workunit.client.0.smithi046.stdout:9/467: creat d0/d29/d69/fa4 x:0 0 0 2024-04-26T12:28:48.045 INFO:tasks.workunit.client.0.smithi046.stdout:6/575: read d7/d1b/d6a/f99 [1655736,12629] 0 2024-04-26T12:28:48.046 INFO:tasks.workunit.client.0.smithi046.stdout:2/485: link d1/de/d65/d1b/c36 d1/de/ca1 0 2024-04-26T12:28:48.047 INFO:tasks.workunit.client.0.smithi046.stdout:4/522: dread - d0/da/d17/d20/d25/d35/d6d/d19/f6c zero size 2024-04-26T12:28:48.047 INFO:tasks.workunit.client.0.smithi046.stdout:9/468: rename d0/f65 to d0/d16/d76/d7d/fa5 0 2024-04-26T12:28:48.049 INFO:tasks.workunit.client.0.smithi046.stdout:1/488: dwrite d7/d12/d89/f8b [4194304,4194304] 0 2024-04-26T12:28:48.050 INFO:tasks.workunit.client.0.smithi046.stdout:7/610: getdents d16/d1a/d31/d5a 0 2024-04-26T12:28:48.051 INFO:tasks.workunit.client.0.smithi046.stdout:5/619: truncate d9/da/d15/f9f 1477510 0 2024-04-26T12:28:48.051 INFO:tasks.workunit.client.0.smithi046.stdout:4/523: rename d0/da/d17/d20/d25/d35/f49 to d0/da/d17/d20/d74/fa9 0 2024-04-26T12:28:48.051 INFO:tasks.workunit.client.0.smithi046.stdout:7/611: mkdir d16/d4e/d6c/dce 0 2024-04-26T12:28:48.051 INFO:tasks.workunit.client.0.smithi046.stdout:1/489: chown d7/d14/d5d/d32/d41/l91 49 1 2024-04-26T12:28:48.051 INFO:tasks.workunit.client.0.smithi046.stdout:9/469: getdents d0/d16/d76/d7d/d72/d85/d97 0 2024-04-26T12:28:48.052 INFO:tasks.workunit.client.0.smithi046.stdout:4/524: creat d0/d64/faa x:0 0 0 2024-04-26T12:28:48.052 INFO:tasks.workunit.client.0.smithi046.stdout:2/486: dwrite d1/de/d2b/f3a [4194304,4194304] 0 2024-04-26T12:28:48.053 INFO:tasks.workunit.client.0.smithi046.stdout:1/490: symlink d7/d14/d5d/d32/d41/d8f/la5 0 2024-04-26T12:28:48.054 INFO:tasks.workunit.client.0.smithi046.stdout:2/487: rename d1/de/d65/d1b/d38/c45 to d1/de/d65/d4a/ca2 0 2024-04-26T12:28:48.054 INFO:tasks.workunit.client.0.smithi046.stdout:1/491: creat d7/d9/d2b/d96/fa6 x:0 0 0 2024-04-26T12:28:48.057 INFO:tasks.workunit.client.0.smithi046.stdout:2/488: write d1/f4 [1968500,9600] 0 2024-04-26T12:28:48.059 INFO:tasks.workunit.client.0.smithi046.stdout:2/489: dread - d1/de/d65/d4a/d90/f92 zero size 2024-04-26T12:28:48.059 INFO:tasks.workunit.client.0.smithi046.stdout:4/525: dwrite d0/da/da1/f34 [0,4194304] 0 2024-04-26T12:28:48.060 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:48.060 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:48.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:48.060 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:48.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.060 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:293 3.13 3:ceffbd45:::200.0000000a:head [write 594763~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.060 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:48.060 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1327173549999996, 2024-04-26T12:28:48.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038803585000000002, 2024-04-26T12:28:48.061 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.061 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.061 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:48.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:48.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924874+0000", 2024-04-26T12:28:48.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924877+0000", 2024-04-26T12:28:48.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7329999999999999e-06 2024-04-26T12:28:48.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924884+0000", 2024-04-26T12:28:48.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:28:48.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924890+0000", 2024-04-26T12:28:48.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:28:48.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958764+0000", 2024-04-26T12:28:48.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.033873863999999997 2024-04-26T12:28:48.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958855+0000", 2024-04-26T12:28:48.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1402000000000003e-05 2024-04-26T12:28:48.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963608+0000", 2024-04-26T12:28:48.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047529039999999996 2024-04-26T12:28:48.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963636+0000", 2024-04-26T12:28:48.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8194000000000001e-05 2024-04-26T12:28:48.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963678+0000", 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2095999999999998e-05 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:294 3.13 3:ceffbd45:::200.0000000a:head [write 596172~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1326726110000003, 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041225228000000003, 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:48.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:48.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924919+0000", 2024-04-26T12:28:48.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924922+0000", 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9160000000000001e-06 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924928+0000", 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3929999999999996e-06 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924933+0000", 2024-04-26T12:28:48.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7820000000000001e-06 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959359+0000", 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034425782000000002 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959439+0000", 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0275e-05 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966079+0000", 2024-04-26T12:28:48.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0066397089999999997 2024-04-26T12:28:48.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966106+0000", 2024-04-26T12:28:48.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7178e-05 2024-04-26T12:28:48.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966145+0000", 2024-04-26T12:28:48.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8618999999999997e-05 2024-04-26T12:28:48.069 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.069 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.069 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.070 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:295 3.13 3:ceffbd45:::200.0000000a:head [write 597574~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.070 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:48.070 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1326464610000002, 2024-04-26T12:28:48.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041258571000000001, 2024-04-26T12:28:48.070 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.070 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.070 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:48.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924945+0000", 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924948+0000", 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924955+0000", 2024-04-26T12:28:48.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4629999999999998e-06 2024-04-26T12:28:48.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924959+0000", 2024-04-26T12:28:48.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2719999999999999e-06 2024-04-26T12:28:48.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959957+0000", 2024-04-26T12:28:48.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034997588000000003 2024-04-26T12:28:48.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960042+0000", 2024-04-26T12:28:48.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5811999999999998e-05 2024-04-26T12:28:48.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966149+0000", 2024-04-26T12:28:48.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061071650000000003 2024-04-26T12:28:48.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966171+0000", 2024-04-26T12:28:48.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1905000000000001e-05 2024-04-26T12:28:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966204+0000", 2024-04-26T12:28:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2845999999999997e-05 2024-04-26T12:28:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:296 3.13 3:ceffbd45:::200.0000000a:head [write 598977~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1326148309999997, 2024-04-26T12:28:48.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041282538000000001, 2024-04-26T12:28:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924979+0000", 2024-04-26T12:28:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3609999999999999e-06 2024-04-26T12:28:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924984+0000", 2024-04-26T12:28:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3259999999999997e-06 2024-04-26T12:28:48.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924987+0000", 2024-04-26T12:28:48.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7810000000000001e-06 2024-04-26T12:28:48.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960618+0000", 2024-04-26T12:28:48.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035631875 2024-04-26T12:28:48.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960698+0000", 2024-04-26T12:28:48.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9373000000000001e-05 2024-04-26T12:28:48.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966208+0000", 2024-04-26T12:28:48.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055104359999999996 2024-04-26T12:28:48.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966228+0000", 2024-04-26T12:28:48.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0208e-05 2024-04-26T12:28:48.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966260+0000", 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1404e-05 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:297 3.13 3:ceffbd45:::200.0000000a:head [write 600380~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1325779970000003, 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041309850000000002, 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925017+0000", 2024-04-26T12:28:48.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.96e-06 2024-04-26T12:28:48.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925020+0000", 2024-04-26T12:28:48.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6629999999999999e-06 2024-04-26T12:28:48.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925023+0000", 2024-04-26T12:28:48.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:28:48.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961241+0000", 2024-04-26T12:28:48.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036217390000000002 2024-04-26T12:28:48.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961335+0000", 2024-04-26T12:28:48.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4537000000000006e-05 2024-04-26T12:28:48.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966264+0000", 2024-04-26T12:28:48.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004928516 2024-04-26T12:28:48.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966290+0000", 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5658999999999999e-05 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966324+0000", 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4459000000000003e-05 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.083 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:298 3.13 3:ceffbd45:::200.0000000a:head [write 602634~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.084 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:48.084 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1325454019999999, 2024-04-26T12:28:48.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046387536, 2024-04-26T12:28:48.084 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.084 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.084 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:48.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925046+0000", 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925049+0000", 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4770000000000002e-06 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925057+0000", 2024-04-26T12:28:48.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9219999999999997e-06 2024-04-26T12:28:48.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925062+0000", 2024-04-26T12:28:48.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:28:48.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961918+0000", 2024-04-26T12:28:48.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036856170000000001 2024-04-26T12:28:48.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962014+0000", 2024-04-26T12:28:48.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6731999999999995e-05 2024-04-26T12:28:48.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971360+0000", 2024-04-26T12:28:48.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0093454569999999997 2024-04-26T12:28:48.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971393+0000", 2024-04-26T12:28:48.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3130999999999998e-05 2024-04-26T12:28:48.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971434+0000", 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1244e-05 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:299 3.13 3:ceffbd45:::200.0000000a:head [write 604033~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1324915710000001, 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046395615000000001, 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.088 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.089 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:48.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:48.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925100+0000", 2024-04-26T12:28:48.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925103+0000", 2024-04-26T12:28:48.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3520000000000001e-06 2024-04-26T12:28:48.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925108+0000", 2024-04-26T12:28:48.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6489999999999996e-06 2024-04-26T12:28:48.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925111+0000", 2024-04-26T12:28:48.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.79e-06 2024-04-26T12:28:48.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962405+0000", 2024-04-26T12:28:48.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037293953999999997 2024-04-26T12:28:48.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962457+0000", 2024-04-26T12:28:48.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2003000000000003e-05 2024-04-26T12:28:48.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971440+0000", 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0089831719999999993 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971463+0000", 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3201e-05 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971496+0000", 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2836000000000002e-05 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.092 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.093 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.093 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:300 3.13 3:ceffbd45:::200.0000000a:head [write 605436~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.093 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:48.093 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1324277130000002, 2024-04-26T12:28:48.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046389606999999999, 2024-04-26T12:28:48.093 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.093 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.093 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:48.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:48.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:48.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925167+0000", 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8870000000000001e-06 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925171+0000", 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6049999999999998e-06 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925173+0000", 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8250000000000001e-06 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962740+0000", 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037566436000000002 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962818+0000", 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8231000000000004e-05 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971501+0000", 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008682525 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971522+0000", 2024-04-26T12:28:48.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1673999999999999e-05 2024-04-26T12:28:48.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971554+0000", 2024-04-26T12:28:48.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1786999999999999e-05 2024-04-26T12:28:48.097 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.097 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.097 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.097 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:301 3.13 3:ceffbd45:::200.0000000a:head [write 606838~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.097 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:48.097 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1324111050000001, 2024-04-26T12:28:48.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046429455000000001, 2024-04-26T12:28:48.098 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.098 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.098 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:48.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:48.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925183+0000", 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0150000000000002e-06 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925186+0000", 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2210000000000002e-06 2024-04-26T12:28:48.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925190+0000", 2024-04-26T12:28:48.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8489999999999999e-06 2024-04-26T12:28:48.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963304+0000", 2024-04-26T12:28:48.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038114207999999997 2024-04-26T12:28:48.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963356+0000", 2024-04-26T12:28:48.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1628000000000001e-05 2024-04-26T12:28:48.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971558+0000", 2024-04-26T12:28:48.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082025199999999996 2024-04-26T12:28:48.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971579+0000", 2024-04-26T12:28:48.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1019e-05 2024-04-26T12:28:48.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971610+0000", 2024-04-26T12:28:48.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1205999999999999e-05 2024-04-26T12:28:48.102 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.102 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.102 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.102 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:302 3.13 3:ceffbd45:::200.0000000a:head [write 608236~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.102 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:48.102 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1323899119999998, 2024-04-26T12:28:48.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046464057000000003, 2024-04-26T12:28:48.102 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.102 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.102 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925204+0000", 2024-04-26T12:28:48.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1270000000000001e-06 2024-04-26T12:28:48.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925207+0000", 2024-04-26T12:28:48.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3720000000000001e-06 2024-04-26T12:28:48.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925210+0000", 2024-04-26T12:28:48.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7489999999999999e-06 2024-04-26T12:28:48.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963713+0000", 2024-04-26T12:28:48.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038502508999999997 2024-04-26T12:28:48.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963792+0000", 2024-04-26T12:28:48.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9087999999999999e-05 2024-04-26T12:28:48.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971615+0000", 2024-04-26T12:28:48.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078230130000000002 2024-04-26T12:28:48.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971636+0000", 2024-04-26T12:28:48.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0996999999999999e-05 2024-04-26T12:28:48.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971666+0000", 2024-04-26T12:28:48.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0443999999999999e-05 2024-04-26T12:28:48.106 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.106 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.106 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.107 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:303 3.13 3:ceffbd45:::200.0000000a:head [write 609649~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.107 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:48.107 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1323468910000001, 2024-04-26T12:28:48.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.047363031, 2024-04-26T12:28:48.107 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.107 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.107 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:48.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925253+0000", 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0369999999999995e-06 2024-04-26T12:28:48.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925261+0000", 2024-04-26T12:28:48.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7420000000000003e-06 2024-04-26T12:28:48.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925271+0000", 2024-04-26T12:28:48.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1589999999999999e-06 2024-04-26T12:28:48.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964198+0000", 2024-04-26T12:28:48.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038927182999999997 2024-04-26T12:28:48.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964281+0000", 2024-04-26T12:28:48.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3355000000000004e-05 2024-04-26T12:28:48.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972542+0000", 2024-04-26T12:28:48.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082607930000000006 2024-04-26T12:28:48.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972570+0000", 2024-04-26T12:28:48.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7937999999999999e-05 2024-04-26T12:28:48.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972608+0000", 2024-04-26T12:28:48.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8384999999999999e-05 2024-04-26T12:28:48.111 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.111 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.111 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.111 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:304 3.13 3:ceffbd45:::200.0000000a:head [write 611057~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.112 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:48.112 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1311812620000001, 2024-04-26T12:28:48.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046259867000000003, 2024-04-26T12:28:48.112 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.112 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.112 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:48.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926410+0000", 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926415+0000", 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7999999999999998e-06 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926423+0000", 2024-04-26T12:28:48.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8569999999999995e-06 2024-04-26T12:28:48.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926429+0000", 2024-04-26T12:28:48.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.421e-06 2024-04-26T12:28:48.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964778+0000", 2024-04-26T12:28:48.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038349045999999998 2024-04-26T12:28:48.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964830+0000", 2024-04-26T12:28:48.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1309e-05 2024-04-26T12:28:48.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972614+0000", 2024-04-26T12:28:48.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077847070000000001 2024-04-26T12:28:48.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972638+0000", 2024-04-26T12:28:48.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3388999999999999e-05 2024-04-26T12:28:48.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972671+0000", 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2999e-05 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:305 3.13 3:ceffbd45:::200.0000000a:head [write 613824~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1311362230000004, 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046273460000000002, 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.116 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.117 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:48.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:48.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926463+0000", 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926467+0000", 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3000000000000003e-06 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926470+0000", 2024-04-26T12:28:48.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1930000000000002e-06 2024-04-26T12:28:48.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965122+0000", 2024-04-26T12:28:48.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038652207000000001 2024-04-26T12:28:48.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965210+0000", 2024-04-26T12:28:48.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7832999999999997e-05 2024-04-26T12:28:48.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972675+0000", 2024-04-26T12:28:48.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074651450000000003 2024-04-26T12:28:48.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972696+0000", 2024-04-26T12:28:48.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0871999999999999e-05 2024-04-26T12:28:48.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972729+0000", 2024-04-26T12:28:48.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:28:48.120 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.120 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:306 3.13 3:ceffbd45:::200.0000000a:head [write 618844~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1302934779999996, 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.04548866, 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:48.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927298+0000", 2024-04-26T12:28:48.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927303+0000", 2024-04-26T12:28:48.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6079999999999998e-06 2024-04-26T12:28:48.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927310+0000", 2024-04-26T12:28:48.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6240000000000002e-06 2024-04-26T12:28:48.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927319+0000", 2024-04-26T12:28:48.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:28:48.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965791+0000", 2024-04-26T12:28:48.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038471350000000001 2024-04-26T12:28:48.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965839+0000", 2024-04-26T12:28:48.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8647999999999999e-05 2024-04-26T12:28:48.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972735+0000", 2024-04-26T12:28:48.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068952429999999997 2024-04-26T12:28:48.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972755+0000", 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0219000000000001e-05 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972787+0000", 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2450000000000003e-05 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.125 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:307 3.13 3:ceffbd45:::200.0000000a:head [write 621801~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.126 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:48.126 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1302439130000002, 2024-04-26T12:28:48.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.045498166, 2024-04-26T12:28:48.126 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.126 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.126 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:48.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:48.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:48.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927351+0000", 2024-04-26T12:28:48.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7130000000000001e-06 2024-04-26T12:28:48.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927355+0000", 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1339999999999997e-06 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927358+0000", 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966366+0000", 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039008207000000003 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966457+0000", 2024-04-26T12:28:48.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1144999999999996e-05 2024-04-26T12:28:48.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972792+0000", 2024-04-26T12:28:48.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0063344819999999998 2024-04-26T12:28:48.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972815+0000", 2024-04-26T12:28:48.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3336000000000002e-05 2024-04-26T12:28:48.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972846+0000", 2024-04-26T12:28:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1504000000000002e-05 2024-04-26T12:28:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:308 3.13 3:ceffbd45:::200.0000000a:head [write 623718~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1285658679999999, 2024-04-26T12:28:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043878271000000003, 2024-04-26T12:28:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:48.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929042+0000", 2024-04-26T12:28:48.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6039e-05 2024-04-26T12:28:48.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929054+0000", 2024-04-26T12:28:48.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2275e-05 2024-04-26T12:28:48.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929063+0000", 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7150000000000004e-06 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967060+0000", 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037996907000000003 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967117+0000", 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7701999999999997e-05 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972850+0000", 2024-04-26T12:28:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0057332679999999997 2024-04-26T12:28:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972872+0000", 2024-04-26T12:28:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1138999999999999e-05 2024-04-26T12:28:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972905+0000", 2024-04-26T12:28:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2904999999999998e-05 2024-04-26T12:28:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.134 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.135 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:309 3.13 3:ceffbd45:::200.0000000a:head [write 638707~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.135 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:48.135 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.127742757, 2024-04-26T12:28:48.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043114311000000002, 2024-04-26T12:28:48.135 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.135 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.135 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:48.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929853+0000", 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2690000000000001e-06 2024-04-26T12:28:48.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929861+0000", 2024-04-26T12:28:48.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.515e-06 2024-04-26T12:28:48.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929867+0000", 2024-04-26T12:28:48.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4640000000000003e-06 2024-04-26T12:28:48.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967590+0000", 2024-04-26T12:28:48.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037722506000000003 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967672+0000", 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2082000000000005e-05 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972908+0000", 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052366289999999996 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972929+0000", 2024-04-26T12:28:48.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0752999999999999e-05 2024-04-26T12:28:48.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972964+0000", 2024-04-26T12:28:48.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4666999999999999e-05 2024-04-26T12:28:48.139 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.139 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.139 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.139 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:310 3.13 3:ceffbd45:::200.0000000a:head [write 641140~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.139 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:48.139 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1276954840000002, 2024-04-26T12:28:48.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043126171999999997, 2024-04-26T12:28:48.140 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.140 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.140 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:48.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:48.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929896+0000", 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929899+0000", 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929903+0000", 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.087e-06 2024-04-26T12:28:48.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929907+0000", 2024-04-26T12:28:48.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1480000000000002e-06 2024-04-26T12:28:48.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.969962+0000", 2024-04-26T12:28:48.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040055457000000003 2024-04-26T12:28:48.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970018+0000", 2024-04-26T12:28:48.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6209999999999999e-05 2024-04-26T12:28:48.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972968+0000", 2024-04-26T12:28:48.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029501689999999999 2024-04-26T12:28:48.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972989+0000", 2024-04-26T12:28:48.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0618000000000001e-05 2024-04-26T12:28:48.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.973023+0000", 2024-04-26T12:28:48.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-26T12:28:48.144 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.144 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.144 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.144 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:312 3.13 3:ceffbd45:::200.0000000a:head [write 648907~1910 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.144 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:48.144 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1223662289999998, 2024-04-26T12:28:48.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039844011999999998, 2024-04-26T12:28:48.144 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.144 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.144 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935225+0000", 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935229+0000", 2024-04-26T12:28:48.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1790000000000001e-06 2024-04-26T12:28:48.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935235+0000", 2024-04-26T12:28:48.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.716e-06 2024-04-26T12:28:48.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935239+0000", 2024-04-26T12:28:48.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5379999999999998e-06 2024-04-26T12:28:48.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970917+0000", 2024-04-26T12:28:48.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035678223000000002 2024-04-26T12:28:48.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971006+0000", 2024-04-26T12:28:48.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9248999999999999e-05 2024-04-26T12:28:48.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.974984+0000", 2024-04-26T12:28:48.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039776769999999998 2024-04-26T12:28:48.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975031+0000", 2024-04-26T12:28:48.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7500000000000003e-05 2024-04-26T12:28:48.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975070+0000", 2024-04-26T12:28:48.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8509e-05 2024-04-26T12:28:48.148 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.148 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.148 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.149 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:313 3.13 3:ceffbd45:::200.0000000a:head [write 650817~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:48.149 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:48.149 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.1221399009999997, 2024-04-26T12:28:48.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040236782999999998, 2024-04-26T12:28:48.149 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:48.149 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.149 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:48.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:48.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:48.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:48.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:48.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:48.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:48.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935451+0000", 2024-04-26T12:28:48.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:48.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:48.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935457+0000", 2024-04-26T12:28:48.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5079999999999996e-06 2024-04-26T12:28:48.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935467+0000", 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0407e-05 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935477+0000", 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3989999999999993e-06 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971691+0000", 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036214534 2024-04-26T12:28:48.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971741+0000", 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0294000000000003e-05 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975619+0000", 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038779259999999999 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975647+0000", 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:28:48.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:48.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:48.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:48.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975689+0000", 2024-04-26T12:28:48.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2055999999999998e-05 2024-04-26T12:28:48.153 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.153 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.153 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.153 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:48.153 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:48.153 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:48.155 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:48.156 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:48.153+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:48.168 INFO:tasks.workunit.client.0.smithi046.stdout:2/490: write d1/de/f5e [141705,82022] 0 2024-04-26T12:28:48.168 INFO:tasks.workunit.client.0.smithi046.stdout:1/492: dwrite d7/d12/d89/f8b [0,4194304] 0 2024-04-26T12:28:48.168 INFO:tasks.workunit.client.0.smithi046.stdout:1/493: fdatasync d7/d9/d2b/d96/f6d 0 2024-04-26T12:28:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:0/556: rename d9/d1d/d40/d41/d43 to d9/d1d/d40/d41/dc0 0 2024-04-26T12:28:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:2/491: creat d1/de/d65/d8f/fa3 x:0 0 0 2024-04-26T12:28:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:2/492: rmdir d1/d42 39 2024-04-26T12:28:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:1/494: creat d7/d14/d5d/d32/d41/d8f/fa7 x:0 0 0 2024-04-26T12:28:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:5/620: rename d9/da/dd/d69 to d9/da/dd/dd7 0 2024-04-26T12:28:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:4/526: write d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/f9d [433718,40637] 0 2024-04-26T12:28:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:5/621: chown d9/da/dd/d5d/fbc 167486 1 2024-04-26T12:28:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:1/495: mknod d7/d12/d3a/ca8 0 2024-04-26T12:28:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:2/493: dread - d1/de/d65/d4a/f80 zero size 2024-04-26T12:28:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:4/527: symlink d0/d1/d5/db/lab 0 2024-04-26T12:28:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:0/557: write f8 [2690153,23104] 0 2024-04-26T12:28:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:1/496: write d7/d14/f4f [2651311,64517] 0 2024-04-26T12:28:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:4/528: mknod d0/cac 0 2024-04-26T12:28:48.169 INFO:tasks.workunit.client.0.smithi046.stdout:2/494: write d1/de/d65/d4a/d58/f9d [3580575,49647] 0 2024-04-26T12:28:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:1/497: truncate d7/d12/f60 1274981 0 2024-04-26T12:28:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:0/558: symlink d9/d1d/d40/d41/d7e/da5/dad/lc1 0 2024-04-26T12:28:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:4/529: dread - d0/da/d17/d20/f7a zero size 2024-04-26T12:28:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:5/622: dwrite d9/da/dd/d34/faf [0,4194304] 0 2024-04-26T12:28:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:1/498: mknod d7/d9/d2b/d31/ca9 0 2024-04-26T12:28:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:0/559: symlink d9/d1d/d40/db3/lc2 0 2024-04-26T12:28:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:4/530: chown d0/da/d17/d20/d25/d35/d6d/d19/f3d 6970454 1 2024-04-26T12:28:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:0/560: fdatasync d9/dc/dd/f3a 0 2024-04-26T12:28:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:2/495: rename d1/de/d65/d4a/d90 to d1/de/da4 0 2024-04-26T12:28:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:5/623: mkdir d9/da/dd/d34/d44/d97/da4/d35/dd8 0 2024-04-26T12:28:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:9/470: read d0/d16/d5f/f64 [207786,14862] 0 2024-04-26T12:28:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:4/531: mknod d0/da/d17/d20/cad 0 2024-04-26T12:28:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:9/471: truncate d0/d19/d51/f99 307571 0 2024-04-26T12:28:48.170 INFO:tasks.workunit.client.0.smithi046.stdout:0/561: creat d9/dc/dd/d45/d69/fc3 x:0 0 0 2024-04-26T12:28:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:4/532: chown d0/da/d17/d20/d25/d35/d6d/d19/d55/d91 1 1 2024-04-26T12:28:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:4/533: fsync d0/da/d17/d20/d25/d35/fa7 0 2024-04-26T12:28:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:2/496: rmdir d1/de/d15/d18/d98/d99 0 2024-04-26T12:28:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:5/624: mknod d9/da/dd/dd7/d7e/cd9 0 2024-04-26T12:28:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:0/562: mkdir d9/dc/dd/d90/dc4 0 2024-04-26T12:28:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:0/563: fsync d9/d1d/d40/d41/d7e/da5/faa 0 2024-04-26T12:28:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:0/564: read - d9/d1d/fbe zero size 2024-04-26T12:28:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:9/472: dread d0/f18 [0,4194304] 0 2024-04-26T12:28:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:6/576: dread d7/f59 [0,4194304] 0 2024-04-26T12:28:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:6/577: fdatasync d7/d1b/d37/f38 0 2024-04-26T12:28:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:5/625: dwrite d9/da/dd/d5d/fad [0,4194304] 0 2024-04-26T12:28:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:8/657: dread d7/d24/d50/d2a/d39/f48 [0,4194304] 0 2024-04-26T12:28:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:6/578: chown d7/d1b/d47/f97 54196896 1 2024-04-26T12:28:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:2/497: dwrite d1/de/d65/d4a/d58/f9d [4194304,4194304] 0 2024-04-26T12:28:48.172 INFO:tasks.workunit.client.0.smithi046.stdout:8/658: chown c5 90634 1 2024-04-26T12:28:48.172 INFO:tasks.workunit.client.0.smithi046.stdout:6/579: mknod d7/d1b/cbb 0 2024-04-26T12:28:48.172 INFO:tasks.workunit.client.0.smithi046.stdout:5/626: rename d9/da/f1b to d9/da/d18/d7d/da7/fda 0 2024-04-26T12:28:48.172 INFO:tasks.workunit.client.0.smithi046.stdout:6/580: mkdir d7/d16/dbc 0 2024-04-26T12:28:48.172 INFO:tasks.workunit.client.0.smithi046.stdout:6/581: chown d7/d1b/d37/d95 10509 1 2024-04-26T12:28:48.172 INFO:tasks.workunit.client.0.smithi046.stdout:5/627: symlink d9/da/d18/dd4/ldb 0 2024-04-26T12:28:48.172 INFO:tasks.workunit.client.0.smithi046.stdout:0/565: dwrite d9/d1d/d5d/d6b/f7d [0,4194304] 0 2024-04-26T12:28:48.172 INFO:tasks.workunit.client.0.smithi046.stdout:6/582: read - d7/d1b/d37/f7d zero size 2024-04-26T12:28:48.172 INFO:tasks.workunit.client.0.smithi046.stdout:4/534: dread d0/d1/d5/db/f10 [0,4194304] 0 2024-04-26T12:28:48.172 INFO:tasks.workunit.client.0.smithi046.stdout:5/628: readlink d9/da/dd/d34/d44/d88/lc7 0 2024-04-26T12:28:48.172 INFO:tasks.workunit.client.0.smithi046.stdout:2/498: dwrite d1/de/d65/d4a/d58/f8e [0,4194304] 0 2024-04-26T12:28:48.172 INFO:tasks.workunit.client.0.smithi046.stdout:8/659: dwrite d7/d24/d50/d2a/f57 [0,4194304] 0 2024-04-26T12:28:48.172 INFO:tasks.workunit.client.0.smithi046.stdout:4/535: write d0/da/fd [4042029,84239] 0 2024-04-26T12:28:48.172 INFO:tasks.workunit.client.0.smithi046.stdout:0/566: creat d9/d1d/d40/d41/dc0/da4/fc5 x:0 0 0 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:5/629: write d9/da/d15/f75 [469677,16417] 0 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:6/583: write d7/d1b/d6a/f7e [2563252,42439] 0 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:2/499: unlink d1/de/d15/d18/l53 0 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:8/660: symlink d7/d24/d50/d2a/ldd 0 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:5/630: creat d9/da/d18/d7d/da7/fdc x:0 0 0 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:2/500: stat d1/de/d15/d18/d8a 0 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:4/536: write d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/f72 [2580880,41206] 0 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:5/631: creat d9/da/dd/d34/d44/fdd x:0 0 0 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:4/537: mkdir d0/da/d17/d20/d25/d35/d6d/d19/d55/dae 0 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:0/567: truncate d9/d1d/d40/d41/f6a 823121 0 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:4/538: mknod d0/da/d17/d20/d74/caf 0 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:5/632: mkdir d9/da/dd/d34/d44/d97/da4/dde 0 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:4/539: chown d0/da/fd 11913201 1 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:5/633: dread - d9/da/dd/d34/d44/d97/da4/d35/fc6 zero size 2024-04-26T12:28:48.173 INFO:tasks.workunit.client.0.smithi046.stdout:8/661: dwrite d7/dc/f45 [0,4194304] 0 2024-04-26T12:28:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:4/540: write d0/da/d17/d20/d8e/f98 [1042148,67497] 0 2024-04-26T12:28:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:9/473: dread d0/d19/f2f [0,4194304] 0 2024-04-26T12:28:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:2/501: dwrite d1/de/d15/d18/d8a/f95 [0,4194304] 0 2024-04-26T12:28:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:4/541: unlink d0/c8c 0 2024-04-26T12:28:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:3/609: sync 2024-04-26T12:28:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:9/474: creat d0/d2c/d3d/d52/fa6 x:0 0 0 2024-04-26T12:28:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:2/502: creat d1/de/d65/d1b/d38/d78/fa5 x:0 0 0 2024-04-26T12:28:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:8/662: dwrite d7/d24/d50/d2a/d39/fd3 [0,4194304] 0 2024-04-26T12:28:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:2/503: link d1/cc d1/ca6 0 2024-04-26T12:28:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:3/610: write d2/f17 [4087540,73595] 0 2024-04-26T12:28:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:2/504: rmdir d1/de/d65/d1b/d38/d78 39 2024-04-26T12:28:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:2/505: readlink d1/de/d65/d1b/l34 0 2024-04-26T12:28:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:4/542: truncate d0/d1/d5/db/f10 75761 0 2024-04-26T12:28:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:5/634: read d9/da/d40/f94 [3052284,125439] 0 2024-04-26T12:28:48.175 INFO:tasks.workunit.client.0.smithi046.stdout:4/543: symlink d0/da/d17/d20/lb0 0 2024-04-26T12:28:48.175 INFO:tasks.workunit.client.0.smithi046.stdout:5/635: write d9/da/dd/f32 [4571227,783] 0 2024-04-26T12:28:48.175 INFO:tasks.workunit.client.0.smithi046.stdout:8/663: dwrite d7/dc/f41 [0,4194304] 0 2024-04-26T12:28:48.175 INFO:tasks.workunit.client.0.smithi046.stdout:4/544: creat d0/da/d17/d20/fb1 x:0 0 0 2024-04-26T12:28:48.175 INFO:tasks.workunit.client.0.smithi046.stdout:3/611: dwrite d2/db/d4a/da9/fbd [0,4194304] 0 2024-04-26T12:28:48.175 INFO:tasks.workunit.client.0.smithi046.stdout:8/664: creat d7/d1c/fde x:0 0 0 2024-04-26T12:28:48.175 INFO:tasks.workunit.client.0.smithi046.stdout:4/545: unlink d0/d1/d12/f47 0 2024-04-26T12:28:48.175 INFO:tasks.workunit.client.0.smithi046.stdout:5/636: getdents d9/da/dd/d34 0 2024-04-26T12:28:48.175 INFO:tasks.workunit.client.0.smithi046.stdout:3/612: creat d2/d16/d35/dbc/fdd x:0 0 0 2024-04-26T12:28:48.175 INFO:tasks.workunit.client.0.smithi046.stdout:4/546: mknod d0/da/d17/d20/cb2 0 2024-04-26T12:28:48.175 INFO:tasks.workunit.client.0.smithi046.stdout:8/665: link d7/da/d88/fb2 d7/d24/d50/d2a/fdf 0 2024-04-26T12:28:48.175 INFO:tasks.workunit.client.0.smithi046.stdout:3/613: stat d2/d16/d2c/d50/d71/d89/dc5/d1b/c61 0 2024-04-26T12:28:48.175 INFO:tasks.workunit.client.0.smithi046.stdout:8/666: chown d7/da/l3e 2 1 2024-04-26T12:28:48.175 INFO:tasks.workunit.client.0.smithi046.stdout:3/614: dread - d2/db/d62/f87 zero size 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:5/637: truncate d9/da/d40/f94 828964 0 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:3/615: read d2/db/fa4 [7869097,110216] 0 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:8/667: dwrite f4 [4194304,4194304] 0 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:8/668: chown d7/d1c/l60 291209482 1 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:5/638: dwrite f8 [0,4194304] 0 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:3/616: write d2/d16/d2c/d50/d71/d89/dc5/d23/f26 [460674,69848] 0 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:5/639: chown d9/da/dd/d34/d44/d97/da4 79082370 1 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:3/617: rmdir d2/db0/dc4 39 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:3/618: write d2/d16/f73 [388024,70458] 0 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:3/619: chown d2/db/d62/fac 691 1 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:3/620: dread - d2/f53 zero size 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:0/568: dread d9/dc/f1a [0,4194304] 0 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:5/640: truncate d9/da/dd/d34/d44/d97/da4/d35/f67 1472612 0 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:0/569: read - d9/dc/d2a/f4a zero size 2024-04-26T12:28:48.176 INFO:tasks.workunit.client.0.smithi046.stdout:2/506: dread d1/d42/f7a [0,4194304] 0 2024-04-26T12:28:48.177 INFO:tasks.workunit.client.0.smithi046.stdout:2/507: readlink d1/de/d15/d18/l7f 0 2024-04-26T12:28:48.177 INFO:tasks.workunit.client.0.smithi046.stdout:2/508: dread d1/f3e [0,4194304] 0 2024-04-26T12:28:48.177 INFO:tasks.workunit.client.0.smithi046.stdout:2/509: unlink d1/de/d65/d4a/d58/f63 0 2024-04-26T12:28:48.177 INFO:tasks.workunit.client.0.smithi046.stdout:2/510: mknod d1/de/d65/d4a/d58/d72/ca7 0 2024-04-26T12:28:48.177 INFO:tasks.workunit.client.0.smithi046.stdout:0/570: write f3 [3863142,9947] 0 2024-04-26T12:28:48.177 INFO:tasks.workunit.client.0.smithi046.stdout:4/547: dread d0/d1/f3b [0,4194304] 0 2024-04-26T12:28:48.177 INFO:tasks.workunit.client.0.smithi046.stdout:4/548: mknod d0/da/d17/d20/d9c/cb3 0 2024-04-26T12:28:48.177 INFO:tasks.workunit.client.0.smithi046.stdout:0/571: read d9/dc/dd/fa6 [1707941,89274] 0 2024-04-26T12:28:48.177 INFO:tasks.workunit.client.0.smithi046.stdout:4/549: dread - d0/d1/d5/db/f8f zero size 2024-04-26T12:28:48.177 INFO:tasks.workunit.client.0.smithi046.stdout:2/511: link d1/de/d15/d18/d8a/c9c d1/de/d65/d4a/d86/d96/ca8 0 2024-04-26T12:28:48.177 INFO:tasks.workunit.client.0.smithi046.stdout:5/641: dwrite d9/da/d18/d7d/da7/fd5 [0,4194304] 0 2024-04-26T12:28:48.177 INFO:tasks.workunit.client.0.smithi046.stdout:4/550: creat d0/da/d17/d20/d25/fb4 x:0 0 0 2024-04-26T12:28:48.177 INFO:tasks.workunit.client.0.smithi046.stdout:5/642: write d9/da/dd/d34/f8a [239949,38139] 0 2024-04-26T12:28:48.177 INFO:tasks.workunit.client.0.smithi046.stdout:2/512: getdents d1/de/d65/d8f 0 2024-04-26T12:28:48.178 INFO:tasks.workunit.client.0.smithi046.stdout:4/551: write d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/f9d [1513284,38332] 0 2024-04-26T12:28:48.178 INFO:tasks.workunit.client.0.smithi046.stdout:7/612: sync 2024-04-26T12:28:48.178 INFO:tasks.workunit.client.0.smithi046.stdout:1/499: sync 2024-04-26T12:28:48.178 INFO:tasks.workunit.client.0.smithi046.stdout:6/584: sync 2024-04-26T12:28:48.178 INFO:tasks.workunit.client.0.smithi046.stdout:5/643: creat d9/da/dd/d34/d44/d97/da4/d35/fdf x:0 0 0 2024-04-26T12:28:48.178 INFO:tasks.workunit.client.0.smithi046.stdout:2/513: rename d1/de/d15/f64 to d1/de/d65/d4a/d58/fa9 0 2024-04-26T12:28:48.178 INFO:tasks.workunit.client.0.smithi046.stdout:4/552: rmdir d0/d1/d5 39 2024-04-26T12:28:48.178 INFO:tasks.workunit.client.0.smithi046.stdout:4/553: readlink d0/da/d17/l78 0 2024-04-26T12:28:48.178 INFO:tasks.workunit.client.0.smithi046.stdout:2/514: truncate d1/f48 874629 0 2024-04-26T12:28:48.178 INFO:tasks.workunit.client.0.smithi046.stdout:0/572: dwrite d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/f80 [4194304,4194304] 0 2024-04-26T12:28:48.178 INFO:tasks.workunit.client.0.smithi046.stdout:2/515: write d1/d42/f7a [5107813,18351] 0 2024-04-26T12:28:48.178 INFO:tasks.workunit.client.0.smithi046.stdout:0/573: getdents d9/dc 0 2024-04-26T12:28:48.180 INFO:tasks.workunit.client.0.smithi046.stdout:7/613: truncate d16/d1a/d31/d55/d6d/fcc 3306787 0 2024-04-26T12:28:48.180 INFO:tasks.workunit.client.0.smithi046.stdout:6/585: dwrite d7/d1b/d47/d65/d77/f9e [0,4194304] 0 2024-04-26T12:28:48.180 INFO:tasks.workunit.client.0.smithi046.stdout:6/586: read - d7/d2b/f8a zero size 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:1/500: dwrite d7/d12/f60 [0,4194304] 0 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:7/614: symlink d16/d35/dc9/lcf 0 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:3/621: dread d2/db/d4a/fb8 [0,4194304] 0 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:5/644: dwrite d9/da/dd/d34/d44/d97/da4/d35/fc6 [0,4194304] 0 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:6/587: symlink d7/d16/lbd 0 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:4/554: dwrite d0/da/d17/d20/d25/d35/d6d/d19/f1a [0,4194304] 0 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:2/516: truncate d1/de/d15/f46 5230648 0 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:6/588: mkdir d7/d1b/d47/d65/da3/dbe 0 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:0/574: truncate d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/f72 119149 0 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:5/645: truncate d9/da/dd/d34/fcb 147396 0 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:2/517: write d1/de/d65/f4b [2430203,77636] 0 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:7/615: mknod d16/d1a/d31/cd0 0 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:3/622: creat d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d/fde x:0 0 0 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:4/555: creat d0/da/d17/d20/d74/fb5 x:0 0 0 2024-04-26T12:28:48.181 INFO:tasks.workunit.client.0.smithi046.stdout:1/501: rename d7/d9/d2b/f97 to d7/d14/d5d/d32/faa 0 2024-04-26T12:28:48.182 INFO:tasks.workunit.client.0.smithi046.stdout:7/616: write d16/f23 [4519415,22816] 0 2024-04-26T12:28:48.183 INFO:tasks.workunit.client.0.smithi046.stdout:5/646: stat d9/da/dd/d34/d44/d97/da4/d35/f67 0 2024-04-26T12:28:48.183 INFO:tasks.workunit.client.0.smithi046.stdout:3/623: stat d2/db/l6f 0 2024-04-26T12:28:48.183 INFO:tasks.workunit.client.0.smithi046.stdout:6/589: creat d7/fbf x:0 0 0 2024-04-26T12:28:48.183 INFO:tasks.workunit.client.0.smithi046.stdout:1/502: symlink d7/d14/d5d/d6b/lab 0 2024-04-26T12:28:48.183 INFO:tasks.workunit.client.0.smithi046.stdout:2/518: write d1/de/d65/d4a/f4d [853853,93038] 0 2024-04-26T12:28:48.183 INFO:tasks.workunit.client.0.smithi046.stdout:7/617: rmdir d16/d4e/d6c/d9f 39 2024-04-26T12:28:48.183 INFO:tasks.workunit.client.0.smithi046.stdout:4/556: write d0/da/d17/d20/fb1 [241589,36906] 0 2024-04-26T12:28:48.183 INFO:tasks.workunit.client.0.smithi046.stdout:7/618: mknod d16/d4e/cd1 0 2024-04-26T12:28:48.184 INFO:tasks.workunit.client.0.smithi046.stdout:6/590: chown d7/d1b/d6a/l6c 250366 1 2024-04-26T12:28:48.184 INFO:tasks.workunit.client.0.smithi046.stdout:3/624: creat d2/d16/d2c/d50/d71/d89/dc5/d23/dbf/fdf x:0 0 0 2024-04-26T12:28:48.184 INFO:tasks.workunit.client.0.smithi046.stdout:2/519: rename d1/de/d2b/f41 to d1/de/d65/d1b/faa 0 2024-04-26T12:28:48.184 INFO:tasks.workunit.client.0.smithi046.stdout:6/591: rmdir d7/d1b/d6a 39 2024-04-26T12:28:48.184 INFO:tasks.workunit.client.0.smithi046.stdout:5/647: rename d9/da/dd/d34/d3e to d9/da/dd/dd7/db0/de0 0 2024-04-26T12:28:48.185 INFO:tasks.workunit.client.0.smithi046.stdout:3/625: creat d2/d16/d35/dbc/dc9/fe0 x:0 0 0 2024-04-26T12:28:48.185 INFO:tasks.workunit.client.0.smithi046.stdout:2/520: creat d1/de/fab x:0 0 0 2024-04-26T12:28:48.185 INFO:tasks.workunit.client.0.smithi046.stdout:5/648: mknod d9/da/dd/ce1 0 2024-04-26T12:28:48.186 INFO:tasks.workunit.client.0.smithi046.stdout:6/592: creat d7/d1b/d47/d65/da3/dbe/fc0 x:0 0 0 2024-04-26T12:28:48.186 INFO:tasks.workunit.client.0.smithi046.stdout:7/619: symlink d16/d1a/d31/d55/d6d/d89/dc7/ld2 0 2024-04-26T12:28:48.186 INFO:tasks.workunit.client.0.smithi046.stdout:2/521: rmdir d1/d71 39 2024-04-26T12:28:48.186 INFO:tasks.workunit.client.0.smithi046.stdout:1/503: read d7/d9/f58 [7563,103143] 0 2024-04-26T12:28:48.186 INFO:tasks.workunit.client.0.smithi046.stdout:6/593: mknod d7/d1b/d37/daa/cc1 0 2024-04-26T12:28:48.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/575: dread d9/dc/dd/f24 [0,4194304] 0 2024-04-26T12:28:48.193 INFO:tasks.workunit.client.0.smithi046.stdout:2/522: dwrite d1/de/d65/d1b/d38/d78/f7b [0,4194304] 0 2024-04-26T12:28:48.193 INFO:tasks.workunit.client.0.smithi046.stdout:6/594: dwrite d7/fe [0,4194304] 0 2024-04-26T12:28:48.193 INFO:tasks.workunit.client.0.smithi046.stdout:1/504: dwrite d7/d38/f90 [0,4194304] 0 2024-04-26T12:28:48.193 INFO:tasks.workunit.client.0.smithi046.stdout:6/595: dread - d7/fbf zero size 2024-04-26T12:28:48.194 INFO:tasks.workunit.client.0.smithi046.stdout:1/505: truncate d7/d12/f36 1408112 0 2024-04-26T12:28:48.196 INFO:tasks.workunit.client.0.smithi046.stdout:1/506: write d7/d12/d3a/f43 [2263672,8126] 0 2024-04-26T12:28:48.196 INFO:tasks.workunit.client.0.smithi046.stdout:0/576: dread d9/dc/f42 [0,4194304] 0 2024-04-26T12:28:48.196 INFO:tasks.workunit.client.0.smithi046.stdout:1/507: dread - d7/d9/d2b/d96/f68 zero size 2024-04-26T12:28:48.196 INFO:tasks.workunit.client.0.smithi046.stdout:4/557: getdents d0/da/d17/d20/d74 0 2024-04-26T12:28:48.198 INFO:tasks.workunit.client.0.smithi046.stdout:1/508: fdatasync d7/d14/f2f 0 2024-04-26T12:28:48.198 INFO:tasks.workunit.client.0.smithi046.stdout:2/523: link d1/ca6 d1/de/d65/d1b/d38/cac 0 2024-04-26T12:28:48.200 INFO:tasks.workunit.client.0.smithi046.stdout:4/558: unlink d0/da/d21/c5f 0 2024-04-26T12:28:48.201 INFO:tasks.workunit.client.0.smithi046.stdout:2/524: fsync d1/de/f11 0 2024-04-26T12:28:48.202 INFO:tasks.workunit.client.0.smithi046.stdout:6/596: dwrite d7/d1b/d47/d65/d77/d92/fb3 [0,4194304] 0 2024-04-26T12:28:48.203 INFO:tasks.workunit.client.0.smithi046.stdout:9/475: sync 2024-04-26T12:28:48.203 INFO:tasks.workunit.client.0.smithi046.stdout:8/669: sync 2024-04-26T12:28:48.203 INFO:tasks.workunit.client.0.smithi046.stdout:3/626: sync 2024-04-26T12:28:48.203 INFO:tasks.workunit.client.0.smithi046.stdout:1/509: symlink d7/d9/d2b/d39/lac 0 2024-04-26T12:28:48.204 INFO:tasks.workunit.client.0.smithi046.stdout:0/577: truncate d9/f10 9575205 0 2024-04-26T12:28:48.205 INFO:tasks.workunit.client.0.smithi046.stdout:4/559: creat d0/da/d17/d20/fb6 x:0 0 0 2024-04-26T12:28:48.205 INFO:tasks.workunit.client.0.smithi046.stdout:1/510: chown d7/d14/f4f 3 1 2024-04-26T12:28:48.207 INFO:tasks.workunit.client.0.smithi046.stdout:7/620: dwrite d16/d1a/d3e/d59/fc8 [0,4194304] 0 2024-04-26T12:28:48.207 INFO:tasks.workunit.client.0.smithi046.stdout:4/560: mknod d0/da/d17/cb7 0 2024-04-26T12:28:48.207 INFO:tasks.workunit.client.0.smithi046.stdout:6/597: write d7/fa [2718366,10384] 0 2024-04-26T12:28:48.207 INFO:tasks.workunit.client.0.smithi046.stdout:5/649: dwrite d9/da/dd/d34/d44/d88/d90/fbd [0,4194304] 0 2024-04-26T12:28:48.208 INFO:tasks.workunit.client.0.smithi046.stdout:8/670: getdents d7 0 2024-04-26T12:28:48.208 INFO:tasks.workunit.client.0.smithi046.stdout:9/476: write d0/d16/d76/d7d/fa5 [784266,1584] 0 2024-04-26T12:28:48.210 INFO:tasks.workunit.client.0.smithi046.stdout:6/598: symlink d7/d2b/lc2 0 2024-04-26T12:28:48.210 INFO:tasks.workunit.client.0.smithi046.stdout:7/621: fsync d16/d1a/d3e/d59/f92 0 2024-04-26T12:28:48.210 INFO:tasks.workunit.client.0.smithi046.stdout:4/561: fsync d0/da/d17/d20/d25/fb4 0 2024-04-26T12:28:48.210 INFO:tasks.workunit.client.0.smithi046.stdout:5/650: write d9/da/d15/fd1 [87904,81587] 0 2024-04-26T12:28:48.211 INFO:tasks.workunit.client.0.smithi046.stdout:2/525: rename d1/de/d15/d18/f2c to d1/de/d65/d8f/fad 0 2024-04-26T12:28:48.211 INFO:tasks.workunit.client.0.smithi046.stdout:6/599: fdatasync d7/fa2 0 2024-04-26T12:28:48.211 INFO:tasks.workunit.client.0.smithi046.stdout:0/578: mknod d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/cc6 0 2024-04-26T12:28:48.211 INFO:tasks.workunit.client.0.smithi046.stdout:1/511: write d7/d9/d2b/d39/d3c/f72 [3859311,52101] 0 2024-04-26T12:28:48.212 INFO:tasks.workunit.client.0.smithi046.stdout:4/562: symlink d0/da/da1/lb8 0 2024-04-26T12:28:48.212 INFO:tasks.workunit.client.0.smithi046.stdout:6/600: write d7/d1b/f74 [598383,27189] 0 2024-04-26T12:28:48.212 INFO:tasks.workunit.client.0.smithi046.stdout:7/622: write d16/d1a/d31/d5a/fa8 [600332,90235] 0 2024-04-26T12:28:48.214 INFO:tasks.workunit.client.0.smithi046.stdout:2/526: truncate d1/de/d15/d18/f9b 296859 0 2024-04-26T12:28:48.214 INFO:tasks.workunit.client.0.smithi046.stdout:3/627: dwrite d2/db/d4a/da9/fda [0,4194304] 0 2024-04-26T12:28:48.215 INFO:tasks.workunit.client.0.smithi046.stdout:4/563: mknod d0/da/d17/d20/d25/d35/d61/cb9 0 2024-04-26T12:28:48.215 INFO:tasks.workunit.client.0.smithi046.stdout:8/671: truncate d7/d24/d50/d62/f68 786811 0 2024-04-26T12:28:48.216 INFO:tasks.workunit.client.0.smithi046.stdout:5/651: write d9/da/dd/d34/d45/f53 [3045822,44298] 0 2024-04-26T12:28:48.216 INFO:tasks.workunit.client.0.smithi046.stdout:8/672: chown l3 12392 1 2024-04-26T12:28:48.216 INFO:tasks.workunit.client.0.smithi046.stdout:1/512: rename d7/d14/d5d/d32/d41/l4b to d7/d9/d2b/d31/d82/lad 0 2024-04-26T12:28:48.217 INFO:tasks.workunit.client.0.smithi046.stdout:0/579: write d9/dc/dd/f24 [1525714,55418] 0 2024-04-26T12:28:48.218 INFO:tasks.workunit.client.0.smithi046.stdout:4/564: symlink d0/lba 0 2024-04-26T12:28:48.218 INFO:tasks.workunit.client.0.smithi046.stdout:3/628: truncate d2/d16/d2c/fd8 500000 0 2024-04-26T12:28:48.219 INFO:tasks.workunit.client.0.smithi046.stdout:5/652: fsync d9/da/dd/d34/d44/d97/da4/d35/fdf 0 2024-04-26T12:28:48.219 INFO:tasks.workunit.client.0.smithi046.stdout:6/601: rename d7/d1b/d37/d95/f96 to d7/d1b/d47/d65/d77/d92/fc3 0 2024-04-26T12:28:48.220 INFO:tasks.workunit.client.0.smithi046.stdout:0/580: stat d9/d1d/d40/d41/d7e/da5/dad/dbd/fa8 0 2024-04-26T12:28:48.220 INFO:tasks.workunit.client.0.smithi046.stdout:1/513: write d7/db/f8c [1055456,123922] 0 2024-04-26T12:28:48.220 INFO:tasks.workunit.client.0.smithi046.stdout:3/629: stat d2/db/fa4 0 2024-04-26T12:28:48.221 INFO:tasks.workunit.client.0.smithi046.stdout:6/602: write d7/fa [633003,31626] 0 2024-04-26T12:28:48.221 INFO:tasks.workunit.client.0.smithi046.stdout:2/527: getdents d1/de/d65/d4a/d86/d96 0 2024-04-26T12:28:48.221 INFO:tasks.workunit.client.0.smithi046.stdout:8/673: write d7/d24/d50/f72 [1636115,13726] 0 2024-04-26T12:28:48.221 INFO:tasks.workunit.client.0.smithi046.stdout:9/477: dwrite d0/d2c/d47/f67 [0,4194304] 0 2024-04-26T12:28:48.223 INFO:tasks.workunit.client.0.smithi046.stdout:1/514: creat d7/fae x:0 0 0 2024-04-26T12:28:48.223 INFO:tasks.workunit.client.0.smithi046.stdout:3/630: chown d2/d16/d2c/d50/d71/d89/dc5/d23/dbf/fdf 578336 1 2024-04-26T12:28:48.223 INFO:tasks.workunit.client.0.smithi046.stdout:5/653: write d9/da/dd/dd7/db0/de0/f76 [1138125,89129] 0 2024-04-26T12:28:48.223 INFO:tasks.workunit.client.0.smithi046.stdout:4/565: mknod d0/da/d17/d20/d25/d35/d6d/d19/d55/dae/cbb 0 2024-04-26T12:28:48.223 INFO:tasks.workunit.client.0.smithi046.stdout:9/478: dread - d0/d2c/d47/f58 zero size 2024-04-26T12:28:48.223 INFO:tasks.workunit.client.0.smithi046.stdout:2/528: fdatasync d1/de/d65/d8f/fad 0 2024-04-26T12:28:48.223 INFO:tasks.workunit.client.0.smithi046.stdout:0/581: link d9/dc/d2a/f50 d9/dc/fc7 0 2024-04-26T12:28:48.224 INFO:tasks.workunit.client.0.smithi046.stdout:7/623: sync 2024-04-26T12:28:48.224 INFO:tasks.workunit.client.0.smithi046.stdout:1/515: creat d7/d12/faf x:0 0 0 2024-04-26T12:28:48.225 INFO:tasks.workunit.client.0.smithi046.stdout:8/674: creat d7/d24/d50/d2a/d39/fe0 x:0 0 0 2024-04-26T12:28:48.226 INFO:tasks.workunit.client.0.smithi046.stdout:7/624: fsync d16/f20 0 2024-04-26T12:28:48.226 INFO:tasks.workunit.client.0.smithi046.stdout:5/654: mkdir d9/da/dd/d34/d44/d97/da4/de2 0 2024-04-26T12:28:48.227 INFO:tasks.workunit.client.0.smithi046.stdout:9/479: symlink d0/d16/d76/d7d/d72/la7 0 2024-04-26T12:28:48.227 INFO:tasks.workunit.client.0.smithi046.stdout:4/566: symlink d0/da/d17/d20/d74/lbc 0 2024-04-26T12:28:48.228 INFO:tasks.workunit.client.0.smithi046.stdout:0/582: creat d9/d1d/d40/d41/dc0/da4/fc8 x:0 0 0 2024-04-26T12:28:48.229 INFO:tasks.workunit.client.0.smithi046.stdout:7/625: creat d16/d35/dc9/fd3 x:0 0 0 2024-04-26T12:28:48.229 INFO:tasks.workunit.client.0.smithi046.stdout:1/516: mkdir d7/db0 0 2024-04-26T12:28:48.230 INFO:tasks.workunit.client.0.smithi046.stdout:8/675: creat d7/dc/d1b/dae/fe1 x:0 0 0 2024-04-26T12:28:48.230 INFO:tasks.workunit.client.0.smithi046.stdout:6/603: dwrite d7/d1b/d37/f42 [0,4194304] 0 2024-04-26T12:28:48.234 INFO:tasks.workunit.client.0.smithi046.stdout:3/631: dwrite d2/db/f10 [0,4194304] 0 2024-04-26T12:28:48.234 INFO:tasks.workunit.client.0.smithi046.stdout:5/655: creat d9/da/fe3 x:0 0 0 2024-04-26T12:28:48.235 INFO:tasks.workunit.client.0.smithi046.stdout:4/567: creat d0/da/d17/d20/d9c/fbd x:0 0 0 2024-04-26T12:28:48.236 INFO:tasks.workunit.client.0.smithi046.stdout:6/604: chown d7/d2b/d31/f43 69 1 2024-04-26T12:28:48.237 INFO:tasks.workunit.client.0.smithi046.stdout:2/529: dwrite d1/de/d65/d1b/d38/f7e [0,4194304] 0 2024-04-26T12:28:48.237 INFO:tasks.workunit.client.0.smithi046.stdout:8/676: mkdir d7/dc/d1b/da0/db6/dda/de2 0 2024-04-26T12:28:48.237 INFO:tasks.workunit.client.0.smithi046.stdout:0/583: symlink d9/d1d/d40/d41/d7e/d9d/lc9 0 2024-04-26T12:28:48.238 INFO:tasks.workunit.client.0.smithi046.stdout:6/605: write d7/d16/f56 [1313547,83351] 0 2024-04-26T12:28:48.239 INFO:tasks.workunit.client.0.smithi046.stdout:3/632: creat d2/db/fe1 x:0 0 0 2024-04-26T12:28:48.240 INFO:tasks.workunit.client.0.smithi046.stdout:2/530: unlink d1/de/d65/f4b 0 2024-04-26T12:28:48.240 INFO:tasks.workunit.client.0.smithi046.stdout:4/568: creat d0/da/d17/d20/d25/d35/fbe x:0 0 0 2024-04-26T12:28:48.242 INFO:tasks.workunit.client.0.smithi046.stdout:8/677: truncate d7/dc/d1b/f8e 4656546 0 2024-04-26T12:28:48.242 INFO:tasks.workunit.client.0.smithi046.stdout:2/531: creat d1/de/da4/fae x:0 0 0 2024-04-26T12:28:48.242 INFO:tasks.workunit.client.0.smithi046.stdout:9/480: dwrite d0/d19/d51/f95 [0,4194304] 0 2024-04-26T12:28:48.242 INFO:tasks.workunit.client.0.smithi046.stdout:6/606: chown d7/d1b/d6a/d57/f8d 18 1 2024-04-26T12:28:48.242 INFO:tasks.workunit.client.0.smithi046.stdout:0/584: chown d9/dc/dd/f3a 94 1 2024-04-26T12:28:48.243 INFO:tasks.workunit.client.0.smithi046.stdout:3/633: creat d2/db0/dc4/d74/fe2 x:0 0 0 2024-04-26T12:28:48.243 INFO:tasks.workunit.client.0.smithi046.stdout:0/585: chown d9/d1d/d40/d41/dc0/db2 7212 1 2024-04-26T12:28:48.243 INFO:tasks.workunit.client.0.smithi046.stdout:9/481: mknod d0/d29/d69/ca8 0 2024-04-26T12:28:48.244 INFO:tasks.workunit.client.0.smithi046.stdout:5/656: truncate d9/da/dd/d34/f6f 2765871 0 2024-04-26T12:28:48.245 INFO:tasks.workunit.client.0.smithi046.stdout:0/586: chown d9/l77 7586017 1 2024-04-26T12:28:48.246 INFO:tasks.workunit.client.0.smithi046.stdout:4/569: mknod d0/da/d17/d20/d8e/cbf 0 2024-04-26T12:28:48.247 INFO:tasks.workunit.client.0.smithi046.stdout:9/482: write d0/d2c/f4e [561190,130015] 0 2024-04-26T12:28:48.248 INFO:tasks.workunit.client.0.smithi046.stdout:0/587: chown d9/dc/c39 8513424 1 2024-04-26T12:28:48.249 INFO:tasks.workunit.client.0.smithi046.stdout:5/657: mknod d9/da/dd/dd7/d7e/dca/ce4 0 2024-04-26T12:28:48.249 INFO:tasks.workunit.client.0.smithi046.stdout:8/678: creat d7/dc/fe3 x:0 0 0 2024-04-26T12:28:48.251 INFO:tasks.workunit.client.0.smithi046.stdout:7/626: dwrite d16/d1a/d31/d55/d6d/fcc [0,4194304] 0 2024-04-26T12:28:48.251 INFO:tasks.workunit.client.0.smithi046.stdout:9/483: chown d0/d2c/d47/f46 30636694 1 2024-04-26T12:28:48.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/607: dwrite d7/d2b/f83 [0,4194304] 0 2024-04-26T12:28:48.251 INFO:tasks.workunit.client.0.smithi046.stdout:4/570: readlink d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/l94 0 2024-04-26T12:28:48.252 INFO:tasks.workunit.client.0.smithi046.stdout:0/588: chown d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/f72 477561 1 2024-04-26T12:28:48.252 INFO:tasks.workunit.client.0.smithi046.stdout:9/484: creat d0/d2c/d47/fa9 x:0 0 0 2024-04-26T12:28:48.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/679: creat d7/dc/d27/fe4 x:0 0 0 2024-04-26T12:28:48.253 INFO:tasks.workunit.client.0.smithi046.stdout:3/634: dwrite d2/d16/d2c/d50/d71/d89/d98/dbb/fc6 [0,4194304] 0 2024-04-26T12:28:48.254 INFO:tasks.workunit.client.0.smithi046.stdout:7/627: symlink d16/d1a/d31/d5a/d93/ld4 0 2024-04-26T12:28:48.256 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:48.254+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:48.256 INFO:tasks.workunit.client.0.smithi046.stdout:0/589: chown d9/dc/d2a/f50 64623 1 2024-04-26T12:28:48.256 INFO:tasks.workunit.client.0.smithi046.stdout:9/485: chown d0/d19/l36 1994 1 2024-04-26T12:28:48.256 INFO:tasks.workunit.client.0.smithi046.stdout:6/608: truncate d7/d16/f84 5123700 0 2024-04-26T12:28:48.258 INFO:tasks.workunit.client.0.smithi046.stdout:0/590: rmdir d9/dc/d2a 39 2024-04-26T12:28:48.258 INFO:tasks.workunit.client.0.smithi046.stdout:8/680: mknod d7/d24/d50/d2a/d92/ce5 0 2024-04-26T12:28:48.260 INFO:tasks.workunit.client.0.smithi046.stdout:6/609: unlink d7/d2b/d31/d4d/l5e 0 2024-04-26T12:28:48.260 INFO:tasks.workunit.client.0.smithi046.stdout:9/486: truncate d0/d29/d69/fa4 756836 0 2024-04-26T12:28:48.260 INFO:tasks.workunit.client.0.smithi046.stdout:0/591: fdatasync d9/dc/dd/f3a 0 2024-04-26T12:28:48.260 INFO:tasks.workunit.client.0.smithi046.stdout:2/532: dwrite d1/de/d65/d1b/f61 [0,4194304] 0 2024-04-26T12:28:48.262 INFO:tasks.workunit.client.0.smithi046.stdout:9/487: chown d0/d19/f2f 319041 1 2024-04-26T12:28:48.263 INFO:tasks.workunit.client.0.smithi046.stdout:4/571: dwrite d0/da/d17/d20/d74/fb5 [0,4194304] 0 2024-04-26T12:28:48.263 INFO:tasks.workunit.client.0.smithi046.stdout:0/592: creat d9/d1d/d40/d41/d7e/fca x:0 0 0 2024-04-26T12:28:48.264 INFO:tasks.workunit.client.0.smithi046.stdout:9/488: rmdir d0 39 2024-04-26T12:28:48.264 INFO:tasks.workunit.client.0.smithi046.stdout:7/628: dwrite f9 [0,4194304] 0 2024-04-26T12:28:48.264 INFO:tasks.workunit.client.0.smithi046.stdout:6/610: creat d7/d2b/d31/fc4 x:0 0 0 2024-04-26T12:28:48.266 INFO:tasks.workunit.client.0.smithi046.stdout:5/658: truncate d9/da/dd/dd7/db0/db6/fc8 2650162 0 2024-04-26T12:28:48.266 INFO:tasks.workunit.client.0.smithi046.stdout:6/611: unlink d7/d1b/d37/f6b 0 2024-04-26T12:28:48.267 INFO:tasks.workunit.client.0.smithi046.stdout:4/572: mkdir d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/dc0 0 2024-04-26T12:28:48.267 INFO:tasks.workunit.client.0.smithi046.stdout:0/593: chown d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/c76 14185 1 2024-04-26T12:28:48.267 INFO:tasks.workunit.client.0.smithi046.stdout:9/489: rename d0/d2c/d47/f2d to d0/d16/d76/d7d/faa 0 2024-04-26T12:28:48.268 INFO:tasks.workunit.client.0.smithi046.stdout:5/659: creat d9/fe5 x:0 0 0 2024-04-26T12:28:48.268 INFO:tasks.workunit.client.0.smithi046.stdout:6/612: rename d7/d1b/c3a to d7/d16/dbc/cc5 0 2024-04-26T12:28:48.268 INFO:tasks.workunit.client.0.smithi046.stdout:4/573: write d0/da/d17/d20/d25/d35/d61/f7b [465934,119623] 0 2024-04-26T12:28:48.271 INFO:tasks.workunit.client.0.smithi046.stdout:6/613: getdents d7/d1b/d37/d95 0 2024-04-26T12:28:48.271 INFO:tasks.workunit.client.0.smithi046.stdout:5/660: write d9/da/dd/d34/d44/d88/d90/fbd [618703,17913] 0 2024-04-26T12:28:48.273 INFO:tasks.workunit.client.0.smithi046.stdout:9/490: dwrite d0/f8a [0,4194304] 0 2024-04-26T12:28:48.273 INFO:tasks.workunit.client.0.smithi046.stdout:0/594: dwrite d9/d1d/d40/d41/d7e/da5/dad/dbd/fa3 [0,4194304] 0 2024-04-26T12:28:48.274 INFO:tasks.workunit.client.0.smithi046.stdout:5/661: write d9/da/dd/d34/d44/f7c [393915,128754] 0 2024-04-26T12:28:48.275 INFO:tasks.workunit.client.0.smithi046.stdout:0/595: rename d9/d1d/d40/d41/fa9 to d9/fcb 0 2024-04-26T12:28:48.276 INFO:tasks.workunit.client.0.smithi046.stdout:0/596: rmdir d9/dc 39 2024-04-26T12:28:48.276 INFO:tasks.workunit.client.0.smithi046.stdout:9/491: link d0/d2c/l3a d0/d16/d76/d7d/d72/lab 0 2024-04-26T12:28:48.277 INFO:tasks.workunit.client.0.smithi046.stdout:5/662: chown d9/da/dd/d34/d44/d97/da4/d35/dd8 0 1 2024-04-26T12:28:48.278 INFO:tasks.workunit.client.0.smithi046.stdout:9/492: mkdir d0/d19/d51/dac 0 2024-04-26T12:28:48.279 INFO:tasks.workunit.client.0.smithi046.stdout:5/663: write d9/da/dd/d34/faf [3939795,91253] 0 2024-04-26T12:28:48.280 INFO:tasks.workunit.client.0.smithi046.stdout:5/664: write d9/da/fe3 [18101,19546] 0 2024-04-26T12:28:48.281 INFO:tasks.workunit.client.0.smithi046.stdout:5/665: chown d9/da/d18/d7d/l4a 231 1 2024-04-26T12:28:48.281 INFO:tasks.workunit.client.0.smithi046.stdout:0/597: truncate d9/dc/dd/d45/f4b 135934 0 2024-04-26T12:28:48.281 INFO:tasks.workunit.client.0.smithi046.stdout:5/666: chown d9/da/d18/f24 6603160 1 2024-04-26T12:28:48.282 INFO:tasks.workunit.client.0.smithi046.stdout:0/598: rename d9/dc/d2a/c3e to d9/dc/dd/d90/dc4/ccc 0 2024-04-26T12:28:48.282 INFO:tasks.workunit.client.0.smithi046.stdout:5/667: mknod d9/da/dd/dd7/db0/de0/ce6 0 2024-04-26T12:28:48.283 INFO:tasks.workunit.client.0.smithi046.stdout:0/599: fsync d9/d1d/d40/d41/f96 0 2024-04-26T12:28:48.284 INFO:tasks.workunit.client.0.smithi046.stdout:8/681: dread d7/da/fa9 [0,4194304] 0 2024-04-26T12:28:48.285 INFO:tasks.workunit.client.0.smithi046.stdout:8/682: stat d7/d24/d50/d62/ca4 0 2024-04-26T12:28:48.285 INFO:tasks.workunit.client.0.smithi046.stdout:1/517: dread d7/d9/fa [0,4194304] 0 2024-04-26T12:28:48.285 INFO:tasks.workunit.client.0.smithi046.stdout:3/635: dread d2/d16/d2c/d50/d71/d89/dc5/f58 [0,4194304] 0 2024-04-26T12:28:48.285 INFO:tasks.workunit.client.0.smithi046.stdout:9/493: read d0/f10 [3099622,7400] 0 2024-04-26T12:28:48.286 INFO:tasks.workunit.client.0.smithi046.stdout:1/518: read - d7/d9/f59 zero size 2024-04-26T12:28:48.287 INFO:tasks.workunit.client.0.smithi046.stdout:9/494: stat d0/d16/c25 0 2024-04-26T12:28:48.288 INFO:tasks.workunit.client.0.smithi046.stdout:3/636: readlink d2/d16/d2c/d50/d71/d89/dc5/d1b/l7e 0 2024-04-26T12:28:48.288 INFO:tasks.workunit.client.0.smithi046.stdout:1/519: chown d7/d12/d3a/l81 548388327 1 2024-04-26T12:28:48.288 INFO:tasks.workunit.client.0.smithi046.stdout:5/668: dread d9/da/dd/dd7/db0/fd0 [0,4194304] 0 2024-04-26T12:28:48.289 INFO:tasks.workunit.client.0.smithi046.stdout:4/574: dread d0/d1/f87 [0,4194304] 0 2024-04-26T12:28:48.289 INFO:tasks.workunit.client.0.smithi046.stdout:9/495: write d0/d29/f37 [5194314,49880] 0 2024-04-26T12:28:48.290 INFO:tasks.workunit.client.0.smithi046.stdout:0/600: dwrite d9/d1d/d40/d41/d7e/fb8 [0,4194304] 0 2024-04-26T12:28:48.290 INFO:tasks.workunit.client.0.smithi046.stdout:3/637: fsync d2/d16/d2c/d50/d71/d89/dc5/f58 0 2024-04-26T12:28:48.290 INFO:tasks.workunit.client.0.smithi046.stdout:5/669: rmdir d9/da/d18/dd4 39 2024-04-26T12:28:48.290 INFO:tasks.workunit.client.0.smithi046.stdout:1/520: truncate d7/d9/d2b/d96/f6d 79865 0 2024-04-26T12:28:48.291 INFO:tasks.workunit.client.0.smithi046.stdout:9/496: rename d0/d29/f4c to d0/d16/d76/d7d/fad 0 2024-04-26T12:28:48.292 INFO:tasks.workunit.client.0.smithi046.stdout:4/575: creat d0/da/d17/d20/d25/d35/fc1 x:0 0 0 2024-04-26T12:28:48.292 INFO:tasks.workunit.client.0.smithi046.stdout:1/521: symlink d7/d14/d5d/d6b/lb1 0 2024-04-26T12:28:48.293 INFO:tasks.workunit.client.0.smithi046.stdout:7/629: dread d16/d27/d51/f67 [0,4194304] 0 2024-04-26T12:28:48.293 INFO:tasks.workunit.client.0.smithi046.stdout:0/601: read - d9/dc/dd/d45/d69/f95 zero size 2024-04-26T12:28:48.294 INFO:tasks.workunit.client.0.smithi046.stdout:4/576: chown d0/da/d17/cb7 2 1 2024-04-26T12:28:48.294 INFO:tasks.workunit.client.0.smithi046.stdout:8/683: truncate d7/d24/d50/d2a/d39/d9d/f9f 2646132 0 2024-04-26T12:28:48.295 INFO:tasks.workunit.client.0.smithi046.stdout:7/630: mkdir d16/d3f/d81/daa/dd5 0 2024-04-26T12:28:48.295 INFO:tasks.workunit.client.0.smithi046.stdout:0/602: fsync d9/dc/f37 0 2024-04-26T12:28:48.295 INFO:tasks.workunit.client.0.smithi046.stdout:1/522: truncate d7/d12/d89/fa0 1023349 0 2024-04-26T12:28:48.296 INFO:tasks.workunit.client.0.smithi046.stdout:4/577: stat d0/d1/d5/c7 0 2024-04-26T12:28:48.297 INFO:tasks.workunit.client.0.smithi046.stdout:3/638: dwrite d2/db/f18 [0,4194304] 0 2024-04-26T12:28:48.298 INFO:tasks.workunit.client.0.smithi046.stdout:1/523: mknod d7/d9/d2b/d96/cb2 0 2024-04-26T12:28:48.299 INFO:tasks.workunit.client.0.smithi046.stdout:5/670: dwrite d9/da/dd/d34/d44/d97/da4/d35/fc6 [0,4194304] 0 2024-04-26T12:28:48.299 INFO:tasks.workunit.client.0.smithi046.stdout:0/603: mkdir d9/d1d/d40/d41/d7e/da5/dad/dbd/dcd 0 2024-04-26T12:28:48.300 INFO:tasks.workunit.client.0.smithi046.stdout:4/578: creat d0/da/d17/d20/d25/d35/d6d/d19/d55/dae/fc2 x:0 0 0 2024-04-26T12:28:48.300 INFO:tasks.workunit.client.0.smithi046.stdout:0/604: stat c4 0 2024-04-26T12:28:48.302 INFO:tasks.workunit.client.0.smithi046.stdout:4/579: rename d0/d1/c24 to d0/da/cc3 0 2024-04-26T12:28:48.304 INFO:tasks.workunit.client.0.smithi046.stdout:3/639: dwrite d2/db0/dc4/f42 [0,4194304] 0 2024-04-26T12:28:48.306 INFO:tasks.workunit.client.0.smithi046.stdout:3/640: dread d2/d16/d2c/d50/d71/d89/f9e [0,4194304] 0 2024-04-26T12:28:48.307 INFO:tasks.workunit.client.0.smithi046.stdout:3/641: dread - d2/fd5 zero size 2024-04-26T12:28:48.308 INFO:tasks.workunit.client.0.smithi046.stdout:3/642: symlink d2/d16/d35/dbc/dc9/dd0/le3 0 2024-04-26T12:28:48.309 INFO:tasks.workunit.client.0.smithi046.stdout:3/643: rename d2/cd6 to d2/db0/ce4 0 2024-04-26T12:28:48.310 INFO:tasks.workunit.client.0.smithi046.stdout:3/644: rename d2/d16/d35/f66 to d2/d16/d2c/d50/d71/d89/d98/fe5 0 2024-04-26T12:28:48.311 INFO:tasks.workunit.client.0.smithi046.stdout:3/645: mkdir d2/db/d84/da5/de6 0 2024-04-26T12:28:48.312 INFO:tasks.workunit.client.0.smithi046.stdout:9/497: dread d0/d16/d76/d7d/d72/d85/d97/f9c [0,4194304] 0 2024-04-26T12:28:48.312 INFO:tasks.workunit.client.0.smithi046.stdout:3/646: creat d2/db0/fe7 x:0 0 0 2024-04-26T12:28:48.313 INFO:tasks.workunit.client.0.smithi046.stdout:9/498: chown d0/d2c/f5d 81577 1 2024-04-26T12:28:48.313 INFO:tasks.workunit.client.0.smithi046.stdout:3/647: write d2/db/d84/fb3 [299207,119728] 0 2024-04-26T12:28:48.314 INFO:tasks.workunit.client.0.smithi046.stdout:9/499: dread d0/f18 [0,4194304] 0 2024-04-26T12:28:48.314 INFO:tasks.workunit.client.0.smithi046.stdout:3/648: symlink d2/d16/d35/dbc/le8 0 2024-04-26T12:28:48.315 INFO:tasks.workunit.client.0.smithi046.stdout:0/605: truncate d9/dc/dd/f27 1763543 0 2024-04-26T12:28:48.316 INFO:tasks.workunit.client.0.smithi046.stdout:3/649: creat d2/d16/d35/dbc/dc9/dd0/fe9 x:0 0 0 2024-04-26T12:28:48.316 INFO:tasks.workunit.client.0.smithi046.stdout:0/606: write d9/d1d/d40/d41/d7e/fca [187118,91822] 0 2024-04-26T12:28:48.319 INFO:tasks.workunit.client.0.smithi046.stdout:4/580: dwrite d0/d1/d5/db/f2f [4194304,4194304] 0 2024-04-26T12:28:48.320 INFO:tasks.workunit.client.0.smithi046.stdout:9/500: dwrite d0/f1d [0,4194304] 0 2024-04-26T12:28:48.321 INFO:tasks.workunit.client.0.smithi046.stdout:4/581: creat d0/da/da1/fc4 x:0 0 0 2024-04-26T12:28:48.321 INFO:tasks.workunit.client.0.smithi046.stdout:0/607: link d9/d1d/c5f d9/d1d/d40/d41/d7e/da5/dad/cce 0 2024-04-26T12:28:48.323 INFO:tasks.workunit.client.0.smithi046.stdout:9/501: chown d0/d2c/d3d/d52/f5a 2198798 1 2024-04-26T12:28:48.324 INFO:tasks.workunit.client.0.smithi046.stdout:4/582: creat d0/d1/d5/fc5 x:0 0 0 2024-04-26T12:28:48.324 INFO:tasks.workunit.client.0.smithi046.stdout:8/684: dread d7/d24/d50/f34 [0,4194304] 0 2024-04-26T12:28:48.324 INFO:tasks.workunit.client.0.smithi046.stdout:3/650: dwrite d2/d16/d35/fcc [0,4194304] 0 2024-04-26T12:28:48.325 INFO:tasks.workunit.client.0.smithi046.stdout:9/502: write d0/d2c/d3d/f5c [3204251,99929] 0 2024-04-26T12:28:48.325 INFO:tasks.workunit.client.0.smithi046.stdout:0/608: creat d9/dc/db9/fcf x:0 0 0 2024-04-26T12:28:48.325 INFO:tasks.workunit.client.0.smithi046.stdout:8/685: stat d7/da/df/f2b 0 2024-04-26T12:28:48.325 INFO:tasks.workunit.client.0.smithi046.stdout:9/503: write d0/f5 [6484997,86146] 0 2024-04-26T12:28:48.325 INFO:tasks.workunit.client.0.smithi046.stdout:0/609: fsync d9/dc/f36 0 2024-04-26T12:28:48.326 INFO:tasks.workunit.client.0.smithi046.stdout:8/686: unlink d7/d1c/d74/l78 0 2024-04-26T12:28:48.326 INFO:tasks.workunit.client.0.smithi046.stdout:9/504: symlink d0/d2c/lae 0 2024-04-26T12:28:48.327 INFO:tasks.workunit.client.0.smithi046.stdout:8/687: creat d7/da/d4f/fe6 x:0 0 0 2024-04-26T12:28:48.327 INFO:tasks.workunit.client.0.smithi046.stdout:0/610: getdents d9/d1d/d40/d41/d7e/da5 0 2024-04-26T12:28:48.328 INFO:tasks.workunit.client.0.smithi046.stdout:9/505: mkdir d0/d29/daf 0 2024-04-26T12:28:48.329 INFO:tasks.workunit.client.0.smithi046.stdout:8/688: creat d7/d24/d50/d2a/d39/d9d/fe7 x:0 0 0 2024-04-26T12:28:48.330 INFO:tasks.workunit.client.0.smithi046.stdout:2/533: sync 2024-04-26T12:28:48.332 INFO:tasks.workunit.client.0.smithi046.stdout:8/689: symlink d7/dc/d1b/dae/dcf/le8 0 2024-04-26T12:28:48.332 INFO:tasks.workunit.client.0.smithi046.stdout:5/671: dread d9/da/f20 [0,4194304] 0 2024-04-26T12:28:48.332 INFO:tasks.workunit.client.0.smithi046.stdout:8/690: write d7/d24/d50/d2a/f57 [4769213,49970] 0 2024-04-26T12:28:48.332 INFO:tasks.workunit.client.0.smithi046.stdout:5/672: write d9/da/d40/f6d [732757,74526] 0 2024-04-26T12:28:48.333 INFO:tasks.workunit.client.0.smithi046.stdout:8/691: creat d7/d24/d50/db3/fe9 x:0 0 0 2024-04-26T12:28:48.335 INFO:tasks.workunit.client.0.smithi046.stdout:5/673: dread d9/da/dd/d34/f8a [0,4194304] 0 2024-04-26T12:28:48.336 INFO:tasks.workunit.client.0.smithi046.stdout:5/674: creat d9/da/d18/dd4/fe7 x:0 0 0 2024-04-26T12:28:48.337 INFO:tasks.workunit.client.0.smithi046.stdout:8/692: dwrite f4 [0,4194304] 0 2024-04-26T12:28:48.339 INFO:tasks.workunit.client.0.smithi046.stdout:0/611: truncate d9/d1d/d40/f6e 3683012 0 2024-04-26T12:28:48.339 INFO:tasks.workunit.client.0.smithi046.stdout:5/675: mknod d9/da/dd/d34/d44/d97/da4/d35/ce8 0 2024-04-26T12:28:48.339 INFO:tasks.workunit.client.0.smithi046.stdout:9/506: write d0/d2c/d47/f23 [790647,21292] 0 2024-04-26T12:28:48.339 INFO:tasks.workunit.client.0.smithi046.stdout:8/693: rename d7/d24/d50/d2a/fc7 to d7/dc/d1b/d7d/fea 0 2024-04-26T12:28:48.340 INFO:tasks.workunit.client.0.smithi046.stdout:9/507: creat d0/d16/d76/d7d/fb0 x:0 0 0 2024-04-26T12:28:48.340 INFO:tasks.workunit.client.0.smithi046.stdout:5/676: creat d9/da/dd/d34/d44/d97/da4/d35/fe9 x:0 0 0 2024-04-26T12:28:48.341 INFO:tasks.workunit.client.0.smithi046.stdout:8/694: write d7/d24/d50/d2a/d92/fb8 [333292,12147] 0 2024-04-26T12:28:48.341 INFO:tasks.workunit.client.0.smithi046.stdout:0/612: truncate d9/d1d/d5d/f5e 2130363 0 2024-04-26T12:28:48.341 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:48.342 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:48.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.342 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:13297 4.16 4:69e5bd7d:::10000003230.00000000:head [write 790647~21292 [3@91908] in=21292b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:28:48.342 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:48.339496+0000", 2024-04-26T12:28:48.342 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.001131085, 2024-04-26T12:28:48.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0011509230000000001, 2024-04-26T12:28:48.343 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.343 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:48.343 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:48.343 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:48.343 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:48.343 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 13297 2024-04-26T12:28:48.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.343 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.339496+0000", 2024-04-26T12:28:48.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.339496+0000", 2024-04-26T12:28:48.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.339495+0000", 2024-04-26T12:28:48.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.339538+0000", 2024-04-26T12:28:48.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2978000000000001e-05 2024-04-26T12:28:48.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.339547+0000", 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4959999999999996e-06 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.339556+0000", 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6319999999999997e-06 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.339591+0000", 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5472000000000002e-05 2024-04-26T12:28:48.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.339646+0000", 2024-04-26T12:28:48.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4685000000000002e-05 2024-04-26T12:28:48.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:48.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.339725+0000", 2024-04-26T12:28:48.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9417000000000002e-05 2024-04-26T12:28:48.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.340461+0000", 2024-04-26T12:28:48.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000736014 2024-04-26T12:28:48.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.347 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.347 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-26T12:28:48.347 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 1 2024-04-26T12:28:48.347 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:48.348 INFO:tasks.workunit.client.0.smithi046.stdout:9/508: rename d0/d2c/d47/l54 to d0/lb1 0 2024-04-26T12:28:48.348 INFO:tasks.workunit.client.0.smithi046.stdout:0/613: dread d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/f72 [0,4194304] 0 2024-04-26T12:28:48.348 INFO:tasks.workunit.client.0.smithi046.stdout:9/509: creat d0/d16/d76/d7d/d72/da1/fb2 x:0 0 0 2024-04-26T12:28:48.348 INFO:tasks.workunit.client.0.smithi046.stdout:9/510: fsync d0/f15 0 2024-04-26T12:28:48.348 INFO:tasks.workunit.client.0.smithi046.stdout:8/695: dwrite d7/d24/d50/f94 [0,4194304] 0 2024-04-26T12:28:48.348 INFO:tasks.workunit.client.0.smithi046.stdout:8/696: creat d7/dc/d27/feb x:0 0 0 2024-04-26T12:28:48.348 INFO:tasks.workunit.client.0.smithi046.stdout:8/697: symlink d7/dc/d1b/d7d/dc1/lec 0 2024-04-26T12:28:48.349 INFO:tasks.workunit.client.0.smithi046.stdout:8/698: write d7/d24/d50/d2a/d39/fe0 [518057,127943] 0 2024-04-26T12:28:48.351 INFO:tasks.workunit.client.0.smithi046.stdout:8/699: mknod d7/dc/d1b/dae/dcf/ced 0 2024-04-26T12:28:48.351 INFO:tasks.workunit.client.0.smithi046.stdout:9/511: dwrite d0/d16/d76/d7d/d72/f91 [0,4194304] 0 2024-04-26T12:28:48.353 INFO:tasks.workunit.client.0.smithi046.stdout:0/614: write d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/fa1 [1159100,35447] 0 2024-04-26T12:28:48.353 INFO:tasks.workunit.client.0.smithi046.stdout:5/677: dwrite d9/da/dd/d34/f6f [0,4194304] 0 2024-04-26T12:28:48.353 INFO:tasks.workunit.client.0.smithi046.stdout:0/615: chown d9/d1d/d40/d41/f7c 353636 1 2024-04-26T12:28:48.354 INFO:tasks.workunit.client.0.smithi046.stdout:5/678: symlink d9/da/d18/d7d/lea 0 2024-04-26T12:28:48.354 INFO:tasks.workunit.client.0.smithi046.stdout:5/679: fdatasync d9/da/fe3 0 2024-04-26T12:28:48.355 INFO:tasks.workunit.client.0.smithi046.stdout:0/616: mkdir d9/d1d/d40/d41/d7e/da5/dad/dbd/dd0 0 2024-04-26T12:28:48.355 INFO:tasks.workunit.client.0.smithi046.stdout:5/680: fsync d9/da/d15/fb9 0 2024-04-26T12:28:48.355 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:48.354+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:48.356 INFO:tasks.workunit.client.0.smithi046.stdout:0/617: rename d9/dc/dd/c8d to d9/dc/dd/d90/dc4/cd1 0 2024-04-26T12:28:48.358 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:48.359 INFO:tasks.workunit.client.0.smithi046.stdout:5/681: rmdir d9 39 2024-04-26T12:28:48.359 INFO:tasks.workunit.client.0.smithi046.stdout:0/618: chown d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/f72 102538425 1 2024-04-26T12:28:48.359 INFO:tasks.workunit.client.0.smithi046.stdout:0/619: fdatasync d9/dc/f1c 0 2024-04-26T12:28:48.359 INFO:tasks.workunit.client.0.smithi046.stdout:5/682: rename d9/da/dd/d34/f49 to d9/da/dd/dd7/db0/db6/feb 0 2024-04-26T12:28:48.360 INFO:tasks.workunit.client.0.smithi046.stdout:0/620: mkdir d9/dc/dd/dd2 0 2024-04-26T12:28:48.361 INFO:tasks.workunit.client.0.smithi046.stdout:0/621: chown d9/d1d/d40/d41/dc0/da4/fc8 5 1 2024-04-26T12:28:48.362 INFO:tasks.workunit.client.0.smithi046.stdout:2/534: dread d1/de/d65/d4a/d58/f9d [0,4194304] 0 2024-04-26T12:28:48.362 INFO:tasks.workunit.client.0.smithi046.stdout:0/622: dread - d9/d1d/d40/d41/d7e/da5/faa zero size 2024-04-26T12:28:48.363 INFO:tasks.workunit.client.0.smithi046.stdout:0/623: chown d9/dc/dd/d45/f4e 4475 1 2024-04-26T12:28:48.363 INFO:tasks.workunit.client.0.smithi046.stdout:2/535: link d1/de/d65/f66 d1/de/d65/d4a/d86/d96/faf 0 2024-04-26T12:28:48.364 INFO:tasks.workunit.client.0.smithi046.stdout:0/624: unlink d9/d1d/d5d/d6b/d8a/d8c/f8f 0 2024-04-26T12:28:48.365 INFO:tasks.workunit.client.0.smithi046.stdout:0/625: truncate d9/dc/dd/d45/d69/f95 926775 0 2024-04-26T12:28:48.365 INFO:tasks.workunit.client.0.smithi046.stdout:6/614: sync 2024-04-26T12:28:48.365 INFO:tasks.workunit.client.0.smithi046.stdout:7/631: sync 2024-04-26T12:28:48.365 INFO:tasks.workunit.client.0.smithi046.stdout:4/583: sync 2024-04-26T12:28:48.366 INFO:tasks.workunit.client.0.smithi046.stdout:3/651: sync 2024-04-26T12:28:48.366 INFO:tasks.workunit.client.0.smithi046.stdout:1/524: sync 2024-04-26T12:28:48.366 INFO:tasks.workunit.client.0.smithi046.stdout:0/626: readlink d9/d1d/d5d/l68 0 2024-04-26T12:28:48.367 INFO:tasks.workunit.client.0.smithi046.stdout:7/632: fdatasync d16/d1a/d3e/d59/fc8 0 2024-04-26T12:28:48.367 INFO:tasks.workunit.client.0.smithi046.stdout:3/652: creat d2/db0/dc4/fea x:0 0 0 2024-04-26T12:28:48.368 INFO:tasks.workunit.client.0.smithi046.stdout:1/525: rename d7/d38 to d7/d9/d2b/d39/db3 0 2024-04-26T12:28:48.369 INFO:tasks.workunit.client.0.smithi046.stdout:0/627: creat d9/d1d/d40/db3/fd3 x:0 0 0 2024-04-26T12:28:48.369 INFO:tasks.workunit.client.0.smithi046.stdout:7/633: creat d16/d1a/d3e/dc5/fd6 x:0 0 0 2024-04-26T12:28:48.370 INFO:tasks.workunit.client.0.smithi046.stdout:1/526: creat d7/d9/d2b/d96/fb4 x:0 0 0 2024-04-26T12:28:48.370 INFO:tasks.workunit.client.0.smithi046.stdout:0/628: symlink d9/db5/ld4 0 2024-04-26T12:28:48.370 INFO:tasks.workunit.client.0.smithi046.stdout:3/653: read d2/db/d4a/f40 [3289818,12830] 0 2024-04-26T12:28:48.371 INFO:tasks.workunit.client.0.smithi046.stdout:1/527: symlink d7/d14/lb5 0 2024-04-26T12:28:48.373 INFO:tasks.workunit.client.0.smithi046.stdout:5/683: dwrite d9/da/dd/dd7/db0/db6/fc8 [0,4194304] 0 2024-04-26T12:28:48.373 INFO:tasks.workunit.client.0.smithi046.stdout:7/634: read d16/d3f/f47 [4135924,4915] 0 2024-04-26T12:28:48.373 INFO:tasks.workunit.client.0.smithi046.stdout:2/536: dread d1/de/d65/d4a/f59 [0,4194304] 0 2024-04-26T12:28:48.373 INFO:tasks.workunit.client.0.smithi046.stdout:3/654: read - d2/d16/d2c/d50/d71/d89/d98/dbb/fca zero size 2024-04-26T12:28:48.374 INFO:tasks.workunit.client.0.smithi046.stdout:3/655: dread - d2/fd5 zero size 2024-04-26T12:28:48.374 INFO:tasks.workunit.client.0.smithi046.stdout:2/537: write d1/f35 [3423886,67382] 0 2024-04-26T12:28:48.375 INFO:tasks.workunit.client.0.smithi046.stdout:6/615: dread d7/d1b/d6a/f5a [0,4194304] 0 2024-04-26T12:28:48.375 INFO:tasks.workunit.client.0.smithi046.stdout:4/584: dread d0/da/d17/d20/d25/d35/d6d/d19/d55/f82 [0,4194304] 0 2024-04-26T12:28:48.376 INFO:tasks.workunit.client.0.smithi046.stdout:0/629: truncate d9/d1d/d5d/d6b/d8a/d8c/fac 681848 0 2024-04-26T12:28:48.377 INFO:tasks.workunit.client.0.smithi046.stdout:3/656: chown d2/d16/d2c/d50/d71/d89/dc5/d23/f26 3804 1 2024-04-26T12:28:48.377 INFO:tasks.workunit.client.0.smithi046.stdout:2/538: mknod d1/de/d2b/cb0 0 2024-04-26T12:28:48.377 INFO:tasks.workunit.client.0.smithi046.stdout:5/684: write d9/da/d18/d7d/fb2 [190559,44953] 0 2024-04-26T12:28:48.378 INFO:tasks.workunit.client.0.smithi046.stdout:6/616: creat d7/d1b/d47/d65/fc6 x:0 0 0 2024-04-26T12:28:48.379 INFO:tasks.workunit.client.0.smithi046.stdout:7/635: dwrite f9 [0,4194304] 0 2024-04-26T12:28:48.379 INFO:tasks.workunit.client.0.smithi046.stdout:1/528: getdents d7 0 2024-04-26T12:28:48.379 INFO:tasks.workunit.client.0.smithi046.stdout:4/585: dread d0/da/d17/d20/d25/d35/d6d/d19/d55/f82 [0,4194304] 0 2024-04-26T12:28:48.380 INFO:tasks.workunit.client.0.smithi046.stdout:5/685: creat d9/da/d18/d7d/da7/fec x:0 0 0 2024-04-26T12:28:48.380 INFO:tasks.workunit.client.0.smithi046.stdout:0/630: fsync d9/dc/dd/f2f 0 2024-04-26T12:28:48.380 INFO:tasks.workunit.client.0.smithi046.stdout:6/617: creat d7/da7/daf/fc7 x:0 0 0 2024-04-26T12:28:48.380 INFO:tasks.workunit.client.0.smithi046.stdout:2/539: mkdir d1/de/db1 0 2024-04-26T12:28:48.381 INFO:tasks.workunit.client.0.smithi046.stdout:6/618: dread - d7/f8b zero size 2024-04-26T12:28:48.381 INFO:tasks.workunit.client.0.smithi046.stdout:4/586: write d0/da/d17/d20/f7f [298165,91407] 0 2024-04-26T12:28:48.381 INFO:tasks.workunit.client.0.smithi046.stdout:5/686: write d9/da/dd/dd7/fae [976826,12370] 0 2024-04-26T12:28:48.383 INFO:tasks.workunit.client.0.smithi046.stdout:1/529: creat d7/d9/d2b/d31/d82/fb6 x:0 0 0 2024-04-26T12:28:48.383 INFO:tasks.workunit.client.0.smithi046.stdout:4/587: write d0/da/d21/f73 [245162,89797] 0 2024-04-26T12:28:48.383 INFO:tasks.workunit.client.0.smithi046.stdout:2/540: creat d1/de/db1/fb2 x:0 0 0 2024-04-26T12:28:48.383 INFO:tasks.workunit.client.0.smithi046.stdout:0/631: creat d9/d1d/d40/d41/d7e/fd5 x:0 0 0 2024-04-26T12:28:48.384 INFO:tasks.workunit.client.0.smithi046.stdout:2/541: fdatasync d1/f35 0 2024-04-26T12:28:48.384 INFO:tasks.workunit.client.0.smithi046.stdout:6/619: write d7/d1b/d47/d65/d77/d92/fc3 [1284070,48232] 0 2024-04-26T12:28:48.384 INFO:tasks.workunit.client.0.smithi046.stdout:5/687: write d9/f4f [2584307,68494] 0 2024-04-26T12:28:48.386 INFO:tasks.workunit.client.0.smithi046.stdout:4/588: mkdir d0/da/d17/d20/d25/d35/d61/dc6 0 2024-04-26T12:28:48.386 INFO:tasks.workunit.client.0.smithi046.stdout:0/632: chown d9/d1d/d5d/d6b/d8a/d8c/fac 1909 1 2024-04-26T12:28:48.386 INFO:tasks.workunit.client.0.smithi046.stdout:2/542: creat d1/de/d15/d18/d91/d9f/fb3 x:0 0 0 2024-04-26T12:28:48.387 INFO:tasks.workunit.client.0.smithi046.stdout:0/633: creat d9/fd6 x:0 0 0 2024-04-26T12:28:48.388 INFO:tasks.workunit.client.0.smithi046.stdout:5/688: dread - d9/da/dd/d34/fd2 zero size 2024-04-26T12:28:48.388 INFO:tasks.workunit.client.0.smithi046.stdout:3/657: dwrite d2/d16/d2c/d50/d71/d89/d98/fe5 [0,4194304] 0 2024-04-26T12:28:48.389 INFO:tasks.workunit.client.0.smithi046.stdout:2/543: mknod d1/de/d65/d4a/d86/cb4 0 2024-04-26T12:28:48.390 INFO:tasks.workunit.client.0.smithi046.stdout:1/530: dread d7/d14/d5d/f30 [0,4194304] 0 2024-04-26T12:28:48.390 INFO:tasks.workunit.client.0.smithi046.stdout:5/689: write d9/da/dd/d34/d45/f56 [2203511,88475] 0 2024-04-26T12:28:48.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/620: dwrite d7/d16/f4a [0,4194304] 0 2024-04-26T12:28:48.392 INFO:tasks.workunit.client.0.smithi046.stdout:0/634: link d9/d1d/d40/d41/dc0/f83 d9/d1d/d5d/d6b/d8a/d8c/fd7 0 2024-04-26T12:28:48.393 INFO:tasks.workunit.client.0.smithi046.stdout:1/531: chown d7/d9/d2b/d31/l8a 416 1 2024-04-26T12:28:48.394 INFO:tasks.workunit.client.0.smithi046.stdout:2/544: link d1/de/d65/d1b/d38/c74 d1/de/d65/d1b/d38/d78/cb5 0 2024-04-26T12:28:48.395 INFO:tasks.workunit.client.0.smithi046.stdout:8/700: sync 2024-04-26T12:28:48.395 INFO:tasks.workunit.client.0.smithi046.stdout:9/512: sync 2024-04-26T12:28:48.395 INFO:tasks.workunit.client.0.smithi046.stdout:4/589: sync 2024-04-26T12:28:48.396 INFO:tasks.workunit.client.0.smithi046.stdout:4/590: chown d0/c18 3 1 2024-04-26T12:28:48.397 INFO:tasks.workunit.client.0.smithi046.stdout:1/532: rename d7/d9/d2b/c87 to d7/d14/d5d/d6b/cb7 0 2024-04-26T12:28:48.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/635: creat d9/d1d/d40/d41/d7e/d9d/fd8 x:0 0 0 2024-04-26T12:28:48.397 INFO:tasks.workunit.client.0.smithi046.stdout:8/701: chown d7/dc/d1b/f79 36359206 1 2024-04-26T12:28:48.397 INFO:tasks.workunit.client.0.smithi046.stdout:9/513: mknod d0/d2c/d47/cb3 0 2024-04-26T12:28:48.397 INFO:tasks.workunit.client.0.smithi046.stdout:2/545: truncate d1/de/d15/d18/f9b 454906 0 2024-04-26T12:28:48.398 INFO:tasks.workunit.client.0.smithi046.stdout:9/514: dread - d0/f9a zero size 2024-04-26T12:28:48.398 INFO:tasks.workunit.client.0.smithi046.stdout:4/591: mkdir d0/da/d70/dc7 0 2024-04-26T12:28:48.398 INFO:tasks.workunit.client.0.smithi046.stdout:2/546: unlink d1/de/d67/c79 0 2024-04-26T12:28:48.398 INFO:tasks.workunit.client.0.smithi046.stdout:9/515: chown d0/f8a 20 1 2024-04-26T12:28:48.398 INFO:tasks.workunit.client.0.smithi046.stdout:1/533: rename d7/d9/f66 to d7/d9/d2b/fb8 0 2024-04-26T12:28:48.399 INFO:tasks.workunit.client.0.smithi046.stdout:9/516: dread - d0/d19/f8c zero size 2024-04-26T12:28:48.400 INFO:tasks.workunit.client.0.smithi046.stdout:1/534: dread - d7/d14/d5d/f7d zero size 2024-04-26T12:28:48.401 INFO:tasks.workunit.client.0.smithi046.stdout:9/517: link d0/d19/c7b d0/d16/d5f/cb4 0 2024-04-26T12:28:48.401 INFO:tasks.workunit.client.0.smithi046.stdout:1/535: getdents d7/d9/d2b/d31/d82/d95 0 2024-04-26T12:28:48.403 INFO:tasks.workunit.client.0.smithi046.stdout:1/536: creat d7/db/d98/fb9 x:0 0 0 2024-04-26T12:28:48.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/547: dwrite d1/de/d65/d4a/f59 [0,4194304] 0 2024-04-26T12:28:48.406 INFO:tasks.workunit.client.0.smithi046.stdout:1/537: creat d7/d14/d5d/d6b/fba x:0 0 0 2024-04-26T12:28:48.406 INFO:tasks.workunit.client.0.smithi046.stdout:2/548: mkdir d1/de/d15/d18/d91/d9f/db6 0 2024-04-26T12:28:48.406 INFO:tasks.workunit.client.0.smithi046.stdout:2/549: readlink d1/l76 0 2024-04-26T12:28:48.406 INFO:tasks.workunit.client.0.smithi046.stdout:2/550: symlink d1/de/da4/lb7 0 2024-04-26T12:28:48.411 INFO:tasks.workunit.client.0.smithi046.stdout:1/538: dread d7/db/f8c [0,4194304] 0 2024-04-26T12:28:48.411 INFO:tasks.workunit.client.0.smithi046.stdout:2/551: dwrite d1/de/d65/d4a/f4d [0,4194304] 0 2024-04-26T12:28:48.412 INFO:tasks.workunit.client.0.smithi046.stdout:1/539: getdents d7/d14 0 2024-04-26T12:28:48.412 INFO:tasks.workunit.client.0.smithi046.stdout:2/552: rename d1/d42/c6a to d1/de/cb8 0 2024-04-26T12:28:48.413 INFO:tasks.workunit.client.0.smithi046.stdout:2/553: write d1/de/d65/f56 [1194051,53938] 0 2024-04-26T12:28:48.413 INFO:tasks.workunit.client.0.smithi046.stdout:1/540: creat d7/d14/d5d/d32/fbb x:0 0 0 2024-04-26T12:28:48.414 INFO:tasks.workunit.client.0.smithi046.stdout:0/636: dread d9/d1d/f3c [0,4194304] 0 2024-04-26T12:28:48.414 INFO:tasks.workunit.client.0.smithi046.stdout:1/541: creat d7/d14/d5d/d32/d41/fbc x:0 0 0 2024-04-26T12:28:48.415 INFO:tasks.workunit.client.0.smithi046.stdout:0/637: creat d9/db5/fd9 x:0 0 0 2024-04-26T12:28:48.415 INFO:tasks.workunit.client.0.smithi046.stdout:8/702: sync 2024-04-26T12:28:48.415 INFO:tasks.workunit.client.0.smithi046.stdout:1/542: readlink d7/d14/d5d/d32/l3d 0 2024-04-26T12:28:48.415 INFO:tasks.workunit.client.0.smithi046.stdout:7/636: dread d16/d1a/d31/d62/f88 [0,4194304] 0 2024-04-26T12:28:48.416 INFO:tasks.workunit.client.0.smithi046.stdout:2/554: rename d1/de/ff to d1/de/d15/d18/d91/fb9 0 2024-04-26T12:28:48.416 INFO:tasks.workunit.client.0.smithi046.stdout:8/703: fsync d7/dc/d1b/dae/fc4 0 2024-04-26T12:28:48.416 INFO:tasks.workunit.client.0.smithi046.stdout:2/555: rmdir d1/de/d65/d1b 39 2024-04-26T12:28:48.417 INFO:tasks.workunit.client.0.smithi046.stdout:7/637: stat d16/d1a/d31/d5a/f50 0 2024-04-26T12:28:48.418 INFO:tasks.workunit.client.0.smithi046.stdout:0/638: symlink d9/d1d/d40/d41/d7e/da5/lda 0 2024-04-26T12:28:48.418 INFO:tasks.workunit.client.0.smithi046.stdout:1/543: creat d7/d14/d5d/d32/fbd x:0 0 0 2024-04-26T12:28:48.418 INFO:tasks.workunit.client.0.smithi046.stdout:2/556: readlink d1/de/d15/d18/l1a 0 2024-04-26T12:28:48.418 INFO:tasks.workunit.client.0.smithi046.stdout:2/557: stat d1/f2 0 2024-04-26T12:28:48.419 INFO:tasks.workunit.client.0.smithi046.stdout:0/639: write d9/dc/d2a/f4a [717542,47513] 0 2024-04-26T12:28:48.420 INFO:tasks.workunit.client.0.smithi046.stdout:1/544: symlink d7/d9/d2b/d31/d82/d95/lbe 0 2024-04-26T12:28:48.421 INFO:tasks.workunit.client.0.smithi046.stdout:2/558: getdents d1/de/d65/d4a 0 2024-04-26T12:28:48.422 INFO:tasks.workunit.client.0.smithi046.stdout:2/559: rmdir d1/de/d15/d18/d8a 39 2024-04-26T12:28:48.422 INFO:tasks.workunit.client.0.smithi046.stdout:6/621: dread d7/d2b/d31/f43 [0,4194304] 0 2024-04-26T12:28:48.422 INFO:tasks.workunit.client.0.smithi046.stdout:1/545: creat d7/d9/d2b/fbf x:0 0 0 2024-04-26T12:28:48.424 INFO:tasks.workunit.client.0.smithi046.stdout:7/638: dwrite d16/d3f/f47 [0,4194304] 0 2024-04-26T12:28:48.424 INFO:tasks.workunit.client.0.smithi046.stdout:6/622: creat d7/fc8 x:0 0 0 2024-04-26T12:28:48.424 INFO:tasks.workunit.client.0.smithi046.stdout:7/639: readlink l2 0 2024-04-26T12:28:48.425 INFO:tasks.workunit.client.0.smithi046.stdout:2/560: truncate d1/de/d65/d8f/fad 6084101 0 2024-04-26T12:28:48.425 INFO:tasks.workunit.client.0.smithi046.stdout:6/623: rename d7/d1b/c61 to d7/d16/dbc/cc9 0 2024-04-26T12:28:48.427 INFO:tasks.workunit.client.0.smithi046.stdout:6/624: rename d7/d2b/lc2 to d7/d16/lca 0 2024-04-26T12:28:48.428 INFO:tasks.workunit.client.0.smithi046.stdout:6/625: chown d7/d16/l18 19672 1 2024-04-26T12:28:48.430 INFO:tasks.workunit.client.0.smithi046.stdout:3/658: dread d2/d16/d2c/d50/d71/d89/dc5/d1b/fab [0,4194304] 0 2024-04-26T12:28:48.430 INFO:tasks.workunit.client.0.smithi046.stdout:9/518: dread d0/d19/d21/f53 [0,4194304] 0 2024-04-26T12:28:48.431 INFO:tasks.workunit.client.0.smithi046.stdout:7/640: dwrite d16/f23 [0,4194304] 0 2024-04-26T12:28:48.431 INFO:tasks.workunit.client.0.smithi046.stdout:5/690: dread d9/da/dd/f1e [0,4194304] 0 2024-04-26T12:28:48.432 INFO:tasks.workunit.client.0.smithi046.stdout:7/641: write f4 [2858177,10722] 0 2024-04-26T12:28:48.433 INFO:tasks.workunit.client.0.smithi046.stdout:2/561: dwrite d1/de/d15/d18/f4c [0,4194304] 0 2024-04-26T12:28:48.433 INFO:tasks.workunit.client.0.smithi046.stdout:3/659: chown d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/f4c 1341 1 2024-04-26T12:28:48.434 INFO:tasks.workunit.client.0.smithi046.stdout:0/640: dread d9/dc/dd/d45/f4b [0,4194304] 0 2024-04-26T12:28:48.434 INFO:tasks.workunit.client.0.smithi046.stdout:5/691: write d9/da/dd/d34/d44/d97/da4/fa3 [1244205,70007] 0 2024-04-26T12:28:48.435 INFO:tasks.workunit.client.0.smithi046.stdout:3/660: fdatasync d2/db/d4a/f40 0 2024-04-26T12:28:48.435 INFO:tasks.workunit.client.0.smithi046.stdout:4/592: dread d0/d1/f15 [0,4194304] 0 2024-04-26T12:28:48.436 INFO:tasks.workunit.client.0.smithi046.stdout:5/692: dread - d9/da/dd/dd7/db0/fc1 zero size 2024-04-26T12:28:48.436 INFO:tasks.workunit.client.0.smithi046.stdout:7/642: chown d16/d1a/d3e/f44 977723736 1 2024-04-26T12:28:48.436 INFO:tasks.workunit.client.0.smithi046.stdout:0/641: unlink d9/d1d/d40/d41/dc0/f5b 0 2024-04-26T12:28:48.437 INFO:tasks.workunit.client.0.smithi046.stdout:2/562: mknod d1/de/d15/d18/d91/d9f/cba 0 2024-04-26T12:28:48.437 INFO:tasks.workunit.client.0.smithi046.stdout:7/643: write d16/d1a/d31/d4d/fa5 [837657,55883] 0 2024-04-26T12:28:48.437 INFO:tasks.workunit.client.0.smithi046.stdout:3/661: write d2/db/f18 [3507326,121073] 0 2024-04-26T12:28:48.438 INFO:tasks.workunit.client.0.smithi046.stdout:5/693: readlink d9/da/dd/d34/d6b/l9e 0 2024-04-26T12:28:48.438 INFO:tasks.workunit.client.0.smithi046.stdout:4/593: mknod d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/cc8 0 2024-04-26T12:28:48.439 INFO:tasks.workunit.client.0.smithi046.stdout:0/642: symlink d9/d1d/ldb 0 2024-04-26T12:28:48.439 INFO:tasks.workunit.client.0.smithi046.stdout:2/563: symlink d1/de/d15/d18/d8a/lbb 0 2024-04-26T12:28:48.440 INFO:tasks.workunit.client.0.smithi046.stdout:3/662: truncate d2/db/d62/fac 418185 0 2024-04-26T12:28:48.440 INFO:tasks.workunit.client.0.smithi046.stdout:2/564: chown d1/l76 58525 1 2024-04-26T12:28:48.440 INFO:tasks.workunit.client.0.smithi046.stdout:4/594: truncate d0/da/da1/f9e 368428 0 2024-04-26T12:28:48.442 INFO:tasks.workunit.client.0.smithi046.stdout:5/694: rename d9/da/d18/d7d/da7/fdc to d9/da/dd/dd7/db0/de0/fed 0 2024-04-26T12:28:48.442 INFO:tasks.workunit.client.0.smithi046.stdout:2/565: symlink d1/de/d15/d18/d8a/lbc 0 2024-04-26T12:28:48.444 INFO:tasks.workunit.client.0.smithi046.stdout:0/643: write d9/d1d/f58 [1588539,32471] 0 2024-04-26T12:28:48.444 INFO:tasks.workunit.client.0.smithi046.stdout:7/644: dwrite d16/d4e/f52 [0,4194304] 0 2024-04-26T12:28:48.447 INFO:tasks.workunit.client.0.smithi046.stdout:7/645: fdatasync d16/d1a/d31/d62/f88 0 2024-04-26T12:28:48.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/695: symlink d9/da/dd/d34/d44/d97/da4/dde/lee 0 2024-04-26T12:28:48.447 INFO:tasks.workunit.client.0.smithi046.stdout:8/704: dread d7/da/df/f5e [0,4194304] 0 2024-04-26T12:28:48.449 INFO:tasks.workunit.client.0.smithi046.stdout:0/644: symlink d9/d1d/d40/d41/dc0/db2/ldc 0 2024-04-26T12:28:48.449 INFO:tasks.workunit.client.0.smithi046.stdout:3/663: dwrite d2/d16/d2c/d50/d71/d89/fba [0,4194304] 0 2024-04-26T12:28:48.450 INFO:tasks.workunit.client.0.smithi046.stdout:7/646: rmdir d16/d1a/d3e/d59 39 2024-04-26T12:28:48.450 INFO:tasks.workunit.client.0.smithi046.stdout:3/664: chown d2/d16/d2c/d50/d71/d89/dc5/d23/c6c 8 1 2024-04-26T12:28:48.451 INFO:tasks.workunit.client.0.smithi046.stdout:4/595: dwrite d0/da/da1/f34 [0,4194304] 0 2024-04-26T12:28:48.451 INFO:tasks.workunit.client.0.smithi046.stdout:1/546: dread d7/d12/d3a/f54 [0,4194304] 0 2024-04-26T12:28:48.451 INFO:tasks.workunit.client.0.smithi046.stdout:9/519: dread d0/d2c/f4e [0,4194304] 0 2024-04-26T12:28:48.452 INFO:tasks.workunit.client.0.smithi046.stdout:0/645: mkdir d9/d1d/d40/d41/d7e/ddd 0 2024-04-26T12:28:48.452 INFO:tasks.workunit.client.0.smithi046.stdout:3/665: chown d2/f17 2039570043 1 2024-04-26T12:28:48.452 INFO:tasks.workunit.client.0.smithi046.stdout:7/647: write d16/d4e/f52 [4737866,109749] 0 2024-04-26T12:28:48.452 INFO:tasks.workunit.client.0.smithi046.stdout:4/596: chown d0/d1/d12/l66 0 1 2024-04-26T12:28:48.453 INFO:tasks.workunit.client.0.smithi046.stdout:5/696: creat d9/da/dd/d34/d44/d97/da4/dde/fef x:0 0 0 2024-04-26T12:28:48.453 INFO:tasks.workunit.client.0.smithi046.stdout:8/705: mknod d7/dc/d1b/da0/db6/dda/de2/cee 0 2024-04-26T12:28:48.453 INFO:tasks.workunit.client.0.smithi046.stdout:2/566: getdents d1/de/d15/d18/d91/d9f/db6 0 2024-04-26T12:28:48.453 INFO:tasks.workunit.client.0.smithi046.stdout:7/648: readlink d16/d1a/d69/l8d 0 2024-04-26T12:28:48.453 INFO:tasks.workunit.client.0.smithi046.stdout:3/666: fdatasync d2/db/d4a/f40 0 2024-04-26T12:28:48.453 INFO:tasks.workunit.client.0.smithi046.stdout:9/520: truncate d0/d19/d51/f57 853232 0 2024-04-26T12:28:48.454 INFO:tasks.workunit.client.0.smithi046.stdout:5/697: unlink d9/da/d18/d7d/f63 0 2024-04-26T12:28:48.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/521: mkdir d0/d29/d69/db5 0 2024-04-26T12:28:48.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/522: stat d0/d29/l84 0 2024-04-26T12:28:48.456 INFO:tasks.workunit.client.0.smithi046.stdout:7/649: write d16/d1a/d3e/dc5/fd6 [47871,3563] 0 2024-04-26T12:28:48.456 INFO:tasks.workunit.client.0.smithi046.stdout:2/567: creat d1/de/d65/d1b/d38/d78/fbd x:0 0 0 2024-04-26T12:28:48.456 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:48.454+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:48.457 INFO:tasks.workunit.client.0.smithi046.stdout:1/547: stat d7/d14/d5d/d32/d41/f93 0 2024-04-26T12:28:48.457 INFO:tasks.workunit.client.0.smithi046.stdout:4/597: creat d0/da/d17/d20/d25/fc9 x:0 0 0 2024-04-26T12:28:48.457 INFO:tasks.workunit.client.0.smithi046.stdout:3/667: mkdir d2/deb 0 2024-04-26T12:28:48.458 INFO:tasks.workunit.client.0.smithi046.stdout:1/548: readlink d7/d14/d5d/d32/l3d 0 2024-04-26T12:28:48.459 INFO:tasks.workunit.client.0.smithi046.stdout:9/523: mkdir d0/db6 0 2024-04-26T12:28:48.459 INFO:tasks.workunit.client.0.smithi046.stdout:7/650: write d16/d1a/d31/d4d/f77 [5152224,5532] 0 2024-04-26T12:28:48.459 INFO:tasks.workunit.client.0.smithi046.stdout:3/668: unlink d2/d16/c51 0 2024-04-26T12:28:48.459 INFO:tasks.workunit.client.0.smithi046.stdout:2/568: mknod d1/de/d15/d18/d98/cbe 0 2024-04-26T12:28:48.460 INFO:tasks.workunit.client.0.smithi046.stdout:9/524: dread - d0/d2c/d3d/d52/f8f zero size 2024-04-26T12:28:48.461 INFO:tasks.workunit.client.0.smithi046.stdout:1/549: mknod d7/d9/d2b/d39/d3c/cc0 0 2024-04-26T12:28:48.461 INFO:tasks.workunit.client.0.smithi046.stdout:7/651: read - d16/d4e/d6c/fa7 zero size 2024-04-26T12:28:48.461 INFO:tasks.workunit.client.0.smithi046.stdout:8/706: dwrite d7/d24/d50/db3/fc8 [0,4194304] 0 2024-04-26T12:28:48.462 INFO:tasks.workunit.client.0.smithi046.stdout:5/698: dwrite d9/da/dd/f32 [4194304,4194304] 0 2024-04-26T12:28:48.463 INFO:tasks.workunit.client.0.smithi046.stdout:1/550: mknod d7/d12/d3a/cc1 0 2024-04-26T12:28:48.464 INFO:tasks.workunit.client.0.smithi046.stdout:0/646: write d9/d1d/d5d/d6b/f89 [1705392,2049] 0 2024-04-26T12:28:48.465 INFO:tasks.workunit.client.0.smithi046.stdout:5/699: creat d9/da/d40/ff0 x:0 0 0 2024-04-26T12:28:48.465 INFO:tasks.workunit.client.0.smithi046.stdout:1/551: readlink d7/d14/lb5 0 2024-04-26T12:28:48.465 INFO:tasks.workunit.client.0.smithi046.stdout:9/525: mknod d0/d29/daf/cb7 0 2024-04-26T12:28:48.467 INFO:tasks.workunit.client.0.smithi046.stdout:1/552: dread - d7/d14/d5d/d32/d41/f93 zero size 2024-04-26T12:28:48.467 INFO:tasks.workunit.client.0.smithi046.stdout:0/647: creat d9/d1d/d5d/d6b/d8a/d8c/fde x:0 0 0 2024-04-26T12:28:48.469 INFO:tasks.workunit.client.0.smithi046.stdout:9/526: creat d0/d2c/d3d/fb8 x:0 0 0 2024-04-26T12:28:48.470 INFO:tasks.workunit.client.0.smithi046.stdout:4/598: dwrite d0/da/d17/d20/d25/fc9 [0,4194304] 0 2024-04-26T12:28:48.471 INFO:tasks.workunit.client.0.smithi046.stdout:8/707: dread d7/da/d4f/f7a [0,4194304] 0 2024-04-26T12:28:48.471 INFO:tasks.workunit.client.0.smithi046.stdout:5/700: symlink d9/da/dd/d34/d44/d97/lf1 0 2024-04-26T12:28:48.472 INFO:tasks.workunit.client.0.smithi046.stdout:1/553: rename d7/d12/d3a to d7/d14/d5d/d6b/dc2 0 2024-04-26T12:28:48.472 INFO:tasks.workunit.client.0.smithi046.stdout:9/527: unlink d0/d2c/d47/fa9 0 2024-04-26T12:28:48.473 INFO:tasks.workunit.client.0.smithi046.stdout:8/708: symlink d7/dc/d1b/lef 0 2024-04-26T12:28:48.473 INFO:tasks.workunit.client.0.smithi046.stdout:5/701: readlink d9/da/dd/d34/d44/d97/da4/l7a 0 2024-04-26T12:28:48.474 INFO:tasks.workunit.client.0.smithi046.stdout:7/652: dwrite d16/d1a/d31/d55/d6d/d89/dc7/fa2 [0,4194304] 0 2024-04-26T12:28:48.474 INFO:tasks.workunit.client.0.smithi046.stdout:2/569: dwrite d1/de/d65/d4a/d58/f5c [0,4194304] 0 2024-04-26T12:28:48.475 INFO:tasks.workunit.client.0.smithi046.stdout:9/528: mknod d0/d16/d76/d7d/cb9 0 2024-04-26T12:28:48.475 INFO:tasks.workunit.client.0.smithi046.stdout:5/702: fdatasync d9/da/d18/dd4/fe7 0 2024-04-26T12:28:48.476 INFO:tasks.workunit.client.0.smithi046.stdout:1/554: sync 2024-04-26T12:28:48.477 INFO:tasks.workunit.client.0.smithi046.stdout:2/570: fdatasync d1/de/d65/d1b/d38/f3b 0 2024-04-26T12:28:48.477 INFO:tasks.workunit.client.0.smithi046.stdout:2/571: chown d1/de/d65/l32 964035 1 2024-04-26T12:28:48.478 INFO:tasks.workunit.client.0.smithi046.stdout:9/529: symlink d0/d29/lba 0 2024-04-26T12:28:48.479 INFO:tasks.workunit.client.0.smithi046.stdout:1/555: symlink d7/d14/d5d/lc3 0 2024-04-26T12:28:48.479 INFO:tasks.workunit.client.0.smithi046.stdout:5/703: creat d9/da/dd/d34/d44/d97/da4/dde/ff2 x:0 0 0 2024-04-26T12:28:48.480 INFO:tasks.workunit.client.0.smithi046.stdout:2/572: fdatasync d1/de/d65/d4a/f7d 0 2024-04-26T12:28:48.480 INFO:tasks.workunit.client.0.smithi046.stdout:9/530: mknod d0/d16/d5f/cbb 0 2024-04-26T12:28:48.480 INFO:tasks.workunit.client.0.smithi046.stdout:5/704: dread - d9/da/dd/f66 zero size 2024-04-26T12:28:48.480 INFO:tasks.workunit.client.0.smithi046.stdout:1/556: fdatasync d7/d9/d2b/d96/f6d 0 2024-04-26T12:28:48.482 INFO:tasks.workunit.client.0.smithi046.stdout:6/626: dread d7/d1b/d47/d65/d77/d92/fc3 [0,4194304] 0 2024-04-26T12:28:48.482 INFO:tasks.workunit.client.0.smithi046.stdout:5/705: dread - d9/da/dd/d34/d44/fcd zero size 2024-04-26T12:28:48.482 INFO:tasks.workunit.client.0.smithi046.stdout:2/573: link d1/de/d2b/fa0 d1/de/d15/d18/d98/fbf 0 2024-04-26T12:28:48.483 INFO:tasks.workunit.client.0.smithi046.stdout:7/653: dwrite d16/d1a/d31/d62/f80 [0,4194304] 0 2024-04-26T12:28:48.483 INFO:tasks.workunit.client.0.smithi046.stdout:9/531: link d0/d29/d69/d88/f94 d0/db6/fbc 0 2024-04-26T12:28:48.483 INFO:tasks.workunit.client.0.smithi046.stdout:0/648: truncate d9/d1d/d40/d41/d7e/fb8 1519048 0 2024-04-26T12:28:48.484 INFO:tasks.workunit.client.0.smithi046.stdout:4/599: fsync d0/da/d17/d20/d25/fc9 0 2024-04-26T12:28:48.485 INFO:tasks.workunit.client.0.smithi046.stdout:7/654: chown d16/d1a/d31/c32 9693736 1 2024-04-26T12:28:48.485 INFO:tasks.workunit.client.0.smithi046.stdout:0/649: chown d9/d1d/fbe 89 1 2024-04-26T12:28:48.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/706: symlink d9/da/dd/dd7/d7e/lf3 0 2024-04-26T12:28:48.485 INFO:tasks.workunit.client.0.smithi046.stdout:9/532: unlink d0/d29/c6f 0 2024-04-26T12:28:48.485 INFO:tasks.workunit.client.0.smithi046.stdout:2/574: creat d1/de/d65/d4a/d58/fc0 x:0 0 0 2024-04-26T12:28:48.487 INFO:tasks.workunit.client.0.smithi046.stdout:9/533: write d0/d2c/d3d/d52/fa6 [717202,90776] 0 2024-04-26T12:28:48.487 INFO:tasks.workunit.client.0.smithi046.stdout:5/707: chown d9/da/dd/dd7/d7e/dca/ce4 86 1 2024-04-26T12:28:48.488 INFO:tasks.workunit.client.0.smithi046.stdout:1/557: dwrite d7/d14/d5d/d32/d41/fbc [0,4194304] 0 2024-04-26T12:28:48.489 INFO:tasks.workunit.client.0.smithi046.stdout:7/655: creat d16/d35/dac/fd7 x:0 0 0 2024-04-26T12:28:48.489 INFO:tasks.workunit.client.0.smithi046.stdout:0/650: mknod d9/d1d/d40/d41/dc0/da4/cdf 0 2024-04-26T12:28:48.489 INFO:tasks.workunit.client.0.smithi046.stdout:4/600: unlink d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/f9d 0 2024-04-26T12:28:48.489 INFO:tasks.workunit.client.0.smithi046.stdout:6/627: rename d7/d1b/d47/d65/d77/fb7 to d7/d1b/fcb 0 2024-04-26T12:28:48.490 INFO:tasks.workunit.client.0.smithi046.stdout:6/628: symlink d7/da7/lcc 0 2024-04-26T12:28:48.490 INFO:tasks.workunit.client.0.smithi046.stdout:1/558: symlink d7/d14/d5d/d32/d5f/lc4 0 2024-04-26T12:28:48.491 INFO:tasks.workunit.client.0.smithi046.stdout:4/601: mknod d0/da/d17/cca 0 2024-04-26T12:28:48.491 INFO:tasks.workunit.client.0.smithi046.stdout:0/651: write d9/dc/db9/fcf [469010,27100] 0 2024-04-26T12:28:48.491 INFO:tasks.workunit.client.0.smithi046.stdout:2/575: rename d1/de/d15/d18/d91/d9f to d1/de/d15/d18/dc1 0 2024-04-26T12:28:48.491 INFO:tasks.workunit.client.0.smithi046.stdout:6/629: symlink d7/d1b/d37/daa/lcd 0 2024-04-26T12:28:48.492 INFO:tasks.workunit.client.0.smithi046.stdout:2/576: mkdir d1/de/d15/dc2 0 2024-04-26T12:28:48.493 INFO:tasks.workunit.client.0.smithi046.stdout:1/559: dread d7/db/f8c [0,4194304] 0 2024-04-26T12:28:48.493 INFO:tasks.workunit.client.0.smithi046.stdout:6/630: chown d7/d1b/d6a/d57/c7c 331 1 2024-04-26T12:28:48.493 INFO:tasks.workunit.client.0.smithi046.stdout:2/577: creat d1/d71/fc3 x:0 0 0 2024-04-26T12:28:48.494 INFO:tasks.workunit.client.0.smithi046.stdout:4/602: rename d0/da/d17/d20/d25/d35/d6d/f13 to d0/da/d17/d20/d25/d35/d6d/d19/d53/fcb 0 2024-04-26T12:28:48.494 INFO:tasks.workunit.client.0.smithi046.stdout:2/578: fsync d1/f2 0 2024-04-26T12:28:48.494 INFO:tasks.workunit.client.0.smithi046.stdout:6/631: readlink d7/d1b/d37/daa/lcd 0 2024-04-26T12:28:48.495 INFO:tasks.workunit.client.0.smithi046.stdout:1/560: rename d7/d9 to d7/db/d98/dc5 0 2024-04-26T12:28:48.495 INFO:tasks.workunit.client.0.smithi046.stdout:4/603: write d0/d1/f87 [1036973,45446] 0 2024-04-26T12:28:48.495 INFO:tasks.workunit.client.0.smithi046.stdout:2/579: mkdir d1/de/d67/dc4 0 2024-04-26T12:28:48.495 INFO:tasks.workunit.client.0.smithi046.stdout:6/632: getdents d7/d1b/d47/d65/da3 0 2024-04-26T12:28:48.497 INFO:tasks.workunit.client.0.smithi046.stdout:9/534: truncate d0/d2c/d3d/f4f 166685 0 2024-04-26T12:28:48.497 INFO:tasks.workunit.client.0.smithi046.stdout:6/633: chown d7/d1b/d37/daa/lad 449 1 2024-04-26T12:28:48.498 INFO:tasks.workunit.client.0.smithi046.stdout:9/535: fdatasync d0/f10 0 2024-04-26T12:28:48.500 INFO:tasks.workunit.client.0.smithi046.stdout:8/709: dread d7/d24/f2f [0,4194304] 0 2024-04-26T12:28:48.501 INFO:tasks.workunit.client.0.smithi046.stdout:6/634: getdents d7/d1b/d37/daa 0 2024-04-26T12:28:48.501 INFO:tasks.workunit.client.0.smithi046.stdout:2/580: dread d1/de/d65/d4a/f59 [0,4194304] 0 2024-04-26T12:28:48.502 INFO:tasks.workunit.client.0.smithi046.stdout:3/669: dread d2/db/d4a/f40 [0,4194304] 0 2024-04-26T12:28:48.503 INFO:tasks.workunit.client.0.smithi046.stdout:8/710: dread - d7/d24/d50/d2a/fdf zero size 2024-04-26T12:28:48.503 INFO:tasks.workunit.client.0.smithi046.stdout:4/604: dwrite d0/da/d17/d20/d25/d35/f5d [4194304,4194304] 0 2024-04-26T12:28:48.504 INFO:tasks.workunit.client.0.smithi046.stdout:0/652: dwrite d9/d1d/d40/d41/d7e/fb8 [0,4194304] 0 2024-04-26T12:28:48.505 INFO:tasks.workunit.client.0.smithi046.stdout:8/711: mknod d7/dd5/cf0 0 2024-04-26T12:28:48.505 INFO:tasks.workunit.client.0.smithi046.stdout:3/670: write d2/db/d4a/fb8 [1616152,66595] 0 2024-04-26T12:28:48.506 INFO:tasks.workunit.client.0.smithi046.stdout:4/605: chown d0/da/d17/d20/d25/d35/d6d/l28 5 1 2024-04-26T12:28:48.507 INFO:tasks.workunit.client.0.smithi046.stdout:8/712: mkdir d7/d24/d50/d2a/d39/da6/df1 0 2024-04-26T12:28:48.508 INFO:tasks.workunit.client.0.smithi046.stdout:7/656: dread d16/d1a/d31/d5a/f60 [0,4194304] 0 2024-04-26T12:28:48.509 INFO:tasks.workunit.client.0.smithi046.stdout:0/653: mknod d9/d1d/d40/d41/dc0/db2/ce0 0 2024-04-26T12:28:48.510 INFO:tasks.workunit.client.0.smithi046.stdout:9/536: truncate d0/d16/d76/d7d/faa 1789259 0 2024-04-26T12:28:48.511 INFO:tasks.workunit.client.0.smithi046.stdout:6/635: dwrite d7/fa2 [0,4194304] 0 2024-04-26T12:28:48.512 INFO:tasks.workunit.client.0.smithi046.stdout:9/537: fsync d0/d2c/d47/f46 0 2024-04-26T12:28:48.512 INFO:tasks.workunit.client.0.smithi046.stdout:2/581: dread d1/de/d65/d4a/d58/f5c [0,4194304] 0 2024-04-26T12:28:48.513 INFO:tasks.workunit.client.0.smithi046.stdout:7/657: chown d16/d1a/d31/d55/d6d/fcc 243869661 1 2024-04-26T12:28:48.513 INFO:tasks.workunit.client.0.smithi046.stdout:2/582: stat d1/de/c12 0 2024-04-26T12:28:48.513 INFO:tasks.workunit.client.0.smithi046.stdout:6/636: symlink d7/d1b/d47/d65/da3/dbe/lce 0 2024-04-26T12:28:48.513 INFO:tasks.workunit.client.0.smithi046.stdout:0/654: mkdir d9/d1d/d40/d41/d7e/de1 0 2024-04-26T12:28:48.514 INFO:tasks.workunit.client.0.smithi046.stdout:2/583: dread - d1/de/d65/d4a/d58/fa9 zero size 2024-04-26T12:28:48.514 INFO:tasks.workunit.client.0.smithi046.stdout:9/538: fdatasync d0/d29/f3b 0 2024-04-26T12:28:48.515 INFO:tasks.workunit.client.0.smithi046.stdout:4/606: dwrite d0/da/d17/d20/d8e/f98 [0,4194304] 0 2024-04-26T12:28:48.515 INFO:tasks.workunit.client.0.smithi046.stdout:6/637: creat d7/d2b/d31/fcf x:0 0 0 2024-04-26T12:28:48.516 INFO:tasks.workunit.client.0.smithi046.stdout:2/584: write d1/de/d65/d4a/f4d [1560976,130100] 0 2024-04-26T12:28:48.516 INFO:tasks.workunit.client.0.smithi046.stdout:0/655: rename d9/d1d/d40/d41/dc0/da4 to d9/dc/dd/dd2/de2 0 2024-04-26T12:28:48.516 INFO:tasks.workunit.client.0.smithi046.stdout:6/638: symlink d7/d1b/d47/d65/ld0 0 2024-04-26T12:28:48.517 INFO:tasks.workunit.client.0.smithi046.stdout:2/585: stat d1/de/d65/d1b/d38 0 2024-04-26T12:28:48.517 INFO:tasks.workunit.client.0.smithi046.stdout:4/607: chown d0/da/d17/d20/d25/d35/d6d/d19/f4a 126219836 1 2024-04-26T12:28:48.518 INFO:tasks.workunit.client.0.smithi046.stdout:6/639: write d7/d1b/d47/d65/d77/d92/fb3 [4995310,54809] 0 2024-04-26T12:28:48.518 INFO:tasks.workunit.client.0.smithi046.stdout:0/656: creat d9/dc/dd/d45/fe3 x:0 0 0 2024-04-26T12:28:48.518 INFO:tasks.workunit.client.0.smithi046.stdout:2/586: rmdir d1/de/d65/d8f 39 2024-04-26T12:28:48.518 INFO:tasks.workunit.client.0.smithi046.stdout:4/608: mkdir d0/da/d17/d20/d25/d35/dcc 0 2024-04-26T12:28:48.519 INFO:tasks.workunit.client.0.smithi046.stdout:0/657: creat d9/d1d/d40/d41/d7e/da5/dad/fe4 x:0 0 0 2024-04-26T12:28:48.519 INFO:tasks.workunit.client.0.smithi046.stdout:2/587: link d1/cc d1/de/d15/d18/dc1/cc5 0 2024-04-26T12:28:48.520 INFO:tasks.workunit.client.0.smithi046.stdout:5/708: sync 2024-04-26T12:28:48.520 INFO:tasks.workunit.client.0.smithi046.stdout:8/713: sync 2024-04-26T12:28:48.520 INFO:tasks.workunit.client.0.smithi046.stdout:1/561: sync 2024-04-26T12:28:48.521 INFO:tasks.workunit.client.0.smithi046.stdout:8/714: write d7/dc/f17 [5187939,121802] 0 2024-04-26T12:28:48.521 INFO:tasks.workunit.client.0.smithi046.stdout:5/709: write d9/da/dd/d34/d44/d88/d90/fa0 [708899,99232] 0 2024-04-26T12:28:48.522 INFO:tasks.workunit.client.0.smithi046.stdout:8/715: write d7/d1c/f2d [2819765,71011] 0 2024-04-26T12:28:48.522 INFO:tasks.workunit.client.0.smithi046.stdout:1/562: creat d7/db/d98/dc5/d2b/d31/fc6 x:0 0 0 2024-04-26T12:28:48.523 INFO:tasks.workunit.client.0.smithi046.stdout:8/716: chown d7/d24/d50 108 1 2024-04-26T12:28:48.523 INFO:tasks.workunit.client.0.smithi046.stdout:1/563: write d7/d12/f21 [2727508,23576] 0 2024-04-26T12:28:48.525 INFO:tasks.workunit.client.0.smithi046.stdout:1/564: creat d7/d14/fc7 x:0 0 0 2024-04-26T12:28:48.525 INFO:tasks.workunit.client.0.smithi046.stdout:9/539: write d0/db6/fbc [1486509,91586] 0 2024-04-26T12:28:48.525 INFO:tasks.workunit.client.0.smithi046.stdout:4/609: dread d0/da/d21/f73 [0,4194304] 0 2024-04-26T12:28:48.527 INFO:tasks.workunit.client.0.smithi046.stdout:5/710: dwrite f2 [0,4194304] 0 2024-04-26T12:28:48.528 INFO:tasks.workunit.client.0.smithi046.stdout:2/588: truncate d1/de/d65/d4a/d58/f9d 2009189 0 2024-04-26T12:28:48.531 INFO:tasks.workunit.client.0.smithi046.stdout:7/658: dread d16/d1a/d31/f39 [0,4194304] 0 2024-04-26T12:28:48.531 INFO:tasks.workunit.client.0.smithi046.stdout:4/610: mknod d0/da/d17/d20/d8e/ccd 0 2024-04-26T12:28:48.531 INFO:tasks.workunit.client.0.smithi046.stdout:5/711: readlink d9/da/dd/l38 0 2024-04-26T12:28:48.532 INFO:tasks.workunit.client.0.smithi046.stdout:1/565: write d7/db/d98/dc5/d2b/d96/f68 [262886,21770] 0 2024-04-26T12:28:48.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/717: dwrite d7/dc/d1b/f8c [0,4194304] 0 2024-04-26T12:28:48.533 INFO:tasks.workunit.client.0.smithi046.stdout:2/589: creat d1/de/da4/fc6 x:0 0 0 2024-04-26T12:28:48.535 INFO:tasks.workunit.client.0.smithi046.stdout:2/590: mknod d1/de/d15/cc7 0 2024-04-26T12:28:48.535 INFO:tasks.workunit.client.0.smithi046.stdout:8/718: write d7/d24/f43 [1999892,107736] 0 2024-04-26T12:28:48.537 INFO:tasks.workunit.client.0.smithi046.stdout:0/658: dwrite d9/dc/d2a/f50 [0,4194304] 0 2024-04-26T12:28:48.538 INFO:tasks.workunit.client.0.smithi046.stdout:6/640: dwrite d7/d1b/d37/f3b [0,4194304] 0 2024-04-26T12:28:48.538 INFO:tasks.workunit.client.0.smithi046.stdout:4/611: symlink d0/da/d17/d20/d25/d35/d6d/d19/d55/dae/lce 0 2024-04-26T12:28:48.538 INFO:tasks.workunit.client.0.smithi046.stdout:9/540: dwrite d0/d29/d69/f77 [0,4194304] 0 2024-04-26T12:28:48.539 INFO:tasks.workunit.client.0.smithi046.stdout:8/719: dread - d7/d24/d50/d2a/d39/d9d/fe7 zero size 2024-04-26T12:28:48.539 INFO:tasks.workunit.client.0.smithi046.stdout:7/659: read d16/d1a/d31/f70 [6117487,97777] 0 2024-04-26T12:28:48.540 INFO:tasks.workunit.client.0.smithi046.stdout:8/720: stat d7/da/d88 0 2024-04-26T12:28:48.540 INFO:tasks.workunit.client.0.smithi046.stdout:4/612: mkdir d0/da/d21/dcf 0 2024-04-26T12:28:48.541 INFO:tasks.workunit.client.0.smithi046.stdout:9/541: chown d0/d16/d5f/cb4 64 1 2024-04-26T12:28:48.543 INFO:tasks.workunit.client.0.smithi046.stdout:0/659: stat d9/d1d/d5d/d6b/c9b 0 2024-04-26T12:28:48.543 INFO:tasks.workunit.client.0.smithi046.stdout:8/721: unlink d7/dc/d27/fe4 0 2024-04-26T12:28:48.543 INFO:tasks.workunit.client.0.smithi046.stdout:5/712: dwrite d9/da/dd/d5d/f5f [0,4194304] 0 2024-04-26T12:28:48.544 INFO:tasks.workunit.client.0.smithi046.stdout:1/566: dwrite d7/f6f [0,4194304] 0 2024-04-26T12:28:48.544 INFO:tasks.workunit.client.0.smithi046.stdout:9/542: chown d0/d19/d21/c7c 96 1 2024-04-26T12:28:48.544 INFO:tasks.workunit.client.0.smithi046.stdout:4/613: link d0/da/d17/c37 d0/d1/d5/cd0 0 2024-04-26T12:28:48.545 INFO:tasks.workunit.client.0.smithi046.stdout:0/660: symlink d9/d1d/d40/d41/le5 0 2024-04-26T12:28:48.546 INFO:tasks.workunit.client.0.smithi046.stdout:5/713: creat d9/da/dd/ff4 x:0 0 0 2024-04-26T12:28:48.547 INFO:tasks.workunit.client.0.smithi046.stdout:9/543: readlink d0/d2c/d3d/l62 0 2024-04-26T12:28:48.547 INFO:tasks.workunit.client.0.smithi046.stdout:8/722: rmdir d7/d1c/dbd 0 2024-04-26T12:28:48.548 INFO:tasks.workunit.client.0.smithi046.stdout:0/661: rmdir d9/dc/dd/d90/dc4 39 2024-04-26T12:28:48.548 INFO:tasks.workunit.client.0.smithi046.stdout:2/591: dwrite d1/d42/f7a [4194304,4194304] 0 2024-04-26T12:28:48.550 INFO:tasks.workunit.client.0.smithi046.stdout:0/662: mkdir d9/dc/dd/d45/d69/de6 0 2024-04-26T12:28:48.550 INFO:tasks.workunit.client.0.smithi046.stdout:8/723: stat d7/dc/d1b/da0/db6/fcc 0 2024-04-26T12:28:48.550 INFO:tasks.workunit.client.0.smithi046.stdout:9/544: mkdir d0/d2c/dbd 0 2024-04-26T12:28:48.552 INFO:tasks.workunit.client.0.smithi046.stdout:1/567: dwrite d7/d14/d5d/d32/f75 [0,4194304] 0 2024-04-26T12:28:48.553 INFO:tasks.workunit.client.0.smithi046.stdout:9/545: chown d0/d16/d76/d7d/fad 405209534 1 2024-04-26T12:28:48.553 INFO:tasks.workunit.client.0.smithi046.stdout:0/663: rename d9/d1d/faf to d9/d1d/d40/d41/d7e/d9d/fe7 0 2024-04-26T12:28:48.554 INFO:tasks.workunit.client.0.smithi046.stdout:8/724: truncate d7/dc/d1b/d7d/fea 396221 0 2024-04-26T12:28:48.554 INFO:tasks.workunit.client.0.smithi046.stdout:5/714: dwrite d9/da/d40/f6d [0,4194304] 0 2024-04-26T12:28:48.555 INFO:tasks.workunit.client.0.smithi046.stdout:9/546: write d0/f9a [201903,89125] 0 2024-04-26T12:28:48.556 INFO:tasks.workunit.client.0.smithi046.stdout:1/568: truncate d7/db/ff 268 0 2024-04-26T12:28:48.557 INFO:tasks.workunit.client.0.smithi046.stdout:8/725: mknod d7/dd5/cf2 0 2024-04-26T12:28:48.557 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:48.555+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:48.558 INFO:tasks.workunit.client.0.smithi046.stdout:7/660: truncate d16/d1a/d31/d4d/f77 3303588 0 2024-04-26T12:28:48.558 INFO:tasks.workunit.client.0.smithi046.stdout:0/664: mkdir d9/d1d/d40/d41/d7e/ddd/de8 0 2024-04-26T12:28:48.558 INFO:tasks.workunit.client.0.smithi046.stdout:1/569: write d7/db/d98/dc5/d2b/d39/d5c/f8e [2732751,30259] 0 2024-04-26T12:28:48.559 INFO:tasks.workunit.client.0.smithi046.stdout:7/661: creat d16/d35/dac/dbb/fd8 x:0 0 0 2024-04-26T12:28:48.559 INFO:tasks.workunit.client.0.smithi046.stdout:1/570: symlink d7/d14/d5d/lc8 0 2024-04-26T12:28:48.559 INFO:tasks.workunit.client.0.smithi046.stdout:0/665: mkdir d9/dc/dd/d90/dc4/de9 0 2024-04-26T12:28:48.560 INFO:tasks.workunit.client.0.smithi046.stdout:0/666: chown d9/d1d/d40/d41/d7e/fca 7355513 1 2024-04-26T12:28:48.560 INFO:tasks.workunit.client.0.smithi046.stdout:7/662: mkdir d16/d1a/d31/d5a/d93/dd9 0 2024-04-26T12:28:48.561 INFO:tasks.workunit.client.0.smithi046.stdout:1/571: truncate d7/db/d98/dc5/d2b/f40 459562 0 2024-04-26T12:28:48.562 INFO:tasks.workunit.client.0.smithi046.stdout:2/592: truncate d1/de/d65/d1b/d38/d78/f7b 1907776 0 2024-04-26T12:28:48.562 INFO:tasks.workunit.client.0.smithi046.stdout:0/667: unlink d9/d1d/c23 0 2024-04-26T12:28:48.562 INFO:tasks.workunit.client.0.smithi046.stdout:7/663: creat d16/d3f/d81/daa/fda x:0 0 0 2024-04-26T12:28:48.563 INFO:tasks.workunit.client.0.smithi046.stdout:7/664: mkdir d16/d4e/d6c/dce/ddb 0 2024-04-26T12:28:48.564 INFO:tasks.workunit.client.0.smithi046.stdout:2/593: write d1/de/d65/d4a/d58/f62 [468425,37094] 0 2024-04-26T12:28:48.564 INFO:tasks.workunit.client.0.smithi046.stdout:2/594: fdatasync d1/de/f5e 0 2024-04-26T12:28:48.565 INFO:tasks.workunit.client.0.smithi046.stdout:2/595: mkdir d1/de/dc8 0 2024-04-26T12:28:48.566 INFO:tasks.workunit.client.0.smithi046.stdout:1/572: dwrite d7/d14/d5d/d32/d41/f93 [0,4194304] 0 2024-04-26T12:28:48.566 INFO:tasks.workunit.client.0.smithi046.stdout:8/726: write d7/dc/f70 [2141068,123325] 0 2024-04-26T12:28:48.566 INFO:tasks.workunit.client.0.smithi046.stdout:5/715: truncate d9/da/d15/f26 231595 0 2024-04-26T12:28:48.568 INFO:tasks.workunit.client.0.smithi046.stdout:8/727: mkdir d7/d24/d50/d2a/d54/df3 0 2024-04-26T12:28:48.568 INFO:tasks.workunit.client.0.smithi046.stdout:9/547: read d0/d2c/d47/ff [1489728,118658] 0 2024-04-26T12:28:48.570 INFO:tasks.workunit.client.0.smithi046.stdout:9/548: mkdir d0/d2c/dbe 0 2024-04-26T12:28:48.570 INFO:tasks.workunit.client.0.smithi046.stdout:1/573: creat d7/d14/d5d/d6b/dc2/d76/fc9 x:0 0 0 2024-04-26T12:28:48.572 INFO:tasks.workunit.client.0.smithi046.stdout:5/716: truncate d9/da/dd/d34/d45/f53 6500099 0 2024-04-26T12:28:48.573 INFO:tasks.workunit.client.0.smithi046.stdout:5/717: mknod d9/da/d18/dd4/cf5 0 2024-04-26T12:28:48.574 INFO:tasks.workunit.client.0.smithi046.stdout:2/596: dread d1/de/d15/d18/f9b [0,4194304] 0 2024-04-26T12:28:48.574 INFO:tasks.workunit.client.0.smithi046.stdout:3/671: dread d2/d16/f73 [0,4194304] 0 2024-04-26T12:28:48.574 INFO:tasks.workunit.client.0.smithi046.stdout:5/718: write d9/da/d40/fb5 [1002492,67933] 0 2024-04-26T12:28:48.575 INFO:tasks.workunit.client.0.smithi046.stdout:3/672: mkdir d2/db/dec 0 2024-04-26T12:28:48.576 INFO:tasks.workunit.client.0.smithi046.stdout:5/719: write d9/da/d40/f50 [4449755,61995] 0 2024-04-26T12:28:48.576 INFO:tasks.workunit.client.0.smithi046.stdout:4/614: dread d0/d1/f87 [0,4194304] 0 2024-04-26T12:28:48.576 INFO:tasks.workunit.client.0.smithi046.stdout:3/673: write d2/f7 [4546587,65034] 0 2024-04-26T12:28:48.576 INFO:tasks.workunit.client.0.smithi046.stdout:2/597: rename d1/de/d15/c21 to d1/de/d15/d18/cc9 0 2024-04-26T12:28:48.577 INFO:tasks.workunit.client.0.smithi046.stdout:5/720: write d9/da/dd/d5d/f5f [1843483,91707] 0 2024-04-26T12:28:48.577 INFO:tasks.workunit.client.0.smithi046.stdout:2/598: chown d1/f2 174 1 2024-04-26T12:28:48.577 INFO:tasks.workunit.client.0.smithi046.stdout:4/615: chown d0/d1/d5/db/c3c 1002 1 2024-04-26T12:28:48.577 INFO:tasks.workunit.client.0.smithi046.stdout:3/674: write d2/db/fe1 [119663,81597] 0 2024-04-26T12:28:48.578 INFO:tasks.workunit.client.0.smithi046.stdout:2/599: mkdir d1/de/d65/d1b/dca 0 2024-04-26T12:28:48.579 INFO:tasks.workunit.client.0.smithi046.stdout:3/675: stat d2/d16/d2c/d50/d71/d89/dc5/d23 0 2024-04-26T12:28:48.579 INFO:tasks.workunit.client.0.smithi046.stdout:2/600: mknod d1/de/da4/ccb 0 2024-04-26T12:28:48.579 INFO:tasks.workunit.client.0.smithi046.stdout:5/721: rename d9/da/d18/d7d/cd6 to d9/da/dd/d34/d44/d97/da4/d35/cf6 0 2024-04-26T12:28:48.580 INFO:tasks.workunit.client.0.smithi046.stdout:5/722: creat d9/da/d18/dd4/ff7 x:0 0 0 2024-04-26T12:28:48.580 INFO:tasks.workunit.client.0.smithi046.stdout:3/676: mknod d2/d16/d2c/d50/d71/d89/dc5/ced 0 2024-04-26T12:28:48.580 INFO:tasks.workunit.client.0.smithi046.stdout:2/601: creat d1/de/d65/d1b/d38/d78/fcc x:0 0 0 2024-04-26T12:28:48.581 INFO:tasks.workunit.client.0.smithi046.stdout:2/602: fdatasync d1/f4 0 2024-04-26T12:28:48.581 INFO:tasks.workunit.client.0.smithi046.stdout:6/641: dread d7/d1b/d6a/f99 [0,4194304] 0 2024-04-26T12:28:48.581 INFO:tasks.workunit.client.0.smithi046.stdout:2/603: stat d1/f3e 0 2024-04-26T12:28:48.582 INFO:tasks.workunit.client.0.smithi046.stdout:6/642: mkdir d7/da7/dd1 0 2024-04-26T12:28:48.582 INFO:tasks.workunit.client.0.smithi046.stdout:5/723: rename d9/da/dd/d34/d44/l99 to d9/da/dd/dd7/d7e/dca/lf8 0 2024-04-26T12:28:48.582 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:48.582 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:48.583 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:48.583 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:48.583 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:48.583 INFO:tasks.workunit.client.0.smithi046.stdout:2/604: fsync d1/de/d65/d4a/f82 0 2024-04-26T12:28:48.583 INFO:tasks.workunit.client.0.smithi046.stdout:3/677: rename d2/d16/d35/dbc/dc9/dd0/le3 to d2/d16/d2c/d50/d71/d89/lee 0 2024-04-26T12:28:48.583 INFO:tasks.workunit.client.0.smithi046.stdout:6/643: rmdir d7/d1b/d6a 39 2024-04-26T12:28:48.583 INFO:tasks.workunit.client.0.smithi046.stdout:2/605: mknod d1/d42/ccd 0 2024-04-26T12:28:48.584 INFO:tasks.workunit.client.0.smithi046.stdout:3/678: mknod d2/d16/d35/dbc/cef 0 2024-04-26T12:28:48.584 INFO:tasks.workunit.client.0.smithi046.stdout:6/644: mknod d7/d2b/d31/cd2 0 2024-04-26T12:28:48.585 INFO:tasks.workunit.client.0.smithi046.stdout:0/668: dread d9/dc/dd/d45/d69/fa7 [0,4194304] 0 2024-04-26T12:28:48.585 INFO:tasks.workunit.client.0.smithi046.stdout:2/606: mknod d1/de/d65/d4a/cce 0 2024-04-26T12:28:48.585 INFO:tasks.workunit.client.0.smithi046.stdout:6/645: read - d7/d2b/d31/fc4 zero size 2024-04-26T12:28:48.586 INFO:tasks.workunit.client.0.smithi046.stdout:4/616: write d0/da/da1/f6e [987204,54671] 0 2024-04-26T12:28:48.586 INFO:tasks.workunit.client.0.smithi046.stdout:0/669: mknod d9/dc/dd/d90/dc4/cea 0 2024-04-26T12:28:48.589 INFO:tasks.workunit.client.0.smithi046.stdout:0/670: creat d9/d1d/d40/d41/dc0/db2/feb x:0 0 0 2024-04-26T12:28:48.591 INFO:tasks.workunit.client.0.smithi046.stdout:0/671: stat d9/d1d/d40/d41/d7e/da5/lda 0 2024-04-26T12:28:48.591 INFO:tasks.workunit.client.0.smithi046.stdout:5/724: dwrite d9/da/dd/d34/d45/f53 [4194304,4194304] 0 2024-04-26T12:28:48.592 INFO:tasks.workunit.client.0.smithi046.stdout:0/672: chown d9/d1d/f3c 2753 1 2024-04-26T12:28:48.593 INFO:tasks.workunit.client.0.smithi046.stdout:2/607: dwrite d1/de/d15/f46 [0,4194304] 0 2024-04-26T12:28:48.594 INFO:tasks.workunit.client.0.smithi046.stdout:9/549: dread d0/d16/d76/d7d/fad [4194304,4194304] 0 2024-04-26T12:28:48.594 INFO:tasks.workunit.client.0.smithi046.stdout:7/665: sync 2024-04-26T12:28:48.595 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:48.598 INFO:tasks.workunit.client.0.smithi046.stdout:2/608: creat d1/d42/fcf x:0 0 0 2024-04-26T12:28:48.598 INFO:tasks.workunit.client.0.smithi046.stdout:5/725: truncate f8 2374796 0 2024-04-26T12:28:48.598 INFO:tasks.workunit.client.0.smithi046.stdout:7/666: rename d16/d1a/d31/d62/f88 to d16/d35/dc9/fdc 0 2024-04-26T12:28:48.598 INFO:tasks.workunit.client.0.smithi046.stdout:1/574: dread d7/db/d98/dc5/d2b/d39/d5c/f8e [0,4194304] 0 2024-04-26T12:28:48.598 INFO:tasks.workunit.client.0.smithi046.stdout:5/726: write d9/da/d18/d7d/f78 [566883,104889] 0 2024-04-26T12:28:48.598 INFO:tasks.workunit.client.0.smithi046.stdout:7/667: rmdir d16/d3f/d81/daa 39 2024-04-26T12:28:48.598 INFO:tasks.workunit.client.0.smithi046.stdout:0/673: link d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/c71 d9/d1d/d40/d41/d7e/ddd/de8/cec 0 2024-04-26T12:28:48.598 INFO:tasks.workunit.client.0.smithi046.stdout:1/575: creat d7/d14/d5d/d6b/dc2/fca x:0 0 0 2024-04-26T12:28:48.599 INFO:tasks.workunit.client.0.smithi046.stdout:8/728: sync 2024-04-26T12:28:48.599 INFO:tasks.workunit.client.0.smithi046.stdout:2/609: sync 2024-04-26T12:28:48.599 INFO:tasks.workunit.client.0.smithi046.stdout:1/576: mknod d7/db/d98/ccb 0 2024-04-26T12:28:48.599 INFO:tasks.workunit.client.0.smithi046.stdout:0/674: truncate d9/d1d/d40/d41/f54 4726079 0 2024-04-26T12:28:48.600 INFO:tasks.workunit.client.0.smithi046.stdout:8/729: rename d7/dc to d7/d1c/d74/df4 0 2024-04-26T12:28:48.601 INFO:tasks.workunit.client.0.smithi046.stdout:8/730: sync 2024-04-26T12:28:48.601 INFO:tasks.workunit.client.0.smithi046.stdout:9/550: dwrite d0/d16/d76/d7d/fa5 [0,4194304] 0 2024-04-26T12:28:48.602 INFO:tasks.workunit.client.0.smithi046.stdout:0/675: rmdir d9/d1d/d5d/d6b/d8a/d8c 39 2024-04-26T12:28:48.603 INFO:tasks.workunit.client.0.smithi046.stdout:9/551: link d0/d19/f2f d0/d2c/d47/fbf 0 2024-04-26T12:28:48.603 INFO:tasks.workunit.client.0.smithi046.stdout:2/610: creat d1/de/d65/d1b/fd0 x:0 0 0 2024-04-26T12:28:48.604 INFO:tasks.workunit.client.0.smithi046.stdout:2/611: mknod d1/de/cd1 0 2024-04-26T12:28:48.604 INFO:tasks.workunit.client.0.smithi046.stdout:0/676: creat d9/d1d/d40/d41/d7e/de1/fed x:0 0 0 2024-04-26T12:28:48.605 INFO:tasks.workunit.client.0.smithi046.stdout:9/552: write d0/d19/d51/f57 [307166,54304] 0 2024-04-26T12:28:48.605 INFO:tasks.workunit.client.0.smithi046.stdout:0/677: sync 2024-04-26T12:28:48.605 INFO:tasks.workunit.client.0.smithi046.stdout:8/731: truncate d7/d24/d50/f34 2536666 0 2024-04-26T12:28:48.605 INFO:tasks.workunit.client.0.smithi046.stdout:9/553: mkdir d0/d2c/dbe/dc0 0 2024-04-26T12:28:48.606 INFO:tasks.workunit.client.0.smithi046.stdout:2/612: mkdir d1/de/d65/d8f/dd2 0 2024-04-26T12:28:48.606 INFO:tasks.workunit.client.0.smithi046.stdout:2/613: unlink d1/f4 0 2024-04-26T12:28:48.608 INFO:tasks.workunit.client.0.smithi046.stdout:9/554: rename d0/d2c/d47/l39 to d0/d16/lc1 0 2024-04-26T12:28:48.608 INFO:tasks.workunit.client.0.smithi046.stdout:0/678: truncate d9/d1d/d40/d41/d7e/da5/dad/dbd/fa8 404770 0 2024-04-26T12:28:48.608 INFO:tasks.workunit.client.0.smithi046.stdout:0/679: sync 2024-04-26T12:28:48.608 INFO:tasks.workunit.client.0.smithi046.stdout:2/614: creat d1/de/d2b/fd3 x:0 0 0 2024-04-26T12:28:48.609 INFO:tasks.workunit.client.0.smithi046.stdout:3/679: dread d2/d16/d35/fcc [0,4194304] 0 2024-04-26T12:28:48.610 INFO:tasks.workunit.client.0.smithi046.stdout:9/555: creat d0/d2c/fc2 x:0 0 0 2024-04-26T12:28:48.610 INFO:tasks.workunit.client.0.smithi046.stdout:2/615: chown d1/de/d65/d4a/d58/fc0 97 1 2024-04-26T12:28:48.610 INFO:tasks.workunit.client.0.smithi046.stdout:0/680: creat d9/dc/dd/dd2/fee x:0 0 0 2024-04-26T12:28:48.610 INFO:tasks.workunit.client.0.smithi046.stdout:3/680: fdatasync d2/db/d4a/f86 0 2024-04-26T12:28:48.611 INFO:tasks.workunit.client.0.smithi046.stdout:5/727: dread d9/da/dd/d34/fb4 [0,4194304] 0 2024-04-26T12:28:48.611 INFO:tasks.workunit.client.0.smithi046.stdout:9/556: chown d0/d2c/d47/ff 123963987 1 2024-04-26T12:28:48.612 INFO:tasks.workunit.client.0.smithi046.stdout:3/681: fsync d2/d16/f37 0 2024-04-26T12:28:48.612 INFO:tasks.workunit.client.0.smithi046.stdout:2/616: chown d1/de/d15/d18/d98/fbf 48715 1 2024-04-26T12:28:48.612 INFO:tasks.workunit.client.0.smithi046.stdout:5/728: fdatasync d9/da/fe3 0 2024-04-26T12:28:48.612 INFO:tasks.workunit.client.0.smithi046.stdout:0/681: mkdir d9/dc/dd/dd2/de2/def 0 2024-04-26T12:28:48.613 INFO:tasks.workunit.client.0.smithi046.stdout:5/729: truncate f2 4937312 0 2024-04-26T12:28:48.613 INFO:tasks.workunit.client.0.smithi046.stdout:2/617: mknod d1/de/d15/cd4 0 2024-04-26T12:28:48.613 INFO:tasks.workunit.client.0.smithi046.stdout:9/557: mknod d0/d16/d76/d7d/d72/d85/cc3 0 2024-04-26T12:28:48.613 INFO:tasks.workunit.client.0.smithi046.stdout:3/682: dread d2/db/d4a/f40 [4194304,4194304] 0 2024-04-26T12:28:48.614 INFO:tasks.workunit.client.0.smithi046.stdout:9/558: rmdir d0/d2c/d3d/d52 39 2024-04-26T12:28:48.615 INFO:tasks.workunit.client.0.smithi046.stdout:5/730: chown d9/da/dd/dd7/d7e/dca/lf8 6 1 2024-04-26T12:28:48.615 INFO:tasks.workunit.client.0.smithi046.stdout:4/617: dread d0/d1/d5/db/f2f [0,4194304] 0 2024-04-26T12:28:48.615 INFO:tasks.workunit.client.0.smithi046.stdout:2/618: mknod d1/de/d15/d18/d98/cd5 0 2024-04-26T12:28:48.615 INFO:tasks.workunit.client.0.smithi046.stdout:0/682: truncate d9/d1d/d5d/d6b/d8a/d8c/fd7 4420377 0 2024-04-26T12:28:48.616 INFO:tasks.workunit.client.0.smithi046.stdout:3/683: mkdir d2/db/d4a/df0 0 2024-04-26T12:28:48.616 INFO:tasks.workunit.client.0.smithi046.stdout:4/618: write d0/d1/f42 [3685550,42201] 0 2024-04-26T12:28:48.617 INFO:tasks.workunit.client.0.smithi046.stdout:5/731: unlink d9/da/d18/d7d/da7/fbf 0 2024-04-26T12:28:48.617 INFO:tasks.workunit.client.0.smithi046.stdout:9/559: read d0/d2c/d47/f2e [1896922,95776] 0 2024-04-26T12:28:48.618 INFO:tasks.workunit.client.0.smithi046.stdout:2/619: link d1/c43 d1/de/d65/d4a/d86/d96/cd6 0 2024-04-26T12:28:48.618 INFO:tasks.workunit.client.0.smithi046.stdout:5/732: rmdir d9/da/dd/d34/d44 39 2024-04-26T12:28:48.618 INFO:tasks.workunit.client.0.smithi046.stdout:3/684: write d2/db/d4a/fb8 [4348747,46646] 0 2024-04-26T12:28:48.618 INFO:tasks.workunit.client.0.smithi046.stdout:9/560: rename d0/d2c/d3d/d52/l73 to d0/d29/d69/d88/lc4 0 2024-04-26T12:28:48.619 INFO:tasks.workunit.client.0.smithi046.stdout:4/619: mknod d0/da/d17/d20/d25/d35/d6d/d19/cd1 0 2024-04-26T12:28:48.619 INFO:tasks.workunit.client.0.smithi046.stdout:2/620: rmdir d1/de/d65/d4a/d86/d96 39 2024-04-26T12:28:48.620 INFO:tasks.workunit.client.0.smithi046.stdout:5/733: write d9/da/dd/d34/d45/f53 [2135917,80716] 0 2024-04-26T12:28:48.620 INFO:tasks.workunit.client.0.smithi046.stdout:3/685: mknod d2/d16/d2c/d50/d71/d89/dc5/d23/cf1 0 2024-04-26T12:28:48.620 INFO:tasks.workunit.client.0.smithi046.stdout:5/734: sync 2024-04-26T12:28:48.620 INFO:tasks.workunit.client.0.smithi046.stdout:6/646: dread d7/fe [0,4194304] 0 2024-04-26T12:28:48.620 INFO:tasks.workunit.client.0.smithi046.stdout:4/620: mknod d0/d41/cd2 0 2024-04-26T12:28:48.622 INFO:tasks.workunit.client.0.smithi046.stdout:5/735: mknod d9/da/d18/dd4/cf9 0 2024-04-26T12:28:48.622 INFO:tasks.workunit.client.0.smithi046.stdout:4/621: rmdir d0/d1/d5 39 2024-04-26T12:28:48.623 INFO:tasks.workunit.client.0.smithi046.stdout:3/686: mknod d2/db/d4a/cf2 0 2024-04-26T12:28:48.623 INFO:tasks.workunit.client.0.smithi046.stdout:3/687: sync 2024-04-26T12:28:48.624 INFO:tasks.workunit.client.0.smithi046.stdout:1/577: dread d7/db/d98/dc5/d2b/fb8 [0,4194304] 0 2024-04-26T12:28:48.624 INFO:tasks.workunit.client.0.smithi046.stdout:1/578: sync 2024-04-26T12:28:48.625 INFO:tasks.workunit.client.0.smithi046.stdout:6/647: rename d7/d1b/d47/cb1 to d7/d1b/d47/d65/d77/cd3 0 2024-04-26T12:28:48.626 INFO:tasks.workunit.client.0.smithi046.stdout:9/561: truncate d0/d16/d76/d7d/d72/d85/d97/f9c 305801 0 2024-04-26T12:28:48.627 INFO:tasks.workunit.client.0.smithi046.stdout:3/688: rename d2/d16/d2c/d50/d71/d89/dc5/d23/f49 to d2/db/dec/ff3 0 2024-04-26T12:28:48.628 INFO:tasks.workunit.client.0.smithi046.stdout:1/579: creat d7/db0/fcc x:0 0 0 2024-04-26T12:28:48.628 INFO:tasks.workunit.client.0.smithi046.stdout:2/621: dwrite d1/d42/f60 [0,4194304] 0 2024-04-26T12:28:48.629 INFO:tasks.workunit.client.0.smithi046.stdout:8/732: dread d7/d1c/d74/df4/fb7 [0,4194304] 0 2024-04-26T12:28:48.629 INFO:tasks.workunit.client.0.smithi046.stdout:9/562: mknod d0/d2c/dbe/dc0/cc5 0 2024-04-26T12:28:48.629 INFO:tasks.workunit.client.0.smithi046.stdout:4/622: rename d0/d1/d5/c32 to d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/cd3 0 2024-04-26T12:28:48.630 INFO:tasks.workunit.client.0.smithi046.stdout:2/622: dread - d1/d71/f77 zero size 2024-04-26T12:28:48.630 INFO:tasks.workunit.client.0.smithi046.stdout:3/689: mknod d2/d16/d35/dbc/dc9/dd0/cf4 0 2024-04-26T12:28:48.631 INFO:tasks.workunit.client.0.smithi046.stdout:9/563: readlink d0/d2c/l3a 0 2024-04-26T12:28:48.632 INFO:tasks.workunit.client.0.smithi046.stdout:1/580: creat d7/db/d98/dc5/d2b/d39/db3/d79/fcd x:0 0 0 2024-04-26T12:28:48.632 INFO:tasks.workunit.client.0.smithi046.stdout:5/736: dwrite d9/da/dd/d34/f6f [0,4194304] 0 2024-04-26T12:28:48.634 INFO:tasks.workunit.client.0.smithi046.stdout:7/668: dread d16/d1a/d31/d4d/f77 [0,4194304] 0 2024-04-26T12:28:48.635 INFO:tasks.workunit.client.0.smithi046.stdout:9/564: chown d0/d16/d5f/c7e 1606 1 2024-04-26T12:28:48.637 INFO:tasks.workunit.client.0.smithi046.stdout:1/581: creat d7/db/d98/dc5/d2b/d31/fce x:0 0 0 2024-04-26T12:28:48.637 INFO:tasks.workunit.client.0.smithi046.stdout:5/737: mkdir d9/da/d40/dfa 0 2024-04-26T12:28:48.637 INFO:tasks.workunit.client.0.smithi046.stdout:6/648: dwrite d7/d2b/f53 [0,4194304] 0 2024-04-26T12:28:48.641 INFO:tasks.workunit.client.0.smithi046.stdout:7/669: creat d16/d4e/d6c/fdd x:0 0 0 2024-04-26T12:28:48.642 INFO:tasks.workunit.client.0.smithi046.stdout:1/582: fdatasync d7/d14/d5d/d6b/dc2/d76/f7c 0 2024-04-26T12:28:48.642 INFO:tasks.workunit.client.0.smithi046.stdout:8/733: dread d7/d24/d50/d62/f68 [0,4194304] 0 2024-04-26T12:28:48.642 INFO:tasks.workunit.client.0.smithi046.stdout:5/738: creat d9/da/d18/d7d/ffb x:0 0 0 2024-04-26T12:28:48.642 INFO:tasks.workunit.client.0.smithi046.stdout:7/670: creat d16/d1a/fde x:0 0 0 2024-04-26T12:28:48.643 INFO:tasks.workunit.client.0.smithi046.stdout:4/623: dwrite d0/da/d17/d20/d25/d35/d61/f7b [0,4194304] 0 2024-04-26T12:28:48.644 INFO:tasks.workunit.client.0.smithi046.stdout:9/565: dwrite d0/d19/d51/f57 [0,4194304] 0 2024-04-26T12:28:48.647 INFO:tasks.workunit.client.0.smithi046.stdout:3/690: truncate d2/db/d4a/da9/fbd 3161061 0 2024-04-26T12:28:48.647 INFO:tasks.workunit.client.0.smithi046.stdout:2/623: dwrite d1/de/d65/d4a/f4d [0,4194304] 0 2024-04-26T12:28:48.647 INFO:tasks.workunit.client.0.smithi046.stdout:5/739: readlink d9/da/dd/d34/d44/d97/da4/l7a 0 2024-04-26T12:28:48.648 INFO:tasks.workunit.client.0.smithi046.stdout:1/583: truncate d7/db/f10 4531987 0 2024-04-26T12:28:48.649 INFO:tasks.workunit.client.0.smithi046.stdout:6/649: dwrite d7/d1b/f74 [0,4194304] 0 2024-04-26T12:28:48.649 INFO:tasks.workunit.client.0.smithi046.stdout:6/650: sync 2024-04-26T12:28:48.649 INFO:tasks.workunit.client.0.smithi046.stdout:9/566: creat d0/fc6 x:0 0 0 2024-04-26T12:28:48.650 INFO:tasks.workunit.client.0.smithi046.stdout:4/624: creat d0/fd4 x:0 0 0 2024-04-26T12:28:48.651 INFO:tasks.workunit.client.0.smithi046.stdout:7/671: symlink d16/d1a/d31/d5a/d93/dd9/ldf 0 2024-04-26T12:28:48.651 INFO:tasks.workunit.client.0.smithi046.stdout:2/624: chown d1/de/d15/d18/d8a 73993 1 2024-04-26T12:28:48.651 INFO:tasks.workunit.client.0.smithi046.stdout:1/584: chown d7/db/f10 1 1 2024-04-26T12:28:48.651 INFO:tasks.workunit.client.0.smithi046.stdout:5/740: chown d9/da/dd/c1d 413924842 1 2024-04-26T12:28:48.653 INFO:tasks.workunit.client.0.smithi046.stdout:3/691: creat d2/d16/d2c/d50/d71/d89/dc5/d82/ff5 x:0 0 0 2024-04-26T12:28:48.653 INFO:tasks.workunit.client.0.smithi046.stdout:6/651: write d7/d1b/d47/d65/da3/dbe/fc0 [59563,95355] 0 2024-04-26T12:28:48.654 INFO:tasks.workunit.client.0.smithi046.stdout:7/672: readlink d16/d1a/d31/d62/l68 0 2024-04-26T12:28:48.655 INFO:tasks.workunit.client.0.smithi046.stdout:1/585: rename d7/d14/d5d/c5e to d7/db/d98/dc5/d2b/d31/d82/ccf 0 2024-04-26T12:28:48.656 INFO:tasks.workunit.client.0.smithi046.stdout:6/652: mknod d7/d1b/d37/cd4 0 2024-04-26T12:28:48.658 INFO:tasks.workunit.client.0.smithi046.stdout:2/625: link d1/de/d2b/c2f d1/de/d65/d1b/cd7 0 2024-04-26T12:28:48.658 INFO:tasks.workunit.client.0.smithi046.stdout:9/567: dwrite d0/d29/d69/d88/f94 [4194304,4194304] 0 2024-04-26T12:28:48.658 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:48.657+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:48.659 INFO:tasks.workunit.client.0.smithi046.stdout:1/586: mkdir d7/db/d98/dc5/d2b/d31/dd0 0 2024-04-26T12:28:48.660 INFO:tasks.workunit.client.0.smithi046.stdout:8/734: dwrite d7/d1c/d74/df4/f45 [4194304,4194304] 0 2024-04-26T12:28:48.662 INFO:tasks.workunit.client.0.smithi046.stdout:6/653: write d7/f13 [4662058,36525] 0 2024-04-26T12:28:48.662 INFO:tasks.workunit.client.0.smithi046.stdout:7/673: getdents d16/d4e 0 2024-04-26T12:28:48.664 INFO:tasks.workunit.client.0.smithi046.stdout:0/683: dread d9/dc/d2a/f31 [0,4194304] 0 2024-04-26T12:28:48.665 INFO:tasks.workunit.client.0.smithi046.stdout:7/674: write f9 [2574225,107948] 0 2024-04-26T12:28:48.665 INFO:tasks.workunit.client.0.smithi046.stdout:0/684: read f5 [738238,95793] 0 2024-04-26T12:28:48.665 INFO:tasks.workunit.client.0.smithi046.stdout:5/741: dwrite d9/da/dd/d34/fcb [0,4194304] 0 2024-04-26T12:28:48.665 INFO:tasks.workunit.client.0.smithi046.stdout:8/735: read - d7/d1c/d74/df4/d1b/dae/fe1 zero size 2024-04-26T12:28:48.666 INFO:tasks.workunit.client.0.smithi046.stdout:4/625: dwrite d0/da/d17/d20/d25/d35/d6d/d19/f3d [0,4194304] 0 2024-04-26T12:28:48.666 INFO:tasks.workunit.client.0.smithi046.stdout:6/654: write d7/f8b [412282,18517] 0 2024-04-26T12:28:48.666 INFO:tasks.workunit.client.0.smithi046.stdout:2/626: link d1/de/fab d1/de/d15/d18/d98/fd8 0 2024-04-26T12:28:48.666 INFO:tasks.workunit.client.0.smithi046.stdout:2/627: chown d1/de/d2b/f37 718249 1 2024-04-26T12:28:48.668 INFO:tasks.workunit.client.0.smithi046.stdout:2/628: link d1/de/d65/d1b/fd0 d1/de/d67/fd9 0 2024-04-26T12:28:48.668 INFO:tasks.workunit.client.0.smithi046.stdout:1/587: write d7/d14/d5d/d32/faa [436042,110485] 0 2024-04-26T12:28:48.669 INFO:tasks.workunit.client.0.smithi046.stdout:2/629: unlink d1/de/d65/d4a/cce 0 2024-04-26T12:28:48.670 INFO:tasks.workunit.client.0.smithi046.stdout:8/736: symlink d7/d1c/d74/df4/d1b/dae/dcf/lf5 0 2024-04-26T12:28:48.670 INFO:tasks.workunit.client.0.smithi046.stdout:5/742: write d9/da/dd/d34/d44/d97/da4/dde/ff2 [274449,68692] 0 2024-04-26T12:28:48.671 INFO:tasks.workunit.client.0.smithi046.stdout:4/626: truncate d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/f90 4459042 0 2024-04-26T12:28:48.672 INFO:tasks.workunit.client.0.smithi046.stdout:5/743: readlink d9/da/d18/d7d/l52 0 2024-04-26T12:28:48.672 INFO:tasks.workunit.client.0.smithi046.stdout:4/627: fsync d0/f14 0 2024-04-26T12:28:48.674 INFO:tasks.workunit.client.0.smithi046.stdout:9/568: dwrite d0/d2c/d3d/f4f [0,4194304] 0 2024-04-26T12:28:48.674 INFO:tasks.workunit.client.0.smithi046.stdout:1/588: creat d7/db/d98/dc5/d2b/d39/db3/fd1 x:0 0 0 2024-04-26T12:28:48.674 INFO:tasks.workunit.client.0.smithi046.stdout:2/630: rename d1/de/d65/d1b/d38 to d1/de/d15/d18/dc1/db6/dda 0 2024-04-26T12:28:48.675 INFO:tasks.workunit.client.0.smithi046.stdout:5/744: fdatasync d9/da/dd/d34/f8a 0 2024-04-26T12:28:48.677 INFO:tasks.workunit.client.0.smithi046.stdout:1/589: dread - d7/d14/d5d/d6b/fba zero size 2024-04-26T12:28:48.677 INFO:tasks.workunit.client.0.smithi046.stdout:0/685: dwrite d9/dc/d2a/f4a [0,4194304] 0 2024-04-26T12:28:48.677 INFO:tasks.workunit.client.0.smithi046.stdout:9/569: mknod d0/d2c/d47/cc7 0 2024-04-26T12:28:48.678 INFO:tasks.workunit.client.0.smithi046.stdout:4/628: truncate d0/da/d17/d20/d25/d35/d6d/d19/f6c 313420 0 2024-04-26T12:28:48.678 INFO:tasks.workunit.client.0.smithi046.stdout:7/675: truncate d16/d27/d51/f63 1103903 0 2024-04-26T12:28:48.680 INFO:tasks.workunit.client.0.smithi046.stdout:8/737: dwrite d7/d24/f2f [0,4194304] 0 2024-04-26T12:28:48.680 INFO:tasks.workunit.client.0.smithi046.stdout:1/590: write d7/db/d98/dc5/d2b/d96/fb4 [787369,51416] 0 2024-04-26T12:28:48.681 INFO:tasks.workunit.client.0.smithi046.stdout:2/631: getdents d1/de/d65 0 2024-04-26T12:28:48.681 INFO:tasks.workunit.client.0.smithi046.stdout:3/692: dread d2/d16/d2c/d50/d71/d89/f9e [0,4194304] 0 2024-04-26T12:28:48.681 INFO:tasks.workunit.client.0.smithi046.stdout:9/570: rename d0/d16/d5f to d0/d16/d76/d7d/d72/da1/dc8 0 2024-04-26T12:28:48.681 INFO:tasks.workunit.client.0.smithi046.stdout:7/676: write f5 [3646489,84437] 0 2024-04-26T12:28:48.681 INFO:tasks.workunit.client.0.smithi046.stdout:4/629: rmdir d0/da/d17/d20/d25/d35/d6d/d19/d55/dae 39 2024-04-26T12:28:48.682 INFO:tasks.workunit.client.0.smithi046.stdout:1/591: readlink d7/d14/d5d/d6b/dc2/l81 0 2024-04-26T12:28:48.682 INFO:tasks.workunit.client.0.smithi046.stdout:3/693: chown d2/d16/l12 41 1 2024-04-26T12:28:48.682 INFO:tasks.workunit.client.0.smithi046.stdout:1/592: chown d7/db0 22075 1 2024-04-26T12:28:48.683 INFO:tasks.workunit.client.0.smithi046.stdout:2/632: creat d1/de/db1/fdb x:0 0 0 2024-04-26T12:28:48.683 INFO:tasks.workunit.client.0.smithi046.stdout:8/738: truncate d7/d24/d50/d2a/d54/fad 343599 0 2024-04-26T12:28:48.683 INFO:tasks.workunit.client.0.smithi046.stdout:1/593: readlink d7/d14/d5d/d6b/lb1 0 2024-04-26T12:28:48.683 INFO:tasks.workunit.client.0.smithi046.stdout:5/745: rename d9/da/dd/dd7/db0/de0/f76 to d9/da/dd/d34/d45/d8f/ffc 0 2024-04-26T12:28:48.684 INFO:tasks.workunit.client.0.smithi046.stdout:4/630: creat d0/da/d70/fd5 x:0 0 0 2024-04-26T12:28:48.684 INFO:tasks.workunit.client.0.smithi046.stdout:0/686: rename d9/d1d/d40/d41/d7e/da5/dad/dbd to d9/d1d/d40/d41/d7e/da5/dad/dbd/dcd/df0 22 2024-04-26T12:28:48.684 INFO:tasks.workunit.client.0.smithi046.stdout:3/694: mkdir d2/d16/d2c/d50/d71/df6 0 2024-04-26T12:28:48.684 INFO:tasks.workunit.client.0.smithi046.stdout:6/655: dread d7/f59 [0,4194304] 0 2024-04-26T12:28:48.685 INFO:tasks.workunit.client.0.smithi046.stdout:8/739: fsync d7/d1c/d74/df4/d1b/f8e 0 2024-04-26T12:28:48.686 INFO:tasks.workunit.client.0.smithi046.stdout:5/746: mknod d9/da/d18/d8b/cfd 0 2024-04-26T12:28:48.686 INFO:tasks.workunit.client.0.smithi046.stdout:6/656: chown d7/d2b/d31/fcf 6513 1 2024-04-26T12:28:48.686 INFO:tasks.workunit.client.0.smithi046.stdout:0/687: chown d9/dc/f26 10 1 2024-04-26T12:28:48.686 INFO:tasks.workunit.client.0.smithi046.stdout:3/695: chown d2/d16/d35/fc2 163 1 2024-04-26T12:28:48.686 INFO:tasks.workunit.client.0.smithi046.stdout:0/688: write d9/dc/f1c [2331514,20164] 0 2024-04-26T12:28:48.687 INFO:tasks.workunit.client.0.smithi046.stdout:6/657: write d7/d1b/d47/d65/da3/dbe/fc0 [844994,53719] 0 2024-04-26T12:28:48.687 INFO:tasks.workunit.client.0.smithi046.stdout:3/696: dread - d2/d16/d2c/d50/d71/d89/dc5/f81 zero size 2024-04-26T12:28:48.687 INFO:tasks.workunit.client.0.smithi046.stdout:8/740: sync 2024-04-26T12:28:48.687 INFO:tasks.workunit.client.0.smithi046.stdout:5/747: unlink d9/da/dd/d5d/fad 0 2024-04-26T12:28:48.688 INFO:tasks.workunit.client.0.smithi046.stdout:7/677: rename d16/d1a/d31/d4d/laf to d16/d4e/d6c/d9f/le0 0 2024-04-26T12:28:48.688 INFO:tasks.workunit.client.0.smithi046.stdout:1/594: link d7/db/d98/dc5/d2b/l3f d7/db/d98/dc5/d2b/d39/ld2 0 2024-04-26T12:28:48.688 INFO:tasks.workunit.client.0.smithi046.stdout:3/697: creat d2/d16/d35/ff7 x:0 0 0 2024-04-26T12:28:48.689 INFO:tasks.workunit.client.0.smithi046.stdout:7/678: rmdir d16/d3f 39 2024-04-26T12:28:48.689 INFO:tasks.workunit.client.0.smithi046.stdout:0/689: creat d9/d1d/d40/d41/dc0/db2/ff1 x:0 0 0 2024-04-26T12:28:48.689 INFO:tasks.workunit.client.0.smithi046.stdout:8/741: dread - d7/d1c/d74/df4/d1b/dae/fc0 zero size 2024-04-26T12:28:48.689 INFO:tasks.workunit.client.0.smithi046.stdout:6/658: rename d7/d1b/d47/f4e to d7/d1b/d37/fd5 0 2024-04-26T12:28:48.690 INFO:tasks.workunit.client.0.smithi046.stdout:3/698: write d2/db/d4a/f86 [151545,28798] 0 2024-04-26T12:28:48.690 INFO:tasks.workunit.client.0.smithi046.stdout:1/595: mkdir d7/d14/d5d/d32/d41/d8f/dd3 0 2024-04-26T12:28:48.691 INFO:tasks.workunit.client.0.smithi046.stdout:5/748: getdents d9/da/dd/dd7 0 2024-04-26T12:28:48.691 INFO:tasks.workunit.client.0.smithi046.stdout:6/659: mkdir d7/da7/dd1/dd6 0 2024-04-26T12:28:48.691 INFO:tasks.workunit.client.0.smithi046.stdout:7/679: fsync d16/d1a/d31/d5a/f3d 0 2024-04-26T12:28:48.691 INFO:tasks.workunit.client.0.smithi046.stdout:8/742: mkdir d7/d1c/d74/df4/d1b/dae/dcf/df6 0 2024-04-26T12:28:48.692 INFO:tasks.workunit.client.0.smithi046.stdout:6/660: readlink d7/d2b/d31/l87 0 2024-04-26T12:28:48.692 INFO:tasks.workunit.client.0.smithi046.stdout:5/749: write d9/da/d15/fd1 [481290,29008] 0 2024-04-26T12:28:48.692 INFO:tasks.workunit.client.0.smithi046.stdout:5/750: sync 2024-04-26T12:28:48.692 INFO:tasks.workunit.client.0.smithi046.stdout:3/699: link d2/c6b d2/db/d4a/da9/cf8 0 2024-04-26T12:28:48.693 INFO:tasks.workunit.client.0.smithi046.stdout:8/743: write d7/d1c/d74/df4/d1b/dae/fc0 [650640,3878] 0 2024-04-26T12:28:48.693 INFO:tasks.workunit.client.0.smithi046.stdout:6/661: creat d7/d2b/d31/fd7 x:0 0 0 2024-04-26T12:28:48.694 INFO:tasks.workunit.client.0.smithi046.stdout:6/662: stat d7/f13 0 2024-04-26T12:28:48.694 INFO:tasks.workunit.client.0.smithi046.stdout:5/751: truncate d9/da/dd/f66 661166 0 2024-04-26T12:28:48.695 INFO:tasks.workunit.client.0.smithi046.stdout:7/680: truncate d16/d1a/d3e/d59/f8b 221323 0 2024-04-26T12:28:48.696 INFO:tasks.workunit.client.0.smithi046.stdout:0/690: write d9/f12 [393248,27598] 0 2024-04-26T12:28:48.696 INFO:tasks.workunit.client.0.smithi046.stdout:0/691: sync 2024-04-26T12:28:48.697 INFO:tasks.workunit.client.0.smithi046.stdout:5/752: creat d9/da/d15/ffe x:0 0 0 2024-04-26T12:28:48.697 INFO:tasks.workunit.client.0.smithi046.stdout:1/596: dwrite d7/d14/d5d/f9a [0,4194304] 0 2024-04-26T12:28:48.698 INFO:tasks.workunit.client.0.smithi046.stdout:7/681: truncate d16/d1a/d3e/dc5/fd6 387486 0 2024-04-26T12:28:48.698 INFO:tasks.workunit.client.0.smithi046.stdout:3/700: rename d2/d16/d2c/d50/d71/d89/dc5/d1b/c61 to d2/db/cf9 0 2024-04-26T12:28:48.699 INFO:tasks.workunit.client.0.smithi046.stdout:5/753: chown d9/da/d18/d7d/l4a 24055 1 2024-04-26T12:28:48.700 INFO:tasks.workunit.client.0.smithi046.stdout:1/597: dread - d7/db/d98/dc5/d2b/d96/f9e zero size 2024-04-26T12:28:48.701 INFO:tasks.workunit.client.0.smithi046.stdout:0/692: rename d9/dc/c19 to d9/dc/dd/d45/d69/de6/cf2 0 2024-04-26T12:28:48.701 INFO:tasks.workunit.client.0.smithi046.stdout:7/682: write d16/d1a/d3e/f44 [526295,82773] 0 2024-04-26T12:28:48.701 INFO:tasks.workunit.client.0.smithi046.stdout:6/663: link d7/d2b/d31/f80 d7/d1b/d47/d65/da3/dbe/fd8 0 2024-04-26T12:28:48.701 INFO:tasks.workunit.client.0.smithi046.stdout:0/693: readlink d9/d1d/l6f 0 2024-04-26T12:28:48.702 INFO:tasks.workunit.client.0.smithi046.stdout:8/744: dwrite d7/d24/d50/d2a/d39/fd3 [0,4194304] 0 2024-04-26T12:28:48.702 INFO:tasks.workunit.client.0.smithi046.stdout:6/664: fdatasync d7/f15 0 2024-04-26T12:28:48.703 INFO:tasks.workunit.client.0.smithi046.stdout:1/598: symlink d7/d14/d5d/d32/d5f/ld4 0 2024-04-26T12:28:48.703 INFO:tasks.workunit.client.0.smithi046.stdout:5/754: readlink d9/da/dd/d34/d44/d97/da4/ld3 0 2024-04-26T12:28:48.703 INFO:tasks.workunit.client.0.smithi046.stdout:6/665: chown d7/d2b/l9f 28 1 2024-04-26T12:28:48.703 INFO:tasks.workunit.client.0.smithi046.stdout:0/694: write d9/d1d/d5d/d6b/f7d [3919862,7565] 0 2024-04-26T12:28:48.704 INFO:tasks.workunit.client.0.smithi046.stdout:7/683: truncate d16/d1a/f2b 1273836 0 2024-04-26T12:28:48.704 INFO:tasks.workunit.client.0.smithi046.stdout:5/755: unlink d9/da/d40/fb5 0 2024-04-26T12:28:48.704 INFO:tasks.workunit.client.0.smithi046.stdout:1/599: write d7/fae [708222,90153] 0 2024-04-26T12:28:48.705 INFO:tasks.workunit.client.0.smithi046.stdout:3/701: dread d2/d16/d35/fcc [0,4194304] 0 2024-04-26T12:28:48.706 INFO:tasks.workunit.client.0.smithi046.stdout:7/684: creat d16/d1a/d31/d55/d6d/d89/dc7/fe1 x:0 0 0 2024-04-26T12:28:48.706 INFO:tasks.workunit.client.0.smithi046.stdout:2/633: dread d1/de/d65/d4a/f82 [0,4194304] 0 2024-04-26T12:28:48.706 INFO:tasks.workunit.client.0.smithi046.stdout:7/685: sync 2024-04-26T12:28:48.706 INFO:tasks.workunit.client.0.smithi046.stdout:5/756: chown d9/da/dd/ff4 239 1 2024-04-26T12:28:48.706 INFO:tasks.workunit.client.0.smithi046.stdout:5/757: sync 2024-04-26T12:28:48.707 INFO:tasks.workunit.client.0.smithi046.stdout:7/686: chown d16/db1 3 1 2024-04-26T12:28:48.707 INFO:tasks.workunit.client.0.smithi046.stdout:0/695: write d9/dc/dd/d45/d69/f8b [469895,116404] 0 2024-04-26T12:28:48.707 INFO:tasks.workunit.client.0.smithi046.stdout:0/696: readlink d9/l77 0 2024-04-26T12:28:48.708 INFO:tasks.workunit.client.0.smithi046.stdout:1/600: truncate d7/d14/d5d/d32/d41/d8f/fa7 906560 0 2024-04-26T12:28:48.708 INFO:tasks.workunit.client.0.smithi046.stdout:7/687: creat d16/d27/fe2 x:0 0 0 2024-04-26T12:28:48.708 INFO:tasks.workunit.client.0.smithi046.stdout:2/634: fsync d1/de/d65/d4a/d58/f9d 0 2024-04-26T12:28:48.708 INFO:tasks.workunit.client.0.smithi046.stdout:1/601: chown d7/db0 881285 1 2024-04-26T12:28:48.709 INFO:tasks.workunit.client.0.smithi046.stdout:8/745: dwrite d7/d24/d50/d2a/d39/f48 [0,4194304] 0 2024-04-26T12:28:48.709 INFO:tasks.workunit.client.0.smithi046.stdout:6/666: truncate d7/d2b/d31/f43 6023454 0 2024-04-26T12:28:48.709 INFO:tasks.workunit.client.0.smithi046.stdout:5/758: mkdir d9/da/dd/d34/d44/d97/da4/d35/dd8/dff 0 2024-04-26T12:28:48.710 INFO:tasks.workunit.client.0.smithi046.stdout:2/635: unlink d1/d42/fcf 0 2024-04-26T12:28:48.711 INFO:tasks.workunit.client.0.smithi046.stdout:2/636: sync 2024-04-26T12:28:48.711 INFO:tasks.workunit.client.0.smithi046.stdout:7/688: creat d16/d1a/d31/d55/d6d/d89/dc7/fe3 x:0 0 0 2024-04-26T12:28:48.711 INFO:tasks.workunit.client.0.smithi046.stdout:1/602: symlink d7/db/d98/dc5/ld5 0 2024-04-26T12:28:48.711 INFO:tasks.workunit.client.0.smithi046.stdout:8/746: write d7/da/fa9 [2622880,38816] 0 2024-04-26T12:28:48.712 INFO:tasks.workunit.client.0.smithi046.stdout:8/747: sync 2024-04-26T12:28:48.712 INFO:tasks.workunit.client.0.smithi046.stdout:6/667: mkdir d7/d2b/d31/dd9 0 2024-04-26T12:28:48.712 INFO:tasks.workunit.client.0.smithi046.stdout:6/668: sync 2024-04-26T12:28:48.714 INFO:tasks.workunit.client.0.smithi046.stdout:2/637: rename d1/d71/f77 to d1/d71/fdc 0 2024-04-26T12:28:48.714 INFO:tasks.workunit.client.0.smithi046.stdout:7/689: creat d16/d1a/fe4 x:0 0 0 2024-04-26T12:28:48.715 INFO:tasks.workunit.client.0.smithi046.stdout:0/697: dwrite d9/d1d/d5d/f5e [0,4194304] 0 2024-04-26T12:28:48.715 INFO:tasks.workunit.client.0.smithi046.stdout:6/669: readlink d7/d1b/d47/d65/da3/dbe/lce 0 2024-04-26T12:28:48.715 INFO:tasks.workunit.client.0.smithi046.stdout:9/571: dread d0/d16/d76/d7d/fad [0,4194304] 0 2024-04-26T12:28:48.717 INFO:tasks.workunit.client.0.smithi046.stdout:2/638: chown d1/de/d65/d8f/fa3 79183 1 2024-04-26T12:28:48.718 INFO:tasks.workunit.client.0.smithi046.stdout:7/690: creat d16/d27/d7e/fe5 x:0 0 0 2024-04-26T12:28:48.719 INFO:tasks.workunit.client.0.smithi046.stdout:3/702: dread d2/d16/d35/dbc/dc9/dd0/fb4 [0,4194304] 0 2024-04-26T12:28:48.719 INFO:tasks.workunit.client.0.smithi046.stdout:5/759: dwrite d9/da/dd/d34/f6f [0,4194304] 0 2024-04-26T12:28:48.720 INFO:tasks.workunit.client.0.smithi046.stdout:0/698: getdents d9/dc/dd/dd2/de2/def 0 2024-04-26T12:28:48.720 INFO:tasks.workunit.client.0.smithi046.stdout:2/639: write d1/d71/fdc [20728,69001] 0 2024-04-26T12:28:48.720 INFO:tasks.workunit.client.0.smithi046.stdout:1/603: dread d7/d14/d5d/d32/f75 [0,4194304] 0 2024-04-26T12:28:48.721 INFO:tasks.workunit.client.0.smithi046.stdout:1/604: mkdir d7/db0/dd6 0 2024-04-26T12:28:48.721 INFO:tasks.workunit.client.0.smithi046.stdout:5/760: write d9/da/dd/d34/d44/fcd [268736,117999] 0 2024-04-26T12:28:48.721 INFO:tasks.workunit.client.0.smithi046.stdout:2/640: mkdir d1/de/dc8/ddd 0 2024-04-26T12:28:48.722 INFO:tasks.workunit.client.0.smithi046.stdout:2/641: chown d1/de/d65/d4a/d58/f5c 4 1 2024-04-26T12:28:48.723 INFO:tasks.workunit.client.0.smithi046.stdout:4/631: dread d0/da/d17/d20/d25/d35/d61/f75 [0,4194304] 0 2024-04-26T12:28:48.723 INFO:tasks.workunit.client.0.smithi046.stdout:7/691: rmdir d16/d1a/d31/d55 39 2024-04-26T12:28:48.725 INFO:tasks.workunit.client.0.smithi046.stdout:2/642: getdents d1/de/d65/d1b/dca 0 2024-04-26T12:28:48.725 INFO:tasks.workunit.client.0.smithi046.stdout:0/699: getdents d9/dc 0 2024-04-26T12:28:48.725 INFO:tasks.workunit.client.0.smithi046.stdout:7/692: chown d16/d35/dac/f94 31220 1 2024-04-26T12:28:48.726 INFO:tasks.workunit.client.0.smithi046.stdout:1/605: readlink d7/db/d98/dc5/d2b/d31/d82/la3 0 2024-04-26T12:28:48.726 INFO:tasks.workunit.client.0.smithi046.stdout:0/700: write d9/dc/f1c [6734491,47036] 0 2024-04-26T12:28:48.727 INFO:tasks.workunit.client.0.smithi046.stdout:7/693: unlink l1 0 2024-04-26T12:28:48.728 INFO:tasks.workunit.client.0.smithi046.stdout:4/632: dread d0/d1/d5/db/f10 [0,4194304] 0 2024-04-26T12:28:48.728 INFO:tasks.workunit.client.0.smithi046.stdout:0/701: fdatasync d9/dc/fc7 0 2024-04-26T12:28:48.729 INFO:tasks.workunit.client.0.smithi046.stdout:5/761: dwrite d9/da/dd/d34/d44/d97/da4/dde/fef [0,4194304] 0 2024-04-26T12:28:48.729 INFO:tasks.workunit.client.0.smithi046.stdout:2/643: write d1/de/d15/d18/d91/fb9 [438881,73385] 0 2024-04-26T12:28:48.729 INFO:tasks.workunit.client.0.smithi046.stdout:0/702: readlink d9/d1d/l6f 0 2024-04-26T12:28:48.730 INFO:tasks.workunit.client.0.smithi046.stdout:9/572: dwrite d0/d16/d76/d7d/faa [0,4194304] 0 2024-04-26T12:28:48.730 INFO:tasks.workunit.client.0.smithi046.stdout:1/606: symlink d7/db/d98/dc5/d2b/d9f/ld7 0 2024-04-26T12:28:48.731 INFO:tasks.workunit.client.0.smithi046.stdout:5/762: dread - d9/da/d18/d7d/ffb zero size 2024-04-26T12:28:48.731 INFO:tasks.workunit.client.0.smithi046.stdout:0/703: chown d9/dc/dd/d45/f4b 0 1 2024-04-26T12:28:48.732 INFO:tasks.workunit.client.0.smithi046.stdout:2/644: truncate d1/de/d65/d4a/d58/f62 541302 0 2024-04-26T12:28:48.732 INFO:tasks.workunit.client.0.smithi046.stdout:7/694: dread d16/d1a/d31/f49 [0,4194304] 0 2024-04-26T12:28:48.732 INFO:tasks.workunit.client.0.smithi046.stdout:1/607: mknod d7/d14/d5d/d32/d5f/cd8 0 2024-04-26T12:28:48.733 INFO:tasks.workunit.client.0.smithi046.stdout:5/763: rmdir d9/da/dd/d34/d44 39 2024-04-26T12:28:48.733 INFO:tasks.workunit.client.0.smithi046.stdout:9/573: creat d0/d16/fc9 x:0 0 0 2024-04-26T12:28:48.733 INFO:tasks.workunit.client.0.smithi046.stdout:0/704: link d9/dc/dd/dd2/de2/fc5 d9/d1d/d40/db3/ff3 0 2024-04-26T12:28:48.734 INFO:tasks.workunit.client.0.smithi046.stdout:1/608: fdatasync d7/d14/d5d/f30 0 2024-04-26T12:28:48.735 INFO:tasks.workunit.client.0.smithi046.stdout:0/705: chown d9/dc/dd/d45/l91 93071568 1 2024-04-26T12:28:48.735 INFO:tasks.workunit.client.0.smithi046.stdout:8/748: dread d7/d24/d50/f9b [0,4194304] 0 2024-04-26T12:28:48.735 INFO:tasks.workunit.client.0.smithi046.stdout:5/764: link d9/da/dd/d34/f6f d9/da/dd/dd7/db0/db6/f100 0 2024-04-26T12:28:48.735 INFO:tasks.workunit.client.0.smithi046.stdout:1/609: write d7/d14/d5d/d32/f75 [1824940,113618] 0 2024-04-26T12:28:48.736 INFO:tasks.workunit.client.0.smithi046.stdout:4/633: creat d0/da/d17/d20/d25/d35/d61/dc6/fd6 x:0 0 0 2024-04-26T12:28:48.736 INFO:tasks.workunit.client.0.smithi046.stdout:4/634: stat d0/fa2 0 2024-04-26T12:28:48.736 INFO:tasks.workunit.client.0.smithi046.stdout:8/749: truncate d7/d24/d50/f89 319420 0 2024-04-26T12:28:48.739 INFO:tasks.workunit.client.0.smithi046.stdout:0/706: symlink d9/dc/dd/d45/lf4 0 2024-04-26T12:28:48.739 INFO:tasks.workunit.client.0.smithi046.stdout:9/574: rename d0/d16/d76/d7d/d72/da1/dc8/c83 to d0/d16/d76/d7d/d72/da1/cca 0 2024-04-26T12:28:48.740 INFO:tasks.workunit.client.0.smithi046.stdout:1/610: read - d7/f62 zero size 2024-04-26T12:28:48.740 INFO:tasks.workunit.client.0.smithi046.stdout:8/750: creat d7/d24/d50/d2a/d54/df3/ff7 x:0 0 0 2024-04-26T12:28:48.741 INFO:tasks.workunit.client.0.smithi046.stdout:9/575: write d0/d19/d21/f53 [552256,50060] 0 2024-04-26T12:28:48.741 INFO:tasks.workunit.client.0.smithi046.stdout:0/707: write d9/d1d/d40/d41/d7e/da5/faa [232310,22540] 0 2024-04-26T12:28:48.742 INFO:tasks.workunit.client.0.smithi046.stdout:1/611: fsync d7/db/d98/dc5/d2b/d96/f9e 0 2024-04-26T12:28:48.742 INFO:tasks.workunit.client.0.smithi046.stdout:7/695: truncate d16/d1a/d31/f70 6165493 0 2024-04-26T12:28:48.743 INFO:tasks.workunit.client.0.smithi046.stdout:1/612: readlink d7/d14/lb5 0 2024-04-26T12:28:48.744 INFO:tasks.workunit.client.0.smithi046.stdout:4/635: dwrite d0/da/fd [0,4194304] 0 2024-04-26T12:28:48.746 INFO:tasks.workunit.client.0.smithi046.stdout:9/576: getdents d0/d2c 0 2024-04-26T12:28:48.748 INFO:tasks.workunit.client.0.smithi046.stdout:2/645: dwrite d1/de/d65/f66 [0,4194304] 0 2024-04-26T12:28:48.749 INFO:tasks.workunit.client.0.smithi046.stdout:8/751: dwrite d7/d1c/d74/df4/d1b/fd7 [0,4194304] 0 2024-04-26T12:28:48.750 INFO:tasks.workunit.client.0.smithi046.stdout:2/646: chown d1/de/d65/d4a/d58/f9d 1748572 1 2024-04-26T12:28:48.750 INFO:tasks.workunit.client.0.smithi046.stdout:9/577: rename d0/d29/d69/fa4 to d0/d2c/dbd/fcb 0 2024-04-26T12:28:48.750 INFO:tasks.workunit.client.0.smithi046.stdout:0/708: dread f5 [0,4194304] 0 2024-04-26T12:28:48.751 INFO:tasks.workunit.client.0.smithi046.stdout:0/709: chown d9/d1d/d40/db3/ff3 85781 1 2024-04-26T12:28:48.751 INFO:tasks.workunit.client.0.smithi046.stdout:1/613: link d7/db/d98/dc5/d2b/d96/cb2 d7/db/d98/dc5/d2b/d39/d5c/cd9 0 2024-04-26T12:28:48.752 INFO:tasks.workunit.client.0.smithi046.stdout:7/696: link d16/d1a/d31/d4d/f5f d16/d1a/d31/d5a/d6b/fe6 0 2024-04-26T12:28:48.752 INFO:tasks.workunit.client.0.smithi046.stdout:8/752: link d7/d24/d50/db3/fc8 d7/da/d88/ff8 0 2024-04-26T12:28:48.753 INFO:tasks.workunit.client.0.smithi046.stdout:9/578: mkdir d0/d16/d76/d7d/dcc 0 2024-04-26T12:28:48.753 INFO:tasks.workunit.client.0.smithi046.stdout:8/753: sync 2024-04-26T12:28:48.753 INFO:tasks.workunit.client.0.smithi046.stdout:7/697: write d16/d27/d7e/fe5 [1033599,125420] 0 2024-04-26T12:28:48.753 INFO:tasks.workunit.client.0.smithi046.stdout:0/710: symlink d9/d1d/d40/d41/d7e/da5/dad/dbd/dd0/lf5 0 2024-04-26T12:28:48.754 INFO:tasks.workunit.client.0.smithi046.stdout:1/614: write d7/d14/d5d/d6b/dc2/f54 [714802,38193] 0 2024-04-26T12:28:48.754 INFO:tasks.workunit.client.0.smithi046.stdout:8/754: readlink d7/d24/d50/d2a/d39/l4e 0 2024-04-26T12:28:48.754 INFO:tasks.workunit.client.0.smithi046.stdout:9/579: fdatasync d0/d16/d76/d7d/fad 0 2024-04-26T12:28:48.755 INFO:tasks.workunit.client.0.smithi046.stdout:7/698: truncate d16/d35/f3a 1499901 0 2024-04-26T12:28:48.755 INFO:tasks.workunit.client.0.smithi046.stdout:0/711: symlink d9/dc/lf6 0 2024-04-26T12:28:48.755 INFO:tasks.workunit.client.0.smithi046.stdout:2/647: rename d1/de/f9a to d1/de/d65/d4a/d86/fde 0 2024-04-26T12:28:48.756 INFO:tasks.workunit.client.0.smithi046.stdout:1/615: chown d7/d14/d5d/d32/l42 151 1 2024-04-26T12:28:48.756 INFO:tasks.workunit.client.0.smithi046.stdout:8/755: creat d7/d1c/d74/df4/d1b/dae/dcf/ff9 x:0 0 0 2024-04-26T12:28:48.757 INFO:tasks.workunit.client.0.smithi046.stdout:5/765: dread d9/da/d18/f39 [0,4194304] 0 2024-04-26T12:28:48.757 INFO:tasks.workunit.client.0.smithi046.stdout:9/580: mkdir d0/d16/d76/d7d/d72/da1/dc8/dcd 0 2024-04-26T12:28:48.757 INFO:tasks.workunit.client.0.smithi046.stdout:2/648: fdatasync d1/de/fab 0 2024-04-26T12:28:48.757 INFO:tasks.workunit.client.0.smithi046.stdout:1/616: unlink d7/db/d98/dc5/d2b/f40 0 2024-04-26T12:28:48.757 INFO:tasks.workunit.client.0.smithi046.stdout:9/581: chown d0/d19/f41 24 1 2024-04-26T12:28:48.758 INFO:tasks.workunit.client.0.smithi046.stdout:2/649: mknod d1/de/d65/d4a/d58/cdf 0 2024-04-26T12:28:48.758 INFO:tasks.workunit.client.0.smithi046.stdout:1/617: readlink d7/d14/d5d/d32/d5f/lc4 0 2024-04-26T12:28:48.758 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:48.757+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:48.759 INFO:tasks.workunit.client.0.smithi046.stdout:7/699: read d16/d1a/d31/d4d/fa5 [342426,35052] 0 2024-04-26T12:28:48.759 INFO:tasks.workunit.client.0.smithi046.stdout:1/618: chown d7/db/c71 2033 1 2024-04-26T12:28:48.759 INFO:tasks.workunit.client.0.smithi046.stdout:3/703: dread d2/d16/d2c/d50/d71/d89/dc5/f3a [0,4194304] 0 2024-04-26T12:28:48.760 INFO:tasks.workunit.client.0.smithi046.stdout:2/650: mknod d1/de/d65/d1b/dca/ce0 0 2024-04-26T12:28:48.760 INFO:tasks.workunit.client.0.smithi046.stdout:9/582: rename d0/d19/d51/l98 to d0/lce 0 2024-04-26T12:28:48.761 INFO:tasks.workunit.client.0.smithi046.stdout:9/583: chown d0/c4b 53753 1 2024-04-26T12:28:48.762 INFO:tasks.workunit.client.0.smithi046.stdout:1/619: chown d7/db/d98/dc5/d2b/d31/d82/ccf 185584 1 2024-04-26T12:28:48.762 INFO:tasks.workunit.client.0.smithi046.stdout:7/700: read d16/d1a/d31/d5a/f7c [35019,41287] 0 2024-04-26T12:28:48.762 INFO:tasks.workunit.client.0.smithi046.stdout:7/701: sync 2024-04-26T12:28:48.763 INFO:tasks.workunit.client.0.smithi046.stdout:2/651: chown d1/de/d65/d4a/d86/d96/cd6 779498 1 2024-04-26T12:28:48.763 INFO:tasks.workunit.client.0.smithi046.stdout:5/766: dwrite d9/da/d18/d8b/fc5 [0,4194304] 0 2024-04-26T12:28:48.763 INFO:tasks.workunit.client.0.smithi046.stdout:9/584: symlink d0/d2c/dbe/dc0/lcf 0 2024-04-26T12:28:48.763 INFO:tasks.workunit.client.0.smithi046.stdout:7/702: chown d16/d4e/d6c 2085 1 2024-04-26T12:28:48.764 INFO:tasks.workunit.client.0.smithi046.stdout:0/712: chown d9/dc/dd/d45/d69/de6/cf2 60081250 1 2024-04-26T12:28:48.764 INFO:tasks.workunit.client.0.smithi046.stdout:1/620: dread - d7/db/d98/dc5/d2b/d39/db3/d79/fcd zero size 2024-04-26T12:28:48.764 INFO:tasks.workunit.client.0.smithi046.stdout:9/585: write d0/d29/f3b [2400515,45487] 0 2024-04-26T12:28:48.765 INFO:tasks.workunit.client.0.smithi046.stdout:2/652: creat d1/de/d65/d8f/fe1 x:0 0 0 2024-04-26T12:28:48.765 INFO:tasks.workunit.client.0.smithi046.stdout:7/703: write d16/d3f/f47 [1902751,108299] 0 2024-04-26T12:28:48.766 INFO:tasks.workunit.client.0.smithi046.stdout:0/713: mknod d9/d1d/d40/cf7 0 2024-04-26T12:28:48.766 INFO:tasks.workunit.client.0.smithi046.stdout:9/586: symlink d0/d29/d69/d88/ld0 0 2024-04-26T12:28:48.766 INFO:tasks.workunit.client.0.smithi046.stdout:1/621: unlink d7/db/d98/dc5/d2b/d96/f68 0 2024-04-26T12:28:48.767 INFO:tasks.workunit.client.0.smithi046.stdout:0/714: creat d9/d1d/d40/d41/ff8 x:0 0 0 2024-04-26T12:28:48.767 INFO:tasks.workunit.client.0.smithi046.stdout:7/704: link d16/d35/f3b d16/d1a/d31/fe7 0 2024-04-26T12:28:48.768 INFO:tasks.workunit.client.0.smithi046.stdout:3/704: dwrite d2/d16/d35/dbc/dc9/dd0/fb4 [0,4194304] 0 2024-04-26T12:28:48.768 INFO:tasks.workunit.client.0.smithi046.stdout:9/587: fdatasync d0/d29/d69/d88/f94 0 2024-04-26T12:28:48.768 INFO:tasks.workunit.client.0.smithi046.stdout:2/653: stat d1/de/d15/d18/d98 0 2024-04-26T12:28:48.769 INFO:tasks.workunit.client.0.smithi046.stdout:3/705: mknod d2/db/dec/cfa 0 2024-04-26T12:28:48.769 INFO:tasks.workunit.client.0.smithi046.stdout:1/622: creat d7/d14/d5d/d32/d41/d8f/dd3/fda x:0 0 0 2024-04-26T12:28:48.769 INFO:tasks.workunit.client.0.smithi046.stdout:2/654: mknod d1/de/d65/d4a/d58/ce2 0 2024-04-26T12:28:48.770 INFO:tasks.workunit.client.0.smithi046.stdout:4/636: dread d0/da/d21/f73 [0,4194304] 0 2024-04-26T12:28:48.770 INFO:tasks.workunit.client.0.smithi046.stdout:0/715: rename d9/dc/dd/f2f to d9/d1d/d40/d41/d7e/da5/dad/dbd/ff9 0 2024-04-26T12:28:48.770 INFO:tasks.workunit.client.0.smithi046.stdout:9/588: mknod d0/d16/d76/d7d/d72/d85/d97/cd1 0 2024-04-26T12:28:48.770 INFO:tasks.workunit.client.0.smithi046.stdout:1/623: mknod d7/cdb 0 2024-04-26T12:28:48.772 INFO:tasks.workunit.client.0.smithi046.stdout:4/637: chown d0/d1/d12/l40 1851280 1 2024-04-26T12:28:48.772 INFO:tasks.workunit.client.0.smithi046.stdout:6/670: dread d7/f79 [0,4194304] 0 2024-04-26T12:28:48.772 INFO:tasks.workunit.client.0.smithi046.stdout:3/706: write d2/d16/d2c/d50/d71/d89/dc5/d23/f26 [1295097,69744] 0 2024-04-26T12:28:48.772 INFO:tasks.workunit.client.0.smithi046.stdout:1/624: mknod d7/db/d98/cdc 0 2024-04-26T12:28:48.774 INFO:tasks.workunit.client.0.smithi046.stdout:3/707: creat d2/d16/d2c/d50/d71/d89/dc5/d82/ffb x:0 0 0 2024-04-26T12:28:48.774 INFO:tasks.workunit.client.0.smithi046.stdout:1/625: dread d7/db/f8d [0,4194304] 0 2024-04-26T12:28:48.774 INFO:tasks.workunit.client.0.smithi046.stdout:0/716: dread d9/f12 [0,4194304] 0 2024-04-26T12:28:48.776 INFO:tasks.workunit.client.0.smithi046.stdout:0/717: mknod d9/dc/dd/dd2/cfa 0 2024-04-26T12:28:48.778 INFO:tasks.workunit.client.0.smithi046.stdout:5/767: write d9/da/f3c [2505750,81750] 0 2024-04-26T12:28:48.778 INFO:tasks.workunit.client.0.smithi046.stdout:6/671: dwrite d7/d2b/d31/f3f [0,4194304] 0 2024-04-26T12:28:48.779 INFO:tasks.workunit.client.0.smithi046.stdout:4/638: dwrite d0/da/d17/d20/d25/fc9 [4194304,4194304] 0 2024-04-26T12:28:48.780 INFO:tasks.workunit.client.0.smithi046.stdout:5/768: creat d9/da/f101 x:0 0 0 2024-04-26T12:28:48.781 INFO:tasks.workunit.client.0.smithi046.stdout:4/639: write d0/d1/d5/fc5 [990167,62555] 0 2024-04-26T12:28:48.781 INFO:tasks.workunit.client.0.smithi046.stdout:6/672: write d7/d1b/d47/d65/d77/d92/fb3 [1959729,96246] 0 2024-04-26T12:28:48.781 INFO:tasks.workunit.client.0.smithi046.stdout:2/655: dread d1/de/d15/d18/f57 [0,4194304] 0 2024-04-26T12:28:48.783 INFO:tasks.workunit.client.0.smithi046.stdout:6/673: mkdir d7/d16/dbc/dda 0 2024-04-26T12:28:48.786 INFO:tasks.workunit.client.0.smithi046.stdout:5/769: rename d9/da/l3a to d9/da/dd/d34/d44/d88/l102 0 2024-04-26T12:28:48.786 INFO:tasks.workunit.client.0.smithi046.stdout:6/674: stat d7/d1b/la4 0 2024-04-26T12:28:48.786 INFO:tasks.workunit.client.0.smithi046.stdout:5/770: readlink d9/da/dd/dd7/d7e/lf3 0 2024-04-26T12:28:48.786 INFO:tasks.workunit.client.0.smithi046.stdout:0/718: link d9/d1d/d5d/d6b/c9b d9/d1d/d40/d41/d7e/da5/dad/dbd/dd0/cfb 0 2024-04-26T12:28:48.786 INFO:tasks.workunit.client.0.smithi046.stdout:2/656: unlink d1/de/d65/d1b/cd7 0 2024-04-26T12:28:48.787 INFO:tasks.workunit.client.0.smithi046.stdout:2/657: dread - d1/d71/fc3 zero size 2024-04-26T12:28:48.787 INFO:tasks.workunit.client.0.smithi046.stdout:1/626: dwrite d7/db/d98/dc5/d2b/d96/fa6 [0,4194304] 0 2024-04-26T12:28:48.787 INFO:tasks.workunit.client.0.smithi046.stdout:5/771: write d9/da/dd/d34/d44/fcd [1255014,57440] 0 2024-04-26T12:28:48.788 INFO:tasks.workunit.client.0.smithi046.stdout:1/627: chown d7/db/d98/dc5/d2b/d31/l34 260239224 1 2024-04-26T12:28:48.789 INFO:tasks.workunit.client.0.smithi046.stdout:1/628: chown d7/db/d98/dc5/d2b/d39/d5c/cd9 4 1 2024-04-26T12:28:48.791 INFO:tasks.workunit.client.0.smithi046.stdout:6/675: dwrite d7/f29 [0,4194304] 0 2024-04-26T12:28:48.794 INFO:tasks.workunit.client.0.smithi046.stdout:5/772: dread d9/da/dd/dd7/db0/fd0 [0,4194304] 0 2024-04-26T12:28:48.795 INFO:tasks.workunit.client.0.smithi046.stdout:2/658: dwrite d1/de/d65/d4a/f59 [0,4194304] 0 2024-04-26T12:28:48.796 INFO:tasks.workunit.client.0.smithi046.stdout:2/659: mkdir d1/de/d15/d18/dc1/de3 0 2024-04-26T12:28:48.797 INFO:tasks.workunit.client.0.smithi046.stdout:5/773: rename d9/da/dd/d34/d44/d88/d90/c9d to d9/da/dd/d34/d45/d8f/c103 0 2024-04-26T12:28:48.797 INFO:tasks.workunit.client.0.smithi046.stdout:1/629: dwrite d7/d14/f4f [0,4194304] 0 2024-04-26T12:28:48.797 INFO:tasks.workunit.client.0.smithi046.stdout:2/660: chown d1/de/d65/d1b/c84 31 1 2024-04-26T12:28:48.798 INFO:tasks.workunit.client.0.smithi046.stdout:2/661: stat d1/d42/f60 0 2024-04-26T12:28:48.798 INFO:tasks.workunit.client.0.smithi046.stdout:5/774: creat d9/da/dd/d34/d44/d97/da4/d35/dd8/f104 x:0 0 0 2024-04-26T12:28:48.799 INFO:tasks.workunit.client.0.smithi046.stdout:2/662: truncate d1/d71/fdc 865762 0 2024-04-26T12:28:48.799 INFO:tasks.workunit.client.0.smithi046.stdout:1/630: write d7/d14/d5d/f7d [755959,102574] 0 2024-04-26T12:28:48.799 INFO:tasks.workunit.client.0.smithi046.stdout:2/663: write d1/de/d65/d4a/f4d [1435896,34559] 0 2024-04-26T12:28:48.800 INFO:tasks.workunit.client.0.smithi046.stdout:5/775: mkdir d9/da/d18/d7d/d105 0 2024-04-26T12:28:48.800 INFO:tasks.workunit.client.0.smithi046.stdout:5/776: fsync d9/da/dd/d34/d44/d97/da4/fa3 0 2024-04-26T12:28:48.801 INFO:tasks.workunit.client.0.smithi046.stdout:1/631: rename d7/f62 to d7/d14/d5d/d32/d41/d8f/dd3/fdd 0 2024-04-26T12:28:48.802 INFO:tasks.workunit.client.0.smithi046.stdout:6/676: dread d7/f8 [0,4194304] 0 2024-04-26T12:28:48.802 INFO:tasks.workunit.client.0.smithi046.stdout:8/756: dread d7/f55 [0,4194304] 0 2024-04-26T12:28:48.803 INFO:tasks.workunit.client.0.smithi046.stdout:2/664: rename d1/d42/f54 to d1/de/dc8/fe4 0 2024-04-26T12:28:48.803 INFO:tasks.workunit.client.0.smithi046.stdout:1/632: mknod d7/d14/d5d/d6b/cde 0 2024-04-26T12:28:48.803 INFO:tasks.workunit.client.0.smithi046.stdout:6/677: write d7/d1b/d37/fd5 [4357887,2131] 0 2024-04-26T12:28:48.803 INFO:tasks.workunit.client.0.smithi046.stdout:8/757: rename d7/d1c/d74/df4/l20 to d7/d1c/d74/df4/d1b/dae/lfa 0 2024-04-26T12:28:48.804 INFO:tasks.workunit.client.0.smithi046.stdout:6/678: fdatasync d7/d1b/d47/d65/fa5 0 2024-04-26T12:28:48.804 INFO:tasks.workunit.client.0.smithi046.stdout:1/633: mknod d7/db/d98/dc5/d2b/d39/d3c/cdf 0 2024-04-26T12:28:48.804 INFO:tasks.workunit.client.0.smithi046.stdout:8/758: mkdir d7/da/d4f/d7f/dfb 0 2024-04-26T12:28:48.806 INFO:tasks.workunit.client.0.smithi046.stdout:1/634: creat d7/db/d98/dc5/d2b/fe0 x:0 0 0 2024-04-26T12:28:48.806 INFO:tasks.workunit.client.0.smithi046.stdout:8/759: write d7/d24/d50/f72 [1437121,53017] 0 2024-04-26T12:28:48.806 INFO:tasks.workunit.client.0.smithi046.stdout:6/679: getdents d7/d1b/d47/d65/d77/d92 0 2024-04-26T12:28:48.806 INFO:tasks.workunit.client.0.smithi046.stdout:8/760: dread - d7/d24/d50/d2a/fdf zero size 2024-04-26T12:28:48.806 INFO:tasks.workunit.client.0.smithi046.stdout:1/635: write d7/d14/d5d/d6b/f84 [3109956,34993] 0 2024-04-26T12:28:48.807 INFO:tasks.workunit.client.0.smithi046.stdout:6/680: symlink d7/da7/dd1/dd6/ldb 0 2024-04-26T12:28:48.807 INFO:tasks.workunit.client.0.smithi046.stdout:8/761: fdatasync d7/d1c/d74/df4/f18 0 2024-04-26T12:28:48.807 INFO:tasks.workunit.client.0.smithi046.stdout:1/636: read - d7/db/d98/dc5/d2b/d39/f61 zero size 2024-04-26T12:28:48.809 INFO:tasks.workunit.client.0.smithi046.stdout:8/762: getdents d7/d1c/d74/df4/d1b/da0 0 2024-04-26T12:28:48.810 INFO:tasks.workunit.client.0.smithi046.stdout:7/705: dread d16/d1a/d3e/d59/f92 [0,4194304] 0 2024-04-26T12:28:48.810 INFO:tasks.workunit.client.0.smithi046.stdout:1/637: truncate d7/db/d98/dc5/d2b/d96/f9e 830235 0 2024-04-26T12:28:48.811 INFO:tasks.workunit.client.0.smithi046.stdout:3/708: dread d2/d16/d2c/d50/d71/d89/dc5/f75 [0,4194304] 0 2024-04-26T12:28:48.811 INFO:tasks.workunit.client.0.smithi046.stdout:2/665: write d1/de/d65/d4a/d58/f9d [577151,4788] 0 2024-04-26T12:28:48.812 INFO:tasks.workunit.client.0.smithi046.stdout:8/763: fdatasync d7/d24/d50/d2a/fdf 0 2024-04-26T12:28:48.812 INFO:tasks.workunit.client.0.smithi046.stdout:0/719: dread d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/f80 [4194304,4194304] 0 2024-04-26T12:28:48.812 INFO:tasks.workunit.client.0.smithi046.stdout:7/706: chown f5 47351 1 2024-04-26T12:28:48.813 INFO:tasks.workunit.client.0.smithi046.stdout:2/666: symlink d1/le5 0 2024-04-26T12:28:48.814 INFO:tasks.workunit.client.0.smithi046.stdout:6/681: dwrite d7/d2b/d31/fcf [0,4194304] 0 2024-04-26T12:28:48.815 INFO:tasks.workunit.client.0.smithi046.stdout:2/667: write d1/de/db1/fdb [921596,19247] 0 2024-04-26T12:28:48.816 INFO:tasks.workunit.client.0.smithi046.stdout:0/720: write d9/dc/dd/f48 [4881342,113033] 0 2024-04-26T12:28:48.816 INFO:tasks.workunit.client.0.smithi046.stdout:6/682: write d7/d1b/d47/d65/fc6 [386741,85686] 0 2024-04-26T12:28:48.816 INFO:tasks.workunit.client.0.smithi046.stdout:7/707: creat d16/d1a/d31/d4d/fe8 x:0 0 0 2024-04-26T12:28:48.817 INFO:tasks.workunit.client.0.smithi046.stdout:6/683: fsync d7/d2b/d31/f3f 0 2024-04-26T12:28:48.818 INFO:tasks.workunit.client.0.smithi046.stdout:7/708: write d16/d1a/d31/f49 [765943,10405] 0 2024-04-26T12:28:48.818 INFO:tasks.workunit.client.0.smithi046.stdout:0/721: creat d9/dc/dd/d45/ffc x:0 0 0 2024-04-26T12:28:48.819 INFO:tasks.workunit.client.0.smithi046.stdout:1/638: dwrite d7/d14/d5d/d32/d41/d8f/fa7 [0,4194304] 0 2024-04-26T12:28:48.819 INFO:tasks.workunit.client.0.smithi046.stdout:2/668: link d1/de/d15/d18/dc1/db6/dda/f3b d1/d71/fe6 0 2024-04-26T12:28:48.820 INFO:tasks.workunit.client.0.smithi046.stdout:6/684: truncate d7/d2b/d31/f80 1014916 0 2024-04-26T12:28:48.820 INFO:tasks.workunit.client.0.smithi046.stdout:2/669: symlink d1/de/d67/le7 0 2024-04-26T12:28:48.820 INFO:tasks.workunit.client.0.smithi046.stdout:1/639: mknod d7/db/d98/dc5/d2b/d9f/ce1 0 2024-04-26T12:28:48.822 INFO:tasks.workunit.client.0.smithi046.stdout:1/640: fsync d7/d14/d5d/d32/d5f/f65 0 2024-04-26T12:28:48.823 INFO:tasks.workunit.client.0.smithi046.stdout:8/764: dwrite d7/d24/d50/d2a/d92/fb8 [0,4194304] 0 2024-04-26T12:28:48.824 INFO:tasks.workunit.client.0.smithi046.stdout:2/670: read d1/f3e [413632,13979] 0 2024-04-26T12:28:48.824 INFO:tasks.workunit.client.0.smithi046.stdout:8/765: readlink l3 0 2024-04-26T12:28:48.824 INFO:tasks.workunit.client.0.smithi046.stdout:9/589: dread d0/db6/fbc [0,4194304] 0 2024-04-26T12:28:48.825 INFO:tasks.workunit.client.0.smithi046.stdout:1/641: fdatasync d7/db/d98/dc5/d2b/d39/d5c/f8e 0 2024-04-26T12:28:48.825 INFO:tasks.workunit.client.0.smithi046.stdout:8/766: chown d7/da/d88/ff8 85392041 1 2024-04-26T12:28:48.826 INFO:tasks.workunit.client.0.smithi046.stdout:0/722: dwrite d9/dc/dd/f99 [0,4194304] 0 2024-04-26T12:28:48.827 INFO:tasks.workunit.client.0.smithi046.stdout:1/642: creat d7/db/d98/fe2 x:0 0 0 2024-04-26T12:28:48.828 INFO:tasks.workunit.client.0.smithi046.stdout:2/671: creat d1/de/d15/d18/d8a/fe8 x:0 0 0 2024-04-26T12:28:48.830 INFO:tasks.workunit.client.0.smithi046.stdout:6/685: dwrite d7/d1b/d6a/d57/f5c [0,4194304] 0 2024-04-26T12:28:48.830 INFO:tasks.workunit.client.0.smithi046.stdout:2/672: fsync d1/de/d15/f4e 0 2024-04-26T12:28:48.831 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1668 3.18 3:1e8917d7:::200.0000000e:head [write 3543177~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.91078515400000004, 2024-04-26T12:28:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067259575000000002, 2024-04-26T12:28:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919147+0000", 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.157e-06 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919151+0000", 2024-04-26T12:28:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.313e-06 2024-04-26T12:28:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919154+0000", 2024-04-26T12:28:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:28:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982687+0000", 2024-04-26T12:28:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063532694000000001 2024-04-26T12:28:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982750+0000", 2024-04-26T12:28:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:28:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986254+0000", 2024-04-26T12:28:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035043880000000002 2024-04-26T12:28:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986322+0000", 2024-04-26T12:28:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7458000000000004e-05 2024-04-26T12:28:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986404+0000", 2024-04-26T12:28:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2015000000000007e-05 2024-04-26T12:28:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1669 3.18 3:1e8917d7:::200.0000000e:head [write 3544575~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.91077254100000005, 2024-04-26T12:28:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067362678999999995, 2024-04-26T12:28:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:28:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919158+0000", 2024-04-26T12:28:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.536e-06 2024-04-26T12:28:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919161+0000", 2024-04-26T12:28:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:28:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919164+0000", 2024-04-26T12:28:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:28:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983465+0000", 2024-04-26T12:28:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064301233999999999 2024-04-26T12:28:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983515+0000", 2024-04-26T12:28:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9774000000000002e-05 2024-04-26T12:28:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986414+0000", 2024-04-26T12:28:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0028991770000000002 2024-04-26T12:28:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986455+0000", 2024-04-26T12:28:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1090000000000001e-05 2024-04-26T12:28:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986520+0000", 2024-04-26T12:28:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4778999999999998e-05 2024-04-26T12:28:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1670 3.18 3:1e8917d7:::200.0000000e:head [write 3545973~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.91076326500000004, 2024-04-26T12:28:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070481470000000004, 2024-04-26T12:28:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:28:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919172+0000", 2024-04-26T12:28:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:28:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919175+0000", 2024-04-26T12:28:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.942e-06 2024-04-26T12:28:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919177+0000", 2024-04-26T12:28:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5790000000000002e-06 2024-04-26T12:28:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983883+0000", 2024-04-26T12:28:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064705768999999996 2024-04-26T12:28:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983975+0000", 2024-04-26T12:28:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2219999999999995e-05 2024-04-26T12:28:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989262+0000", 2024-04-26T12:28:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052864940000000001 2024-04-26T12:28:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989361+0000", 2024-04-26T12:28:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9374000000000001e-05 2024-04-26T12:28:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989648+0000", 2024-04-26T12:28:48.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028677200000000003 2024-04-26T12:28:48.847 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.847 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.847 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.848 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1671 3.18 3:1e8917d7:::200.0000000e:head [write 3547932~12451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.848 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:48.848 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.90946814799999998, 2024-04-26T12:28:48.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069443256999999994, 2024-04-26T12:28:48.848 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.848 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.848 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:48.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920460+0000", 2024-04-26T12:28:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920542+0000", 2024-04-26T12:28:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650999999999995e-05 2024-04-26T12:28:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920554+0000", 2024-04-26T12:28:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2228e-05 2024-04-26T12:28:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920560+0000", 2024-04-26T12:28:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8869999999999997e-06 2024-04-26T12:28:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984749+0000", 2024-04-26T12:28:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064188913 2024-04-26T12:28:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984795+0000", 2024-04-26T12:28:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5893000000000003e-05 2024-04-26T12:28:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989659+0000", 2024-04-26T12:28:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048643669999999996 2024-04-26T12:28:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989836+0000", 2024-04-26T12:28:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017699799999999999 2024-04-26T12:28:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989905+0000", 2024-04-26T12:28:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8238000000000006e-05 2024-04-26T12:28:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1672 3.18 3:1e8917d7:::200.0000000e:head [write 3560383~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.90936450599999996, 2024-04-26T12:28:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070651368000000006, 2024-04-26T12:28:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920569+0000", 2024-04-26T12:28:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2610000000000004e-06 2024-04-26T12:28:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920572+0000", 2024-04-26T12:28:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6150000000000001e-06 2024-04-26T12:28:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920578+0000", 2024-04-26T12:28:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:28:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985287+0000", 2024-04-26T12:28:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064708946000000003 2024-04-26T12:28:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985343+0000", 2024-04-26T12:28:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6109000000000001e-05 2024-04-26T12:28:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991135+0000", 2024-04-26T12:28:48.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057923430000000001 2024-04-26T12:28:48.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991163+0000", 2024-04-26T12:28:48.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7083000000000001e-05 2024-04-26T12:28:48.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991216+0000", 2024-04-26T12:28:48.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3854999999999999e-05 2024-04-26T12:28:48.862 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.862 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.862 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.862 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1673 3.18 3:1e8917d7:::200.0000000e:head [write 3563148~4730 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.862 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:48.862 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.90761037600000005, 2024-04-26T12:28:48.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068974127999999996, 2024-04-26T12:28:48.863 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.863 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.863 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:48.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:48.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922318+0000", 2024-04-26T12:28:48.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:48.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922327+0000", 2024-04-26T12:28:48.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.02e-06 2024-04-26T12:28:48.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922336+0000", 2024-04-26T12:28:48.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:28:48.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922344+0000", 2024-04-26T12:28:48.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5220000000000001e-06 2024-04-26T12:28:48.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986575+0000", 2024-04-26T12:28:48.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064231885000000002 2024-04-26T12:28:48.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986628+0000", 2024-04-26T12:28:48.868 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:48.867+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:48.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.219e-05 2024-04-26T12:28:48.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991222+0000", 2024-04-26T12:28:48.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045942500000000002 2024-04-26T12:28:48.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991245+0000", 2024-04-26T12:28:48.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2764000000000001e-05 2024-04-26T12:28:48.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991293+0000", 2024-04-26T12:28:48.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8628999999999998e-05 2024-04-26T12:28:48.871 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.871 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.871 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.871 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:13020 4.10 4:09df41af:::1000000333c.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:28:48.871 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.90660815500000003, 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066586204999999996, 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 13020 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:48.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923320+0000", 2024-04-26T12:28:48.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:48.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923328+0000", 2024-04-26T12:28:48.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3289999999999994e-06 2024-04-26T12:28:48.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923340+0000", 2024-04-26T12:28:48.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1891e-05 2024-04-26T12:28:48.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923353+0000", 2024-04-26T12:28:48.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3273e-05 2024-04-26T12:28:48.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986568+0000", 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063214801000000001 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986686+0000", 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118009 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989908+0000", 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032213039999999999 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1674 3.18 3:1e8917d7:::200.0000000e:head [write 3567878~12568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.90567537099999995, 2024-04-26T12:28:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067102822000000006, 2024-04-26T12:28:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924253+0000", 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924269+0000", 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924279+0000", 2024-04-26T12:28:48.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0676000000000001e-05 2024-04-26T12:28:48.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924288+0000", 2024-04-26T12:28:48.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4649999999999994e-06 2024-04-26T12:28:48.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987080+0000", 2024-04-26T12:28:48.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062792312000000003 2024-04-26T12:28:48.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987132+0000", 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1712999999999998e-05 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991298+0000", 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041660539999999998 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991321+0000", 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3575e-05 2024-04-26T12:28:48.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991357+0000", 2024-04-26T12:28:48.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5506000000000002e-05 2024-04-26T12:28:48.880 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.880 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.880 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.880 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1675 3.18 3:1e8917d7:::200.0000000e:head [write 3580446~9112 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.880 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:48.880 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.904655828, 2024-04-26T12:28:48.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066218224000000006, 2024-04-26T12:28:48.881 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.881 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.881 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:48.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:48.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925273+0000", 2024-04-26T12:28:48.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925282+0000", 2024-04-26T12:28:48.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:28:48.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925291+0000", 2024-04-26T12:28:48.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2800000000000003e-06 2024-04-26T12:28:48.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925296+0000", 2024-04-26T12:28:48.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6080000000000003e-06 2024-04-26T12:28:48.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987663+0000", 2024-04-26T12:28:48.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062366705000000001 2024-04-26T12:28:48.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987729+0000", 2024-04-26T12:28:48.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6330999999999999e-05 2024-04-26T12:28:48.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991362+0000", 2024-04-26T12:28:48.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036322820000000001 2024-04-26T12:28:48.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991431+0000", 2024-04-26T12:28:48.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9799e-05 2024-04-26T12:28:48.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991492+0000", 2024-04-26T12:28:48.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0587000000000001e-05 2024-04-26T12:28:48.885 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.885 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.885 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.885 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1676 3.18 3:1e8917d7:::200.0000000e:head [write 3589558~5068 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.885 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:48.885 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.90445659199999995, 2024-04-26T12:28:48.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066120133999999997, 2024-04-26T12:28:48.885 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.885 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.885 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:48.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:48.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:48.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925479+0000", 2024-04-26T12:28:48.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.054e-06 2024-04-26T12:28:48.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925489+0000", 2024-04-26T12:28:48.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0847e-05 2024-04-26T12:28:48.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925494+0000", 2024-04-26T12:28:48.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6569999999999996e-06 2024-04-26T12:28:48.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988275+0000", 2024-04-26T12:28:48.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062780582000000001 2024-04-26T12:28:48.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988319+0000", 2024-04-26T12:28:48.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3881999999999998e-05 2024-04-26T12:28:48.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991497+0000", 2024-04-26T12:28:48.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031781520000000001 2024-04-26T12:28:48.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991519+0000", 2024-04-26T12:28:48.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2382e-05 2024-04-26T12:28:48.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991593+0000", 2024-04-26T12:28:48.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3987999999999997e-05 2024-04-26T12:28:48.889 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.889 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.889 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1677 3.18 3:1e8917d7:::200.0000000e:head [write 3594626~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.90405507799999996, 2024-04-26T12:28:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065839106999999994, 2024-04-26T12:28:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:48.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:48.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:48.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:48.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925880+0000", 2024-04-26T12:28:48.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:28:48.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925896+0000", 2024-04-26T12:28:48.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5696999999999999e-05 2024-04-26T12:28:48.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925904+0000", 2024-04-26T12:28:48.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9619999999999993e-06 2024-04-26T12:28:48.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988800+0000", 2024-04-26T12:28:48.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062896142000000002 2024-04-26T12:28:48.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988877+0000", 2024-04-26T12:28:48.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7175999999999994e-05 2024-04-26T12:28:48.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991598+0000", 2024-04-26T12:28:48.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027209399999999998 2024-04-26T12:28:48.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991620+0000", 2024-04-26T12:28:48.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2396e-05 2024-04-26T12:28:48.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991714+0000", 2024-04-26T12:28:48.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3213000000000004e-05 2024-04-26T12:28:48.895 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.895 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.895 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.895 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1678 3.18 3:1e8917d7:::200.0000000e:head [write 3597232~4822 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.895 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:48.895 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.90311805599999995, 2024-04-26T12:28:48.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066189707, 2024-04-26T12:28:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:48.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:48.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:48.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926819+0000", 2024-04-26T12:28:48.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:28:48.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926831+0000", 2024-04-26T12:28:48.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2300000000000001e-05 2024-04-26T12:28:48.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926839+0000", 2024-04-26T12:28:48.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9929999999999995e-06 2024-04-26T12:28:48.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989923+0000", 2024-04-26T12:28:48.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063083319999999998 2024-04-26T12:28:48.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989970+0000", 2024-04-26T12:28:48.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7290000000000003e-05 2024-04-26T12:28:48.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992907+0000", 2024-04-26T12:28:48.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029369740000000002 2024-04-26T12:28:48.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992953+0000", 2024-04-26T12:28:48.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6165000000000003e-05 2024-04-26T12:28:48.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993001+0000", 2024-04-26T12:28:48.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7984e-05 2024-04-26T12:28:48.901 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.901 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.901 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.901 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1679 3.18 3:1e8917d7:::200.0000000e:head [write 3602054~5518 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.901 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:48.901 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.90307646799999997, 2024-04-26T12:28:48.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068775656000000004, 2024-04-26T12:28:48.902 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.902 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.902 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:48.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:48.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:48.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926858+0000", 2024-04-26T12:28:48.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7969999999999997e-06 2024-04-26T12:28:48.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926871+0000", 2024-04-26T12:28:48.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2965e-05 2024-04-26T12:28:48.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926878+0000", 2024-04-26T12:28:48.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9369999999999998e-06 2024-04-26T12:28:48.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990409+0000", 2024-04-26T12:28:48.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063531219999999999 2024-04-26T12:28:48.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990537+0000", 2024-04-26T12:28:48.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000127074 2024-04-26T12:28:48.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995467+0000", 2024-04-26T12:28:48.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049307190000000001 2024-04-26T12:28:48.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995519+0000", 2024-04-26T12:28:48.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1638000000000003e-05 2024-04-26T12:28:48.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995629+0000", 2024-04-26T12:28:48.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109852 2024-04-26T12:28:48.907 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.907 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.907 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.907 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1680 3.18 3:1e8917d7:::200.0000000e:head [write 3607572~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.907 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:48.907 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.90304094800000001, 2024-04-26T12:28:48.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070113521999999998, 2024-04-26T12:28:48.907 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.907 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.907 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:48.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:48.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926885+0000", 2024-04-26T12:28:48.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999962 2024-04-26T12:28:48.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926893+0000", 2024-04-26T12:28:48.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6299999999999998e-06 2024-04-26T12:28:48.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926899+0000", 2024-04-26T12:28:48.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5359999999999998e-06 2024-04-26T12:28:48.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926906+0000", 2024-04-26T12:28:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8349999999999998e-06 2024-04-26T12:28:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991747+0000", 2024-04-26T12:28:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064841012000000003 2024-04-26T12:28:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991834+0000", 2024-04-26T12:28:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6602999999999997e-05 2024-04-26T12:28:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996894+0000", 2024-04-26T12:28:48.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050608850000000002 2024-04-26T12:28:48.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996954+0000", 2024-04-26T12:28:48.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9598000000000001e-05 2024-04-26T12:28:48.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997002+0000", 2024-04-26T12:28:48.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8050000000000002e-05 2024-04-26T12:28:48.912 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.912 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.912 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.912 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1681 3.18 3:1e8917d7:::200.0000000e:head [write 3609487~2938 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.912 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:48.912 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.90300095400000002, 2024-04-26T12:28:48.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070147752999999993, 2024-04-26T12:28:48.912 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.912 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.912 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:48.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:48.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926928+0000", 2024-04-26T12:28:48.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926932+0000", 2024-04-26T12:28:48.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5669999999999999e-06 2024-04-26T12:28:48.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926939+0000", 2024-04-26T12:28:48.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:28:48.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926947+0000", 2024-04-26T12:28:48.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.238e-06 2024-04-26T12:28:48.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992399+0000", 2024-04-26T12:28:48.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065452859000000002 2024-04-26T12:28:48.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992484+0000", 2024-04-26T12:28:48.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4197999999999996e-05 2024-04-26T12:28:48.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997011+0000", 2024-04-26T12:28:48.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045271759999999999 2024-04-26T12:28:48.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997038+0000", 2024-04-26T12:28:48.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7684000000000001e-05 2024-04-26T12:28:48.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997076+0000", 2024-04-26T12:28:48.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7901000000000002e-05 2024-04-26T12:28:48.917 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.917 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.917 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.917 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1682 3.18 3:1e8917d7:::200.0000000e:head [write 3612425~3220 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.917 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:48.917 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.90067412199999997, 2024-04-26T12:28:48.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067934001999999993, 2024-04-26T12:28:48.917 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.917 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.917 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:48.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:48.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:48.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:48.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929260+0000", 2024-04-26T12:28:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:28:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929268+0000", 2024-04-26T12:28:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6399999999999997e-06 2024-04-26T12:28:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929273+0000", 2024-04-26T12:28:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:28:48.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993049+0000", 2024-04-26T12:28:48.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063775736999999999 2024-04-26T12:28:48.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993159+0000", 2024-04-26T12:28:48.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000110807 2024-04-26T12:28:48.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997083+0000", 2024-04-26T12:28:48.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039233769999999996 2024-04-26T12:28:48.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997126+0000", 2024-04-26T12:28:48.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3544999999999997e-05 2024-04-26T12:28:48.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997189+0000", 2024-04-26T12:28:48.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3128999999999998e-05 2024-04-26T12:28:48.921 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.921 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.921 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.922 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1683 3.18 3:1e8917d7:::200.0000000e:head [write 3615645~5682 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.922 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:48.922 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.900427011, 2024-04-26T12:28:48.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067807854000000001, 2024-04-26T12:28:48.922 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.922 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.922 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:48.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:48.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929502+0000", 2024-04-26T12:28:48.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:48.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929510+0000", 2024-04-26T12:28:48.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1179999999999992e-06 2024-04-26T12:28:48.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929519+0000", 2024-04-26T12:28:48.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2129999999999997e-06 2024-04-26T12:28:48.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929531+0000", 2024-04-26T12:28:48.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1615e-05 2024-04-26T12:28:48.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993765+0000", 2024-04-26T12:28:48.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064233810000000002 2024-04-26T12:28:48.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993842+0000", 2024-04-26T12:28:48.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7645999999999995e-05 2024-04-26T12:28:48.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997198+0000", 2024-04-26T12:28:48.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003355977 2024-04-26T12:28:48.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997249+0000", 2024-04-26T12:28:48.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0834000000000002e-05 2024-04-26T12:28:48.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997310+0000", 2024-04-26T12:28:48.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1408999999999994e-05 2024-04-26T12:28:48.926 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.926 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.926 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.926 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1684 3.18 3:1e8917d7:::200.0000000e:head [write 3621327~8700 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.898130435, 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066650928999999998, 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:48.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931798+0000", 2024-04-26T12:28:48.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:48.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931809+0000", 2024-04-26T12:28:48.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0662000000000001e-05 2024-04-26T12:28:48.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931816+0000", 2024-04-26T12:28:48.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1590000000000004e-06 2024-04-26T12:28:48.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931821+0000", 2024-04-26T12:28:48.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0710000000000002e-06 2024-04-26T12:28:48.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994486+0000", 2024-04-26T12:28:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062664719999999993 2024-04-26T12:28:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994567+0000", 2024-04-26T12:28:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1138999999999997e-05 2024-04-26T12:28:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998343+0000", 2024-04-26T12:28:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003775769 2024-04-26T12:28:48.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998387+0000", 2024-04-26T12:28:48.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4564999999999998e-05 2024-04-26T12:28:48.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998450+0000", 2024-04-26T12:28:48.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2589999999999995e-05 2024-04-26T12:28:48.931 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.931 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.931 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.932 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1685 3.18 3:1e8917d7:::200.0000000e:head [write 3630027~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.932 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:48.932 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.89810356499999999, 2024-04-26T12:28:48.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066694793000000002, 2024-04-26T12:28:48.932 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.932 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.932 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931828+0000", 2024-04-26T12:28:48.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:28:48.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931831+0000", 2024-04-26T12:28:48.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.45e-06 2024-04-26T12:28:48.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931835+0000", 2024-04-26T12:28:48.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:48.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995016+0000", 2024-04-26T12:28:48.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063180397999999999 2024-04-26T12:28:48.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995064+0000", 2024-04-26T12:28:48.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8538999999999997e-05 2024-04-26T12:28:48.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998455+0000", 2024-04-26T12:28:48.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033911000000000002 2024-04-26T12:28:48.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998478+0000", 2024-04-26T12:28:48.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2793999999999999e-05 2024-04-26T12:28:48.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998521+0000", 2024-04-26T12:28:48.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2608999999999998e-05 2024-04-26T12:28:48.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.937 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.937 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1687 3.18 3:1e8917d7:::200.0000000e:head [write 3636544~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:48.938 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:48.938 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.89688636099999997, 2024-04-26T12:28:48.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068592686, 2024-04-26T12:28:48.938 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:48.938 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:48.938 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:48.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:48.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:48.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:48.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:48.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:48.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:48.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:48.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:48.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:48.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933046+0000", 2024-04-26T12:28:48.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0850000000000001e-06 2024-04-26T12:28:48.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:48.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933050+0000", 2024-04-26T12:28:48.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5549999999999996e-06 2024-04-26T12:28:48.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:48.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933054+0000", 2024-04-26T12:28:48.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:28:48.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:48.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996223+0000", 2024-04-26T12:28:48.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063169004000000001 2024-04-26T12:28:48.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:48.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996307+0000", 2024-04-26T12:28:48.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3660999999999997e-05 2024-04-26T12:28:48.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:48.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001540+0000", 2024-04-26T12:28:48.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052334160000000003 2024-04-26T12:28:48.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:48.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001573+0000", 2024-04-26T12:28:48.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2981999999999997e-05 2024-04-26T12:28:48.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:48.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:48.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:48.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001636+0000", 2024-04-26T12:28:48.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2601999999999995e-05 2024-04-26T12:28:48.943 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.943 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.943 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.943 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:48.943 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:48.944 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:48.944 INFO:tasks.workunit.client.0.smithi046.stdout:4/640: dread d0/da/d17/d20/d25/d35/d6d/d19/fa8 [0,4194304] 0 2024-04-26T12:28:48.944 INFO:tasks.workunit.client.0.smithi046.stdout:2/673: fdatasync d1/de/d15/d18/dc1/db6/dda/d78/fcc 0 2024-04-26T12:28:48.944 INFO:tasks.workunit.client.0.smithi046.stdout:0/723: creat d9/dc/db9/ffd x:0 0 0 2024-04-26T12:28:48.944 INFO:tasks.workunit.client.0.smithi046.stdout:1/643: write d7/d14/d5d/d32/d41/d8f/dd3/fda [763410,25483] 0 2024-04-26T12:28:48.944 INFO:tasks.workunit.client.0.smithi046.stdout:2/674: chown d1/de/d15/d18/dc1/cc5 187582 1 2024-04-26T12:28:48.944 INFO:tasks.workunit.client.0.smithi046.stdout:0/724: creat d9/dc/dd/dd2/ffe x:0 0 0 2024-04-26T12:28:48.944 INFO:tasks.workunit.client.0.smithi046.stdout:4/641: truncate d0/da/d17/d20/d25/d35/d61/f7b 5158740 0 2024-04-26T12:28:48.944 INFO:tasks.workunit.client.0.smithi046.stdout:4/642: stat d0/da/d17/d20/d25/fb4 0 2024-04-26T12:28:48.944 INFO:tasks.workunit.client.0.smithi046.stdout:0/725: read d9/dc/d2a/f4a [454851,1469] 0 2024-04-26T12:28:48.944 INFO:tasks.workunit.client.0.smithi046.stdout:4/643: creat d0/da/d17/d20/d25/d35/d6d/d19/d55/dae/fd7 x:0 0 0 2024-04-26T12:28:48.944 INFO:tasks.workunit.client.0.smithi046.stdout:0/726: unlink d9/d1d/fbe 0 2024-04-26T12:28:48.944 INFO:tasks.workunit.client.0.smithi046.stdout:4/644: write d0/d64/faa [359956,117014] 0 2024-04-26T12:28:48.945 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2024-04-26T12:28:48.945 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:48.950 INFO:tasks.workunit.client.0.smithi046.stdout:6/686: dread d7/f8b [0,4194304] 0 2024-04-26T12:28:48.950 INFO:tasks.workunit.client.0.smithi046.stdout:4/645: read - d0/da/d70/fd5 zero size 2024-04-26T12:28:48.950 INFO:tasks.workunit.client.0.smithi046.stdout:0/727: creat d9/dc/dd/dd2/de2/dae/fff x:0 0 0 2024-04-26T12:28:48.950 INFO:tasks.workunit.client.0.smithi046.stdout:6/687: link d7/d1b/d47/l89 d7/d1b/d47/d65/d77/ldc 0 2024-04-26T12:28:48.950 INFO:tasks.workunit.client.0.smithi046.stdout:0/728: link d9/d1d/d40/f94 d9/d1d/d5d/f100 0 2024-04-26T12:28:48.950 INFO:tasks.workunit.client.0.smithi046.stdout:6/688: creat d7/d1b/d47/d65/d77/d92/fdd x:0 0 0 2024-04-26T12:28:48.950 INFO:tasks.workunit.client.0.smithi046.stdout:0/729: write d9/d1d/d40/d41/ff8 [630714,127311] 0 2024-04-26T12:28:48.950 INFO:tasks.workunit.client.0.smithi046.stdout:6/689: write d7/d1b/d47/d65/f82 [431960,52208] 0 2024-04-26T12:28:48.950 INFO:tasks.workunit.client.0.smithi046.stdout:0/730: creat d9/d1d/d40/d41/d7e/d9d/f101 x:0 0 0 2024-04-26T12:28:48.950 INFO:tasks.workunit.client.0.smithi046.stdout:4/646: dwrite d0/da/d17/d20/d25/fc9 [8388608,4194304] 0 2024-04-26T12:28:48.951 INFO:tasks.workunit.client.0.smithi046.stdout:6/690: symlink d7/d2b/d31/dd9/lde 0 2024-04-26T12:28:48.951 INFO:tasks.workunit.client.0.smithi046.stdout:0/731: symlink d9/dc/dd/d45/d69/l102 0 2024-04-26T12:28:48.951 INFO:tasks.workunit.client.0.smithi046.stdout:4/647: symlink d0/da/d17/d20/d25/d35/dcc/ld8 0 2024-04-26T12:28:48.951 INFO:tasks.workunit.client.0.smithi046.stdout:0/732: creat d9/dc/dd/d90/f103 x:0 0 0 2024-04-26T12:28:48.951 INFO:tasks.workunit.client.0.smithi046.stdout:0/733: dread - d9/dc/dd/f3a zero size 2024-04-26T12:28:48.951 INFO:tasks.workunit.client.0.smithi046.stdout:0/734: rmdir d9/d1d/d5d/d6b 39 2024-04-26T12:28:48.951 INFO:tasks.workunit.client.0.smithi046.stdout:5/777: sync 2024-04-26T12:28:48.951 INFO:tasks.workunit.client.0.smithi046.stdout:7/709: sync 2024-04-26T12:28:48.951 INFO:tasks.workunit.client.0.smithi046.stdout:0/735: rmdir d9/d1d/d40/d41 39 2024-04-26T12:28:48.951 INFO:tasks.workunit.client.0.smithi046.stdout:4/648: dwrite d0/da/d17/d20/d25/d35/f5d [4194304,4194304] 0 2024-04-26T12:28:48.951 INFO:tasks.workunit.client.0.smithi046.stdout:0/736: chown d9/dc/fc7 597 1 2024-04-26T12:28:48.951 INFO:tasks.workunit.client.0.smithi046.stdout:4/649: unlink d0/da/d17/d20/d74/lbc 0 2024-04-26T12:28:48.951 INFO:tasks.workunit.client.0.smithi046.stdout:0/737: write d9/dc/f1a [3433702,106893] 0 2024-04-26T12:28:48.952 INFO:tasks.workunit.client.0.smithi046.stdout:3/709: sync 2024-04-26T12:28:48.952 INFO:tasks.workunit.client.0.smithi046.stdout:4/650: mkdir d0/d64/dd9 0 2024-04-26T12:28:48.952 INFO:tasks.workunit.client.0.smithi046.stdout:3/710: chown d2/db/d4a/fb8 6080 1 2024-04-26T12:28:48.952 INFO:tasks.workunit.client.0.smithi046.stdout:0/738: symlink d9/d1d/d40/d41/d7e/l104 0 2024-04-26T12:28:48.952 INFO:tasks.workunit.client.0.smithi046.stdout:5/778: dwrite d9/da/dd/dd7/db0/db6/fc9 [0,4194304] 0 2024-04-26T12:28:48.952 INFO:tasks.workunit.client.0.smithi046.stdout:1/644: dread d7/d14/d5d/d6b/f84 [0,4194304] 0 2024-04-26T12:28:48.952 INFO:tasks.workunit.client.0.smithi046.stdout:7/710: dwrite d16/d27/d51/f67 [0,4194304] 0 2024-04-26T12:28:48.952 INFO:tasks.workunit.client.0.smithi046.stdout:3/711: creat d2/d16/d2c/d50/ffc x:0 0 0 2024-04-26T12:28:48.952 INFO:tasks.workunit.client.0.smithi046.stdout:4/651: truncate d0/da/d17/d20/d74/fa9 1565009 0 2024-04-26T12:28:48.952 INFO:tasks.workunit.client.0.smithi046.stdout:1/645: mkdir d7/d14/de3 0 2024-04-26T12:28:48.952 INFO:tasks.workunit.client.0.smithi046.stdout:0/739: getdents d9/d1d/d5d/d6b/d8a 0 2024-04-26T12:28:48.952 INFO:tasks.workunit.client.0.smithi046.stdout:5/779: truncate d9/f41 4693061 0 2024-04-26T12:28:48.952 INFO:tasks.workunit.client.0.smithi046.stdout:7/711: write d16/d1a/d31/d55/d6d/d89/dc7/f97 [855696,70443] 0 2024-04-26T12:28:48.952 INFO:tasks.workunit.client.0.smithi046.stdout:0/740: dread - d9/d1d/d40/d41/d7e/de1/fed zero size 2024-04-26T12:28:48.953 INFO:tasks.workunit.client.0.smithi046.stdout:4/652: creat d0/da/fda x:0 0 0 2024-04-26T12:28:48.953 INFO:tasks.workunit.client.0.smithi046.stdout:4/653: dread - d0/da/d17/d20/d25/d35/fa7 zero size 2024-04-26T12:28:48.953 INFO:tasks.workunit.client.0.smithi046.stdout:3/712: dwrite d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/f4c [0,4194304] 0 2024-04-26T12:28:48.966 INFO:tasks.workunit.client.0.smithi046.stdout:2/675: dread d1/d42/f7a [0,4194304] 0 2024-04-26T12:28:48.967 INFO:tasks.workunit.client.0.smithi046.stdout:1/646: rename d7/db/ff to d7/db/d98/dc5/d2b/d31/dd0/fe4 0 2024-04-26T12:28:48.967 INFO:tasks.workunit.client.0.smithi046.stdout:0/741: creat d9/d1d/f105 x:0 0 0 2024-04-26T12:28:48.967 INFO:tasks.workunit.client.0.smithi046.stdout:5/780: rename d9/da/d18/d7d/da7/lb1 to d9/da/d18/d8b/l106 0 2024-04-26T12:28:48.967 INFO:tasks.workunit.client.0.smithi046.stdout:2/676: mknod d1/de/d15/d18/ce9 0 2024-04-26T12:28:48.967 INFO:tasks.workunit.client.0.smithi046.stdout:4/654: rename d0/da/da1/fc4 to d0/d64/dd9/fdb 0 2024-04-26T12:28:48.967 INFO:tasks.workunit.client.0.smithi046.stdout:5/781: creat d9/da/dd/f107 x:0 0 0 2024-04-26T12:28:48.967 INFO:tasks.workunit.client.0.smithi046.stdout:3/713: getdents d2/db0/dc4 0 2024-04-26T12:28:48.967 INFO:tasks.workunit.client.0.smithi046.stdout:4/655: mkdir d0/ddc 0 2024-04-26T12:28:48.967 INFO:tasks.workunit.client.0.smithi046.stdout:1/647: dread d7/d14/d5d/d32/f75 [0,4194304] 0 2024-04-26T12:28:48.967 INFO:tasks.workunit.client.0.smithi046.stdout:2/677: symlink d1/de/lea 0 2024-04-26T12:28:48.967 INFO:tasks.workunit.client.0.smithi046.stdout:5/782: chown d9/da/dd/la2 1 1 2024-04-26T12:28:48.967 INFO:tasks.workunit.client.0.smithi046.stdout:0/742: dwrite d9/d1d/d40/d41/d7e/da5/dad/dbd/f97 [0,4194304] 0 2024-04-26T12:28:48.967 INFO:tasks.workunit.client.0.smithi046.stdout:5/783: read - d9/da/dd/d34/d44/d97/da4/d35/fe9 zero size 2024-04-26T12:28:48.968 INFO:tasks.workunit.client.0.smithi046.stdout:8/767: dread d7/d24/d50/f94 [0,4194304] 0 2024-04-26T12:28:48.968 INFO:tasks.workunit.client.0.smithi046.stdout:0/743: write d9/d1d/d40/d41/d7e/fca [338823,4502] 0 2024-04-26T12:28:48.968 INFO:tasks.workunit.client.0.smithi046.stdout:3/714: dwrite d2/d16/d2c/d50/d71/d89/dc5/d82/ff5 [0,4194304] 0 2024-04-26T12:28:48.968 INFO:tasks.workunit.client.0.smithi046.stdout:4/656: dwrite d0/da/d17/d20/d25/fb4 [0,4194304] 0 2024-04-26T12:28:48.968 INFO:tasks.workunit.client.0.smithi046.stdout:0/744: stat d9/d1d/d40/d41/dc0/l51 0 2024-04-26T12:28:48.968 INFO:tasks.workunit.client.0.smithi046.stdout:3/715: mkdir d2/deb/dfd 0 2024-04-26T12:28:48.968 INFO:tasks.workunit.client.0.smithi046.stdout:1/648: dwrite d7/db/d98/dc5/f1a [0,4194304] 0 2024-04-26T12:28:48.968 INFO:tasks.workunit.client.0.smithi046.stdout:3/716: write d2/d16/d2c/d50/d71/d89/dc5/d82/ffb [134285,87583] 0 2024-04-26T12:28:48.968 INFO:tasks.workunit.client.0.smithi046.stdout:0/745: truncate d9/d1d/d5d/d6b/d8a/d8c/fac 808991 0 2024-04-26T12:28:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:0/746: readlink d9/d1d/l34 0 2024-04-26T12:28:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:8/768: dwrite d7/da/d4f/fe6 [0,4194304] 0 2024-04-26T12:28:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:3/717: chown d2/db/f10 43941633 1 2024-04-26T12:28:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:0/747: fsync d9/dc/f1c 0 2024-04-26T12:28:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:7/712: dread d16/d1a/d31/d5a/d6b/fe6 [0,4194304] 0 2024-04-26T12:28:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:9/590: dread d0/d2c/d47/f13 [0,4194304] 0 2024-04-26T12:28:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:8/769: write d7/da/df/f5e [768618,116278] 0 2024-04-26T12:28:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:3/718: truncate d2/db/d84/da5/fb2 863935 0 2024-04-26T12:28:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:9/591: dread - d0/d16/fc9 zero size 2024-04-26T12:28:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:3/719: mknod d2/db/dec/cfe 0 2024-04-26T12:28:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:7/713: write d16/d1a/d31/f39 [1215184,4451] 0 2024-04-26T12:28:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:0/748: mkdir d9/dc/dd/d90/d106 0 2024-04-26T12:28:48.969 INFO:tasks.workunit.client.0.smithi046.stdout:7/714: creat d16/d1a/d3e/d59/fe9 x:0 0 0 2024-04-26T12:28:48.970 INFO:tasks.workunit.client.0.smithi046.stdout:0/749: truncate d9/dc/dd/fa6 1127708 0 2024-04-26T12:28:48.970 INFO:tasks.workunit.client.0.smithi046.stdout:3/720: creat d2/d16/d2c/d50/d71/d89/dc5/d1b/fff x:0 0 0 2024-04-26T12:28:48.970 INFO:tasks.workunit.client.0.smithi046.stdout:7/715: chown d16/d27/d51/d9c/fbc 99197 1 2024-04-26T12:28:48.970 INFO:tasks.workunit.client.0.smithi046.stdout:3/721: write d2/db/d84/fd9 [539976,20379] 0 2024-04-26T12:28:48.970 INFO:tasks.workunit.client.0.smithi046.stdout:0/750: truncate d9/d1d/d40/d41/d7e/de1/fed 143353 0 2024-04-26T12:28:48.970 INFO:tasks.workunit.client.0.smithi046.stdout:0/751: creat d9/dc/dd/d90/dc4/f107 x:0 0 0 2024-04-26T12:28:48.970 INFO:tasks.workunit.client.0.smithi046.stdout:0/752: chown d9/d1d/d40/d41/f6a 438450 1 2024-04-26T12:28:48.970 INFO:tasks.workunit.client.0.smithi046.stdout:7/716: dread d16/d1a/d31/f49 [0,4194304] 0 2024-04-26T12:28:48.970 INFO:tasks.workunit.client.0.smithi046.stdout:7/717: getdents d16/d4e/d6c/d9f 0 2024-04-26T12:28:48.970 INFO:tasks.workunit.client.0.smithi046.stdout:7/718: readlink d16/d1a/d31/d5a/l98 0 2024-04-26T12:28:48.970 INFO:tasks.workunit.client.0.smithi046.stdout:6/691: dread d7/f13 [0,4194304] 0 2024-04-26T12:28:48.970 INFO:tasks.workunit.client.0.smithi046.stdout:0/753: rename d9/dc/dd/d90/dc4 to d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d108 0 2024-04-26T12:28:48.971 INFO:tasks.workunit.client.0.smithi046.stdout:6/692: symlink d7/d2b/ldf 0 2024-04-26T12:28:48.971 INFO:tasks.workunit.client.0.smithi046.stdout:0/754: fdatasync d9/d1d/d5d/d6b/f7d 0 2024-04-26T12:28:48.971 INFO:tasks.workunit.client.0.smithi046.stdout:9/592: dwrite d0/f15 [0,4194304] 0 2024-04-26T12:28:48.971 INFO:tasks.workunit.client.0.smithi046.stdout:7/719: dread d16/d1a/d31/d5a/f7c [0,4194304] 0 2024-04-26T12:28:48.971 INFO:tasks.workunit.client.0.smithi046.stdout:6/693: creat d7/d16/dbc/dda/fe0 x:0 0 0 2024-04-26T12:28:48.971 INFO:tasks.workunit.client.0.smithi046.stdout:0/755: fsync d9/d1d/d5d/d6b/d8a/d8c/fde 0 2024-04-26T12:28:48.971 INFO:tasks.workunit.client.0.smithi046.stdout:9/593: rmdir d0/d16/d76/d7d/d72 39 2024-04-26T12:28:48.971 INFO:tasks.workunit.client.0.smithi046.stdout:6/694: stat d7/d1b/d6a/d57 0 2024-04-26T12:28:48.971 INFO:tasks.workunit.client.0.smithi046.stdout:9/594: fsync d0/d19/f2f 0 2024-04-26T12:28:48.971 INFO:tasks.workunit.client.0.smithi046.stdout:7/720: getdents d16/d1a/d31/d4d 0 2024-04-26T12:28:48.972 INFO:tasks.workunit.client.0.smithi046.stdout:9/595: chown d0/d16/f6e 39364 1 2024-04-26T12:28:48.972 INFO:tasks.workunit.client.0.smithi046.stdout:7/721: chown d16/d1a/d31/d55/d6d/d89/c9a 47 1 2024-04-26T12:28:48.972 INFO:tasks.workunit.client.0.smithi046.stdout:9/596: mkdir d0/d2c/dbe/dd2 0 2024-04-26T12:28:48.972 INFO:tasks.workunit.client.0.smithi046.stdout:7/722: chown d16/d27/d51/c86 201 1 2024-04-26T12:28:48.972 INFO:tasks.workunit.client.0.smithi046.stdout:9/597: mknod d0/d29/d69/cd3 0 2024-04-26T12:28:48.972 INFO:tasks.workunit.client.0.smithi046.stdout:7/723: dread - d16/d3f/d81/daa/fda zero size 2024-04-26T12:28:48.972 INFO:tasks.workunit.client.0.smithi046.stdout:0/756: dwrite d9/d1d/d40/d41/dc0/f4f [0,4194304] 0 2024-04-26T12:28:48.972 INFO:tasks.workunit.client.0.smithi046.stdout:7/724: read - d16/d4e/d6c/fa7 zero size 2024-04-26T12:28:48.972 INFO:tasks.workunit.client.0.smithi046.stdout:5/784: dread d9/da/dd/d34/d44/d88/d90/fbd [0,4194304] 0 2024-04-26T12:28:48.972 INFO:tasks.workunit.client.0.smithi046.stdout:0/757: unlink d9/dc/fc7 0 2024-04-26T12:28:48.972 INFO:tasks.workunit.client.0.smithi046.stdout:7/725: creat d16/d4e/d6c/dce/ddb/fea x:0 0 0 2024-04-26T12:28:48.972 INFO:tasks.workunit.client.0.smithi046.stdout:5/785: write d9/da/dd/f1e [7575419,85704] 0 2024-04-26T12:28:48.973 INFO:tasks.workunit.client.0.smithi046.stdout:7/726: link d16/d1a/d31/d5a/f3d d16/d1a/d3e/d4f/feb 0 2024-04-26T12:28:48.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/598: dwrite d0/d2c/d3d/d52/f8f [0,4194304] 0 2024-04-26T12:28:48.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/599: readlink d0/d2c/d3d/l62 0 2024-04-26T12:28:48.973 INFO:tasks.workunit.client.0.smithi046.stdout:7/727: dread - d16/db1/fb5 zero size 2024-04-26T12:28:48.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/600: read - d0/fc6 zero size 2024-04-26T12:28:48.973 INFO:tasks.workunit.client.0.smithi046.stdout:2/678: dread d1/f2 [0,4194304] 0 2024-04-26T12:28:48.973 INFO:tasks.workunit.client.0.smithi046.stdout:2/679: readlink d1/de/d67/le7 0 2024-04-26T12:28:48.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/601: mknod d0/d29/cd4 0 2024-04-26T12:28:48.973 INFO:tasks.workunit.client.0.smithi046.stdout:2/680: write d1/de/d2b/f3a [5215272,10962] 0 2024-04-26T12:28:48.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/602: symlink d0/d16/d76/d7d/d72/d85/ld5 0 2024-04-26T12:28:48.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/603: chown d0/d2c/f5d 1378575 1 2024-04-26T12:28:48.973 INFO:tasks.workunit.client.0.smithi046.stdout:0/758: dwrite d9/d1d/d40/d41/d7e/da5/dad/dbd/fa8 [0,4194304] 0 2024-04-26T12:28:48.973 INFO:tasks.workunit.client.0.smithi046.stdout:4/657: dread d0/da/d17/d20/d25/d35/d6d/d19/f4a [0,4194304] 0 2024-04-26T12:28:48.973 INFO:tasks.workunit.client.0.smithi046.stdout:5/786: dwrite d9/da/d15/f9f [0,4194304] 0 2024-04-26T12:28:48.974 INFO:tasks.workunit.client.0.smithi046.stdout:9/604: write d0/d19/f8c [8915,52015] 0 2024-04-26T12:28:48.974 INFO:tasks.workunit.client.0.smithi046.stdout:4/658: fdatasync d0/d1/d5/fc5 0 2024-04-26T12:28:48.974 INFO:tasks.workunit.client.0.smithi046.stdout:0/759: truncate d9/dc/dd/f99 4818982 0 2024-04-26T12:28:48.974 INFO:tasks.workunit.client.0.smithi046.stdout:5/787: fsync d9/da/dd/d5d/fbc 0 2024-04-26T12:28:48.974 INFO:tasks.workunit.client.0.smithi046.stdout:7/728: dwrite d16/d1a/d31/d5a/f60 [0,4194304] 0 2024-04-26T12:28:48.974 INFO:tasks.workunit.client.0.smithi046.stdout:0/760: chown d9/d1d/d5d/d6b 6311 1 2024-04-26T12:28:48.974 INFO:tasks.workunit.client.0.smithi046.stdout:9/605: rename d0/d2c/f5d to d0/d29/fd6 0 2024-04-26T12:28:48.974 INFO:tasks.workunit.client.0.smithi046.stdout:4/659: fsync d0/d64/dd9/fdb 0 2024-04-26T12:28:48.974 INFO:tasks.workunit.client.0.smithi046.stdout:5/788: write d9/da/dd/d34/d44/d97/da4/fa3 [2245828,70212] 0 2024-04-26T12:28:48.974 INFO:tasks.workunit.client.0.smithi046.stdout:9/606: truncate d0/d19/d21/f30 954886 0 2024-04-26T12:28:48.974 INFO:tasks.workunit.client.0.smithi046.stdout:8/770: dread d7/d1c/d74/df4/f70 [0,4194304] 0 2024-04-26T12:28:48.974 INFO:tasks.workunit.client.0.smithi046.stdout:8/771: readlink l3 0 2024-04-26T12:28:48.975 INFO:tasks.workunit.client.0.smithi046.stdout:3/722: sync 2024-04-26T12:28:48.975 INFO:tasks.workunit.client.0.smithi046.stdout:1/649: sync 2024-04-26T12:28:48.975 INFO:tasks.workunit.client.0.smithi046.stdout:8/772: read d7/da/df/f3f [177128,55295] 0 2024-04-26T12:28:48.975 INFO:tasks.workunit.client.0.smithi046.stdout:0/761: getdents d9/dc/db9 0 2024-04-26T12:28:48.975 INFO:tasks.workunit.client.0.smithi046.stdout:4/660: dwrite d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/f72 [0,4194304] 0 2024-04-26T12:28:48.975 INFO:tasks.workunit.client.0.smithi046.stdout:7/729: getdents d16/d1a/d31 0 2024-04-26T12:28:48.975 INFO:tasks.workunit.client.0.smithi046.stdout:8/773: mknod d7/d24/d50/d2a/d39/da6/cfc 0 2024-04-26T12:28:48.975 INFO:tasks.workunit.client.0.smithi046.stdout:9/607: dwrite d0/d16/d76/d7d/faa [0,4194304] 0 2024-04-26T12:28:48.975 INFO:tasks.workunit.client.0.smithi046.stdout:4/661: write d0/d41/f9b [5990951,109450] 0 2024-04-26T12:28:48.975 INFO:tasks.workunit.client.0.smithi046.stdout:5/789: dwrite d9/da/dd/d34/d45/d8f/ffc [0,4194304] 0 2024-04-26T12:28:48.975 INFO:tasks.workunit.client.0.smithi046.stdout:0/762: truncate d9/d1d/d40/d41/d7e/d9d/fd8 361136 0 2024-04-26T12:28:48.975 INFO:tasks.workunit.client.0.smithi046.stdout:1/650: dwrite d7/d14/d5d/d32/f75 [0,4194304] 0 2024-04-26T12:28:48.975 INFO:tasks.workunit.client.0.smithi046.stdout:5/790: write d9/da/dd/ff4 [846318,38148] 0 2024-04-26T12:28:48.976 INFO:tasks.workunit.client.0.smithi046.stdout:7/730: write d16/d1a/d31/d55/d6d/fcc [1116266,57417] 0 2024-04-26T12:28:48.976 INFO:tasks.workunit.client.0.smithi046.stdout:8/774: getdents d7/dd5 0 2024-04-26T12:28:48.976 INFO:tasks.workunit.client.0.smithi046.stdout:3/723: dwrite d2/d16/d35/dbc/fdd [0,4194304] 0 2024-04-26T12:28:48.976 INFO:tasks.workunit.client.0.smithi046.stdout:1/651: mkdir d7/d14/d5d/d32/d41/d8f/dd3/de5 0 2024-04-26T12:28:48.976 INFO:tasks.workunit.client.0.smithi046.stdout:1/652: write d7/d14/d5d/d32/f75 [2155920,125369] 0 2024-04-26T12:28:48.976 INFO:tasks.workunit.client.0.smithi046.stdout:0/763: rename d9/dc/dd/f3a to d9/d1d/d5d/d6b/d8a/d8c/f109 0 2024-04-26T12:28:48.976 INFO:tasks.workunit.client.0.smithi046.stdout:7/731: fdatasync d16/d1a/d31/fe7 0 2024-04-26T12:28:48.976 INFO:tasks.workunit.client.0.smithi046.stdout:3/724: mknod d2/d16/d2c/d50/d71/d89/d98/dce/c100 0 2024-04-26T12:28:48.976 INFO:tasks.workunit.client.0.smithi046.stdout:0/764: chown d9/dc/l7f 274965 1 2024-04-26T12:28:48.976 INFO:tasks.workunit.client.0.smithi046.stdout:9/608: dwrite d0/d2c/f4d [0,4194304] 0 2024-04-26T12:28:48.976 INFO:tasks.workunit.client.0.smithi046.stdout:0/765: write d9/fbc [48718,117236] 0 2024-04-26T12:28:48.976 INFO:tasks.workunit.client.0.smithi046.stdout:3/725: mknod d2/db/d62/c101 0 2024-04-26T12:28:48.976 INFO:tasks.workunit.client.0.smithi046.stdout:1/653: rmdir d7/db/d98/dc5/d2b/d31/dd0 39 2024-04-26T12:28:48.976 INFO:tasks.workunit.client.0.smithi046.stdout:8/775: dread d7/d24/d50/d2a/fd2 [0,4194304] 0 2024-04-26T12:28:48.977 INFO:tasks.workunit.client.0.smithi046.stdout:0/766: dread - d9/d1d/d40/db3/fd3 zero size 2024-04-26T12:28:48.977 INFO:tasks.workunit.client.0.smithi046.stdout:7/732: symlink d16/d3f/lec 0 2024-04-26T12:28:48.977 INFO:tasks.workunit.client.0.smithi046.stdout:5/791: write f8 [272886,89086] 0 2024-04-26T12:28:48.977 INFO:tasks.workunit.client.0.smithi046.stdout:1/654: symlink d7/d14/d5d/d32/d41/d8f/dd3/le6 0 2024-04-26T12:28:48.977 INFO:tasks.workunit.client.0.smithi046.stdout:0/767: symlink d9/dc/dd/d45/d69/de6/l10a 0 2024-04-26T12:28:48.977 INFO:tasks.workunit.client.0.smithi046.stdout:3/726: link d2/db/d84/fb3 d2/d16/d2c/d50/d71/d89/dc5/f102 0 2024-04-26T12:28:48.977 INFO:tasks.workunit.client.0.smithi046.stdout:9/609: write d0/d2c/d47/fbf [246734,50177] 0 2024-04-26T12:28:48.977 INFO:tasks.workunit.client.0.smithi046.stdout:5/792: creat d9/da/dd/d34/d44/d97/f108 x:0 0 0 2024-04-26T12:28:48.977 INFO:tasks.workunit.client.0.smithi046.stdout:8/776: dwrite d7/da/df/f2b [0,4194304] 0 2024-04-26T12:28:48.977 INFO:tasks.workunit.client.0.smithi046.stdout:4/662: dread d0/da/d17/d20/d25/d35/d6d/d19/d55/f82 [0,4194304] 0 2024-04-26T12:28:48.978 INFO:tasks.workunit.client.0.smithi046.stdout:3/727: link d2/d16/f73 d2/d16/d2c/d50/d71/d89/f103 0 2024-04-26T12:28:48.978 INFO:tasks.workunit.client.0.smithi046.stdout:9/610: truncate d0/d19/f6d 553062 0 2024-04-26T12:28:48.978 INFO:tasks.workunit.client.0.smithi046.stdout:5/793: creat d9/da/dd/d34/d44/d97/da4/dde/f109 x:0 0 0 2024-04-26T12:28:48.978 INFO:tasks.workunit.client.0.smithi046.stdout:4/663: chown d0/d1/f3b 213 1 2024-04-26T12:28:48.978 INFO:tasks.workunit.client.0.smithi046.stdout:7/733: dwrite d16/d3f/d81/daa/fda [0,4194304] 0 2024-04-26T12:28:48.978 INFO:tasks.workunit.client.0.smithi046.stdout:5/794: mkdir d9/da/dd/d5d/d10a 0 2024-04-26T12:28:48.978 INFO:tasks.workunit.client.0.smithi046.stdout:3/728: write d2/d16/d2c/d50/d71/d89/dc5/d23/f67 [1515092,49964] 0 2024-04-26T12:28:48.981 INFO:tasks.workunit.client.0.smithi046.stdout:4/664: creat d0/da/d70/dc7/fdd x:0 0 0 2024-04-26T12:28:48.981 INFO:tasks.workunit.client.0.smithi046.stdout:9/611: link d0/d2c/d47/l14 d0/d16/d76/d7d/d72/d85/ld7 0 2024-04-26T12:28:48.981 INFO:tasks.workunit.client.0.smithi046.stdout:5/795: stat d9/da/d18/d7d/d105 0 2024-04-26T12:28:48.981 INFO:tasks.workunit.client.0.smithi046.stdout:7/734: link d16/d1a/d31/cd0 d16/d1a/d3e/d59/ced 0 2024-04-26T12:28:48.982 INFO:tasks.workunit.client.0.smithi046.stdout:4/665: symlink d0/da/d17/d20/lde 0 2024-04-26T12:28:48.982 INFO:tasks.workunit.client.0.smithi046.stdout:3/729: creat d2/d16/d35/dbc/dc9/dd0/f104 x:0 0 0 2024-04-26T12:28:48.982 INFO:tasks.workunit.client.0.smithi046.stdout:7/735: mkdir d16/db1/dc0/dee 0 2024-04-26T12:28:48.982 INFO:tasks.workunit.client.0.smithi046.stdout:8/777: dwrite d7/d24/d50/f9b [0,4194304] 0 2024-04-26T12:28:48.982 INFO:tasks.workunit.client.0.smithi046.stdout:4/666: link d0/da/la0 d0/d64/dd9/ldf 0 2024-04-26T12:28:48.982 INFO:tasks.workunit.client.0.smithi046.stdout:0/768: read d9/dc/dd/fa6 [581275,59173] 0 2024-04-26T12:28:48.982 INFO:tasks.workunit.client.0.smithi046.stdout:7/736: fdatasync d16/d27/d51/d9c/fbc 0 2024-04-26T12:28:48.982 INFO:tasks.workunit.client.0.smithi046.stdout:2/681: sync 2024-04-26T12:28:48.982 INFO:tasks.workunit.client.0.smithi046.stdout:7/737: chown d16/d1a/d31 0 1 2024-04-26T12:28:48.982 INFO:tasks.workunit.client.0.smithi046.stdout:6/695: dread d7/fe [8388608,4194304] 0 2024-04-26T12:28:48.983 INFO:tasks.workunit.client.0.smithi046.stdout:5/796: dwrite d9/da/dd/f13 [0,4194304] 0 2024-04-26T12:28:48.983 INFO:tasks.workunit.client.0.smithi046.stdout:6/696: read d7/f8 [469728,49679] 0 2024-04-26T12:28:48.983 INFO:tasks.workunit.client.0.smithi046.stdout:4/667: truncate d0/da/d17/d20/d25/d35/fc1 200153 0 2024-04-26T12:28:48.983 INFO:tasks.workunit.client.0.smithi046.stdout:7/738: link d16/d4e/cd1 d16/d3f/cef 0 2024-04-26T12:28:48.983 INFO:tasks.workunit.client.0.smithi046.stdout:1/655: dwrite d7/db/d98/dc5/d2b/d31/dd0/fe4 [0,4194304] 0 2024-04-26T12:28:48.983 INFO:tasks.workunit.client.0.smithi046.stdout:5/797: symlink d9/da/dd/d34/d44/l10b 0 2024-04-26T12:28:48.983 INFO:tasks.workunit.client.0.smithi046.stdout:6/697: truncate d7/fc8 297764 0 2024-04-26T12:28:48.984 INFO:tasks.workunit.client.0.smithi046.stdout:8/778: dwrite d7/da/d4f/fe6 [0,4194304] 0 2024-04-26T12:28:48.984 INFO:tasks.workunit.client.0.smithi046.stdout:7/739: write d16/d1a/fcb [631521,128876] 0 2024-04-26T12:28:48.984 INFO:tasks.workunit.client.0.smithi046.stdout:3/730: getdents d2/d16/d35/dbc/dc9/dd0 0 2024-04-26T12:28:48.985 INFO:tasks.workunit.client.0.smithi046.stdout:7/740: write d16/d1a/d31/d5a/f50 [592987,91810] 0 2024-04-26T12:28:48.986 INFO:tasks.workunit.client.0.smithi046.stdout:2/682: dwrite d1/de/d65/d1b/f61 [0,4194304] 0 2024-04-26T12:28:48.986 INFO:tasks.workunit.client.0.smithi046.stdout:0/769: dwrite d9/dc/dd/d45/d69/f7a [0,4194304] 0 2024-04-26T12:28:48.986 INFO:tasks.workunit.client.0.smithi046.stdout:8/779: stat d7/l6d 0 2024-04-26T12:28:48.986 INFO:tasks.workunit.client.0.smithi046.stdout:3/731: write d2/db/d4a/da9/faf [4787413,105091] 0 2024-04-26T12:28:48.986 INFO:tasks.workunit.client.0.smithi046.stdout:5/798: creat d9/da/dd/dd7/db0/f10c x:0 0 0 2024-04-26T12:28:48.986 INFO:tasks.workunit.client.0.smithi046.stdout:2/683: chown d1/ca6 6 1 2024-04-26T12:28:48.986 INFO:tasks.workunit.client.0.smithi046.stdout:4/668: write d0/da/d17/d20/d25/d35/d6d/d19/d53/f62 [522216,100061] 0 2024-04-26T12:28:48.987 INFO:tasks.workunit.client.0.smithi046.stdout:3/732: rename d2 to d2/d16/d35/dbc/dc9/d105 22 2024-04-26T12:28:48.987 INFO:tasks.workunit.client.0.smithi046.stdout:5/799: chown d9/da/dd/d34/d44/d88/c93 74 1 2024-04-26T12:28:48.988 INFO:tasks.workunit.client.0.smithi046.stdout:8/780: mkdir d7/d1c/d74/df4/d1b/d7d/dc1/dfd 0 2024-04-26T12:28:48.988 INFO:tasks.workunit.client.0.smithi046.stdout:2/684: truncate d1/de/d65/d4a/d58/f73 1454725 0 2024-04-26T12:28:48.989 INFO:tasks.workunit.client.0.smithi046.stdout:5/800: mknod d9/da/dd/d34/d44/d97/da4/d35/dd8/dff/c10d 0 2024-04-26T12:28:48.989 INFO:tasks.workunit.client.0.smithi046.stdout:8/781: chown d7/d1c/d74/df4/d27/db0/fc3 0 1 2024-04-26T12:28:48.990 INFO:tasks.workunit.client.0.smithi046.stdout:2/685: rename d1/de/d15/d18/d98/fbf to d1/de/dc8/feb 0 2024-04-26T12:28:48.991 INFO:tasks.workunit.client.0.smithi046.stdout:8/782: getdents d7/d1c/d74 0 2024-04-26T12:28:48.991 INFO:tasks.workunit.client.0.smithi046.stdout:2/686: symlink d1/de/d15/dc2/lec 0 2024-04-26T12:28:48.993 INFO:tasks.workunit.client.0.smithi046.stdout:8/783: fdatasync d7/d24/d50/d2a/fdf 0 2024-04-26T12:28:48.993 INFO:tasks.workunit.client.0.smithi046.stdout:4/669: dwrite d0/da/d17/d20/d9c/fbd [0,4194304] 0 2024-04-26T12:28:48.993 INFO:tasks.workunit.client.0.smithi046.stdout:2/687: chown d1/de/d15/d18/d8a/lbc 312 1 2024-04-26T12:28:48.996 INFO:tasks.workunit.client.0.smithi046.stdout:5/801: dwrite d9/da/dd/f13 [0,4194304] 0 2024-04-26T12:28:48.997 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:48.995+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:48.997 INFO:tasks.workunit.client.0.smithi046.stdout:2/688: rename d1/de/d15/d18/f4c to d1/de/d15/d18/d8a/fed 0 2024-04-26T12:28:48.998 INFO:tasks.workunit.client.0.smithi046.stdout:5/802: unlink d9/da/dd/d34/d44/c6a 0 2024-04-26T12:28:48.998 INFO:tasks.workunit.client.0.smithi046.stdout:2/689: chown d1/de/d15/d18/dc1/de3 695962850 1 2024-04-26T12:28:48.999 INFO:tasks.workunit.client.0.smithi046.stdout:2/690: symlink d1/de/dc8/lee 0 2024-04-26T12:28:48.999 INFO:tasks.workunit.client.0.smithi046.stdout:5/803: mkdir d9/da/dd/dd7/d7e/d10e 0 2024-04-26T12:28:49.000 INFO:tasks.workunit.client.0.smithi046.stdout:5/804: rename d9/da/d15/fb7 to d9/da/dd/d34/d44/d97/da4/d35/dd8/f10f 0 2024-04-26T12:28:49.000 INFO:tasks.workunit.client.0.smithi046.stdout:9/612: dread d0/d2c/d47/f23 [0,4194304] 0 2024-04-26T12:28:49.002 INFO:tasks.workunit.client.0.smithi046.stdout:5/805: creat d9/da/dd/d34/f110 x:0 0 0 2024-04-26T12:28:49.003 INFO:tasks.workunit.client.0.smithi046.stdout:4/670: truncate d0/da/d17/d20/d9c/fbd 3582349 0 2024-04-26T12:28:49.005 INFO:tasks.workunit.client.0.smithi046.stdout:2/691: dwrite d1/de/f3c [0,4194304] 0 2024-04-26T12:28:49.005 INFO:tasks.workunit.client.0.smithi046.stdout:5/806: rename d9/da/dd/dd7/db0/de0/ce6 to d9/da/dd/dd7/c111 0 2024-04-26T12:28:49.007 INFO:tasks.workunit.client.0.smithi046.stdout:4/671: rename d0/da/d17/d20/d25/d35/d61/f7b to d0/da/d17/d20/d25/fe0 0 2024-04-26T12:28:49.008 INFO:tasks.workunit.client.0.smithi046.stdout:9/613: dwrite d0/d16/d76/d7d/d72/f91 [0,4194304] 0 2024-04-26T12:28:49.009 INFO:tasks.workunit.client.0.smithi046.stdout:9/614: chown d0/d16/d76/d7d/c6b 1 1 2024-04-26T12:28:49.010 INFO:tasks.workunit.client.0.smithi046.stdout:2/692: dread d1/de/d65/d1b/f61 [0,4194304] 0 2024-04-26T12:28:49.010 INFO:tasks.workunit.client.0.smithi046.stdout:9/615: mkdir d0/d29/dd8 0 2024-04-26T12:28:49.011 INFO:tasks.workunit.client.0.smithi046.stdout:9/616: chown d0/d16 14853 1 2024-04-26T12:28:49.012 INFO:tasks.workunit.client.0.smithi046.stdout:9/617: getdents d0/d16/d76/d7d/d72/da1 0 2024-04-26T12:28:49.013 INFO:tasks.workunit.client.0.smithi046.stdout:9/618: chown d0/d19/f50 8135 1 2024-04-26T12:28:49.013 INFO:tasks.workunit.client.0.smithi046.stdout:8/784: dread d7/d1c/d74/df4/f17 [4194304,4194304] 0 2024-04-26T12:28:49.015 INFO:tasks.workunit.client.0.smithi046.stdout:8/785: mknod d7/d1c/d74/df4/d1b/dae/dcf/cfe 0 2024-04-26T12:28:49.015 INFO:tasks.workunit.client.0.smithi046.stdout:2/693: dwrite d1/f35 [0,4194304] 0 2024-04-26T12:28:49.015 INFO:tasks.workunit.client.0.smithi046.stdout:9/619: rename d0/fc6 to d0/d16/d76/d7d/d72/da1/dc8/dcd/fd9 0 2024-04-26T12:28:49.016 INFO:tasks.workunit.client.0.smithi046.stdout:8/786: fdatasync d7/d24/f2f 0 2024-04-26T12:28:49.016 INFO:tasks.workunit.client.0.smithi046.stdout:2/694: write d1/de/d15/d18/f57 [173983,118062] 0 2024-04-26T12:28:49.017 INFO:tasks.workunit.client.0.smithi046.stdout:8/787: fdatasync d7/d24/d50/f72 0 2024-04-26T12:28:49.018 INFO:tasks.workunit.client.0.smithi046.stdout:8/788: symlink d7/d24/d50/d2a/d92/lff 0 2024-04-26T12:28:49.018 INFO:tasks.workunit.client.0.smithi046.stdout:2/695: write d1/de/d15/d18/dc1/db6/dda/d78/fbd [365900,85208] 0 2024-04-26T12:28:49.019 INFO:tasks.workunit.client.0.smithi046.stdout:9/620: rename d0/d16 to d0/d2c/dda 0 2024-04-26T12:28:49.020 INFO:tasks.workunit.client.0.smithi046.stdout:2/696: mknod d1/de/d65/d4a/d58/d72/cef 0 2024-04-26T12:28:49.020 INFO:tasks.workunit.client.0.smithi046.stdout:0/770: sync 2024-04-26T12:28:49.021 INFO:tasks.workunit.client.0.smithi046.stdout:3/733: sync 2024-04-26T12:28:49.021 INFO:tasks.workunit.client.0.smithi046.stdout:8/789: creat d7/d24/d50/d2a/d92/f100 x:0 0 0 2024-04-26T12:28:49.021 INFO:tasks.workunit.client.0.smithi046.stdout:9/621: creat d0/d29/fdb x:0 0 0 2024-04-26T12:28:49.021 INFO:tasks.workunit.client.0.smithi046.stdout:9/622: fdatasync d0/d19/f6d 0 2024-04-26T12:28:49.021 INFO:tasks.workunit.client.0.smithi046.stdout:0/771: symlink d9/d1d/d40/db3/l10b 0 2024-04-26T12:28:49.022 INFO:tasks.workunit.client.0.smithi046.stdout:2/697: creat d1/de/d15/d18/dc1/db6/dda/d78/ff0 x:0 0 0 2024-04-26T12:28:49.022 INFO:tasks.workunit.client.0.smithi046.stdout:3/734: fsync d2/d16/d2c/d50/d71/d89/dc5/f3a 0 2024-04-26T12:28:49.022 INFO:tasks.workunit.client.0.smithi046.stdout:2/698: chown d1 1003367018 1 2024-04-26T12:28:49.022 INFO:tasks.workunit.client.0.smithi046.stdout:7/741: dread d16/d1a/d3e/f44 [0,4194304] 0 2024-04-26T12:28:49.023 INFO:tasks.workunit.client.0.smithi046.stdout:0/772: rmdir d9/d1d/d40/d41/d7e/d9d 39 2024-04-26T12:28:49.023 INFO:tasks.workunit.client.0.smithi046.stdout:7/742: dread - d16/d1a/fe4 zero size 2024-04-26T12:28:49.024 INFO:tasks.workunit.client.0.smithi046.stdout:2/699: rename d1/de/d65/d4a/d58/d72/cef to d1/de/d2b/cf1 0 2024-04-26T12:28:49.024 INFO:tasks.workunit.client.0.smithi046.stdout:7/743: mknod d16/d3f/d81/daa/cf0 0 2024-04-26T12:28:49.024 INFO:tasks.workunit.client.0.smithi046.stdout:0/773: creat d9/dc/dd/d45/f10c x:0 0 0 2024-04-26T12:28:49.025 INFO:tasks.workunit.client.0.smithi046.stdout:7/744: rmdir d16/d27 39 2024-04-26T12:28:49.025 INFO:tasks.workunit.client.0.smithi046.stdout:3/735: rename d2/d16/d2c/d50/d71/d89/dc5/d6d/lae to d2/d16/d2c/d50/l106 0 2024-04-26T12:28:49.025 INFO:tasks.workunit.client.0.smithi046.stdout:6/698: dread d7/d16/f4a [0,4194304] 0 2024-04-26T12:28:49.026 INFO:tasks.workunit.client.0.smithi046.stdout:6/699: rmdir d7 39 2024-04-26T12:28:49.027 INFO:tasks.workunit.client.0.smithi046.stdout:3/736: unlink d2/d16/d2c/d50/d71/d89/dc5/d1b/c1e 0 2024-04-26T12:28:49.027 INFO:tasks.workunit.client.0.smithi046.stdout:6/700: creat d7/d16/dbc/fe1 x:0 0 0 2024-04-26T12:28:49.028 INFO:tasks.workunit.client.0.smithi046.stdout:2/700: truncate d1/de/d65/d1b/faa 1494618 0 2024-04-26T12:28:49.029 INFO:tasks.workunit.client.0.smithi046.stdout:1/656: dread d7/db/d98/dc5/d2b/d96/fa6 [0,4194304] 0 2024-04-26T12:28:49.030 INFO:tasks.workunit.client.0.smithi046.stdout:6/701: chown d7/d1b/d6a/f99 103614877 1 2024-04-26T12:28:49.031 INFO:tasks.workunit.client.0.smithi046.stdout:7/745: dread d16/d1a/d3e/f44 [0,4194304] 0 2024-04-26T12:28:49.031 INFO:tasks.workunit.client.0.smithi046.stdout:1/657: creat d7/d14/d5d/d32/d41/d8f/dd3/fe7 x:0 0 0 2024-04-26T12:28:49.032 INFO:tasks.workunit.client.0.smithi046.stdout:0/774: dwrite d9/f61 [0,4194304] 0 2024-04-26T12:28:49.033 INFO:tasks.workunit.client.0.smithi046.stdout:6/702: symlink d7/d1b/d47/d65/d77/d92/le2 0 2024-04-26T12:28:49.033 INFO:tasks.workunit.client.0.smithi046.stdout:4/672: dread d0/d1/f15 [0,4194304] 0 2024-04-26T12:28:49.033 INFO:tasks.workunit.client.0.smithi046.stdout:7/746: dread - d16/d4e/d6c/dce/ddb/fea zero size 2024-04-26T12:28:49.033 INFO:tasks.workunit.client.0.smithi046.stdout:1/658: read - d7/db/d98/dc5/d2b/d39/db3/fd1 zero size 2024-04-26T12:28:49.034 INFO:tasks.workunit.client.0.smithi046.stdout:6/703: write d7/d16/f1c [169294,42843] 0 2024-04-26T12:28:49.034 INFO:tasks.workunit.client.0.smithi046.stdout:1/659: mkdir d7/d14/de8 0 2024-04-26T12:28:49.034 INFO:tasks.workunit.client.0.smithi046.stdout:4/673: write d0/d41/f9b [7270111,130571] 0 2024-04-26T12:28:49.035 INFO:tasks.workunit.client.0.smithi046.stdout:7/747: mknod d16/d1a/d31/d55/d6d/d89/dc7/cf1 0 2024-04-26T12:28:49.035 INFO:tasks.workunit.client.0.smithi046.stdout:6/704: creat d7/d16/dbc/dda/fe3 x:0 0 0 2024-04-26T12:28:49.036 INFO:tasks.workunit.client.0.smithi046.stdout:0/775: write d9/dc/dd/d45/f4b [381098,72212] 0 2024-04-26T12:28:49.037 INFO:tasks.workunit.client.0.smithi046.stdout:7/748: chown d16/d35/f3a 93826083 1 2024-04-26T12:28:49.038 INFO:tasks.workunit.client.0.smithi046.stdout:5/807: dread d9/da/dd/d34/d44/d97/da4/dde/fef [0,4194304] 0 2024-04-26T12:28:49.038 INFO:tasks.workunit.client.0.smithi046.stdout:0/776: chown d9/d1d/d40/d41/dc0/db2/ff1 4 1 2024-04-26T12:28:49.039 INFO:tasks.workunit.client.0.smithi046.stdout:0/777: creat d9/dc/dd/d45/d69/f10d x:0 0 0 2024-04-26T12:28:49.039 INFO:tasks.workunit.client.0.smithi046.stdout:5/808: write d9/da/dd/d34/d44/fdd [224799,90240] 0 2024-04-26T12:28:49.040 INFO:tasks.workunit.client.0.smithi046.stdout:8/790: sync 2024-04-26T12:28:49.040 INFO:tasks.workunit.client.0.smithi046.stdout:9/623: sync 2024-04-26T12:28:49.040 INFO:tasks.workunit.client.0.smithi046.stdout:5/809: chown d9/c59 8084 1 2024-04-26T12:28:49.041 INFO:tasks.workunit.client.0.smithi046.stdout:0/778: write d9/dc/d2a/f31 [2684106,83157] 0 2024-04-26T12:28:49.042 INFO:tasks.workunit.client.0.smithi046.stdout:4/674: dread d0/f14 [0,4194304] 0 2024-04-26T12:28:49.042 INFO:tasks.workunit.client.0.smithi046.stdout:7/749: dread d16/d1a/d31/d4d/f5f [4194304,4194304] 0 2024-04-26T12:28:49.042 INFO:tasks.workunit.client.0.smithi046.stdout:0/779: mkdir d9/dc/dd/dd2/d10e 0 2024-04-26T12:28:49.043 INFO:tasks.workunit.client.0.smithi046.stdout:5/810: symlink d9/da/dd/dd7/d7e/d10e/l112 0 2024-04-26T12:28:49.043 INFO:tasks.workunit.client.0.smithi046.stdout:8/791: getdents d7/d1c/d74/df4/d1b 0 2024-04-26T12:28:49.044 INFO:tasks.workunit.client.0.smithi046.stdout:7/750: rename d16/d4e/d6c/dce to d16/d1a/d31/d5a/d6b/df2 0 2024-04-26T12:28:49.044 INFO:tasks.workunit.client.0.smithi046.stdout:4/675: mkdir d0/da/d17/d20/d25/d35/de1 0 2024-04-26T12:28:49.045 INFO:tasks.workunit.client.0.smithi046.stdout:8/792: chown d7/d24/d50/d2a/d39/fe0 9 1 2024-04-26T12:28:49.045 INFO:tasks.workunit.client.0.smithi046.stdout:5/811: unlink d9/da/dd/d34/d44/d97/da4/fa3 0 2024-04-26T12:28:49.045 INFO:tasks.workunit.client.0.smithi046.stdout:0/780: mkdir d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d10f 0 2024-04-26T12:28:49.046 INFO:tasks.workunit.client.0.smithi046.stdout:7/751: write d16/d27/fe2 [996971,56314] 0 2024-04-26T12:28:49.046 INFO:tasks.workunit.client.0.smithi046.stdout:8/793: mknod d7/da/c101 0 2024-04-26T12:28:49.047 INFO:tasks.workunit.client.0.smithi046.stdout:4/676: mkdir d0/da/d17/d20/d25/d35/d61/dc6/de2 0 2024-04-26T12:28:49.047 INFO:tasks.workunit.client.0.smithi046.stdout:7/752: symlink d16/d27/d51/lf3 0 2024-04-26T12:28:49.047 INFO:tasks.workunit.client.0.smithi046.stdout:0/781: write d9/dc/dd/d45/d69/fc3 [518183,50994] 0 2024-04-26T12:28:49.047 INFO:tasks.workunit.client.0.smithi046.stdout:8/794: fdatasync d7/d24/d50/db3/fe9 0 2024-04-26T12:28:49.047 INFO:tasks.workunit.client.0.smithi046.stdout:5/812: write d9/da/dd/d34/d44/f8e [910991,73127] 0 2024-04-26T12:28:49.048 INFO:tasks.workunit.client.0.smithi046.stdout:2/701: dread d1/de/d65/f5d [0,4194304] 0 2024-04-26T12:28:49.049 INFO:tasks.workunit.client.0.smithi046.stdout:5/813: creat d9/da/d18/d7d/da7/f113 x:0 0 0 2024-04-26T12:28:49.049 INFO:tasks.workunit.client.0.smithi046.stdout:7/753: link d16/d1a/d31/fe7 d16/d4e/ff4 0 2024-04-26T12:28:49.050 INFO:tasks.workunit.client.0.smithi046.stdout:2/702: write d1/de/d65/d8f/fe1 [990894,75519] 0 2024-04-26T12:28:49.051 INFO:tasks.workunit.client.0.smithi046.stdout:6/705: dread d7/fa [0,4194304] 0 2024-04-26T12:28:49.051 INFO:tasks.workunit.client.0.smithi046.stdout:5/814: readlink d9/da/dd/d34/d44/d97/da4/d35/l91 0 2024-04-26T12:28:49.052 INFO:tasks.workunit.client.0.smithi046.stdout:3/737: dread d2/d16/d35/fcc [0,4194304] 0 2024-04-26T12:28:49.053 INFO:tasks.workunit.client.0.smithi046.stdout:2/703: read - d1/de/d65/d4a/d58/fa9 zero size 2024-04-26T12:28:49.053 INFO:tasks.workunit.client.0.smithi046.stdout:5/815: rename d9/da/dd/d5d/f5f to d9/da/dd/f114 0 2024-04-26T12:28:49.054 INFO:tasks.workunit.client.0.smithi046.stdout:0/782: dwrite d9/dc/f1c [4194304,4194304] 0 2024-04-26T12:28:49.055 INFO:tasks.workunit.client.0.smithi046.stdout:4/677: truncate d0/da/d17/d20/d25/d35/d6d/d19/f3d 3566592 0 2024-04-26T12:28:49.055 INFO:tasks.workunit.client.0.smithi046.stdout:3/738: write d2/db/d62/f87 [1040290,30620] 0 2024-04-26T12:28:49.057 INFO:tasks.workunit.client.0.smithi046.stdout:2/704: rmdir d1/de/d15/d18/dc1/db6/dda 39 2024-04-26T12:28:49.058 INFO:tasks.workunit.client.0.smithi046.stdout:7/754: dwrite d16/d3f/d81/fc1 [0,4194304] 0 2024-04-26T12:28:49.058 INFO:tasks.workunit.client.0.smithi046.stdout:1/660: dread d7/db/d98/dc5/d2b/d39/d3c/f72 [0,4194304] 0 2024-04-26T12:28:49.058 INFO:tasks.workunit.client.0.smithi046.stdout:8/795: dread d7/d24/f43 [0,4194304] 0 2024-04-26T12:28:49.059 INFO:tasks.workunit.client.0.smithi046.stdout:8/796: chown d7/da/fa9 7165 1 2024-04-26T12:28:49.059 INFO:tasks.workunit.client.0.smithi046.stdout:4/678: creat d0/da/fe3 x:0 0 0 2024-04-26T12:28:49.060 INFO:tasks.workunit.client.0.smithi046.stdout:7/755: chown d16/d1a/d31/d5a/f2a 444867 1 2024-04-26T12:28:49.060 INFO:tasks.workunit.client.0.smithi046.stdout:0/783: creat d9/d1d/d40/d41/d7e/ddd/de8/f110 x:0 0 0 2024-04-26T12:28:49.060 INFO:tasks.workunit.client.0.smithi046.stdout:3/739: getdents d2/d16/d2c/d50/d71/df6 0 2024-04-26T12:28:49.060 INFO:tasks.workunit.client.0.smithi046.stdout:2/705: rename d1/de/d15/dc2 to d1/df2 0 2024-04-26T12:28:49.060 INFO:tasks.workunit.client.0.smithi046.stdout:1/661: fsync d7/db/d98/dc5/d2b/d31/d82/fb6 0 2024-04-26T12:28:49.061 INFO:tasks.workunit.client.0.smithi046.stdout:0/784: readlink d9/dc/dd/dd2/de2/lab 0 2024-04-26T12:28:49.061 INFO:tasks.workunit.client.0.smithi046.stdout:4/679: symlink d0/d1/le4 0 2024-04-26T12:28:49.061 INFO:tasks.workunit.client.0.smithi046.stdout:7/756: symlink d16/d3f/d81/daa/lf5 0 2024-04-26T12:28:49.061 INFO:tasks.workunit.client.0.smithi046.stdout:3/740: write d2/d16/d35/dbc/fdd [334079,32459] 0 2024-04-26T12:28:49.062 INFO:tasks.workunit.client.0.smithi046.stdout:8/797: truncate d7/d1c/d74/df4/d1b/dae/dcf/fd6 570857 0 2024-04-26T12:28:49.063 INFO:tasks.workunit.client.0.smithi046.stdout:7/757: chown d16/d27/l43 5 1 2024-04-26T12:28:49.063 INFO:tasks.workunit.client.0.smithi046.stdout:3/741: chown l0 5 1 2024-04-26T12:28:49.063 INFO:tasks.workunit.client.0.smithi046.stdout:0/785: write d9/d1d/d5d/d6b/d8a/d8c/fac [677167,12917] 0 2024-04-26T12:28:49.063 INFO:tasks.workunit.client.0.smithi046.stdout:4/680: fsync d0/d1/f15 0 2024-04-26T12:28:49.063 INFO:tasks.workunit.client.0.smithi046.stdout:5/816: truncate d9/da/dd/d34/d45/d8f/ffc 4113250 0 2024-04-26T12:28:49.063 INFO:tasks.workunit.client.0.smithi046.stdout:2/706: creat d1/de/d65/d1b/ff3 x:0 0 0 2024-04-26T12:28:49.064 INFO:tasks.workunit.client.0.smithi046.stdout:3/742: creat d2/f107 x:0 0 0 2024-04-26T12:28:49.064 INFO:tasks.workunit.client.0.smithi046.stdout:2/707: symlink d1/d71/lf4 0 2024-04-26T12:28:49.065 INFO:tasks.workunit.client.0.smithi046.stdout:8/798: write d7/d1c/d74/df4/fe3 [1013173,116182] 0 2024-04-26T12:28:49.065 INFO:tasks.workunit.client.0.smithi046.stdout:7/758: write d16/d27/d51/f67 [223790,14734] 0 2024-04-26T12:28:49.065 INFO:tasks.workunit.client.0.smithi046.stdout:5/817: symlink d9/da/d18/dd4/l115 0 2024-04-26T12:28:49.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/786: truncate d9/dc/dd/d45/d69/f10d 557458 0 2024-04-26T12:28:49.066 INFO:tasks.workunit.client.0.smithi046.stdout:8/799: chown d7/da/l3e 57 1 2024-04-26T12:28:49.066 INFO:tasks.workunit.client.0.smithi046.stdout:3/743: write d2/db/d84/da5/fb2 [406147,69114] 0 2024-04-26T12:28:49.067 INFO:tasks.workunit.client.0.smithi046.stdout:2/708: dread - d1/de/d65/d4a/d58/fa9 zero size 2024-04-26T12:28:49.068 INFO:tasks.workunit.client.0.smithi046.stdout:7/759: creat d16/d1a/d31/d55/d6d/ff6 x:0 0 0 2024-04-26T12:28:49.068 INFO:tasks.workunit.client.0.smithi046.stdout:4/681: write d0/da/d17/d20/d25/d35/d6d/d19/d55/dae/fc2 [87775,124336] 0 2024-04-26T12:28:49.068 INFO:tasks.workunit.client.0.smithi046.stdout:5/818: symlink d9/da/dd/dd7/d7e/d10e/l116 0 2024-04-26T12:28:49.068 INFO:tasks.workunit.client.0.smithi046.stdout:1/662: dwrite d7/fae [0,4194304] 0 2024-04-26T12:28:49.069 INFO:tasks.workunit.client.0.smithi046.stdout:3/744: symlink d2/d16/l108 0 2024-04-26T12:28:49.069 INFO:tasks.workunit.client.0.smithi046.stdout:2/709: creat d1/de/da4/ff5 x:0 0 0 2024-04-26T12:28:49.069 INFO:tasks.workunit.client.0.smithi046.stdout:0/787: symlink d9/d1d/d5d/d6b/d8a/d8c/l111 0 2024-04-26T12:28:49.069 INFO:tasks.workunit.client.0.smithi046.stdout:7/760: write d16/d35/dc9/fd3 [1018153,13372] 0 2024-04-26T12:28:49.070 INFO:tasks.workunit.client.0.smithi046.stdout:4/682: rename d0/da/da1/lb8 to d0/le5 0 2024-04-26T12:28:49.070 INFO:tasks.workunit.client.0.smithi046.stdout:1/663: rename d7/db to d7/db/d98/dc5/d2b/d9f/de9 22 2024-04-26T12:28:49.071 INFO:tasks.workunit.client.0.smithi046.stdout:8/800: link d7/d1c/d74/df4/d1b/da0/caf d7/d1c/d74/df4/d1b/da0/db6/c102 0 2024-04-26T12:28:49.071 INFO:tasks.workunit.client.0.smithi046.stdout:4/683: chown d0/f14 1165194611 1 2024-04-26T12:28:49.071 INFO:tasks.workunit.client.0.smithi046.stdout:6/706: dread d7/f79 [0,4194304] 0 2024-04-26T12:28:49.072 INFO:tasks.workunit.client.0.smithi046.stdout:1/664: chown d7/d14/d5d/d32/d5f/f65 3 1 2024-04-26T12:28:49.072 INFO:tasks.workunit.client.0.smithi046.stdout:7/761: getdents d16/d1a/d3e/d4f 0 2024-04-26T12:28:49.072 INFO:tasks.workunit.client.0.smithi046.stdout:1/665: chown d7/db/d98/dc5/d2b/d31 5363616 1 2024-04-26T12:28:49.072 INFO:tasks.workunit.client.0.smithi046.stdout:7/762: mkdir d16/d4e/d6c/df7 0 2024-04-26T12:28:49.073 INFO:tasks.workunit.client.0.smithi046.stdout:1/666: mknod d7/d12/cea 0 2024-04-26T12:28:49.073 INFO:tasks.workunit.client.0.smithi046.stdout:7/763: chown d16/d1a/d31/d55 91209 1 2024-04-26T12:28:49.074 INFO:tasks.workunit.client.0.smithi046.stdout:7/764: creat d16/d1a/d69/ff8 x:0 0 0 2024-04-26T12:28:49.076 INFO:tasks.workunit.client.0.smithi046.stdout:3/745: write d2/db/d4a/fc8 [850636,84730] 0 2024-04-26T12:28:49.076 INFO:tasks.workunit.client.0.smithi046.stdout:4/684: write d0/f14 [2237273,30215] 0 2024-04-26T12:28:49.076 INFO:tasks.workunit.client.0.smithi046.stdout:6/707: dwrite d7/d1b/d47/d65/fc6 [0,4194304] 0 2024-04-26T12:28:49.077 INFO:tasks.workunit.client.0.smithi046.stdout:8/801: truncate d7/f55 1696761 0 2024-04-26T12:28:49.077 INFO:tasks.workunit.client.0.smithi046.stdout:3/746: unlink d2/db0/dc4/d74/fe2 0 2024-04-26T12:28:49.078 INFO:tasks.workunit.client.0.smithi046.stdout:6/708: chown d7/da7/dd1/dd6 11545 1 2024-04-26T12:28:49.078 INFO:tasks.workunit.client.0.smithi046.stdout:7/765: write d16/d1a/d31/fe7 [9700370,108632] 0 2024-04-26T12:28:49.079 INFO:tasks.workunit.client.0.smithi046.stdout:1/667: dwrite d7/d12/faf [0,4194304] 0 2024-04-26T12:28:49.080 INFO:tasks.workunit.client.0.smithi046.stdout:6/709: write d7/d2b/f30 [2695203,66475] 0 2024-04-26T12:28:49.080 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:49.078+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:49.081 INFO:tasks.workunit.client.0.smithi046.stdout:3/747: symlink d2/d16/d2c/d50/d71/d89/dc5/d1b/l109 0 2024-04-26T12:28:49.081 INFO:tasks.workunit.client.0.smithi046.stdout:7/766: write f9 [3176624,730] 0 2024-04-26T12:28:49.082 INFO:tasks.workunit.client.0.smithi046.stdout:3/748: dread - d2/d16/d35/dbc/dc9/dd0/fb6 zero size 2024-04-26T12:28:49.085 INFO:tasks.workunit.client.0.smithi046.stdout:7/767: write d16/d27/d51/d9c/fbc [969848,56569] 0 2024-04-26T12:28:49.086 INFO:tasks.workunit.client.0.smithi046.stdout:4/685: dwrite d0/d1/f42 [4194304,4194304] 0 2024-04-26T12:28:49.086 INFO:tasks.workunit.client.0.smithi046.stdout:8/802: dwrite d7/da/df/f65 [0,4194304] 0 2024-04-26T12:28:49.086 INFO:tasks.workunit.client.0.smithi046.stdout:4/686: symlink d0/da/d70/dc7/le6 0 2024-04-26T12:28:49.087 INFO:tasks.workunit.client.0.smithi046.stdout:4/687: dread - d0/da/d70/fd5 zero size 2024-04-26T12:28:49.091 INFO:tasks.workunit.client.0.smithi046.stdout:8/803: dwrite d7/d24/d50/d2a/f4b [0,4194304] 0 2024-04-26T12:28:49.092 INFO:tasks.workunit.client.0.smithi046.stdout:6/710: dwrite d7/d1b/fcb [0,4194304] 0 2024-04-26T12:28:49.092 INFO:tasks.workunit.client.0.smithi046.stdout:9/624: sync 2024-04-26T12:28:49.092 INFO:tasks.workunit.client.0.smithi046.stdout:8/804: fdatasync d7/d1c/d74/df4/f13 0 2024-04-26T12:28:49.093 INFO:tasks.workunit.client.0.smithi046.stdout:8/805: readlink d7/d24/l26 0 2024-04-26T12:28:49.093 INFO:tasks.workunit.client.0.smithi046.stdout:4/688: read d0/da/d17/d20/d25/d35/d6d/d19/d55/dae/fc2 [10493,73730] 0 2024-04-26T12:28:49.094 INFO:tasks.workunit.client.0.smithi046.stdout:4/689: stat d0/d41 0 2024-04-26T12:28:49.095 INFO:tasks.workunit.client.0.smithi046.stdout:9/625: creat d0/d2c/dda/fdc x:0 0 0 2024-04-26T12:28:49.096 INFO:tasks.workunit.client.0.smithi046.stdout:6/711: dwrite d7/d1b/f4b [0,4194304] 0 2024-04-26T12:28:49.097 INFO:tasks.workunit.client.0.smithi046.stdout:9/626: creat d0/d29/d69/fdd x:0 0 0 2024-04-26T12:28:49.097 INFO:tasks.workunit.client.0.smithi046.stdout:4/690: write d0/da/d17/d20/d25/d35/d6d/d19/d53/f62 [954936,79284] 0 2024-04-26T12:28:49.101 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:49.101 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:49.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.101 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4519.0:14073 4.2c 4:355d4ede:::100000032c2.00000001:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T12:28:49.101 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:49.084709+0000", 2024-04-26T12:28:49.101 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.015850395999999999, 2024-04-26T12:28:49.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015877516000000001, 2024-04-26T12:28:49.101 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.101 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:49.101 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-26T12:28:49.101 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4519", 2024-04-26T12:28:49.101 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:49.102 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 14073 2024-04-26T12:28:49.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.102 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.084709+0000", 2024-04-26T12:28:49.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.084709+0000", 2024-04-26T12:28:49.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.084708+0000", 2024-04-26T12:28:49.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:49.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.093875+0000", 2024-04-26T12:28:49.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.009167438 2024-04-26T12:28:49.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.093891+0000", 2024-04-26T12:28:49.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5939000000000001e-05 2024-04-26T12:28:49.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.093905+0000", 2024-04-26T12:28:49.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.359e-05 2024-04-26T12:28:49.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.093959+0000", 2024-04-26T12:28:49.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.4462999999999997e-05 2024-04-26T12:28:49.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.094069+0000", 2024-04-26T12:28:49.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000109635 2024-04-26T12:28:49.105 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.105 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.106 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.106 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4519.0:14074 4.3a e54/46 4:5eedc3b3:::100000033ce.00000000:head v 54'187, mlcod=54'185)", 2024-04-26T12:28:49.106 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:49.093358+0000", 2024-04-26T12:28:49.106 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0072010429999999999, 2024-04-26T12:28:49.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0072776749999999999, 2024-04-26T12:28:49.106 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.106 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-26T12:28:49.106 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.093358+0000", 2024-04-26T12:28:49.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.093358+0000", 2024-04-26T12:28:49.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.093358+0000", 2024-04-26T12:28:49.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.097610+0000", 2024-04-26T12:28:49.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0042523170000000002 2024-04-26T12:28:49.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.097620+0000", 2024-04-26T12:28:49.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.8409999999999995e-06 2024-04-26T12:28:49.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.097626+0000", 2024-04-26T12:28:49.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4110000000000001e-06 2024-04-26T12:28:49.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.097672+0000", 2024-04-26T12:28:49.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5627999999999997e-05 2024-04-26T12:28:49.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:49.097698+0000", 2024-04-26T12:28:49.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.616e-05 2024-04-26T12:28:49.110 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.110 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.111 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.111 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.111 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-04-26T12:28:49.111 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 2 2024-04-26T12:28:49.111 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:49.112 INFO:tasks.workunit.client.0.smithi046.stdout:9/627: dread d0/d2c/d3d/d52/f8f [0,4194304] 0 2024-04-26T12:28:49.113 INFO:tasks.workunit.client.0.smithi046.stdout:9/628: chown d0/d29/f3b 1189 1 2024-04-26T12:28:49.113 INFO:tasks.workunit.client.0.smithi046.stdout:8/806: read d7/d24/d50/f2c [1422252,117030] 0 2024-04-26T12:28:49.113 INFO:tasks.workunit.client.0.smithi046.stdout:6/712: dwrite d7/f15 [4194304,4194304] 0 2024-04-26T12:28:49.113 INFO:tasks.workunit.client.0.smithi046.stdout:7/768: dread d16/d1a/d31/d55/d6d/fcc [0,4194304] 0 2024-04-26T12:28:49.113 INFO:tasks.workunit.client.0.smithi046.stdout:8/807: creat d7/d1c/d74/df4/d27/f103 x:0 0 0 2024-04-26T12:28:49.113 INFO:tasks.workunit.client.0.smithi046.stdout:4/691: dwrite d0/da/d17/d20/f69 [0,4194304] 0 2024-04-26T12:28:49.113 INFO:tasks.workunit.client.0.smithi046.stdout:9/629: rename d0/d2c/dda/d76/fa2 to d0/d29/daf/fde 0 2024-04-26T12:28:49.113 INFO:tasks.workunit.client.0.smithi046.stdout:6/713: symlink d7/d1b/d47/d65/da3/le4 0 2024-04-26T12:28:49.113 INFO:tasks.workunit.client.0.smithi046.stdout:8/808: rename d7/d1c/d74/df4/d1b/da0 to d7/da/df/d104 0 2024-04-26T12:28:49.113 INFO:tasks.workunit.client.0.smithi046.stdout:4/692: write d0/da/d17/d20/d25/d35/d6d/f23 [3886984,29207] 0 2024-04-26T12:28:49.113 INFO:tasks.workunit.client.0.smithi046.stdout:6/714: write d7/d1b/d47/d65/da3/dbe/fc0 [1198396,71150] 0 2024-04-26T12:28:49.113 INFO:tasks.workunit.client.0.smithi046.stdout:4/693: stat d0/c80 0 2024-04-26T12:28:49.113 INFO:tasks.workunit.client.0.smithi046.stdout:6/715: fsync d7/d16/dbc/fe1 0 2024-04-26T12:28:49.114 INFO:tasks.workunit.client.0.smithi046.stdout:4/694: creat d0/d1/d5/db/fe7 x:0 0 0 2024-04-26T12:28:49.114 INFO:tasks.workunit.client.0.smithi046.stdout:9/630: dwrite d0/d19/f8c [0,4194304] 0 2024-04-26T12:28:49.115 INFO:tasks.workunit.client.0.smithi046.stdout:9/631: rename d0/d2c/dda/f60 to d0/d2c/dda/d76/d7d/d72/d85/fdf 0 2024-04-26T12:28:49.115 INFO:tasks.workunit.client.0.smithi046.stdout:8/809: truncate d7/d24/d50/d2a/fd2 1003936 0 2024-04-26T12:28:49.115 INFO:tasks.workunit.client.0.smithi046.stdout:9/632: creat d0/d19/d51/dac/fe0 x:0 0 0 2024-04-26T12:28:49.115 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:49.116 INFO:tasks.workunit.client.0.smithi046.stdout:9/633: rename d0/d29/f37 to d0/d2c/dda/d76/d7d/d72/d85/d97/fe1 0 2024-04-26T12:28:49.117 INFO:tasks.workunit.client.0.smithi046.stdout:4/695: dwrite d0/da/d17/d20/d25/d35/d6d/d19/f1a [0,4194304] 0 2024-04-26T12:28:49.118 INFO:tasks.workunit.client.0.smithi046.stdout:8/810: truncate d7/d1c/d74/df4/d1b/fd7 887501 0 2024-04-26T12:28:49.119 INFO:tasks.workunit.client.0.smithi046.stdout:3/749: dread d2/db/d4a/f40 [4194304,4194304] 0 2024-04-26T12:28:49.119 INFO:tasks.workunit.client.0.smithi046.stdout:8/811: symlink d7/l105 0 2024-04-26T12:28:49.120 INFO:tasks.workunit.client.0.smithi046.stdout:3/750: creat d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d/f10a x:0 0 0 2024-04-26T12:28:49.120 INFO:tasks.workunit.client.0.smithi046.stdout:8/812: symlink d7/da/d4f/d7f/l106 0 2024-04-26T12:28:49.120 INFO:tasks.workunit.client.0.smithi046.stdout:4/696: dread d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/f72 [0,4194304] 0 2024-04-26T12:28:49.121 INFO:tasks.workunit.client.0.smithi046.stdout:8/813: truncate d7/da/df/f8d 402656 0 2024-04-26T12:28:49.123 INFO:tasks.workunit.client.0.smithi046.stdout:8/814: rename d7/d24/d50/d2a/d39/l97 to d7/da/df/d104/l107 0 2024-04-26T12:28:49.125 INFO:tasks.workunit.client.0.smithi046.stdout:4/697: dwrite d0/da/fda [0,4194304] 0 2024-04-26T12:28:49.126 INFO:tasks.workunit.client.0.smithi046.stdout:3/751: dread d2/db/d4a/f86 [0,4194304] 0 2024-04-26T12:28:49.127 INFO:tasks.workunit.client.0.smithi046.stdout:4/698: dread - d0/da/d17/d20/fb6 zero size 2024-04-26T12:28:49.127 INFO:tasks.workunit.client.0.smithi046.stdout:1/668: dread d7/db/d98/dc5/d2b/d39/d5c/f8e [0,4194304] 0 2024-04-26T12:28:49.127 INFO:tasks.workunit.client.0.smithi046.stdout:4/699: mknod d0/d64/ce8 0 2024-04-26T12:28:49.128 INFO:tasks.workunit.client.0.smithi046.stdout:4/700: fdatasync d0/da/d17/d20/d25/d35/f5d 0 2024-04-26T12:28:49.128 INFO:tasks.workunit.client.0.smithi046.stdout:1/669: truncate d7/db/d98/dc5/d2b/f6a 574534 0 2024-04-26T12:28:49.129 INFO:tasks.workunit.client.0.smithi046.stdout:1/670: readlink d7/db/d98/dc5/l7f 0 2024-04-26T12:28:49.130 INFO:tasks.workunit.client.0.smithi046.stdout:4/701: mknod d0/da/da1/ce9 0 2024-04-26T12:28:49.130 INFO:tasks.workunit.client.0.smithi046.stdout:1/671: read d7/d14/d5d/f7d [3789,94050] 0 2024-04-26T12:28:49.132 INFO:tasks.workunit.client.0.smithi046.stdout:1/672: rename d7/db/d98/dc5/d2b/d9f/ce1 to d7/db/d98/dc5/d2b/d39/ceb 0 2024-04-26T12:28:49.132 INFO:tasks.workunit.client.0.smithi046.stdout:1/673: rmdir d7/d14/de8 0 2024-04-26T12:28:49.133 INFO:tasks.workunit.client.0.smithi046.stdout:8/815: dread d7/d1c/d74/df4/fe3 [0,4194304] 0 2024-04-26T12:28:49.134 INFO:tasks.workunit.client.0.smithi046.stdout:5/819: sync 2024-04-26T12:28:49.134 INFO:tasks.workunit.client.0.smithi046.stdout:2/710: sync 2024-04-26T12:28:49.134 INFO:tasks.workunit.client.0.smithi046.stdout:0/788: sync 2024-04-26T12:28:49.134 INFO:tasks.workunit.client.0.smithi046.stdout:1/674: truncate d7/d14/d5d/d32/fbb 124748 0 2024-04-26T12:28:49.135 INFO:tasks.workunit.client.0.smithi046.stdout:8/816: fsync d7/d24/d50/f2c 0 2024-04-26T12:28:49.136 INFO:tasks.workunit.client.0.smithi046.stdout:5/820: unlink d9/da/d15/f75 0 2024-04-26T12:28:49.136 INFO:tasks.workunit.client.0.smithi046.stdout:8/817: chown d7/d1c/fde 447696071 1 2024-04-26T12:28:49.136 INFO:tasks.workunit.client.0.smithi046.stdout:1/675: chown d7/d14/d5d/d32/d41/d8f/dd3/de5 9980592 1 2024-04-26T12:28:49.136 INFO:tasks.workunit.client.0.smithi046.stdout:0/789: creat d9/dc/f112 x:0 0 0 2024-04-26T12:28:49.136 INFO:tasks.workunit.client.0.smithi046.stdout:1/676: rmdir d7 39 2024-04-26T12:28:49.136 INFO:tasks.workunit.client.0.smithi046.stdout:5/821: symlink d9/da/dd/l117 0 2024-04-26T12:28:49.136 INFO:tasks.workunit.client.0.smithi046.stdout:8/818: chown d7/da/d88/cbb 6 1 2024-04-26T12:28:49.137 INFO:tasks.workunit.client.0.smithi046.stdout:1/677: creat d7/db/d98/fec x:0 0 0 2024-04-26T12:28:49.137 INFO:tasks.workunit.client.0.smithi046.stdout:0/790: read d9/f12 [1622186,95088] 0 2024-04-26T12:28:49.138 INFO:tasks.workunit.client.0.smithi046.stdout:8/819: rename d7/d24/d50/d2a/fdf to d7/d1c/d74/df4/f108 0 2024-04-26T12:28:49.139 INFO:tasks.workunit.client.0.smithi046.stdout:0/791: truncate d9/dc/f37 346717 0 2024-04-26T12:28:49.140 INFO:tasks.workunit.client.0.smithi046.stdout:2/711: dwrite d1/de/d65/d4a/d58/f5c [0,4194304] 0 2024-04-26T12:28:49.141 INFO:tasks.workunit.client.0.smithi046.stdout:0/792: symlink d9/d1d/d40/d41/d7e/da5/l113 0 2024-04-26T12:28:49.141 INFO:tasks.workunit.client.0.smithi046.stdout:2/712: creat d1/de/d15/d18/d98/ff6 x:0 0 0 2024-04-26T12:28:49.142 INFO:tasks.workunit.client.0.smithi046.stdout:8/820: getdents d7/d1c/d74/df4/d27 0 2024-04-26T12:28:49.143 INFO:tasks.workunit.client.0.smithi046.stdout:5/822: dwrite d9/da/dd/dd7/db0/db6/feb [0,4194304] 0 2024-04-26T12:28:49.143 INFO:tasks.workunit.client.0.smithi046.stdout:2/713: mknod d1/de/d65/d4a/d58/cf7 0 2024-04-26T12:28:49.144 INFO:tasks.workunit.client.0.smithi046.stdout:8/821: creat d7/da/df/d104/db6/dda/de2/f109 x:0 0 0 2024-04-26T12:28:49.145 INFO:tasks.workunit.client.0.smithi046.stdout:2/714: rename d1/de/d15/d18/c6f to d1/de/da4/cf8 0 2024-04-26T12:28:49.145 INFO:tasks.workunit.client.0.smithi046.stdout:7/769: dread f9 [0,4194304] 0 2024-04-26T12:28:49.145 INFO:tasks.workunit.client.0.smithi046.stdout:5/823: write d9/da/d18/d8b/fc5 [2696076,121285] 0 2024-04-26T12:28:49.146 INFO:tasks.workunit.client.0.smithi046.stdout:8/822: write d7/d1c/d74/df4/f17 [5073368,7641] 0 2024-04-26T12:28:49.147 INFO:tasks.workunit.client.0.smithi046.stdout:7/770: write d16/d4e/d6c/fdd [463743,81078] 0 2024-04-26T12:28:49.147 INFO:tasks.workunit.client.0.smithi046.stdout:5/824: chown d9/da/d15/f26 452494902 1 2024-04-26T12:28:49.147 INFO:tasks.workunit.client.0.smithi046.stdout:2/715: creat d1/de/d67/dc4/ff9 x:0 0 0 2024-04-26T12:28:49.147 INFO:tasks.workunit.client.0.smithi046.stdout:0/793: dwrite d9/dc/f1c [4194304,4194304] 0 2024-04-26T12:28:49.148 INFO:tasks.workunit.client.0.smithi046.stdout:5/825: fsync d9/da/dd/d5d/f6e 0 2024-04-26T12:28:49.149 INFO:tasks.workunit.client.0.smithi046.stdout:0/794: chown d9/d1d/d40/c87 525 1 2024-04-26T12:28:49.149 INFO:tasks.workunit.client.0.smithi046.stdout:1/678: truncate d7/d14/d5d/d32/d41/f93 558479 0 2024-04-26T12:28:49.149 INFO:tasks.workunit.client.0.smithi046.stdout:8/823: link d7/d24/c46 d7/da/d4f/d7f/dfb/c10a 0 2024-04-26T12:28:49.150 INFO:tasks.workunit.client.0.smithi046.stdout:5/826: truncate d9/da/fe3 189097 0 2024-04-26T12:28:49.151 INFO:tasks.workunit.client.0.smithi046.stdout:1/679: rmdir d7/db/d98/dc5/d2b 39 2024-04-26T12:28:49.152 INFO:tasks.workunit.client.0.smithi046.stdout:5/827: unlink d9/da/d18/f77 0 2024-04-26T12:28:49.152 INFO:tasks.workunit.client.0.smithi046.stdout:8/824: mkdir d7/d1c/d74/df4/d1b/dae/dcf/d10b 0 2024-04-26T12:28:49.152 INFO:tasks.workunit.client.0.smithi046.stdout:1/680: mkdir d7/d14/d5d/d32/d41/ded 0 2024-04-26T12:28:49.153 INFO:tasks.workunit.client.0.smithi046.stdout:2/716: dread d1/de/d65/f5d [0,4194304] 0 2024-04-26T12:28:49.153 INFO:tasks.workunit.client.0.smithi046.stdout:5/828: fsync d9/da/f10 0 2024-04-26T12:28:49.153 INFO:tasks.workunit.client.0.smithi046.stdout:9/634: dread d0/f10 [0,4194304] 0 2024-04-26T12:28:49.153 INFO:tasks.workunit.client.0.smithi046.stdout:8/825: mkdir d7/d24/d50/d2a/d39/d10c 0 2024-04-26T12:28:49.154 INFO:tasks.workunit.client.0.smithi046.stdout:2/717: symlink d1/de/d65/d8f/lfa 0 2024-04-26T12:28:49.155 INFO:tasks.workunit.client.0.smithi046.stdout:6/716: sync 2024-04-26T12:28:49.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/752: sync 2024-04-26T12:28:49.156 INFO:tasks.workunit.client.0.smithi046.stdout:7/771: dwrite d16/d1a/d3e/f44 [0,4194304] 0 2024-04-26T12:28:49.156 INFO:tasks.workunit.client.0.smithi046.stdout:4/702: sync 2024-04-26T12:28:49.156 INFO:tasks.workunit.client.0.smithi046.stdout:5/829: symlink d9/da/dd/d34/d44/d88/d90/l118 0 2024-04-26T12:28:49.157 INFO:tasks.workunit.client.0.smithi046.stdout:2/718: mknod d1/df2/cfb 0 2024-04-26T12:28:49.157 INFO:tasks.workunit.client.0.smithi046.stdout:3/753: rmdir d2/db 39 2024-04-26T12:28:49.158 INFO:tasks.workunit.client.0.smithi046.stdout:7/772: mkdir d16/d1a/d31/d5a/d93/dd9/df9 0 2024-04-26T12:28:49.158 INFO:tasks.workunit.client.0.smithi046.stdout:5/830: mkdir d9/da/dd/dd7/db0/de0/d119 0 2024-04-26T12:28:49.159 INFO:tasks.workunit.client.0.smithi046.stdout:3/754: rmdir d2/d16/d2c/d50/d71/d89/dc5/d6d 39 2024-04-26T12:28:49.160 INFO:tasks.workunit.client.0.smithi046.stdout:7/773: creat d16/d1a/ffa x:0 0 0 2024-04-26T12:28:49.161 INFO:tasks.workunit.client.0.smithi046.stdout:5/831: fdatasync d9/da/d18/d8b/f96 0 2024-04-26T12:28:49.161 INFO:tasks.workunit.client.0.smithi046.stdout:9/635: dwrite d0/d2c/d3d/fb8 [0,4194304] 0 2024-04-26T12:28:49.163 INFO:tasks.workunit.client.0.smithi046.stdout:1/681: dwrite d7/db/d98/dc5/d2b/d39/db3/d79/fcd [0,4194304] 0 2024-04-26T12:28:49.164 INFO:tasks.workunit.client.0.smithi046.stdout:8/826: fsync d7/d1c/d74/df4/d1b/d7d/fea 0 2024-04-26T12:28:49.165 INFO:tasks.workunit.client.0.smithi046.stdout:6/717: dwrite d7/d1b/d6a/f93 [0,4194304] 0 2024-04-26T12:28:49.165 INFO:tasks.workunit.client.0.smithi046.stdout:1/682: mkdir d7/db/dee 0 2024-04-26T12:28:49.168 INFO:tasks.workunit.client.0.smithi046.stdout:2/719: dwrite d1/de/d15/d18/f9b [0,4194304] 0 2024-04-26T12:28:49.169 INFO:tasks.workunit.client.0.smithi046.stdout:7/774: dread d16/d3f/d81/fc1 [0,4194304] 0 2024-04-26T12:28:49.171 INFO:tasks.workunit.client.0.smithi046.stdout:0/795: dwrite d9/d1d/d40/f6e [0,4194304] 0 2024-04-26T12:28:49.171 INFO:tasks.workunit.client.0.smithi046.stdout:6/718: unlink d7/d1b/d37/daa/lcd 0 2024-04-26T12:28:49.171 INFO:tasks.workunit.client.0.smithi046.stdout:7/775: rmdir d16/d27/d51/d9c 39 2024-04-26T12:28:49.172 INFO:tasks.workunit.client.0.smithi046.stdout:8/827: link d7/da/fa7 d7/da/df/d104/f10d 0 2024-04-26T12:28:49.172 INFO:tasks.workunit.client.0.smithi046.stdout:9/636: symlink d0/d2c/dda/d76/d7d/d72/da1/dc8/d9b/le2 0 2024-04-26T12:28:49.172 INFO:tasks.workunit.client.0.smithi046.stdout:6/719: mkdir d7/d1b/d47/d65/da3/de5 0 2024-04-26T12:28:49.174 INFO:tasks.workunit.client.0.smithi046.stdout:6/720: fdatasync d7/d2b/d31/fc4 0 2024-04-26T12:28:49.174 INFO:tasks.workunit.client.0.smithi046.stdout:3/755: dwrite d2/d16/d35/f4e [0,4194304] 0 2024-04-26T12:28:49.174 INFO:tasks.workunit.client.0.smithi046.stdout:9/637: write d0/d2c/dda/d76/d7d/fad [5375642,57212] 0 2024-04-26T12:28:49.175 INFO:tasks.workunit.client.0.smithi046.stdout:8/828: mknod d7/d1c/d74/df4/d1b/d7d/dc1/dfd/c10e 0 2024-04-26T12:28:49.176 INFO:tasks.workunit.client.0.smithi046.stdout:6/721: link d7/d1b/d6a/d57/f5c d7/d1b/d37/fe6 0 2024-04-26T12:28:49.176 INFO:tasks.workunit.client.0.smithi046.stdout:8/829: mkdir d7/d24/d50/d2a/d39/da6/d10f 0 2024-04-26T12:28:49.177 INFO:tasks.workunit.client.0.smithi046.stdout:9/638: mknod d0/d2c/dda/d76/d7d/d72/ce3 0 2024-04-26T12:28:49.177 INFO:tasks.workunit.client.0.smithi046.stdout:3/756: symlink d2/db/d4a/df0/l10b 0 2024-04-26T12:28:49.178 INFO:tasks.workunit.client.0.smithi046.stdout:6/722: mkdir d7/d1b/d37/daa/de7 0 2024-04-26T12:28:49.180 INFO:tasks.workunit.client.0.smithi046.stdout:1/683: truncate d7/db/d98/dc5/d2b/d96/fa6 1661510 0 2024-04-26T12:28:49.180 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:49.179+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:49.181 INFO:tasks.workunit.client.0.smithi046.stdout:7/776: dwrite f6 [0,4194304] 0 2024-04-26T12:28:49.182 INFO:tasks.workunit.client.0.smithi046.stdout:4/703: sync 2024-04-26T12:28:49.182 INFO:tasks.workunit.client.0.smithi046.stdout:3/757: dread d2/db/d4a/f91 [0,4194304] 0 2024-04-26T12:28:49.182 INFO:tasks.workunit.client.0.smithi046.stdout:2/720: sync 2024-04-26T12:28:49.183 INFO:tasks.workunit.client.0.smithi046.stdout:6/723: creat d7/fe8 x:0 0 0 2024-04-26T12:28:49.184 INFO:tasks.workunit.client.0.smithi046.stdout:1/684: write d7/db/d98/dc5/f18 [721089,92907] 0 2024-04-26T12:28:49.184 INFO:tasks.workunit.client.0.smithi046.stdout:9/639: link d0/d2c/dda/d76/d7d/fb0 d0/d29/daf/fe4 0 2024-04-26T12:28:49.184 INFO:tasks.workunit.client.0.smithi046.stdout:2/721: dread - d1/de/db1/fb2 zero size 2024-04-26T12:28:49.185 INFO:tasks.workunit.client.0.smithi046.stdout:1/685: fsync d7/db/d98/fe2 0 2024-04-26T12:28:49.185 INFO:tasks.workunit.client.0.smithi046.stdout:6/724: fdatasync d7/d1b/d47/d65/d77/d92/fc3 0 2024-04-26T12:28:49.185 INFO:tasks.workunit.client.0.smithi046.stdout:3/758: rename d2/d16/f78 to d2/d16/d35/dbc/f10c 0 2024-04-26T12:28:49.186 INFO:tasks.workunit.client.0.smithi046.stdout:9/640: creat d0/d19/d51/dac/fe5 x:0 0 0 2024-04-26T12:28:49.186 INFO:tasks.workunit.client.0.smithi046.stdout:2/722: chown d1/de/d67/dc4/ff9 1 1 2024-04-26T12:28:49.187 INFO:tasks.workunit.client.0.smithi046.stdout:8/830: dwrite d7/d24/d50/d2a/f4b [0,4194304] 0 2024-04-26T12:28:49.187 INFO:tasks.workunit.client.0.smithi046.stdout:7/777: truncate d16/d1a/d31/d5a/f2a 3401374 0 2024-04-26T12:28:49.187 INFO:tasks.workunit.client.0.smithi046.stdout:0/796: dwrite d9/d1d/d40/d41/d7e/d9d/fe7 [0,4194304] 0 2024-04-26T12:28:49.188 INFO:tasks.workunit.client.0.smithi046.stdout:8/831: fdatasync d7/d1c/fde 0 2024-04-26T12:28:49.188 INFO:tasks.workunit.client.0.smithi046.stdout:3/759: write d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d/f10a [513238,44929] 0 2024-04-26T12:28:49.189 INFO:tasks.workunit.client.0.smithi046.stdout:1/686: write d7/db/d98/dc5/f58 [519603,51874] 0 2024-04-26T12:28:49.189 INFO:tasks.workunit.client.0.smithi046.stdout:4/704: link d0/d1/d5/db/fe7 d0/da/d17/d20/d25/d35/d61/fea 0 2024-04-26T12:28:49.191 INFO:tasks.workunit.client.0.smithi046.stdout:7/778: mknod d16/d1a/d69/cfb 0 2024-04-26T12:28:49.191 INFO:tasks.workunit.client.0.smithi046.stdout:9/641: truncate d0/d29/d69/f70 4597143 0 2024-04-26T12:28:49.191 INFO:tasks.workunit.client.0.smithi046.stdout:4/705: chown d0/da/d17/c1c 166821 1 2024-04-26T12:28:49.191 INFO:tasks.workunit.client.0.smithi046.stdout:7/779: readlink d16/d27/l75 0 2024-04-26T12:28:49.192 INFO:tasks.workunit.client.0.smithi046.stdout:8/832: creat d7/d1c/d74/f110 x:0 0 0 2024-04-26T12:28:49.192 INFO:tasks.workunit.client.0.smithi046.stdout:3/760: rename d2/f7 to d2/d16/d2c/d50/d71/df6/f10d 0 2024-04-26T12:28:49.192 INFO:tasks.workunit.client.0.smithi046.stdout:1/687: truncate d7/db/f8c 1736113 0 2024-04-26T12:28:49.193 INFO:tasks.workunit.client.0.smithi046.stdout:1/688: fsync d7/d12/f21 0 2024-04-26T12:28:49.193 INFO:tasks.workunit.client.0.smithi046.stdout:0/797: rmdir d9/dc/dd/dd2/de2/def 0 2024-04-26T12:28:49.193 INFO:tasks.workunit.client.0.smithi046.stdout:8/833: unlink d7/d1c/fde 0 2024-04-26T12:28:49.193 INFO:tasks.workunit.client.0.smithi046.stdout:7/780: creat d16/d1a/d31/ffc x:0 0 0 2024-04-26T12:28:49.193 INFO:tasks.workunit.client.0.smithi046.stdout:2/723: dwrite d1/de/d65/d4a/f82 [0,4194304] 0 2024-04-26T12:28:49.194 INFO:tasks.workunit.client.0.smithi046.stdout:3/761: chown d2/d16/d2c/d50/d71/d89 9 1 2024-04-26T12:28:49.195 INFO:tasks.workunit.client.0.smithi046.stdout:1/689: symlink d7/d14/lef 0 2024-04-26T12:28:49.196 INFO:tasks.workunit.client.0.smithi046.stdout:2/724: mknod d1/de/db1/cfc 0 2024-04-26T12:28:49.196 INFO:tasks.workunit.client.0.smithi046.stdout:7/781: creat d16/db1/ffd x:0 0 0 2024-04-26T12:28:49.197 INFO:tasks.workunit.client.0.smithi046.stdout:8/834: truncate d7/d1c/d74/df4/d27/f103 262242 0 2024-04-26T12:28:49.197 INFO:tasks.workunit.client.0.smithi046.stdout:2/725: mkdir d1/d71/dfd 0 2024-04-26T12:28:49.197 INFO:tasks.workunit.client.0.smithi046.stdout:1/690: read - d7/db/d98/dc5/d2b/d39/f61 zero size 2024-04-26T12:28:49.198 INFO:tasks.workunit.client.0.smithi046.stdout:7/782: creat d16/d3f/d81/ffe x:0 0 0 2024-04-26T12:28:49.199 INFO:tasks.workunit.client.0.smithi046.stdout:1/691: rmdir d7/d14/d5d/d32/d5f 39 2024-04-26T12:28:49.199 INFO:tasks.workunit.client.0.smithi046.stdout:2/726: getdents d1/de/d67 0 2024-04-26T12:28:49.200 INFO:tasks.workunit.client.0.smithi046.stdout:9/642: dwrite d0/d2c/dda/d76/d7d/d72/d85/fdf [0,4194304] 0 2024-04-26T12:28:49.201 INFO:tasks.workunit.client.0.smithi046.stdout:1/692: chown d7/d12/f99 316 1 2024-04-26T12:28:49.201 INFO:tasks.workunit.client.0.smithi046.stdout:3/762: dwrite d2/d16/d2c/d50/f90 [0,4194304] 0 2024-04-26T12:28:49.201 INFO:tasks.workunit.client.0.smithi046.stdout:0/798: rmdir d9 39 2024-04-26T12:28:49.202 INFO:tasks.workunit.client.0.smithi046.stdout:3/763: stat d2/d16/l1a 0 2024-04-26T12:28:49.202 INFO:tasks.workunit.client.0.smithi046.stdout:3/764: stat d2/d16/d2c/d50/ffc 0 2024-04-26T12:28:49.203 INFO:tasks.workunit.client.0.smithi046.stdout:9/643: unlink d0/d2c/d47/l78 0 2024-04-26T12:28:49.204 INFO:tasks.workunit.client.0.smithi046.stdout:8/835: truncate d7/d24/d50/d2a/f4b 2222281 0 2024-04-26T12:28:49.204 INFO:tasks.workunit.client.0.smithi046.stdout:7/783: getdents d16/d4e 0 2024-04-26T12:28:49.204 INFO:tasks.workunit.client.0.smithi046.stdout:3/765: write d2/d16/d35/f4e [1720815,6532] 0 2024-04-26T12:28:49.205 INFO:tasks.workunit.client.0.smithi046.stdout:9/644: chown d0/d2c/d47/f23 51365 1 2024-04-26T12:28:49.205 INFO:tasks.workunit.client.0.smithi046.stdout:5/832: dread d9/da/dd/d34/d45/f95 [0,4194304] 0 2024-04-26T12:28:49.206 INFO:tasks.workunit.client.0.smithi046.stdout:8/836: write d7/da/df/f8d [395257,100391] 0 2024-04-26T12:28:49.206 INFO:tasks.workunit.client.0.smithi046.stdout:9/645: symlink d0/d2c/dbe/le6 0 2024-04-26T12:28:49.207 INFO:tasks.workunit.client.0.smithi046.stdout:2/727: write d1/de/d15/d18/dc1/db6/dda/f3b [294833,32661] 0 2024-04-26T12:28:49.207 INFO:tasks.workunit.client.0.smithi046.stdout:5/833: mkdir d9/da/d40/dfa/d11a 0 2024-04-26T12:28:49.209 INFO:tasks.workunit.client.0.smithi046.stdout:8/837: mknod d7/d1c/d74/df4/d27/db0/c111 0 2024-04-26T12:28:49.209 INFO:tasks.workunit.client.0.smithi046.stdout:5/834: creat d9/da/dd/d34/d45/f11b x:0 0 0 2024-04-26T12:28:49.209 INFO:tasks.workunit.client.0.smithi046.stdout:0/799: dwrite d9/d1d/d40/d41/f6a [0,4194304] 0 2024-04-26T12:28:49.210 INFO:tasks.workunit.client.0.smithi046.stdout:1/693: truncate d7/d12/f60 193063 0 2024-04-26T12:28:49.210 INFO:tasks.workunit.client.0.smithi046.stdout:0/800: unlink d9/dc/dd/l18 0 2024-04-26T12:28:49.211 INFO:tasks.workunit.client.0.smithi046.stdout:5/835: mknod d9/da/dd/d34/d45/c11c 0 2024-04-26T12:28:49.211 INFO:tasks.workunit.client.0.smithi046.stdout:3/766: read d2/d16/d2c/d50/d71/d89/dc5/d82/ffb [219243,103113] 0 2024-04-26T12:28:49.212 INFO:tasks.workunit.client.0.smithi046.stdout:8/838: creat d7/d1c/d74/df4/d1b/dae/dcf/d10b/f112 x:0 0 0 2024-04-26T12:28:49.213 INFO:tasks.workunit.client.0.smithi046.stdout:5/836: chown d9/da/dd/d34/d44/fcd 426501942 1 2024-04-26T12:28:49.213 INFO:tasks.workunit.client.0.smithi046.stdout:0/801: symlink d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d108/l114 0 2024-04-26T12:28:49.214 INFO:tasks.workunit.client.0.smithi046.stdout:9/646: dwrite d0/d29/fd6 [0,4194304] 0 2024-04-26T12:28:49.214 INFO:tasks.workunit.client.0.smithi046.stdout:1/694: getdents d7/db/d98/dc5 0 2024-04-26T12:28:49.214 INFO:tasks.workunit.client.0.smithi046.stdout:8/839: link d7/d1c/c4c d7/d24/d50/db3/c113 0 2024-04-26T12:28:49.216 INFO:tasks.workunit.client.0.smithi046.stdout:9/647: mknod d0/d2c/dbd/ce7 0 2024-04-26T12:28:49.216 INFO:tasks.workunit.client.0.smithi046.stdout:0/802: readlink d9/d1d/d40/d41/dc0/db2/ldc 0 2024-04-26T12:28:49.216 INFO:tasks.workunit.client.0.smithi046.stdout:5/837: rename d9/da/d18/d7d/lea to d9/da/dd/dd7/db0/db6/l11d 0 2024-04-26T12:28:49.217 INFO:tasks.workunit.client.0.smithi046.stdout:2/728: dwrite d1/de/d15/d18/dc1/db6/dda/d78/fcc [0,4194304] 0 2024-04-26T12:28:49.217 INFO:tasks.workunit.client.0.smithi046.stdout:8/840: mknod d7/d1c/d74/df4/d27/db0/c114 0 2024-04-26T12:28:49.217 INFO:tasks.workunit.client.0.smithi046.stdout:1/695: mknod d7/d14/d5d/d6b/dc2/d76/cf0 0 2024-04-26T12:28:49.218 INFO:tasks.workunit.client.0.smithi046.stdout:9/648: chown d0/d2c/f4e 7167 1 2024-04-26T12:28:49.218 INFO:tasks.workunit.client.0.smithi046.stdout:3/767: write d2/db/f2b [1787756,84544] 0 2024-04-26T12:28:49.219 INFO:tasks.workunit.client.0.smithi046.stdout:9/649: unlink d0/d29/c92 0 2024-04-26T12:28:49.219 INFO:tasks.workunit.client.0.smithi046.stdout:1/696: chown d7/db/d98/dc5/d2b/d39/d3c/cdf 4 1 2024-04-26T12:28:49.219 INFO:tasks.workunit.client.0.smithi046.stdout:2/729: write d1/d42/f60 [811902,70138] 0 2024-04-26T12:28:49.221 INFO:tasks.workunit.client.0.smithi046.stdout:3/768: truncate d2/f107 696042 0 2024-04-26T12:28:49.221 INFO:tasks.workunit.client.0.smithi046.stdout:5/838: truncate d9/da/dd/d34/d44/d97/da4/d35/fe9 973008 0 2024-04-26T12:28:49.221 INFO:tasks.workunit.client.0.smithi046.stdout:2/730: dread - d1/de/da4/f92 zero size 2024-04-26T12:28:49.221 INFO:tasks.workunit.client.0.smithi046.stdout:2/731: read - d1/de/da4/ff5 zero size 2024-04-26T12:28:49.222 INFO:tasks.workunit.client.0.smithi046.stdout:1/697: rename d7/d14/d5d/f30 to d7/db/d98/dc5/d2b/d39/d5c/ff1 0 2024-04-26T12:28:49.222 INFO:tasks.workunit.client.0.smithi046.stdout:3/769: symlink d2/d16/d35/dbc/dc9/l10e 0 2024-04-26T12:28:49.222 INFO:tasks.workunit.client.0.smithi046.stdout:5/839: getdents d9/da/d18/d7d/d105 0 2024-04-26T12:28:49.223 INFO:tasks.workunit.client.0.smithi046.stdout:3/770: creat d2/db/d4a/df0/f10f x:0 0 0 2024-04-26T12:28:49.225 INFO:tasks.workunit.client.0.smithi046.stdout:5/840: mknod d9/da/dd/d34/d44/d97/c11e 0 2024-04-26T12:28:49.225 INFO:tasks.workunit.client.0.smithi046.stdout:2/732: link d1/de/d65/d1b/l34 d1/de/d2b/lfe 0 2024-04-26T12:28:49.226 INFO:tasks.workunit.client.0.smithi046.stdout:0/803: dwrite d9/d1d/d40/d41/d7e/da5/dad/fe4 [0,4194304] 0 2024-04-26T12:28:49.227 INFO:tasks.workunit.client.0.smithi046.stdout:2/733: chown d1/de/da4/f92 2677 1 2024-04-26T12:28:49.227 INFO:tasks.workunit.client.0.smithi046.stdout:3/771: creat d2/d16/d35/dbc/dc9/dd0/f110 x:0 0 0 2024-04-26T12:28:49.229 INFO:tasks.workunit.client.0.smithi046.stdout:7/784: dread d16/d1a/d31/d5a/d6b/fe6 [0,4194304] 0 2024-04-26T12:28:49.230 INFO:tasks.workunit.client.0.smithi046.stdout:3/772: mknod d2/d16/d2c/d50/d71/d89/d98/c111 0 2024-04-26T12:28:49.230 INFO:tasks.workunit.client.0.smithi046.stdout:1/698: dwrite d7/db/d98/dc5/d2b/f6a [0,4194304] 0 2024-04-26T12:28:49.230 INFO:tasks.workunit.client.0.smithi046.stdout:7/785: creat d16/db1/dc0/fff x:0 0 0 2024-04-26T12:28:49.231 INFO:tasks.workunit.client.0.smithi046.stdout:9/650: dread d0/d2c/d47/f1a [0,4194304] 0 2024-04-26T12:28:49.232 INFO:tasks.workunit.client.0.smithi046.stdout:0/804: creat d9/d1d/d40/d41/d7e/da5/dad/f115 x:0 0 0 2024-04-26T12:28:49.232 INFO:tasks.workunit.client.0.smithi046.stdout:5/841: dwrite f2 [0,4194304] 0 2024-04-26T12:28:49.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/651: creat d0/d2c/dda/d76/fe8 x:0 0 0 2024-04-26T12:28:49.234 INFO:tasks.workunit.client.0.smithi046.stdout:7/786: mkdir d16/d100 0 2024-04-26T12:28:49.235 INFO:tasks.workunit.client.0.smithi046.stdout:9/652: readlink d0/d2c/dda/l22 0 2024-04-26T12:28:49.237 INFO:tasks.workunit.client.0.smithi046.stdout:2/734: dwrite d1/de/f11 [0,4194304] 0 2024-04-26T12:28:49.238 INFO:tasks.workunit.client.0.smithi046.stdout:5/842: mknod d9/da/dd/d34/d44/c11f 0 2024-04-26T12:28:49.240 INFO:tasks.workunit.client.0.smithi046.stdout:2/735: symlink d1/d42/lff 0 2024-04-26T12:28:49.240 INFO:tasks.workunit.client.0.smithi046.stdout:6/725: dread d7/d1b/d6a/d57/f8d [0,4194304] 0 2024-04-26T12:28:49.240 INFO:tasks.workunit.client.0.smithi046.stdout:4/706: dread d0/da/d17/d20/d25/fe0 [0,4194304] 0 2024-04-26T12:28:49.241 INFO:tasks.workunit.client.0.smithi046.stdout:7/787: creat d16/d3f/d81/daa/dd5/f101 x:0 0 0 2024-04-26T12:28:49.241 INFO:tasks.workunit.client.0.smithi046.stdout:5/843: truncate d9/fe5 100665 0 2024-04-26T12:28:49.242 INFO:tasks.workunit.client.0.smithi046.stdout:9/653: creat d0/d2c/dda/d76/d7d/d72/da1/dc8/dcd/fe9 x:0 0 0 2024-04-26T12:28:49.242 INFO:tasks.workunit.client.0.smithi046.stdout:2/736: unlink d1/c26 0 2024-04-26T12:28:49.242 INFO:tasks.workunit.client.0.smithi046.stdout:8/841: dwrite d7/d24/d50/d2a/d39/d9d/f9f [0,4194304] 0 2024-04-26T12:28:49.243 INFO:tasks.workunit.client.0.smithi046.stdout:0/805: link d9/d1d/d40/d41/d7e/da5/faa d9/dc/dd/f116 0 2024-04-26T12:28:49.243 INFO:tasks.workunit.client.0.smithi046.stdout:4/707: mknod d0/da/d17/d20/d25/d35/de1/ceb 0 2024-04-26T12:28:49.244 INFO:tasks.workunit.client.0.smithi046.stdout:2/737: symlink d1/de/d65/d4a/d58/l100 0 2024-04-26T12:28:49.244 INFO:tasks.workunit.client.0.smithi046.stdout:9/654: mkdir d0/d2c/dda/d76/d7d/d72/d85/dea 0 2024-04-26T12:28:49.244 INFO:tasks.workunit.client.0.smithi046.stdout:7/788: stat d16/d27/d51/d9c/la6 0 2024-04-26T12:28:49.245 INFO:tasks.workunit.client.0.smithi046.stdout:2/738: dread - d1/d71/fc3 zero size 2024-04-26T12:28:49.246 INFO:tasks.workunit.client.0.smithi046.stdout:0/806: mkdir d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d117 0 2024-04-26T12:28:49.247 INFO:tasks.workunit.client.0.smithi046.stdout:0/807: dread - d9/dc/f112 zero size 2024-04-26T12:28:49.248 INFO:tasks.workunit.client.0.smithi046.stdout:8/842: dwrite d7/d1c/d74/df4/d1b/f79 [0,4194304] 0 2024-04-26T12:28:49.249 INFO:tasks.workunit.client.0.smithi046.stdout:6/726: truncate d7/d1b/d6a/f5f 1498934 0 2024-04-26T12:28:49.249 INFO:tasks.workunit.client.0.smithi046.stdout:2/739: rename d1/de/d2b/cf1 to d1/de/d15/d18/d8a/c101 0 2024-04-26T12:28:49.251 INFO:tasks.workunit.client.0.smithi046.stdout:5/844: read d9/da/d18/d7d/f78 [133053,59012] 0 2024-04-26T12:28:49.251 INFO:tasks.workunit.client.0.smithi046.stdout:4/708: read d0/d1/d5/fc5 [777152,97871] 0 2024-04-26T12:28:49.252 INFO:tasks.workunit.client.0.smithi046.stdout:7/789: truncate d16/d1a/d31/d62/f80 669788 0 2024-04-26T12:28:49.252 INFO:tasks.workunit.client.0.smithi046.stdout:1/699: dread d7/d14/d5d/d32/d41/d8f/fa7 [0,4194304] 0 2024-04-26T12:28:49.254 INFO:tasks.workunit.client.0.smithi046.stdout:0/808: dwrite d9/dc/dd/d45/d69/fc3 [0,4194304] 0 2024-04-26T12:28:49.254 INFO:tasks.workunit.client.0.smithi046.stdout:4/709: symlink d0/da/d17/d20/d25/d35/d6d/d19/lec 0 2024-04-26T12:28:49.258 INFO:tasks.workunit.client.0.smithi046.stdout:6/727: dwrite d7/d1b/f4b [0,4194304] 0 2024-04-26T12:28:49.262 INFO:tasks.workunit.client.0.smithi046.stdout:2/740: dwrite d1/de/da4/f92 [0,4194304] 0 2024-04-26T12:28:49.263 INFO:tasks.workunit.client.0.smithi046.stdout:5/845: dwrite d9/da/d15/f4c [0,4194304] 0 2024-04-26T12:28:49.263 INFO:tasks.workunit.client.0.smithi046.stdout:0/809: write d9/dc/f37 [386005,112193] 0 2024-04-26T12:28:49.264 INFO:tasks.workunit.client.0.smithi046.stdout:5/846: dread - d9/da/dd/f107 zero size 2024-04-26T12:28:49.264 INFO:tasks.workunit.client.0.smithi046.stdout:1/700: dread d7/d14/d5d/d32/d41/d8f/fa7 [0,4194304] 0 2024-04-26T12:28:49.265 INFO:tasks.workunit.client.0.smithi046.stdout:2/741: write d1/de/d65/d4a/f82 [1246603,90427] 0 2024-04-26T12:28:49.265 INFO:tasks.workunit.client.0.smithi046.stdout:0/810: mknod d9/d1d/d5d/d6b/d8a/d8c/c118 0 2024-04-26T12:28:49.267 INFO:tasks.workunit.client.0.smithi046.stdout:1/701: write d7/db/d98/dc5/d2b/d96/f6d [907431,118827] 0 2024-04-26T12:28:49.268 INFO:tasks.workunit.client.0.smithi046.stdout:0/811: mknod d9/dc/dd/d45/c119 0 2024-04-26T12:28:49.268 INFO:tasks.workunit.client.0.smithi046.stdout:5/847: write d9/da/dd/d34/d44/d97/da4/dde/ff2 [601068,118829] 0 2024-04-26T12:28:49.268 INFO:tasks.workunit.client.0.smithi046.stdout:1/702: write d7/f9d [226044,85225] 0 2024-04-26T12:28:49.269 INFO:tasks.workunit.client.0.smithi046.stdout:5/848: dread - d9/da/dd/dd7/f70 zero size 2024-04-26T12:28:49.269 INFO:tasks.workunit.client.0.smithi046.stdout:2/742: truncate d1/de/d15/d18/dc1/db6/dda/d78/f7b 1110107 0 2024-04-26T12:28:49.269 INFO:tasks.workunit.client.0.smithi046.stdout:2/743: symlink d1/de/dc8/l102 0 2024-04-26T12:28:49.271 INFO:tasks.workunit.client.0.smithi046.stdout:0/812: link d9/dc/c39 d9/d1d/d40/d41/d7e/de1/c11a 0 2024-04-26T12:28:49.272 INFO:tasks.workunit.client.0.smithi046.stdout:2/744: creat d1/df2/f103 x:0 0 0 2024-04-26T12:28:49.272 INFO:tasks.workunit.client.0.smithi046.stdout:1/703: link d7/d14/d5d/d32/fbd d7/db/d98/dc5/d2b/d39/ff2 0 2024-04-26T12:28:49.272 INFO:tasks.workunit.client.0.smithi046.stdout:4/710: write d0/da/d17/d20/d25/d35/d6d/d19/f3d [2403272,1681] 0 2024-04-26T12:28:49.272 INFO:tasks.workunit.client.0.smithi046.stdout:2/745: dread - d1/de/d15/d18/dc1/fb3 zero size 2024-04-26T12:28:49.272 INFO:tasks.workunit.client.0.smithi046.stdout:0/813: mknod d9/d1d/d40/d41/d7e/ddd/c11b 0 2024-04-26T12:28:49.272 INFO:tasks.workunit.client.0.smithi046.stdout:7/790: dread d16/d1a/d3e/dc5/fd6 [0,4194304] 0 2024-04-26T12:28:49.273 INFO:tasks.workunit.client.0.smithi046.stdout:6/728: write d7/d2b/d31/f2e [3115133,90484] 0 2024-04-26T12:28:49.276 INFO:tasks.workunit.client.0.smithi046.stdout:1/704: truncate d7/d14/d5d/d6b/fba 1012512 0 2024-04-26T12:28:49.276 INFO:tasks.workunit.client.0.smithi046.stdout:4/711: rename d0/da/d17/d20/d25/d35/d6d/l28 to d0/da/d70/dc7/led 0 2024-04-26T12:28:49.276 INFO:tasks.workunit.client.0.smithi046.stdout:2/746: creat d1/de/f104 x:0 0 0 2024-04-26T12:28:49.276 INFO:tasks.workunit.client.0.smithi046.stdout:0/814: write d9/d1d/d40/db3/fd3 [560859,62682] 0 2024-04-26T12:28:49.276 INFO:tasks.workunit.client.0.smithi046.stdout:4/712: symlink d0/d64/dd9/lee 0 2024-04-26T12:28:49.277 INFO:tasks.workunit.client.0.smithi046.stdout:1/705: write d7/d14/d5d/d6b/f84 [2549378,130270] 0 2024-04-26T12:28:49.277 INFO:tasks.workunit.client.0.smithi046.stdout:2/747: chown d1/d42/f7a 115576 1 2024-04-26T12:28:49.277 INFO:tasks.workunit.client.0.smithi046.stdout:0/815: creat d9/dc/dd/dd2/de2/dae/f11c x:0 0 0 2024-04-26T12:28:49.277 INFO:tasks.workunit.client.0.smithi046.stdout:4/713: chown d0/da/d17/d20 7595 1 2024-04-26T12:28:49.277 INFO:tasks.workunit.client.0.smithi046.stdout:4/714: write d0/f14 [1882079,78222] 0 2024-04-26T12:28:49.277 INFO:tasks.workunit.client.0.smithi046.stdout:1/706: fdatasync d7/d14/d5d/d32/d41/f93 0 2024-04-26T12:28:49.280 INFO:tasks.workunit.client.0.smithi046.stdout:8/843: dread d7/da/df/f5e [0,4194304] 0 2024-04-26T12:28:49.281 INFO:tasks.workunit.client.0.smithi046.stdout:2/748: rmdir d1/de/d65/d8f/dd2 0 2024-04-26T12:28:49.281 INFO:tasks.workunit.client.0.smithi046.stdout:1/707: mknod d7/db0/dd6/cf3 0 2024-04-26T12:28:49.281 INFO:tasks.workunit.client.0.smithi046.stdout:3/773: dread d2/d16/d2c/d50/d71/d89/fba [0,4194304] 0 2024-04-26T12:28:49.281 INFO:tasks.workunit.client.0.smithi046.stdout:4/715: write d0/da/da1/f9e [576466,19064] 0 2024-04-26T12:28:49.281 INFO:tasks.workunit.client.0.smithi046.stdout:2/749: fdatasync d1/de/d65/d4a/d58/f9d 0 2024-04-26T12:28:49.281 INFO:tasks.workunit.client.0.smithi046.stdout:6/729: dwrite d7/d2b/d31/fd7 [0,4194304] 0 2024-04-26T12:28:49.282 INFO:tasks.workunit.client.0.smithi046.stdout:0/816: rename d9/dc/dd/d45/d69/de6/cf2 to d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d10f/c11d 0 2024-04-26T12:28:49.282 INFO:tasks.workunit.client.0.smithi046.stdout:4/716: creat d0/da/da1/fef x:0 0 0 2024-04-26T12:28:49.282 INFO:tasks.workunit.client.0.smithi046.stdout:3/774: rmdir d2/d16/d35/dbc/dc9/dd3 39 2024-04-26T12:28:49.282 INFO:tasks.workunit.client.0.smithi046.stdout:9/655: sync 2024-04-26T12:28:49.282 INFO:tasks.workunit.client.0.smithi046.stdout:1/708: getdents d7/d12 0 2024-04-26T12:28:49.282 INFO:tasks.workunit.client.0.smithi046.stdout:6/730: write d7/fc8 [1305205,33693] 0 2024-04-26T12:28:49.284 INFO:tasks.workunit.client.0.smithi046.stdout:0/817: mknod d9/d1d/d40/d41/d7e/ddd/de8/c11e 0 2024-04-26T12:28:49.285 INFO:tasks.workunit.client.0.smithi046.stdout:3/775: stat d2/d16/d2c/d50/d71/d89/f103 0 2024-04-26T12:28:49.285 INFO:tasks.workunit.client.0.smithi046.stdout:9/656: link d0/d29/d69/fdd d0/d19/feb 0 2024-04-26T12:28:49.285 INFO:tasks.workunit.client.0.smithi046.stdout:3/776: write d2/d16/d2c/d50/d71/d89/dc5/f3a [2134048,36211] 0 2024-04-26T12:28:49.285 INFO:tasks.workunit.client.0.smithi046.stdout:9/657: symlink d0/d2c/dda/d76/d7d/d72/d85/dea/lec 0 2024-04-26T12:28:49.286 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:49.282+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:49.286 INFO:tasks.workunit.client.0.smithi046.stdout:2/750: read d1/d71/fe6 [1080947,104552] 0 2024-04-26T12:28:49.287 INFO:tasks.workunit.client.0.smithi046.stdout:6/731: dwrite d7/d1b/d6a/f93 [0,4194304] 0 2024-04-26T12:28:49.288 INFO:tasks.workunit.client.0.smithi046.stdout:2/751: write d1/de/d65/d8f/fe1 [1595796,52013] 0 2024-04-26T12:28:49.289 INFO:tasks.workunit.client.0.smithi046.stdout:6/732: creat d7/d16/dbc/dda/fe9 x:0 0 0 2024-04-26T12:28:49.290 INFO:tasks.workunit.client.0.smithi046.stdout:1/709: dwrite d7/d14/d5d/d32/d5f/f92 [0,4194304] 0 2024-04-26T12:28:49.290 INFO:tasks.workunit.client.0.smithi046.stdout:5/849: dread f8 [0,4194304] 0 2024-04-26T12:28:49.294 INFO:tasks.workunit.client.0.smithi046.stdout:6/733: write d7/fa2 [2444631,26191] 0 2024-04-26T12:28:49.294 INFO:tasks.workunit.client.0.smithi046.stdout:3/777: dwrite d2/d16/f37 [0,4194304] 0 2024-04-26T12:28:49.295 INFO:tasks.workunit.client.0.smithi046.stdout:1/710: rename d7/d14/d5d/d6b/dc2/f85 to d7/d14/ff4 0 2024-04-26T12:28:49.296 INFO:tasks.workunit.client.0.smithi046.stdout:5/850: creat d9/da/dd/d34/d44/d97/da4/de2/f120 x:0 0 0 2024-04-26T12:28:49.296 INFO:tasks.workunit.client.0.smithi046.stdout:9/658: dwrite d0/d2c/dda/d76/d7d/faa [0,4194304] 0 2024-04-26T12:28:49.296 INFO:tasks.workunit.client.0.smithi046.stdout:3/778: mkdir d2/d16/d112 0 2024-04-26T12:28:49.297 INFO:tasks.workunit.client.0.smithi046.stdout:3/779: fdatasync d2/db/f10 0 2024-04-26T12:28:49.297 INFO:tasks.workunit.client.0.smithi046.stdout:1/711: read d7/db/d98/dc5/d2b/d96/fb4 [797245,2286] 0 2024-04-26T12:28:49.299 INFO:tasks.workunit.client.0.smithi046.stdout:0/818: dwrite d9/d1d/d40/db3/ff3 [0,4194304] 0 2024-04-26T12:28:49.299 INFO:tasks.workunit.client.0.smithi046.stdout:9/659: mkdir d0/d19/d51/dac/ded 0 2024-04-26T12:28:49.299 INFO:tasks.workunit.client.0.smithi046.stdout:3/780: fsync d2/db0/dc4/fea 0 2024-04-26T12:28:49.300 INFO:tasks.workunit.client.0.smithi046.stdout:9/660: stat d0/d2c/d47/fbf 0 2024-04-26T12:28:49.301 INFO:tasks.workunit.client.0.smithi046.stdout:0/819: rename d9/dc/dd/dd2/de2 to d9/dc/dd/dd2/d10e/d11f 0 2024-04-26T12:28:49.301 INFO:tasks.workunit.client.0.smithi046.stdout:3/781: creat d2/db/d4a/df0/f113 x:0 0 0 2024-04-26T12:28:49.302 INFO:tasks.workunit.client.0.smithi046.stdout:1/712: write d7/db/d98/dc5/d2b/d96/fb4 [1634839,11898] 0 2024-04-26T12:28:49.302 INFO:tasks.workunit.client.0.smithi046.stdout:1/713: chown d7/db/d98/dc5/d2b/d39/d5c/cd9 0 1 2024-04-26T12:28:49.304 INFO:tasks.workunit.client.0.smithi046.stdout:8/844: dread d7/d24/d50/d2a/d39/f61 [0,4194304] 0 2024-04-26T12:28:49.304 INFO:tasks.workunit.client.0.smithi046.stdout:1/714: write d7/db/d98/dc5/d2b/d39/d3c/f72 [5210338,103932] 0 2024-04-26T12:28:49.306 INFO:tasks.workunit.client.0.smithi046.stdout:8/845: rename d7/da/df/d104/db6/dda/de2/f109 to d7/d24/d50/d2a/d39/da6/df1/f115 0 2024-04-26T12:28:49.307 INFO:tasks.workunit.client.0.smithi046.stdout:2/752: dread d1/de/d65/d4a/d58/f73 [0,4194304] 0 2024-04-26T12:28:49.307 INFO:tasks.workunit.client.0.smithi046.stdout:8/846: read - d7/d1c/d74/f110 zero size 2024-04-26T12:28:49.308 INFO:tasks.workunit.client.0.smithi046.stdout:8/847: chown d7/d1c/d74/df4/d1b/lef 80807 1 2024-04-26T12:28:49.308 INFO:tasks.workunit.client.0.smithi046.stdout:3/782: dwrite d2/d16/d35/dbc/dc9/dd0/fe9 [0,4194304] 0 2024-04-26T12:28:49.309 INFO:tasks.workunit.client.0.smithi046.stdout:3/783: fsync d2/d16/d35/dbc/dc9/dd0/fb4 0 2024-04-26T12:28:49.310 INFO:tasks.workunit.client.0.smithi046.stdout:9/661: read d0/d19/f41 [260391,42965] 0 2024-04-26T12:28:49.311 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:49.311 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:49.311 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:49.311 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:49.311 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:49.312 INFO:tasks.workunit.client.0.smithi046.stdout:9/662: readlink d0/d2c/d47/l14 0 2024-04-26T12:28:49.313 INFO:tasks.workunit.client.0.smithi046.stdout:9/663: mknod d0/d2c/cee 0 2024-04-26T12:28:49.314 INFO:tasks.workunit.client.0.smithi046.stdout:8/848: dwrite d7/da/df/d104/fcb [4194304,4194304] 0 2024-04-26T12:28:49.315 INFO:tasks.workunit.client.0.smithi046.stdout:9/664: dread - d0/d2c/dda/d76/f79 zero size 2024-04-26T12:28:49.315 INFO:tasks.workunit.client.0.smithi046.stdout:3/784: dwrite d2/db/d4a/f40 [4194304,4194304] 0 2024-04-26T12:28:49.316 INFO:tasks.workunit.client.0.smithi046.stdout:9/665: fsync d0/d19/d21/f53 0 2024-04-26T12:28:49.316 INFO:tasks.workunit.client.0.smithi046.stdout:0/820: truncate d9/f12 1187511 0 2024-04-26T12:28:49.316 INFO:tasks.workunit.client.0.smithi046.stdout:1/715: truncate d7/db/d98/dc5/f58 44491 0 2024-04-26T12:28:49.316 INFO:tasks.workunit.client.0.smithi046.stdout:2/753: write d1/de/d65/d1b/faa [25083,119942] 0 2024-04-26T12:28:49.317 INFO:tasks.workunit.client.0.smithi046.stdout:8/849: rename d7/d24/d50/d2a/d92/fb8 to d7/d1c/d74/df4/d1b/dae/f116 0 2024-04-26T12:28:49.317 INFO:tasks.workunit.client.0.smithi046.stdout:3/785: read d2/d16/d35/dbc/dc9/dd0/fe9 [3154673,68641] 0 2024-04-26T12:28:49.318 INFO:tasks.workunit.client.0.smithi046.stdout:9/666: creat d0/d2c/fef x:0 0 0 2024-04-26T12:28:49.318 INFO:tasks.workunit.client.0.smithi046.stdout:2/754: creat d1/de/d15/d18/d91/f105 x:0 0 0 2024-04-26T12:28:49.319 INFO:tasks.workunit.client.0.smithi046.stdout:9/667: readlink d0/d29/l84 0 2024-04-26T12:28:49.320 INFO:tasks.workunit.client.0.smithi046.stdout:2/755: symlink d1/de/da4/l106 0 2024-04-26T12:28:49.321 INFO:tasks.workunit.client.0.smithi046.stdout:3/786: truncate d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d/f10a 564039 0 2024-04-26T12:28:49.322 INFO:tasks.workunit.client.0.smithi046.stdout:2/756: rmdir d1/de 39 2024-04-26T12:28:49.322 INFO:tasks.workunit.client.0.smithi046.stdout:3/787: write d2/d16/d2c/d50/fc7 [4619082,6049] 0 2024-04-26T12:28:49.324 INFO:tasks.workunit.client.0.smithi046.stdout:8/850: dwrite d7/da/df/f8d [0,4194304] 0 2024-04-26T12:28:49.324 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:49.325 INFO:tasks.workunit.client.0.smithi046.stdout:9/668: dwrite d0/d2c/d47/f13 [0,4194304] 0 2024-04-26T12:28:49.325 INFO:tasks.workunit.client.0.smithi046.stdout:8/851: symlink d7/d1c/d74/df4/d27/db0/l117 0 2024-04-26T12:28:49.325 INFO:tasks.workunit.client.0.smithi046.stdout:3/788: write d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/f56 [744232,24925] 0 2024-04-26T12:28:49.326 INFO:tasks.workunit.client.0.smithi046.stdout:9/669: fsync d0/d19/d21/f53 0 2024-04-26T12:28:49.326 INFO:tasks.workunit.client.0.smithi046.stdout:3/789: readlink d2/d16/l1a 0 2024-04-26T12:28:49.326 INFO:tasks.workunit.client.0.smithi046.stdout:0/821: truncate d9/dc/dd/f27 1637645 0 2024-04-26T12:28:49.327 INFO:tasks.workunit.client.0.smithi046.stdout:8/852: read - d7/d24/d50/d2a/d54/df3/ff7 zero size 2024-04-26T12:28:49.328 INFO:tasks.workunit.client.0.smithi046.stdout:9/670: unlink d0/d19/d21/c6c 0 2024-04-26T12:28:49.328 INFO:tasks.workunit.client.0.smithi046.stdout:0/822: unlink d9/d1d/d5d/d6b/c9b 0 2024-04-26T12:28:49.328 INFO:tasks.workunit.client.0.smithi046.stdout:3/790: mknod d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/c114 0 2024-04-26T12:28:49.329 INFO:tasks.workunit.client.0.smithi046.stdout:9/671: mknod d0/d2c/dbd/cf0 0 2024-04-26T12:28:49.330 INFO:tasks.workunit.client.0.smithi046.stdout:8/853: chown d7/d24/d50/d2a/d39/d9d/fb4 105021 1 2024-04-26T12:28:49.330 INFO:tasks.workunit.client.0.smithi046.stdout:0/823: mkdir d9/d1d/d40/d41/d7e/d9d/d120 0 2024-04-26T12:28:49.330 INFO:tasks.workunit.client.0.smithi046.stdout:6/734: dread d7/fe [0,4194304] 0 2024-04-26T12:28:49.330 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:28:49.331 INFO:tasks.workunit.client.0.smithi046.stdout:2/757: dwrite d1/de/d15/d18/dc1/db6/dda/d78/fa5 [0,4194304] 0 2024-04-26T12:28:49.331 INFO:tasks.workunit.client.0.smithi046.stdout:3/791: rmdir d2/d16/d112 0 2024-04-26T12:28:49.333 INFO:tasks.workunit.client.0.smithi046.stdout:2/758: truncate d1/de/d15/d18/d91/f105 319445 0 2024-04-26T12:28:49.334 INFO:tasks.workunit.client.0.smithi046.stdout:8/854: mknod d7/d24/d50/d2a/d39/c118 0 2024-04-26T12:28:49.334 INFO:tasks.workunit.client.0.smithi046.stdout:3/792: creat d2/d16/d2c/d50/f115 x:0 0 0 2024-04-26T12:28:49.335 INFO:tasks.workunit.client.0.smithi046.stdout:2/759: write d1/f83 [474985,123164] 0 2024-04-26T12:28:49.336 INFO:tasks.workunit.client.0.smithi046.stdout:8/855: link d7/da/df/f8d d7/d1c/d74/df4/d1b/d7d/dc1/dfd/f119 0 2024-04-26T12:28:49.337 INFO:tasks.workunit.client.0.smithi046.stdout:3/793: mkdir d2/d16/d35/dbc/dc9/d116 0 2024-04-26T12:28:49.337 INFO:tasks.workunit.client.0.smithi046.stdout:2/760: mknod d1/de/d65/d4a/c107 0 2024-04-26T12:28:49.337 INFO:tasks.workunit.client.0.smithi046.stdout:3/794: readlink d2/d16/d2c/d50/d71/d89/lc1 0 2024-04-26T12:28:49.338 INFO:tasks.workunit.client.0.smithi046.stdout:2/761: creat d1/de/dc8/ddd/f108 x:0 0 0 2024-04-26T12:28:49.338 INFO:tasks.workunit.client.0.smithi046.stdout:3/795: write d2/d16/d35/dbc/fdd [1128468,33184] 0 2024-04-26T12:28:49.339 INFO:tasks.workunit.client.0.smithi046.stdout:9/672: write d0/d2c/dda/d76/d7d/d72/d85/d97/f9c [16494,63192] 0 2024-04-26T12:28:49.339 INFO:tasks.workunit.client.0.smithi046.stdout:6/735: dwrite d7/d1b/fcb [0,4194304] 0 2024-04-26T12:28:49.339 INFO:tasks.workunit.client.0.smithi046.stdout:0/824: fsync d9/d1d/d5d/d6b/f98 0 2024-04-26T12:28:49.340 INFO:tasks.workunit.client.0.smithi046.stdout:3/796: mknod d2/db/d4a/df0/c117 0 2024-04-26T12:28:49.340 INFO:tasks.workunit.client.0.smithi046.stdout:6/736: readlink d7/d1b/d6a/l6c 0 2024-04-26T12:28:49.341 INFO:tasks.workunit.client.0.smithi046.stdout:0/825: unlink f3 0 2024-04-26T12:28:49.342 INFO:tasks.workunit.client.0.smithi046.stdout:2/762: write d1/d42/f7a [836220,85947] 0 2024-04-26T12:28:49.342 INFO:tasks.workunit.client.0.smithi046.stdout:0/826: chown d9/dc/c75 97 1 2024-04-26T12:28:49.347 INFO:tasks.workunit.client.0.smithi046.stdout:1/716: dread d7/d14/d5d/d32/d41/fbc [0,4194304] 0 2024-04-26T12:28:49.348 INFO:tasks.workunit.client.0.smithi046.stdout:2/763: dwrite d1/de/dc8/ddd/f108 [0,4194304] 0 2024-04-26T12:28:49.349 INFO:tasks.workunit.client.0.smithi046.stdout:0/827: dwrite d9/dc/d2a/f4a [0,4194304] 0 2024-04-26T12:28:49.350 INFO:tasks.workunit.client.0.smithi046.stdout:2/764: write d1/de/d15/d18/f57 [655330,10107] 0 2024-04-26T12:28:49.352 INFO:tasks.workunit.client.0.smithi046.stdout:2/765: dread - d1/de/da4/ff5 zero size 2024-04-26T12:28:49.352 INFO:tasks.workunit.client.0.smithi046.stdout:0/828: dread - d9/dc/dd/dd2/fee zero size 2024-04-26T12:28:49.354 INFO:tasks.workunit.client.0.smithi046.stdout:2/766: read - d1/d71/fc3 zero size 2024-04-26T12:28:49.355 INFO:tasks.workunit.client.0.smithi046.stdout:1/717: dwrite d7/db/d98/dc5/f11 [0,4194304] 0 2024-04-26T12:28:49.355 INFO:tasks.workunit.client.0.smithi046.stdout:0/829: creat d9/d1d/f121 x:0 0 0 2024-04-26T12:28:49.355 INFO:tasks.workunit.client.0.smithi046.stdout:2/767: write d1/df2/f103 [108157,82221] 0 2024-04-26T12:28:49.357 INFO:tasks.workunit.client.0.smithi046.stdout:2/768: unlink d1/de/d15/d18/d8a/fed 0 2024-04-26T12:28:49.358 INFO:tasks.workunit.client.0.smithi046.stdout:0/830: rename d9/d1d/d40/d41/d7e/da5/l113 to d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d108/l122 0 2024-04-26T12:28:49.359 INFO:tasks.workunit.client.0.smithi046.stdout:0/831: write d9/d1d/d40/d41/d7e/d9d/f101 [702597,105395] 0 2024-04-26T12:28:49.362 INFO:tasks.workunit.client.0.smithi046.stdout:1/718: dwrite d7/db/d98/dc5/d2b/d96/f6d [0,4194304] 0 2024-04-26T12:28:49.362 INFO:tasks.workunit.client.0.smithi046.stdout:0/832: symlink d9/dc/dd/dd2/d10e/l123 0 2024-04-26T12:28:49.362 INFO:tasks.workunit.client.0.smithi046.stdout:1/719: chown d7/fae 46996 1 2024-04-26T12:28:49.363 INFO:tasks.workunit.client.0.smithi046.stdout:0/833: truncate d9/db5/fd9 876471 0 2024-04-26T12:28:49.363 INFO:tasks.workunit.client.0.smithi046.stdout:1/720: chown d7/db/d98/cdc 944 1 2024-04-26T12:28:49.364 INFO:tasks.workunit.client.0.smithi046.stdout:0/834: unlink d9/fbc 0 2024-04-26T12:28:49.364 INFO:tasks.workunit.client.0.smithi046.stdout:1/721: write d7/d14/f53 [76899,105169] 0 2024-04-26T12:28:49.365 INFO:tasks.workunit.client.0.smithi046.stdout:8/856: dread d7/da/fa9 [0,4194304] 0 2024-04-26T12:28:49.366 INFO:tasks.workunit.client.0.smithi046.stdout:9/673: dread d0/db6/fbc [0,4194304] 0 2024-04-26T12:28:49.366 INFO:tasks.workunit.client.0.smithi046.stdout:1/722: unlink d7/d14/d5d/d6b/cde 0 2024-04-26T12:28:49.368 INFO:tasks.workunit.client.0.smithi046.stdout:8/857: rename d7/da/df/d104 to d7/d11a 0 2024-04-26T12:28:49.368 INFO:tasks.workunit.client.0.smithi046.stdout:9/674: mkdir d0/d2c/dda/d76/d7d/d72/da1/df1 0 2024-04-26T12:28:49.369 INFO:tasks.workunit.client.0.smithi046.stdout:9/675: write d0/d2c/fef [86902,53094] 0 2024-04-26T12:28:49.369 INFO:tasks.workunit.client.0.smithi046.stdout:1/723: rename d7/d12/d89/fa0 to d7/db/d98/dc5/d2b/d39/db3/ff5 0 2024-04-26T12:28:49.369 INFO:tasks.workunit.client.0.smithi046.stdout:8/858: mknod d7/d1c/d74/df4/d1b/dae/c11b 0 2024-04-26T12:28:49.370 INFO:tasks.workunit.client.0.smithi046.stdout:8/859: readlink d7/d1c/l60 0 2024-04-26T12:28:49.370 INFO:tasks.workunit.client.0.smithi046.stdout:9/676: mknod d0/d2c/d3d/d52/cf2 0 2024-04-26T12:28:49.370 INFO:tasks.workunit.client.0.smithi046.stdout:7/791: sync 2024-04-26T12:28:49.372 INFO:tasks.workunit.client.0.smithi046.stdout:2/769: dwrite d1/de/d65/d8f/fad [0,4194304] 0 2024-04-26T12:28:49.378 INFO:tasks.workunit.client.0.smithi046.stdout:3/797: dread d2/f4 [0,4194304] 0 2024-04-26T12:28:49.379 INFO:tasks.workunit.client.0.smithi046.stdout:6/737: dread d7/d2b/f53 [0,4194304] 0 2024-04-26T12:28:49.380 INFO:tasks.workunit.client.0.smithi046.stdout:1/724: dwrite d7/db/d98/dc5/d2b/d39/f61 [0,4194304] 0 2024-04-26T12:28:49.381 INFO:tasks.workunit.client.0.smithi046.stdout:7/792: dwrite d16/d35/dac/f94 [0,4194304] 0 2024-04-26T12:28:49.381 INFO:tasks.workunit.client.0.smithi046.stdout:8/860: dwrite d7/d1c/d74/df4/d27/feb [0,4194304] 0 2024-04-26T12:28:49.381 INFO:tasks.workunit.client.0.smithi046.stdout:6/738: chown d7/d2b/d31/f2e 3488507 1 2024-04-26T12:28:49.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/798: chown d2/d16/d2c/d50/d71/d89/dc5/d1b/c83 1408004 1 2024-04-26T12:28:49.382 INFO:tasks.workunit.client.0.smithi046.stdout:1/725: mknod d7/db/cf6 0 2024-04-26T12:28:49.383 INFO:tasks.workunit.client.0.smithi046.stdout:0/835: dread d9/dc/dd/d45/d69/f8b [0,4194304] 0 2024-04-26T12:28:49.384 INFO:tasks.workunit.client.0.smithi046.stdout:8/861: dread d7/d24/d50/f89 [0,4194304] 0 2024-04-26T12:28:49.384 INFO:tasks.workunit.client.0.smithi046.stdout:6/739: write d7/d1b/d37/f7d [1009763,10732] 0 2024-04-26T12:28:49.384 INFO:tasks.workunit.client.0.smithi046.stdout:9/677: dread d0/d19/d21/f30 [0,4194304] 0 2024-04-26T12:28:49.385 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:49.383+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:49.385 INFO:tasks.workunit.client.0.smithi046.stdout:7/793: creat d16/d27/d51/f102 x:0 0 0 2024-04-26T12:28:49.385 INFO:tasks.workunit.client.0.smithi046.stdout:1/726: write d7/db/d98/dc5/d2b/d39/db3/fd1 [83108,2246] 0 2024-04-26T12:28:49.386 INFO:tasks.workunit.client.0.smithi046.stdout:6/740: symlink d7/da7/daf/lea 0 2024-04-26T12:28:49.386 INFO:tasks.workunit.client.0.smithi046.stdout:7/794: chown d16/d1a/d3e/d59/fe9 415 1 2024-04-26T12:28:49.387 INFO:tasks.workunit.client.0.smithi046.stdout:8/862: creat d7/d1c/d74/df4/d27/db0/f11c x:0 0 0 2024-04-26T12:28:49.387 INFO:tasks.workunit.client.0.smithi046.stdout:9/678: rename d0/d19/f41 to d0/d2c/dda/d76/d7d/dcc/ff3 0 2024-04-26T12:28:49.389 INFO:tasks.workunit.client.0.smithi046.stdout:1/727: unlink d7/db/d98/dc5/d2b/d96/la2 0 2024-04-26T12:28:49.389 INFO:tasks.workunit.client.0.smithi046.stdout:6/741: mkdir d7/d2b/d31/dd9/deb 0 2024-04-26T12:28:49.389 INFO:tasks.workunit.client.0.smithi046.stdout:7/795: symlink d16/d1a/d31/d55/d6d/d89/dc7/l103 0 2024-04-26T12:28:49.389 INFO:tasks.workunit.client.0.smithi046.stdout:0/836: chown d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/c76 70516237 1 2024-04-26T12:28:49.390 INFO:tasks.workunit.client.0.smithi046.stdout:8/863: fdatasync d7/d24/d50/d2a/d39/fa8 0 2024-04-26T12:28:49.390 INFO:tasks.workunit.client.0.smithi046.stdout:9/679: mknod d0/d2c/dbe/dd2/cf4 0 2024-04-26T12:28:49.390 INFO:tasks.workunit.client.0.smithi046.stdout:1/728: truncate d7/f9d 565575 0 2024-04-26T12:28:49.391 INFO:tasks.workunit.client.0.smithi046.stdout:7/796: write d16/d35/dac/fd7 [445675,74019] 0 2024-04-26T12:28:49.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/742: creat d7/d1b/d47/d65/d77/fec x:0 0 0 2024-04-26T12:28:49.391 INFO:tasks.workunit.client.0.smithi046.stdout:3/799: dwrite d2/f53 [0,4194304] 0 2024-04-26T12:28:49.391 INFO:tasks.workunit.client.0.smithi046.stdout:8/864: readlink d7/d24/d50/d2a/l71 0 2024-04-26T12:28:49.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/743: write d7/d16/fb5 [368138,43138] 0 2024-04-26T12:28:49.391 INFO:tasks.workunit.client.0.smithi046.stdout:9/680: symlink d0/d2c/dda/d76/d7d/d72/lf5 0 2024-04-26T12:28:49.392 INFO:tasks.workunit.client.0.smithi046.stdout:1/729: rename d7/db/c47 to d7/db/d98/dc5/cf7 0 2024-04-26T12:28:49.394 INFO:tasks.workunit.client.0.smithi046.stdout:6/744: creat d7/d2b/d31/d4d/fed x:0 0 0 2024-04-26T12:28:49.394 INFO:tasks.workunit.client.0.smithi046.stdout:9/681: symlink d0/d2c/d3d/lf6 0 2024-04-26T12:28:49.394 INFO:tasks.workunit.client.0.smithi046.stdout:8/865: rename d7/d1c/d74/df4/d1b/fdc to d7/da/df/f11d 0 2024-04-26T12:28:49.395 INFO:tasks.workunit.client.0.smithi046.stdout:0/837: dread d9/db5/fd9 [0,4194304] 0 2024-04-26T12:28:49.395 INFO:tasks.workunit.client.0.smithi046.stdout:9/682: dread - d0/d2c/dda/d76/f79 zero size 2024-04-26T12:28:49.396 INFO:tasks.workunit.client.0.smithi046.stdout:1/730: rename d7/d14/d5d/l73 to d7/d14/d5d/d32/d41/d8f/dd3/de5/lf8 0 2024-04-26T12:28:49.396 INFO:tasks.workunit.client.0.smithi046.stdout:8/866: read d7/d1c/d74/df4/d27/f103 [84038,12234] 0 2024-04-26T12:28:49.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/838: chown d9/d1d/d40/d41/d7e/da5/lda 60838 1 2024-04-26T12:28:49.398 INFO:tasks.workunit.client.0.smithi046.stdout:7/797: dwrite d16/db1/fb5 [0,4194304] 0 2024-04-26T12:28:49.400 INFO:tasks.workunit.client.0.smithi046.stdout:8/867: unlink d7/d24/d50/d2a/d39/l9a 0 2024-04-26T12:28:49.400 INFO:tasks.workunit.client.0.smithi046.stdout:7/798: rmdir d16/d1a/d31/d4d 39 2024-04-26T12:28:49.400 INFO:tasks.workunit.client.0.smithi046.stdout:8/868: chown d7/d11a/db6 1 1 2024-04-26T12:28:49.400 INFO:tasks.workunit.client.0.smithi046.stdout:1/731: rmdir d7/db/d98/dc5/d2b/d31/d82 39 2024-04-26T12:28:49.400 INFO:tasks.workunit.client.0.smithi046.stdout:0/839: symlink d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d10f/l124 0 2024-04-26T12:28:49.400 INFO:tasks.workunit.client.0.smithi046.stdout:6/745: dwrite d7/f15 [8388608,4194304] 0 2024-04-26T12:28:49.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/869: write d7/d1c/d74/df4/d1b/dae/dcf/ff9 [904717,59673] 0 2024-04-26T12:28:49.401 INFO:tasks.workunit.client.0.smithi046.stdout:0/840: unlink d9/dc/f9f 0 2024-04-26T12:28:49.401 INFO:tasks.workunit.client.0.smithi046.stdout:6/746: mkdir d7/d1b/dee 0 2024-04-26T12:28:49.402 INFO:tasks.workunit.client.0.smithi046.stdout:8/870: chown d7/cac 3207 1 2024-04-26T12:28:49.402 INFO:tasks.workunit.client.0.smithi046.stdout:1/732: getdents d7/d14/d5d/d32 0 2024-04-26T12:28:49.403 INFO:tasks.workunit.client.0.smithi046.stdout:6/747: write d7/d1b/d47/f97 [332606,72698] 0 2024-04-26T12:28:49.403 INFO:tasks.workunit.client.0.smithi046.stdout:0/841: creat d9/d1d/d5d/d6b/d8a/d8c/f125 x:0 0 0 2024-04-26T12:28:49.404 INFO:tasks.workunit.client.0.smithi046.stdout:1/733: mkdir d7/db/d98/dc5/d2b/d31/d82/d95/df9 0 2024-04-26T12:28:49.405 INFO:tasks.workunit.client.0.smithi046.stdout:0/842: getdents d9/d1d/d40/d41/d7e/de1 0 2024-04-26T12:28:49.405 INFO:tasks.workunit.client.0.smithi046.stdout:6/748: chown d7/d16/dbc/cc9 18490 1 2024-04-26T12:28:49.405 INFO:tasks.workunit.client.0.smithi046.stdout:8/871: link d7/d1c/d74/df4/d1b/dae/dcf/cfe d7/d1c/d74/df4/d1b/dae/dcf/c11e 0 2024-04-26T12:28:49.405 INFO:tasks.workunit.client.0.smithi046.stdout:6/749: stat d7/d2b 0 2024-04-26T12:28:49.405 INFO:tasks.workunit.client.0.smithi046.stdout:1/734: creat d7/db/d98/dc5/d2b/d39/ffa x:0 0 0 2024-04-26T12:28:49.405 INFO:tasks.workunit.client.0.smithi046.stdout:0/843: symlink d9/dc/dd/dd2/d10e/l126 0 2024-04-26T12:28:49.406 INFO:tasks.workunit.client.0.smithi046.stdout:4/717: sync 2024-04-26T12:28:49.406 INFO:tasks.workunit.client.0.smithi046.stdout:5/851: sync 2024-04-26T12:28:49.406 INFO:tasks.workunit.client.0.smithi046.stdout:8/872: mknod d7/da/d4f/d7f/dfb/c11f 0 2024-04-26T12:28:49.406 INFO:tasks.workunit.client.0.smithi046.stdout:6/750: dread - d7/d2b/d31/d4d/fed zero size 2024-04-26T12:28:49.408 INFO:tasks.workunit.client.0.smithi046.stdout:4/718: creat d0/da/d17/d20/d25/ff0 x:0 0 0 2024-04-26T12:28:49.408 INFO:tasks.workunit.client.0.smithi046.stdout:4/719: mknod d0/d41/cf1 0 2024-04-26T12:28:49.409 INFO:tasks.workunit.client.0.smithi046.stdout:5/852: mkdir d9/da/dd/dd7/db0/db6/d121 0 2024-04-26T12:28:49.409 INFO:tasks.workunit.client.0.smithi046.stdout:4/720: symlink d0/da/d21/dcf/lf2 0 2024-04-26T12:28:49.411 INFO:tasks.workunit.client.0.smithi046.stdout:4/721: getdents d0/da/d17/d20/d8e 0 2024-04-26T12:28:49.411 INFO:tasks.workunit.client.0.smithi046.stdout:6/751: dwrite d7/d1b/f74 [0,4194304] 0 2024-04-26T12:28:49.412 INFO:tasks.workunit.client.0.smithi046.stdout:6/752: fdatasync d7/d2b/d31/fd7 0 2024-04-26T12:28:49.412 INFO:tasks.workunit.client.0.smithi046.stdout:4/722: creat d0/da/d70/dc7/ff3 x:0 0 0 2024-04-26T12:28:49.413 INFO:tasks.workunit.client.0.smithi046.stdout:6/753: mkdir d7/d1b/d37/d95/def 0 2024-04-26T12:28:49.414 INFO:tasks.workunit.client.0.smithi046.stdout:6/754: creat d7/d1b/d6a/d57/ff0 x:0 0 0 2024-04-26T12:28:49.415 INFO:tasks.workunit.client.0.smithi046.stdout:6/755: mkdir d7/da7/daf/df1 0 2024-04-26T12:28:49.415 INFO:tasks.workunit.client.0.smithi046.stdout:4/723: getdents d0/da/d17/d20/d25/d35/d61/dc6 0 2024-04-26T12:28:49.415 INFO:tasks.workunit.client.0.smithi046.stdout:2/770: dread d1/de/d65/d4a/d58/f5c [0,4194304] 0 2024-04-26T12:28:49.416 INFO:tasks.workunit.client.0.smithi046.stdout:6/756: rename d7/d2b/c4c to d7/d2b/cf2 0 2024-04-26T12:28:49.417 INFO:tasks.workunit.client.0.smithi046.stdout:2/771: creat d1/f109 x:0 0 0 2024-04-26T12:28:49.417 INFO:tasks.workunit.client.0.smithi046.stdout:1/735: truncate d7/db/d98/dc5/d2b/d39/db3/f90 3546673 0 2024-04-26T12:28:49.417 INFO:tasks.workunit.client.0.smithi046.stdout:6/757: creat d7/da7/dd1/ff3 x:0 0 0 2024-04-26T12:28:49.417 INFO:tasks.workunit.client.0.smithi046.stdout:4/724: rename d0/da/d17/d20/d25/d35/d6d/d19/d55/dae/lce to d0/da/d21/lf4 0 2024-04-26T12:28:49.418 INFO:tasks.workunit.client.0.smithi046.stdout:1/736: dread - d7/d14/d5d/f74 zero size 2024-04-26T12:28:49.418 INFO:tasks.workunit.client.0.smithi046.stdout:2/772: stat d1/de/d15/d18/dc1/db6/dda/d78/ff0 0 2024-04-26T12:28:49.418 INFO:tasks.workunit.client.0.smithi046.stdout:4/725: mkdir d0/d41/df5 0 2024-04-26T12:28:49.418 INFO:tasks.workunit.client.0.smithi046.stdout:1/737: creat d7/d14/ffb x:0 0 0 2024-04-26T12:28:49.419 INFO:tasks.workunit.client.0.smithi046.stdout:4/726: mkdir d0/da/d21/df6 0 2024-04-26T12:28:49.420 INFO:tasks.workunit.client.0.smithi046.stdout:2/773: truncate d1/de/d65/d8f/fe1 1823949 0 2024-04-26T12:28:49.420 INFO:tasks.workunit.client.0.smithi046.stdout:4/727: creat d0/ff7 x:0 0 0 2024-04-26T12:28:49.420 INFO:tasks.workunit.client.0.smithi046.stdout:2/774: readlink d1/de/dc8/l102 0 2024-04-26T12:28:49.421 INFO:tasks.workunit.client.0.smithi046.stdout:1/738: rename d7/db/d98/dc5/d2b/d31/dd0 to d7/db/dee/dfc 0 2024-04-26T12:28:49.422 INFO:tasks.workunit.client.0.smithi046.stdout:2/775: symlink d1/de/d65/d1b/dca/l10a 0 2024-04-26T12:28:49.422 INFO:tasks.workunit.client.0.smithi046.stdout:1/739: mkdir d7/d14/d5d/d32/d41/d8f/dfd 0 2024-04-26T12:28:49.422 INFO:tasks.workunit.client.0.smithi046.stdout:6/758: dwrite d7/d16/f4a [0,4194304] 0 2024-04-26T12:28:49.423 INFO:tasks.workunit.client.0.smithi046.stdout:2/776: mknod d1/de/d65/d4a/d86/c10b 0 2024-04-26T12:28:49.424 INFO:tasks.workunit.client.0.smithi046.stdout:1/740: mknod d7/db/d98/dc5/d2b/d39/db3/d79/cfe 0 2024-04-26T12:28:49.425 INFO:tasks.workunit.client.0.smithi046.stdout:1/741: fdatasync d7/db/d98/fec 0 2024-04-26T12:28:49.426 INFO:tasks.workunit.client.0.smithi046.stdout:1/742: rename d7/fae to d7/d14/de3/fff 0 2024-04-26T12:28:49.428 INFO:tasks.workunit.client.0.smithi046.stdout:1/743: chown d7/db/d98/dc5/d2b/d39/d5c/f8e 1 1 2024-04-26T12:28:49.428 INFO:tasks.workunit.client.0.smithi046.stdout:6/759: dwrite d7/d1b/d47/f97 [0,4194304] 0 2024-04-26T12:28:49.430 INFO:tasks.workunit.client.0.smithi046.stdout:2/777: dwrite d1/de/d2b/fa0 [0,4194304] 0 2024-04-26T12:28:49.430 INFO:tasks.workunit.client.0.smithi046.stdout:8/873: dread d7/d1c/d74/df4/f41 [4194304,4194304] 0 2024-04-26T12:28:49.431 INFO:tasks.workunit.client.0.smithi046.stdout:6/760: mknod d7/d1b/d47/d65/da3/cf4 0 2024-04-26T12:28:49.431 INFO:tasks.workunit.client.0.smithi046.stdout:8/874: chown d7/d24 7105 1 2024-04-26T12:28:49.432 INFO:tasks.workunit.client.0.smithi046.stdout:6/761: unlink d7/da7/dd1/ff3 0 2024-04-26T12:28:49.432 INFO:tasks.workunit.client.0.smithi046.stdout:2/778: getdents d1/d71 0 2024-04-26T12:28:49.434 INFO:tasks.workunit.client.0.smithi046.stdout:2/779: creat d1/de/d15/d18/f10c x:0 0 0 2024-04-26T12:28:49.434 INFO:tasks.workunit.client.0.smithi046.stdout:0/844: dread d9/dc/dd/d45/d69/f7a [0,4194304] 0 2024-04-26T12:28:49.435 INFO:tasks.workunit.client.0.smithi046.stdout:1/744: dwrite d7/d14/fc7 [0,4194304] 0 2024-04-26T12:28:49.436 INFO:tasks.workunit.client.0.smithi046.stdout:0/845: unlink d9/dc/l7f 0 2024-04-26T12:28:49.437 INFO:tasks.workunit.client.0.smithi046.stdout:1/745: mkdir d7/d100 0 2024-04-26T12:28:49.437 INFO:tasks.workunit.client.0.smithi046.stdout:8/875: creat d7/d24/d50/d2a/d39/f120 x:0 0 0 2024-04-26T12:28:49.438 INFO:tasks.workunit.client.0.smithi046.stdout:8/876: truncate d7/da/d4f/f7a 907618 0 2024-04-26T12:28:49.440 INFO:tasks.workunit.client.0.smithi046.stdout:6/762: write d7/d1b/d37/f42 [4994341,101997] 0 2024-04-26T12:28:49.441 INFO:tasks.workunit.client.0.smithi046.stdout:8/877: link d7/d11a/db6/dda/de2/cee d7/d24/d50/d2a/d39/c121 0 2024-04-26T12:28:49.441 INFO:tasks.workunit.client.0.smithi046.stdout:0/846: dwrite d9/dc/dd/dd2/fee [0,4194304] 0 2024-04-26T12:28:49.442 INFO:tasks.workunit.client.0.smithi046.stdout:8/878: stat d7/d24/d50/d2a/d39/c5b 0 2024-04-26T12:28:49.442 INFO:tasks.workunit.client.0.smithi046.stdout:8/879: stat d7/da 0 2024-04-26T12:28:49.443 INFO:tasks.workunit.client.0.smithi046.stdout:8/880: creat d7/d11a/db6/dda/de2/f122 x:0 0 0 2024-04-26T12:28:49.444 INFO:tasks.workunit.client.0.smithi046.stdout:2/780: read d1/de/d15/d18/d8a/f95 [158602,129188] 0 2024-04-26T12:28:49.444 INFO:tasks.workunit.client.0.smithi046.stdout:8/881: readlink d7/d1c/d74/df4/d1b/d7d/l98 0 2024-04-26T12:28:49.444 INFO:tasks.workunit.client.0.smithi046.stdout:2/781: symlink d1/de/d15/l10d 0 2024-04-26T12:28:49.445 INFO:tasks.workunit.client.0.smithi046.stdout:8/882: creat d7/d1c/d74/df4/d1b/dae/dcf/f123 x:0 0 0 2024-04-26T12:28:49.446 INFO:tasks.workunit.client.0.smithi046.stdout:8/883: chown d7/d24/d50/d2a/d39/f61 771696 1 2024-04-26T12:28:49.449 INFO:tasks.workunit.client.0.smithi046.stdout:8/884: dwrite d7/d24/d50/f9b [4194304,4194304] 0 2024-04-26T12:28:49.451 INFO:tasks.workunit.client.0.smithi046.stdout:8/885: rename d7/c66 to d7/d1c/d74/df4/d1b/c124 0 2024-04-26T12:28:49.452 INFO:tasks.workunit.client.0.smithi046.stdout:8/886: mknod d7/d11a/db6/c125 0 2024-04-26T12:28:49.453 INFO:tasks.workunit.client.0.smithi046.stdout:8/887: creat d7/d24/d50/d2a/f126 x:0 0 0 2024-04-26T12:28:49.453 INFO:tasks.workunit.client.0.smithi046.stdout:8/888: mknod d7/d24/d50/c127 0 2024-04-26T12:28:49.454 INFO:tasks.workunit.client.0.smithi046.stdout:0/847: truncate d9/d1d/d5d/d6b/f89 2324090 0 2024-04-26T12:28:49.455 INFO:tasks.workunit.client.0.smithi046.stdout:8/889: mkdir d7/da/df/d128 0 2024-04-26T12:28:49.455 INFO:tasks.workunit.client.0.smithi046.stdout:2/782: truncate d1/de/d65/f66 2104927 0 2024-04-26T12:28:49.456 INFO:tasks.workunit.client.0.smithi046.stdout:1/746: sync 2024-04-26T12:28:49.456 INFO:tasks.workunit.client.0.smithi046.stdout:3/800: sync 2024-04-26T12:28:49.456 INFO:tasks.workunit.client.0.smithi046.stdout:4/728: sync 2024-04-26T12:28:49.456 INFO:tasks.workunit.client.0.smithi046.stdout:9/683: sync 2024-04-26T12:28:49.456 INFO:tasks.workunit.client.0.smithi046.stdout:5/853: sync 2024-04-26T12:28:49.456 INFO:tasks.workunit.client.0.smithi046.stdout:7/799: sync 2024-04-26T12:28:49.456 INFO:tasks.workunit.client.0.smithi046.stdout:8/890: mkdir d7/d1c/d129 0 2024-04-26T12:28:49.457 INFO:tasks.workunit.client.0.smithi046.stdout:5/854: stat d9/da/dd/d34/faf 0 2024-04-26T12:28:49.458 INFO:tasks.workunit.client.0.smithi046.stdout:7/800: mkdir d16/d104 0 2024-04-26T12:28:49.458 INFO:tasks.workunit.client.0.smithi046.stdout:3/801: mknod d2/d16/d35/dbc/dc9/dd3/c118 0 2024-04-26T12:28:49.460 INFO:tasks.workunit.client.0.smithi046.stdout:4/729: mknod d0/da/d17/d20/d25/d35/d6d/cf8 0 2024-04-26T12:28:49.461 INFO:tasks.workunit.client.0.smithi046.stdout:3/802: rmdir d2/db/d4a 39 2024-04-26T12:28:49.461 INFO:tasks.workunit.client.0.smithi046.stdout:6/763: dwrite d7/d1b/d37/f76 [4194304,4194304] 0 2024-04-26T12:28:49.463 INFO:tasks.workunit.client.0.smithi046.stdout:2/783: dwrite d1/de/da4/fc6 [0,4194304] 0 2024-04-26T12:28:49.466 INFO:tasks.workunit.client.0.smithi046.stdout:4/730: write d0/da/d17/d20/d25/fc9 [8851236,122387] 0 2024-04-26T12:28:49.466 INFO:tasks.workunit.client.0.smithi046.stdout:9/684: dwrite d0/d29/f89 [0,4194304] 0 2024-04-26T12:28:49.467 INFO:tasks.workunit.client.0.smithi046.stdout:5/855: rename d9/da/dd/d34/d45/d8f/ffc to d9/da/d15/f122 0 2024-04-26T12:28:49.468 INFO:tasks.workunit.client.0.smithi046.stdout:1/747: truncate d7/d14/d5d/d32/f75 115734 0 2024-04-26T12:28:49.468 INFO:tasks.workunit.client.0.smithi046.stdout:2/784: chown d1/de/d15/d18/d98/cd5 49624 1 2024-04-26T12:28:49.469 INFO:tasks.workunit.client.0.smithi046.stdout:0/848: truncate d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/f80 6962788 0 2024-04-26T12:28:49.469 INFO:tasks.workunit.client.0.smithi046.stdout:8/891: dwrite d7/d1c/d74/df4/d1b/dae/f116 [0,4194304] 0 2024-04-26T12:28:49.469 INFO:tasks.workunit.client.0.smithi046.stdout:7/801: link d16/d3f/cb3 d16/d3f/d81/c105 0 2024-04-26T12:28:49.469 INFO:tasks.workunit.client.0.smithi046.stdout:3/803: chown d2/d16/d35/dbc/dc9/dd0/cb5 0 1 2024-04-26T12:28:49.470 INFO:tasks.workunit.client.0.smithi046.stdout:4/731: write d0/da/d17/d20/d25/d35/d6d/d19/f3d [2786238,14730] 0 2024-04-26T12:28:49.471 INFO:tasks.workunit.client.0.smithi046.stdout:3/804: chown d2/d16/d35/fc2 4 1 2024-04-26T12:28:49.471 INFO:tasks.workunit.client.0.smithi046.stdout:6/764: dwrite d7/d2b/d31/fc4 [0,4194304] 0 2024-04-26T12:28:49.472 INFO:tasks.workunit.client.0.smithi046.stdout:1/748: symlink d7/db/d98/dc5/d2b/d39/d3c/l101 0 2024-04-26T12:28:49.472 INFO:tasks.workunit.client.0.smithi046.stdout:0/849: symlink d9/dc/db9/l127 0 2024-04-26T12:28:49.473 INFO:tasks.workunit.client.0.smithi046.stdout:2/785: unlink d1/de/d65/d4a/d58/l100 0 2024-04-26T12:28:49.473 INFO:tasks.workunit.client.0.smithi046.stdout:7/802: creat d16/d35/dc9/f106 x:0 0 0 2024-04-26T12:28:49.475 INFO:tasks.workunit.client.0.smithi046.stdout:7/803: chown d16/db1/ffd 250034976 1 2024-04-26T12:28:49.476 INFO:tasks.workunit.client.0.smithi046.stdout:1/749: getdents d7/db/d98 0 2024-04-26T12:28:49.476 INFO:tasks.workunit.client.0.smithi046.stdout:2/786: creat d1/de/d15/f10e x:0 0 0 2024-04-26T12:28:49.476 INFO:tasks.workunit.client.0.smithi046.stdout:7/804: readlink d16/d4e/l54 0 2024-04-26T12:28:49.477 INFO:tasks.workunit.client.0.smithi046.stdout:6/765: truncate d7/da7/daf/fc7 181687 0 2024-04-26T12:28:49.478 INFO:tasks.workunit.client.0.smithi046.stdout:7/805: unlink d16/d1a/d31/f70 0 2024-04-26T12:28:49.478 INFO:tasks.workunit.client.0.smithi046.stdout:6/766: mknod d7/d1b/d47/cf5 0 2024-04-26T12:28:49.480 INFO:tasks.workunit.client.0.smithi046.stdout:2/787: creat d1/de/d15/d18/dc1/db6/f10f x:0 0 0 2024-04-26T12:28:49.481 INFO:tasks.workunit.client.0.smithi046.stdout:7/806: unlink d16/d1a/d31/d5a/f60 0 2024-04-26T12:28:49.481 INFO:tasks.workunit.client.0.smithi046.stdout:4/732: dwrite d0/da/d21/f73 [0,4194304] 0 2024-04-26T12:28:49.481 INFO:tasks.workunit.client.0.smithi046.stdout:0/850: dwrite d9/dc/dd/dd2/d10e/d11f/fc8 [0,4194304] 0 2024-04-26T12:28:49.482 INFO:tasks.workunit.client.0.smithi046.stdout:1/750: link d7/db/d98/dc5/l7f d7/d14/d5d/d32/d41/d8f/dd3/l102 0 2024-04-26T12:28:49.483 INFO:tasks.workunit.client.0.smithi046.stdout:7/807: symlink d16/d1a/d31/d55/d6d/l107 0 2024-04-26T12:28:49.483 INFO:tasks.workunit.client.0.smithi046.stdout:2/788: chown d1/de/d65/d4a/d58/fc0 59202465 1 2024-04-26T12:28:49.483 INFO:tasks.workunit.client.0.smithi046.stdout:0/851: unlink d9/dc/dd/l3d 0 2024-04-26T12:28:49.484 INFO:tasks.workunit.client.0.smithi046.stdout:7/808: creat d16/db1/dc0/f108 x:0 0 0 2024-04-26T12:28:49.484 INFO:tasks.workunit.client.0.smithi046.stdout:2/789: dread - d1/de/da4/ff5 zero size 2024-04-26T12:28:49.486 INFO:tasks.workunit.client.0.smithi046.stdout:0/852: symlink d9/d1d/d5d/d6b/l128 0 2024-04-26T12:28:49.486 INFO:tasks.workunit.client.0.smithi046.stdout:1/751: link d7/db/f8d d7/db/d98/dc5/d2b/d31/f103 0 2024-04-26T12:28:49.486 INFO:tasks.workunit.client.0.smithi046.stdout:2/790: dread - d1/de/d67/dc4/ff9 zero size 2024-04-26T12:28:49.486 INFO:tasks.workunit.client.0.smithi046.stdout:7/809: symlink d16/d1a/d31/d55/d6d/d89/l109 0 2024-04-26T12:28:49.486 INFO:tasks.workunit.client.0.smithi046.stdout:4/733: link d0/cac d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/dc0/cf9 0 2024-04-26T12:28:49.487 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:49.484+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:49.489 INFO:tasks.workunit.client.0.smithi046.stdout:1/752: truncate d7/d14/ff4 386842 0 2024-04-26T12:28:49.489 INFO:tasks.workunit.client.0.smithi046.stdout:0/853: mknod d9/d1d/d40/d41/d7e/ddd/de8/c129 0 2024-04-26T12:28:49.489 INFO:tasks.workunit.client.0.smithi046.stdout:2/791: unlink d1/d42/ccd 0 2024-04-26T12:28:49.490 INFO:tasks.workunit.client.0.smithi046.stdout:7/810: symlink d16/d1a/d31/d55/d6d/l10a 0 2024-04-26T12:28:49.490 INFO:tasks.workunit.client.0.smithi046.stdout:3/805: dwrite d2/d16/d2c/d50/d71/d89/f9e [0,4194304] 0 2024-04-26T12:28:49.490 INFO:tasks.workunit.client.0.smithi046.stdout:4/734: creat d0/da/d17/d20/d25/ffa x:0 0 0 2024-04-26T12:28:49.490 INFO:tasks.workunit.client.0.smithi046.stdout:1/753: write d7/f9d [1500306,128612] 0 2024-04-26T12:28:49.490 INFO:tasks.workunit.client.0.smithi046.stdout:8/892: truncate d7/f99 1600388 0 2024-04-26T12:28:49.490 INFO:tasks.workunit.client.0.smithi046.stdout:7/811: stat d16/d1a/d3e/d59 0 2024-04-26T12:28:49.491 INFO:tasks.workunit.client.0.smithi046.stdout:4/735: mkdir d0/da/da1/dfb 0 2024-04-26T12:28:49.492 INFO:tasks.workunit.client.0.smithi046.stdout:3/806: write d2/d16/d35/dbc/dc9/dd0/f110 [717998,94455] 0 2024-04-26T12:28:49.492 INFO:tasks.workunit.client.0.smithi046.stdout:4/736: chown d0/da/d17/l78 428521 1 2024-04-26T12:28:49.492 INFO:tasks.workunit.client.0.smithi046.stdout:1/754: rename d7/d12/faf to d7/db/dee/f104 0 2024-04-26T12:28:49.494 INFO:tasks.workunit.client.0.smithi046.stdout:7/812: truncate d16/d1a/d31/d55/d6d/d89/dc7/fe3 909677 0 2024-04-26T12:28:49.495 INFO:tasks.workunit.client.0.smithi046.stdout:4/737: rename d0/d1/l85 to d0/da/d17/d20/d25/d35/d6d/d19/lfc 0 2024-04-26T12:28:49.496 INFO:tasks.workunit.client.0.smithi046.stdout:7/813: creat d16/d27/d7e/f10b x:0 0 0 2024-04-26T12:28:49.498 INFO:tasks.workunit.client.0.smithi046.stdout:9/685: sync 2024-04-26T12:28:49.498 INFO:tasks.workunit.client.0.smithi046.stdout:8/893: dwrite d7/da/df/f11d [0,4194304] 0 2024-04-26T12:28:49.499 INFO:tasks.workunit.client.0.smithi046.stdout:0/854: sync 2024-04-26T12:28:49.499 INFO:tasks.workunit.client.0.smithi046.stdout:7/814: creat d16/d27/f10c x:0 0 0 2024-04-26T12:28:49.499 INFO:tasks.workunit.client.0.smithi046.stdout:5/856: dread d9/da/f10 [0,4194304] 0 2024-04-26T12:28:49.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/807: truncate d2/d16/d2c/d50/d71/d89/dc5/d82/ff5 558092 0 2024-04-26T12:28:49.500 INFO:tasks.workunit.client.0.smithi046.stdout:1/755: dread d7/d14/d5d/d32/d41/d8f/fa7 [0,4194304] 0 2024-04-26T12:28:49.500 INFO:tasks.workunit.client.0.smithi046.stdout:9/686: mknod d0/d2c/dbd/cf7 0 2024-04-26T12:28:49.500 INFO:tasks.workunit.client.0.smithi046.stdout:7/815: readlink d16/d1a/d69/lb4 0 2024-04-26T12:28:49.501 INFO:tasks.workunit.client.0.smithi046.stdout:8/894: mkdir d7/d11a/db6/dda/de2/d12a 0 2024-04-26T12:28:49.501 INFO:tasks.workunit.client.0.smithi046.stdout:4/738: dread d0/da/da1/f6e [0,4194304] 0 2024-04-26T12:28:49.502 INFO:tasks.workunit.client.0.smithi046.stdout:6/767: dwrite d7/d2b/d31/f43 [4194304,4194304] 0 2024-04-26T12:28:49.503 INFO:tasks.workunit.client.0.smithi046.stdout:4/739: fdatasync d0/d64/faa 0 2024-04-26T12:28:49.503 INFO:tasks.workunit.client.0.smithi046.stdout:1/756: mkdir d7/d14/d5d/d6b/d105 0 2024-04-26T12:28:49.503 INFO:tasks.workunit.client.0.smithi046.stdout:7/816: mkdir d16/d104/d10d 0 2024-04-26T12:28:49.504 INFO:tasks.workunit.client.0.smithi046.stdout:0/855: creat d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d108/f12a x:0 0 0 2024-04-26T12:28:49.504 INFO:tasks.workunit.client.0.smithi046.stdout:8/895: mkdir d7/d11a/db6/dda/de2/d12b 0 2024-04-26T12:28:49.504 INFO:tasks.workunit.client.0.smithi046.stdout:7/817: fdatasync f6 0 2024-04-26T12:28:49.504 INFO:tasks.workunit.client.0.smithi046.stdout:3/808: rename d2/f8e to d2/d16/d2c/d50/d71/d89/f119 0 2024-04-26T12:28:49.506 INFO:tasks.workunit.client.0.smithi046.stdout:9/687: creat d0/d2c/dda/d76/d7d/d72/da1/dc8/ff8 x:0 0 0 2024-04-26T12:28:49.508 INFO:tasks.workunit.client.0.smithi046.stdout:0/856: chown d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/l8e 383265 1 2024-04-26T12:28:49.509 INFO:tasks.workunit.client.0.smithi046.stdout:3/809: link d2/d16/d35/dbc/dc9/dd0/fe9 d2/db/d84/da5/de6/f11a 0 2024-04-26T12:28:49.510 INFO:tasks.workunit.client.0.smithi046.stdout:2/792: dread d1/de/d65/f56 [0,4194304] 0 2024-04-26T12:28:49.510 INFO:tasks.workunit.client.0.smithi046.stdout:9/688: read d0/d2c/d3d/d52/f5a [3955436,32431] 0 2024-04-26T12:28:49.511 INFO:tasks.workunit.client.0.smithi046.stdout:0/857: write d9/d1d/d40/d41/ff8 [1657787,95365] 0 2024-04-26T12:28:49.511 INFO:tasks.workunit.client.0.smithi046.stdout:3/810: write d2/db/d84/da5/fb2 [119496,75215] 0 2024-04-26T12:28:49.512 INFO:tasks.workunit.client.0.smithi046.stdout:5/857: dwrite d9/da/d40/ff0 [0,4194304] 0 2024-04-26T12:28:49.513 INFO:tasks.workunit.client.0.smithi046.stdout:4/740: dwrite d0/d1/d5/db/f2f [4194304,4194304] 0 2024-04-26T12:28:49.513 INFO:tasks.workunit.client.0.smithi046.stdout:9/689: write d0/d2c/f4e [457672,48192] 0 2024-04-26T12:28:49.513 INFO:tasks.workunit.client.0.smithi046.stdout:7/818: dwrite d16/d1a/fcb [0,4194304] 0 2024-04-26T12:28:49.515 INFO:tasks.workunit.client.0.smithi046.stdout:3/811: rmdir d2/db/d84/da5/de6 39 2024-04-26T12:28:49.515 INFO:tasks.workunit.client.0.smithi046.stdout:9/690: write d0/d2c/d47/f46 [5153182,82479] 0 2024-04-26T12:28:49.515 INFO:tasks.workunit.client.0.smithi046.stdout:3/812: chown d2/f107 0 1 2024-04-26T12:28:49.515 INFO:tasks.workunit.client.0.smithi046.stdout:0/858: symlink d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d10f/l12b 0 2024-04-26T12:28:49.516 INFO:tasks.workunit.client.0.smithi046.stdout:5/858: creat d9/da/dd/d34/d44/d97/da4/f123 x:0 0 0 2024-04-26T12:28:49.516 INFO:tasks.workunit.client.0.smithi046.stdout:9/691: symlink d0/d2c/dbd/lf9 0 2024-04-26T12:28:49.519 INFO:tasks.workunit.client.0.smithi046.stdout:9/692: mknod d0/d2c/cfa 0 2024-04-26T12:28:49.519 INFO:tasks.workunit.client.0.smithi046.stdout:6/768: truncate d7/d1b/d47/f97 3510944 0 2024-04-26T12:28:49.519 INFO:tasks.workunit.client.0.smithi046.stdout:5/859: write d9/da/dd/d34/d44/d97/da4/dde/ff2 [375807,104606] 0 2024-04-26T12:28:49.520 INFO:tasks.workunit.client.0.smithi046.stdout:8/896: write d7/d1c/d74/df4/d27/f103 [707429,94907] 0 2024-04-26T12:28:49.521 INFO:tasks.workunit.client.0.smithi046.stdout:4/741: dwrite d0/da/d17/d20/f69 [0,4194304] 0 2024-04-26T12:28:49.522 INFO:tasks.workunit.client.0.smithi046.stdout:3/813: rename d2/d16/f34 to d2/d16/d2c/d50/d71/df6/f11b 0 2024-04-26T12:28:49.525 INFO:tasks.workunit.client.0.smithi046.stdout:7/819: dwrite d16/d1a/d31/d55/d6d/fcc [0,4194304] 0 2024-04-26T12:28:49.525 INFO:tasks.workunit.client.0.smithi046.stdout:8/897: symlink d7/d24/d56/l12c 0 2024-04-26T12:28:49.525 INFO:tasks.workunit.client.0.smithi046.stdout:1/757: dwrite d7/db/d98/dc5/d2b/d39/db3/f90 [4194304,4194304] 0 2024-04-26T12:28:49.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/742: mknod d0/da/d17/d20/cfd 0 2024-04-26T12:28:49.527 INFO:tasks.workunit.client.0.smithi046.stdout:6/769: rename d7/d1b/d47/d65/da3/cf4 to d7/d2b/d31/d4d/cf6 0 2024-04-26T12:28:49.527 INFO:tasks.workunit.client.0.smithi046.stdout:3/814: symlink d2/l11c 0 2024-04-26T12:28:49.528 INFO:tasks.workunit.client.0.smithi046.stdout:4/743: stat d0/da/da1/f34 0 2024-04-26T12:28:49.528 INFO:tasks.workunit.client.0.smithi046.stdout:7/820: chown d16/d1a/d31/d55/d6d/d89/dc7/ld2 1085 1 2024-04-26T12:28:49.528 INFO:tasks.workunit.client.0.smithi046.stdout:3/815: creat d2/deb/f11d x:0 0 0 2024-04-26T12:28:49.531 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:49.531 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:49.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:49.532 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:49.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.532 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:293 3.13 3:ceffbd45:::200.0000000a:head [write 594763~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.532 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:49.532 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.6008681429999996, 2024-04-26T12:28:49.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038803585000000002, 2024-04-26T12:28:49.533 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.533 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.533 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:49.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:49.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924874+0000", 2024-04-26T12:28:49.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924877+0000", 2024-04-26T12:28:49.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7329999999999999e-06 2024-04-26T12:28:49.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924884+0000", 2024-04-26T12:28:49.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:28:49.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924890+0000", 2024-04-26T12:28:49.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:28:49.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958764+0000", 2024-04-26T12:28:49.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.033873863999999997 2024-04-26T12:28:49.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958855+0000", 2024-04-26T12:28:49.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1402000000000003e-05 2024-04-26T12:28:49.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963608+0000", 2024-04-26T12:28:49.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047529039999999996 2024-04-26T12:28:49.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963636+0000", 2024-04-26T12:28:49.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8194000000000001e-05 2024-04-26T12:28:49.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963678+0000", 2024-04-26T12:28:49.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2095999999999998e-05 2024-04-26T12:28:49.543 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.543 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.543 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.544 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:294 3.13 3:ceffbd45:::200.0000000a:head [write 596172~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.544 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:49.544 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.6008233990000003, 2024-04-26T12:28:49.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041225228000000003, 2024-04-26T12:28:49.545 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.545 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.545 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:49.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:49.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924919+0000", 2024-04-26T12:28:49.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924922+0000", 2024-04-26T12:28:49.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9160000000000001e-06 2024-04-26T12:28:49.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924928+0000", 2024-04-26T12:28:49.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3929999999999996e-06 2024-04-26T12:28:49.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924933+0000", 2024-04-26T12:28:49.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7820000000000001e-06 2024-04-26T12:28:49.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959359+0000", 2024-04-26T12:28:49.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034425782000000002 2024-04-26T12:28:49.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959439+0000", 2024-04-26T12:28:49.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0275e-05 2024-04-26T12:28:49.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966079+0000", 2024-04-26T12:28:49.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0066397089999999997 2024-04-26T12:28:49.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966106+0000", 2024-04-26T12:28:49.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7178e-05 2024-04-26T12:28:49.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966145+0000", 2024-04-26T12:28:49.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8618999999999997e-05 2024-04-26T12:28:49.555 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.555 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.555 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.556 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:295 3.13 3:ceffbd45:::200.0000000a:head [write 597574~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.556 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:49.556 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.6007972490000002, 2024-04-26T12:28:49.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041258571000000001, 2024-04-26T12:28:49.557 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.557 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.557 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:49.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:49.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924945+0000", 2024-04-26T12:28:49.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924948+0000", 2024-04-26T12:28:49.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:28:49.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924955+0000", 2024-04-26T12:28:49.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4629999999999998e-06 2024-04-26T12:28:49.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924959+0000", 2024-04-26T12:28:49.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2719999999999999e-06 2024-04-26T12:28:49.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959957+0000", 2024-04-26T12:28:49.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034997588000000003 2024-04-26T12:28:49.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960042+0000", 2024-04-26T12:28:49.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5811999999999998e-05 2024-04-26T12:28:49.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966149+0000", 2024-04-26T12:28:49.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061071650000000003 2024-04-26T12:28:49.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966171+0000", 2024-04-26T12:28:49.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1905000000000001e-05 2024-04-26T12:28:49.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966204+0000", 2024-04-26T12:28:49.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2845999999999997e-05 2024-04-26T12:28:49.566 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.567 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.567 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.567 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:296 3.13 3:ceffbd45:::200.0000000a:head [write 598977~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.568 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:49.568 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.6007656189999997, 2024-04-26T12:28:49.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041282538000000001, 2024-04-26T12:28:49.568 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.568 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.568 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:49.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:49.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:49.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:49.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924979+0000", 2024-04-26T12:28:49.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3609999999999999e-06 2024-04-26T12:28:49.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924984+0000", 2024-04-26T12:28:49.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3259999999999997e-06 2024-04-26T12:28:49.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924987+0000", 2024-04-26T12:28:49.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7810000000000001e-06 2024-04-26T12:28:49.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960618+0000", 2024-04-26T12:28:49.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035631875 2024-04-26T12:28:49.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960698+0000", 2024-04-26T12:28:49.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9373000000000001e-05 2024-04-26T12:28:49.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966208+0000", 2024-04-26T12:28:49.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055104359999999996 2024-04-26T12:28:49.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966228+0000", 2024-04-26T12:28:49.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0208e-05 2024-04-26T12:28:49.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966260+0000", 2024-04-26T12:28:49.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1404e-05 2024-04-26T12:28:49.574 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.574 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.574 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:297 3.13 3:ceffbd45:::200.0000000a:head [write 600380~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.6007287850000003, 2024-04-26T12:28:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041309850000000002, 2024-04-26T12:28:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:49.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:49.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925017+0000", 2024-04-26T12:28:49.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.96e-06 2024-04-26T12:28:49.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925020+0000", 2024-04-26T12:28:49.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6629999999999999e-06 2024-04-26T12:28:49.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925023+0000", 2024-04-26T12:28:49.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:28:49.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961241+0000", 2024-04-26T12:28:49.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036217390000000002 2024-04-26T12:28:49.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961335+0000", 2024-04-26T12:28:49.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4537000000000006e-05 2024-04-26T12:28:49.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966264+0000", 2024-04-26T12:28:49.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004928516 2024-04-26T12:28:49.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966290+0000", 2024-04-26T12:28:49.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5658999999999999e-05 2024-04-26T12:28:49.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966324+0000", 2024-04-26T12:28:49.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4459000000000003e-05 2024-04-26T12:28:49.580 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.580 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.580 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.580 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:298 3.13 3:ceffbd45:::200.0000000a:head [write 602634~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.580 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:49.581 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.6006961899999999, 2024-04-26T12:28:49.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046387536, 2024-04-26T12:28:49.581 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.581 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.581 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:49.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:49.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925046+0000", 2024-04-26T12:28:49.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:49.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925049+0000", 2024-04-26T12:28:49.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4770000000000002e-06 2024-04-26T12:28:49.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925057+0000", 2024-04-26T12:28:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9219999999999997e-06 2024-04-26T12:28:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925062+0000", 2024-04-26T12:28:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:28:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961918+0000", 2024-04-26T12:28:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036856170000000001 2024-04-26T12:28:49.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962014+0000", 2024-04-26T12:28:49.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6731999999999995e-05 2024-04-26T12:28:49.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971360+0000", 2024-04-26T12:28:49.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0093454569999999997 2024-04-26T12:28:49.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971393+0000", 2024-04-26T12:28:49.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3130999999999998e-05 2024-04-26T12:28:49.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971434+0000", 2024-04-26T12:28:49.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1244e-05 2024-04-26T12:28:49.585 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.585 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.585 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.585 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:299 3.13 3:ceffbd45:::200.0000000a:head [write 604033~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.586 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:49.586 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.6006423590000001, 2024-04-26T12:28:49.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046395615000000001, 2024-04-26T12:28:49.586 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.586 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.586 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:49.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:49.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925100+0000", 2024-04-26T12:28:49.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925103+0000", 2024-04-26T12:28:49.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3520000000000001e-06 2024-04-26T12:28:49.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925108+0000", 2024-04-26T12:28:49.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6489999999999996e-06 2024-04-26T12:28:49.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925111+0000", 2024-04-26T12:28:49.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.79e-06 2024-04-26T12:28:49.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962405+0000", 2024-04-26T12:28:49.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037293953999999997 2024-04-26T12:28:49.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962457+0000", 2024-04-26T12:28:49.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2003000000000003e-05 2024-04-26T12:28:49.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971440+0000", 2024-04-26T12:28:49.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0089831719999999993 2024-04-26T12:28:49.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971463+0000", 2024-04-26T12:28:49.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3201e-05 2024-04-26T12:28:49.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971496+0000", 2024-04-26T12:28:49.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2836000000000002e-05 2024-04-26T12:28:49.590 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.590 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.590 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.590 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:300 3.13 3:ceffbd45:::200.0000000a:head [write 605436~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.591 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:49.591 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.6005785010000002, 2024-04-26T12:28:49.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046389606999999999, 2024-04-26T12:28:49.591 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.591 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.591 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:49.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:49.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:49.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925167+0000", 2024-04-26T12:28:49.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8870000000000001e-06 2024-04-26T12:28:49.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925171+0000", 2024-04-26T12:28:49.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6049999999999998e-06 2024-04-26T12:28:49.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925173+0000", 2024-04-26T12:28:49.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8250000000000001e-06 2024-04-26T12:28:49.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962740+0000", 2024-04-26T12:28:49.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037566436000000002 2024-04-26T12:28:49.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962818+0000", 2024-04-26T12:28:49.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8231000000000004e-05 2024-04-26T12:28:49.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971501+0000", 2024-04-26T12:28:49.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008682525 2024-04-26T12:28:49.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971522+0000", 2024-04-26T12:28:49.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1673999999999999e-05 2024-04-26T12:28:49.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971554+0000", 2024-04-26T12:28:49.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1786999999999999e-05 2024-04-26T12:28:49.595 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.595 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.595 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:301 3.13 3:ceffbd45:::200.0000000a:head [write 606838~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.6005618930000001, 2024-04-26T12:28:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046429455000000001, 2024-04-26T12:28:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:49.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:49.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:49.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925183+0000", 2024-04-26T12:28:49.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0150000000000002e-06 2024-04-26T12:28:49.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925186+0000", 2024-04-26T12:28:49.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2210000000000002e-06 2024-04-26T12:28:49.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925190+0000", 2024-04-26T12:28:49.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8489999999999999e-06 2024-04-26T12:28:49.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963304+0000", 2024-04-26T12:28:49.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038114207999999997 2024-04-26T12:28:49.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963356+0000", 2024-04-26T12:28:49.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1628000000000001e-05 2024-04-26T12:28:49.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971558+0000", 2024-04-26T12:28:49.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082025199999999996 2024-04-26T12:28:49.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971579+0000", 2024-04-26T12:28:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1019e-05 2024-04-26T12:28:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971610+0000", 2024-04-26T12:28:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1205999999999999e-05 2024-04-26T12:28:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:302 3.13 3:ceffbd45:::200.0000000a:head [write 608236~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.601 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:49.601 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.6005406999999998, 2024-04-26T12:28:49.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046464057000000003, 2024-04-26T12:28:49.601 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.601 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.601 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:49.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:49.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:49.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925204+0000", 2024-04-26T12:28:49.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1270000000000001e-06 2024-04-26T12:28:49.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925207+0000", 2024-04-26T12:28:49.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3720000000000001e-06 2024-04-26T12:28:49.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925210+0000", 2024-04-26T12:28:49.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7489999999999999e-06 2024-04-26T12:28:49.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963713+0000", 2024-04-26T12:28:49.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038502508999999997 2024-04-26T12:28:49.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963792+0000", 2024-04-26T12:28:49.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9087999999999999e-05 2024-04-26T12:28:49.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971615+0000", 2024-04-26T12:28:49.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078230130000000002 2024-04-26T12:28:49.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971636+0000", 2024-04-26T12:28:49.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0996999999999999e-05 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971666+0000", 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0443999999999999e-05 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:303 3.13 3:ceffbd45:::200.0000000a:head [write 609649~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.6004976790000001, 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.047363031, 2024-04-26T12:28:49.605 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.606 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.606 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:49.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:49.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:49.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925253+0000", 2024-04-26T12:28:49.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0369999999999995e-06 2024-04-26T12:28:49.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925261+0000", 2024-04-26T12:28:49.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7420000000000003e-06 2024-04-26T12:28:49.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925271+0000", 2024-04-26T12:28:49.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1589999999999999e-06 2024-04-26T12:28:49.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964198+0000", 2024-04-26T12:28:49.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038927182999999997 2024-04-26T12:28:49.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964281+0000", 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3355000000000004e-05 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972542+0000", 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082607930000000006 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972570+0000", 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7937999999999999e-05 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972608+0000", 2024-04-26T12:28:49.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8384999999999999e-05 2024-04-26T12:28:49.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.610 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.610 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:304 3.13 3:ceffbd45:::200.0000000a:head [write 611057~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.610 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:49.610 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.5993320500000001, 2024-04-26T12:28:49.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046259867000000003, 2024-04-26T12:28:49.610 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.610 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.610 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:49.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:49.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926410+0000", 2024-04-26T12:28:49.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926415+0000", 2024-04-26T12:28:49.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7999999999999998e-06 2024-04-26T12:28:49.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926423+0000", 2024-04-26T12:28:49.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8569999999999995e-06 2024-04-26T12:28:49.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926429+0000", 2024-04-26T12:28:49.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.421e-06 2024-04-26T12:28:49.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964778+0000", 2024-04-26T12:28:49.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038349045999999998 2024-04-26T12:28:49.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964830+0000", 2024-04-26T12:28:49.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1309e-05 2024-04-26T12:28:49.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972614+0000", 2024-04-26T12:28:49.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077847070000000001 2024-04-26T12:28:49.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972638+0000", 2024-04-26T12:28:49.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3388999999999999e-05 2024-04-26T12:28:49.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972671+0000", 2024-04-26T12:28:49.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2999e-05 2024-04-26T12:28:49.615 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.615 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.615 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.615 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:305 3.13 3:ceffbd45:::200.0000000a:head [write 613824~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.615 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:49.615 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.5992870110000004, 2024-04-26T12:28:49.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046273460000000002, 2024-04-26T12:28:49.615 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.615 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.616 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:49.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:49.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:49.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926463+0000", 2024-04-26T12:28:49.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:28:49.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926467+0000", 2024-04-26T12:28:49.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3000000000000003e-06 2024-04-26T12:28:49.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926470+0000", 2024-04-26T12:28:49.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1930000000000002e-06 2024-04-26T12:28:49.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965122+0000", 2024-04-26T12:28:49.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038652207000000001 2024-04-26T12:28:49.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965210+0000", 2024-04-26T12:28:49.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7832999999999997e-05 2024-04-26T12:28:49.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972675+0000", 2024-04-26T12:28:49.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074651450000000003 2024-04-26T12:28:49.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972696+0000", 2024-04-26T12:28:49.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0871999999999999e-05 2024-04-26T12:28:49.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972729+0000", 2024-04-26T12:28:49.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:28:49.620 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.620 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.620 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.620 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:306 3.13 3:ceffbd45:::200.0000000a:head [write 618844~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.620 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:49.620 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.5984442659999996, 2024-04-26T12:28:49.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.04548866, 2024-04-26T12:28:49.620 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.620 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.620 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:49.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:49.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927298+0000", 2024-04-26T12:28:49.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927303+0000", 2024-04-26T12:28:49.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6079999999999998e-06 2024-04-26T12:28:49.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927310+0000", 2024-04-26T12:28:49.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6240000000000002e-06 2024-04-26T12:28:49.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927319+0000", 2024-04-26T12:28:49.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:28:49.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965791+0000", 2024-04-26T12:28:49.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038471350000000001 2024-04-26T12:28:49.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965839+0000", 2024-04-26T12:28:49.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8647999999999999e-05 2024-04-26T12:28:49.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972735+0000", 2024-04-26T12:28:49.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068952429999999997 2024-04-26T12:28:49.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972755+0000", 2024-04-26T12:28:49.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0219000000000001e-05 2024-04-26T12:28:49.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972787+0000", 2024-04-26T12:28:49.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2450000000000003e-05 2024-04-26T12:28:49.625 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.625 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.625 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.625 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:307 3.13 3:ceffbd45:::200.0000000a:head [write 621801~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.625 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:49.625 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.5983947010000001, 2024-04-26T12:28:49.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.045498166, 2024-04-26T12:28:49.625 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.625 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.626 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:49.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:49.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:49.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927351+0000", 2024-04-26T12:28:49.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7130000000000001e-06 2024-04-26T12:28:49.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927355+0000", 2024-04-26T12:28:49.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1339999999999997e-06 2024-04-26T12:28:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927358+0000", 2024-04-26T12:28:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:28:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966366+0000", 2024-04-26T12:28:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039008207000000003 2024-04-26T12:28:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966457+0000", 2024-04-26T12:28:49.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1144999999999996e-05 2024-04-26T12:28:49.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972792+0000", 2024-04-26T12:28:49.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0063344819999999998 2024-04-26T12:28:49.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972815+0000", 2024-04-26T12:28:49.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3336000000000002e-05 2024-04-26T12:28:49.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972846+0000", 2024-04-26T12:28:49.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1504000000000002e-05 2024-04-26T12:28:49.630 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.630 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.630 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.630 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:308 3.13 3:ceffbd45:::200.0000000a:head [write 623718~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.630 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:49.630 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.5967166559999999, 2024-04-26T12:28:49.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043878271000000003, 2024-04-26T12:28:49.630 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.630 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.630 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:49.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:49.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:49.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929042+0000", 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6039e-05 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929054+0000", 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2275e-05 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929063+0000", 2024-04-26T12:28:49.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7150000000000004e-06 2024-04-26T12:28:49.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967060+0000", 2024-04-26T12:28:49.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037996907000000003 2024-04-26T12:28:49.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967117+0000", 2024-04-26T12:28:49.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7701999999999997e-05 2024-04-26T12:28:49.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972850+0000", 2024-04-26T12:28:49.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0057332679999999997 2024-04-26T12:28:49.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972872+0000", 2024-04-26T12:28:49.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1138999999999999e-05 2024-04-26T12:28:49.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972905+0000", 2024-04-26T12:28:49.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2904999999999998e-05 2024-04-26T12:28:49.634 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.634 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.634 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:309 3.13 3:ceffbd45:::200.0000000a:head [write 638707~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.595893545, 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043114311000000002, 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929853+0000", 2024-04-26T12:28:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2690000000000001e-06 2024-04-26T12:28:49.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929861+0000", 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.515e-06 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929867+0000", 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4640000000000003e-06 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967590+0000", 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037722506000000003 2024-04-26T12:28:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967672+0000", 2024-04-26T12:28:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2082000000000005e-05 2024-04-26T12:28:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972908+0000", 2024-04-26T12:28:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052366289999999996 2024-04-26T12:28:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972929+0000", 2024-04-26T12:28:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0752999999999999e-05 2024-04-26T12:28:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972964+0000", 2024-04-26T12:28:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4666999999999999e-05 2024-04-26T12:28:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:310 3.13 3:ceffbd45:::200.0000000a:head [write 641140~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.5958462720000002, 2024-04-26T12:28:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043126171999999997, 2024-04-26T12:28:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929896+0000", 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929899+0000", 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929903+0000", 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.087e-06 2024-04-26T12:28:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929907+0000", 2024-04-26T12:28:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1480000000000002e-06 2024-04-26T12:28:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.969962+0000", 2024-04-26T12:28:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040055457000000003 2024-04-26T12:28:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970018+0000", 2024-04-26T12:28:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6209999999999999e-05 2024-04-26T12:28:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972968+0000", 2024-04-26T12:28:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029501689999999999 2024-04-26T12:28:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972989+0000", 2024-04-26T12:28:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0618000000000001e-05 2024-04-26T12:28:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.973023+0000", 2024-04-26T12:28:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-26T12:28:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:312 3.13 3:ceffbd45:::200.0000000a:head [write 648907~1910 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.5905170169999998, 2024-04-26T12:28:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039844011999999998, 2024-04-26T12:28:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935225+0000", 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935229+0000", 2024-04-26T12:28:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1790000000000001e-06 2024-04-26T12:28:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935235+0000", 2024-04-26T12:28:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.716e-06 2024-04-26T12:28:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935239+0000", 2024-04-26T12:28:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5379999999999998e-06 2024-04-26T12:28:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970917+0000", 2024-04-26T12:28:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035678223000000002 2024-04-26T12:28:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971006+0000", 2024-04-26T12:28:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9248999999999999e-05 2024-04-26T12:28:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.974984+0000", 2024-04-26T12:28:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039776769999999998 2024-04-26T12:28:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975031+0000", 2024-04-26T12:28:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7500000000000003e-05 2024-04-26T12:28:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975070+0000", 2024-04-26T12:28:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8509e-05 2024-04-26T12:28:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:313 3.13 3:ceffbd45:::200.0000000a:head [write 650817~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 6.5902906889999997, 2024-04-26T12:28:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040236782999999998, 2024-04-26T12:28:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935451+0000", 2024-04-26T12:28:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935457+0000", 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5079999999999996e-06 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935467+0000", 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0407e-05 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935477+0000", 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3989999999999993e-06 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971691+0000", 2024-04-26T12:28:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036214534 2024-04-26T12:28:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971741+0000", 2024-04-26T12:28:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0294000000000003e-05 2024-04-26T12:28:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975619+0000", 2024-04-26T12:28:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038779259999999999 2024-04-26T12:28:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975647+0000", 2024-04-26T12:28:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:28:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975689+0000", 2024-04-26T12:28:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2055999999999998e-05 2024-04-26T12:28:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:49.654 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:49.658 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:49.658 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:49.655+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:49.670 INFO:tasks.workunit.client.0.smithi046.stdout:7/821: unlink d16/d27/l75 0 2024-04-26T12:28:49.670 INFO:tasks.workunit.client.0.smithi046.stdout:1/758: creat d7/db/d98/dc5/d2b/d39/d3c/f106 x:0 0 0 2024-04-26T12:28:49.670 INFO:tasks.workunit.client.0.smithi046.stdout:6/770: chown d7/d1b/d37/f76 324090 1 2024-04-26T12:28:49.670 INFO:tasks.workunit.client.0.smithi046.stdout:8/898: readlink d7/d1c/d74/df4/d1b/dae/lfa 0 2024-04-26T12:28:49.670 INFO:tasks.workunit.client.0.smithi046.stdout:9/693: dwrite d0/d29/d69/f77 [0,4194304] 0 2024-04-26T12:28:49.670 INFO:tasks.workunit.client.0.smithi046.stdout:4/744: write d0/d1/f15 [255517,86434] 0 2024-04-26T12:28:49.670 INFO:tasks.workunit.client.0.smithi046.stdout:7/822: chown d16/d1a/d31/l7d 14465 1 2024-04-26T12:28:49.670 INFO:tasks.workunit.client.0.smithi046.stdout:8/899: dread - d7/d24/d50/d2a/d39/da6/df1/f115 zero size 2024-04-26T12:28:49.670 INFO:tasks.workunit.client.0.smithi046.stdout:4/745: readlink d0/da/d21/dcf/lf2 0 2024-04-26T12:28:49.670 INFO:tasks.workunit.client.0.smithi046.stdout:7/823: fsync d16/d4e/d6c/fdd 0 2024-04-26T12:28:49.670 INFO:tasks.workunit.client.0.smithi046.stdout:6/771: mkdir d7/d1b/d47/d65/d77/df7 0 2024-04-26T12:28:49.670 INFO:tasks.workunit.client.0.smithi046.stdout:3/816: getdents d2/db/d4a 0 2024-04-26T12:28:49.671 INFO:tasks.workunit.client.0.smithi046.stdout:6/772: rename d7 to d7/da7/dd1/dd6/df8 22 2024-04-26T12:28:49.671 INFO:tasks.workunit.client.0.smithi046.stdout:7/824: getdents d16/db1 0 2024-04-26T12:28:49.671 INFO:tasks.workunit.client.0.smithi046.stdout:8/900: link d7/d24/d50/d2a/d54/l5f d7/d1c/d74/df4/d1b/l12d 0 2024-04-26T12:28:49.671 INFO:tasks.workunit.client.0.smithi046.stdout:3/817: getdents d2/d16/d2c/d50/d71/d89/dc5/d23 0 2024-04-26T12:28:49.671 INFO:tasks.workunit.client.0.smithi046.stdout:6/773: mkdir d7/d1b/d37/daa/df9 0 2024-04-26T12:28:49.671 INFO:tasks.workunit.client.0.smithi046.stdout:4/746: read d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/f90 [2588627,56614] 0 2024-04-26T12:28:49.671 INFO:tasks.workunit.client.0.smithi046.stdout:1/759: read d7/d12/f60 [66432,82211] 0 2024-04-26T12:28:49.671 INFO:tasks.workunit.client.0.smithi046.stdout:3/818: creat d2/d16/f11e x:0 0 0 2024-04-26T12:28:49.671 INFO:tasks.workunit.client.0.smithi046.stdout:5/860: write d9/da/d15/f122 [2233331,104982] 0 2024-04-26T12:28:49.671 INFO:tasks.workunit.client.0.smithi046.stdout:3/819: sync 2024-04-26T12:28:49.671 INFO:tasks.workunit.client.0.smithi046.stdout:8/901: rename d7/d1c/d74/df4/d1b/dae/fe1 to d7/da/f12e 0 2024-04-26T12:28:49.671 INFO:tasks.workunit.client.0.smithi046.stdout:4/747: mkdir d0/da/dfe 0 2024-04-26T12:28:49.671 INFO:tasks.workunit.client.0.smithi046.stdout:8/902: mkdir d7/d11a/d12f 0 2024-04-26T12:28:49.671 INFO:tasks.workunit.client.0.smithi046.stdout:1/760: chown d7/db/d98/dc5/d2b/la1 2064294 1 2024-04-26T12:28:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:6/774: link d7/d2b/f83 d7/d1b/d47/d65/da3/de5/ffa 0 2024-04-26T12:28:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:2/793: dread d1/de/d65/d4a/d58/f9d [0,4194304] 0 2024-04-26T12:28:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:6/775: sync 2024-04-26T12:28:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:7/825: dwrite f5 [0,4194304] 0 2024-04-26T12:28:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:9/694: dread d0/d19/f50 [0,4194304] 0 2024-04-26T12:28:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:1/761: write d7/d12/f99 [466247,1533] 0 2024-04-26T12:28:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:7/826: fsync d16/db1/dc0/f108 0 2024-04-26T12:28:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:2/794: fdatasync d1/de/d65/d4a/f82 0 2024-04-26T12:28:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:5/861: creat d9/da/dd/d34/d44/d97/da4/f124 x:0 0 0 2024-04-26T12:28:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:8/903: symlink d7/d1c/d74/df4/d1b/dae/l130 0 2024-04-26T12:28:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:6/776: creat d7/d1b/d37/d95/def/ffb x:0 0 0 2024-04-26T12:28:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:4/748: write d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/f72 [4624083,20784] 0 2024-04-26T12:28:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:8/904: stat d7/d24/d50/f89 0 2024-04-26T12:28:49.672 INFO:tasks.workunit.client.0.smithi046.stdout:7/827: readlink d16/d27/d51/l61 0 2024-04-26T12:28:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:6/777: creat d7/d16/ffc x:0 0 0 2024-04-26T12:28:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:8/905: mkdir d7/da/d88/d131 0 2024-04-26T12:28:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:1/762: read d7/d14/d5d/d6b/dc2/f43 [1268522,62187] 0 2024-04-26T12:28:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:7/828: rename d16/d1a/d31/cc2 to d16/d4e/c10e 0 2024-04-26T12:28:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:5/862: link d9/da/d18/f2d d9/da/dd/dd7/d7e/d10e/f125 0 2024-04-26T12:28:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:8/906: creat d7/d24/d50/d2a/d54/df3/f132 x:0 0 0 2024-04-26T12:28:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:7/829: stat d16/d27/l30 0 2024-04-26T12:28:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:3/820: dwrite d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d/fde [0,4194304] 0 2024-04-26T12:28:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:6/778: write d7/d1b/d47/d65/d77/d92/fb3 [2479486,82313] 0 2024-04-26T12:28:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:7/830: fdatasync d16/d1a/d31/d55/d6d/ff6 0 2024-04-26T12:28:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:5/863: mknod d9/da/d40/dfa/d11a/c126 0 2024-04-26T12:28:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:6/779: creat d7/d1b/d6a/d57/ffd x:0 0 0 2024-04-26T12:28:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:7/831: chown d16/d3f/d81/daa 153 1 2024-04-26T12:28:49.673 INFO:tasks.workunit.client.0.smithi046.stdout:3/821: creat d2/deb/dfd/f11f x:0 0 0 2024-04-26T12:28:49.674 INFO:tasks.workunit.client.0.smithi046.stdout:9/695: truncate d0/d29/f89 3165936 0 2024-04-26T12:28:49.674 INFO:tasks.workunit.client.0.smithi046.stdout:4/749: dread d0/da/d17/d20/f7f [0,4194304] 0 2024-04-26T12:28:49.674 INFO:tasks.workunit.client.0.smithi046.stdout:5/864: write d9/da/d15/f4c [5134719,32301] 0 2024-04-26T12:28:49.674 INFO:tasks.workunit.client.0.smithi046.stdout:3/822: rmdir d2/db 39 2024-04-26T12:28:49.674 INFO:tasks.workunit.client.0.smithi046.stdout:4/750: sync 2024-04-26T12:28:49.674 INFO:tasks.workunit.client.0.smithi046.stdout:0/859: dread d9/dc/dd/f14 [0,4194304] 0 2024-04-26T12:28:49.674 INFO:tasks.workunit.client.0.smithi046.stdout:9/696: creat d0/d2c/dda/d76/d7d/d72/da1/df1/ffb x:0 0 0 2024-04-26T12:28:49.674 INFO:tasks.workunit.client.0.smithi046.stdout:7/832: truncate d16/d1a/fde 826382 0 2024-04-26T12:28:49.674 INFO:tasks.workunit.client.0.smithi046.stdout:6/780: truncate d7/d1b/d47/d65/da3/dbe/fd8 926186 0 2024-04-26T12:28:49.674 INFO:tasks.workunit.client.0.smithi046.stdout:9/697: sync 2024-04-26T12:28:49.674 INFO:tasks.workunit.client.0.smithi046.stdout:7/833: sync 2024-04-26T12:28:49.674 INFO:tasks.workunit.client.0.smithi046.stdout:6/781: sync 2024-04-26T12:28:49.674 INFO:tasks.workunit.client.0.smithi046.stdout:4/751: mknod d0/da/d17/d20/d9c/cff 0 2024-04-26T12:28:49.674 INFO:tasks.workunit.client.0.smithi046.stdout:6/782: fsync d7/d1b/d47/d65/d77/f9e 0 2024-04-26T12:28:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:0/860: creat d9/d1d/d40/d41/d7e/da5/f12c x:0 0 0 2024-04-26T12:28:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:5/865: truncate d9/da/dd/d34/d44/d97/da4/de2/f120 972890 0 2024-04-26T12:28:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:3/823: rename d2/db0/fcd to d2/d16/d35/dbc/dc9/f120 0 2024-04-26T12:28:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:0/861: mkdir d9/dc/d2a/d12d 0 2024-04-26T12:28:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:6/783: rename d7/d2b/d31/fc4 to d7/da7/daf/ffe 0 2024-04-26T12:28:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:5/866: write d9/da/d18/d8b/fc5 [4818752,63480] 0 2024-04-26T12:28:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:4/752: dwrite d0/da/d17/d20/f7a [0,4194304] 0 2024-04-26T12:28:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:5/867: creat d9/da/d15/f127 x:0 0 0 2024-04-26T12:28:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:5/868: sync 2024-04-26T12:28:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:3/824: write d2/d16/d2c/d50/d71/d89/dc5/d23/f26 [399807,88580] 0 2024-04-26T12:28:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:9/698: dwrite d0/db6/fbc [0,4194304] 0 2024-04-26T12:28:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:7/834: dread d16/d1a/d31/d55/d6d/fcc [0,4194304] 0 2024-04-26T12:28:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:2/795: dread d1/de/d15/d18/d8a/f95 [0,4194304] 0 2024-04-26T12:28:49.675 INFO:tasks.workunit.client.0.smithi046.stdout:6/784: dwrite d7/d2b/d31/f98 [0,4194304] 0 2024-04-26T12:28:49.676 INFO:tasks.workunit.client.0.smithi046.stdout:0/862: getdents d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d108 0 2024-04-26T12:28:49.676 INFO:tasks.workunit.client.0.smithi046.stdout:7/835: truncate d16/d27/fe2 1635800 0 2024-04-26T12:28:49.676 INFO:tasks.workunit.client.0.smithi046.stdout:7/836: stat d16/d1a/d31/d5a/d93/dd9 0 2024-04-26T12:28:49.676 INFO:tasks.workunit.client.0.smithi046.stdout:3/825: symlink d2/d16/d2c/d50/d71/d89/dc5/d1b/l121 0 2024-04-26T12:28:49.676 INFO:tasks.workunit.client.0.smithi046.stdout:0/863: mknod d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d10f/c12e 0 2024-04-26T12:28:49.676 INFO:tasks.workunit.client.0.smithi046.stdout:9/699: link d0/d2c/l3a d0/d2c/dbe/dc0/lfc 0 2024-04-26T12:28:49.676 INFO:tasks.workunit.client.0.smithi046.stdout:4/753: creat d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/dc0/f100 x:0 0 0 2024-04-26T12:28:49.676 INFO:tasks.workunit.client.0.smithi046.stdout:0/864: mkdir d9/d1d/d5d/d12f 0 2024-04-26T12:28:49.676 INFO:tasks.workunit.client.0.smithi046.stdout:4/754: creat d0/da/d17/d20/d25/d35/dcc/f101 x:0 0 0 2024-04-26T12:28:49.676 INFO:tasks.workunit.client.0.smithi046.stdout:2/796: dwrite d1/de/d65/d4a/f59 [4194304,4194304] 0 2024-04-26T12:28:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:0/865: mkdir d9/d1d/d40/d41/d7e/da5/d130 0 2024-04-26T12:28:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:3/826: dwrite d2/d16/d2c/d50/fc7 [4194304,4194304] 0 2024-04-26T12:28:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:2/797: mkdir d1/de/d65/d1b/dca/d110 0 2024-04-26T12:28:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:0/866: mknod d9/dc/db9/c131 0 2024-04-26T12:28:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:7/837: dwrite d16/d35/dc9/fdc [4194304,4194304] 0 2024-04-26T12:28:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:4/755: link d0/da/d17/d20/d25/d35/d6d/d19/d55/c71 d0/ddc/c102 0 2024-04-26T12:28:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:0/867: stat d9/dc/lf 0 2024-04-26T12:28:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:4/756: chown d0/da/d21 137 1 2024-04-26T12:28:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:7/838: creat d16/d27/f10f x:0 0 0 2024-04-26T12:28:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:0/868: mknod d9/dc/d2a/d12d/c132 0 2024-04-26T12:28:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:6/785: dwrite d7/d1b/d6a/f7e [0,4194304] 0 2024-04-26T12:28:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:1/763: dread d7/d14/d5d/d6b/dc2/f4a [0,4194304] 0 2024-04-26T12:28:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:0/869: mknod d9/dc/db9/c133 0 2024-04-26T12:28:49.677 INFO:tasks.workunit.client.0.smithi046.stdout:0/870: creat d9/db5/f134 x:0 0 0 2024-04-26T12:28:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:2/798: dwrite d1/d42/f7a [0,4194304] 0 2024-04-26T12:28:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:3/827: dread d2/db0/dc4/d74/fa7 [0,4194304] 0 2024-04-26T12:28:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:8/907: dread d7/d1c/d74/df4/f45 [0,4194304] 0 2024-04-26T12:28:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:7/839: creat d16/d1a/f110 x:0 0 0 2024-04-26T12:28:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:1/764: mknod d7/db/d98/dc5/d2b/d39/db3/d79/c107 0 2024-04-26T12:28:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:6/786: creat d7/d1b/d37/daa/de7/fff x:0 0 0 2024-04-26T12:28:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:3/828: creat d2/db0/dc4/f122 x:0 0 0 2024-04-26T12:28:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:8/908: creat d7/d24/d50/d2a/d54/f133 x:0 0 0 2024-04-26T12:28:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:4/757: truncate d0/fa2 1473301 0 2024-04-26T12:28:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:0/871: mkdir d9/dc/dd/d90/d106/d135 0 2024-04-26T12:28:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:1/765: dread - d7/d14/d5d/f74 zero size 2024-04-26T12:28:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:8/909: creat d7/da/df/f134 x:0 0 0 2024-04-26T12:28:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:6/787: chown d7/d2b/d31/d4d/f81 27753 1 2024-04-26T12:28:49.678 INFO:tasks.workunit.client.0.smithi046.stdout:4/758: chown d0/da/d21/lf4 1 1 2024-04-26T12:28:49.679 INFO:tasks.workunit.client.0.smithi046.stdout:8/910: write d7/d24/f53 [596328,52977] 0 2024-04-26T12:28:49.679 INFO:tasks.workunit.client.0.smithi046.stdout:0/872: symlink d9/d1d/d40/d41/d7e/de1/l136 0 2024-04-26T12:28:49.679 INFO:tasks.workunit.client.0.smithi046.stdout:7/840: truncate d16/d3f/d81/daa/dd5/f101 506689 0 2024-04-26T12:28:49.679 INFO:tasks.workunit.client.0.smithi046.stdout:4/759: write d0/da/d17/d20/d25/d35/fa7 [845737,30869] 0 2024-04-26T12:28:49.679 INFO:tasks.workunit.client.0.smithi046.stdout:3/829: creat d2/d16/d2c/d50/d71/d89/dc5/d6d/f123 x:0 0 0 2024-04-26T12:28:49.679 INFO:tasks.workunit.client.0.smithi046.stdout:1/766: mknod d7/d12/d89/c108 0 2024-04-26T12:28:49.679 INFO:tasks.workunit.client.0.smithi046.stdout:5/869: dread d9/da/d18/f39 [0,4194304] 0 2024-04-26T12:28:49.679 INFO:tasks.workunit.client.0.smithi046.stdout:4/760: stat d0/da/d17/d20/d9c/fbd 0 2024-04-26T12:28:49.679 INFO:tasks.workunit.client.0.smithi046.stdout:4/761: write d0/d1/f42 [5164435,9113] 0 2024-04-26T12:28:49.679 INFO:tasks.workunit.client.0.smithi046.stdout:0/873: readlink d9/dc/l46 0 2024-04-26T12:28:49.679 INFO:tasks.workunit.client.0.smithi046.stdout:8/911: chown d7/d1c/cd9 5 1 2024-04-26T12:28:49.679 INFO:tasks.workunit.client.0.smithi046.stdout:2/799: dwrite d1/f83 [0,4194304] 0 2024-04-26T12:28:49.679 INFO:tasks.workunit.client.0.smithi046.stdout:1/767: mknod d7/db/c109 0 2024-04-26T12:28:49.680 INFO:tasks.workunit.client.0.smithi046.stdout:1/768: chown d7/db/d98/dc5/d2b/d39/d3c 241 1 2024-04-26T12:28:49.680 INFO:tasks.workunit.client.0.smithi046.stdout:2/800: readlink d1/de/d2b/l93 0 2024-04-26T12:28:49.680 INFO:tasks.workunit.client.0.smithi046.stdout:5/870: mkdir d9/d128 0 2024-04-26T12:28:49.680 INFO:tasks.workunit.client.0.smithi046.stdout:3/830: write d2/d16/d2c/f54 [824183,21621] 0 2024-04-26T12:28:49.680 INFO:tasks.workunit.client.0.smithi046.stdout:2/801: symlink d1/de/d65/l111 0 2024-04-26T12:28:49.680 INFO:tasks.workunit.client.0.smithi046.stdout:4/762: dwrite d0/da/d17/d20/d25/d35/fc1 [0,4194304] 0 2024-04-26T12:28:49.680 INFO:tasks.workunit.client.0.smithi046.stdout:0/874: dwrite d9/d1d/d5d/d6b/d8a/d8c/fd7 [0,4194304] 0 2024-04-26T12:28:49.680 INFO:tasks.workunit.client.0.smithi046.stdout:1/769: mknod d7/db/d98/dc5/d2b/c10a 0 2024-04-26T12:28:49.680 INFO:tasks.workunit.client.0.smithi046.stdout:5/871: symlink d9/da/dd/dd7/l129 0 2024-04-26T12:28:49.680 INFO:tasks.workunit.client.0.smithi046.stdout:7/841: getdents d16/d35 0 2024-04-26T12:28:49.680 INFO:tasks.workunit.client.0.smithi046.stdout:2/802: write d1/de/d15/d18/dc1/db6/dda/d78/fcc [3828580,99694] 0 2024-04-26T12:28:49.681 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:49.686 INFO:tasks.workunit.client.0.smithi046.stdout:0/875: fdatasync d9/d1d/d40/d41/d7e/da5/faa 0 2024-04-26T12:28:49.687 INFO:tasks.workunit.client.0.smithi046.stdout:4/763: dread d0/da/da1/f6e [0,4194304] 0 2024-04-26T12:28:49.687 INFO:tasks.workunit.client.0.smithi046.stdout:3/831: getdents d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d 0 2024-04-26T12:28:49.687 INFO:tasks.workunit.client.0.smithi046.stdout:5/872: symlink d9/da/dd/dd7/db0/db6/d121/l12a 0 2024-04-26T12:28:49.687 INFO:tasks.workunit.client.0.smithi046.stdout:7/842: symlink d16/d35/dac/dbb/l111 0 2024-04-26T12:28:49.687 INFO:tasks.workunit.client.0.smithi046.stdout:1/770: mknod d7/db/d98/dc5/d2b/d31/d82/d95/df9/c10b 0 2024-04-26T12:28:49.687 INFO:tasks.workunit.client.0.smithi046.stdout:2/803: dread - d1/de/d15/d18/d98/fd8 zero size 2024-04-26T12:28:49.687 INFO:tasks.workunit.client.0.smithi046.stdout:3/832: symlink d2/d16/d2c/d50/d71/df6/l124 0 2024-04-26T12:28:49.687 INFO:tasks.workunit.client.0.smithi046.stdout:2/804: fsync d1/df2/f103 0 2024-04-26T12:28:49.687 INFO:tasks.workunit.client.0.smithi046.stdout:0/876: symlink d9/d1d/d5d/d6b/d8a/d8c/l137 0 2024-04-26T12:28:49.687 INFO:tasks.workunit.client.0.smithi046.stdout:1/771: stat d7/db/d98/dc5/d2b/d31/fc6 0 2024-04-26T12:28:49.687 INFO:tasks.workunit.client.0.smithi046.stdout:4/764: creat d0/d41/f103 x:0 0 0 2024-04-26T12:28:49.688 INFO:tasks.workunit.client.0.smithi046.stdout:3/833: creat d2/db0/dc4/f125 x:0 0 0 2024-04-26T12:28:49.688 INFO:tasks.workunit.client.0.smithi046.stdout:7/843: mknod d16/d27/d51/c112 0 2024-04-26T12:28:49.688 INFO:tasks.workunit.client.0.smithi046.stdout:9/700: dread d0/d2c/d47/f13 [0,4194304] 0 2024-04-26T12:28:49.688 INFO:tasks.workunit.client.0.smithi046.stdout:1/772: symlink d7/d14/d5d/d32/d41/d8f/l10c 0 2024-04-26T12:28:49.688 INFO:tasks.workunit.client.0.smithi046.stdout:5/873: rename d9/da/dd/dd7/d7e/d10e/l116 to d9/da/d18/d7d/da7/l12b 0 2024-04-26T12:28:49.688 INFO:tasks.workunit.client.0.smithi046.stdout:9/701: unlink d0/d19/f6d 0 2024-04-26T12:28:49.688 INFO:tasks.workunit.client.0.smithi046.stdout:7/844: rename d16/d1a/fe4 to d16/d1a/f113 0 2024-04-26T12:28:49.688 INFO:tasks.workunit.client.0.smithi046.stdout:3/834: chown d2/d16/d2c/d50/d71/d89/dc5/d6d 2008307450 1 2024-04-26T12:28:49.688 INFO:tasks.workunit.client.0.smithi046.stdout:6/788: dread d7/d1b/d6a/d57/f8d [0,4194304] 0 2024-04-26T12:28:49.688 INFO:tasks.workunit.client.0.smithi046.stdout:7/845: chown d16/d1a/d3e/d59/la1 3 1 2024-04-26T12:28:49.688 INFO:tasks.workunit.client.0.smithi046.stdout:8/912: dwrite d7/d1c/d74/df4/f70 [0,4194304] 0 2024-04-26T12:28:49.688 INFO:tasks.workunit.client.0.smithi046.stdout:6/789: symlink d7/d2b/d31/l100 0 2024-04-26T12:28:49.688 INFO:tasks.workunit.client.0.smithi046.stdout:0/877: dwrite d9/dc/f42 [0,4194304] 0 2024-04-26T12:28:49.688 INFO:tasks.workunit.client.0.smithi046.stdout:2/805: dwrite d1/d42/f60 [0,4194304] 0 2024-04-26T12:28:49.689 INFO:tasks.workunit.client.0.smithi046.stdout:8/913: chown d7/da/df/f2b 3575 1 2024-04-26T12:28:49.689 INFO:tasks.workunit.client.0.smithi046.stdout:1/773: dwrite d7/f6f [0,4194304] 0 2024-04-26T12:28:49.689 INFO:tasks.workunit.client.0.smithi046.stdout:7/846: rename d16/d35/l36 to d16/d100/l114 0 2024-04-26T12:28:49.689 INFO:tasks.workunit.client.0.smithi046.stdout:2/806: creat d1/de/d67/f112 x:0 0 0 2024-04-26T12:28:49.689 INFO:tasks.workunit.client.0.smithi046.stdout:9/702: truncate d0/d2c/d47/f67 2095642 0 2024-04-26T12:28:49.689 INFO:tasks.workunit.client.0.smithi046.stdout:8/914: mknod d7/d11a/d12f/c135 0 2024-04-26T12:28:49.689 INFO:tasks.workunit.client.0.smithi046.stdout:7/847: mkdir d16/d104/d115 0 2024-04-26T12:28:49.689 INFO:tasks.workunit.client.0.smithi046.stdout:2/807: rmdir d1/df2 39 2024-04-26T12:28:49.689 INFO:tasks.workunit.client.0.smithi046.stdout:0/878: dwrite d9/dc/dd/dd2/ffe [0,4194304] 0 2024-04-26T12:28:49.689 INFO:tasks.workunit.client.0.smithi046.stdout:5/874: dwrite d9/f41 [4194304,4194304] 0 2024-04-26T12:28:49.689 INFO:tasks.workunit.client.0.smithi046.stdout:9/703: mknod d0/d29/dd8/cfd 0 2024-04-26T12:28:49.689 INFO:tasks.workunit.client.0.smithi046.stdout:1/774: rename d7/db/d98/dc5/d2b/d39/ld2 to d7/d14/d5d/d32/d41/d8f/l10d 0 2024-04-26T12:28:49.690 INFO:tasks.workunit.client.0.smithi046.stdout:0/879: chown d9/dc/dd/dd2 104 1 2024-04-26T12:28:49.690 INFO:tasks.workunit.client.0.smithi046.stdout:7/848: write d16/d35/f3a [1897224,118493] 0 2024-04-26T12:28:49.690 INFO:tasks.workunit.client.0.smithi046.stdout:2/808: chown d1/de/db1/fdb 475787500 1 2024-04-26T12:28:49.690 INFO:tasks.workunit.client.0.smithi046.stdout:5/875: chown d9/da/dd/d34/d45/c11c 28781418 1 2024-04-26T12:28:49.690 INFO:tasks.workunit.client.0.smithi046.stdout:5/876: fsync d9/da/dd/dd7/db0/db6/feb 0 2024-04-26T12:28:49.690 INFO:tasks.workunit.client.0.smithi046.stdout:7/849: creat d16/db1/f116 x:0 0 0 2024-04-26T12:28:49.690 INFO:tasks.workunit.client.0.smithi046.stdout:1/775: creat d7/db/d98/dc5/d2b/d96/f10e x:0 0 0 2024-04-26T12:28:49.690 INFO:tasks.workunit.client.0.smithi046.stdout:1/776: chown d7/d14/fc7 1018761304 1 2024-04-26T12:28:49.690 INFO:tasks.workunit.client.0.smithi046.stdout:7/850: chown d16/d1a/d31/d4d/fa5 224842 1 2024-04-26T12:28:49.690 INFO:tasks.workunit.client.0.smithi046.stdout:1/777: mknod d7/d14/d5d/d32/d41/d8f/c10f 0 2024-04-26T12:28:49.690 INFO:tasks.workunit.client.0.smithi046.stdout:1/778: creat d7/db/dee/dfc/f110 x:0 0 0 2024-04-26T12:28:49.690 INFO:tasks.workunit.client.0.smithi046.stdout:0/880: dwrite d9/d1d/d40/d41/d7e/da5/dad/f115 [0,4194304] 0 2024-04-26T12:28:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:1/779: mkdir d7/db/d98/dc5/d2b/d96/d111 0 2024-04-26T12:28:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:0/881: creat d9/d1d/d5d/d6b/f138 x:0 0 0 2024-04-26T12:28:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:0/882: link d9/d1d/d40/d41/d7e/da5/f12c d9/d1d/d40/d41/d7e/da5/dad/dbd/dcd/f139 0 2024-04-26T12:28:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:7/851: dwrite d16/d1a/f113 [0,4194304] 0 2024-04-26T12:28:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:7/852: creat d16/d35/f117 x:0 0 0 2024-04-26T12:28:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:7/853: symlink d16/d1a/d31/d5a/d6b/df2/ddb/l118 0 2024-04-26T12:28:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:6/790: dread d7/d1b/d6a/f93 [0,4194304] 0 2024-04-26T12:28:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:7/854: creat d16/d1a/d31/d55/d6d/d89/f119 x:0 0 0 2024-04-26T12:28:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:7/855: fsync d16/d1a/d3e/d59/f92 0 2024-04-26T12:28:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:6/791: creat d7/d16/f101 x:0 0 0 2024-04-26T12:28:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:1/780: truncate d7/d14/d5d/d32/d41/d8f/fa7 3418783 0 2024-04-26T12:28:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:6/792: unlink d7/d16/ffc 0 2024-04-26T12:28:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:9/704: read d0/d2c/d47/ff [1612926,58018] 0 2024-04-26T12:28:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:4/765: sync 2024-04-26T12:28:49.692 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:49.692 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:49.692 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:49.692 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:49.693 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:49.693 INFO:tasks.workunit.client.0.smithi046.stdout:7/856: link d16/d4e/c10e d16/d1a/d31/d5a/d6b/df2/c11a 0 2024-04-26T12:28:49.693 INFO:tasks.workunit.client.0.smithi046.stdout:0/883: dwrite d9/dc/f32 [0,4194304] 0 2024-04-26T12:28:49.693 INFO:tasks.workunit.client.0.smithi046.stdout:7/857: creat d16/d1a/d31/d55/d6d/f11b x:0 0 0 2024-04-26T12:28:49.693 INFO:tasks.workunit.client.0.smithi046.stdout:4/766: dread d0/da/d21/f73 [0,4194304] 0 2024-04-26T12:28:49.693 INFO:tasks.workunit.client.0.smithi046.stdout:7/858: read d16/d1a/d31/d4d/f77 [1822574,11636] 0 2024-04-26T12:28:49.694 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:49.706 INFO:tasks.workunit.client.0.smithi046.stdout:4/767: creat d0/d1/d5/db/f104 x:0 0 0 2024-04-26T12:28:49.706 INFO:tasks.workunit.client.0.smithi046.stdout:7/859: creat d16/db1/f11c x:0 0 0 2024-04-26T12:28:49.706 INFO:tasks.workunit.client.0.smithi046.stdout:7/860: truncate d16/d35/dac/fd7 1522221 0 2024-04-26T12:28:49.706 INFO:tasks.workunit.client.0.smithi046.stdout:1/781: fsync d7/db/f8c 0 2024-04-26T12:28:49.706 INFO:tasks.workunit.client.0.smithi046.stdout:7/861: write d16/f20 [4559719,84530] 0 2024-04-26T12:28:49.707 INFO:tasks.workunit.client.0.smithi046.stdout:9/705: read d0/d19/d21/f4a [3441345,80027] 0 2024-04-26T12:28:49.707 INFO:tasks.workunit.client.0.smithi046.stdout:1/782: dwrite d7/db/d98/dc5/d2b/d96/f9e [0,4194304] 0 2024-04-26T12:28:49.707 INFO:tasks.workunit.client.0.smithi046.stdout:9/706: creat d0/d19/d51/dac/ded/ffe x:0 0 0 2024-04-26T12:28:49.707 INFO:tasks.workunit.client.0.smithi046.stdout:1/783: write d7/db/d98/dc5/d2b/d39/ffa [653243,98645] 0 2024-04-26T12:28:49.707 INFO:tasks.workunit.client.0.smithi046.stdout:0/884: dread d9/dc/f1c [0,4194304] 0 2024-04-26T12:28:49.707 INFO:tasks.workunit.client.0.smithi046.stdout:5/877: dread d9/da/d40/f94 [0,4194304] 0 2024-04-26T12:28:49.708 INFO:tasks.workunit.client.0.smithi046.stdout:0/885: write d9/d1d/f58 [2466064,41032] 0 2024-04-26T12:28:49.708 INFO:tasks.workunit.client.0.smithi046.stdout:0/886: write d9/d1d/d40/d41/d7e/da5/dad/dbd/fb4 [997185,4890] 0 2024-04-26T12:28:49.708 INFO:tasks.workunit.client.0.smithi046.stdout:7/862: dread d16/d27/d7e/fe5 [0,4194304] 0 2024-04-26T12:28:49.708 INFO:tasks.workunit.client.0.smithi046.stdout:0/887: chown f8 168 1 2024-04-26T12:28:49.708 INFO:tasks.workunit.client.0.smithi046.stdout:5/878: read d9/da/dd/d34/d44/d97/da4/dde/fef [2360596,21459] 0 2024-04-26T12:28:49.708 INFO:tasks.workunit.client.0.smithi046.stdout:8/915: dread d7/d24/d50/d2a/d39/f61 [0,4194304] 0 2024-04-26T12:28:49.709 INFO:tasks.workunit.client.0.smithi046.stdout:7/863: mknod d16/d1a/c11d 0 2024-04-26T12:28:49.709 INFO:tasks.workunit.client.0.smithi046.stdout:0/888: chown d9/d1d/d5d/d6b/d8a/d8c/fde 3514791 1 2024-04-26T12:28:49.709 INFO:tasks.workunit.client.0.smithi046.stdout:8/916: read - d7/d24/d50/d2a/d39/d9d/fb4 zero size 2024-04-26T12:28:49.709 INFO:tasks.workunit.client.0.smithi046.stdout:5/879: mknod d9/da/dd/dd7/db0/db6/d121/c12c 0 2024-04-26T12:28:49.709 INFO:tasks.workunit.client.0.smithi046.stdout:0/889: creat d9/dc/db9/f13a x:0 0 0 2024-04-26T12:28:49.709 INFO:tasks.workunit.client.0.smithi046.stdout:8/917: write d7/d24/d50/d2a/d54/df3/ff7 [98544,29101] 0 2024-04-26T12:28:49.710 INFO:tasks.workunit.client.0.smithi046.stdout:5/880: mknod d9/da/d40/c12d 0 2024-04-26T12:28:49.710 INFO:tasks.workunit.client.0.smithi046.stdout:3/835: dread d2/d16/d2c/d50/fc7 [0,4194304] 0 2024-04-26T12:28:49.710 INFO:tasks.workunit.client.0.smithi046.stdout:5/881: rmdir d9/da/dd/d34/d45/d8f 39 2024-04-26T12:28:49.710 INFO:tasks.workunit.client.0.smithi046.stdout:8/918: write d7/d24/d50/d62/fdb [976360,58940] 0 2024-04-26T12:28:49.710 INFO:tasks.workunit.client.0.smithi046.stdout:0/890: creat d9/dc/dd/d45/f13b x:0 0 0 2024-04-26T12:28:49.710 INFO:tasks.workunit.client.0.smithi046.stdout:8/919: mknod d7/da/c136 0 2024-04-26T12:28:49.711 INFO:tasks.workunit.client.0.smithi046.stdout:3/836: chown d2/db/dec/ff3 5683 1 2024-04-26T12:28:49.711 INFO:tasks.workunit.client.0.smithi046.stdout:5/882: chown d9/da/d18/d8b/caa 509210863 1 2024-04-26T12:28:49.711 INFO:tasks.workunit.client.0.smithi046.stdout:0/891: creat d9/d1d/d5d/f13c x:0 0 0 2024-04-26T12:28:49.711 INFO:tasks.workunit.client.0.smithi046.stdout:5/883: fsync d9/da/d15/f9f 0 2024-04-26T12:28:49.711 INFO:tasks.workunit.client.0.smithi046.stdout:8/920: fdatasync d7/d24/d50/d2a/d39/fe0 0 2024-04-26T12:28:49.711 INFO:tasks.workunit.client.0.smithi046.stdout:3/837: symlink d2/db/d84/da5/l126 0 2024-04-26T12:28:49.712 INFO:tasks.workunit.client.0.smithi046.stdout:0/892: unlink d9/d1d/d40/d41/d7e/ddd/de8/f110 0 2024-04-26T12:28:49.712 INFO:tasks.workunit.client.0.smithi046.stdout:3/838: truncate d2/db/d4a/fc8 3881253 0 2024-04-26T12:28:49.712 INFO:tasks.workunit.client.0.smithi046.stdout:5/884: getdents d9 0 2024-04-26T12:28:49.712 INFO:tasks.workunit.client.0.smithi046.stdout:8/921: rename d7/d24/d50/d2a/d39/c121 to d7/dd5/c137 0 2024-04-26T12:28:49.712 INFO:tasks.workunit.client.0.smithi046.stdout:3/839: mkdir d2/db0/dc4/d127 0 2024-04-26T12:28:49.712 INFO:tasks.workunit.client.0.smithi046.stdout:5/885: creat d9/da/dd/d34/d44/d97/f12e x:0 0 0 2024-04-26T12:28:49.713 INFO:tasks.workunit.client.0.smithi046.stdout:8/922: rename d7/l105 to d7/d1c/d129/l138 0 2024-04-26T12:28:49.713 INFO:tasks.workunit.client.0.smithi046.stdout:8/923: creat d7/da/f139 x:0 0 0 2024-04-26T12:28:49.713 INFO:tasks.workunit.client.0.smithi046.stdout:8/924: symlink d7/d1c/d74/df4/d27/db0/l13a 0 2024-04-26T12:28:49.713 INFO:tasks.workunit.client.0.smithi046.stdout:2/809: dread d1/de/f27 [0,4194304] 0 2024-04-26T12:28:49.713 INFO:tasks.workunit.client.0.smithi046.stdout:0/893: dwrite d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d108/f107 [0,4194304] 0 2024-04-26T12:28:49.713 INFO:tasks.workunit.client.0.smithi046.stdout:3/840: dwrite d2/d16/d35/f4e [4194304,4194304] 0 2024-04-26T12:28:49.714 INFO:tasks.workunit.client.0.smithi046.stdout:0/894: fdatasync d9/db5/fd9 0 2024-04-26T12:28:49.714 INFO:tasks.workunit.client.0.smithi046.stdout:6/793: dread d7/d1b/f4b [0,4194304] 0 2024-04-26T12:28:49.714 INFO:tasks.workunit.client.0.smithi046.stdout:3/841: creat d2/d16/d2c/d50/f128 x:0 0 0 2024-04-26T12:28:49.714 INFO:tasks.workunit.client.0.smithi046.stdout:5/886: dwrite d9/da/f20 [0,4194304] 0 2024-04-26T12:28:49.714 INFO:tasks.workunit.client.0.smithi046.stdout:8/925: chown d7/d24/d50/d2a/d39/da6/fba 191 1 2024-04-26T12:28:49.714 INFO:tasks.workunit.client.0.smithi046.stdout:1/784: dread d7/d14/d5d/d32/d5f/f92 [0,4194304] 0 2024-04-26T12:28:49.715 INFO:tasks.workunit.client.0.smithi046.stdout:6/794: readlink d7/d1b/d47/l89 0 2024-04-26T12:28:49.715 INFO:tasks.workunit.client.0.smithi046.stdout:1/785: creat d7/db/d98/dc5/d2b/d39/db3/f112 x:0 0 0 2024-04-26T12:28:49.715 INFO:tasks.workunit.client.0.smithi046.stdout:3/842: rename d2/d16/d2c/d50/d71/d89/dc5/d82/ccb to d2/db0/dc4/d127/c129 0 2024-04-26T12:28:49.715 INFO:tasks.workunit.client.0.smithi046.stdout:6/795: write d7/d1b/d37/d95/def/ffb [404100,106055] 0 2024-04-26T12:28:49.715 INFO:tasks.workunit.client.0.smithi046.stdout:0/895: chown d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/cb1 183420631 1 2024-04-26T12:28:49.715 INFO:tasks.workunit.client.0.smithi046.stdout:1/786: read d7/db/f10 [2761356,72670] 0 2024-04-26T12:28:49.716 INFO:tasks.workunit.client.0.smithi046.stdout:6/796: creat d7/d1b/d47/d65/da3/dbe/f102 x:0 0 0 2024-04-26T12:28:49.716 INFO:tasks.workunit.client.0.smithi046.stdout:3/843: chown d2/d16/d2c/d50/d71/d89/dc5/ced 119 1 2024-04-26T12:28:49.716 INFO:tasks.workunit.client.0.smithi046.stdout:0/896: unlink d9/dc/d2a/f50 0 2024-04-26T12:28:49.716 INFO:tasks.workunit.client.0.smithi046.stdout:1/787: write d7/db/d98/dc5/d2b/d31/fce [995433,97542] 0 2024-04-26T12:28:49.716 INFO:tasks.workunit.client.0.smithi046.stdout:8/926: dwrite d7/da/df/f134 [0,4194304] 0 2024-04-26T12:28:49.716 INFO:tasks.workunit.client.0.smithi046.stdout:6/797: mknod d7/d1b/d47/d65/d77/c103 0 2024-04-26T12:28:49.717 INFO:tasks.workunit.client.0.smithi046.stdout:8/927: readlink d7/d1c/d74/df4/d1b/dae/dcf/lf5 0 2024-04-26T12:28:49.717 INFO:tasks.workunit.client.0.smithi046.stdout:6/798: mknod d7/d1b/d47/d65/c104 0 2024-04-26T12:28:49.718 INFO:tasks.workunit.client.0.smithi046.stdout:6/799: readlink d7/da7/lcc 0 2024-04-26T12:28:49.719 INFO:tasks.workunit.client.0.smithi046.stdout:5/887: dwrite d9/da/dd/d34/d44/d97/da4/dde/ff2 [0,4194304] 0 2024-04-26T12:28:49.719 INFO:tasks.workunit.client.0.smithi046.stdout:5/888: chown d9/da/d18/f39 234 1 2024-04-26T12:28:49.719 INFO:tasks.workunit.client.0.smithi046.stdout:3/844: dwrite d2/d16/d2c/d50/d71/d89/dc5/d23/f26 [0,4194304] 0 2024-04-26T12:28:49.719 INFO:tasks.workunit.client.0.smithi046.stdout:8/928: rename d7/d1c/d74/df4/d1b/dae/l130 to d7/d24/d50/d2a/d39/d10c/l13b 0 2024-04-26T12:28:49.719 INFO:tasks.workunit.client.0.smithi046.stdout:2/810: dread d1/f48 [0,4194304] 0 2024-04-26T12:28:49.719 INFO:tasks.workunit.client.0.smithi046.stdout:0/897: dread d9/dc/f32 [0,4194304] 0 2024-04-26T12:28:49.719 INFO:tasks.workunit.client.0.smithi046.stdout:1/788: dwrite d7/db/d98/fec [0,4194304] 0 2024-04-26T12:28:49.719 INFO:tasks.workunit.client.0.smithi046.stdout:4/768: sync 2024-04-26T12:28:49.719 INFO:tasks.workunit.client.0.smithi046.stdout:7/864: sync 2024-04-26T12:28:49.719 INFO:tasks.workunit.client.0.smithi046.stdout:3/845: chown d2/d16/d2c/f36 12029 1 2024-04-26T12:28:49.719 INFO:tasks.workunit.client.0.smithi046.stdout:6/800: dwrite d7/d1b/d37/d95/fa1 [0,4194304] 0 2024-04-26T12:28:49.719 INFO:tasks.workunit.client.0.smithi046.stdout:6/801: dread - d7/d2b/d31/d4d/fed zero size 2024-04-26T12:28:49.719 INFO:tasks.workunit.client.0.smithi046.stdout:5/889: rename d9/da/dd/dd7/d7e/d10e/f125 to d9/da/dd/d34/f12f 0 2024-04-26T12:28:49.719 INFO:tasks.workunit.client.0.smithi046.stdout:4/769: symlink d0/da/d17/d20/d8e/l105 0 2024-04-26T12:28:49.720 INFO:tasks.workunit.client.0.smithi046.stdout:1/789: chown d7/d14/d5d/d32/f75 2266 1 2024-04-26T12:28:49.720 INFO:tasks.workunit.client.0.smithi046.stdout:4/770: rmdir d0/da/da1/dfb 0 2024-04-26T12:28:49.720 INFO:tasks.workunit.client.0.smithi046.stdout:5/890: write d9/da/dd/d34/d44/d97/da4/f123 [915151,15162] 0 2024-04-26T12:28:49.722 INFO:tasks.workunit.client.0.smithi046.stdout:3/846: dwrite d2/d16/d2c/d50/f90 [0,4194304] 0 2024-04-26T12:28:49.723 INFO:tasks.workunit.client.0.smithi046.stdout:8/929: dread d7/d24/d50/d2a/d39/fe0 [0,4194304] 0 2024-04-26T12:28:49.723 INFO:tasks.workunit.client.0.smithi046.stdout:0/898: dwrite d9/d1d/d5d/d6b/f89 [0,4194304] 0 2024-04-26T12:28:49.724 INFO:tasks.workunit.client.0.smithi046.stdout:3/847: truncate d2/d16/d2c/d50/f128 41614 0 2024-04-26T12:28:49.724 INFO:tasks.workunit.client.0.smithi046.stdout:8/930: write d7/d24/f2f [3627877,77261] 0 2024-04-26T12:28:49.725 INFO:tasks.workunit.client.0.smithi046.stdout:5/891: rename d9/da/d18/d7d/da7/fd5 to d9/da/dd/dd7/d7e/d10e/f130 0 2024-04-26T12:28:49.726 INFO:tasks.workunit.client.0.smithi046.stdout:3/848: write d2/db/d62/fac [25943,59519] 0 2024-04-26T12:28:49.728 INFO:tasks.workunit.client.0.smithi046.stdout:3/849: creat d2/d16/d35/f12a x:0 0 0 2024-04-26T12:28:49.728 INFO:tasks.workunit.client.0.smithi046.stdout:9/707: sync 2024-04-26T12:28:49.729 INFO:tasks.workunit.client.0.smithi046.stdout:3/850: creat d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d/f12b x:0 0 0 2024-04-26T12:28:49.731 INFO:tasks.workunit.client.0.smithi046.stdout:3/851: creat d2/db/d84/f12c x:0 0 0 2024-04-26T12:28:49.731 INFO:tasks.workunit.client.0.smithi046.stdout:9/708: dread d0/db6/fbc [0,4194304] 0 2024-04-26T12:28:49.731 INFO:tasks.workunit.client.0.smithi046.stdout:4/771: write d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/f90 [3566206,47597] 0 2024-04-26T12:28:49.731 INFO:tasks.workunit.client.0.smithi046.stdout:8/931: truncate d7/d1c/d74/df4/f41 6573025 0 2024-04-26T12:28:49.732 INFO:tasks.workunit.client.0.smithi046.stdout:9/709: mkdir d0/d2c/dbe/dd2/dff 0 2024-04-26T12:28:49.733 INFO:tasks.workunit.client.0.smithi046.stdout:3/852: mkdir d2/d16/d2c/d50/d71/d89/dc5/d23/dbf/d12d 0 2024-04-26T12:28:49.733 INFO:tasks.workunit.client.0.smithi046.stdout:8/932: creat d7/d24/d50/d2a/d39/f13c x:0 0 0 2024-04-26T12:28:49.733 INFO:tasks.workunit.client.0.smithi046.stdout:9/710: write d0/d2c/d3d/fb8 [4873275,55356] 0 2024-04-26T12:28:49.733 INFO:tasks.workunit.client.0.smithi046.stdout:4/772: creat d0/da/d17/d20/d25/d35/d6d/d19/d53/f106 x:0 0 0 2024-04-26T12:28:49.733 INFO:tasks.workunit.client.0.smithi046.stdout:3/853: rmdir d2/db0/dc4/d127 39 2024-04-26T12:28:49.734 INFO:tasks.workunit.client.0.smithi046.stdout:9/711: rmdir d0/d2c/d3d 39 2024-04-26T12:28:49.734 INFO:tasks.workunit.client.0.smithi046.stdout:8/933: readlink d7/d24/d50/d2a/d54/l5f 0 2024-04-26T12:28:49.735 INFO:tasks.workunit.client.0.smithi046.stdout:9/712: write d0/d2c/d47/f46 [1505902,123555] 0 2024-04-26T12:28:49.735 INFO:tasks.workunit.client.0.smithi046.stdout:4/773: rename d0/da/d17/d20/d8e/ccd to d0/ddc/c107 0 2024-04-26T12:28:49.736 INFO:tasks.workunit.client.0.smithi046.stdout:9/713: write d0/d2c/d47/f58 [640445,60382] 0 2024-04-26T12:28:49.736 INFO:tasks.workunit.client.0.smithi046.stdout:4/774: dread - d0/d1/d5/db/fe7 zero size 2024-04-26T12:28:49.736 INFO:tasks.workunit.client.0.smithi046.stdout:0/899: dwrite d9/dc/dd/f116 [0,4194304] 0 2024-04-26T12:28:49.737 INFO:tasks.workunit.client.0.smithi046.stdout:4/775: unlink d0/c80 0 2024-04-26T12:28:49.737 INFO:tasks.workunit.client.0.smithi046.stdout:0/900: write d9/fd6 [819545,26496] 0 2024-04-26T12:28:49.738 INFO:tasks.workunit.client.0.smithi046.stdout:4/776: write d0/da/da1/f9e [542716,75788] 0 2024-04-26T12:28:49.739 INFO:tasks.workunit.client.0.smithi046.stdout:0/901: read d9/dc/dd/dd2/fee [1586878,71465] 0 2024-04-26T12:28:49.740 INFO:tasks.workunit.client.0.smithi046.stdout:0/902: fsync d9/dc/dd/d45/f49 0 2024-04-26T12:28:49.740 INFO:tasks.workunit.client.0.smithi046.stdout:0/903: chown d9/dc/f37 248 1 2024-04-26T12:28:49.741 INFO:tasks.workunit.client.0.smithi046.stdout:0/904: creat d9/d1d/d40/d41/f13d x:0 0 0 2024-04-26T12:28:49.744 INFO:tasks.workunit.client.0.smithi046.stdout:0/905: truncate d9/d1d/d40/d41/d7e/fd5 52056 0 2024-04-26T12:28:49.744 INFO:tasks.workunit.client.0.smithi046.stdout:4/777: truncate d0/d1/f15 318837 0 2024-04-26T12:28:49.744 INFO:tasks.workunit.client.0.smithi046.stdout:0/906: truncate d9/db5/fd9 750974 0 2024-04-26T12:28:49.745 INFO:tasks.workunit.client.0.smithi046.stdout:0/907: mkdir d9/dc/dd/dd2/d10e/d13e 0 2024-04-26T12:28:49.745 INFO:tasks.workunit.client.0.smithi046.stdout:4/778: write d0/da/d17/d20/d25/d35/d61/dc6/fd6 [1015001,29464] 0 2024-04-26T12:28:49.746 INFO:tasks.workunit.client.0.smithi046.stdout:9/714: dread d0/f9a [0,4194304] 0 2024-04-26T12:28:49.747 INFO:tasks.workunit.client.0.smithi046.stdout:4/779: chown d0/da/d17/d20/d25/d35/d61/f75 0 1 2024-04-26T12:28:49.747 INFO:tasks.workunit.client.0.smithi046.stdout:9/715: truncate d0/d19/d51/dac/fe5 338171 0 2024-04-26T12:28:49.747 INFO:tasks.workunit.client.0.smithi046.stdout:0/908: link d9/d1d/d40/d41/d7e/de1/fed d9/d1d/d40/d41/d7e/ddd/de8/f13f 0 2024-04-26T12:28:49.748 INFO:tasks.workunit.client.0.smithi046.stdout:9/716: creat d0/d2c/dbe/f100 x:0 0 0 2024-04-26T12:28:49.749 INFO:tasks.workunit.client.0.smithi046.stdout:0/909: creat d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d117/f140 x:0 0 0 2024-04-26T12:28:49.751 INFO:tasks.workunit.client.0.smithi046.stdout:0/910: symlink d9/d1d/d5d/d6b/d8a/l141 0 2024-04-26T12:28:49.751 INFO:tasks.workunit.client.0.smithi046.stdout:0/911: chown d9/d1d/d40 85 1 2024-04-26T12:28:49.752 INFO:tasks.workunit.client.0.smithi046.stdout:0/912: chown d9/d1d/d5d/d12f 5645 1 2024-04-26T12:28:49.753 INFO:tasks.workunit.client.0.smithi046.stdout:0/913: mknod d9/d1d/d40/d41/d7e/d9d/c142 0 2024-04-26T12:28:49.754 INFO:tasks.workunit.client.0.smithi046.stdout:9/717: dwrite d0/d2c/dda/d76/d7d/d72/da1/dc8/f64 [0,4194304] 0 2024-04-26T12:28:49.754 INFO:tasks.workunit.client.0.smithi046.stdout:5/892: sync 2024-04-26T12:28:49.754 INFO:tasks.workunit.client.0.smithi046.stdout:8/934: sync 2024-04-26T12:28:49.755 INFO:tasks.workunit.client.0.smithi046.stdout:9/718: chown d0/d2c/dda/f6e 5 1 2024-04-26T12:28:49.757 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:49.756+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:49.758 INFO:tasks.workunit.client.0.smithi046.stdout:6/802: dread d7/d2b/f30 [0,4194304] 0 2024-04-26T12:28:49.760 INFO:tasks.workunit.client.0.smithi046.stdout:5/893: dwrite d9/da/d15/fb9 [0,4194304] 0 2024-04-26T12:28:49.760 INFO:tasks.workunit.client.0.smithi046.stdout:7/865: dread d16/d3f/d81/daa/fda [0,4194304] 0 2024-04-26T12:28:49.762 INFO:tasks.workunit.client.0.smithi046.stdout:5/894: stat d9/da/dd/dd7/c111 0 2024-04-26T12:28:49.762 INFO:tasks.workunit.client.0.smithi046.stdout:9/719: dwrite d0/d2c/f4d [0,4194304] 0 2024-04-26T12:28:49.762 INFO:tasks.workunit.client.0.smithi046.stdout:1/790: dread d7/d14/f53 [0,4194304] 0 2024-04-26T12:28:49.763 INFO:tasks.workunit.client.0.smithi046.stdout:0/914: write d9/db5/fd9 [1615864,90354] 0 2024-04-26T12:28:49.763 INFO:tasks.workunit.client.0.smithi046.stdout:9/720: write d0/d2c/dda/d76/f79 [487778,33033] 0 2024-04-26T12:28:49.763 INFO:tasks.workunit.client.0.smithi046.stdout:5/895: write d9/da/dd/dd7/db0/de0/fed [889048,127298] 0 2024-04-26T12:28:49.764 INFO:tasks.workunit.client.0.smithi046.stdout:9/721: dread - d0/d19/d51/dac/ded/ffe zero size 2024-04-26T12:28:49.764 INFO:tasks.workunit.client.0.smithi046.stdout:5/896: chown d9/da/d18/d7d 53 1 2024-04-26T12:28:49.765 INFO:tasks.workunit.client.0.smithi046.stdout:8/935: sync 2024-04-26T12:28:49.765 INFO:tasks.workunit.client.0.smithi046.stdout:7/866: sync 2024-04-26T12:28:49.766 INFO:tasks.workunit.client.0.smithi046.stdout:8/936: chown d7/d24/d50/f2c 1327532 1 2024-04-26T12:28:49.769 INFO:tasks.workunit.client.0.smithi046.stdout:0/915: dwrite d9/d1d/d40/d41/d7e/d9d/fd8 [0,4194304] 0 2024-04-26T12:28:49.769 INFO:tasks.workunit.client.0.smithi046.stdout:9/722: getdents d0/d2c/d47 0 2024-04-26T12:28:49.770 INFO:tasks.workunit.client.0.smithi046.stdout:2/811: dread d1/de/f31 [0,4194304] 0 2024-04-26T12:28:49.771 INFO:tasks.workunit.client.0.smithi046.stdout:9/723: readlink d0/d2c/dda/d76/d7d/d72/da1/dc8/l74 0 2024-04-26T12:28:49.771 INFO:tasks.workunit.client.0.smithi046.stdout:6/803: dread d7/d1b/d37/d95/def/ffb [0,4194304] 0 2024-04-26T12:28:49.772 INFO:tasks.workunit.client.0.smithi046.stdout:1/791: read d7/d14/d5d/d32/d41/f93 [298135,5937] 0 2024-04-26T12:28:49.772 INFO:tasks.workunit.client.0.smithi046.stdout:2/812: rename d1/d71 to d1/d42/d113 0 2024-04-26T12:28:49.772 INFO:tasks.workunit.client.0.smithi046.stdout:6/804: creat d7/d1b/d37/daa/de7/f105 x:0 0 0 2024-04-26T12:28:49.773 INFO:tasks.workunit.client.0.smithi046.stdout:9/724: truncate d0/d19/f8c 4243965 0 2024-04-26T12:28:49.773 INFO:tasks.workunit.client.0.smithi046.stdout:8/937: dwrite d7/d24/d50/d2a/d39/d9d/faa [0,4194304] 0 2024-04-26T12:28:49.773 INFO:tasks.workunit.client.0.smithi046.stdout:1/792: fsync d7/db/d98/dc5/f59 0 2024-04-26T12:28:49.773 INFO:tasks.workunit.client.0.smithi046.stdout:2/813: write d1/f48 [1203657,106179] 0 2024-04-26T12:28:49.775 INFO:tasks.workunit.client.0.smithi046.stdout:5/897: truncate d9/da/f20 2926450 0 2024-04-26T12:28:49.775 INFO:tasks.workunit.client.0.smithi046.stdout:9/725: unlink d0/c4b 0 2024-04-26T12:28:49.775 INFO:tasks.workunit.client.0.smithi046.stdout:2/814: creat d1/de/d67/f114 x:0 0 0 2024-04-26T12:28:49.776 INFO:tasks.workunit.client.0.smithi046.stdout:9/726: chown d0/d2c 161778 1 2024-04-26T12:28:49.778 INFO:tasks.workunit.client.0.smithi046.stdout:5/898: unlink d9/da/dd/d34/d44/d88/l102 0 2024-04-26T12:28:49.779 INFO:tasks.workunit.client.0.smithi046.stdout:9/727: rename d0/d2c/d47/c5b to d0/d19/d51/dac/c101 0 2024-04-26T12:28:49.779 INFO:tasks.workunit.client.0.smithi046.stdout:6/805: dwrite d7/f8b [0,4194304] 0 2024-04-26T12:28:49.780 INFO:tasks.workunit.client.0.smithi046.stdout:2/815: truncate d1/de/d65/d4a/f7d 250210 0 2024-04-26T12:28:49.781 INFO:tasks.workunit.client.0.smithi046.stdout:8/938: dwrite d7/d24/d50/d62/f84 [0,4194304] 0 2024-04-26T12:28:49.781 INFO:tasks.workunit.client.0.smithi046.stdout:9/728: readlink d0/d19/l36 0 2024-04-26T12:28:49.781 INFO:tasks.workunit.client.0.smithi046.stdout:3/854: dread d2/db/d84/da5/de6/f11a [0,4194304] 0 2024-04-26T12:28:49.781 INFO:tasks.workunit.client.0.smithi046.stdout:5/899: truncate d9/da/d18/d7d/ffb 756655 0 2024-04-26T12:28:49.782 INFO:tasks.workunit.client.0.smithi046.stdout:2/816: write d1/f2 [4735076,40444] 0 2024-04-26T12:28:49.783 INFO:tasks.workunit.client.0.smithi046.stdout:8/939: rmdir d7/d24/d50/d2a/d92 39 2024-04-26T12:28:49.783 INFO:tasks.workunit.client.0.smithi046.stdout:9/729: chown d0/d29/d69/l81 399230 1 2024-04-26T12:28:49.783 INFO:tasks.workunit.client.0.smithi046.stdout:2/817: symlink d1/de/d67/dc4/l115 0 2024-04-26T12:28:49.784 INFO:tasks.workunit.client.0.smithi046.stdout:3/855: mknod d2/d16/d35/dbc/dc9/dd3/c12e 0 2024-04-26T12:28:49.784 INFO:tasks.workunit.client.0.smithi046.stdout:3/856: sync 2024-04-26T12:28:49.784 INFO:tasks.workunit.client.0.smithi046.stdout:5/900: truncate d9/da/dd/d34/fcb 4732925 0 2024-04-26T12:28:49.786 INFO:tasks.workunit.client.0.smithi046.stdout:8/940: write d7/d24/f2f [2768080,97271] 0 2024-04-26T12:28:49.787 INFO:tasks.workunit.client.0.smithi046.stdout:6/806: dread d7/d1b/d37/d95/fa1 [0,4194304] 0 2024-04-26T12:28:49.788 INFO:tasks.workunit.client.0.smithi046.stdout:3/857: unlink d2/d16/d2c/d50/d71/d89/d98/dbb/fca 0 2024-04-26T12:28:49.788 INFO:tasks.workunit.client.0.smithi046.stdout:4/780: dread d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/f90 [0,4194304] 0 2024-04-26T12:28:49.788 INFO:tasks.workunit.client.0.smithi046.stdout:9/730: truncate d0/d2c/dda/d76/d7d/d72/da1/fb2 831449 0 2024-04-26T12:28:49.788 INFO:tasks.workunit.client.0.smithi046.stdout:8/941: unlink d7/d1c/cd1 0 2024-04-26T12:28:49.789 INFO:tasks.workunit.client.0.smithi046.stdout:5/901: truncate d9/da/dd/d34/d44/d97/da4/d35/f67 2587746 0 2024-04-26T12:28:49.789 INFO:tasks.workunit.client.0.smithi046.stdout:9/731: rename d0/d29/c44 to d0/d19/d51/c102 0 2024-04-26T12:28:49.790 INFO:tasks.workunit.client.0.smithi046.stdout:0/916: dread d9/d1d/d40/d41/d7e/d9d/f101 [0,4194304] 0 2024-04-26T12:28:49.791 INFO:tasks.workunit.client.0.smithi046.stdout:3/858: getdents d2/db 0 2024-04-26T12:28:49.791 INFO:tasks.workunit.client.0.smithi046.stdout:4/781: chown d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/cc8 130 1 2024-04-26T12:28:49.791 INFO:tasks.workunit.client.0.smithi046.stdout:8/942: creat d7/d24/d50/d2a/f13d x:0 0 0 2024-04-26T12:28:49.792 INFO:tasks.workunit.client.0.smithi046.stdout:2/818: dwrite d1/d42/f7a [0,4194304] 0 2024-04-26T12:28:49.792 INFO:tasks.workunit.client.0.smithi046.stdout:8/943: readlink l3 0 2024-04-26T12:28:49.792 INFO:tasks.workunit.client.0.smithi046.stdout:9/732: rmdir d0/d29/d69/d88 39 2024-04-26T12:28:49.793 INFO:tasks.workunit.client.0.smithi046.stdout:4/782: fsync d0/da/d17/d20/d9c/fbd 0 2024-04-26T12:28:49.794 INFO:tasks.workunit.client.0.smithi046.stdout:9/733: read d0/f8a [1793142,25696] 0 2024-04-26T12:28:49.794 INFO:tasks.workunit.client.0.smithi046.stdout:3/859: rename d2/d16/c48 to d2/d16/d35/dbc/c12f 0 2024-04-26T12:28:49.794 INFO:tasks.workunit.client.0.smithi046.stdout:8/944: creat d7/d24/d50/db3/f13e x:0 0 0 2024-04-26T12:28:49.795 INFO:tasks.workunit.client.0.smithi046.stdout:2/819: mkdir d1/de/dc8/d116 0 2024-04-26T12:28:49.796 INFO:tasks.workunit.client.0.smithi046.stdout:4/783: symlink d0/d41/df5/l108 0 2024-04-26T12:28:49.796 INFO:tasks.workunit.client.0.smithi046.stdout:6/807: dwrite d7/f8b [0,4194304] 0 2024-04-26T12:28:49.797 INFO:tasks.workunit.client.0.smithi046.stdout:9/734: creat d0/d19/f103 x:0 0 0 2024-04-26T12:28:49.798 INFO:tasks.workunit.client.0.smithi046.stdout:6/808: fdatasync d7/d2b/d31/f80 0 2024-04-26T12:28:49.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/735: rmdir d0/d29 39 2024-04-26T12:28:49.798 INFO:tasks.workunit.client.0.smithi046.stdout:4/784: unlink d0/da/d17/d20/d25/d35/d6d/d19/fa8 0 2024-04-26T12:28:49.798 INFO:tasks.workunit.client.0.smithi046.stdout:8/945: symlink d7/d24/d50/d2a/d54/l13f 0 2024-04-26T12:28:49.799 INFO:tasks.workunit.client.0.smithi046.stdout:3/860: read d2/db/d4a/f40 [4103713,79912] 0 2024-04-26T12:28:49.799 INFO:tasks.workunit.client.0.smithi046.stdout:4/785: creat d0/d41/df5/f109 x:0 0 0 2024-04-26T12:28:49.799 INFO:tasks.workunit.client.0.smithi046.stdout:9/736: write d0/d2c/fef [998588,89684] 0 2024-04-26T12:28:49.800 INFO:tasks.workunit.client.0.smithi046.stdout:2/820: truncate d1/de/d15/d18/d91/fb9 3861231 0 2024-04-26T12:28:49.801 INFO:tasks.workunit.client.0.smithi046.stdout:3/861: mknod d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d/c130 0 2024-04-26T12:28:49.801 INFO:tasks.workunit.client.0.smithi046.stdout:4/786: rename d0/d41/df5/f109 to d0/d64/dd9/f10a 0 2024-04-26T12:28:49.802 INFO:tasks.workunit.client.0.smithi046.stdout:8/946: creat d7/d1c/d129/f140 x:0 0 0 2024-04-26T12:28:49.802 INFO:tasks.workunit.client.0.smithi046.stdout:9/737: creat d0/d2c/dda/d76/d7d/d72/da1/dc8/f104 x:0 0 0 2024-04-26T12:28:49.803 INFO:tasks.workunit.client.0.smithi046.stdout:2/821: stat d1/de/d15/d18/dc1/db6/dda/d78/ff0 0 2024-04-26T12:28:49.804 INFO:tasks.workunit.client.0.smithi046.stdout:3/862: write d2/d16/d35/dbc/dc9/dd0/fb6 [392913,10495] 0 2024-04-26T12:28:49.804 INFO:tasks.workunit.client.0.smithi046.stdout:6/809: dwrite d7/d1b/d47/d65/f73 [4194304,4194304] 0 2024-04-26T12:28:49.805 INFO:tasks.workunit.client.0.smithi046.stdout:8/947: chown d7/d1c/d74/df4/d1b/dae/dcf/cfe 3 1 2024-04-26T12:28:49.805 INFO:tasks.workunit.client.0.smithi046.stdout:7/867: dread d16/d1a/d3e/d4f/feb [4194304,4194304] 0 2024-04-26T12:28:49.805 INFO:tasks.workunit.client.0.smithi046.stdout:4/787: rename d0/da/d17/d20/d25/d35/d61/f75 to d0/da/d17/d20/d9c/f10b 0 2024-04-26T12:28:49.806 INFO:tasks.workunit.client.0.smithi046.stdout:8/948: creat d7/da/f141 x:0 0 0 2024-04-26T12:28:49.806 INFO:tasks.workunit.client.0.smithi046.stdout:3/863: chown d2/d16/d2c/d50/d71/d89/dc5/d23/dbf/fdf 52 1 2024-04-26T12:28:49.806 INFO:tasks.workunit.client.0.smithi046.stdout:4/788: readlink d0/d41/df5/l108 0 2024-04-26T12:28:49.806 INFO:tasks.workunit.client.0.smithi046.stdout:2/822: link d1/de/d15/c81 d1/de/d15/d18/dc1/c117 0 2024-04-26T12:28:49.807 INFO:tasks.workunit.client.0.smithi046.stdout:7/868: truncate d16/d1a/d31/d5a/fa8 1676493 0 2024-04-26T12:28:49.807 INFO:tasks.workunit.client.0.smithi046.stdout:2/823: read d1/d42/f60 [3757507,9668] 0 2024-04-26T12:28:49.808 INFO:tasks.workunit.client.0.smithi046.stdout:4/789: chown d0/da/d17/d20/lb0 475746 1 2024-04-26T12:28:49.808 INFO:tasks.workunit.client.0.smithi046.stdout:8/949: mkdir d7/d1c/d74/df4/d1b/dae/dcf/d142 0 2024-04-26T12:28:49.808 INFO:tasks.workunit.client.0.smithi046.stdout:7/869: chown d16/d35/dac/dbb/l111 2715350 1 2024-04-26T12:28:49.808 INFO:tasks.workunit.client.0.smithi046.stdout:9/738: read d0/d19/d21/f30 [880873,4144] 0 2024-04-26T12:28:49.808 INFO:tasks.workunit.client.0.smithi046.stdout:7/870: chown d16/d3f/lec 22 1 2024-04-26T12:28:49.809 INFO:tasks.workunit.client.0.smithi046.stdout:3/864: fsync d2/d16/d2c/d50/d71/d89/dc5/f4b 0 2024-04-26T12:28:49.809 INFO:tasks.workunit.client.0.smithi046.stdout:1/793: dread d7/d14/fc7 [0,4194304] 0 2024-04-26T12:28:49.810 INFO:tasks.workunit.client.0.smithi046.stdout:4/790: creat d0/da/d17/d20/d25/d35/de1/f10c x:0 0 0 2024-04-26T12:28:49.810 INFO:tasks.workunit.client.0.smithi046.stdout:3/865: write d2/d16/f4f [424289,13362] 0 2024-04-26T12:28:49.811 INFO:tasks.workunit.client.0.smithi046.stdout:2/824: rename d1/de/d2b/f37 to d1/de/d65/d4a/d86/d96/f118 0 2024-04-26T12:28:49.811 INFO:tasks.workunit.client.0.smithi046.stdout:9/739: link d0/f15 d0/d2c/dda/d76/d7d/f105 0 2024-04-26T12:28:49.811 INFO:tasks.workunit.client.0.smithi046.stdout:4/791: readlink d0/d41/df5/l108 0 2024-04-26T12:28:49.811 INFO:tasks.workunit.client.0.smithi046.stdout:7/871: symlink d16/d1a/d31/d5a/d6b/df2/ddb/l11e 0 2024-04-26T12:28:49.811 INFO:tasks.workunit.client.0.smithi046.stdout:1/794: write d7/d12/f36 [451767,113765] 0 2024-04-26T12:28:49.811 INFO:tasks.workunit.client.0.smithi046.stdout:6/810: read d7/fe [9197385,83320] 0 2024-04-26T12:28:49.812 INFO:tasks.workunit.client.0.smithi046.stdout:1/795: fdatasync d7/db/d98/dc5/d2b/d31/fce 0 2024-04-26T12:28:49.813 INFO:tasks.workunit.client.0.smithi046.stdout:7/872: chown d16/d4e/d6c/d9f/le0 111 1 2024-04-26T12:28:49.813 INFO:tasks.workunit.client.0.smithi046.stdout:6/811: creat d7/d16/dbc/dda/f106 x:0 0 0 2024-04-26T12:28:49.814 INFO:tasks.workunit.client.0.smithi046.stdout:4/792: rename d0/da/d17/d20/d25/d35/f5d to d0/da/d70/f10d 0 2024-04-26T12:28:49.814 INFO:tasks.workunit.client.0.smithi046.stdout:2/825: read d1/de/d65/d4a/f7d [149400,109535] 0 2024-04-26T12:28:49.814 INFO:tasks.workunit.client.0.smithi046.stdout:9/740: getdents d0/d2c/d3d 0 2024-04-26T12:28:49.815 INFO:tasks.workunit.client.0.smithi046.stdout:1/796: creat d7/d14/d5d/d6b/f113 x:0 0 0 2024-04-26T12:28:49.815 INFO:tasks.workunit.client.0.smithi046.stdout:6/812: stat d7/d16/dbc/dda/fe0 0 2024-04-26T12:28:49.817 INFO:tasks.workunit.client.0.smithi046.stdout:4/793: write d0/da/da1/f6e [1761489,86163] 0 2024-04-26T12:28:49.817 INFO:tasks.workunit.client.0.smithi046.stdout:2/826: write d1/de/d67/f112 [613365,84744] 0 2024-04-26T12:28:49.818 INFO:tasks.workunit.client.0.smithi046.stdout:8/950: dwrite d7/d1c/d74/df4/f45 [4194304,4194304] 0 2024-04-26T12:28:49.818 INFO:tasks.workunit.client.0.smithi046.stdout:3/866: dwrite d2/d16/f4f [0,4194304] 0 2024-04-26T12:28:49.819 INFO:tasks.workunit.client.0.smithi046.stdout:2/827: mkdir d1/de/d2b/d119 0 2024-04-26T12:28:49.819 INFO:tasks.workunit.client.0.smithi046.stdout:9/741: getdents d0/d2c/dda/d76/d7d/d72 0 2024-04-26T12:28:49.820 INFO:tasks.workunit.client.0.smithi046.stdout:4/794: rmdir d0/da/d17/d20/d25/d35/d6d/d19/d55/dae 39 2024-04-26T12:28:49.821 INFO:tasks.workunit.client.0.smithi046.stdout:3/867: truncate d2/d16/d35/f12a 77311 0 2024-04-26T12:28:49.823 INFO:tasks.workunit.client.0.smithi046.stdout:3/868: read - d2/d16/d2c/d50/d71/d89/f119 zero size 2024-04-26T12:28:49.824 INFO:tasks.workunit.client.0.smithi046.stdout:5/902: dread d9/da/dd/d34/d45/f56 [0,4194304] 0 2024-04-26T12:28:49.825 INFO:tasks.workunit.client.0.smithi046.stdout:9/742: rename d0/d2c/d3d/d52/cf2 to d0/d2c/c106 0 2024-04-26T12:28:49.825 INFO:tasks.workunit.client.0.smithi046.stdout:1/797: truncate d7/db/d98/dc5/fa 1719238 0 2024-04-26T12:28:49.826 INFO:tasks.workunit.client.0.smithi046.stdout:3/869: write d2/d16/d35/dbc/f10c [983609,29909] 0 2024-04-26T12:28:49.827 INFO:tasks.workunit.client.0.smithi046.stdout:0/917: dread d9/d1d/d40/d41/d7e/fb8 [0,4194304] 0 2024-04-26T12:28:49.827 INFO:tasks.workunit.client.0.smithi046.stdout:2/828: dwrite d1/de/d65/d4a/d58/fc0 [0,4194304] 0 2024-04-26T12:28:49.827 INFO:tasks.workunit.client.0.smithi046.stdout:5/903: creat d9/da/dd/dd7/d7e/f131 x:0 0 0 2024-04-26T12:28:49.827 INFO:tasks.workunit.client.0.smithi046.stdout:1/798: chown d7/d14/d5d/lc3 1000333 1 2024-04-26T12:28:49.828 INFO:tasks.workunit.client.0.smithi046.stdout:4/795: dwrite d0/d1/d5/db/f10 [0,4194304] 0 2024-04-26T12:28:49.828 INFO:tasks.workunit.client.0.smithi046.stdout:2/829: rmdir d1/de/d65/d1b 39 2024-04-26T12:28:49.829 INFO:tasks.workunit.client.0.smithi046.stdout:3/870: dread - d2/db/d84/f12c zero size 2024-04-26T12:28:49.830 INFO:tasks.workunit.client.0.smithi046.stdout:8/951: dread d7/d1c/d74/df4/d1b/dae/dcf/fd6 [0,4194304] 0 2024-04-26T12:28:49.831 INFO:tasks.workunit.client.0.smithi046.stdout:0/918: creat d9/d1d/d40/d41/d7e/da5/dad/dbd/f143 x:0 0 0 2024-04-26T12:28:49.831 INFO:tasks.workunit.client.0.smithi046.stdout:3/871: mkdir d2/db/d131 0 2024-04-26T12:28:49.831 INFO:tasks.workunit.client.0.smithi046.stdout:1/799: mkdir d7/d14/d5d/d32/d41/d8f/d114 0 2024-04-26T12:28:49.832 INFO:tasks.workunit.client.0.smithi046.stdout:1/800: chown d7/db/dee 8463 1 2024-04-26T12:28:49.834 INFO:tasks.workunit.client.0.smithi046.stdout:9/743: dread d0/d2c/f4d [0,4194304] 0 2024-04-26T12:28:49.834 INFO:tasks.workunit.client.0.smithi046.stdout:1/801: chown d7/db/d98/dc5/d2b/d39/d3c/f72 24302 1 2024-04-26T12:28:49.834 INFO:tasks.workunit.client.0.smithi046.stdout:5/904: dwrite d9/da/dd/d34/d44/d97/da4/d35/f67 [0,4194304] 0 2024-04-26T12:28:49.835 INFO:tasks.workunit.client.0.smithi046.stdout:7/873: dread d16/d1a/d31/d4d/fa5 [0,4194304] 0 2024-04-26T12:28:49.836 INFO:tasks.workunit.client.0.smithi046.stdout:3/872: mkdir d2/d16/d2c/d50/d71/df6/d132 0 2024-04-26T12:28:49.837 INFO:tasks.workunit.client.0.smithi046.stdout:2/830: read d1/de/d65/d4a/f7d [33242,118897] 0 2024-04-26T12:28:49.837 INFO:tasks.workunit.client.0.smithi046.stdout:4/796: rename d0/da/d17/d20/d9c/fbd to d0/da/d17/d20/d25/d35/d6d/f10e 0 2024-04-26T12:28:49.838 INFO:tasks.workunit.client.0.smithi046.stdout:2/831: write d1/de/d15/d18/f9b [449657,1854] 0 2024-04-26T12:28:49.838 INFO:tasks.workunit.client.0.smithi046.stdout:4/797: chown d0/da/d17/d20/d25/ffa 440 1 2024-04-26T12:28:49.839 INFO:tasks.workunit.client.0.smithi046.stdout:2/832: readlink d1/de/d15/d18/l1a 0 2024-04-26T12:28:49.839 INFO:tasks.workunit.client.0.smithi046.stdout:5/905: fdatasync d9/da/d18/f2d 0 2024-04-26T12:28:49.840 INFO:tasks.workunit.client.0.smithi046.stdout:1/802: creat d7/db/d98/dc5/d2b/d31/d82/f115 x:0 0 0 2024-04-26T12:28:49.840 INFO:tasks.workunit.client.0.smithi046.stdout:0/919: rename d9/dc/dd/d45/c81 to d9/d1d/d40/d41/d7e/de1/c144 0 2024-04-26T12:28:49.841 INFO:tasks.workunit.client.0.smithi046.stdout:3/873: symlink d2/db0/l133 0 2024-04-26T12:28:49.841 INFO:tasks.workunit.client.0.smithi046.stdout:7/874: dwrite d16/d3f/d81/ffe [0,4194304] 0 2024-04-26T12:28:49.842 INFO:tasks.workunit.client.0.smithi046.stdout:2/833: rmdir d1/de/d15/d18/d8a 39 2024-04-26T12:28:49.842 INFO:tasks.workunit.client.0.smithi046.stdout:5/906: creat d9/f132 x:0 0 0 2024-04-26T12:28:49.843 INFO:tasks.workunit.client.0.smithi046.stdout:3/874: write d2/d16/d2c/d50/f128 [41410,55153] 0 2024-04-26T12:28:49.843 INFO:tasks.workunit.client.0.smithi046.stdout:9/744: link d0/d29/d69/ca0 d0/d2c/dda/d76/d7d/d72/c107 0 2024-04-26T12:28:49.845 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:49.845 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:49.849 INFO:tasks.workunit.client.0.smithi046.stdout:0/920: fsync d9/dc/dd/d45/d69/f95 0 2024-04-26T12:28:49.850 INFO:tasks.workunit.client.0.smithi046.stdout:2/834: chown d1/de/d15/d18/dc1/db6/dda/d78/ff0 8403 1 2024-04-26T12:28:49.850 INFO:tasks.workunit.client.0.smithi046.stdout:0/921: chown d9/d1d/d40/d41/f54 101235271 1 2024-04-26T12:28:49.850 INFO:tasks.workunit.client.0.smithi046.stdout:6/813: dread d7/d16/f56 [0,4194304] 0 2024-04-26T12:28:49.851 INFO:tasks.workunit.client.0.smithi046.stdout:4/798: dwrite d0/da/d17/d20/d9c/f10b [0,4194304] 0 2024-04-26T12:28:49.851 INFO:tasks.workunit.client.0.smithi046.stdout:1/803: rename d7/db/d98/dc5/d2b/d31/f103 to d7/d14/d5d/d6b/dc2/d76/f116 0 2024-04-26T12:28:49.851 INFO:tasks.workunit.client.0.smithi046.stdout:9/745: rmdir d0/d2c/dda/d76/d7d/d72/d85 39 2024-04-26T12:28:49.851 INFO:tasks.workunit.client.0.smithi046.stdout:9/746: readlink d0/d2c/l3a 0 2024-04-26T12:28:49.851 INFO:tasks.workunit.client.0.smithi046.stdout:6/814: symlink d7/d1b/d47/d65/d77/df7/l107 0 2024-04-26T12:28:49.851 INFO:tasks.workunit.client.0.smithi046.stdout:6/815: dread - d7/fbf zero size 2024-04-26T12:28:49.852 INFO:tasks.workunit.client.0.smithi046.stdout:9/747: fdatasync d0/d2c/dda/d76/d7d/faa 0 2024-04-26T12:28:49.853 INFO:tasks.workunit.client.0.smithi046.stdout:6/816: symlink d7/d1b/d37/l108 0 2024-04-26T12:28:49.853 INFO:tasks.workunit.client.0.smithi046.stdout:9/748: write d0/db6/fbc [6815396,124275] 0 2024-04-26T12:28:49.854 INFO:tasks.workunit.client.0.smithi046.stdout:6/817: chown d7/d2b/d31/d4d/l72 613612 1 2024-04-26T12:28:49.854 INFO:tasks.workunit.client.0.smithi046.stdout:9/749: chown d0/d2c/dbe/dc0/lcf 1289 1 2024-04-26T12:28:49.854 INFO:tasks.workunit.client.0.smithi046.stdout:5/907: creat d9/da/f133 x:0 0 0 2024-04-26T12:28:49.854 INFO:tasks.workunit.client.0.smithi046.stdout:2/835: read d1/de/d15/d18/dc1/db6/dda/d78/f7b [186904,1669] 0 2024-04-26T12:28:49.854 INFO:tasks.workunit.client.0.smithi046.stdout:8/952: dread d7/d1c/d74/df4/fe3 [0,4194304] 0 2024-04-26T12:28:49.854 INFO:tasks.workunit.client.0.smithi046.stdout:9/750: write d0/f9a [1246076,105124] 0 2024-04-26T12:28:49.854 INFO:tasks.workunit.client.0.smithi046.stdout:2/836: dread - d1/de/d15/d18/dc1/db6/f10f zero size 2024-04-26T12:28:49.854 INFO:tasks.workunit.client.0.smithi046.stdout:8/953: write d7/d24/d50/d62/fdb [867120,105385] 0 2024-04-26T12:28:49.854 INFO:tasks.workunit.client.0.smithi046.stdout:4/799: dread d0/da/d17/d20/d25/d35/d6d/d19/d55/dae/fc2 [0,4194304] 0 2024-04-26T12:28:49.855 INFO:tasks.workunit.client.0.smithi046.stdout:2/837: symlink d1/d42/l11a 0 2024-04-26T12:28:49.855 INFO:tasks.workunit.client.0.smithi046.stdout:4/800: chown d0/d41/c8a 12613 1 2024-04-26T12:28:49.855 INFO:tasks.workunit.client.0.smithi046.stdout:7/875: truncate d16/d1a/d31/d4d/f5f 864357 0 2024-04-26T12:28:49.855 INFO:tasks.workunit.client.0.smithi046.stdout:2/838: creat d1/de/dc8/ddd/f11b x:0 0 0 2024-04-26T12:28:49.856 INFO:tasks.workunit.client.0.smithi046.stdout:0/922: truncate d9/d1d/d5d/d6b/d8a/d8c/fd7 3370306 0 2024-04-26T12:28:49.858 INFO:tasks.workunit.client.0.smithi046.stdout:6/818: truncate d7/d2b/f30 268561 0 2024-04-26T12:28:49.858 INFO:tasks.workunit.client.0.smithi046.stdout:2/839: fsync d1/de/d2b/f50 0 2024-04-26T12:28:49.858 INFO:tasks.workunit.client.0.smithi046.stdout:8/954: link d7/da/df/c40 d7/d24/d50/d2a/d39/da6/d10f/c143 0 2024-04-26T12:28:49.862 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:49.856+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:49.862 INFO:tasks.workunit.client.0.smithi046.stdout:8/955: mkdir d7/da/d88/d144 0 2024-04-26T12:28:49.863 INFO:tasks.workunit.client.0.smithi046.stdout:6/819: creat d7/d1b/dee/f109 x:0 0 0 2024-04-26T12:28:49.863 INFO:tasks.workunit.client.0.smithi046.stdout:0/923: rmdir d9/d1d/d40/d41/d7e/da5/dad/dbd/dcd 39 2024-04-26T12:28:49.863 INFO:tasks.workunit.client.0.smithi046.stdout:9/751: dwrite d0/d2c/dda/d76/d7d/d72/f91 [0,4194304] 0 2024-04-26T12:28:49.863 INFO:tasks.workunit.client.0.smithi046.stdout:1/804: dwrite d7/db/d98/dc5/d2b/d39/ff2 [0,4194304] 0 2024-04-26T12:28:49.863 INFO:tasks.workunit.client.0.smithi046.stdout:6/820: mkdir d7/d2b/d31/d10a 0 2024-04-26T12:28:49.863 INFO:tasks.workunit.client.0.smithi046.stdout:9/752: creat d0/d2c/f108 x:0 0 0 2024-04-26T12:28:49.864 INFO:tasks.workunit.client.0.smithi046.stdout:1/805: chown d7/db/d98/dc5/d2b/d96/fb4 3610969 1 2024-04-26T12:28:49.864 INFO:tasks.workunit.client.0.smithi046.stdout:9/753: symlink d0/d29/dd8/l109 0 2024-04-26T12:28:49.864 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:49.866 INFO:tasks.workunit.client.0.smithi046.stdout:2/840: dwrite d1/f109 [0,4194304] 0 2024-04-26T12:28:49.866 INFO:tasks.workunit.client.0.smithi046.stdout:9/754: symlink d0/d2c/dbe/dc0/l10a 0 2024-04-26T12:28:49.866 INFO:tasks.workunit.client.0.smithi046.stdout:8/956: dread d7/d24/d50/d2a/d39/d9d/faa [0,4194304] 0 2024-04-26T12:28:49.867 INFO:tasks.workunit.client.0.smithi046.stdout:9/755: creat d0/d2c/d47/f10b x:0 0 0 2024-04-26T12:28:49.867 INFO:tasks.workunit.client.0.smithi046.stdout:2/841: truncate d1/de/d67/dc4/ff9 590288 0 2024-04-26T12:28:49.869 INFO:tasks.workunit.client.0.smithi046.stdout:0/924: truncate d9/d1d/d40/d41/d7e/d9d/fd8 2881461 0 2024-04-26T12:28:49.869 INFO:tasks.workunit.client.0.smithi046.stdout:2/842: mkdir d1/de/d15/d18/dc1/d11c 0 2024-04-26T12:28:49.870 INFO:tasks.workunit.client.0.smithi046.stdout:3/875: dread d2/db0/dc4/f42 [0,4194304] 0 2024-04-26T12:28:49.870 INFO:tasks.workunit.client.0.smithi046.stdout:0/925: write d9/dc/f32 [159979,10390] 0 2024-04-26T12:28:49.870 INFO:tasks.workunit.client.0.smithi046.stdout:9/756: read d0/d29/f3b [1773844,59140] 0 2024-04-26T12:28:49.871 INFO:tasks.workunit.client.0.smithi046.stdout:0/926: stat d9/dc/lf6 0 2024-04-26T12:28:49.871 INFO:tasks.workunit.client.0.smithi046.stdout:9/757: write d0/d19/f103 [513795,81222] 0 2024-04-26T12:28:49.872 INFO:tasks.workunit.client.0.smithi046.stdout:3/876: write d2/d16/d2c/d50/d71/d89/fba [685462,31027] 0 2024-04-26T12:28:49.874 INFO:tasks.workunit.client.0.smithi046.stdout:9/758: truncate d0/d2c/d47/f10b 151939 0 2024-04-26T12:28:49.874 INFO:tasks.workunit.client.0.smithi046.stdout:8/957: dwrite d7/d1c/d74/df4/f17 [4194304,4194304] 0 2024-04-26T12:28:49.875 INFO:tasks.workunit.client.0.smithi046.stdout:3/877: read d2/d16/d35/dbc/f10c [503220,58827] 0 2024-04-26T12:28:49.875 INFO:tasks.workunit.client.0.smithi046.stdout:9/759: rmdir d0/d29 39 2024-04-26T12:28:49.875 INFO:tasks.workunit.client.0.smithi046.stdout:8/958: stat d7/d1c/d74 0 2024-04-26T12:28:49.876 INFO:tasks.workunit.client.0.smithi046.stdout:2/843: dwrite d1/de/d67/dc4/ff9 [0,4194304] 0 2024-04-26T12:28:49.876 INFO:tasks.workunit.client.0.smithi046.stdout:0/927: link d9/d1d/d40/d41/d7e/da5/dad/dbd/f143 d9/d1d/d40/d41/d7e/f145 0 2024-04-26T12:28:49.876 INFO:tasks.workunit.client.0.smithi046.stdout:2/844: chown d1/de 1724 1 2024-04-26T12:28:49.876 INFO:tasks.workunit.client.0.smithi046.stdout:0/928: readlink d9/d1d/ldb 0 2024-04-26T12:28:49.876 INFO:tasks.workunit.client.0.smithi046.stdout:3/878: creat d2/d16/d35/f134 x:0 0 0 2024-04-26T12:28:49.878 INFO:tasks.workunit.client.0.smithi046.stdout:9/760: link d0/d29/d69/d88/f94 d0/d2c/dbe/dd2/dff/f10c 0 2024-04-26T12:28:49.878 INFO:tasks.workunit.client.0.smithi046.stdout:3/879: chown d2/db/d84/d8a/c8f 9999 1 2024-04-26T12:28:49.879 INFO:tasks.workunit.client.0.smithi046.stdout:0/929: rename d9/d1d/d40/d41/d7e/da5/dad/cce to d9/d1d/d40/d41/dc0/db2/c146 0 2024-04-26T12:28:49.879 INFO:tasks.workunit.client.0.smithi046.stdout:9/761: getdents d0/db6 0 2024-04-26T12:28:49.879 INFO:tasks.workunit.client.0.smithi046.stdout:8/959: truncate d7/d1c/d74/df4/d1b/d7d/dc1/dfd/f119 4980959 0 2024-04-26T12:28:49.879 INFO:tasks.workunit.client.0.smithi046.stdout:3/880: creat d2/d16/d2c/d50/d71/d89/dc5/d23/f135 x:0 0 0 2024-04-26T12:28:49.880 INFO:tasks.workunit.client.0.smithi046.stdout:0/930: creat d9/dc/dd/d45/d69/f147 x:0 0 0 2024-04-26T12:28:49.881 INFO:tasks.workunit.client.0.smithi046.stdout:8/960: creat d7/d24/d56/f145 x:0 0 0 2024-04-26T12:28:49.881 INFO:tasks.workunit.client.0.smithi046.stdout:9/762: truncate d0/d2c/f108 939525 0 2024-04-26T12:28:49.882 INFO:tasks.workunit.client.0.smithi046.stdout:8/961: fdatasync d7/d1c/d74/df4/d1b/dae/dcf/fd6 0 2024-04-26T12:28:49.882 INFO:tasks.workunit.client.0.smithi046.stdout:9/763: creat d0/d2c/dbe/dd2/f10d x:0 0 0 2024-04-26T12:28:49.883 INFO:tasks.workunit.client.0.smithi046.stdout:9/764: mkdir d0/d19/d51/dac/ded/d10e 0 2024-04-26T12:28:49.883 INFO:tasks.workunit.client.0.smithi046.stdout:8/962: symlink d7/d1c/d74/df4/d27/db0/l146 0 2024-04-26T12:28:49.885 INFO:tasks.workunit.client.0.smithi046.stdout:9/765: creat d0/f10f x:0 0 0 2024-04-26T12:28:49.886 INFO:tasks.workunit.client.0.smithi046.stdout:8/963: write d7/da/df/f10 [279668,748] 0 2024-04-26T12:28:49.886 INFO:tasks.workunit.client.0.smithi046.stdout:3/881: dwrite d2/db/fe1 [0,4194304] 0 2024-04-26T12:28:49.886 INFO:tasks.workunit.client.0.smithi046.stdout:0/931: dwrite d9/dc/dd/d45/f4e [0,4194304] 0 2024-04-26T12:28:49.887 INFO:tasks.workunit.client.0.smithi046.stdout:2/845: truncate d1/de/d65/f5d 545038 0 2024-04-26T12:28:49.887 INFO:tasks.workunit.client.0.smithi046.stdout:2/846: read - d1/de/f104 zero size 2024-04-26T12:28:49.888 INFO:tasks.workunit.client.0.smithi046.stdout:8/964: symlink d7/d24/d50/d2a/d54/l147 0 2024-04-26T12:28:49.888 INFO:tasks.workunit.client.0.smithi046.stdout:3/882: symlink d2/db/d84/d8a/l136 0 2024-04-26T12:28:49.888 INFO:tasks.workunit.client.0.smithi046.stdout:0/932: mkdir d9/d1d/d5d/d6b/d8a/d148 0 2024-04-26T12:28:49.889 INFO:tasks.workunit.client.0.smithi046.stdout:8/965: stat d7/d24/d50/d2a/d39/d9d/faa 0 2024-04-26T12:28:49.889 INFO:tasks.workunit.client.0.smithi046.stdout:0/933: write d9/dc/db9/f13a [838063,58687] 0 2024-04-26T12:28:49.889 INFO:tasks.workunit.client.0.smithi046.stdout:3/883: stat d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d/f12b 0 2024-04-26T12:28:49.889 INFO:tasks.workunit.client.0.smithi046.stdout:2/847: stat d1/de/d15/d18/dc1/db6/dda/d78/cb5 0 2024-04-26T12:28:49.890 INFO:tasks.workunit.client.0.smithi046.stdout:8/966: read - d7/da/f12e zero size 2024-04-26T12:28:49.890 INFO:tasks.workunit.client.0.smithi046.stdout:9/766: write d0/d29/d69/f70 [103870,95349] 0 2024-04-26T12:28:49.891 INFO:tasks.workunit.client.0.smithi046.stdout:3/884: stat d2/d16/d2c/fd8 0 2024-04-26T12:28:49.891 INFO:tasks.workunit.client.0.smithi046.stdout:9/767: write d0/d2c/d3d/fb8 [3775855,6388] 0 2024-04-26T12:28:49.892 INFO:tasks.workunit.client.0.smithi046.stdout:0/934: creat d9/d1d/d5d/d6b/d8a/d8c/f149 x:0 0 0 2024-04-26T12:28:49.893 INFO:tasks.workunit.client.0.smithi046.stdout:9/768: chown d0/d2c/dda/d76/d7d/d72/da1/dc8/d9b 264675834 1 2024-04-26T12:28:49.893 INFO:tasks.workunit.client.0.smithi046.stdout:3/885: readlink d2/d16/d2c/d50/d71/d89/lee 0 2024-04-26T12:28:49.894 INFO:tasks.workunit.client.0.smithi046.stdout:8/967: dread d7/d24/d50/d62/f84 [0,4194304] 0 2024-04-26T12:28:49.895 INFO:tasks.workunit.client.0.smithi046.stdout:6/821: dread d7/d2b/d31/f3f [0,4194304] 0 2024-04-26T12:28:49.896 INFO:tasks.workunit.client.0.smithi046.stdout:8/968: mkdir d7/d24/d50/d148 0 2024-04-26T12:28:49.896 INFO:tasks.workunit.client.0.smithi046.stdout:3/886: mknod d2/db/d4a/da9/c137 0 2024-04-26T12:28:49.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/822: write d7/d16/dbc/dda/f106 [587072,28682] 0 2024-04-26T12:28:49.897 INFO:tasks.workunit.client.0.smithi046.stdout:9/769: dread d0/d2c/d47/f10b [0,4194304] 0 2024-04-26T12:28:49.897 INFO:tasks.workunit.client.0.smithi046.stdout:8/969: rmdir d7/da/d88/d131 0 2024-04-26T12:28:49.897 INFO:tasks.workunit.client.0.smithi046.stdout:3/887: mkdir d2/d16/d2c/d50/d71/df6/d138 0 2024-04-26T12:28:49.898 INFO:tasks.workunit.client.0.smithi046.stdout:3/888: dread - d2/db/f9d zero size 2024-04-26T12:28:49.898 INFO:tasks.workunit.client.0.smithi046.stdout:8/970: write d7/d24/d50/d2a/d39/f61 [1641909,112388] 0 2024-04-26T12:28:49.899 INFO:tasks.workunit.client.0.smithi046.stdout:8/971: mknod d7/d24/d50/db3/c149 0 2024-04-26T12:28:49.899 INFO:tasks.workunit.client.0.smithi046.stdout:3/889: mkdir d2/db0/dc4/d127/d139 0 2024-04-26T12:28:49.899 INFO:tasks.workunit.client.0.smithi046.stdout:3/890: chown d2/db/caa 84561 1 2024-04-26T12:28:49.900 INFO:tasks.workunit.client.0.smithi046.stdout:3/891: write d2/db/d4a/df0/f10f [47792,38318] 0 2024-04-26T12:28:49.901 INFO:tasks.workunit.client.0.smithi046.stdout:3/892: write d2/db/d4a/df0/f113 [663113,99636] 0 2024-04-26T12:28:49.902 INFO:tasks.workunit.client.0.smithi046.stdout:6/823: dread d7/d1b/d37/f7d [0,4194304] 0 2024-04-26T12:28:49.903 INFO:tasks.workunit.client.0.smithi046.stdout:1/806: dread d7/db/d98/dc5/d2b/f6a [0,4194304] 0 2024-04-26T12:28:49.903 INFO:tasks.workunit.client.0.smithi046.stdout:6/824: fsync d7/d16/dbc/dda/f106 0 2024-04-26T12:28:49.904 INFO:tasks.workunit.client.0.smithi046.stdout:0/935: dread d9/d1d/d40/d41/d7e/da5/dad/dbd/fa8 [0,4194304] 0 2024-04-26T12:28:49.908 INFO:tasks.workunit.client.0.smithi046.stdout:8/972: dwrite d7/d1c/d74/df4/f41 [0,4194304] 0 2024-04-26T12:28:49.910 INFO:tasks.workunit.client.0.smithi046.stdout:3/893: dwrite d2/db/d84/fd9 [0,4194304] 0 2024-04-26T12:28:49.910 INFO:tasks.workunit.client.0.smithi046.stdout:1/807: dread d7/db/d98/fec [0,4194304] 0 2024-04-26T12:28:49.911 INFO:tasks.workunit.client.0.smithi046.stdout:0/936: dwrite d9/dc/db9/f13a [0,4194304] 0 2024-04-26T12:28:49.911 INFO:tasks.workunit.client.0.smithi046.stdout:3/894: fdatasync d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d/f12b 0 2024-04-26T12:28:49.912 INFO:tasks.workunit.client.0.smithi046.stdout:8/973: unlink d7/da/fa7 0 2024-04-26T12:28:49.912 INFO:tasks.workunit.client.0.smithi046.stdout:1/808: mkdir d7/d14/d5d/d6b/dc2/d117 0 2024-04-26T12:28:49.913 INFO:tasks.workunit.client.0.smithi046.stdout:3/895: mknod d2/d16/d2c/d50/d71/d89/d98/dbb/c13a 0 2024-04-26T12:28:49.914 INFO:tasks.workunit.client.0.smithi046.stdout:1/809: write d7/d14/d5d/f7d [454532,39909] 0 2024-04-26T12:28:49.914 INFO:tasks.workunit.client.0.smithi046.stdout:5/908: sync 2024-04-26T12:28:49.914 INFO:tasks.workunit.client.0.smithi046.stdout:3/896: creat d2/db/d84/da5/de6/f13b x:0 0 0 2024-04-26T12:28:49.915 INFO:tasks.workunit.client.0.smithi046.stdout:1/810: rename d7/db/d98/dc5/d2b/d39/ceb to d7/c118 0 2024-04-26T12:28:49.916 INFO:tasks.workunit.client.0.smithi046.stdout:2/848: dread d1/de/d15/d18/dc1/db6/dda/f7e [0,4194304] 0 2024-04-26T12:28:49.916 INFO:tasks.workunit.client.0.smithi046.stdout:0/937: symlink d9/d1d/d40/d41/d7e/da5/dad/l14a 0 2024-04-26T12:28:49.917 INFO:tasks.workunit.client.0.smithi046.stdout:1/811: creat d7/db/d98/dc5/d2b/d31/d82/d95/f119 x:0 0 0 2024-04-26T12:28:49.918 INFO:tasks.workunit.client.0.smithi046.stdout:1/812: link d7/cdb d7/d14/d5d/d6b/dc2/d76/c11a 0 2024-04-26T12:28:49.919 INFO:tasks.workunit.client.0.smithi046.stdout:1/813: stat d7/d14/fc7 0 2024-04-26T12:28:49.921 INFO:tasks.workunit.client.0.smithi046.stdout:2/849: dwrite d1/de/d2b/f3a [0,4194304] 0 2024-04-26T12:28:49.922 INFO:tasks.workunit.client.0.smithi046.stdout:2/850: unlink d1/de/d15/d18/d8a/c9c 0 2024-04-26T12:28:49.923 INFO:tasks.workunit.client.0.smithi046.stdout:8/974: write d7/d1c/f8b [195851,91051] 0 2024-04-26T12:28:49.923 INFO:tasks.workunit.client.0.smithi046.stdout:0/938: truncate d9/dc/f42 2181326 0 2024-04-26T12:28:49.924 INFO:tasks.workunit.client.0.smithi046.stdout:6/825: dread d7/d1b/d37/fa0 [0,4194304] 0 2024-04-26T12:28:49.924 INFO:tasks.workunit.client.0.smithi046.stdout:2/851: creat d1/de/d15/d18/dc1/db6/dda/d78/f11d x:0 0 0 2024-04-26T12:28:49.924 INFO:tasks.workunit.client.0.smithi046.stdout:0/939: unlink d9/d1d/d40/lb6 0 2024-04-26T12:28:49.925 INFO:tasks.workunit.client.0.smithi046.stdout:2/852: write d1/de/d15/d18/dc1/db6/dda/d78/fbd [178097,52932] 0 2024-04-26T12:28:49.925 INFO:tasks.workunit.client.0.smithi046.stdout:1/814: read d7/db/d98/dc5/d2b/d39/db3/ff5 [609146,40299] 0 2024-04-26T12:28:49.926 INFO:tasks.workunit.client.0.smithi046.stdout:2/853: mkdir d1/d42/d113/dfd/d11e 0 2024-04-26T12:28:49.926 INFO:tasks.workunit.client.0.smithi046.stdout:0/940: getdents d9/d1d/d40/d41/d7e/da5/dad 0 2024-04-26T12:28:49.927 INFO:tasks.workunit.client.0.smithi046.stdout:0/941: creat d9/dc/d2a/d12d/f14b x:0 0 0 2024-04-26T12:28:49.927 INFO:tasks.workunit.client.0.smithi046.stdout:2/854: symlink d1/de/d65/d1b/l11f 0 2024-04-26T12:28:49.927 INFO:tasks.workunit.client.0.smithi046.stdout:8/975: unlink d7/d1c/d74/df4/d1b/d7d/cb1 0 2024-04-26T12:28:49.928 INFO:tasks.workunit.client.0.smithi046.stdout:2/855: readlink d1/de/dc8/l102 0 2024-04-26T12:28:49.928 INFO:tasks.workunit.client.0.smithi046.stdout:8/976: symlink d7/da/d88/l14a 0 2024-04-26T12:28:49.928 INFO:tasks.workunit.client.0.smithi046.stdout:2/856: rmdir d1/de/dc8/ddd 39 2024-04-26T12:28:49.928 INFO:tasks.workunit.client.0.smithi046.stdout:8/977: write d7/d24/f30 [632268,111217] 0 2024-04-26T12:28:49.929 INFO:tasks.workunit.client.0.smithi046.stdout:2/857: rename d1/de/d67 to d1/de/d67/d120 22 2024-04-26T12:28:49.929 INFO:tasks.workunit.client.0.smithi046.stdout:5/909: dread d9/da/dd/d34/f8a [0,4194304] 0 2024-04-26T12:28:49.930 INFO:tasks.workunit.client.0.smithi046.stdout:2/858: unlink d1/de/fab 0 2024-04-26T12:28:49.931 INFO:tasks.workunit.client.0.smithi046.stdout:6/826: truncate d7/d1b/d6a/d57/f8d 1940813 0 2024-04-26T12:28:49.931 INFO:tasks.workunit.client.0.smithi046.stdout:8/978: write d7/d1c/d74/df4/d1b/f8c [994780,12379] 0 2024-04-26T12:28:49.931 INFO:tasks.workunit.client.0.smithi046.stdout:0/942: rmdir d9/dc/d2a/d12d 39 2024-04-26T12:28:49.931 INFO:tasks.workunit.client.0.smithi046.stdout:5/910: mkdir d9/da/d18/dd4/d134 0 2024-04-26T12:28:49.931 INFO:tasks.workunit.client.0.smithi046.stdout:3/897: dread d2/d16/d2c/f54 [0,4194304] 0 2024-04-26T12:28:49.931 INFO:tasks.workunit.client.0.smithi046.stdout:8/979: mkdir d7/d14b 0 2024-04-26T12:28:49.932 INFO:tasks.workunit.client.0.smithi046.stdout:0/943: creat d9/d1d/f14c x:0 0 0 2024-04-26T12:28:49.933 INFO:tasks.workunit.client.0.smithi046.stdout:8/980: mkdir d7/d11a/d12f/d14c 0 2024-04-26T12:28:49.933 INFO:tasks.workunit.client.0.smithi046.stdout:0/944: mkdir d9/db5/d14d 0 2024-04-26T12:28:49.934 INFO:tasks.workunit.client.0.smithi046.stdout:5/911: getdents d9/da/dd/dd7/d7e/dca 0 2024-04-26T12:28:49.934 INFO:tasks.workunit.client.0.smithi046.stdout:0/945: readlink d9/dc/lf 0 2024-04-26T12:28:49.936 INFO:tasks.workunit.client.0.smithi046.stdout:5/912: mkdir d9/da/d18/dd4/d135 0 2024-04-26T12:28:49.936 INFO:tasks.workunit.client.0.smithi046.stdout:0/946: readlink d9/d1d/d40/d41/d7e/de1/l136 0 2024-04-26T12:28:49.937 INFO:tasks.workunit.client.0.smithi046.stdout:2/859: dwrite d1/de/d65/d1b/ff3 [0,4194304] 0 2024-04-26T12:28:49.938 INFO:tasks.workunit.client.0.smithi046.stdout:3/898: dwrite d2/db0/fe7 [0,4194304] 0 2024-04-26T12:28:49.938 INFO:tasks.workunit.client.0.smithi046.stdout:5/913: mknod d9/da/d18/d7d/c136 0 2024-04-26T12:28:49.939 INFO:tasks.workunit.client.0.smithi046.stdout:5/914: readlink d9/l14 0 2024-04-26T12:28:49.939 INFO:tasks.workunit.client.0.smithi046.stdout:0/947: chown d9/dc/dd/d45/d69/de6/l10a 19 1 2024-04-26T12:28:49.940 INFO:tasks.workunit.client.0.smithi046.stdout:3/899: rmdir d2/d16/d35/dbc/dc9/dd3 39 2024-04-26T12:28:49.940 INFO:tasks.workunit.client.0.smithi046.stdout:5/915: fsync d9/da/d18/d7d/f78 0 2024-04-26T12:28:49.940 INFO:tasks.workunit.client.0.smithi046.stdout:9/770: sync 2024-04-26T12:28:49.940 INFO:tasks.workunit.client.0.smithi046.stdout:7/876: sync 2024-04-26T12:28:49.941 INFO:tasks.workunit.client.0.smithi046.stdout:6/827: sync 2024-04-26T12:28:49.941 INFO:tasks.workunit.client.0.smithi046.stdout:4/801: sync 2024-04-26T12:28:49.941 INFO:tasks.workunit.client.0.smithi046.stdout:3/900: write d2/d16/d2c/fd8 [43785,13380] 0 2024-04-26T12:28:49.941 INFO:tasks.workunit.client.0.smithi046.stdout:5/916: write d9/da/d18/d7d/f78 [1206456,84539] 0 2024-04-26T12:28:49.942 INFO:tasks.workunit.client.0.smithi046.stdout:0/948: truncate d9/db5/fd9 1336074 0 2024-04-26T12:28:49.942 INFO:tasks.workunit.client.0.smithi046.stdout:7/877: write d16/d1a/d31/d55/f65 [947674,79949] 0 2024-04-26T12:28:49.943 INFO:tasks.workunit.client.0.smithi046.stdout:5/917: unlink d9/da/dd/f32 0 2024-04-26T12:28:49.943 INFO:tasks.workunit.client.0.smithi046.stdout:3/901: mknod d2/db/d4a/da9/c13c 0 2024-04-26T12:28:49.943 INFO:tasks.workunit.client.0.smithi046.stdout:0/949: readlink d9/l21 0 2024-04-26T12:28:49.944 INFO:tasks.workunit.client.0.smithi046.stdout:7/878: creat d16/d4e/d6c/d9f/f11f x:0 0 0 2024-04-26T12:28:49.945 INFO:tasks.workunit.client.0.smithi046.stdout:0/950: stat d9/d1d/d5d/d6b/d8a/d148 0 2024-04-26T12:28:49.946 INFO:tasks.workunit.client.0.smithi046.stdout:0/951: truncate d9/d1d/d5d/d6b/d8a/d8c/f109 604389 0 2024-04-26T12:28:49.946 INFO:tasks.workunit.client.0.smithi046.stdout:7/879: symlink d16/d1a/d31/d5a/d93/l120 0 2024-04-26T12:28:49.947 INFO:tasks.workunit.client.0.smithi046.stdout:9/771: link d0/d2c/dda/d76/d7d/d72/da1/dc8/cb4 d0/c110 0 2024-04-26T12:28:49.947 INFO:tasks.workunit.client.0.smithi046.stdout:5/918: link d9/da/dd/d34/d45/d8f/cbb d9/da/d15/c137 0 2024-04-26T12:28:49.947 INFO:tasks.workunit.client.0.smithi046.stdout:3/902: getdents d2/d16/d2c/d50/d71/d89/dc5/d1b 0 2024-04-26T12:28:49.947 INFO:tasks.workunit.client.0.smithi046.stdout:1/815: dread d7/f6f [0,4194304] 0 2024-04-26T12:28:49.948 INFO:tasks.workunit.client.0.smithi046.stdout:8/981: dread d7/d1c/d74/df4/d1b/f8e [0,4194304] 0 2024-04-26T12:28:49.948 INFO:tasks.workunit.client.0.smithi046.stdout:2/860: read d1/de/d65/d4a/f59 [1040813,74642] 0 2024-04-26T12:28:49.949 INFO:tasks.workunit.client.0.smithi046.stdout:3/903: write d2/db/d84/d8a/f8c [2078955,30292] 0 2024-04-26T12:28:49.949 INFO:tasks.workunit.client.0.smithi046.stdout:0/952: rename d9/db5/f134 to d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d117/f14e 0 2024-04-26T12:28:49.950 INFO:tasks.workunit.client.0.smithi046.stdout:1/816: getdents d7/db/d98 0 2024-04-26T12:28:49.952 INFO:tasks.workunit.client.0.smithi046.stdout:3/904: dread d2/f107 [0,4194304] 0 2024-04-26T12:28:49.953 INFO:tasks.workunit.client.0.smithi046.stdout:0/953: symlink d9/d1d/d5d/d6b/d8a/l14f 0 2024-04-26T12:28:49.954 INFO:tasks.workunit.client.0.smithi046.stdout:6/828: truncate d7/d1b/d47/f7b 545343 0 2024-04-26T12:28:49.954 INFO:tasks.workunit.client.0.smithi046.stdout:1/817: symlink d7/d14/d5d/d32/d41/d8f/dd3/l11b 0 2024-04-26T12:28:49.955 INFO:tasks.workunit.client.0.smithi046.stdout:7/880: rmdir d16/d4e/d6c 39 2024-04-26T12:28:49.955 INFO:tasks.workunit.client.0.smithi046.stdout:9/772: dwrite d0/d2c/d3d/d52/f5a [4194304,4194304] 0 2024-04-26T12:28:49.956 INFO:tasks.workunit.client.0.smithi046.stdout:5/919: dwrite d9/da/dd/d34/d44/f8e [0,4194304] 0 2024-04-26T12:28:49.957 INFO:tasks.workunit.client.0.smithi046.stdout:8/982: dwrite d7/d1c/d74/df4/f95 [0,4194304] 0 2024-04-26T12:28:49.958 INFO:tasks.workunit.client.0.smithi046.stdout:6/829: truncate d7/da7/daf/fc7 1178692 0 2024-04-26T12:28:49.961 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:49.958+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:49.964 INFO:tasks.workunit.client.0.smithi046.stdout:0/954: mkdir d9/dc/dd/d45/d69/d150 0 2024-04-26T12:28:49.964 INFO:tasks.workunit.client.0.smithi046.stdout:3/905: write d2/d16/d35/fcc [235092,106756] 0 2024-04-26T12:28:49.964 INFO:tasks.workunit.client.0.smithi046.stdout:9/773: dread - d0/d2c/fc2 zero size 2024-04-26T12:28:49.964 INFO:tasks.workunit.client.0.smithi046.stdout:8/983: creat d7/d24/d50/d2a/d39/d10c/f14d x:0 0 0 2024-04-26T12:28:49.964 INFO:tasks.workunit.client.0.smithi046.stdout:3/906: chown d2/d16/f4f 185717699 1 2024-04-26T12:28:49.965 INFO:tasks.workunit.client.0.smithi046.stdout:7/881: mkdir d16/d4e/d6c/d121 0 2024-04-26T12:28:49.965 INFO:tasks.workunit.client.0.smithi046.stdout:5/920: creat d9/da/d18/d7d/d105/f138 x:0 0 0 2024-04-26T12:28:49.965 INFO:tasks.workunit.client.0.smithi046.stdout:8/984: dread - d7/d24/d50/d2a/f13d zero size 2024-04-26T12:28:49.971 INFO:tasks.workunit.client.0.smithi046.stdout:9/774: mkdir d0/d2c/dda/d76/d7d/d72/da1/dc8/d111 0 2024-04-26T12:28:49.972 INFO:tasks.workunit.client.0.smithi046.stdout:4/802: sync 2024-04-26T12:28:49.972 INFO:tasks.workunit.client.0.smithi046.stdout:0/955: truncate d9/d1d/d40/d41/d7e/d9d/fd8 1042516 0 2024-04-26T12:28:49.972 INFO:tasks.workunit.client.0.smithi046.stdout:7/882: stat d16/d3f/d81/daa/dd5/f101 0 2024-04-26T12:28:49.972 INFO:tasks.workunit.client.0.smithi046.stdout:3/907: rmdir d2/d16/d2c/d50/d71/df6/d132 0 2024-04-26T12:28:49.972 INFO:tasks.workunit.client.0.smithi046.stdout:8/985: write d7/d1c/d74/df4/d27/db0/f11c [783617,122973] 0 2024-04-26T12:28:49.972 INFO:tasks.workunit.client.0.smithi046.stdout:5/921: link d9/l46 d9/da/d40/dfa/l139 0 2024-04-26T12:28:49.972 INFO:tasks.workunit.client.0.smithi046.stdout:7/883: creat d16/d4e/d6c/f122 x:0 0 0 2024-04-26T12:28:49.972 INFO:tasks.workunit.client.0.smithi046.stdout:0/956: getdents d9/dc/db9 0 2024-04-26T12:28:49.972 INFO:tasks.workunit.client.0.smithi046.stdout:8/986: rmdir d7/d1c/d74/df4/d1b/dae 39 2024-04-26T12:28:49.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/775: write d0/d2c/dda/d76/d7d/d72/d85/d97/f9c [1182394,6478] 0 2024-04-26T12:28:49.973 INFO:tasks.workunit.client.0.smithi046.stdout:5/922: truncate d9/f41 2168119 0 2024-04-26T12:28:49.973 INFO:tasks.workunit.client.0.smithi046.stdout:2/861: dread d1/de/d65/d4a/d58/f73 [0,4194304] 0 2024-04-26T12:28:49.973 INFO:tasks.workunit.client.0.smithi046.stdout:7/884: truncate d16/d35/f117 197546 0 2024-04-26T12:28:49.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/776: fdatasync d0/f15 0 2024-04-26T12:28:49.973 INFO:tasks.workunit.client.0.smithi046.stdout:0/957: write d9/dc/dd/dd2/fee [2230960,25548] 0 2024-04-26T12:28:49.973 INFO:tasks.workunit.client.0.smithi046.stdout:8/987: stat d7/d1c/d74/df4/d27/db0/fc3 0 2024-04-26T12:28:49.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/777: chown d0/d2c/d47/l14 76512733 1 2024-04-26T12:28:49.973 INFO:tasks.workunit.client.0.smithi046.stdout:5/923: symlink d9/da/dd/dd7/db0/de0/d119/l13a 0 2024-04-26T12:28:49.973 INFO:tasks.workunit.client.0.smithi046.stdout:8/988: mknod d7/d24/d50/c14e 0 2024-04-26T12:28:49.975 INFO:tasks.workunit.client.0.smithi046.stdout:9/778: mknod d0/d29/d69/d88/c112 0 2024-04-26T12:28:49.975 INFO:tasks.workunit.client.0.smithi046.stdout:3/908: dwrite d2/db/d62/fac [0,4194304] 0 2024-04-26T12:28:49.976 INFO:tasks.workunit.client.0.smithi046.stdout:8/989: write d7/da/df/f11d [3964976,64009] 0 2024-04-26T12:28:49.976 INFO:tasks.workunit.client.0.smithi046.stdout:5/924: creat d9/da/dd/dd7/db0/db6/d121/f13b x:0 0 0 2024-04-26T12:28:49.976 INFO:tasks.workunit.client.0.smithi046.stdout:4/803: sync 2024-04-26T12:28:49.976 INFO:tasks.workunit.client.0.smithi046.stdout:9/779: truncate d0/d2c/f9f 73314 0 2024-04-26T12:28:49.976 INFO:tasks.workunit.client.0.smithi046.stdout:3/909: sync 2024-04-26T12:28:49.977 INFO:tasks.workunit.client.0.smithi046.stdout:4/804: sync 2024-04-26T12:28:49.977 INFO:tasks.workunit.client.0.smithi046.stdout:8/990: getdents d7/d1c/d74/df4 0 2024-04-26T12:28:49.977 INFO:tasks.workunit.client.0.smithi046.stdout:9/780: getdents d0/d2c/dda/d76/d7d/d72/da1/dc8/d9b 0 2024-04-26T12:28:49.979 INFO:tasks.workunit.client.0.smithi046.stdout:9/781: readlink d0/d29/d69/d88/ld0 0 2024-04-26T12:28:49.979 INFO:tasks.workunit.client.0.smithi046.stdout:2/862: truncate d1/de/d65/d8f/fad 2114355 0 2024-04-26T12:28:49.980 INFO:tasks.workunit.client.0.smithi046.stdout:4/805: write d0/da/d17/d20/d25/d35/d6d/d19/d53/f106 [610321,35928] 0 2024-04-26T12:28:49.981 INFO:tasks.workunit.client.0.smithi046.stdout:8/991: truncate d7/d1c/d74/df4/d1b/d7d/dc1/dfd/f119 5383285 0 2024-04-26T12:28:49.982 INFO:tasks.workunit.client.0.smithi046.stdout:0/958: dwrite d9/d1d/d5d/d6b/d8a/d8c/fd7 [0,4194304] 0 2024-04-26T12:28:49.982 INFO:tasks.workunit.client.0.smithi046.stdout:5/925: dwrite d9/da/dd/dd7/db0/de0/f51 [0,4194304] 0 2024-04-26T12:28:49.982 INFO:tasks.workunit.client.0.smithi046.stdout:4/806: write d0/da/d17/f46 [700015,99821] 0 2024-04-26T12:28:49.984 INFO:tasks.workunit.client.0.smithi046.stdout:0/959: chown d9/d1d/d5d/d6b/d8a/d8c/f149 3 1 2024-04-26T12:28:49.985 INFO:tasks.workunit.client.0.smithi046.stdout:5/926: symlink d9/da/d40/dfa/l13c 0 2024-04-26T12:28:49.986 INFO:tasks.workunit.client.0.smithi046.stdout:3/910: dwrite d2/d16/d2c/d50/d71/d89/dc5/d23/f26 [0,4194304] 0 2024-04-26T12:28:49.986 INFO:tasks.workunit.client.0.smithi046.stdout:2/863: truncate d1/de/d2b/f50 3110751 0 2024-04-26T12:28:49.986 INFO:tasks.workunit.client.0.smithi046.stdout:4/807: chown d0/da/d17/d20/d25/d35/d6d/d19/lfc 34 1 2024-04-26T12:28:49.986 INFO:tasks.workunit.client.0.smithi046.stdout:8/992: chown d7/d11a/db6/dda/de2/cee 1 1 2024-04-26T12:28:49.986 INFO:tasks.workunit.client.0.smithi046.stdout:3/911: mkdir d2/d13d 0 2024-04-26T12:28:49.988 INFO:tasks.workunit.client.0.smithi046.stdout:0/960: rmdir d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d108/de9 0 2024-04-26T12:28:49.989 INFO:tasks.workunit.client.0.smithi046.stdout:5/927: write d9/da/dd/d5d/fbc [726428,20707] 0 2024-04-26T12:28:49.989 INFO:tasks.workunit.client.0.smithi046.stdout:2/864: rename d1/f35 to d1/de/d67/dc4/f121 0 2024-04-26T12:28:49.989 INFO:tasks.workunit.client.0.smithi046.stdout:1/818: dread d7/db/d98/dc5/d2b/d39/db3/f90 [4194304,4194304] 0 2024-04-26T12:28:49.989 INFO:tasks.workunit.client.0.smithi046.stdout:9/782: write d0/d19/feb [167131,95492] 0 2024-04-26T12:28:49.989 INFO:tasks.workunit.client.0.smithi046.stdout:8/993: mkdir d7/d1c/d74/df4/d1b/d7d/dc1/dfd/d14f 0 2024-04-26T12:28:49.989 INFO:tasks.workunit.client.0.smithi046.stdout:1/819: chown d7/d14/f4f 0 1 2024-04-26T12:28:49.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/928: unlink d9/da/d18/f39 0 2024-04-26T12:28:49.991 INFO:tasks.workunit.client.0.smithi046.stdout:8/994: rename d7/d24/d50/d148 to d7/d1c/d74/df4/d150 0 2024-04-26T12:28:49.992 INFO:tasks.workunit.client.0.smithi046.stdout:9/783: symlink d0/d2c/dda/l113 0 2024-04-26T12:28:49.992 INFO:tasks.workunit.client.0.smithi046.stdout:1/820: mkdir d7/d14/d5d/d32/d41/d8f/d114/d11c 0 2024-04-26T12:28:49.993 INFO:tasks.workunit.client.0.smithi046.stdout:5/929: fdatasync d9/da/dd/d34/d44/f8e 0 2024-04-26T12:28:49.994 INFO:tasks.workunit.client.0.smithi046.stdout:4/808: dwrite d0/d1/d12/f4b [0,4194304] 0 2024-04-26T12:28:49.995 INFO:tasks.workunit.client.0.smithi046.stdout:9/784: write d0/d2c/d47/f46 [1183884,107071] 0 2024-04-26T12:28:49.996 INFO:tasks.workunit.client.0.smithi046.stdout:9/785: stat d0/d2c/fef 0 2024-04-26T12:28:49.997 INFO:tasks.workunit.client.0.smithi046.stdout:3/912: dwrite d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d/fde [0,4194304] 0 2024-04-26T12:28:49.998 INFO:tasks.workunit.client.0.smithi046.stdout:0/961: write d9/d1d/d5d/f100 [1409031,89108] 0 2024-04-26T12:28:50.000 INFO:tasks.workunit.client.0.smithi046.stdout:4/809: creat d0/da/d17/d20/d25/d35/d61/dc6/f10f x:0 0 0 2024-04-26T12:28:50.001 INFO:tasks.workunit.client.0.smithi046.stdout:9/786: stat d0/d2c/dda/d76/d7d/d72/ce3 0 2024-04-26T12:28:50.001 INFO:tasks.workunit.client.0.smithi046.stdout:5/930: rename d9/da/d40/dfa to d9/da/dd/d34/d13d 0 2024-04-26T12:28:50.001 INFO:tasks.workunit.client.0.smithi046.stdout:6/830: dread d7/f79 [0,4194304] 0 2024-04-26T12:28:50.005 INFO:tasks.workunit.client.0.smithi046.stdout:8/995: dwrite d7/d24/d50/d62/fdb [0,4194304] 0 2024-04-26T12:28:50.005 INFO:tasks.workunit.client.0.smithi046.stdout:1/821: dwrite d7/db/d98/dc5/f18 [0,4194304] 0 2024-04-26T12:28:50.006 INFO:tasks.workunit.client.0.smithi046.stdout:0/962: mkdir d9/d1d/d40/d41/d7e/da5/dad/dbd/d151 0 2024-04-26T12:28:50.008 INFO:tasks.workunit.client.0.smithi046.stdout:7/885: dread d16/d35/f3b [0,4194304] 0 2024-04-26T12:28:50.008 INFO:tasks.workunit.client.0.smithi046.stdout:0/963: fdatasync d9/d1d/d40/d41/d7e/fd5 0 2024-04-26T12:28:50.009 INFO:tasks.workunit.client.0.smithi046.stdout:2/865: dwrite d1/de/d67/fd9 [0,4194304] 0 2024-04-26T12:28:50.009 INFO:tasks.workunit.client.0.smithi046.stdout:5/931: creat d9/da/dd/d34/d13d/d11a/f13e x:0 0 0 2024-04-26T12:28:50.011 INFO:tasks.workunit.client.0.smithi046.stdout:7/886: chown d16/d1a/d31/d5a/d6b/fe6 1 1 2024-04-26T12:28:50.012 INFO:tasks.workunit.client.0.smithi046.stdout:7/887: readlink d16/d27/l74 0 2024-04-26T12:28:50.013 INFO:tasks.workunit.client.0.smithi046.stdout:4/810: dwrite d0/da/da1/f5b [4194304,4194304] 0 2024-04-26T12:28:50.014 INFO:tasks.workunit.client.0.smithi046.stdout:5/932: unlink d9/da/dd/d34/d44/d97/da4/d35/dd8/f10f 0 2024-04-26T12:28:50.015 INFO:tasks.workunit.client.0.smithi046.stdout:6/831: dwrite d7/fbf [0,4194304] 0 2024-04-26T12:28:50.015 INFO:tasks.workunit.client.0.smithi046.stdout:7/888: readlink d16/d1a/d3e/d59/la1 0 2024-04-26T12:28:50.015 INFO:tasks.workunit.client.0.smithi046.stdout:4/811: dread - d0/da/d70/dc7/fdd zero size 2024-04-26T12:28:50.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/933: fdatasync d9/da/dd/d34/d44/d97/da4/dde/ff2 0 2024-04-26T12:28:50.016 INFO:tasks.workunit.client.0.smithi046.stdout:1/822: dread d7/d14/d5d/d32/fbd [0,4194304] 0 2024-04-26T12:28:50.016 INFO:tasks.workunit.client.0.smithi046.stdout:2/866: truncate d1/de/d15/d18/d98/ff6 737337 0 2024-04-26T12:28:50.016 INFO:tasks.workunit.client.0.smithi046.stdout:4/812: mknod d0/da/da1/c110 0 2024-04-26T12:28:50.016 INFO:tasks.workunit.client.0.smithi046.stdout:7/889: symlink d16/d1a/d31/d4d/l123 0 2024-04-26T12:28:50.017 INFO:tasks.workunit.client.0.smithi046.stdout:7/890: dread - d16/db1/f11c zero size 2024-04-26T12:28:50.018 INFO:tasks.workunit.client.0.smithi046.stdout:2/867: mkdir d1/de/d65/d8f/d122 0 2024-04-26T12:28:50.018 INFO:tasks.workunit.client.0.smithi046.stdout:4/813: write d0/da/d70/f10d [4509693,126115] 0 2024-04-26T12:28:50.019 INFO:tasks.workunit.client.0.smithi046.stdout:9/787: read d0/d2c/d47/f13 [1126486,75389] 0 2024-04-26T12:28:50.020 INFO:tasks.workunit.client.0.smithi046.stdout:7/891: write d16/d1a/f110 [438705,2461] 0 2024-04-26T12:28:50.020 INFO:tasks.workunit.client.0.smithi046.stdout:5/934: creat d9/da/dd/d34/d44/d88/d90/f13f x:0 0 0 2024-04-26T12:28:50.020 INFO:tasks.workunit.client.0.smithi046.stdout:2/868: write d1/de/d15/d18/d91/f105 [1209118,112822] 0 2024-04-26T12:28:50.021 INFO:tasks.workunit.client.0.smithi046.stdout:4/814: mkdir d0/d41/d111 0 2024-04-26T12:28:50.021 INFO:tasks.workunit.client.0.smithi046.stdout:8/996: creat d7/d1c/d74/df4/d150/f151 x:0 0 0 2024-04-26T12:28:50.022 INFO:tasks.workunit.client.0.smithi046.stdout:9/788: rename d0/d29/d69/cd3 to d0/d29/d69/db5/c114 0 2024-04-26T12:28:50.022 INFO:tasks.workunit.client.0.smithi046.stdout:7/892: truncate d16/db1/f116 293001 0 2024-04-26T12:28:50.023 INFO:tasks.workunit.client.0.smithi046.stdout:5/935: symlink d9/da/dd/d34/d44/d97/l140 0 2024-04-26T12:28:50.023 INFO:tasks.workunit.client.0.smithi046.stdout:9/789: symlink d0/d29/d69/db5/l115 0 2024-04-26T12:28:50.024 INFO:tasks.workunit.client.0.smithi046.stdout:4/815: symlink d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/l112 0 2024-04-26T12:28:50.024 INFO:tasks.workunit.client.0.smithi046.stdout:6/832: read d7/d2b/d31/f35 [441065,52782] 0 2024-04-26T12:28:50.024 INFO:tasks.workunit.client.0.smithi046.stdout:5/936: chown d9/da/dd/d34/fd2 59671 1 2024-04-26T12:28:50.025 INFO:tasks.workunit.client.0.smithi046.stdout:6/833: unlink d7/d2b/l4f 0 2024-04-26T12:28:50.025 INFO:tasks.workunit.client.0.smithi046.stdout:4/816: creat d0/da/da1/f113 x:0 0 0 2024-04-26T12:28:50.025 INFO:tasks.workunit.client.0.smithi046.stdout:8/997: rename d7/d24/d50/d2a/f13d to d7/d1c/d74/df4/d1b/dae/dcf/d10b/f152 0 2024-04-26T12:28:50.026 INFO:tasks.workunit.client.0.smithi046.stdout:5/937: read - d9/da/dd/d34/d44/d97/f12e zero size 2024-04-26T12:28:50.026 INFO:tasks.workunit.client.0.smithi046.stdout:4/817: fdatasync d0/d1/d12/f4b 0 2024-04-26T12:28:50.027 INFO:tasks.workunit.client.0.smithi046.stdout:7/893: rename d16/d1a/d31/cd0 to d16/d3f/d81/c124 0 2024-04-26T12:28:50.028 INFO:tasks.workunit.client.0.smithi046.stdout:8/998: write d7/f4a [1310346,69218] 0 2024-04-26T12:28:50.028 INFO:tasks.workunit.client.0.smithi046.stdout:5/938: chown d9/da/dd/ce1 0 1 2024-04-26T12:28:50.030 INFO:tasks.workunit.client.0.smithi046.stdout:7/894: fsync d16/d1a/d31/f49 0 2024-04-26T12:28:50.030 INFO:tasks.workunit.client.0.smithi046.stdout:1/823: dwrite d7/d14/d5d/d32/d41/d8f/fa7 [0,4194304] 0 2024-04-26T12:28:50.030 INFO:tasks.workunit.client.0.smithi046.stdout:4/818: creat d0/da/d17/d20/d25/d35/d6d/d19/d53/f114 x:0 0 0 2024-04-26T12:28:50.031 INFO:tasks.workunit.client.0.smithi046.stdout:5/939: write d9/da/dd/d34/f6f [864198,85457] 0 2024-04-26T12:28:50.031 INFO:tasks.workunit.client.0.smithi046.stdout:8/999: rmdir d7/d24/d50/d2a/d54 39 2024-04-26T12:28:50.032 INFO:tasks.workunit.client.0.smithi046.stdout:9/790: dwrite d0/d29/d69/fdd [0,4194304] 0 2024-04-26T12:28:50.032 INFO:tasks.workunit.client.0.smithi046.stdout:0/964: dread d9/f9a [0,4194304] 0 2024-04-26T12:28:50.032 INFO:tasks.workunit.client.0.smithi046.stdout:1/824: mkdir d7/d14/d5d/d11d 0 2024-04-26T12:28:50.033 INFO:tasks.workunit.client.0.smithi046.stdout:7/895: rename d16/d4e/d6c/fdd to d16/d35/dac/f125 0 2024-04-26T12:28:50.034 INFO:tasks.workunit.client.0.smithi046.stdout:9/791: mknod d0/d2c/dda/d76/d7d/d72/d85/d97/c116 0 2024-04-26T12:28:50.038 INFO:tasks.workunit.client.0.smithi046.stdout:7/896: getdents d16/d1a/d3e/d59 0 2024-04-26T12:28:50.038 INFO:tasks.workunit.client.0.smithi046.stdout:4/819: read d0/da/d17/d20/d25/d35/fc1 [3793057,75760] 0 2024-04-26T12:28:50.038 INFO:tasks.workunit.client.0.smithi046.stdout:6/834: dread d7/d1b/d47/d65/da3/dbe/fd8 [0,4194304] 0 2024-04-26T12:28:50.039 INFO:tasks.workunit.client.0.smithi046.stdout:7/897: creat d16/d35/f126 x:0 0 0 2024-04-26T12:28:50.039 INFO:tasks.workunit.client.0.smithi046.stdout:6/835: unlink d7/d2b/d31/f80 0 2024-04-26T12:28:50.039 INFO:tasks.workunit.client.0.smithi046.stdout:0/965: dwrite d9/dc/d2a/f4a [0,4194304] 0 2024-04-26T12:28:50.040 INFO:tasks.workunit.client.0.smithi046.stdout:6/836: stat d7/d1b/cbb 0 2024-04-26T12:28:50.040 INFO:tasks.workunit.client.0.smithi046.stdout:4/820: dread d0/da/d17/d20/d25/d35/d6d/d19/d55/dae/fc2 [0,4194304] 0 2024-04-26T12:28:50.040 INFO:tasks.workunit.client.0.smithi046.stdout:7/898: symlink d16/d3f/d81/daa/dd5/l127 0 2024-04-26T12:28:50.041 INFO:tasks.workunit.client.0.smithi046.stdout:6/837: stat d7/d2b/d31/d4d/c5b 0 2024-04-26T12:28:50.041 INFO:tasks.workunit.client.0.smithi046.stdout:5/940: dwrite d9/da/dd/dd7/d7e/fab [0,4194304] 0 2024-04-26T12:28:50.042 INFO:tasks.workunit.client.0.smithi046.stdout:7/899: creat d16/d35/dac/f128 x:0 0 0 2024-04-26T12:28:50.042 INFO:tasks.workunit.client.0.smithi046.stdout:6/838: fsync d7/d1b/d37/daa/de7/f105 0 2024-04-26T12:28:50.042 INFO:tasks.workunit.client.0.smithi046.stdout:7/900: unlink d16/d1a/d69/lb4 0 2024-04-26T12:28:50.043 INFO:tasks.workunit.client.0.smithi046.stdout:5/941: symlink d9/da/dd/d34/d44/d97/da4/d35/dd8/dff/l141 0 2024-04-26T12:28:50.043 INFO:tasks.workunit.client.0.smithi046.stdout:4/821: rename d0/d64/faa to d0/da/da1/f115 0 2024-04-26T12:28:50.045 INFO:tasks.workunit.client.0.smithi046.stdout:5/942: creat d9/da/dd/dd7/d7e/f142 x:0 0 0 2024-04-26T12:28:50.046 INFO:tasks.workunit.client.0.smithi046.stdout:6/839: rename d7/d1b/cb2 to d7/d1b/d37/daa/c10b 0 2024-04-26T12:28:50.046 INFO:tasks.workunit.client.0.smithi046.stdout:5/943: fsync d9/da/dd/dd7/f6c 0 2024-04-26T12:28:50.047 INFO:tasks.workunit.client.0.smithi046.stdout:7/901: rename d16/d1a/d31/d55/d6d/d89/c9a to d16/d1a/d31/d5a/d6b/df2/ddb/c129 0 2024-04-26T12:28:50.047 INFO:tasks.workunit.client.0.smithi046.stdout:6/840: symlink d7/da7/daf/l10c 0 2024-04-26T12:28:50.047 INFO:tasks.workunit.client.0.smithi046.stdout:5/944: chown d9/da/dd/f13 25412862 1 2024-04-26T12:28:50.047 INFO:tasks.workunit.client.0.smithi046.stdout:6/841: symlink d7/da7/dd1/l10d 0 2024-04-26T12:28:50.047 INFO:tasks.workunit.client.0.smithi046.stdout:5/945: write d9/da/d15/fb9 [3011089,42136] 0 2024-04-26T12:28:50.048 INFO:tasks.workunit.client.0.smithi046.stdout:6/842: fdatasync d7/d1b/d37/f7d 0 2024-04-26T12:28:50.049 INFO:tasks.workunit.client.0.smithi046.stdout:5/946: symlink d9/da/dd/d5d/l143 0 2024-04-26T12:28:50.049 INFO:tasks.workunit.client.0.smithi046.stdout:2/869: dread d1/de/d65/d1b/f61 [0,4194304] 0 2024-04-26T12:28:50.049 INFO:tasks.workunit.client.0.smithi046.stdout:7/902: read d16/d3f/d81/fc1 [1472759,33076] 0 2024-04-26T12:28:50.049 INFO:tasks.workunit.client.0.smithi046.stdout:6/843: creat d7/d2b/d31/d4d/f10e x:0 0 0 2024-04-26T12:28:50.050 INFO:tasks.workunit.client.0.smithi046.stdout:6/844: rmdir d7/da7/dd1/dd6 39 2024-04-26T12:28:50.051 INFO:tasks.workunit.client.0.smithi046.stdout:6/845: stat d7 0 2024-04-26T12:28:50.051 INFO:tasks.workunit.client.0.smithi046.stdout:7/903: mkdir d16/d1a/d31/d5a/d93/dd9/d12a 0 2024-04-26T12:28:50.051 INFO:tasks.workunit.client.0.smithi046.stdout:5/947: write d9/da/dd/d34/d44/d97/da4/dde/fef [2041156,35938] 0 2024-04-26T12:28:50.052 INFO:tasks.workunit.client.0.smithi046.stdout:6/846: fsync d7/d16/dbc/dda/fe3 0 2024-04-26T12:28:50.053 INFO:tasks.workunit.client.0.smithi046.stdout:7/904: write d16/d1a/d31/d5a/f50 [2986102,18502] 0 2024-04-26T12:28:50.053 INFO:tasks.workunit.client.0.smithi046.stdout:7/905: readlink d16/d35/dac/dbb/l111 0 2024-04-26T12:28:50.054 INFO:tasks.workunit.client.0.smithi046.stdout:3/913: dread d2/d16/d2c/d50/d71/d89/dc5/d1b/fab [0,4194304] 0 2024-04-26T12:28:50.054 INFO:tasks.workunit.client.0.smithi046.stdout:5/948: rename d9/da/dd/d34/f8a to d9/da/d18/dd4/d135/f144 0 2024-04-26T12:28:50.054 INFO:tasks.workunit.client.0.smithi046.stdout:7/906: creat d16/d100/f12b x:0 0 0 2024-04-26T12:28:50.055 INFO:tasks.workunit.client.0.smithi046.stdout:6/847: dread d7/f79 [0,4194304] 0 2024-04-26T12:28:50.055 INFO:tasks.workunit.client.0.smithi046.stdout:7/907: creat d16/d3f/d81/daa/f12c x:0 0 0 2024-04-26T12:28:50.056 INFO:tasks.workunit.client.0.smithi046.stdout:6/848: write d7/d2b/f8a [907704,55279] 0 2024-04-26T12:28:50.056 INFO:tasks.workunit.client.0.smithi046.stdout:9/792: dread d0/d29/d69/f77 [0,4194304] 0 2024-04-26T12:28:50.057 INFO:tasks.workunit.client.0.smithi046.stdout:5/949: truncate d9/da/dd/d34/d44/d97/da4/dde/ff2 3498571 0 2024-04-26T12:28:50.057 INFO:tasks.workunit.client.0.smithi046.stdout:6/849: fsync d7/d1b/d47/d65/f82 0 2024-04-26T12:28:50.058 INFO:tasks.workunit.client.0.smithi046.stdout:7/908: rename d16/d35/dac/dbb/fd8 to d16/d1a/d31/d5a/d6b/df2/f12d 0 2024-04-26T12:28:50.059 INFO:tasks.workunit.client.0.smithi046.stdout:5/950: write d9/da/dd/d5d/f6e [3935848,1903] 0 2024-04-26T12:28:50.059 INFO:tasks.workunit.client.0.smithi046.stdout:7/909: creat d16/d1a/d3e/f12e x:0 0 0 2024-04-26T12:28:50.059 INFO:tasks.workunit.client.0.smithi046.stdout:2/870: dread d1/de/d65/d4a/d58/f9d [0,4194304] 0 2024-04-26T12:28:50.060 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:50.058+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:50.060 INFO:tasks.workunit.client.0.smithi046.stdout:7/910: mknod d16/d4e/d6c/d121/c12f 0 2024-04-26T12:28:50.061 INFO:tasks.workunit.client.0.smithi046.stdout:6/850: read d7/fa [671863,11814] 0 2024-04-26T12:28:50.061 INFO:tasks.workunit.client.0.smithi046.stdout:2/871: unlink d1/de/d15/d18/dc1/c117 0 2024-04-26T12:28:50.062 INFO:tasks.workunit.client.0.smithi046.stdout:7/911: mknod d16/d35/dac/dbb/c130 0 2024-04-26T12:28:50.062 INFO:tasks.workunit.client.0.smithi046.stdout:5/951: getdents d9/da/dd/d34/d44/d97/da4/d35/dd8 0 2024-04-26T12:28:50.062 INFO:tasks.workunit.client.0.smithi046.stdout:9/793: dread d0/d19/d21/f3e [0,4194304] 0 2024-04-26T12:28:50.062 INFO:tasks.workunit.client.0.smithi046.stdout:6/851: mknod d7/d1b/d37/c10f 0 2024-04-26T12:28:50.062 INFO:tasks.workunit.client.0.smithi046.stdout:7/912: creat d16/d104/f131 x:0 0 0 2024-04-26T12:28:50.063 INFO:tasks.workunit.client.0.smithi046.stdout:2/872: write d1/de/d65/d4a/d58/f5c [4906502,80830] 0 2024-04-26T12:28:50.063 INFO:tasks.workunit.client.0.smithi046.stdout:5/952: creat d9/da/dd/dd7/db0/de0/d119/f145 x:0 0 0 2024-04-26T12:28:50.064 INFO:tasks.workunit.client.0.smithi046.stdout:6/852: chown d7/d1b/f4b 871 1 2024-04-26T12:28:50.064 INFO:tasks.workunit.client.0.smithi046.stdout:9/794: fdatasync d0/d2c/dbe/dd2/dff/f10c 0 2024-04-26T12:28:50.064 INFO:tasks.workunit.client.0.smithi046.stdout:7/913: chown d16/d1a/d69/f95 3 1 2024-04-26T12:28:50.064 INFO:tasks.workunit.client.0.smithi046.stdout:6/853: creat d7/d2b/d31/d4d/f110 x:0 0 0 2024-04-26T12:28:50.064 INFO:tasks.workunit.client.0.smithi046.stdout:5/953: symlink d9/da/dd/d34/l146 0 2024-04-26T12:28:50.065 INFO:tasks.workunit.client.0.smithi046.stdout:7/914: truncate d16/d1a/d69/f95 4435170 0 2024-04-26T12:28:50.065 INFO:tasks.workunit.client.0.smithi046.stdout:6/854: creat d7/d1b/dee/f111 x:0 0 0 2024-04-26T12:28:50.066 INFO:tasks.workunit.client.0.smithi046.stdout:6/855: rmdir d7/d1b/d6a 39 2024-04-26T12:28:50.067 INFO:tasks.workunit.client.0.smithi046.stdout:7/915: creat d16/d3f/d81/daa/f132 x:0 0 0 2024-04-26T12:28:50.067 INFO:tasks.workunit.client.0.smithi046.stdout:1/825: dread d7/db/d98/dc5/f11 [0,4194304] 0 2024-04-26T12:28:50.068 INFO:tasks.workunit.client.0.smithi046.stdout:5/954: rename d9/da/dd/d34/d44/d97/da4/d35/c3d to d9/da/dd/dd7/db0/de0/d119/c147 0 2024-04-26T12:28:50.068 INFO:tasks.workunit.client.0.smithi046.stdout:7/916: symlink d16/d1a/d69/l133 0 2024-04-26T12:28:50.069 INFO:tasks.workunit.client.0.smithi046.stdout:6/856: rename d7/d1b/d6a/f5a to d7/d1b/d47/d65/da3/de5/f112 0 2024-04-26T12:28:50.069 INFO:tasks.workunit.client.0.smithi046.stdout:2/873: dwrite d1/de/d2b/f3a [0,4194304] 0 2024-04-26T12:28:50.070 INFO:tasks.workunit.client.0.smithi046.stdout:5/955: creat d9/da/dd/d34/d44/d97/f148 x:0 0 0 2024-04-26T12:28:50.071 INFO:tasks.workunit.client.0.smithi046.stdout:5/956: fdatasync d9/da/dd/dd7/f70 0 2024-04-26T12:28:50.076 INFO:tasks.workunit.client.0.smithi046.stdout:4/822: dread d0/da/d17/d20/d25/d35/f65 [0,4194304] 0 2024-04-26T12:28:50.077 INFO:tasks.workunit.client.0.smithi046.stdout:1/826: dwrite d7/d14/d5d/d32/f75 [0,4194304] 0 2024-04-26T12:28:50.077 INFO:tasks.workunit.client.0.smithi046.stdout:2/874: dwrite d1/f2 [0,4194304] 0 2024-04-26T12:28:50.078 INFO:tasks.workunit.client.0.smithi046.stdout:4/823: dread - d0/da/da1/f113 zero size 2024-04-26T12:28:50.078 INFO:tasks.workunit.client.0.smithi046.stdout:6/857: dwrite d7/d1b/d47/d65/d77/d92/fdd [0,4194304] 0 2024-04-26T12:28:50.078 INFO:tasks.workunit.client.0.smithi046.stdout:2/875: fdatasync d1/de/d67/dc4/ff9 0 2024-04-26T12:28:50.080 INFO:tasks.workunit.client.0.smithi046.stdout:4/824: creat d0/d1/d5/f116 x:0 0 0 2024-04-26T12:28:50.080 INFO:tasks.workunit.client.0.smithi046.stdout:2/876: creat d1/de/d15/d18/dc1/db6/dda/d78/f123 x:0 0 0 2024-04-26T12:28:50.081 INFO:tasks.workunit.client.0.smithi046.stdout:1/827: link d7/d14/d5d/d6b/dc2/d76/f7c d7/db/d98/dc5/d2b/d39/d5c/f11e 0 2024-04-26T12:28:50.082 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:50.082 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:50.082 INFO:tasks.workunit.client.0.smithi046.stdout:2/877: chown d1/de/d15/d18/dc1/de3 6510126 1 2024-04-26T12:28:50.082 INFO:tasks.workunit.client.0.smithi046.stdout:3/914: dread d2/d16/d2c/d50/f90 [0,4194304] 0 2024-04-26T12:28:50.084 INFO:tasks.workunit.client.0.smithi046.stdout:5/957: dwrite d9/da/dd/d34/d44/d97/da4/dde/ff2 [0,4194304] 0 2024-04-26T12:28:50.084 INFO:tasks.workunit.client.0.smithi046.stdout:4/825: mknod d0/da/d70/dc7/c117 0 2024-04-26T12:28:50.084 INFO:tasks.workunit.client.0.smithi046.stdout:2/878: stat d1/de/d15/d18/d8a/c101 0 2024-04-26T12:28:50.085 INFO:tasks.workunit.client.0.smithi046.stdout:5/958: chown d9/da/d18/d8b 95 1 2024-04-26T12:28:50.085 INFO:tasks.workunit.client.0.smithi046.stdout:4/826: chown d0/da/d17/d20/lb0 1622001 1 2024-04-26T12:28:50.086 INFO:tasks.workunit.client.0.smithi046.stdout:4/827: chown d0/d1/d12 31 1 2024-04-26T12:28:50.086 INFO:tasks.workunit.client.0.smithi046.stdout:5/959: fsync d9/da/dd/d34/d44/d97/da4/f124 0 2024-04-26T12:28:50.086 INFO:tasks.workunit.client.0.smithi046.stdout:5/960: fdatasync d9/da/dd/f82 0 2024-04-26T12:28:50.087 INFO:tasks.workunit.client.0.smithi046.stdout:4/828: creat d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/f118 x:0 0 0 2024-04-26T12:28:50.087 INFO:tasks.workunit.client.0.smithi046.stdout:5/961: mknod d9/c149 0 2024-04-26T12:28:50.087 INFO:tasks.workunit.client.0.smithi046.stdout:4/829: readlink d0/d41/df5/l108 0 2024-04-26T12:28:50.087 INFO:tasks.workunit.client.0.smithi046.stdout:5/962: write d9/da/dd/dd7/fae [1320417,16049] 0 2024-04-26T12:28:50.089 INFO:tasks.workunit.client.0.smithi046.stdout:1/828: dread d7/db/d98/dc5/f58 [0,4194304] 0 2024-04-26T12:28:50.090 INFO:tasks.workunit.client.0.smithi046.stdout:2/879: dwrite d1/d42/d113/fdc [0,4194304] 0 2024-04-26T12:28:50.090 INFO:tasks.workunit.client.0.smithi046.stdout:1/829: creat d7/db/d98/dc5/d2b/d39/f11f x:0 0 0 2024-04-26T12:28:50.091 INFO:tasks.workunit.client.0.smithi046.stdout:1/830: creat d7/d14/d5d/d32/d41/d8f/d114/d11c/f120 x:0 0 0 2024-04-26T12:28:50.094 INFO:tasks.workunit.client.0.smithi046.stdout:6/858: write d7/d1b/d47/f7b [501432,18818] 0 2024-04-26T12:28:50.095 INFO:tasks.workunit.client.0.smithi046.stdout:3/915: truncate d2/d16/d2c/d50/d71/d89/d98/dbb/fc6 2950928 0 2024-04-26T12:28:50.096 INFO:tasks.workunit.client.0.smithi046.stdout:1/831: dwrite d7/db/d98/dc5/d2b/d39/db3/ff5 [0,4194304] 0 2024-04-26T12:28:50.097 INFO:tasks.workunit.client.0.smithi046.stdout:3/916: getdents d2/d16/d2c/d50/d71/d89/dc5/d1b 0 2024-04-26T12:28:50.097 INFO:tasks.workunit.client.0.smithi046.stdout:1/832: stat d7/db/d98/dc5/d2b/d39/db3/d79/c107 0 2024-04-26T12:28:50.097 INFO:tasks.workunit.client.0.smithi046.stdout:6/859: getdents d7/d1b/d47/d65/da3/dbe 0 2024-04-26T12:28:50.098 INFO:tasks.workunit.client.0.smithi046.stdout:3/917: symlink d2/db0/dc4/d127/l13e 0 2024-04-26T12:28:50.098 INFO:tasks.workunit.client.0.smithi046.stdout:6/860: fsync d7/d1b/d37/daa/de7/fff 0 2024-04-26T12:28:50.098 INFO:tasks.workunit.client.0.smithi046.stdout:1/833: write d7/db/d98/dc5/d2b/fe0 [357817,127580] 0 2024-04-26T12:28:50.099 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:50.100 INFO:tasks.workunit.client.0.smithi046.stdout:6/861: symlink d7/d1b/d37/daa/de7/l113 0 2024-04-26T12:28:50.100 INFO:tasks.workunit.client.0.smithi046.stdout:6/862: readlink d7/lf 0 2024-04-26T12:28:50.100 INFO:tasks.workunit.client.0.smithi046.stdout:6/863: mkdir d7/d1b/d37/daa/d114 0 2024-04-26T12:28:50.100 INFO:tasks.workunit.client.0.smithi046.stdout:6/864: unlink d7/d1b/d37/daa/de7/l113 0 2024-04-26T12:28:50.102 INFO:tasks.workunit.client.0.smithi046.stdout:7/917: dread d16/d1a/d3e/d4f/f71 [0,4194304] 0 2024-04-26T12:28:50.104 INFO:tasks.workunit.client.0.smithi046.stdout:1/834: dwrite d7/d14/d5d/d6b/dc2/d76/fc9 [0,4194304] 0 2024-04-26T12:28:50.105 INFO:tasks.workunit.client.0.smithi046.stdout:1/835: creat d7/d14/d5d/d6b/f121 x:0 0 0 2024-04-26T12:28:50.105 INFO:tasks.workunit.client.0.smithi046.stdout:1/836: fsync d7/db/f64 0 2024-04-26T12:28:50.106 INFO:tasks.workunit.client.0.smithi046.stdout:1/837: chown d7/d14/fc7 497 1 2024-04-26T12:28:50.108 INFO:tasks.workunit.client.0.smithi046.stdout:6/865: truncate d7/d1b/d47/d65/da3/dbe/fc0 402697 0 2024-04-26T12:28:50.108 INFO:tasks.workunit.client.0.smithi046.stdout:1/838: write d7/d14/d5d/d6b/f113 [391480,60654] 0 2024-04-26T12:28:50.109 INFO:tasks.workunit.client.0.smithi046.stdout:1/839: creat d7/d14/d5d/d6b/d105/f122 x:0 0 0 2024-04-26T12:28:50.109 INFO:tasks.workunit.client.0.smithi046.stdout:0/966: sync 2024-04-26T12:28:50.110 INFO:tasks.workunit.client.0.smithi046.stdout:1/840: readlink d7/d14/d5d/d32/d5f/ld4 0 2024-04-26T12:28:50.114 INFO:tasks.workunit.client.0.smithi046.stdout:1/841: dwrite d7/db/d98/dc5/d2b/d96/fb4 [0,4194304] 0 2024-04-26T12:28:50.115 INFO:tasks.workunit.client.0.smithi046.stdout:1/842: chown d7/d14/d5d/d32/d41/d8f/c10f 91384 1 2024-04-26T12:28:50.119 INFO:tasks.workunit.client.0.smithi046.stdout:1/843: write d7/d14/d5d/d32/fbb [629608,66299] 0 2024-04-26T12:28:50.119 INFO:tasks.workunit.client.0.smithi046.stdout:1/844: fdatasync d7/db/f10 0 2024-04-26T12:28:50.119 INFO:tasks.workunit.client.0.smithi046.stdout:1/845: chown d7/d14/d5d/d6b/dc2/d76 27 1 2024-04-26T12:28:50.119 INFO:tasks.workunit.client.0.smithi046.stdout:1/846: chown d7/db/d98/dc5/d2b/d9f/l6e 1 1 2024-04-26T12:28:50.121 INFO:tasks.workunit.client.0.smithi046.stdout:0/967: dread d9/dc/dd/f13 [0,4194304] 0 2024-04-26T12:28:50.121 INFO:tasks.workunit.client.0.smithi046.stdout:1/847: read d7/db/d98/dc5/d2b/d96/fa6 [110778,127723] 0 2024-04-26T12:28:50.122 INFO:tasks.workunit.client.0.smithi046.stdout:1/848: write d7/db/d98/dc5/d2b/d39/ffa [1348684,121573] 0 2024-04-26T12:28:50.123 INFO:tasks.workunit.client.0.smithi046.stdout:1/849: mkdir d7/d14/d5d/d32/d41/d8f/d114/d123 0 2024-04-26T12:28:50.124 INFO:tasks.workunit.client.0.smithi046.stdout:1/850: chown d7/d14/d5d/d32/d41/d8f/dd3/de5/lf8 52 1 2024-04-26T12:28:50.126 INFO:tasks.workunit.client.0.smithi046.stdout:2/880: dread d1/de/d15/d18/dc1/db6/dda/d78/fa5 [0,4194304] 0 2024-04-26T12:28:50.127 INFO:tasks.workunit.client.0.smithi046.stdout:2/881: symlink d1/d42/d113/dfd/d11e/l124 0 2024-04-26T12:28:50.127 INFO:tasks.workunit.client.0.smithi046.stdout:2/882: chown d1/de/d65/d4a/d58/d72/ca7 253 1 2024-04-26T12:28:50.128 INFO:tasks.workunit.client.0.smithi046.stdout:2/883: link d1/d42/lff d1/de/d2b/d119/l125 0 2024-04-26T12:28:50.129 INFO:tasks.workunit.client.0.smithi046.stdout:2/884: creat d1/de/da4/f126 x:0 0 0 2024-04-26T12:28:50.130 INFO:tasks.workunit.client.0.smithi046.stdout:2/885: readlink d1/de/d15/d18/d8a/lbc 0 2024-04-26T12:28:50.130 INFO:tasks.workunit.client.0.smithi046.stdout:0/968: truncate d9/dc/dd/d45/f4e 2446651 0 2024-04-26T12:28:50.131 INFO:tasks.workunit.client.0.smithi046.stdout:1/851: rmdir d7/d14/d5d/d32/d41 39 2024-04-26T12:28:50.133 INFO:tasks.workunit.client.0.smithi046.stdout:2/886: mknod d1/de/d15/d18/d98/c127 0 2024-04-26T12:28:50.133 INFO:tasks.workunit.client.0.smithi046.stdout:1/852: creat d7/d14/d5d/d6b/f124 x:0 0 0 2024-04-26T12:28:50.133 INFO:tasks.workunit.client.0.smithi046.stdout:0/969: write d9/d1d/d40/f6e [2534479,37811] 0 2024-04-26T12:28:50.133 INFO:tasks.workunit.client.0.smithi046.stdout:0/970: stat d9/dc/d2a 0 2024-04-26T12:28:50.133 INFO:tasks.workunit.client.0.smithi046.stdout:2/887: creat d1/de/d15/d18/dc1/f128 x:0 0 0 2024-04-26T12:28:50.133 INFO:tasks.workunit.client.0.smithi046.stdout:1/853: mknod d7/db/dee/dfc/c125 0 2024-04-26T12:28:50.133 INFO:tasks.workunit.client.0.smithi046.stdout:2/888: dread - d1/de/d15/d18/dc1/db6/dda/d78/f11d zero size 2024-04-26T12:28:50.133 INFO:tasks.workunit.client.0.smithi046.stdout:5/963: dread f2 [0,4194304] 0 2024-04-26T12:28:50.134 INFO:tasks.workunit.client.0.smithi046.stdout:2/889: symlink d1/de/d15/d18/dc1/d11c/l129 0 2024-04-26T12:28:50.135 INFO:tasks.workunit.client.0.smithi046.stdout:2/890: mkdir d1/de/d15/d18/d12a 0 2024-04-26T12:28:50.136 INFO:tasks.workunit.client.0.smithi046.stdout:5/964: rename d9/da/dd/dd7/db0/de0/fed to d9/da/dd/dd7/db0/de0/d119/f14a 0 2024-04-26T12:28:50.136 INFO:tasks.workunit.client.0.smithi046.stdout:5/965: chown d9/da/dd/dd7/db0/db6/d121 699 1 2024-04-26T12:28:50.137 INFO:tasks.workunit.client.0.smithi046.stdout:1/854: dwrite d7/d14/d5d/d32/d41/d8f/dd3/fe7 [0,4194304] 0 2024-04-26T12:28:50.137 INFO:tasks.workunit.client.0.smithi046.stdout:5/966: write d9/da/f10 [5261983,54125] 0 2024-04-26T12:28:50.138 INFO:tasks.workunit.client.0.smithi046.stdout:5/967: unlink d9/da/dd/d34/d45/d8f/cbb 0 2024-04-26T12:28:50.141 INFO:tasks.workunit.client.0.smithi046.stdout:5/968: mknod d9/da/dd/d34/d44/d97/da4/de2/c14b 0 2024-04-26T12:28:50.141 INFO:tasks.workunit.client.0.smithi046.stdout:1/855: truncate d7/db/d98/dc5/f1a 565039 0 2024-04-26T12:28:50.142 INFO:tasks.workunit.client.0.smithi046.stdout:2/891: dwrite d1/de/d65/d4a/d86/d96/faf [0,4194304] 0 2024-04-26T12:28:50.142 INFO:tasks.workunit.client.0.smithi046.stdout:5/969: rmdir d9/da/d40 39 2024-04-26T12:28:50.142 INFO:tasks.workunit.client.0.smithi046.stdout:1/856: rmdir d7/db/d98/dc5/d2b/d39/db3 39 2024-04-26T12:28:50.146 INFO:tasks.workunit.client.0.smithi046.stdout:5/970: dwrite d9/da/d18/d7d/fb2 [0,4194304] 0 2024-04-26T12:28:50.148 INFO:tasks.workunit.client.0.smithi046.stdout:2/892: dwrite d1/de/f104 [0,4194304] 0 2024-04-26T12:28:50.148 INFO:tasks.workunit.client.0.smithi046.stdout:2/893: chown d1/de/d65/d1b/ff3 0 1 2024-04-26T12:28:50.149 INFO:tasks.workunit.client.0.smithi046.stdout:2/894: dread - d1/de/d67/f114 zero size 2024-04-26T12:28:50.150 INFO:tasks.workunit.client.0.smithi046.stdout:2/895: chown d1/de/d65/l6e 487793064 1 2024-04-26T12:28:50.155 INFO:tasks.workunit.client.0.smithi046.stdout:2/896: dwrite d1/de/d15/d18/dc1/db6/dda/d78/fcc [0,4194304] 0 2024-04-26T12:28:50.157 INFO:tasks.workunit.client.0.smithi046.stdout:2/897: creat d1/de/d15/d18/dc1/d11c/f12b x:0 0 0 2024-04-26T12:28:50.167 INFO:tasks.workunit.client.0.smithi046.stdout:2/898: truncate d1/de/d15/d18/d98/fd8 170588 0 2024-04-26T12:28:50.167 INFO:tasks.workunit.client.0.smithi046.stdout:5/971: dread d9/da/f20 [0,4194304] 0 2024-04-26T12:28:50.168 INFO:tasks.workunit.client.0.smithi046.stdout:2/899: chown d1/de/d15/d18/dc1/db6/dda/f7e 2 1 2024-04-26T12:28:50.168 INFO:tasks.workunit.client.0.smithi046.stdout:2/900: fsync d1/de/d65/d4a/f80 0 2024-04-26T12:28:50.168 INFO:tasks.workunit.client.0.smithi046.stdout:5/972: chown d9/da/dd/d34/d44/d97/da4/f92 15 1 2024-04-26T12:28:50.168 INFO:tasks.workunit.client.0.smithi046.stdout:5/973: dread - d9/da/dd/dd7/db0/db6/d121/f13b zero size 2024-04-26T12:28:50.168 INFO:tasks.workunit.client.0.smithi046.stdout:5/974: symlink d9/da/d18/dd4/d134/l14c 0 2024-04-26T12:28:50.168 INFO:tasks.workunit.client.0.smithi046.stdout:2/901: rename d1/de/d65/d4a/f7d to d1/de/f12c 0 2024-04-26T12:28:50.168 INFO:tasks.workunit.client.0.smithi046.stdout:2/902: creat d1/de/d67/dc4/f12d x:0 0 0 2024-04-26T12:28:50.169 INFO:tasks.workunit.client.0.smithi046.stdout:5/975: creat d9/da/dd/d5d/f14d x:0 0 0 2024-04-26T12:28:50.169 INFO:tasks.workunit.client.0.smithi046.stdout:2/903: mkdir d1/de/d15/d18/d12a/d12e 0 2024-04-26T12:28:50.169 INFO:tasks.workunit.client.0.smithi046.stdout:5/976: stat d9/da/dd/d34/d44/d88/d90/f13f 0 2024-04-26T12:28:50.169 INFO:tasks.workunit.client.0.smithi046.stdout:1/857: dread d7/d12/d89/f8b [0,4194304] 0 2024-04-26T12:28:50.169 INFO:tasks.workunit.client.0.smithi046.stdout:2/904: readlink d1/de/dc8/l102 0 2024-04-26T12:28:50.169 INFO:tasks.workunit.client.0.smithi046.stdout:5/977: chown d9/da/d18/d8b/l106 0 1 2024-04-26T12:28:50.169 INFO:tasks.workunit.client.0.smithi046.stdout:2/905: chown d1/de/d65/d1b/l8d 142 1 2024-04-26T12:28:50.169 INFO:tasks.workunit.client.0.smithi046.stdout:5/978: chown d9/da/dd/la2 6 1 2024-04-26T12:28:50.169 INFO:tasks.workunit.client.0.smithi046.stdout:5/979: fsync d9/da/dd/d34/d44/d97/f108 0 2024-04-26T12:28:50.170 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:50.159+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:50.171 INFO:tasks.workunit.client.0.smithi046.stdout:5/980: chown d9/da/dd/d34/d44/d97/da4/d35/dd8/dff/l141 361567272 1 2024-04-26T12:28:50.171 INFO:tasks.workunit.client.0.smithi046.stdout:5/981: creat d9/da/dd/f14e x:0 0 0 2024-04-26T12:28:50.171 INFO:tasks.workunit.client.0.smithi046.stdout:1/858: dwrite d7/db/dee/f104 [0,4194304] 0 2024-04-26T12:28:50.171 INFO:tasks.workunit.client.0.smithi046.stdout:5/982: unlink d9/da/dd/d34/d13d/l13c 0 2024-04-26T12:28:50.172 INFO:tasks.workunit.client.0.smithi046.stdout:1/859: truncate d7/db/d98/dc5/d2b/d31/d82/d95/f119 899841 0 2024-04-26T12:28:50.172 INFO:tasks.workunit.client.0.smithi046.stdout:1/860: chown d7/d14/d5d/d32/l37 738 1 2024-04-26T12:28:50.173 INFO:tasks.workunit.client.0.smithi046.stdout:2/906: dwrite d1/de/d65/d4a/d58/f73 [0,4194304] 0 2024-04-26T12:28:50.174 INFO:tasks.workunit.client.0.smithi046.stdout:1/861: rename d7/d14/d5d/d32/d41/d8f/dd3/fe7 to d7/db/dee/f126 0 2024-04-26T12:28:50.180 INFO:tasks.workunit.client.0.smithi046.stdout:4/830: sync 2024-04-26T12:28:50.180 INFO:tasks.workunit.client.0.smithi046.stdout:9/795: sync 2024-04-26T12:28:50.181 INFO:tasks.workunit.client.0.smithi046.stdout:9/796: creat d0/d2c/dda/d76/d7d/d72/d85/d97/f117 x:0 0 0 2024-04-26T12:28:50.182 INFO:tasks.workunit.client.0.smithi046.stdout:9/797: mknod d0/d2c/d3d/c118 0 2024-04-26T12:28:50.185 INFO:tasks.workunit.client.0.smithi046.stdout:4/831: write d0/da/d17/d20/d25/d35/d61/fea [336134,44187] 0 2024-04-26T12:28:50.185 INFO:tasks.workunit.client.0.smithi046.stdout:2/907: write d1/de/d15/d18/d98/fd8 [594787,44899] 0 2024-04-26T12:28:50.185 INFO:tasks.workunit.client.0.smithi046.stdout:1/862: dread d7/db/d98/dc5/d2b/d31/fce [0,4194304] 0 2024-04-26T12:28:50.187 INFO:tasks.workunit.client.0.smithi046.stdout:9/798: dwrite d0/d19/d21/f4a [4194304,4194304] 0 2024-04-26T12:28:50.187 INFO:tasks.workunit.client.0.smithi046.stdout:1/863: write d7/d14/fc7 [839724,71739] 0 2024-04-26T12:28:50.188 INFO:tasks.workunit.client.0.smithi046.stdout:4/832: getdents d0/da/d17/d20/d25/d35/d6d/d19/d55 0 2024-04-26T12:28:50.188 INFO:tasks.workunit.client.0.smithi046.stdout:9/799: getdents d0/d2c/dbd 0 2024-04-26T12:28:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:5/983: dread d9/da/dd/d34/fcb [0,4194304] 0 2024-04-26T12:28:50.189 INFO:tasks.workunit.client.0.smithi046.stdout:2/908: truncate d1/de/d15/d18/d98/fd8 550000 0 2024-04-26T12:28:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:1/864: dread d7/db/f8d [0,4194304] 0 2024-04-26T12:28:50.190 INFO:tasks.workunit.client.0.smithi046.stdout:1/865: chown d7/d14/d5d/d6b 0 1 2024-04-26T12:28:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:5/984: truncate d9/da/dd/d34/fce 53038 0 2024-04-26T12:28:50.191 INFO:tasks.workunit.client.0.smithi046.stdout:2/909: write d1/de/f11 [1485154,12965] 0 2024-04-26T12:28:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:1/866: mkdir d7/d14/d5d/d32/d41/d8f/dd3/de5/d127 0 2024-04-26T12:28:50.192 INFO:tasks.workunit.client.0.smithi046.stdout:9/800: dread d0/d19/f103 [0,4194304] 0 2024-04-26T12:28:50.193 INFO:tasks.workunit.client.0.smithi046.stdout:2/910: creat d1/de/dc8/f12f x:0 0 0 2024-04-26T12:28:50.193 INFO:tasks.workunit.client.0.smithi046.stdout:9/801: creat d0/d29/daf/f119 x:0 0 0 2024-04-26T12:28:50.194 INFO:tasks.workunit.client.0.smithi046.stdout:1/867: rename d7/db/d98/cdc to d7/d14/d5d/d32/d41/ded/c128 0 2024-04-26T12:28:50.194 INFO:tasks.workunit.client.0.smithi046.stdout:4/833: dwrite d0/da/d17/d20/d25/d35/d61/dc6/f10f [0,4194304] 0 2024-04-26T12:28:50.196 INFO:tasks.workunit.client.0.smithi046.stdout:2/911: creat d1/de/dc8/ddd/f130 x:0 0 0 2024-04-26T12:28:50.196 INFO:tasks.workunit.client.0.smithi046.stdout:9/802: creat d0/d2c/dbe/dd2/f11a x:0 0 0 2024-04-26T12:28:50.196 INFO:tasks.workunit.client.0.smithi046.stdout:4/834: stat d0/da/da1/f6e 0 2024-04-26T12:28:50.196 INFO:tasks.workunit.client.0.smithi046.stdout:9/803: readlink d0/d2c/d47/ld 0 2024-04-26T12:28:50.196 INFO:tasks.workunit.client.0.smithi046.stdout:1/868: fsync d7/db/d98/dc5/d2b/d39/db3/ff5 0 2024-04-26T12:28:50.197 INFO:tasks.workunit.client.0.smithi046.stdout:2/912: creat d1/de/dc8/d116/f131 x:0 0 0 2024-04-26T12:28:50.197 INFO:tasks.workunit.client.0.smithi046.stdout:4/835: fsync d0/fa2 0 2024-04-26T12:28:50.197 INFO:tasks.workunit.client.0.smithi046.stdout:2/913: creat d1/de/d15/d18/d12a/d12e/f132 x:0 0 0 2024-04-26T12:28:50.198 INFO:tasks.workunit.client.0.smithi046.stdout:1/869: rename d7/d12/f99 to d7/db/d98/dc5/d2b/d39/db3/f129 0 2024-04-26T12:28:50.199 INFO:tasks.workunit.client.0.smithi046.stdout:1/870: creat d7/d14/d5d/d32/d41/d8f/d114/f12a x:0 0 0 2024-04-26T12:28:50.199 INFO:tasks.workunit.client.0.smithi046.stdout:1/871: fsync d7/db/f8c 0 2024-04-26T12:28:50.200 INFO:tasks.workunit.client.0.smithi046.stdout:1/872: truncate d7/d14/d5d/d6b/dc2/f4a 2545828 0 2024-04-26T12:28:50.201 INFO:tasks.workunit.client.0.smithi046.stdout:1/873: mkdir d7/db/dee/d12b 0 2024-04-26T12:28:50.201 INFO:tasks.workunit.client.0.smithi046.stdout:1/874: unlink d7/db/d98/dc5/d2b/d39/db3/d79/fcd 0 2024-04-26T12:28:50.202 INFO:tasks.workunit.client.0.smithi046.stdout:4/836: dread d0/d1/d5/db/fe7 [0,4194304] 0 2024-04-26T12:28:50.202 INFO:tasks.workunit.client.0.smithi046.stdout:1/875: mknod d7/db/d98/dc5/d2b/d39/db3/d79/c12c 0 2024-04-26T12:28:50.203 INFO:tasks.workunit.client.0.smithi046.stdout:1/876: chown d7/d14/ffb 8425 1 2024-04-26T12:28:50.206 INFO:tasks.workunit.client.0.smithi046.stdout:6/866: sync 2024-04-26T12:28:50.206 INFO:tasks.workunit.client.0.smithi046.stdout:3/918: sync 2024-04-26T12:28:50.206 INFO:tasks.workunit.client.0.smithi046.stdout:0/971: sync 2024-04-26T12:28:50.206 INFO:tasks.workunit.client.0.smithi046.stdout:7/918: sync 2024-04-26T12:28:50.206 INFO:tasks.workunit.client.0.smithi046.stdout:2/914: sync 2024-04-26T12:28:50.207 INFO:tasks.workunit.client.0.smithi046.stdout:6/867: write d7/d1b/d37/fd5 [1465339,106047] 0 2024-04-26T12:28:50.207 INFO:tasks.workunit.client.0.smithi046.stdout:4/837: dread d0/da/d17/d20/fb1 [0,4194304] 0 2024-04-26T12:28:50.208 INFO:tasks.workunit.client.0.smithi046.stdout:7/919: dread - d16/d1a/d31/d55/d6d/d89/f119 zero size 2024-04-26T12:28:50.209 INFO:tasks.workunit.client.0.smithi046.stdout:7/920: chown l7 0 1 2024-04-26T12:28:50.209 INFO:tasks.workunit.client.0.smithi046.stdout:0/972: getdents d9/dc/dd/dd2 0 2024-04-26T12:28:50.209 INFO:tasks.workunit.client.0.smithi046.stdout:1/877: dwrite d7/db/d98/dc5/d2b/d31/d82/f115 [0,4194304] 0 2024-04-26T12:28:50.210 INFO:tasks.workunit.client.0.smithi046.stdout:6/868: mknod d7/d1b/d47/d65/d77/d92/c115 0 2024-04-26T12:28:50.211 INFO:tasks.workunit.client.0.smithi046.stdout:6/869: write d7/d1b/fcb [2379697,101446] 0 2024-04-26T12:28:50.212 INFO:tasks.workunit.client.0.smithi046.stdout:6/870: dread - d7/d1b/d6a/d57/ff0 zero size 2024-04-26T12:28:50.212 INFO:tasks.workunit.client.0.smithi046.stdout:1/878: link d7/d14/ff4 d7/d14/f12d 0 2024-04-26T12:28:50.212 INFO:tasks.workunit.client.0.smithi046.stdout:4/838: rename d0/da/d17/d20/d9c/cb3 to d0/da/d17/d20/d25/d35/c119 0 2024-04-26T12:28:50.215 INFO:tasks.workunit.client.0.smithi046.stdout:1/879: unlink d7/db/d98/dc5/d2b/d39/db3/d79/c12c 0 2024-04-26T12:28:50.215 INFO:tasks.workunit.client.0.smithi046.stdout:5/985: dread d9/da/dd/d34/d45/f53 [4194304,4194304] 0 2024-04-26T12:28:50.215 INFO:tasks.workunit.client.0.smithi046.stdout:7/921: dwrite d16/d27/fe2 [0,4194304] 0 2024-04-26T12:28:50.216 INFO:tasks.workunit.client.0.smithi046.stdout:1/880: dread - d7/d14/d5d/d32/d5f/f65 zero size 2024-04-26T12:28:50.216 INFO:tasks.workunit.client.0.smithi046.stdout:5/986: mkdir d9/da/d18/dd4/d135/d14f 0 2024-04-26T12:28:50.219 INFO:tasks.workunit.client.0.smithi046.stdout:1/881: dread - d7/d14/d5d/d32/d41/d8f/d114/d11c/f120 zero size 2024-04-26T12:28:50.219 INFO:tasks.workunit.client.0.smithi046.stdout:7/922: truncate d16/d1a/d31/d55/d6d/d89/dc7/fe1 277273 0 2024-04-26T12:28:50.219 INFO:tasks.workunit.client.0.smithi046.stdout:6/871: write d7/d1b/d37/fe6 [3801686,64987] 0 2024-04-26T12:28:50.219 INFO:tasks.workunit.client.0.smithi046.stdout:5/987: creat d9/da/dd/dd7/d7e/d10e/f150 x:0 0 0 2024-04-26T12:28:50.219 INFO:tasks.workunit.client.0.smithi046.stdout:7/923: chown d16/d27/f10f 1678 1 2024-04-26T12:28:50.219 INFO:tasks.workunit.client.0.smithi046.stdout:5/988: rmdir d9/da/d18/dd4/d134 39 2024-04-26T12:28:50.219 INFO:tasks.workunit.client.0.smithi046.stdout:6/872: chown d7/d1b/d6a/d57/c7c 15 1 2024-04-26T12:28:50.219 INFO:tasks.workunit.client.0.smithi046.stdout:1/882: rename d7/d14/d5d/d6b/dc2/d117 to d7/d14/d5d/d6b/d105/d12e 0 2024-04-26T12:28:50.220 INFO:tasks.workunit.client.0.smithi046.stdout:7/924: creat d16/d1a/d31/d5a/d6b/df2/f134 x:0 0 0 2024-04-26T12:28:50.220 INFO:tasks.workunit.client.0.smithi046.stdout:6/873: fsync d7/d1b/d47/f97 0 2024-04-26T12:28:50.221 INFO:tasks.workunit.client.0.smithi046.stdout:1/883: mkdir d7/d14/de3/d12f 0 2024-04-26T12:28:50.221 INFO:tasks.workunit.client.0.smithi046.stdout:5/989: write d9/da/d15/f9f [5033669,105892] 0 2024-04-26T12:28:50.221 INFO:tasks.workunit.client.0.smithi046.stdout:7/925: mknod d16/dba/c135 0 2024-04-26T12:28:50.221 INFO:tasks.workunit.client.0.smithi046.stdout:7/926: chown d16/d104/d10d 3738487 1 2024-04-26T12:28:50.221 INFO:tasks.workunit.client.0.smithi046.stdout:6/874: creat d7/d1b/d47/d65/d77/d92/f116 x:0 0 0 2024-04-26T12:28:50.221 INFO:tasks.workunit.client.0.smithi046.stdout:5/990: write d9/da/dd/dd7/f6c [34326,23241] 0 2024-04-26T12:28:50.222 INFO:tasks.workunit.client.0.smithi046.stdout:1/884: write d7/db/d98/dc5/d2b/d39/ff2 [1589701,121885] 0 2024-04-26T12:28:50.222 INFO:tasks.workunit.client.0.smithi046.stdout:7/927: unlink d16/db1/dc0/fff 0 2024-04-26T12:28:50.222 INFO:tasks.workunit.client.0.smithi046.stdout:3/919: dread d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d/f10a [0,4194304] 0 2024-04-26T12:28:50.223 INFO:tasks.workunit.client.0.smithi046.stdout:5/991: dread - d9/da/d15/f127 zero size 2024-04-26T12:28:50.223 INFO:tasks.workunit.client.0.smithi046.stdout:3/920: readlink d2/db0/dc4/l76 0 2024-04-26T12:28:50.223 INFO:tasks.workunit.client.0.smithi046.stdout:9/804: dread d0/d19/d51/f57 [0,4194304] 0 2024-04-26T12:28:50.223 INFO:tasks.workunit.client.0.smithi046.stdout:0/973: dread d9/dc/dd/d45/d69/f8b [0,4194304] 0 2024-04-26T12:28:50.224 INFO:tasks.workunit.client.0.smithi046.stdout:7/928: unlink d16/d1a/d31/d5a/d6b/df2/ddb/l118 0 2024-04-26T12:28:50.230 INFO:tasks.workunit.client.0.smithi046.stdout:2/915: dread d1/de/d15/d18/dc1/db6/dda/f3b [0,4194304] 0 2024-04-26T12:28:50.230 INFO:tasks.workunit.client.0.smithi046.stdout:0/974: mkdir d9/d1d/d40/d41/d152 0 2024-04-26T12:28:50.230 INFO:tasks.workunit.client.0.smithi046.stdout:9/805: read d0/d19/d51/f57 [1499306,119536] 0 2024-04-26T12:28:50.230 INFO:tasks.workunit.client.0.smithi046.stdout:7/929: symlink d16/d1a/d31/d4d/l136 0 2024-04-26T12:28:50.231 INFO:tasks.workunit.client.0.smithi046.stdout:3/921: getdents d2/d16/d2c 0 2024-04-26T12:28:50.231 INFO:tasks.workunit.client.0.smithi046.stdout:2/916: mknod d1/df2/c133 0 2024-04-26T12:28:50.231 INFO:tasks.workunit.client.0.smithi046.stdout:3/922: fdatasync d2/f17 0 2024-04-26T12:28:50.231 INFO:tasks.workunit.client.0.smithi046.stdout:0/975: mknod d9/d1d/d40/d41/d7e/c153 0 2024-04-26T12:28:50.232 INFO:tasks.workunit.client.0.smithi046.stdout:7/930: truncate d16/d27/f10c 430788 0 2024-04-26T12:28:50.232 INFO:tasks.workunit.client.0.smithi046.stdout:6/875: dwrite d7/d1b/d47/d65/fa5 [0,4194304] 0 2024-04-26T12:28:50.232 INFO:tasks.workunit.client.0.smithi046.stdout:1/885: dwrite d7/db/dee/f104 [4194304,4194304] 0 2024-04-26T12:28:50.235 INFO:tasks.workunit.client.0.smithi046.stdout:9/806: rename d0/d2c/dda/d76/d7d/d72/da1/dc8/d9b to d0/d2c/dbe/dd2/d11b 0 2024-04-26T12:28:50.235 INFO:tasks.workunit.client.0.smithi046.stdout:0/976: mknod d9/d1d/d40/d41/d7e/ddd/c154 0 2024-04-26T12:28:50.235 INFO:tasks.workunit.client.0.smithi046.stdout:6/876: symlink d7/d1b/d47/d65/d77/d92/l117 0 2024-04-26T12:28:50.235 INFO:tasks.workunit.client.0.smithi046.stdout:7/931: rename c15 to d16/d35/dac/dbb/c137 0 2024-04-26T12:28:50.235 INFO:tasks.workunit.client.0.smithi046.stdout:1/886: mkdir d7/db/d98/dc5/d2b/d31/d130 0 2024-04-26T12:28:50.235 INFO:tasks.workunit.client.0.smithi046.stdout:0/977: stat d9/d1d/d40/d41/d7e/da5/dad/dbd/dcd/f139 0 2024-04-26T12:28:50.236 INFO:tasks.workunit.client.0.smithi046.stdout:6/877: truncate d7/d1b/d6a/d57/f75 699787 0 2024-04-26T12:28:50.236 INFO:tasks.workunit.client.0.smithi046.stdout:7/932: write d16/d1a/d31/d5a/fa8 [2561909,52153] 0 2024-04-26T12:28:50.236 INFO:tasks.workunit.client.0.smithi046.stdout:1/887: fsync d7/db/d98/dc5/f18 0 2024-04-26T12:28:50.236 INFO:tasks.workunit.client.0.smithi046.stdout:6/878: dread - d7/d1b/fb6 zero size 2024-04-26T12:28:50.236 INFO:tasks.workunit.client.0.smithi046.stdout:7/933: chown d16/d35/f117 71 1 2024-04-26T12:28:50.237 INFO:tasks.workunit.client.0.smithi046.stdout:6/879: fdatasync d7/f15 0 2024-04-26T12:28:50.237 INFO:tasks.workunit.client.0.smithi046.stdout:3/923: dread d2/d16/d2c/d50/d71/d89/dc5/d1b/fab [0,4194304] 0 2024-04-26T12:28:50.237 INFO:tasks.workunit.client.0.smithi046.stdout:2/917: truncate d1/de/d15/d18/f9b 743741 0 2024-04-26T12:28:50.238 INFO:tasks.workunit.client.0.smithi046.stdout:7/934: chown d16/c17 1401 1 2024-04-26T12:28:50.238 INFO:tasks.workunit.client.0.smithi046.stdout:9/807: write d0/d2c/d3d/d52/fa6 [1317803,65043] 0 2024-04-26T12:28:50.238 INFO:tasks.workunit.client.0.smithi046.stdout:1/888: rename d7/db/d98/dc5/ld5 to d7/d14/d5d/d32/d41/l131 0 2024-04-26T12:28:50.239 INFO:tasks.workunit.client.0.smithi046.stdout:7/935: creat d16/d35/f138 x:0 0 0 2024-04-26T12:28:50.239 INFO:tasks.workunit.client.0.smithi046.stdout:9/808: write d0/d19/f93 [98320,28547] 0 2024-04-26T12:28:50.240 INFO:tasks.workunit.client.0.smithi046.stdout:3/924: write d2/d16/d2c/d50/d71/d89/dc5/f58 [2830790,94864] 0 2024-04-26T12:28:50.240 INFO:tasks.workunit.client.0.smithi046.stdout:2/918: read d1/de/d15/f4e [123054,45332] 0 2024-04-26T12:28:50.241 INFO:tasks.workunit.client.0.smithi046.stdout:3/925: chown d2/d13d 159 1 2024-04-26T12:28:50.241 INFO:tasks.workunit.client.0.smithi046.stdout:1/889: creat d7/d14/d5d/d6b/dc2/d76/f132 x:0 0 0 2024-04-26T12:28:50.242 INFO:tasks.workunit.client.0.smithi046.stdout:9/809: fsync d0/d19/d51/dac/fe0 0 2024-04-26T12:28:50.242 INFO:tasks.workunit.client.0.smithi046.stdout:5/992: dwrite d9/da/d18/f2d [0,4194304] 0 2024-04-26T12:28:50.242 INFO:tasks.workunit.client.0.smithi046.stdout:2/919: chown d1/de/db1/fb2 45244380 1 2024-04-26T12:28:50.243 INFO:tasks.workunit.client.0.smithi046.stdout:9/810: readlink d0/d19/d21/l27 0 2024-04-26T12:28:50.243 INFO:tasks.workunit.client.0.smithi046.stdout:0/978: dwrite d9/dc/d2a/f31 [0,4194304] 0 2024-04-26T12:28:50.243 INFO:tasks.workunit.client.0.smithi046.stdout:1/890: write d7/db/f8c [1985447,84146] 0 2024-04-26T12:28:50.244 INFO:tasks.workunit.client.0.smithi046.stdout:3/926: chown d2/d16/d2c/d50/d71/d89/dc5/d82/cb7 0 1 2024-04-26T12:28:50.244 INFO:tasks.workunit.client.0.smithi046.stdout:5/993: write d9/da/d15/f122 [1114093,35248] 0 2024-04-26T12:28:50.245 INFO:tasks.workunit.client.0.smithi046.stdout:6/880: write d7/d2b/d31/f35 [21802,41910] 0 2024-04-26T12:28:50.246 INFO:tasks.workunit.client.0.smithi046.stdout:2/920: chown d1/de/d65/d1b/l11f 0 1 2024-04-26T12:28:50.247 INFO:tasks.workunit.client.0.smithi046.stdout:4/839: dread d0/da/d17/d20/d25/fc9 [0,4194304] 0 2024-04-26T12:28:50.247 INFO:tasks.workunit.client.0.smithi046.stdout:2/921: truncate d1/f83 5133568 0 2024-04-26T12:28:50.247 INFO:tasks.workunit.client.0.smithi046.stdout:0/979: mkdir d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d10f/d155 0 2024-04-26T12:28:50.247 INFO:tasks.workunit.client.0.smithi046.stdout:6/881: symlink d7/da7/dd1/l118 0 2024-04-26T12:28:50.249 INFO:tasks.workunit.client.0.smithi046.stdout:7/936: dread d16/d1a/d31/fe7 [4194304,4194304] 0 2024-04-26T12:28:50.249 INFO:tasks.workunit.client.0.smithi046.stdout:1/891: dread - d7/db/d98/dc5/d2b/d39/d3c/f106 zero size 2024-04-26T12:28:50.250 INFO:tasks.workunit.client.0.smithi046.stdout:4/840: read - d0/da/d17/d20/d25/d35/d6d/d19/d55/f9a zero size 2024-04-26T12:28:50.250 INFO:tasks.workunit.client.0.smithi046.stdout:9/811: dwrite d0/d2c/d47/f46 [4194304,4194304] 0 2024-04-26T12:28:50.252 INFO:tasks.workunit.client.0.smithi046.stdout:7/937: stat d16/d1a/d31/d62/f80 0 2024-04-26T12:28:50.252 INFO:tasks.workunit.client.0.smithi046.stdout:1/892: chown d7/d14/d5d/d32/d41/d8f/l10c 159843693 1 2024-04-26T12:28:50.252 INFO:tasks.workunit.client.0.smithi046.stdout:5/994: creat d9/da/dd/d34/d44/d97/da4/d35/dd8/dff/f151 x:0 0 0 2024-04-26T12:28:50.253 INFO:tasks.workunit.client.0.smithi046.stdout:4/841: write d0/f52 [4593697,113231] 0 2024-04-26T12:28:50.255 INFO:tasks.workunit.client.0.smithi046.stdout:7/938: creat d16/d4e/d6c/d9f/f139 x:0 0 0 2024-04-26T12:28:50.255 INFO:tasks.workunit.client.0.smithi046.stdout:9/812: creat d0/d2c/dda/d76/d7d/d72/da1/df1/f11c x:0 0 0 2024-04-26T12:28:50.255 INFO:tasks.workunit.client.0.smithi046.stdout:1/893: chown d7/d14/d5d/d32/d5f/f65 197466243 1 2024-04-26T12:28:50.256 INFO:tasks.workunit.client.0.smithi046.stdout:2/922: dwrite d1/de/db1/fdb [0,4194304] 0 2024-04-26T12:28:50.257 INFO:tasks.workunit.client.0.smithi046.stdout:6/882: dwrite d7/d1b/f4b [0,4194304] 0 2024-04-26T12:28:50.257 INFO:tasks.workunit.client.0.smithi046.stdout:9/813: creat d0/d2c/d47/f11d x:0 0 0 2024-04-26T12:28:50.259 INFO:tasks.workunit.client.0.smithi046.stdout:0/980: dwrite d9/dc/dd/f13 [0,4194304] 0 2024-04-26T12:28:50.259 INFO:tasks.workunit.client.0.smithi046.stdout:3/927: truncate d2/db/d84/da5/de6/f11a 3303615 0 2024-04-26T12:28:50.261 INFO:tasks.workunit.client.0.smithi046.stdout:2/923: write d1/de/d65/d4a/f80 [67461,36558] 0 2024-04-26T12:28:50.261 INFO:tasks.workunit.client.0.smithi046.stdout:1/894: rename d7/db/d98/dc5/d2b/d31/d82/l9b to d7/d12/d89/l133 0 2024-04-26T12:28:50.262 INFO:tasks.workunit.client.0.smithi046.stdout:9/814: getdents d0/d2c/dda/d76/d7d 0 2024-04-26T12:28:50.262 INFO:tasks.workunit.client.0.smithi046.stdout:0/981: write d9/d1d/d40/d41/f7c [296477,100797] 0 2024-04-26T12:28:50.263 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:50.261+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:50.263 INFO:tasks.workunit.client.0.smithi046.stdout:2/924: chown d1/de/db1/fdb 365 1 2024-04-26T12:28:50.263 INFO:tasks.workunit.client.0.smithi046.stdout:1/895: mkdir d7/db/d98/d134 0 2024-04-26T12:28:50.264 INFO:tasks.workunit.client.0.smithi046.stdout:3/928: rename d2/d16/d2c/d50/d71/d89/dc5/d82/fad to d2/db/d4a/f13f 0 2024-04-26T12:28:50.264 INFO:tasks.workunit.client.0.smithi046.stdout:4/842: dwrite d0/d64/dd9/fdb [0,4194304] 0 2024-04-26T12:28:50.266 INFO:tasks.workunit.client.0.smithi046.stdout:2/925: stat d1/de/d15/d18/d8a/fe8 0 2024-04-26T12:28:50.266 INFO:tasks.workunit.client.0.smithi046.stdout:6/883: dwrite d7/d1b/d6a/f7e [0,4194304] 0 2024-04-26T12:28:50.266 INFO:tasks.workunit.client.0.smithi046.stdout:6/884: write d7/d1b/d37/daa/de7/f105 [526995,2678] 0 2024-04-26T12:28:50.269 INFO:tasks.workunit.client.0.smithi046.stdout:9/815: creat d0/d2c/dda/d76/d7d/d72/da1/dc8/d111/f11e x:0 0 0 2024-04-26T12:28:50.269 INFO:tasks.workunit.client.0.smithi046.stdout:1/896: creat d7/db/d98/dc5/d2b/d39/d3c/f135 x:0 0 0 2024-04-26T12:28:50.270 INFO:tasks.workunit.client.0.smithi046.stdout:6/885: mknod d7/da7/daf/c119 0 2024-04-26T12:28:50.270 INFO:tasks.workunit.client.0.smithi046.stdout:0/982: dwrite d9/d1d/d5d/d6b/d8a/d8c/fde [0,4194304] 0 2024-04-26T12:28:50.270 INFO:tasks.workunit.client.0.smithi046.stdout:4/843: creat d0/d64/f11a x:0 0 0 2024-04-26T12:28:50.270 INFO:tasks.workunit.client.0.smithi046.stdout:1/897: write d7/db/d98/fe2 [126844,108080] 0 2024-04-26T12:28:50.272 INFO:tasks.workunit.client.0.smithi046.stdout:9/816: write d0/d2c/d47/f11d [130692,94989] 0 2024-04-26T12:28:50.272 INFO:tasks.workunit.client.0.smithi046.stdout:1/898: fsync d7/db/f64 0 2024-04-26T12:28:50.272 INFO:tasks.workunit.client.0.smithi046.stdout:2/926: dread d1/de/f5e [0,4194304] 0 2024-04-26T12:28:50.274 INFO:tasks.workunit.client.0.smithi046.stdout:4/844: creat d0/da/d17/d20/d25/f11b x:0 0 0 2024-04-26T12:28:50.274 INFO:tasks.workunit.client.0.smithi046.stdout:0/983: creat d9/dc/db9/f156 x:0 0 0 2024-04-26T12:28:50.275 INFO:tasks.workunit.client.0.smithi046.stdout:2/927: mknod d1/de/db1/c134 0 2024-04-26T12:28:50.275 INFO:tasks.workunit.client.0.smithi046.stdout:1/899: link d7/d14/d5d/d32/d5f/ld4 d7/d14/d5d/d32/d41/d8f/dd3/l136 0 2024-04-26T12:28:50.275 INFO:tasks.workunit.client.0.smithi046.stdout:0/984: creat d9/d1d/d40/d41/d7e/de1/f157 x:0 0 0 2024-04-26T12:28:50.275 INFO:tasks.workunit.client.0.smithi046.stdout:2/928: getdents d1/de/d65/d8f/d122 0 2024-04-26T12:28:50.276 INFO:tasks.workunit.client.0.smithi046.stdout:4/845: link d0/d64/f6a d0/da/d17/d20/d25/d35/d6d/d19/d55/f11c 0 2024-04-26T12:28:50.276 INFO:tasks.workunit.client.0.smithi046.stdout:2/929: dread - d1/de/d15/d18/f10c zero size 2024-04-26T12:28:50.277 INFO:tasks.workunit.client.0.smithi046.stdout:0/985: write d9/dc/dd/dd2/d10e/d11f/fc5 [1391649,112751] 0 2024-04-26T12:28:50.278 INFO:tasks.workunit.client.0.smithi046.stdout:0/986: stat d9/l77 0 2024-04-26T12:28:50.278 INFO:tasks.workunit.client.0.smithi046.stdout:2/930: stat d1/de/d2b/lfe 0 2024-04-26T12:28:50.278 INFO:tasks.workunit.client.0.smithi046.stdout:4/846: chown d0/d1/d5/db/f8f 13754692 1 2024-04-26T12:28:50.279 INFO:tasks.workunit.client.0.smithi046.stdout:2/931: truncate d1/de/d15/d18/dc1/f128 435592 0 2024-04-26T12:28:50.280 INFO:tasks.workunit.client.0.smithi046.stdout:7/939: sync 2024-04-26T12:28:50.280 INFO:tasks.workunit.client.0.smithi046.stdout:4/847: sync 2024-04-26T12:28:50.282 INFO:tasks.workunit.client.0.smithi046.stdout:2/932: mknod d1/de/c135 0 2024-04-26T12:28:50.282 INFO:tasks.workunit.client.0.smithi046.stdout:4/848: fdatasync d0/d1/f3b 0 2024-04-26T12:28:50.282 INFO:tasks.workunit.client.0.smithi046.stdout:7/940: chown d16/d1a/d69/cc3 19 1 2024-04-26T12:28:50.282 INFO:tasks.workunit.client.0.smithi046.stdout:3/929: dread d2/db/d4a/f13f [0,4194304] 0 2024-04-26T12:28:50.283 INFO:tasks.workunit.client.0.smithi046.stdout:7/941: mknod d16/d1a/d31/d5a/d6b/df2/ddb/c13a 0 2024-04-26T12:28:50.283 INFO:tasks.workunit.client.0.smithi046.stdout:2/933: mkdir d1/de/d136 0 2024-04-26T12:28:50.283 INFO:tasks.workunit.client.0.smithi046.stdout:3/930: fsync d2/db/d4a/da9/faf 0 2024-04-26T12:28:50.284 INFO:tasks.workunit.client.0.smithi046.stdout:2/934: creat d1/de/d15/d18/dc1/de3/f137 x:0 0 0 2024-04-26T12:28:50.284 INFO:tasks.workunit.client.0.smithi046.stdout:7/942: creat d16/d1a/d31/f13b x:0 0 0 2024-04-26T12:28:50.285 INFO:tasks.workunit.client.0.smithi046.stdout:3/931: write d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d/f12b [281497,109346] 0 2024-04-26T12:28:50.285 INFO:tasks.workunit.client.0.smithi046.stdout:7/943: fsync d16/d1a/ffa 0 2024-04-26T12:28:50.286 INFO:tasks.workunit.client.0.smithi046.stdout:3/932: readlink d2/d16/d2c/d50/d71/df6/l124 0 2024-04-26T12:28:50.287 INFO:tasks.workunit.client.0.smithi046.stdout:7/944: unlink d16/d1a/d31/f39 0 2024-04-26T12:28:50.287 INFO:tasks.workunit.client.0.smithi046.stdout:4/849: read d0/da/da1/f34 [2757210,125220] 0 2024-04-26T12:28:50.287 INFO:tasks.workunit.client.0.smithi046.stdout:2/935: rename d1/de/db1/fdb to d1/de/d15/d18/dc1/db6/f138 0 2024-04-26T12:28:50.287 INFO:tasks.workunit.client.0.smithi046.stdout:2/936: symlink d1/df2/l139 0 2024-04-26T12:28:50.288 INFO:tasks.workunit.client.0.smithi046.stdout:4/850: creat d0/da/d17/d20/d25/d35/de1/f11d x:0 0 0 2024-04-26T12:28:50.288 INFO:tasks.workunit.client.0.smithi046.stdout:7/945: write d16/d1a/d31/d55/d6d/d89/dc7/fe1 [604192,25553] 0 2024-04-26T12:28:50.290 INFO:tasks.workunit.client.0.smithi046.stdout:4/851: creat d0/da/d17/d20/d74/f11e x:0 0 0 2024-04-26T12:28:50.290 INFO:tasks.workunit.client.0.smithi046.stdout:4/852: chown d0/ddc/c102 852 1 2024-04-26T12:28:50.292 INFO:tasks.workunit.client.0.smithi046.stdout:4/853: write d0/da/d17/d20/d25/f43 [3990514,11143] 0 2024-04-26T12:28:50.292 INFO:tasks.workunit.client.0.smithi046.stdout:0/987: write d9/d1d/d40/d41/d7e/f145 [126581,118673] 0 2024-04-26T12:28:50.292 INFO:tasks.workunit.client.0.smithi046.stdout:3/933: truncate d2/d16/d2c/d50/d71/d89/dc5/f3a 3578497 0 2024-04-26T12:28:50.293 INFO:tasks.workunit.client.0.smithi046.stdout:9/817: dread d0/d2c/d47/f58 [0,4194304] 0 2024-04-26T12:28:50.293 INFO:tasks.workunit.client.0.smithi046.stdout:1/900: dread d7/db/d98/dc5/d2b/d39/d5c/f11e [0,4194304] 0 2024-04-26T12:28:50.293 INFO:tasks.workunit.client.0.smithi046.stdout:4/854: write d0/da/d21/f73 [2574918,51115] 0 2024-04-26T12:28:50.294 INFO:tasks.workunit.client.0.smithi046.stdout:3/934: read - d2/db0/dc4/fea zero size 2024-04-26T12:28:50.294 INFO:tasks.workunit.client.0.smithi046.stdout:9/818: mknod d0/d29/c11f 0 2024-04-26T12:28:50.295 INFO:tasks.workunit.client.0.smithi046.stdout:5/995: dread d9/da/dd/d34/d45/f56 [0,4194304] 0 2024-04-26T12:28:50.295 INFO:tasks.workunit.client.0.smithi046.stdout:9/819: fsync d0/f5 0 2024-04-26T12:28:50.295 INFO:tasks.workunit.client.0.smithi046.stdout:1/901: creat d7/d14/f137 x:0 0 0 2024-04-26T12:28:50.295 INFO:tasks.workunit.client.0.smithi046.stdout:0/988: dread - d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d108/f12a zero size 2024-04-26T12:28:50.296 INFO:tasks.workunit.client.0.smithi046.stdout:4/855: creat d0/d41/f11f x:0 0 0 2024-04-26T12:28:50.298 INFO:tasks.workunit.client.0.smithi046.stdout:4/856: fdatasync d0/da/d17/d20/d25/d35/d61/fea 0 2024-04-26T12:28:50.298 INFO:tasks.workunit.client.0.smithi046.stdout:3/935: write d2/d16/d2c/f36 [3978881,123958] 0 2024-04-26T12:28:50.298 INFO:tasks.workunit.client.0.smithi046.stdout:0/989: link d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/d108/f107 d9/d1d/d40/d41/d7e/da5/dad/dbd/d151/f158 0 2024-04-26T12:28:50.299 INFO:tasks.workunit.client.0.smithi046.stdout:4/857: dread - d0/da/d17/d20/d25/ffa zero size 2024-04-26T12:28:50.300 INFO:tasks.workunit.client.0.smithi046.stdout:3/936: symlink d2/db/d4a/da9/l140 0 2024-04-26T12:28:50.301 INFO:tasks.workunit.client.0.smithi046.stdout:1/902: dwrite d7/db/f8c [0,4194304] 0 2024-04-26T12:28:50.303 INFO:tasks.workunit.client.0.smithi046.stdout:6/886: dread d7/d2b/d31/f2e [0,4194304] 0 2024-04-26T12:28:50.304 INFO:tasks.workunit.client.0.smithi046.stdout:3/937: fdatasync d2/d16/d2c/d50/fc7 0 2024-04-26T12:28:50.304 INFO:tasks.workunit.client.0.smithi046.stdout:0/990: getdents d9/d1d/d40/d41/d7e/d9d 0 2024-04-26T12:28:50.305 INFO:tasks.workunit.client.0.smithi046.stdout:2/937: dread d1/de/d2b/f50 [0,4194304] 0 2024-04-26T12:28:50.305 INFO:tasks.workunit.client.0.smithi046.stdout:4/858: mkdir d0/da/d17/d20/d25/d35/d6d/d19/d55/dae/d120 0 2024-04-26T12:28:50.306 INFO:tasks.workunit.client.0.smithi046.stdout:3/938: mknod d2/db0/dc4/d127/d139/c141 0 2024-04-26T12:28:50.306 INFO:tasks.workunit.client.0.smithi046.stdout:9/820: sync 2024-04-26T12:28:50.307 INFO:tasks.workunit.client.0.smithi046.stdout:6/887: sync 2024-04-26T12:28:50.307 INFO:tasks.workunit.client.0.smithi046.stdout:3/939: mkdir d2/d16/d2c/d142 0 2024-04-26T12:28:50.307 INFO:tasks.workunit.client.0.smithi046.stdout:1/903: read d7/d14/d5d/d32/fbd [4135872,93159] 0 2024-04-26T12:28:50.307 INFO:tasks.workunit.client.0.smithi046.stdout:3/940: rmdir d2/deb/dfd 39 2024-04-26T12:28:50.308 INFO:tasks.workunit.client.0.smithi046.stdout:6/888: mknod d7/d1b/c11a 0 2024-04-26T12:28:50.308 INFO:tasks.workunit.client.0.smithi046.stdout:1/904: write d7/d12/f36 [1839125,67095] 0 2024-04-26T12:28:50.308 INFO:tasks.workunit.client.0.smithi046.stdout:7/946: dread d16/d1a/d3e/f44 [0,4194304] 0 2024-04-26T12:28:50.309 INFO:tasks.workunit.client.0.smithi046.stdout:3/941: mkdir d2/db/d4a/da9/d143 0 2024-04-26T12:28:50.309 INFO:tasks.workunit.client.0.smithi046.stdout:6/889: rmdir d7/d2b/d31/dd9 39 2024-04-26T12:28:50.309 INFO:tasks.workunit.client.0.smithi046.stdout:9/821: rename d0/d2c/d47/l17 to d0/d2c/dda/d76/d7d/d72/l120 0 2024-04-26T12:28:50.310 INFO:tasks.workunit.client.0.smithi046.stdout:9/822: chown d0/d2c/dbe 6191 1 2024-04-26T12:28:50.310 INFO:tasks.workunit.client.0.smithi046.stdout:7/947: rename d16/d3f/d81/fc1 to d16/d100/f13c 0 2024-04-26T12:28:50.310 INFO:tasks.workunit.client.0.smithi046.stdout:6/890: write d7/d1b/d6a/d57/f75 [24670,86398] 0 2024-04-26T12:28:50.311 INFO:tasks.workunit.client.0.smithi046.stdout:9/823: chown d0/d2c/cfa 5750822 1 2024-04-26T12:28:50.311 INFO:tasks.workunit.client.0.smithi046.stdout:3/942: creat d2/d16/d2c/d50/d71/d89/dc5/f144 x:0 0 0 2024-04-26T12:28:50.311 INFO:tasks.workunit.client.0.smithi046.stdout:7/948: creat d16/d1a/d31/d62/f13d x:0 0 0 2024-04-26T12:28:50.312 INFO:tasks.workunit.client.0.smithi046.stdout:6/891: creat d7/d2b/d31/d4d/f11b x:0 0 0 2024-04-26T12:28:50.313 INFO:tasks.workunit.client.0.smithi046.stdout:9/824: creat d0/d29/d69/db5/f121 x:0 0 0 2024-04-26T12:28:50.313 INFO:tasks.workunit.client.0.smithi046.stdout:4/859: truncate d0/da/fda 2322177 0 2024-04-26T12:28:50.313 INFO:tasks.workunit.client.0.smithi046.stdout:0/991: dread d9/d1d/d40/d41/d7e/d9d/fd8 [0,4194304] 0 2024-04-26T12:28:50.313 INFO:tasks.workunit.client.0.smithi046.stdout:7/949: mkdir d16/d35/dc9/d13e 0 2024-04-26T12:28:50.313 INFO:tasks.workunit.client.0.smithi046.stdout:2/938: truncate d1/de/d65/d4a/d58/fc0 1985784 0 2024-04-26T12:28:50.314 INFO:tasks.workunit.client.0.smithi046.stdout:9/825: creat d0/d2c/dda/d76/f122 x:0 0 0 2024-04-26T12:28:50.314 INFO:tasks.workunit.client.0.smithi046.stdout:3/943: getdents d2 0 2024-04-26T12:28:50.314 INFO:tasks.workunit.client.0.smithi046.stdout:6/892: rename d7/d2b/d31/f43 to d7/d1b/d37/daa/f11c 0 2024-04-26T12:28:50.315 INFO:tasks.workunit.client.0.smithi046.stdout:4/860: write d0/da/d17/d20/d25/d35/de1/f11d [117479,50251] 0 2024-04-26T12:28:50.318 INFO:tasks.workunit.client.0.smithi046.stdout:2/939: write d1/de/d65/d4a/d86/fde [373271,105726] 0 2024-04-26T12:28:50.318 INFO:tasks.workunit.client.0.smithi046.stdout:9/826: chown d0/d2c/d47/ld 9 1 2024-04-26T12:28:50.318 INFO:tasks.workunit.client.0.smithi046.stdout:0/992: getdents d9/d1d/d40/d41/d7e/d9d/d120 0 2024-04-26T12:28:50.318 INFO:tasks.workunit.client.0.smithi046.stdout:3/944: read - d2/d16/f11e zero size 2024-04-26T12:28:50.318 INFO:tasks.workunit.client.0.smithi046.stdout:7/950: getdents d16/d1a 0 2024-04-26T12:28:50.318 INFO:tasks.workunit.client.0.smithi046.stdout:5/996: dread d9/da/dd/dd7/db0/db6/feb [0,4194304] 0 2024-04-26T12:28:50.318 INFO:tasks.workunit.client.0.smithi046.stdout:2/940: mkdir d1/de/dc8/ddd/d13a 0 2024-04-26T12:28:50.319 INFO:tasks.workunit.client.0.smithi046.stdout:4/861: readlink d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/l112 0 2024-04-26T12:28:50.319 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:50.319 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:50.320 INFO:tasks.workunit.client.0.smithi046.stdout:1/905: dwrite d7/db/f8d [0,4194304] 0 2024-04-26T12:28:50.320 INFO:tasks.workunit.client.0.smithi046.stdout:0/993: creat d9/dc/dd/dd2/d10e/d11f/dae/f159 x:0 0 0 2024-04-26T12:28:50.321 INFO:tasks.workunit.client.0.smithi046.stdout:3/945: rename d2/d16/d35/fc2 to d2/db/d4a/da9/d143/f145 0 2024-04-26T12:28:50.321 INFO:tasks.workunit.client.0.smithi046.stdout:5/997: rmdir d9/da/d18/d7d/d105 39 2024-04-26T12:28:50.321 INFO:tasks.workunit.client.0.smithi046.stdout:9/827: chown d0/d2c/dda/d76/d7d/d72/d85 4622218 1 2024-04-26T12:28:50.321 INFO:tasks.workunit.client.0.smithi046.stdout:0/994: chown d9/d1d/d40/d41/d7e/da5/lda 747 1 2024-04-26T12:28:50.322 INFO:tasks.workunit.client.0.smithi046.stdout:6/893: dwrite d7/d1b/d37/f7d [0,4194304] 0 2024-04-26T12:28:50.322 INFO:tasks.workunit.client.0.smithi046.stdout:9/828: chown d0/d2c/dda/d76/d7d/d72 2246098 1 2024-04-26T12:28:50.324 INFO:tasks.workunit.client.0.smithi046.stdout:6/894: fsync d7/d1b/d47/d65/d77/d92/fb3 0 2024-04-26T12:28:50.324 INFO:tasks.workunit.client.0.smithi046.stdout:0/995: truncate d9/d1d/d40/d41/d7e/da5/dad/dbd/d62/f72 184356 0 2024-04-26T12:28:50.325 INFO:tasks.workunit.client.0.smithi046.stdout:4/862: link d0/da/d17/d20/d25/d35/d6d/cf8 d0/da/d17/d20/d25/c121 0 2024-04-26T12:28:50.326 INFO:tasks.workunit.client.0.smithi046.stdout:4/863: dread - d0/da/da1/f113 zero size 2024-04-26T12:28:50.326 INFO:tasks.workunit.client.0.smithi046.stdout:0/996: link d9/dc/db9/l127 d9/d1d/d5d/d6b/d8a/l15a 0 2024-04-26T12:28:50.326 INFO:tasks.workunit.client.0.smithi046.stdout:3/946: dread d2/db/d4a/f13f [0,4194304] 0 2024-04-26T12:28:50.327 INFO:tasks.workunit.client.0.smithi046.stdout:6/895: mknod d7/d1b/c11d 0 2024-04-26T12:28:50.328 INFO:tasks.workunit.client.0.smithi046.stdout:3/947: dread - d2/d16/d2c/d50/d71/d89/dc5/d23/f135 zero size 2024-04-26T12:28:50.330 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:50.331 INFO:tasks.workunit.client.0.smithi046.stdout:7/951: truncate d16/d27/d51/d9c/fbc 862808 0 2024-04-26T12:28:50.333 INFO:tasks.workunit.client.0.smithi046.stdout:7/952: stat d16/d4e/lbd 0 2024-04-26T12:28:50.334 INFO:tasks.workunit.client.0.smithi046.stdout:4/864: dwrite d0/f99 [0,4194304] 0 2024-04-26T12:28:50.334 INFO:tasks.workunit.client.0.smithi046.stdout:6/896: dwrite d7/d1b/d6a/d57/ffd [0,4194304] 0 2024-04-26T12:28:50.336 INFO:tasks.workunit.client.0.smithi046.stdout:0/997: dwrite d9/dc/dd/f99 [4194304,4194304] 0 2024-04-26T12:28:50.338 INFO:tasks.workunit.client.0.smithi046.stdout:1/906: dwrite d7/d14/d5d/d32/d41/f93 [0,4194304] 0 2024-04-26T12:28:50.342 INFO:tasks.workunit.client.0.smithi046.stdout:0/998: unlink d9/d1d/d40/d41/d7e/f145 0 2024-04-26T12:28:50.342 INFO:tasks.workunit.client.0.smithi046.stdout:1/907: chown d7/db/c109 878 1 2024-04-26T12:28:50.342 INFO:tasks.workunit.client.0.smithi046.stdout:5/998: dwrite d9/da/d18/f25 [0,4194304] 0 2024-04-26T12:28:50.343 INFO:tasks.workunit.client.0.smithi046.stdout:1/908: creat d7/d14/de3/d12f/f138 x:0 0 0 2024-04-26T12:28:50.343 INFO:tasks.workunit.client.0.smithi046.stdout:5/999: creat d9/da/d18/d7d/da7/f152 x:0 0 0 2024-04-26T12:28:50.344 INFO:tasks.workunit.client.0.smithi046.stdout:4/865: dwrite d0/d1/d5/db/f8f [0,4194304] 0 2024-04-26T12:28:50.345 INFO:tasks.workunit.client.0.smithi046.stdout:1/909: mknod d7/d14/d5d/d32/d41/d8f/dfd/c139 0 2024-04-26T12:28:50.346 INFO:tasks.workunit.client.0.smithi046.stdout:6/897: dwrite d7/d1b/d37/daa/de7/f105 [0,4194304] 0 2024-04-26T12:28:50.346 INFO:tasks.workunit.client.0.smithi046.stdout:7/953: truncate d16/d1a/d31/d5a/fa8 1046240 0 2024-04-26T12:28:50.346 INFO:tasks.workunit.client.0.smithi046.stdout:4/866: unlink d0/da/d17/d20/fb1 0 2024-04-26T12:28:50.347 INFO:tasks.workunit.client.0.smithi046.stdout:6/898: write d7/d1b/d47/f7b [226368,91092] 0 2024-04-26T12:28:50.347 INFO:tasks.workunit.client.0.smithi046.stdout:7/954: write d16/d3f/d81/daa/fda [3921363,55506] 0 2024-04-26T12:28:50.348 INFO:tasks.workunit.client.0.smithi046.stdout:6/899: creat d7/d2b/d31/d10a/f11e x:0 0 0 2024-04-26T12:28:50.348 INFO:tasks.workunit.client.0.smithi046.stdout:7/955: creat d16/d27/f13f x:0 0 0 2024-04-26T12:28:50.349 INFO:tasks.workunit.client.0.smithi046.stdout:6/900: creat d7/d16/f11f x:0 0 0 2024-04-26T12:28:50.349 INFO:tasks.workunit.client.0.smithi046.stdout:7/956: creat d16/d1a/f140 x:0 0 0 2024-04-26T12:28:50.350 INFO:tasks.workunit.client.0.smithi046.stdout:6/901: write d7/d16/f56 [98322,74101] 0 2024-04-26T12:28:50.351 INFO:tasks.workunit.client.0.smithi046.stdout:6/902: mknod d7/d1b/d37/d95/def/c120 0 2024-04-26T12:28:50.353 INFO:tasks.workunit.client.0.smithi046.stdout:6/903: write d7/d2b/d31/d4d/fed [516289,28986] 0 2024-04-26T12:28:50.353 INFO:tasks.workunit.client.0.smithi046.stdout:7/957: rmdir d16/d1a/d3e/d59 39 2024-04-26T12:28:50.353 INFO:tasks.workunit.client.0.smithi046.stdout:6/904: stat d7/d16/dbc/dda/fe0 0 2024-04-26T12:28:50.354 INFO:tasks.workunit.client.0.smithi046.stdout:6/905: mkdir d7/da7/dd1/dd6/d121 0 2024-04-26T12:28:50.355 INFO:tasks.workunit.client.0.smithi046.stdout:9/829: dread d0/d2c/d3d/d52/f8f [0,4194304] 0 2024-04-26T12:28:50.355 INFO:tasks.workunit.client.0.smithi046.stdout:6/906: chown d7/d2b/d31/f98 982016 1 2024-04-26T12:28:50.357 INFO:tasks.workunit.client.0.smithi046.stdout:7/958: dwrite d16/d1a/d31/d55/f65 [0,4194304] 0 2024-04-26T12:28:50.362 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:50.360+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:50.362 INFO:tasks.workunit.client.0.smithi046.stdout:2/941: dread d1/de/d65/d4a/f59 [4194304,4194304] 0 2024-04-26T12:28:50.364 INFO:tasks.workunit.client.0.smithi046.stdout:7/959: dwrite d16/d1a/f113 [0,4194304] 0 2024-04-26T12:28:50.366 INFO:tasks.workunit.client.0.smithi046.stdout:7/960: rename d16/d35/l85 to d16/db1/dc0/l141 0 2024-04-26T12:28:50.370 INFO:tasks.workunit.client.0.smithi046.stdout:7/961: dwrite d16/d27/d7e/fe5 [0,4194304] 0 2024-04-26T12:28:50.372 INFO:tasks.workunit.client.0.smithi046.stdout:7/962: write d16/d35/dac/fd7 [1927457,12309] 0 2024-04-26T12:28:50.373 INFO:tasks.workunit.client.0.smithi046.stdout:2/942: read d1/de/d15/f4e [2405729,99088] 0 2024-04-26T12:28:50.374 INFO:tasks.workunit.client.0.smithi046.stdout:2/943: write d1/de/d2b/fd3 [278646,3180] 0 2024-04-26T12:28:50.375 INFO:tasks.workunit.client.0.smithi046.stdout:2/944: chown d1/de/d65/d1b/f61 115 1 2024-04-26T12:28:50.378 INFO:tasks.workunit.client.0.smithi046.stdout:7/963: dwrite d16/d1a/d31/d55/d6d/fcc [0,4194304] 0 2024-04-26T12:28:50.379 INFO:tasks.workunit.client.0.smithi046.stdout:7/964: fsync d16/d3f/f47 0 2024-04-26T12:28:50.381 INFO:tasks.workunit.client.0.smithi046.stdout:7/965: rename d16/f20 to d16/d1a/d31/d5a/d6b/df2/f142 0 2024-04-26T12:28:50.381 INFO:tasks.workunit.client.0.smithi046.stdout:2/945: dread d1/de/d15/d18/dc1/f128 [0,4194304] 0 2024-04-26T12:28:50.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/948: dread d2/db/d62/fac [0,4194304] 0 2024-04-26T12:28:50.384 INFO:tasks.workunit.client.0.smithi046.stdout:0/999: dread d9/dc/dd/d45/f4e [0,4194304] 0 2024-04-26T12:28:50.387 INFO:tasks.workunit.client.0.smithi046.stdout:7/966: dwrite d16/d3f/f47 [0,4194304] 0 2024-04-26T12:28:50.388 INFO:tasks.workunit.client.0.smithi046.stdout:7/967: fsync d16/d35/f5d 0 2024-04-26T12:28:50.389 INFO:tasks.workunit.client.0.smithi046.stdout:7/968: mknod d16/d3f/d81/c143 0 2024-04-26T12:28:50.389 INFO:tasks.workunit.client.0.smithi046.stdout:1/910: dread d7/d14/d5d/f9a [0,4194304] 0 2024-04-26T12:28:50.390 INFO:tasks.workunit.client.0.smithi046.stdout:7/969: mkdir d16/d4e/d6c/df7/d144 0 2024-04-26T12:28:50.391 INFO:tasks.workunit.client.0.smithi046.stdout:1/911: getdents d7/d12/d89 0 2024-04-26T12:28:50.392 INFO:tasks.workunit.client.0.smithi046.stdout:7/970: truncate d16/d1a/d31/d5a/d6b/df2/f134 33641 0 2024-04-26T12:28:50.393 INFO:tasks.workunit.client.0.smithi046.stdout:4/867: dread d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/f72 [0,4194304] 0 2024-04-26T12:28:50.395 INFO:tasks.workunit.client.0.smithi046.stdout:7/971: rename d16/d1a/c11d to d16/d1a/d31/d4d/c145 0 2024-04-26T12:28:50.395 INFO:tasks.workunit.client.0.smithi046.stdout:4/868: rmdir d0/da/d17/d20/d25/d35/d6d/d19/d53 39 2024-04-26T12:28:50.395 INFO:tasks.workunit.client.0.smithi046.stdout:6/907: dread d7/d1b/d47/d65/d77/d92/fdd [0,4194304] 0 2024-04-26T12:28:50.396 INFO:tasks.workunit.client.0.smithi046.stdout:4/869: write d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/dc0/f100 [847321,9627] 0 2024-04-26T12:28:50.398 INFO:tasks.workunit.client.0.smithi046.stdout:4/870: dread d0/da/d17/d20/d25/d35/d61/fea [0,4194304] 0 2024-04-26T12:28:50.399 INFO:tasks.workunit.client.0.smithi046.stdout:7/972: rename d16/d1a/d31/d5a/d6b/df2/f12d to d16/d27/f146 0 2024-04-26T12:28:50.400 INFO:tasks.workunit.client.0.smithi046.stdout:6/908: dwrite d7/d1b/d6a/f7e [0,4194304] 0 2024-04-26T12:28:50.400 INFO:tasks.workunit.client.0.smithi046.stdout:6/909: chown d7/f29 519 1 2024-04-26T12:28:50.401 INFO:tasks.workunit.client.0.smithi046.stdout:7/973: rmdir d16/d1a/d31/d5a/d6b/df2/ddb 39 2024-04-26T12:28:50.402 INFO:tasks.workunit.client.0.smithi046.stdout:7/974: write d16/d35/f138 [757428,107031] 0 2024-04-26T12:28:50.403 INFO:tasks.workunit.client.0.smithi046.stdout:7/975: symlink d16/d27/l147 0 2024-04-26T12:28:50.404 INFO:tasks.workunit.client.0.smithi046.stdout:1/912: dread d7/db/d98/dc5/d2b/d39/ff2 [0,4194304] 0 2024-04-26T12:28:50.406 INFO:tasks.workunit.client.0.smithi046.stdout:1/913: chown d7/d14/d5d/d6b/dc2/f43 18 1 2024-04-26T12:28:50.406 INFO:tasks.workunit.client.0.smithi046.stdout:4/871: dwrite d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/f90 [0,4194304] 0 2024-04-26T12:28:50.406 INFO:tasks.workunit.client.0.smithi046.stdout:7/976: creat d16/d1a/d31/d55/d6d/f148 x:0 0 0 2024-04-26T12:28:50.406 INFO:tasks.workunit.client.0.smithi046.stdout:7/977: unlink d16/d1a/d69/c84 0 2024-04-26T12:28:50.407 INFO:tasks.workunit.client.0.smithi046.stdout:4/872: getdents d0/da/da1 0 2024-04-26T12:28:50.409 INFO:tasks.workunit.client.0.smithi046.stdout:7/978: truncate d16/d4e/d6c/d9f/f11f 82968 0 2024-04-26T12:28:50.410 INFO:tasks.workunit.client.0.smithi046.stdout:4/873: creat d0/da/d17/d20/d74/f122 x:0 0 0 2024-04-26T12:28:50.410 INFO:tasks.workunit.client.0.smithi046.stdout:7/979: chown d16/d1a/d31/d55/d6d/f148 25679 1 2024-04-26T12:28:50.410 INFO:tasks.workunit.client.0.smithi046.stdout:9/830: sync 2024-04-26T12:28:50.411 INFO:tasks.workunit.client.0.smithi046.stdout:3/949: dread d2/d16/d2c/d50/d71/d89/f9e [0,4194304] 0 2024-04-26T12:28:50.411 INFO:tasks.workunit.client.0.smithi046.stdout:4/874: truncate d0/da/d17/d20/f7f 1410563 0 2024-04-26T12:28:50.411 INFO:tasks.workunit.client.0.smithi046.stdout:7/980: truncate d16/d3f/d81/daa/f132 405586 0 2024-04-26T12:28:50.411 INFO:tasks.workunit.client.0.smithi046.stdout:4/875: dread - d0/d41/f103 zero size 2024-04-26T12:28:50.412 INFO:tasks.workunit.client.0.smithi046.stdout:9/831: rename d0/d2c/dda/d76/d7d/d72/da1 to d0/d2c/dda/d76/d7d/d72/da1/d123 22 2024-04-26T12:28:50.412 INFO:tasks.workunit.client.0.smithi046.stdout:3/950: fdatasync d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/f56 0 2024-04-26T12:28:50.412 INFO:tasks.workunit.client.0.smithi046.stdout:1/914: truncate d7/db/d98/dc5/f11 1003909 0 2024-04-26T12:28:50.412 INFO:tasks.workunit.client.0.smithi046.stdout:7/981: creat d16/d100/f149 x:0 0 0 2024-04-26T12:28:50.413 INFO:tasks.workunit.client.0.smithi046.stdout:7/982: unlink d16/d27/c28 0 2024-04-26T12:28:50.413 INFO:tasks.workunit.client.0.smithi046.stdout:3/951: creat d2/d16/d35/dbc/f146 x:0 0 0 2024-04-26T12:28:50.413 INFO:tasks.workunit.client.0.smithi046.stdout:1/915: write d7/d14/d5d/d6b/d105/f122 [985879,129949] 0 2024-04-26T12:28:50.413 INFO:tasks.workunit.client.0.smithi046.stdout:9/832: write d0/d2c/dda/d76/d7d/d72/da1/df1/ffb [763020,59296] 0 2024-04-26T12:28:50.414 INFO:tasks.workunit.client.0.smithi046.stdout:7/983: rename d16/d4e/d6c/d9f/le0 to d16/db1/l14a 0 2024-04-26T12:28:50.415 INFO:tasks.workunit.client.0.smithi046.stdout:3/952: write d2/d16/d2c/d50/d71/d89/dc5/f75 [689485,103139] 0 2024-04-26T12:28:50.415 INFO:tasks.workunit.client.0.smithi046.stdout:7/984: fdatasync d16/d27/d51/f102 0 2024-04-26T12:28:50.415 INFO:tasks.workunit.client.0.smithi046.stdout:3/953: read - d2/d16/d35/dbc/f146 zero size 2024-04-26T12:28:50.416 INFO:tasks.workunit.client.0.smithi046.stdout:1/916: link d7/d14/d5d/d6b/dc2/d76/f132 d7/db/d98/dc5/d2b/d31/f13a 0 2024-04-26T12:28:50.416 INFO:tasks.workunit.client.0.smithi046.stdout:7/985: truncate d16/d1a/d31/d55/d6d/ff6 542862 0 2024-04-26T12:28:50.417 INFO:tasks.workunit.client.0.smithi046.stdout:1/917: truncate d7/d14/f4f 4705883 0 2024-04-26T12:28:50.418 INFO:tasks.workunit.client.0.smithi046.stdout:3/954: dread d2/d16/d2c/d50/d71/d89/dc5/f4b [0,4194304] 0 2024-04-26T12:28:50.418 INFO:tasks.workunit.client.0.smithi046.stdout:1/918: creat d7/d14/d5d/d32/d41/ded/f13b x:0 0 0 2024-04-26T12:28:50.419 INFO:tasks.workunit.client.0.smithi046.stdout:7/986: creat d16/d1a/d31/d5a/d93/dd9/df9/f14b x:0 0 0 2024-04-26T12:28:50.419 INFO:tasks.workunit.client.0.smithi046.stdout:9/833: dwrite d0/d2c/dda/d76/d7d/faa [0,4194304] 0 2024-04-26T12:28:50.419 INFO:tasks.workunit.client.0.smithi046.stdout:3/955: mkdir d2/d147 0 2024-04-26T12:28:50.419 INFO:tasks.workunit.client.0.smithi046.stdout:7/987: fsync d16/d4e/d6c/fa7 0 2024-04-26T12:28:50.421 INFO:tasks.workunit.client.0.smithi046.stdout:9/834: write d0/d19/feb [3250603,94043] 0 2024-04-26T12:28:50.422 INFO:tasks.workunit.client.0.smithi046.stdout:4/876: truncate d0/f14 1449914 0 2024-04-26T12:28:50.422 INFO:tasks.workunit.client.0.smithi046.stdout:9/835: unlink d0/d2c/dda/d76/d7d/d72/d85/cc3 0 2024-04-26T12:28:50.425 INFO:tasks.workunit.client.0.smithi046.stdout:7/988: dwrite d16/d1a/fde [0,4194304] 0 2024-04-26T12:28:50.425 INFO:tasks.workunit.client.0.smithi046.stdout:4/877: write d0/da/d17/d20/d25/d35/d6d/f10e [3534321,94747] 0 2024-04-26T12:28:50.426 INFO:tasks.workunit.client.0.smithi046.stdout:1/919: dwrite d7/d14/d5d/d6b/fba [0,4194304] 0 2024-04-26T12:28:50.426 INFO:tasks.workunit.client.0.smithi046.stdout:3/956: getdents d2/d16/d2c/d50/d71/d89/dc5/d6d 0 2024-04-26T12:28:50.426 INFO:tasks.workunit.client.0.smithi046.stdout:7/989: mkdir d16/d1a/d31/d14c 0 2024-04-26T12:28:50.428 INFO:tasks.workunit.client.0.smithi046.stdout:6/910: dread d7/d1b/fcb [0,4194304] 0 2024-04-26T12:28:50.429 INFO:tasks.workunit.client.0.smithi046.stdout:7/990: write d16/d1a/d31/d55/d6d/fcc [3907043,113217] 0 2024-04-26T12:28:50.429 INFO:tasks.workunit.client.0.smithi046.stdout:4/878: chown d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/f72 1754249 1 2024-04-26T12:28:50.429 INFO:tasks.workunit.client.0.smithi046.stdout:6/911: chown d7/d1b/d6a/d57/f75 7321629 1 2024-04-26T12:28:50.431 INFO:tasks.workunit.client.0.smithi046.stdout:7/991: stat d16/d1a/d31/d55/d6d/d89/dc7/fe1 0 2024-04-26T12:28:50.431 INFO:tasks.workunit.client.0.smithi046.stdout:9/836: dwrite d0/d19/d21/f4a [8388608,4194304] 0 2024-04-26T12:28:50.431 INFO:tasks.workunit.client.0.smithi046.stdout:1/920: rename d7/d14/d5d/d32/d41/d8f/dd3/de5/d127 to d7/d14/d5d/d13c 0 2024-04-26T12:28:50.434 INFO:tasks.workunit.client.0.smithi046.stdout:9/837: rename d0/d2c/dda/fdc to d0/d29/d69/db5/f124 0 2024-04-26T12:28:50.435 INFO:tasks.workunit.client.0.smithi046.stdout:7/992: mkdir d16/d1a/d31/d5a/d6b/df2/d14d 0 2024-04-26T12:28:50.435 INFO:tasks.workunit.client.0.smithi046.stdout:1/921: creat d7/f13d x:0 0 0 2024-04-26T12:28:50.435 INFO:tasks.workunit.client.0.smithi046.stdout:3/957: write d2/f107 [1598382,99240] 0 2024-04-26T12:28:50.436 INFO:tasks.workunit.client.0.smithi046.stdout:9/838: chown d0/d2c/dda/d76/d7d/d72/d85/fdf 2 1 2024-04-26T12:28:50.437 INFO:tasks.workunit.client.0.smithi046.stdout:1/922: read d7/f9d [250421,25046] 0 2024-04-26T12:28:50.438 INFO:tasks.workunit.client.0.smithi046.stdout:7/993: rename d16/d27/d51/c112 to d16/d1a/d31/d5a/d6b/df2/c14e 0 2024-04-26T12:28:50.438 INFO:tasks.workunit.client.0.smithi046.stdout:3/958: read - d2/d16/d2c/d50/d71/d89/dc5/d6d/f123 zero size 2024-04-26T12:28:50.438 INFO:tasks.workunit.client.0.smithi046.stdout:6/912: dwrite d7/d2b/d31/d4d/f10e [0,4194304] 0 2024-04-26T12:28:50.439 INFO:tasks.workunit.client.0.smithi046.stdout:4/879: dwrite d0/da/d17/d20/d25/d35/dcc/f101 [0,4194304] 0 2024-04-26T12:28:50.440 INFO:tasks.workunit.client.0.smithi046.stdout:3/959: dread - d2/d16/d35/dbc/dc9/fe0 zero size 2024-04-26T12:28:50.440 INFO:tasks.workunit.client.0.smithi046.stdout:7/994: write d16/d27/d7e/f10b [948713,95860] 0 2024-04-26T12:28:50.441 INFO:tasks.workunit.client.0.smithi046.stdout:1/923: rename d7/d14/d5d/d32/d5f/lc4 to d7/d14/d5d/d32/d41/d8f/l13e 0 2024-04-26T12:28:50.441 INFO:tasks.workunit.client.0.smithi046.stdout:6/913: mkdir d7/d1b/d47/d65/da3/de5/d122 0 2024-04-26T12:28:50.441 INFO:tasks.workunit.client.0.smithi046.stdout:7/995: chown d16/d1a/d31/d55 16129 1 2024-04-26T12:28:50.441 INFO:tasks.workunit.client.0.smithi046.stdout:4/880: creat d0/d41/d111/f123 x:0 0 0 2024-04-26T12:28:50.442 INFO:tasks.workunit.client.0.smithi046.stdout:3/960: write d2/db0/dc4/d74/f9f [733282,129583] 0 2024-04-26T12:28:50.443 INFO:tasks.workunit.client.0.smithi046.stdout:7/996: fdatasync d16/d1a/d31/fe7 0 2024-04-26T12:28:50.443 INFO:tasks.workunit.client.0.smithi046.stdout:6/914: write d7/d1b/d47/d65/fc6 [3267988,20172] 0 2024-04-26T12:28:50.443 INFO:tasks.workunit.client.0.smithi046.stdout:4/881: fsync d0/da/d17/d20/d25/d35/d6d/d19/f4a 0 2024-04-26T12:28:50.443 INFO:tasks.workunit.client.0.smithi046.stdout:9/839: dwrite d0/d2c/dbe/dd2/f10d [0,4194304] 0 2024-04-26T12:28:50.443 INFO:tasks.workunit.client.0.smithi046.stdout:6/915: chown d7/fa2 5 1 2024-04-26T12:28:50.444 INFO:tasks.workunit.client.0.smithi046.stdout:7/997: stat d16/d1a/d31/d5a/d93/dd9/df9 0 2024-04-26T12:28:50.444 INFO:tasks.workunit.client.0.smithi046.stdout:6/916: fsync d7/d1b/d47/d65/d77/fb4 0 2024-04-26T12:28:50.445 INFO:tasks.workunit.client.0.smithi046.stdout:1/924: link d7/db/d98/dc5/d2b/d39/d3c/f106 d7/d14/d5d/d6b/dc2/d76/f13f 0 2024-04-26T12:28:50.445 INFO:tasks.workunit.client.0.smithi046.stdout:9/840: write d0/d19/d51/dac/fe0 [62062,44323] 0 2024-04-26T12:28:50.445 INFO:tasks.workunit.client.0.smithi046.stdout:3/961: unlink d2/d16/d2c/d50/d71/d89/dc5/f144 0 2024-04-26T12:28:50.445 INFO:tasks.workunit.client.0.smithi046.stdout:7/998: fsync d16/d3f/d81/daa/f132 0 2024-04-26T12:28:50.445 INFO:tasks.workunit.client.0.smithi046.stdout:6/917: chown d7/d2b/d31/l100 678 1 2024-04-26T12:28:50.446 INFO:tasks.workunit.client.0.smithi046.stdout:9/841: stat d0/d29/d69/db5 0 2024-04-26T12:28:50.446 INFO:tasks.workunit.client.0.smithi046.stdout:4/882: creat d0/da/d17/d20/d25/d35/d6d/d19/d53/f124 x:0 0 0 2024-04-26T12:28:50.447 INFO:tasks.workunit.client.0.smithi046.stdout:6/918: truncate d7/d1b/dee/f111 348606 0 2024-04-26T12:28:50.447 INFO:tasks.workunit.client.0.smithi046.stdout:3/962: sync 2024-04-26T12:28:50.447 INFO:tasks.workunit.client.0.smithi046.stdout:2/946: sync 2024-04-26T12:28:50.448 INFO:tasks.workunit.client.0.smithi046.stdout:4/883: mknod d0/d1/d12/c125 0 2024-04-26T12:28:50.448 INFO:tasks.workunit.client.0.smithi046.stdout:6/919: read - d7/d1b/d47/d65/d77/fec zero size 2024-04-26T12:28:50.449 INFO:tasks.workunit.client.0.smithi046.stdout:9/842: rename d0/d19/d51/l61 to d0/d2c/dda/d76/d7d/d72/da1/dc8/dcd/l125 0 2024-04-26T12:28:50.451 INFO:tasks.workunit.client.0.smithi046.stdout:2/947: mknod d1/de/d15/d18/dc1/db6/dda/d78/c13b 0 2024-04-26T12:28:50.451 INFO:tasks.workunit.client.0.smithi046.stdout:4/884: creat d0/d41/df5/f126 x:0 0 0 2024-04-26T12:28:50.451 INFO:tasks.workunit.client.0.smithi046.stdout:3/963: truncate d2/d16/d35/dbc/dc9/dd3/fd7 1030563 0 2024-04-26T12:28:50.451 INFO:tasks.workunit.client.0.smithi046.stdout:7/999: dwrite d16/d4e/d6c/d9f/f11f [0,4194304] 0 2024-04-26T12:28:50.452 INFO:tasks.workunit.client.0.smithi046.stdout:6/920: rename d7/d1b/c11a to d7/d1b/d47/d65/d77/c123 0 2024-04-26T12:28:50.452 INFO:tasks.workunit.client.0.smithi046.stdout:2/948: fsync d1/de/dc8/f12f 0 2024-04-26T12:28:50.453 INFO:tasks.workunit.client.0.smithi046.stdout:1/925: dwrite d7/f6f [0,4194304] 0 2024-04-26T12:28:50.454 INFO:tasks.workunit.client.0.smithi046.stdout:6/921: write d7/d16/dbc/fe1 [75142,119651] 0 2024-04-26T12:28:50.454 INFO:tasks.workunit.client.0.smithi046.stdout:4/885: fdatasync d0/da/d17/d20/d25/d35/d61/dc6/f10f 0 2024-04-26T12:28:50.454 INFO:tasks.workunit.client.0.smithi046.stdout:3/964: mkdir d2/d16/d35/dbc/dc9/dd0/d148 0 2024-04-26T12:28:50.454 INFO:tasks.workunit.client.0.smithi046.stdout:2/949: creat d1/de/dc8/d116/f13c x:0 0 0 2024-04-26T12:28:50.456 INFO:tasks.workunit.client.0.smithi046.stdout:6/922: creat d7/d1b/d47/d65/d77/f124 x:0 0 0 2024-04-26T12:28:50.456 INFO:tasks.workunit.client.0.smithi046.stdout:1/926: creat d7/d14/d5d/d32/d41/d8f/d114/d11c/f140 x:0 0 0 2024-04-26T12:28:50.457 INFO:tasks.workunit.client.0.smithi046.stdout:3/965: sync 2024-04-26T12:28:50.457 INFO:tasks.workunit.client.0.smithi046.stdout:9/843: dwrite d0/d2c/d3d/f5c [0,4194304] 0 2024-04-26T12:28:50.458 INFO:tasks.workunit.client.0.smithi046.stdout:9/844: readlink d0/d2c/d47/l14 0 2024-04-26T12:28:50.458 INFO:tasks.workunit.client.0.smithi046.stdout:3/966: dread - d2/d16/d2c/d50/f115 zero size 2024-04-26T12:28:50.460 INFO:tasks.workunit.client.0.smithi046.stdout:4/886: dwrite d0/da/d17/d20/fb6 [0,4194304] 0 2024-04-26T12:28:50.460 INFO:tasks.workunit.client.0.smithi046.stdout:3/967: mknod d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/c149 0 2024-04-26T12:28:50.461 INFO:tasks.workunit.client.0.smithi046.stdout:4/887: dread - d0/da/d70/dc7/ff3 zero size 2024-04-26T12:28:50.462 INFO:tasks.workunit.client.0.smithi046.stdout:3/968: symlink d2/db0/dc4/d127/d139/l14a 0 2024-04-26T12:28:50.462 INFO:tasks.workunit.client.0.smithi046.stdout:6/923: dwrite d7/f79 [0,4194304] 0 2024-04-26T12:28:50.462 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:50.461+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:50.463 INFO:tasks.workunit.client.0.smithi046.stdout:6/924: creat d7/da7/f125 x:0 0 0 2024-04-26T12:28:50.464 INFO:tasks.workunit.client.0.smithi046.stdout:6/925: dread - d7/d2b/d31/d10a/f11e zero size 2024-04-26T12:28:50.465 INFO:tasks.workunit.client.0.smithi046.stdout:6/926: creat d7/da7/dd1/dd6/d121/f126 x:0 0 0 2024-04-26T12:28:50.465 INFO:tasks.workunit.client.0.smithi046.stdout:9/845: truncate d0/d2c/d47/f13 2815742 0 2024-04-26T12:28:50.465 INFO:tasks.workunit.client.0.smithi046.stdout:4/888: truncate d0/da/d17/d20/d25/fc9 7209749 0 2024-04-26T12:28:50.466 INFO:tasks.workunit.client.0.smithi046.stdout:9/846: mknod d0/d2c/dbd/c126 0 2024-04-26T12:28:50.466 INFO:tasks.workunit.client.0.smithi046.stdout:6/927: read - d7/d1b/d47/d65/d77/fb4 zero size 2024-04-26T12:28:50.467 INFO:tasks.workunit.client.0.smithi046.stdout:4/889: creat d0/da/d17/d20/f127 x:0 0 0 2024-04-26T12:28:50.467 INFO:tasks.workunit.client.0.smithi046.stdout:6/928: chown l3 435321 1 2024-04-26T12:28:50.468 INFO:tasks.workunit.client.0.smithi046.stdout:6/929: write d7/d2b/d31/d4d/f110 [560125,104036] 0 2024-04-26T12:28:50.468 INFO:tasks.workunit.client.0.smithi046.stdout:4/890: mknod d0/da/d17/d20/d25/d35/dcc/c128 0 2024-04-26T12:28:50.468 INFO:tasks.workunit.client.0.smithi046.stdout:9/847: rename d0/d2c/dda/d76/d7d/d72/da1/dc8/f104 to d0/f127 0 2024-04-26T12:28:50.469 INFO:tasks.workunit.client.0.smithi046.stdout:4/891: creat d0/da/d17/d20/d25/f129 x:0 0 0 2024-04-26T12:28:50.470 INFO:tasks.workunit.client.0.smithi046.stdout:3/969: dwrite d2/d16/d2c/d50/d71/d89/dc5/f81 [0,4194304] 0 2024-04-26T12:28:50.470 INFO:tasks.workunit.client.0.smithi046.stdout:9/848: rename d0/d2c/dda/f6e to d0/d2c/dda/d76/d7d/d72/da1/df1/f128 0 2024-04-26T12:28:50.470 INFO:tasks.workunit.client.0.smithi046.stdout:4/892: write d0/da/da1/f5b [8471373,10598] 0 2024-04-26T12:28:50.471 INFO:tasks.workunit.client.0.smithi046.stdout:9/849: chown d0/d2c/f108 5 1 2024-04-26T12:28:50.473 INFO:tasks.workunit.client.0.smithi046.stdout:9/850: chown d0/d29/l84 247077 1 2024-04-26T12:28:50.473 INFO:tasks.workunit.client.0.smithi046.stdout:4/893: symlink d0/d41/df5/l12a 0 2024-04-26T12:28:50.473 INFO:tasks.workunit.client.0.smithi046.stdout:3/970: link d2/db/d84/d8a/l136 d2/deb/l14b 0 2024-04-26T12:28:50.473 INFO:tasks.workunit.client.0.smithi046.stdout:9/851: creat d0/d2c/dbe/f129 x:0 0 0 2024-04-26T12:28:50.473 INFO:tasks.workunit.client.0.smithi046.stdout:9/852: write d0/f5 [1813699,82500] 0 2024-04-26T12:28:50.474 INFO:tasks.workunit.client.0.smithi046.stdout:3/971: write d2/d16/d2c/d50/d71/d89/d98/fe5 [3213804,117512] 0 2024-04-26T12:28:50.474 INFO:tasks.workunit.client.0.smithi046.stdout:9/853: mknod d0/d29/daf/c12a 0 2024-04-26T12:28:50.474 INFO:tasks.workunit.client.0.smithi046.stdout:3/972: mkdir d2/deb/d14c 0 2024-04-26T12:28:50.475 INFO:tasks.workunit.client.0.smithi046.stdout:9/854: creat d0/d29/d69/f12b x:0 0 0 2024-04-26T12:28:50.476 INFO:tasks.workunit.client.0.smithi046.stdout:3/973: chown d2/db0/dc4/c2f 31 1 2024-04-26T12:28:50.477 INFO:tasks.workunit.client.0.smithi046.stdout:9/855: unlink d0/d2c/dda/d76/d7d/faa 0 2024-04-26T12:28:50.477 INFO:tasks.workunit.client.0.smithi046.stdout:4/894: dwrite d0/d41/f11f [0,4194304] 0 2024-04-26T12:28:50.477 INFO:tasks.workunit.client.0.smithi046.stdout:3/974: mkdir d2/d16/d14d 0 2024-04-26T12:28:50.478 INFO:tasks.workunit.client.0.smithi046.stdout:4/895: rename d0/cac to d0/d1/d5/db/c12b 0 2024-04-26T12:28:50.478 INFO:tasks.workunit.client.0.smithi046.stdout:3/975: rmdir d2/d16/d2c/d50/d71/d89/dc5/d82 39 2024-04-26T12:28:50.479 INFO:tasks.workunit.client.0.smithi046.stdout:3/976: unlink d2/db/d4a/fc8 0 2024-04-26T12:28:50.482 INFO:tasks.workunit.client.0.smithi046.stdout:1/927: dread d7/db/d98/dc5/f11 [0,4194304] 0 2024-04-26T12:28:50.483 INFO:tasks.workunit.client.0.smithi046.stdout:1/928: chown d7/d14/d5d/d32/d41/fbc 3950874 1 2024-04-26T12:28:50.485 INFO:tasks.workunit.client.0.smithi046.stdout:3/977: dwrite d2/db/fa4 [4194304,4194304] 0 2024-04-26T12:28:50.485 INFO:tasks.workunit.client.0.smithi046.stdout:1/929: rmdir d7/d14/d5d/d32/d41/d8f/d114/d123 0 2024-04-26T12:28:50.485 INFO:tasks.workunit.client.0.smithi046.stdout:3/978: stat d2/d16/d2c/d50/d71/d89/dc5/f58 0 2024-04-26T12:28:50.486 INFO:tasks.workunit.client.0.smithi046.stdout:1/930: getdents d7/d14/d5d/d6b/d105 0 2024-04-26T12:28:50.489 INFO:tasks.workunit.client.0.smithi046.stdout:1/931: link d7/db/d98/dc5/d2b/d39/db3/d79/c107 d7/d14/d5d/d32/d41/d8f/dd3/de5/c141 0 2024-04-26T12:28:50.489 INFO:tasks.workunit.client.0.smithi046.stdout:1/932: readlink d7/db/d98/dc5/d2b/d39/d5c/la4 0 2024-04-26T12:28:50.491 INFO:tasks.workunit.client.0.smithi046.stdout:3/979: write d2/db0/dc4/d74/fa7 [1361577,57638] 0 2024-04-26T12:28:50.492 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:50.492 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:50.492 INFO:tasks.workunit.client.0.smithi046.stdout:3/980: truncate d2/db/d84/da5/de6/f13b 819823 0 2024-04-26T12:28:50.494 INFO:tasks.workunit.client.0.smithi046.stdout:3/981: chown d2/d16/d2c/d50/d71/d89/dc5/d82/l94 281974 1 2024-04-26T12:28:50.495 INFO:tasks.workunit.client.0.smithi046.stdout:3/982: creat d2/d16/d2c/d50/f14e x:0 0 0 2024-04-26T12:28:50.496 INFO:tasks.workunit.client.0.smithi046.stdout:9/856: dwrite d0/d2c/dda/d76/d7d/d72/da1/dc8/dcd/fe9 [0,4194304] 0 2024-04-26T12:28:50.497 INFO:tasks.workunit.client.0.smithi046.stdout:3/983: creat d2/d16/d2c/d50/f14f x:0 0 0 2024-04-26T12:28:50.498 INFO:tasks.workunit.client.0.smithi046.stdout:3/984: chown d2/db/dec 10401803 1 2024-04-26T12:28:50.498 INFO:tasks.workunit.client.0.smithi046.stdout:9/857: getdents d0/d2c/dda/d76/d7d/dcc 0 2024-04-26T12:28:50.499 INFO:tasks.workunit.client.0.smithi046.stdout:9/858: readlink d0/d2c/dda/lc1 0 2024-04-26T12:28:50.500 INFO:tasks.workunit.client.0.smithi046.stdout:9/859: mkdir d0/d29/d69/db5/d12c 0 2024-04-26T12:28:50.502 INFO:tasks.workunit.client.0.smithi046.stdout:4/896: dread d0/da/d17/d20/d25/d35/d6d/d19/f4a [0,4194304] 0 2024-04-26T12:28:50.502 INFO:tasks.workunit.client.0.smithi046.stdout:3/985: dwrite d2/d16/f4f [0,4194304] 0 2024-04-26T12:28:50.502 INFO:tasks.workunit.client.0.smithi046.stdout:4/897: sync 2024-04-26T12:28:50.502 INFO:tasks.workunit.client.0.smithi046.stdout:9/860: write d0/d2c/dda/d76/d7d/d72/da1/dc8/dcd/fe9 [4024874,130961] 0 2024-04-26T12:28:50.504 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:50.504 INFO:tasks.workunit.client.0.smithi046.stdout:9/861: rename d0/d19/f50 to d0/d19/d51/dac/ded/f12d 0 2024-04-26T12:28:50.504 INFO:tasks.workunit.client.0.smithi046.stdout:4/898: truncate d0/d1/d5/fc5 425365 0 2024-04-26T12:28:50.505 INFO:tasks.workunit.client.0.smithi046.stdout:4/899: rmdir d0/da/d17/d20/d9c 39 2024-04-26T12:28:50.505 INFO:tasks.workunit.client.0.smithi046.stdout:6/930: dread d7/d1b/d47/d65/d77/d92/fb3 [0,4194304] 0 2024-04-26T12:28:50.506 INFO:tasks.workunit.client.0.smithi046.stdout:4/900: symlink d0/da/dfe/l12c 0 2024-04-26T12:28:50.506 INFO:tasks.workunit.client.0.smithi046.stdout:6/931: write d7/d16/dbc/dda/f106 [676267,73292] 0 2024-04-26T12:28:50.507 INFO:tasks.workunit.client.0.smithi046.stdout:3/986: dwrite d2/d16/f37 [0,4194304] 0 2024-04-26T12:28:50.508 INFO:tasks.workunit.client.0.smithi046.stdout:6/932: unlink d7/d1b/d37/daa/c10b 0 2024-04-26T12:28:50.509 INFO:tasks.workunit.client.0.smithi046.stdout:4/901: creat d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/f12d x:0 0 0 2024-04-26T12:28:50.510 INFO:tasks.workunit.client.0.smithi046.stdout:4/902: write d0/da/d70/dc7/ff3 [283508,83299] 0 2024-04-26T12:28:50.510 INFO:tasks.workunit.client.0.smithi046.stdout:1/933: dread d7/d14/d5d/d32/d41/d8f/dd3/fda [0,4194304] 0 2024-04-26T12:28:50.510 INFO:tasks.workunit.client.0.smithi046.stdout:2/950: dread d1/de/d65/d1b/ff3 [0,4194304] 0 2024-04-26T12:28:50.511 INFO:tasks.workunit.client.0.smithi046.stdout:9/862: read d0/d2c/d47/f67 [1684775,33791] 0 2024-04-26T12:28:50.512 INFO:tasks.workunit.client.0.smithi046.stdout:4/903: write d0/da/d17/d20/d74/f11e [447493,40082] 0 2024-04-26T12:28:50.513 INFO:tasks.workunit.client.0.smithi046.stdout:2/951: chown d1/de/d15/d18/dc1/de3 260 1 2024-04-26T12:28:50.513 INFO:tasks.workunit.client.0.smithi046.stdout:9/863: write d0/d2c/d3d/fb8 [2456586,130458] 0 2024-04-26T12:28:50.513 INFO:tasks.workunit.client.0.smithi046.stdout:6/933: dwrite d7/fe8 [0,4194304] 0 2024-04-26T12:28:50.514 INFO:tasks.workunit.client.0.smithi046.stdout:1/934: rename d7/db/d98/dc5/d2b/d39/f11f to d7/d14/d5d/d6b/d105/f142 0 2024-04-26T12:28:50.514 INFO:tasks.workunit.client.0.smithi046.stdout:2/952: chown d1/de/d15/d18/dc1/d11c 650 1 2024-04-26T12:28:50.514 INFO:tasks.workunit.client.0.smithi046.stdout:4/904: chown d0/da/d17/d20/d25/f129 106929910 1 2024-04-26T12:28:50.514 INFO:tasks.workunit.client.0.smithi046.stdout:6/934: readlink d7/d1b/d6a/l8f 0 2024-04-26T12:28:50.514 INFO:tasks.workunit.client.0.smithi046.stdout:9/864: unlink d0/d29/d69/ca0 0 2024-04-26T12:28:50.515 INFO:tasks.workunit.client.0.smithi046.stdout:4/905: fdatasync d0/da/da1/f113 0 2024-04-26T12:28:50.515 INFO:tasks.workunit.client.0.smithi046.stdout:2/953: symlink d1/de/d67/dc4/l13d 0 2024-04-26T12:28:50.515 INFO:tasks.workunit.client.0.smithi046.stdout:2/954: sync 2024-04-26T12:28:50.516 INFO:tasks.workunit.client.0.smithi046.stdout:6/935: write d7/d1b/d47/d65/f73 [246928,41063] 0 2024-04-26T12:28:50.517 INFO:tasks.workunit.client.0.smithi046.stdout:2/955: chown d1/de/d15/cd4 116962 1 2024-04-26T12:28:50.517 INFO:tasks.workunit.client.0.smithi046.stdout:6/936: chown d7/d1b/d6a/l8f 868522527 1 2024-04-26T12:28:50.517 INFO:tasks.workunit.client.0.smithi046.stdout:4/906: creat d0/d1/d5/db/f12e x:0 0 0 2024-04-26T12:28:50.518 INFO:tasks.workunit.client.0.smithi046.stdout:6/937: creat d7/d1b/d37/d95/def/f127 x:0 0 0 2024-04-26T12:28:50.518 INFO:tasks.workunit.client.0.smithi046.stdout:2/956: getdents d1/de/d65/d4a/d86 0 2024-04-26T12:28:50.518 INFO:tasks.workunit.client.0.smithi046.stdout:4/907: fsync d0/da/d17/d20/d25/fc9 0 2024-04-26T12:28:50.523 INFO:tasks.workunit.client.0.smithi046.stdout:6/938: write d7/d1b/d6a/f93 [408575,91506] 0 2024-04-26T12:28:50.523 INFO:tasks.workunit.client.0.smithi046.stdout:2/957: fdatasync d1/de/da4/fc6 0 2024-04-26T12:28:50.523 INFO:tasks.workunit.client.0.smithi046.stdout:4/908: chown d0/d1/d12/l66 28 1 2024-04-26T12:28:50.523 INFO:tasks.workunit.client.0.smithi046.stdout:6/939: write d7/d1b/d37/daa/de7/fff [155728,99227] 0 2024-04-26T12:28:50.523 INFO:tasks.workunit.client.0.smithi046.stdout:2/958: write d1/de/d65/d8f/fe1 [1763211,14311] 0 2024-04-26T12:28:50.523 INFO:tasks.workunit.client.0.smithi046.stdout:1/935: dwrite d7/db/d98/dc5/d2b/d96/fa6 [0,4194304] 0 2024-04-26T12:28:50.523 INFO:tasks.workunit.client.0.smithi046.stdout:6/940: stat d7/d1b/d47/d65/d77/ldc 0 2024-04-26T12:28:50.523 INFO:tasks.workunit.client.0.smithi046.stdout:6/941: sync 2024-04-26T12:28:50.523 INFO:tasks.workunit.client.0.smithi046.stdout:2/959: chown d1/de/d65/d4a/d58/cdf 255307 1 2024-04-26T12:28:50.523 INFO:tasks.workunit.client.0.smithi046.stdout:2/960: readlink d1/de/d2b/lfe 0 2024-04-26T12:28:50.524 INFO:tasks.workunit.client.0.smithi046.stdout:3/987: dread d2/db/d4a/df0/f113 [0,4194304] 0 2024-04-26T12:28:50.524 INFO:tasks.workunit.client.0.smithi046.stdout:6/942: rename d7/d1b/d47/d65/d77/d92/c115 to d7/d2b/c128 0 2024-04-26T12:28:50.524 INFO:tasks.workunit.client.0.smithi046.stdout:2/961: write d1/de/d15/d18/dc1/db6/dda/d78/f123 [797575,25170] 0 2024-04-26T12:28:50.525 INFO:tasks.workunit.client.0.smithi046.stdout:2/962: symlink d1/de/d15/d18/d8a/l13e 0 2024-04-26T12:28:50.526 INFO:tasks.workunit.client.0.smithi046.stdout:3/988: getdents d2/db/d4a 0 2024-04-26T12:28:50.526 INFO:tasks.workunit.client.0.smithi046.stdout:2/963: read d1/de/d15/f4e [30472,21416] 0 2024-04-26T12:28:50.527 INFO:tasks.workunit.client.0.smithi046.stdout:3/989: rmdir d2/db 39 2024-04-26T12:28:50.528 INFO:tasks.workunit.client.0.smithi046.stdout:2/964: write d1/d42/f7a [1741508,11855] 0 2024-04-26T12:28:50.528 INFO:tasks.workunit.client.0.smithi046.stdout:6/943: dwrite d7/d1b/d47/d65/d77/fec [0,4194304] 0 2024-04-26T12:28:50.528 INFO:tasks.workunit.client.0.smithi046.stdout:3/990: dread - d2/db0/dc4/f122 zero size 2024-04-26T12:28:50.529 INFO:tasks.workunit.client.0.smithi046.stdout:2/965: mkdir d1/d42/d113/dfd/d13f 0 2024-04-26T12:28:50.530 INFO:tasks.workunit.client.0.smithi046.stdout:3/991: truncate d2/db/fe 3758578 0 2024-04-26T12:28:50.530 INFO:tasks.workunit.client.0.smithi046.stdout:6/944: link d7/d1b/d47/d65/d77/ldc d7/d2b/l129 0 2024-04-26T12:28:50.531 INFO:tasks.workunit.client.0.smithi046.stdout:2/966: link d1/de/d65/d1b/l11f d1/de/l140 0 2024-04-26T12:28:50.531 INFO:tasks.workunit.client.0.smithi046.stdout:6/945: dread - d7/d2b/d31/d10a/f11e zero size 2024-04-26T12:28:50.533 INFO:tasks.workunit.client.0.smithi046.stdout:6/946: symlink d7/d1b/d47/d65/d77/l12a 0 2024-04-26T12:28:50.533 INFO:tasks.workunit.client.0.smithi046.stdout:6/947: unlink d7/d2b/l6f 0 2024-04-26T12:28:50.535 INFO:tasks.workunit.client.0.smithi046.stdout:4/909: dread d0/f14 [0,4194304] 0 2024-04-26T12:28:50.535 INFO:tasks.workunit.client.0.smithi046.stdout:6/948: chown d7/d1b/d37/d95/def/f127 832374484 1 2024-04-26T12:28:50.537 INFO:tasks.workunit.client.0.smithi046.stdout:2/967: dwrite d1/de/d15/d18/d12a/d12e/f132 [0,4194304] 0 2024-04-26T12:28:50.537 INFO:tasks.workunit.client.0.smithi046.stdout:3/992: dwrite d2/db/d4a/da9/faf [0,4194304] 0 2024-04-26T12:28:50.538 INFO:tasks.workunit.client.0.smithi046.stdout:2/968: rmdir d1/df2 39 2024-04-26T12:28:50.540 INFO:tasks.workunit.client.0.smithi046.stdout:3/993: creat d2/d16/d2c/d50/d71/d89/d98/dce/f150 x:0 0 0 2024-04-26T12:28:50.540 INFO:tasks.workunit.client.0.smithi046.stdout:2/969: truncate d1/de/d15/f4e 4584480 0 2024-04-26T12:28:50.540 INFO:tasks.workunit.client.0.smithi046.stdout:3/994: stat d2/db/d62/c101 0 2024-04-26T12:28:50.541 INFO:tasks.workunit.client.0.smithi046.stdout:6/949: dread d7/fe8 [0,4194304] 0 2024-04-26T12:28:50.543 INFO:tasks.workunit.client.0.smithi046.stdout:6/950: write d7/d1b/d47/d65/d77/d92/fdd [3855614,81494] 0 2024-04-26T12:28:50.543 INFO:tasks.workunit.client.0.smithi046.stdout:9/865: dread d0/f8a [0,4194304] 0 2024-04-26T12:28:50.545 INFO:tasks.workunit.client.0.smithi046.stdout:6/951: mknod d7/d1b/d37/daa/d114/c12b 0 2024-04-26T12:28:50.545 INFO:tasks.workunit.client.0.smithi046.stdout:2/970: dwrite d1/de/d65/d1b/ff3 [0,4194304] 0 2024-04-26T12:28:50.546 INFO:tasks.workunit.client.0.smithi046.stdout:9/866: mkdir d0/d29/daf/d12e 0 2024-04-26T12:28:50.547 INFO:tasks.workunit.client.0.smithi046.stdout:4/910: read d0/da/d17/d20/d25/d35/d6d/d19/f50 [3330059,31405] 0 2024-04-26T12:28:50.548 INFO:tasks.workunit.client.0.smithi046.stdout:6/952: mkdir d7/d1b/d47/d65/d77/d92/d12c 0 2024-04-26T12:28:50.548 INFO:tasks.workunit.client.0.smithi046.stdout:9/867: chown d0/d2c/dda/d76/d7d/d72/f7f 8271589 1 2024-04-26T12:28:50.548 INFO:tasks.workunit.client.0.smithi046.stdout:6/953: sync 2024-04-26T12:28:50.548 INFO:tasks.workunit.client.0.smithi046.stdout:3/995: dwrite d2/d16/d2c/d50/d71/d89/dc5/d1b/d2d/d7d/fde [0,4194304] 0 2024-04-26T12:28:50.549 INFO:tasks.workunit.client.0.smithi046.stdout:4/911: write d0/da/d17/d20/d25/d35/d6d/f7e [4940607,108528] 0 2024-04-26T12:28:50.552 INFO:tasks.workunit.client.0.smithi046.stdout:9/868: dread d0/f8a [0,4194304] 0 2024-04-26T12:28:50.553 INFO:tasks.workunit.client.0.smithi046.stdout:9/869: truncate d0/d2c/d47/f23 1128703 0 2024-04-26T12:28:50.554 INFO:tasks.workunit.client.0.smithi046.stdout:6/954: dwrite d7/d1b/d6a/d57/ffd [0,4194304] 0 2024-04-26T12:28:50.556 INFO:tasks.workunit.client.0.smithi046.stdout:1/936: dread d7/db/d98/dc5/d2b/d96/f6d [0,4194304] 0 2024-04-26T12:28:50.557 INFO:tasks.workunit.client.0.smithi046.stdout:9/870: getdents d0/d2c/dda/d76/d7d/d72/d85/dea 0 2024-04-26T12:28:50.558 INFO:tasks.workunit.client.0.smithi046.stdout:4/912: dwrite d0/da/d17/d20/d25/d35/d6d/d19/d53/f106 [0,4194304] 0 2024-04-26T12:28:50.558 INFO:tasks.workunit.client.0.smithi046.stdout:1/937: rename d7/db/d98/dc5/f18 to d7/f143 0 2024-04-26T12:28:50.559 INFO:tasks.workunit.client.0.smithi046.stdout:3/996: dwrite d2/db/fe [0,4194304] 0 2024-04-26T12:28:50.559 INFO:tasks.workunit.client.0.smithi046.stdout:4/913: fdatasync d0/da/d70/dc7/fdd 0 2024-04-26T12:28:50.560 INFO:tasks.workunit.client.0.smithi046.stdout:1/938: chown d7/d14/d5d/d32/d41 1 1 2024-04-26T12:28:50.560 INFO:tasks.workunit.client.0.smithi046.stdout:9/871: link d0/d19/d21/c7c d0/d2c/dbe/dd2/c12f 0 2024-04-26T12:28:50.560 INFO:tasks.workunit.client.0.smithi046.stdout:3/997: write d2/db/fe1 [543778,70474] 0 2024-04-26T12:28:50.560 INFO:tasks.workunit.client.0.smithi046.stdout:1/939: stat d7/d14/d5d/d32/fbd 0 2024-04-26T12:28:50.560 INFO:tasks.workunit.client.0.smithi046.stdout:4/914: readlink d0/d64/dd9/ldf 0 2024-04-26T12:28:50.561 INFO:tasks.workunit.client.0.smithi046.stdout:3/998: unlink d2/l3 0 2024-04-26T12:28:50.564 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:50.562+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:50.564 INFO:tasks.workunit.client.0.smithi046.stdout:3/999: write d2/d16/d2c/d50/d71/df6/f11b [1447223,71970] 0 2024-04-26T12:28:50.564 INFO:tasks.workunit.client.0.smithi046.stdout:4/915: rename d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/f118 to d0/da/d17/d20/d25/d35/d6d/f12f 0 2024-04-26T12:28:50.565 INFO:tasks.workunit.client.0.smithi046.stdout:9/872: dwrite d0/d19/d51/f95 [0,4194304] 0 2024-04-26T12:28:50.565 INFO:tasks.workunit.client.0.smithi046.stdout:4/916: rename d0/d1/d12/l66 to d0/da/d21/dcf/l130 0 2024-04-26T12:28:50.566 INFO:tasks.workunit.client.0.smithi046.stdout:9/873: chown d0/d2c/d47/ff 1305568 1 2024-04-26T12:28:50.567 INFO:tasks.workunit.client.0.smithi046.stdout:9/874: write d0/d2c/dbe/f100 [1044418,194] 0 2024-04-26T12:28:50.567 INFO:tasks.workunit.client.0.smithi046.stdout:9/875: sync 2024-04-26T12:28:50.568 INFO:tasks.workunit.client.0.smithi046.stdout:9/876: symlink d0/d2c/dbe/dd2/l130 0 2024-04-26T12:28:50.568 INFO:tasks.workunit.client.0.smithi046.stdout:9/877: write d0/f5 [8154458,31202] 0 2024-04-26T12:28:50.569 INFO:tasks.workunit.client.0.smithi046.stdout:4/917: dwrite d0/da/fd [0,4194304] 0 2024-04-26T12:28:50.570 INFO:tasks.workunit.client.0.smithi046.stdout:9/878: getdents d0/d2c/dda/d76/d7d/d72/d85 0 2024-04-26T12:28:50.571 INFO:tasks.workunit.client.0.smithi046.stdout:9/879: write d0/d2c/dda/d76/d7d/d72/da1/fb2 [1298515,104402] 0 2024-04-26T12:28:50.572 INFO:tasks.workunit.client.0.smithi046.stdout:9/880: creat d0/d29/daf/f131 x:0 0 0 2024-04-26T12:28:50.573 INFO:tasks.workunit.client.0.smithi046.stdout:2/971: read d1/de/dc8/fe4 [194790,35753] 0 2024-04-26T12:28:50.575 INFO:tasks.workunit.client.0.smithi046.stdout:4/918: dwrite d0/da/d17/d20/d25/d35/d6d/d19/d53/f124 [0,4194304] 0 2024-04-26T12:28:50.577 INFO:tasks.workunit.client.0.smithi046.stdout:4/919: dread - d0/da/d17/d20/d25/d35/d6d/d19/d55/f9a zero size 2024-04-26T12:28:50.578 INFO:tasks.workunit.client.0.smithi046.stdout:4/920: creat d0/da/d17/d20/d25/d35/d6d/d19/d53/f131 x:0 0 0 2024-04-26T12:28:50.582 INFO:tasks.workunit.client.0.smithi046.stdout:9/881: dread d0/d2c/f108 [0,4194304] 0 2024-04-26T12:28:50.583 INFO:tasks.workunit.client.0.smithi046.stdout:9/882: symlink d0/d2c/dda/d76/d7d/l132 0 2024-04-26T12:28:50.583 INFO:tasks.workunit.client.0.smithi046.stdout:9/883: fdatasync d0/d2c/d47/f10b 0 2024-04-26T12:28:50.584 INFO:tasks.workunit.client.0.smithi046.stdout:4/921: dwrite d0/d1/d5/db/f8f [4194304,4194304] 0 2024-04-26T12:28:50.584 INFO:tasks.workunit.client.0.smithi046.stdout:9/884: chown d0/d2c/d47/f10b 2342 1 2024-04-26T12:28:50.585 INFO:tasks.workunit.client.0.smithi046.stdout:9/885: dread - d0/d2c/dda/d76/d7d/d72/da1/dc8/d111/f11e zero size 2024-04-26T12:28:50.586 INFO:tasks.workunit.client.0.smithi046.stdout:9/886: chown d0/d2c/dbd/cf0 114054535 1 2024-04-26T12:28:50.587 INFO:tasks.workunit.client.0.smithi046.stdout:9/887: creat d0/d19/d51/dac/ded/f133 x:0 0 0 2024-04-26T12:28:50.593 INFO:tasks.workunit.client.0.smithi046.stdout:4/922: write d0/d64/f6a [613415,73057] 0 2024-04-26T12:28:50.597 INFO:tasks.workunit.client.0.smithi046.stdout:6/955: dread d7/d1b/d37/f42 [0,4194304] 0 2024-04-26T12:28:50.599 INFO:tasks.workunit.client.0.smithi046.stdout:4/923: dwrite d0/da/d21/f83 [0,4194304] 0 2024-04-26T12:28:50.599 INFO:tasks.workunit.client.0.smithi046.stdout:6/956: creat d7/d1b/f12d x:0 0 0 2024-04-26T12:28:50.599 INFO:tasks.workunit.client.0.smithi046.stdout:1/940: dread d7/db/dee/f104 [0,4194304] 0 2024-04-26T12:28:50.599 INFO:tasks.workunit.client.0.smithi046.stdout:6/957: stat d7/d2b/d31/d10a/f11e 0 2024-04-26T12:28:50.599 INFO:tasks.workunit.client.0.smithi046.stdout:4/924: read d0/d1/d5/db/fe7 [356547,80592] 0 2024-04-26T12:28:50.600 INFO:tasks.workunit.client.0.smithi046.stdout:4/925: creat d0/d64/f132 x:0 0 0 2024-04-26T12:28:50.603 INFO:tasks.workunit.client.0.smithi046.stdout:9/888: dread d0/f9a [0,4194304] 0 2024-04-26T12:28:50.604 INFO:tasks.workunit.client.0.smithi046.stdout:4/926: mknod d0/da/d70/c133 0 2024-04-26T12:28:50.605 INFO:tasks.workunit.client.0.smithi046.stdout:2/972: dread d1/de/d65/d4a/d58/f8e [0,4194304] 0 2024-04-26T12:28:50.605 INFO:tasks.workunit.client.0.smithi046.stdout:4/927: dread - d0/d64/dd9/f10a zero size 2024-04-26T12:28:50.606 INFO:tasks.workunit.client.0.smithi046.stdout:2/973: creat d1/de/db1/f141 x:0 0 0 2024-04-26T12:28:50.607 INFO:tasks.workunit.client.0.smithi046.stdout:1/941: dwrite d7/d14/d5d/d6b/dc2/fca [0,4194304] 0 2024-04-26T12:28:50.607 INFO:tasks.workunit.client.0.smithi046.stdout:6/958: dwrite d7/d1b/d47/f7b [0,4194304] 0 2024-04-26T12:28:50.608 INFO:tasks.workunit.client.0.smithi046.stdout:4/928: rename d0/da/fe3 to d0/da/d17/d20/d8e/f134 0 2024-04-26T12:28:50.609 INFO:tasks.workunit.client.0.smithi046.stdout:1/942: creat d7/d14/d5d/d6b/dc2/d76/f144 x:0 0 0 2024-04-26T12:28:50.609 INFO:tasks.workunit.client.0.smithi046.stdout:6/959: mkdir d7/d1b/d37/daa/d114/d12e 0 2024-04-26T12:28:50.609 INFO:tasks.workunit.client.0.smithi046.stdout:4/929: mkdir d0/da/d21/dcf/d135 0 2024-04-26T12:28:50.610 INFO:tasks.workunit.client.0.smithi046.stdout:2/974: link d1/de/d15/d18/d91/fb9 d1/de/d15/d18/dc1/f142 0 2024-04-26T12:28:50.610 INFO:tasks.workunit.client.0.smithi046.stdout:1/943: chown d7/db/d98/dc5/d2b/d96/c78 2175887 1 2024-04-26T12:28:50.610 INFO:tasks.workunit.client.0.smithi046.stdout:4/930: write d0/da/d17/d20/f7a [2023175,108270] 0 2024-04-26T12:28:50.610 INFO:tasks.workunit.client.0.smithi046.stdout:1/944: sync 2024-04-26T12:28:50.611 INFO:tasks.workunit.client.0.smithi046.stdout:2/975: symlink d1/de/dc8/d116/l143 0 2024-04-26T12:28:50.611 INFO:tasks.workunit.client.0.smithi046.stdout:6/960: getdents d7/da7/dd1 0 2024-04-26T12:28:50.611 INFO:tasks.workunit.client.0.smithi046.stdout:6/961: stat d7/d1b/c46 0 2024-04-26T12:28:50.611 INFO:tasks.workunit.client.0.smithi046.stdout:4/931: write d0/d1/f42 [6264202,33026] 0 2024-04-26T12:28:50.611 INFO:tasks.workunit.client.0.smithi046.stdout:1/945: creat d7/d14/d5d/d6b/dc2/f145 x:0 0 0 2024-04-26T12:28:50.612 INFO:tasks.workunit.client.0.smithi046.stdout:2/976: mknod d1/de/d65/d4a/c144 0 2024-04-26T12:28:50.612 INFO:tasks.workunit.client.0.smithi046.stdout:6/962: write d7/d1b/d37/daa/de7/fff [151253,61308] 0 2024-04-26T12:28:50.613 INFO:tasks.workunit.client.0.smithi046.stdout:4/932: creat d0/d1/d5/f136 x:0 0 0 2024-04-26T12:28:50.613 INFO:tasks.workunit.client.0.smithi046.stdout:1/946: chown d7/d14/d5d/d32/d41/ded/f13b 193705283 1 2024-04-26T12:28:50.613 INFO:tasks.workunit.client.0.smithi046.stdout:9/889: read d0/d2c/f9f [50138,24532] 0 2024-04-26T12:28:50.613 INFO:tasks.workunit.client.0.smithi046.stdout:4/933: fdatasync d0/d1/d5/db/f8f 0 2024-04-26T12:28:50.614 INFO:tasks.workunit.client.0.smithi046.stdout:1/947: write d7/d14/d5d/d6b/dc2/d76/f7c [939298,119021] 0 2024-04-26T12:28:50.614 INFO:tasks.workunit.client.0.smithi046.stdout:4/934: read d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/f90 [1056565,22587] 0 2024-04-26T12:28:50.615 INFO:tasks.workunit.client.0.smithi046.stdout:1/948: readlink d7/d14/d5d/d32/d41/l131 0 2024-04-26T12:28:50.615 INFO:tasks.workunit.client.0.smithi046.stdout:2/977: dread d1/de/d65/d4a/d86/fde [0,4194304] 0 2024-04-26T12:28:50.617 INFO:tasks.workunit.client.0.smithi046.stdout:2/978: chown d1/de/d15/d18/dc1/db6/f10f 2229546 1 2024-04-26T12:28:50.617 INFO:tasks.workunit.client.0.smithi046.stdout:1/949: symlink d7/db/d98/dc5/d2b/d31/d82/d95/df9/l146 0 2024-04-26T12:28:50.617 INFO:tasks.workunit.client.0.smithi046.stdout:2/979: chown d1/de/d65/d1b/dca 184 1 2024-04-26T12:28:50.618 INFO:tasks.workunit.client.0.smithi046.stdout:1/950: mknod d7/d14/d5d/d32/d5f/c147 0 2024-04-26T12:28:50.618 INFO:tasks.workunit.client.0.smithi046.stdout:2/980: rmdir d1/de/d65/d8f 39 2024-04-26T12:28:50.618 INFO:tasks.workunit.client.0.smithi046.stdout:2/981: mkdir d1/de/db1/d145 0 2024-04-26T12:28:50.618 INFO:tasks.workunit.client.0.smithi046.stdout:1/951: chown d7/d14/d5d/d32/d41/ded/c128 466 1 2024-04-26T12:28:50.620 INFO:tasks.workunit.client.0.smithi046.stdout:4/935: dread d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/dc0/f100 [0,4194304] 0 2024-04-26T12:28:50.623 INFO:tasks.workunit.client.0.smithi046.stdout:4/936: link d0/da/d70/dc7/fdd d0/da/d17/d20/d9c/f137 0 2024-04-26T12:28:50.623 INFO:tasks.workunit.client.0.smithi046.stdout:4/937: readlink d0/da/d17/d20/d25/l2d 0 2024-04-26T12:28:50.625 INFO:tasks.workunit.client.0.smithi046.stdout:1/952: dwrite d7/db/d98/dc5/d2b/d39/db3/f90 [8388608,4194304] 0 2024-04-26T12:28:50.625 INFO:tasks.workunit.client.0.smithi046.stdout:4/938: truncate d0/da/d17/d20/d9c/f137 546300 0 2024-04-26T12:28:50.627 INFO:tasks.workunit.client.0.smithi046.stdout:1/953: link d7/d14/d5d/d6b/dc2/f54 d7/d14/d5d/d32/d5f/f148 0 2024-04-26T12:28:50.629 INFO:tasks.workunit.client.0.smithi046.stdout:1/954: stat d7/db/d98/dc5/d2b/d39/db3/ff5 0 2024-04-26T12:28:50.629 INFO:tasks.workunit.client.0.smithi046.stdout:9/890: dread d0/f1d [0,4194304] 0 2024-04-26T12:28:50.630 INFO:tasks.workunit.client.0.smithi046.stdout:2/982: dread d1/de/d65/d4a/d86/d96/f118 [0,4194304] 0 2024-04-26T12:28:50.631 INFO:tasks.workunit.client.0.smithi046.stdout:4/939: dwrite d0/d64/f11a [0,4194304] 0 2024-04-26T12:28:50.631 INFO:tasks.workunit.client.0.smithi046.stdout:1/955: fdatasync d7/db/d98/dc5/d2b/d96/fb4 0 2024-04-26T12:28:50.632 INFO:tasks.workunit.client.0.smithi046.stdout:4/940: symlink d0/ddc/l138 0 2024-04-26T12:28:50.632 INFO:tasks.workunit.client.0.smithi046.stdout:2/983: write d1/de/d65/d1b/ff3 [1744368,128266] 0 2024-04-26T12:28:50.632 INFO:tasks.workunit.client.0.smithi046.stdout:1/956: symlink d7/db/d98/dc5/d2b/d31/d82/l149 0 2024-04-26T12:28:50.632 INFO:tasks.workunit.client.0.smithi046.stdout:4/941: unlink d0/da/d70/dc7/c117 0 2024-04-26T12:28:50.633 INFO:tasks.workunit.client.0.smithi046.stdout:4/942: dread - d0/d64/f132 zero size 2024-04-26T12:28:50.634 INFO:tasks.workunit.client.0.smithi046.stdout:1/957: symlink d7/d14/d5d/d32/d41/ded/l14a 0 2024-04-26T12:28:50.634 INFO:tasks.workunit.client.0.smithi046.stdout:6/963: dread d7/d1b/f24 [0,4194304] 0 2024-04-26T12:28:50.636 INFO:tasks.workunit.client.0.smithi046.stdout:1/958: chown d7/db/d98/dc5/d2b/d39/d3c/c5b 172 1 2024-04-26T12:28:50.636 INFO:tasks.workunit.client.0.smithi046.stdout:4/943: fsync d0/da/d17/d20/d25/d35/d6d/d19/d55/f82 0 2024-04-26T12:28:50.636 INFO:tasks.workunit.client.0.smithi046.stdout:6/964: rename d7/da7/dd1/dd6/d121 to d7/d1b/d37/d95/d12f 0 2024-04-26T12:28:50.637 INFO:tasks.workunit.client.0.smithi046.stdout:2/984: dwrite d1/d42/d113/fc3 [0,4194304] 0 2024-04-26T12:28:50.638 INFO:tasks.workunit.client.0.smithi046.stdout:4/944: creat d0/da/d17/d20/d25/d35/f139 x:0 0 0 2024-04-26T12:28:50.638 INFO:tasks.workunit.client.0.smithi046.stdout:2/985: write d1/de/d65/d4a/f59 [3971156,9873] 0 2024-04-26T12:28:50.639 INFO:tasks.workunit.client.0.smithi046.stdout:2/986: write d1/de/db1/f141 [136281,90696] 0 2024-04-26T12:28:50.639 INFO:tasks.workunit.client.0.smithi046.stdout:4/945: write d0/da/d17/d20/d25/d35/fbe [973066,119994] 0 2024-04-26T12:28:50.639 INFO:tasks.workunit.client.0.smithi046.stdout:1/959: truncate d7/db/d98/dc5/d2b/d39/db3/f129 578218 0 2024-04-26T12:28:50.640 INFO:tasks.workunit.client.0.smithi046.stdout:4/946: dread - d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/f79 zero size 2024-04-26T12:28:50.640 INFO:tasks.workunit.client.0.smithi046.stdout:2/987: rename d1/de/d65/d4a/d86/fde to d1/d42/d113/dfd/d13f/f146 0 2024-04-26T12:28:50.641 INFO:tasks.workunit.client.0.smithi046.stdout:2/988: symlink d1/d42/d113/dfd/l147 0 2024-04-26T12:28:50.641 INFO:tasks.workunit.client.0.smithi046.stdout:1/960: fdatasync d7/d14/d5d/d32/d5f/f92 0 2024-04-26T12:28:50.642 INFO:tasks.workunit.client.0.smithi046.stdout:1/961: stat d7/db/d98/dc5/d2b/d31/l34 0 2024-04-26T12:28:50.642 INFO:tasks.workunit.client.0.smithi046.stdout:2/989: rename d1/de/d65/d1b/dca/l10a to d1/d42/d113/l148 0 2024-04-26T12:28:50.643 INFO:tasks.workunit.client.0.smithi046.stdout:1/962: read d7/d12/f36 [318569,72562] 0 2024-04-26T12:28:50.643 INFO:tasks.workunit.client.0.smithi046.stdout:2/990: truncate d1/de/d65/f5d 468287 0 2024-04-26T12:28:50.644 INFO:tasks.workunit.client.0.smithi046.stdout:2/991: stat d1/de/db1/d145 0 2024-04-26T12:28:50.644 INFO:tasks.workunit.client.0.smithi046.stdout:1/963: read - d7/db/d98/dc5/f59 zero size 2024-04-26T12:28:50.645 INFO:tasks.workunit.client.0.smithi046.stdout:2/992: mknod d1/d42/d113/dfd/d13f/c149 0 2024-04-26T12:28:50.645 INFO:tasks.workunit.client.0.smithi046.stdout:1/964: rename d7/d14/d5d/f74 to d7/db/d98/dc5/d2b/d96/f14b 0 2024-04-26T12:28:50.646 INFO:tasks.workunit.client.0.smithi046.stdout:1/965: symlink d7/d14/d5d/d32/l14c 0 2024-04-26T12:28:50.647 INFO:tasks.workunit.client.0.smithi046.stdout:1/966: mkdir d7/db0/dd6/d14d 0 2024-04-26T12:28:50.648 INFO:tasks.workunit.client.0.smithi046.stdout:1/967: symlink d7/d14/d5d/d6b/d105/l14e 0 2024-04-26T12:28:50.649 INFO:tasks.workunit.client.0.smithi046.stdout:4/947: dread d0/d1/f3b [0,4194304] 0 2024-04-26T12:28:50.650 INFO:tasks.workunit.client.0.smithi046.stdout:2/993: dwrite d1/de/d67/dc4/ff9 [0,4194304] 0 2024-04-26T12:28:50.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/968: fsync d7/db/d98/dc5/d2b/d39/ffa 0 2024-04-26T12:28:50.650 INFO:tasks.workunit.client.0.smithi046.stdout:4/948: dread - d0/d1/d5/f136 zero size 2024-04-26T12:28:50.651 INFO:tasks.workunit.client.0.smithi046.stdout:4/949: rmdir d0/d41 39 2024-04-26T12:28:50.651 INFO:tasks.workunit.client.0.smithi046.stdout:2/994: rename d1/de/d65/d4a/c6d to d1/de/d15/d18/dc1/d11c/c14a 0 2024-04-26T12:28:50.653 INFO:tasks.workunit.client.0.smithi046.stdout:1/969: link d7/d14/d5d/d32/d41/d8f/dd3/fda d7/db/f14f 0 2024-04-26T12:28:50.653 INFO:tasks.workunit.client.0.smithi046.stdout:9/891: dread d0/d29/f89 [0,4194304] 0 2024-04-26T12:28:50.653 INFO:tasks.workunit.client.0.smithi046.stdout:1/970: chown d7/d14/d5d/d32/d41/d8f/la5 9 1 2024-04-26T12:28:50.657 INFO:tasks.workunit.client.0.smithi046.stdout:1/971: dread d7/db/d98/dc5/d2b/fe0 [0,4194304] 0 2024-04-26T12:28:50.657 INFO:tasks.workunit.client.0.smithi046.stdout:2/995: readlink d1/de/d65/d4a/d86/l8c 0 2024-04-26T12:28:50.658 INFO:tasks.workunit.client.0.smithi046.stdout:1/972: write d7/db/d98/dc5/d2b/fe0 [215749,19523] 0 2024-04-26T12:28:50.659 INFO:tasks.workunit.client.0.smithi046.stdout:4/950: write d0/da/d70/dc7/fdd [67005,22038] 0 2024-04-26T12:28:50.659 INFO:tasks.workunit.client.0.smithi046.stdout:1/973: mkdir d7/db/d98/dc5/d2b/d39/d150 0 2024-04-26T12:28:50.660 INFO:tasks.workunit.client.0.smithi046.stdout:9/892: dread d0/d2c/dda/d76/d7d/d72/f7f [0,4194304] 0 2024-04-26T12:28:50.660 INFO:tasks.workunit.client.0.smithi046.stdout:9/893: chown d0/d19/d51 1251 1 2024-04-26T12:28:50.660 INFO:tasks.workunit.client.0.smithi046.stdout:1/974: mkdir d7/db/d98/dc5/d2b/d39/d151 0 2024-04-26T12:28:50.661 INFO:tasks.workunit.client.0.smithi046.stdout:6/965: dread d7/f7f [0,4194304] 0 2024-04-26T12:28:50.661 INFO:tasks.workunit.client.0.smithi046.stdout:4/951: dread d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/dc0/f100 [0,4194304] 0 2024-04-26T12:28:50.661 INFO:tasks.workunit.client.0.smithi046.stdout:6/966: fdatasync d7/d2b/d31/f35 0 2024-04-26T12:28:50.661 INFO:tasks.workunit.client.0.smithi046.stdout:1/975: mknod d7/d14/de3/d12f/c152 0 2024-04-26T12:28:50.662 INFO:tasks.workunit.client.0.smithi046.stdout:4/952: readlink d0/da/d21/l95 0 2024-04-26T12:28:50.662 INFO:tasks.workunit.client.0.smithi046.stdout:2/996: truncate d1/de/d65/f56 474039 0 2024-04-26T12:28:50.663 INFO:tasks.workunit.client.0.smithi046.stdout:1/976: mknod d7/db0/c153 0 2024-04-26T12:28:50.663 INFO:tasks.workunit.client.0.smithi046.stdout:4/953: stat d0/d41/d111/f123 0 2024-04-26T12:28:50.663 INFO:tasks.workunit.client.0.smithi046.stdout:2/997: write d1/de/db1/fb2 [1041817,119017] 0 2024-04-26T12:28:50.664 INFO:tasks.workunit.client.0.smithi046.stdout:4/954: unlink d0/da/d17/d20/d25/d35/l89 0 2024-04-26T12:28:50.664 INFO:tasks.workunit.client.0.smithi046.stdout:2/998: chown d1/de/d65/d4a/ca2 45 1 2024-04-26T12:28:50.665 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:50.662+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:50.665 INFO:tasks.workunit.client.0.smithi046.stdout:1/977: creat d7/db/d98/dc5/d2b/d39/f154 x:0 0 0 2024-04-26T12:28:50.665 INFO:tasks.workunit.client.0.smithi046.stdout:6/967: write d7/d1b/d47/d65/da3/de5/ffa [3505901,65338] 0 2024-04-26T12:28:50.665 INFO:tasks.workunit.client.0.smithi046.stdout:9/894: dwrite d0/d19/f2f [0,4194304] 0 2024-04-26T12:28:50.666 INFO:tasks.workunit.client.0.smithi046.stdout:2/999: chown d1/de/d65/d4a/d58/c6b 84716188 1 2024-04-26T12:28:50.666 INFO:tasks.workunit.client.0.smithi046.stdout:4/955: mknod d0/da/d17/d20/d25/d35/c13a 0 2024-04-26T12:28:50.666 INFO:tasks.workunit.client.0.smithi046.stdout:6/968: rmdir d7/d1b/d47/d65/d77 39 2024-04-26T12:28:50.667 INFO:tasks.workunit.client.0.smithi046.stdout:1/978: symlink d7/db/d98/dc5/d2b/d39/l155 0 2024-04-26T12:28:50.667 INFO:tasks.workunit.client.0.smithi046.stdout:1/979: dread - d7/d14/de3/d12f/f138 zero size 2024-04-26T12:28:50.667 INFO:tasks.workunit.client.0.smithi046.stdout:6/969: unlink d7/d2b/d31/l87 0 2024-04-26T12:28:50.667 INFO:tasks.workunit.client.0.smithi046.stdout:4/956: getdents d0/da/d21/df6 0 2024-04-26T12:28:50.668 INFO:tasks.workunit.client.0.smithi046.stdout:9/895: rename d0/d29/c49 to d0/d2c/dda/d76/d7d/c134 0 2024-04-26T12:28:50.668 INFO:tasks.workunit.client.0.smithi046.stdout:6/970: chown d7/d1b/d37/f7d 1449510 1 2024-04-26T12:28:50.668 INFO:tasks.workunit.client.0.smithi046.stdout:1/980: truncate d7/d14/de3/d12f/f138 562663 0 2024-04-26T12:28:50.669 INFO:tasks.workunit.client.0.smithi046.stdout:1/981: stat d7/d14/d5d/lc3 0 2024-04-26T12:28:50.669 INFO:tasks.workunit.client.0.smithi046.stdout:6/971: rmdir d7/d16/dbc/dda 39 2024-04-26T12:28:50.670 INFO:tasks.workunit.client.0.smithi046.stdout:9/896: mknod d0/d2c/dda/d76/d7d/d72/da1/dc8/c135 0 2024-04-26T12:28:50.670 INFO:tasks.workunit.client.0.smithi046.stdout:1/982: readlink d7/db/d98/dc5/d2b/d9f/ld7 0 2024-04-26T12:28:50.670 INFO:tasks.workunit.client.0.smithi046.stdout:9/897: dread - d0/d29/fdb zero size 2024-04-26T12:28:50.671 INFO:tasks.workunit.client.0.smithi046.stdout:1/983: mknod d7/d14/d5d/d6b/c156 0 2024-04-26T12:28:50.672 INFO:tasks.workunit.client.0.smithi046.stdout:1/984: write d7/d14/d5d/d6b/dc2/d76/f144 [124763,74386] 0 2024-04-26T12:28:50.672 INFO:tasks.workunit.client.0.smithi046.stdout:1/985: stat d7/db/d98/fe2 0 2024-04-26T12:28:50.673 INFO:tasks.workunit.client.0.smithi046.stdout:1/986: fsync d7/db/d98/dc5/d2b/d39/d3c/f72 0 2024-04-26T12:28:50.674 INFO:tasks.workunit.client.0.smithi046.stdout:6/972: dwrite d7/d16/dbc/dda/fe9 [0,4194304] 0 2024-04-26T12:28:50.674 INFO:tasks.workunit.client.0.smithi046.stdout:6/973: chown d7/d2b/d31/cd2 1304711 1 2024-04-26T12:28:50.675 INFO:tasks.workunit.client.0.smithi046.stdout:1/987: mkdir d7/db/d98/dc5/d2b/d31/d157 0 2024-04-26T12:28:50.675 INFO:tasks.workunit.client.0.smithi046.stdout:1/988: mkdir d7/d14/d5d/d158 0 2024-04-26T12:28:50.677 INFO:tasks.workunit.client.0.smithi046.stdout:1/989: symlink d7/d14/d5d/d32/d41/d8f/dd3/l159 0 2024-04-26T12:28:50.678 INFO:tasks.workunit.client.0.smithi046.stdout:9/898: write d0/d29/daf/fe4 [48662,120128] 0 2024-04-26T12:28:50.679 INFO:tasks.workunit.client.0.smithi046.stdout:9/899: mkdir d0/d2c/dda/d76/d7d/d72/da1/d136 0 2024-04-26T12:28:50.679 INFO:tasks.workunit.client.0.smithi046.stdout:9/900: fdatasync d0/d2c/fc2 0 2024-04-26T12:28:50.680 INFO:tasks.workunit.client.0.smithi046.stdout:9/901: mknod d0/d2c/dbe/dd2/dff/c137 0 2024-04-26T12:28:50.681 INFO:tasks.workunit.client.0.smithi046.stdout:9/902: dread - d0/d29/d69/db5/f124 zero size 2024-04-26T12:28:50.685 INFO:tasks.workunit.client.0.smithi046.stdout:6/974: dread d7/fa [0,4194304] 0 2024-04-26T12:28:50.686 INFO:tasks.workunit.client.0.smithi046.stdout:1/990: dread d7/d14/d5d/d6b/dc2/f54 [0,4194304] 0 2024-04-26T12:28:50.687 INFO:tasks.workunit.client.0.smithi046.stdout:6/975: write d7/d1b/f4b [701023,4904] 0 2024-04-26T12:28:50.687 INFO:tasks.workunit.client.0.smithi046.stdout:9/903: truncate d0/d29/fd6 4039268 0 2024-04-26T12:28:50.687 INFO:tasks.workunit.client.0.smithi046.stdout:1/991: readlink d7/db/d98/dc5/d2b/d9f/l6e 0 2024-04-26T12:28:50.687 INFO:tasks.workunit.client.0.smithi046.stdout:6/976: write d7/d1b/d6a/d57/f5c [2333768,84890] 0 2024-04-26T12:28:50.687 INFO:tasks.workunit.client.0.smithi046.stdout:9/904: rename d0 to d0/d29/d69/d138 22 2024-04-26T12:28:50.687 INFO:tasks.workunit.client.0.smithi046.stdout:1/992: fdatasync d7/d14/d5d/d32/d41/d8f/d114/f12a 0 2024-04-26T12:28:50.688 INFO:tasks.workunit.client.0.smithi046.stdout:6/977: write d7/d1b/fb6 [798142,65856] 0 2024-04-26T12:28:50.688 INFO:tasks.workunit.client.0.smithi046.stdout:4/957: dread d0/d1/d5/db/f10 [0,4194304] 0 2024-04-26T12:28:50.688 INFO:tasks.workunit.client.0.smithi046.stdout:6/978: unlink d7/d2b/d31/f35 0 2024-04-26T12:28:50.689 INFO:tasks.workunit.client.0.smithi046.stdout:6/979: link d7/da7/daf/lea d7/d1b/d47/d65/l130 0 2024-04-26T12:28:50.690 INFO:tasks.workunit.client.0.smithi046.stdout:6/980: chown d7/d2b/l9f 182707 1 2024-04-26T12:28:50.691 INFO:tasks.workunit.client.0.smithi046.stdout:1/993: write d7/db/d98/dc5/d2b/d31/f13a [237088,64998] 0 2024-04-26T12:28:50.692 INFO:tasks.workunit.client.0.smithi046.stdout:6/981: truncate d7/d2b/d31/d4d/f11b 576129 0 2024-04-26T12:28:50.692 INFO:tasks.workunit.client.0.smithi046.stdout:6/982: stat d7/l7a 0 2024-04-26T12:28:50.692 INFO:tasks.workunit.client.0.smithi046.stdout:4/958: dwrite d0/da/d17/d20/d25/fe0 [0,4194304] 0 2024-04-26T12:28:50.693 INFO:tasks.workunit.client.0.smithi046.stdout:1/994: write d7/d14/d5d/f9a [2127591,66367] 0 2024-04-26T12:28:50.694 INFO:tasks.workunit.client.0.smithi046.stdout:6/983: creat d7/d1b/d47/d65/d77/d92/d12c/f131 x:0 0 0 2024-04-26T12:28:50.695 INFO:tasks.workunit.client.0.smithi046.stdout:1/995: read d7/db/d98/dc5/d2b/d39/d5c/f11e [3374151,6697] 0 2024-04-26T12:28:50.695 INFO:tasks.workunit.client.0.smithi046.stdout:6/984: rename d7/d1b/d47/d65/da3/de5 to d7/d16/dbc/dda/d132 0 2024-04-26T12:28:50.696 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:50.696 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:50.697 INFO:tasks.workunit.client.0.smithi046.stdout:1/996: creat d7/d14/d5d/d32/d41/d8f/f15a x:0 0 0 2024-04-26T12:28:50.697 INFO:tasks.workunit.client.0.smithi046.stdout:6/985: write d7/d1b/f24 [2197005,128355] 0 2024-04-26T12:28:50.697 INFO:tasks.workunit.client.0.smithi046.stdout:1/997: rmdir d7/db/d98/dc5/d2b/d39 39 2024-04-26T12:28:50.698 INFO:tasks.workunit.client.0.smithi046.stdout:6/986: getdents d7/d16 0 2024-04-26T12:28:50.699 INFO:tasks.workunit.client.0.smithi046.stdout:1/998: getdents d7/d14/d5d/d6b 0 2024-04-26T12:28:50.699 INFO:tasks.workunit.client.0.smithi046.stdout:6/987: mkdir d7/d1b/d37/daa/df9/d133 0 2024-04-26T12:28:50.700 INFO:tasks.workunit.client.0.smithi046.stdout:1/999: symlink d7/db/d98/dc5/d2b/d9f/l15b 0 2024-04-26T12:28:50.704 INFO:tasks.workunit.client.0.smithi046.stdout:6/988: truncate d7/f79 2217364 0 2024-04-26T12:28:50.705 INFO:tasks.workunit.client.0.smithi046.stdout:6/989: creat d7/da7/dd1/f134 x:0 0 0 2024-04-26T12:28:50.705 INFO:tasks.workunit.client.0.smithi046.stdout:9/905: dread d0/d2c/dda/d76/d7d/d72/da1/dc8/f64 [0,4194304] 0 2024-04-26T12:28:50.706 INFO:tasks.workunit.client.0.smithi046.stdout:6/990: creat d7/d1b/d37/daa/d114/f135 x:0 0 0 2024-04-26T12:28:50.706 INFO:tasks.workunit.client.0.smithi046.stdout:9/906: write d0/d2c/dda/d76/d7d/d72/da1/fb2 [232782,32942] 0 2024-04-26T12:28:50.706 INFO:tasks.workunit.client.0.smithi046.stdout:9/907: fsync d0/d2c/d3d/f5c 0 2024-04-26T12:28:50.708 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:50.709 INFO:tasks.workunit.client.0.smithi046.stdout:4/959: dread d0/d1/f42 [4194304,4194304] 0 2024-04-26T12:28:50.711 INFO:tasks.workunit.client.0.smithi046.stdout:9/908: dwrite d0/d2c/d3d/f4f [0,4194304] 0 2024-04-26T12:28:50.713 INFO:tasks.workunit.client.0.smithi046.stdout:9/909: write d0/d2c/dda/d76/d7d/d72/da1/dc8/f64 [641478,84065] 0 2024-04-26T12:28:50.714 INFO:tasks.workunit.client.0.smithi046.stdout:4/960: dwrite d0/da/d17/d20/d25/d35/d6d/f7e [4194304,4194304] 0 2024-04-26T12:28:50.715 INFO:tasks.workunit.client.0.smithi046.stdout:9/910: mknod d0/d2c/dda/d76/d7d/d72/da1/d136/c139 0 2024-04-26T12:28:50.715 INFO:tasks.workunit.client.0.smithi046.stdout:9/911: write d0/d2c/d3d/d52/fa6 [815781,125758] 0 2024-04-26T12:28:50.719 INFO:tasks.workunit.client.0.smithi046.stdout:4/961: dwrite d0/da/d17/d20/f7a [0,4194304] 0 2024-04-26T12:28:50.723 INFO:tasks.workunit.client.0.smithi046.stdout:4/962: symlink d0/da/d17/d20/d9c/l13b 0 2024-04-26T12:28:50.723 INFO:tasks.workunit.client.0.smithi046.stdout:4/963: unlink d0/da/d17/d20/d25/d35/c8b 0 2024-04-26T12:28:50.723 INFO:tasks.workunit.client.0.smithi046.stdout:4/964: write d0/da/d17/d20/d9c/f137 [1278425,13805] 0 2024-04-26T12:28:50.726 INFO:tasks.workunit.client.0.smithi046.stdout:4/965: write d0/da/d17/d20/d8e/f98 [3345234,73576] 0 2024-04-26T12:28:50.726 INFO:tasks.workunit.client.0.smithi046.stdout:9/912: dwrite d0/d2c/dda/d76/d7d/dcc/ff3 [0,4194304] 0 2024-04-26T12:28:50.727 INFO:tasks.workunit.client.0.smithi046.stdout:9/913: stat d0/f5 0 2024-04-26T12:28:50.727 INFO:tasks.workunit.client.0.smithi046.stdout:4/966: creat d0/da/d17/d20/d8e/f13c x:0 0 0 2024-04-26T12:28:50.727 INFO:tasks.workunit.client.0.smithi046.stdout:9/914: dread - d0/d29/daf/f119 zero size 2024-04-26T12:28:50.730 INFO:tasks.workunit.client.0.smithi046.stdout:9/915: dwrite d0/d2c/d3d/d52/f5a [4194304,4194304] 0 2024-04-26T12:28:50.730 INFO:tasks.workunit.client.0.smithi046.stdout:6/991: sync 2024-04-26T12:28:50.730 INFO:tasks.workunit.client.0.smithi046.stdout:4/967: sync 2024-04-26T12:28:50.731 INFO:tasks.workunit.client.0.smithi046.stdout:4/968: chown d0/d41/c8a 107051 1 2024-04-26T12:28:50.731 INFO:tasks.workunit.client.0.smithi046.stdout:6/992: mknod d7/d1b/d37/daa/de7/c136 0 2024-04-26T12:28:50.732 INFO:tasks.workunit.client.0.smithi046.stdout:4/969: write d0/d1/f42 [3841996,14268] 0 2024-04-26T12:28:50.732 INFO:tasks.workunit.client.0.smithi046.stdout:4/970: rmdir d0/d41 39 2024-04-26T12:28:50.732 INFO:tasks.workunit.client.0.smithi046.stdout:6/993: write d7/d1b/d37/f7d [2247035,29151] 0 2024-04-26T12:28:50.733 INFO:tasks.workunit.client.0.smithi046.stdout:6/994: symlink d7/d1b/d37/daa/df9/d133/l137 0 2024-04-26T12:28:50.734 INFO:tasks.workunit.client.0.smithi046.stdout:4/971: getdents d0/da/d17/d20/d25/d35/d6d/d19/d53 0 2024-04-26T12:28:50.736 INFO:tasks.workunit.client.0.smithi046.stdout:9/916: dwrite d0/d19/d21/f53 [0,4194304] 0 2024-04-26T12:28:50.738 INFO:tasks.workunit.client.0.smithi046.stdout:6/995: dwrite d7/d1b/fb6 [0,4194304] 0 2024-04-26T12:28:50.739 INFO:tasks.workunit.client.0.smithi046.stdout:6/996: symlink d7/d1b/d37/daa/l138 0 2024-04-26T12:28:50.740 INFO:tasks.workunit.client.0.smithi046.stdout:4/972: sync 2024-04-26T12:28:50.741 INFO:tasks.workunit.client.0.smithi046.stdout:6/997: fdatasync d7/d1b/d47/f7b 0 2024-04-26T12:28:50.741 INFO:tasks.workunit.client.0.smithi046.stdout:9/917: dread d0/d2c/d47/fbf [0,4194304] 0 2024-04-26T12:28:50.741 INFO:tasks.workunit.client.0.smithi046.stdout:4/973: chown d0/d64/ce8 1720451703 1 2024-04-26T12:28:50.742 INFO:tasks.workunit.client.0.smithi046.stdout:4/974: write d0/da/d17/d20/d74/fb5 [1377316,117706] 0 2024-04-26T12:28:50.742 INFO:tasks.workunit.client.0.smithi046.stdout:9/918: mknod d0/d2c/dda/d76/d7d/d72/da1/d136/c13a 0 2024-04-26T12:28:50.743 INFO:tasks.workunit.client.0.smithi046.stdout:4/975: rmdir d0/d1/d12 39 2024-04-26T12:28:50.743 INFO:tasks.workunit.client.0.smithi046.stdout:4/976: dread - d0/ff7 zero size 2024-04-26T12:28:50.744 INFO:tasks.workunit.client.0.smithi046.stdout:9/919: creat d0/d2c/dda/d76/d7d/d72/d85/d97/f13b x:0 0 0 2024-04-26T12:28:50.744 INFO:tasks.workunit.client.0.smithi046.stdout:4/977: dread - d0/da/d17/d20/d8e/f13c zero size 2024-04-26T12:28:50.747 INFO:tasks.workunit.client.0.smithi046.stdout:9/920: dread d0/d2c/dda/d76/d7d/fa5 [0,4194304] 0 2024-04-26T12:28:50.751 INFO:tasks.workunit.client.0.smithi046.stdout:9/921: dwrite d0/d2c/dbe/dd2/f10d [4194304,4194304] 0 2024-04-26T12:28:50.753 INFO:tasks.workunit.client.0.smithi046.stdout:9/922: creat d0/d2c/dda/d76/d7d/d72/f13c x:0 0 0 2024-04-26T12:28:50.758 INFO:tasks.workunit.client.0.smithi046.stdout:9/923: dwrite d0/d2c/d3d/f4f [4194304,4194304] 0 2024-04-26T12:28:50.759 INFO:tasks.workunit.client.0.smithi046.stdout:9/924: creat d0/d29/daf/f13d x:0 0 0 2024-04-26T12:28:50.760 INFO:tasks.workunit.client.0.smithi046.stdout:9/925: truncate d0/d2c/d47/f1f 690544 0 2024-04-26T12:28:50.761 INFO:tasks.workunit.client.0.smithi046.stdout:6/998: dread d7/d1b/d6a/f93 [0,4194304] 0 2024-04-26T12:28:50.761 INFO:tasks.workunit.client.0.smithi046.stdout:9/926: unlink d0/d2c/dda/d76/d7d/d72/d85/ld5 0 2024-04-26T12:28:50.761 INFO:tasks.workunit.client.0.smithi046.stdout:6/999: creat d7/da7/f139 x:0 0 0 2024-04-26T12:28:50.762 INFO:tasks.workunit.client.0.smithi046.stdout:9/927: truncate d0/d29/d69/f77 5236342 0 2024-04-26T12:28:50.763 INFO:tasks.workunit.client.0.smithi046.stdout:9/928: getdents d0/d2c/dda/d76 0 2024-04-26T12:28:50.765 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:50.764+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:50.765 INFO:tasks.workunit.client.0.smithi046.stdout:4/978: dread d0/da/d17/d20/fb6 [0,4194304] 0 2024-04-26T12:28:50.766 INFO:tasks.workunit.client.0.smithi046.stdout:4/979: sync 2024-04-26T12:28:50.767 INFO:tasks.workunit.client.0.smithi046.stdout:9/929: dwrite d0/d2c/d47/f1a [0,4194304] 0 2024-04-26T12:28:50.769 INFO:tasks.workunit.client.0.smithi046.stdout:9/930: read d0/d2c/d47/f23 [299774,104672] 0 2024-04-26T12:28:50.772 INFO:tasks.workunit.client.0.smithi046.stdout:4/980: truncate d0/da/d17/d20/d25/f33 1057403 0 2024-04-26T12:28:50.772 INFO:tasks.workunit.client.0.smithi046.stdout:9/931: dread d0/d19/f103 [0,4194304] 0 2024-04-26T12:28:50.773 INFO:tasks.workunit.client.0.smithi046.stdout:9/932: rename d0/d19/d21 to d0/d2c/dda/d76/d7d/d72/d85/d13e 0 2024-04-26T12:28:50.774 INFO:tasks.workunit.client.0.smithi046.stdout:9/933: dread - d0/d29/d69/db5/f121 zero size 2024-04-26T12:28:50.775 INFO:tasks.workunit.client.0.smithi046.stdout:9/934: getdents d0/d19/d51/dac/ded 0 2024-04-26T12:28:50.775 INFO:tasks.workunit.client.0.smithi046.stdout:9/935: stat d0/d19/d51/dac/ded/f133 0 2024-04-26T12:28:50.776 INFO:tasks.workunit.client.0.smithi046.stdout:9/936: unlink d0/d29/d69/f77 0 2024-04-26T12:28:50.780 INFO:tasks.workunit.client.0.smithi046.stdout:9/937: dwrite d0/d2c/dda/d76/d7d/d72/d85/d97/f13b [0,4194304] 0 2024-04-26T12:28:50.783 INFO:tasks.workunit.client.0.smithi046.stdout:4/981: dwrite d0/da/d17/d20/d74/fa9 [0,4194304] 0 2024-04-26T12:28:50.784 INFO:tasks.workunit.client.0.smithi046.stdout:9/938: write d0/d29/d69/d88/f94 [278325,94342] 0 2024-04-26T12:28:50.785 INFO:tasks.workunit.client.0.smithi046.stdout:4/982: mkdir d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/d13d 0 2024-04-26T12:28:50.786 INFO:tasks.workunit.client.0.smithi046.stdout:4/983: write d0/d1/d5/f136 [928435,41645] 0 2024-04-26T12:28:50.788 INFO:tasks.workunit.client.0.smithi046.stdout:9/939: dwrite d0/d2c/d3d/f5c [0,4194304] 0 2024-04-26T12:28:50.791 INFO:tasks.workunit.client.0.smithi046.stdout:4/984: dwrite d0/da/d17/d20/d25/d35/d6d/f7e [0,4194304] 0 2024-04-26T12:28:50.793 INFO:tasks.workunit.client.0.smithi046.stdout:4/985: chown d0/da/d17/d20/d25/d35/d6d/d19/d55/d91/d7c/f12d 1 1 2024-04-26T12:28:50.794 INFO:tasks.workunit.client.0.smithi046.stdout:9/940: dwrite d0/d2c/dda/d76/d7d/d72/f13c [0,4194304] 0 2024-04-26T12:28:50.794 INFO:tasks.workunit.client.0.smithi046.stdout:4/986: symlink d0/da/d17/d20/l13e 0 2024-04-26T12:28:50.796 INFO:tasks.workunit.client.0.smithi046.stdout:9/941: mknod d0/d2c/dda/c13f 0 2024-04-26T12:28:50.796 INFO:tasks.workunit.client.0.smithi046.stdout:9/942: readlink d0/d2c/lae 0 2024-04-26T12:28:50.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2024-04-26T12:28:50.800 INFO:tasks.workunit.client.0.smithi046.stdout:9/943: write d0/f15 [4208472,50205] 0 2024-04-26T12:28:50.800 INFO:tasks.workunit.client.0.smithi046.stdout:4/987: truncate d0/da/d17/d20/d9c/f137 831737 0 2024-04-26T12:28:50.800 INFO:tasks.workunit.client.0.smithi046.stdout:9/944: mkdir d0/d19/d51/dac/d140 0 2024-04-26T12:28:50.801 INFO:tasks.workunit.client.0.smithi046.stdout:4/988: rename d0/da/d21/l95 to d0/da/dfe/l13f 0 2024-04-26T12:28:50.801 INFO:tasks.workunit.client.0.smithi046.stdout:9/945: mkdir d0/d141 0 2024-04-26T12:28:50.802 INFO:tasks.workunit.client.0.smithi046.stdout:4/989: rmdir d0/da/d17/d20/d25/d35/d6d/d19/d55 39 2024-04-26T12:28:50.802 INFO:tasks.workunit.client.0.smithi046.stdout:9/946: read - d0/d2c/dda/d76/d7d/d72/da1/df1/f128 zero size 2024-04-26T12:28:50.802 INFO:tasks.workunit.client.0.smithi046.stdout:4/990: fsync d0/da/d17/d20/d25/f11b 0 2024-04-26T12:28:50.803 INFO:tasks.workunit.client.0.smithi046.stdout:9/947: creat d0/d2c/dbe/dd2/f142 x:0 0 0 2024-04-26T12:28:50.803 INFO:tasks.workunit.client.0.smithi046.stdout:9/948: dread - d0/d2c/dda/d76/d7d/d72/d85/d97/f117 zero size 2024-04-26T12:28:50.805 INFO:tasks.workunit.client.0.smithi046.stdout:9/949: rename d0/d19/d51/l8e to d0/d2c/dda/l143 0 2024-04-26T12:28:50.805 INFO:tasks.workunit.client.0.smithi046.stdout:9/950: write d0/d2c/d3d/fb8 [4283557,30927] 0 2024-04-26T12:28:50.806 INFO:tasks.workunit.client.0.smithi046.stdout:9/951: link d0/f15 d0/d2c/dbe/dd2/d11b/f144 0 2024-04-26T12:28:50.807 INFO:tasks.workunit.client.0.smithi046.stdout:4/991: dread d0/d1/f87 [0,4194304] 0 2024-04-26T12:28:50.808 INFO:tasks.workunit.client.0.smithi046.stdout:4/992: chown d0/da/d17/d20/d74/fa9 279626 1 2024-04-26T12:28:50.808 INFO:tasks.workunit.client.0.smithi046.stdout:4/993: stat d0/da/d70/c133 0 2024-04-26T12:28:50.809 INFO:tasks.workunit.client.0.smithi046.stdout:9/952: dread d0/d2c/dda/d76/d7d/fa5 [0,4194304] 0 2024-04-26T12:28:50.809 INFO:tasks.workunit.client.0.smithi046.stdout:4/994: rename d0/d1/d12/l40 to d0/d64/dd9/l140 0 2024-04-26T12:28:50.810 INFO:tasks.workunit.client.0.smithi046.stdout:9/953: truncate d0/d2c/d47/f2e 378825 0 2024-04-26T12:28:50.811 INFO:tasks.workunit.client.0.smithi046.stdout:9/954: mkdir d0/d2c/dbe/dc0/d145 0 2024-04-26T12:28:50.812 INFO:tasks.workunit.client.0.smithi046.stdout:9/955: creat d0/d29/d69/f146 x:0 0 0 2024-04-26T12:28:50.812 INFO:tasks.workunit.client.0.smithi046.stdout:4/995: dread d0/d1/d5/fc5 [0,4194304] 0 2024-04-26T12:28:50.812 INFO:tasks.workunit.client.0.smithi046.stdout:4/996: chown d0/da/d17/d20/d25/d35 4761460 1 2024-04-26T12:28:50.813 INFO:tasks.workunit.client.0.smithi046.stdout:9/956: creat d0/d2c/dda/d76/d7d/d72/da1/dc8/f147 x:0 0 0 2024-04-26T12:28:50.813 INFO:tasks.workunit.client.0.smithi046.stdout:9/957: stat d0/d29/d69/db5/f124 0 2024-04-26T12:28:50.814 INFO:tasks.workunit.client.0.smithi046.stdout:4/997: creat d0/da/d17/d20/d25/d35/d6d/d19/d53/f141 x:0 0 0 2024-04-26T12:28:50.814 INFO:tasks.workunit.client.0.smithi046.stdout:4/998: write d0/f99 [3697479,127443] 0 2024-04-26T12:28:50.814 INFO:tasks.workunit.client.0.smithi046.stdout:9/958: write d0/d29/d69/fdd [4655653,5177] 0 2024-04-26T12:28:50.815 INFO:tasks.workunit.client.0.smithi046.stdout:9/959: symlink d0/d29/d69/d88/l148 0 2024-04-26T12:28:50.815 INFO:tasks.workunit.client.0.smithi046.stdout:4/999: mknod d0/da/d17/d20/d25/d35/d6d/d19/d55/c142 0 2024-04-26T12:28:50.817 INFO:tasks.workunit.client.0.smithi046.stdout:9/960: fsync d0/d2c/dda/d76/d7d/f105 0 2024-04-26T12:28:50.818 INFO:tasks.workunit.client.0.smithi046.stdout:9/961: dread - d0/d2c/dda/d76/d7d/d72/da1/df1/f128 zero size 2024-04-26T12:28:50.819 INFO:tasks.workunit.client.0.smithi046.stdout:9/962: symlink d0/d29/daf/d12e/l149 0 2024-04-26T12:28:50.820 INFO:tasks.workunit.client.0.smithi046.stdout:9/963: creat d0/d2c/dda/d76/d7d/d72/d85/d13e/f14a x:0 0 0 2024-04-26T12:28:50.821 INFO:tasks.workunit.client.0.smithi046.stdout:9/964: getdents d0/d19 0 2024-04-26T12:28:50.821 INFO:tasks.workunit.client.0.smithi046.stdout:9/965: unlink d0/d2c/d3d/f4f 0 2024-04-26T12:28:50.821 INFO:tasks.workunit.client.0.smithi046.stdout:9/966: dread - d0/d29/d69/db5/f124 zero size 2024-04-26T12:28:50.825 INFO:tasks.workunit.client.0.smithi046.stdout:9/967: dwrite d0/d2c/f108 [0,4194304] 0 2024-04-26T12:28:50.828 INFO:tasks.workunit.client.0.smithi046.stdout:9/968: rename d0/d2c/dbd/cf7 to d0/d2c/dda/d76/d7d/d72/d85/d13e/c14b 0 2024-04-26T12:28:50.832 INFO:tasks.workunit.client.0.smithi046.stdout:9/969: dwrite d0/d2c/dda/d76/d7d/d72/d85/d13e/f14a [0,4194304] 0 2024-04-26T12:28:50.833 INFO:tasks.workunit.client.0.smithi046.stdout:9/970: truncate d0/d19/f103 899883 0 2024-04-26T12:28:50.833 INFO:tasks.workunit.client.0.smithi046.stdout:9/971: readlink d0/d2c/dbe/dc0/lcf 0 2024-04-26T12:28:50.834 INFO:tasks.workunit.client.0.smithi046.stdout:9/972: mknod d0/db6/c14c 0 2024-04-26T12:28:50.835 INFO:tasks.workunit.client.0.smithi046.stdout:9/973: chown d0/c110 0 1 2024-04-26T12:28:50.836 INFO:tasks.workunit.client.0.smithi046.stdout:9/974: mknod d0/d2c/dda/d76/d7d/d72/da1/dc8/d111/c14d 0 2024-04-26T12:28:50.836 INFO:tasks.workunit.client.0.smithi046.stdout:9/975: rename d0/f5 to d0/d2c/dbe/dc0/d145/f14e 0 2024-04-26T12:28:50.837 INFO:tasks.workunit.client.0.smithi046.stdout:9/976: symlink d0/l14f 0 2024-04-26T12:28:50.837 INFO:tasks.workunit.client.0.smithi046.stdout:9/977: rmdir d0/d2c/dda/d76/d7d 39 2024-04-26T12:28:50.838 INFO:tasks.workunit.client.0.smithi046.stdout:9/978: fsync d0/d2c/dda/d76/d7d/fb0 0 2024-04-26T12:28:50.839 INFO:tasks.workunit.client.0.smithi046.stdout:9/979: unlink d0/d2c/dda/d76/d7d/fad 0 2024-04-26T12:28:50.839 INFO:tasks.workunit.client.0.smithi046.stdout:9/980: fsync d0/d29/fdb 0 2024-04-26T12:28:50.849 INFO:tasks.workunit.client.0.smithi046.stdout:9/981: dread d0/d2c/d47/f67 [0,4194304] 0 2024-04-26T12:28:50.852 INFO:tasks.workunit.client.0.smithi046.stdout:9/982: dwrite d0/d2c/f4e [0,4194304] 0 2024-04-26T12:28:50.853 INFO:tasks.workunit.client.0.smithi046.stdout:9/983: mknod d0/d2c/d3d/d52/c150 0 2024-04-26T12:28:50.856 INFO:tasks.workunit.client.0.smithi046.stdout:9/984: rmdir d0 39 2024-04-26T12:28:50.857 INFO:tasks.workunit.client.0.smithi046.stdout:9/985: symlink d0/d29/d69/db5/d12c/l151 0 2024-04-26T12:28:50.858 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:50.858 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:50.858 INFO:tasks.workunit.client.0.smithi046.stdout:9/986: fsync d0/d2c/dda/d76/d7d/f105 0 2024-04-26T12:28:50.859 INFO:tasks.workunit.client.0.smithi046.stdout:9/987: mknod d0/d2c/dda/d76/d7d/d72/da1/df1/c152 0 2024-04-26T12:28:50.859 INFO:tasks.workunit.client.0.smithi046.stdout:9/988: readlink d0/d2c/dbe/dd2/d11b/le2 0 2024-04-26T12:28:50.862 INFO:tasks.workunit.client.0.smithi046.stdout:9/989: dwrite d0/d19/d51/f95 [0,4194304] 0 2024-04-26T12:28:50.863 INFO:tasks.workunit.client.0.smithi046.stdout:9/990: mkdir d0/d19/d51/d153 0 2024-04-26T12:28:50.865 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:50.864+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:50.869 INFO:tasks.workunit.client.0.smithi046.stdout:9/991: dwrite d0/d2c/dda/d76/f122 [0,4194304] 0 2024-04-26T12:28:50.870 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:50.871 INFO:tasks.workunit.client.0.smithi046.stdout:9/992: unlink d0/d2c/dda/d76/d7d/d72/da1/dc8/dcd/fe9 0 2024-04-26T12:28:50.874 INFO:tasks.workunit.client.0.smithi046.stdout:9/993: read d0/d2c/d47/f1f [673477,34008] 0 2024-04-26T12:28:50.874 INFO:tasks.workunit.client.0.smithi046.stdout:9/994: stat d0/d2c/dda/d76/d7d/d72/da1/dc8/ff8 0 2024-04-26T12:28:50.875 INFO:tasks.workunit.client.0.smithi046.stdout:9/995: mknod d0/d2c/dbe/dc0/c154 0 2024-04-26T12:28:50.878 INFO:tasks.workunit.client.0.smithi046.stdout:9/996: dwrite d0/d2c/d47/f1a [0,4194304] 0 2024-04-26T12:28:50.879 INFO:tasks.workunit.client.0.smithi046.stdout:9/997: mkdir d0/d29/dd8/d155 0 2024-04-26T12:28:50.880 INFO:tasks.workunit.client.0.smithi046.stdout:9/998: read d0/d19/d51/dac/fe5 [20777,53409] 0 2024-04-26T12:28:50.881 INFO:tasks.workunit.client.0.smithi046.stdout:9/999: dread - d0/d29/d69/f12b zero size 2024-04-26T12:28:50.885 INFO:tasks.workunit.client.0.smithi046.stderr:+ rm -rf -- ./tmp.w9w6ARTAD2 2024-04-26T12:28:50.954 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:28:50.966 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:50.966+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:51.007 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:51.008 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:51.018 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:51.067 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:51.066+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:51.153 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:51.153 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:51.165 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:51.167 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:51.166+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:51.268 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:51.267+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:51.302 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:51.302 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:51.315 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:51.369 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:51.368+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:51.441 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:51.442 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:51.451 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:51.495 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:51.494+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:51.571 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:51.569+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:51.578 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:51.578 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:51.588 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:51.672 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:51.671+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:51.695 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:28:51.756 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:51.756 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:51.766 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:51.807 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:51.806+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:51.850 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2024-04-26T12:28:51.869 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:51.874 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:51.872+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:51.892 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:51.893 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:51.893 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:51.893 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:51.895 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:51.896 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:51.899 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:51.899 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:28:51.899 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:51.910 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:51.975 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:51.975+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:52.076 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:52.074+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:52.081 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:52.081 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:52.082 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:52.082 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:52.082 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:52.092 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:52.177 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:52.177+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:52.266 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:52.266 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:52.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:52.266 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:52.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.267 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1668 3.18 3:1e8917d7:::200.0000000e:head [write 3543177~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.267 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:52.267 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3453822349999998, 2024-04-26T12:28:52.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067259575000000002, 2024-04-26T12:28:52.267 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.267 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.267 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:52.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:52.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:52.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919147+0000", 2024-04-26T12:28:52.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.157e-06 2024-04-26T12:28:52.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919151+0000", 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.313e-06 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919154+0000", 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982687+0000", 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063532694000000001 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982750+0000", 2024-04-26T12:28:52.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:28:52.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986254+0000", 2024-04-26T12:28:52.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035043880000000002 2024-04-26T12:28:52.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986322+0000", 2024-04-26T12:28:52.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7458000000000004e-05 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986404+0000", 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2015000000000007e-05 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1669 3.18 3:1e8917d7:::200.0000000e:head [write 3544575~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3453696219999998, 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067362678999999995, 2024-04-26T12:28:52.271 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:52.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:28:52.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919158+0000", 2024-04-26T12:28:52.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.536e-06 2024-04-26T12:28:52.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919161+0000", 2024-04-26T12:28:52.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:28:52.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919164+0000", 2024-04-26T12:28:52.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:28:52.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983465+0000", 2024-04-26T12:28:52.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064301233999999999 2024-04-26T12:28:52.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983515+0000", 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9774000000000002e-05 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986414+0000", 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0028991770000000002 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986455+0000", 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1090000000000001e-05 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986520+0000", 2024-04-26T12:28:52.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4778999999999998e-05 2024-04-26T12:28:52.276 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.276 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.276 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.276 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1670 3.18 3:1e8917d7:::200.0000000e:head [write 3545973~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.276 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:52.276 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3453603459999997, 2024-04-26T12:28:52.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070481470000000004, 2024-04-26T12:28:52.276 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.276 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.276 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:28:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919172+0000", 2024-04-26T12:28:52.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:28:52.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919175+0000", 2024-04-26T12:28:52.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.942e-06 2024-04-26T12:28:52.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919177+0000", 2024-04-26T12:28:52.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5790000000000002e-06 2024-04-26T12:28:52.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983883+0000", 2024-04-26T12:28:52.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064705768999999996 2024-04-26T12:28:52.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983975+0000", 2024-04-26T12:28:52.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2219999999999995e-05 2024-04-26T12:28:52.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989262+0000", 2024-04-26T12:28:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052864940000000001 2024-04-26T12:28:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989361+0000", 2024-04-26T12:28:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9374000000000001e-05 2024-04-26T12:28:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989648+0000", 2024-04-26T12:28:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028677200000000003 2024-04-26T12:28:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.281 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.281 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1671 3.18 3:1e8917d7:::200.0000000e:head [write 3547932~12451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.281 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:52.281 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3440652289999999, 2024-04-26T12:28:52.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069443256999999994, 2024-04-26T12:28:52.281 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.281 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.281 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:52.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:52.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920460+0000", 2024-04-26T12:28:52.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920542+0000", 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650999999999995e-05 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920554+0000", 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2228e-05 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920560+0000", 2024-04-26T12:28:52.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8869999999999997e-06 2024-04-26T12:28:52.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984749+0000", 2024-04-26T12:28:52.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064188913 2024-04-26T12:28:52.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984795+0000", 2024-04-26T12:28:52.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5893000000000003e-05 2024-04-26T12:28:52.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989659+0000", 2024-04-26T12:28:52.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048643669999999996 2024-04-26T12:28:52.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989836+0000", 2024-04-26T12:28:52.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017699799999999999 2024-04-26T12:28:52.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989905+0000", 2024-04-26T12:28:52.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8238000000000006e-05 2024-04-26T12:28:52.285 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.285 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.285 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.286 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1672 3.18 3:1e8917d7:::200.0000000e:head [write 3560383~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.286 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:52.286 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3439615869999999, 2024-04-26T12:28:52.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070651368000000006, 2024-04-26T12:28:52.286 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.286 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.286 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:52.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:52.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:52.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920569+0000", 2024-04-26T12:28:52.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2610000000000004e-06 2024-04-26T12:28:52.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920572+0000", 2024-04-26T12:28:52.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6150000000000001e-06 2024-04-26T12:28:52.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920578+0000", 2024-04-26T12:28:52.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:28:52.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985287+0000", 2024-04-26T12:28:52.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064708946000000003 2024-04-26T12:28:52.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985343+0000", 2024-04-26T12:28:52.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6109000000000001e-05 2024-04-26T12:28:52.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991135+0000", 2024-04-26T12:28:52.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057923430000000001 2024-04-26T12:28:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991163+0000", 2024-04-26T12:28:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7083000000000001e-05 2024-04-26T12:28:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991216+0000", 2024-04-26T12:28:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3854999999999999e-05 2024-04-26T12:28:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1673 3.18 3:1e8917d7:::200.0000000e:head [write 3563148~4730 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3422074569999998, 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068974127999999996, 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922318+0000", 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922327+0000", 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.02e-06 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922336+0000", 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922344+0000", 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5220000000000001e-06 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986575+0000", 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064231885000000002 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986628+0000", 2024-04-26T12:28:52.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.219e-05 2024-04-26T12:28:52.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991222+0000", 2024-04-26T12:28:52.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045942500000000002 2024-04-26T12:28:52.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991245+0000", 2024-04-26T12:28:52.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2764000000000001e-05 2024-04-26T12:28:52.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991293+0000", 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8628999999999998e-05 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:13020 4.10 4:09df41af:::1000000333c.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3412052360000004, 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066586204999999996, 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.295 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:52.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:52.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:52.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:52.296 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 13020 2024-04-26T12:28:52.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.296 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:52.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923320+0000", 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923328+0000", 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3289999999999994e-06 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923340+0000", 2024-04-26T12:28:52.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1891e-05 2024-04-26T12:28:52.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923353+0000", 2024-04-26T12:28:52.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3273e-05 2024-04-26T12:28:52.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986568+0000", 2024-04-26T12:28:52.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063214801000000001 2024-04-26T12:28:52.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986686+0000", 2024-04-26T12:28:52.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118009 2024-04-26T12:28:52.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989908+0000", 2024-04-26T12:28:52.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032213039999999999 2024-04-26T12:28:52.299 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.299 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.299 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.300 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1674 3.18 3:1e8917d7:::200.0000000e:head [write 3567878~12568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.300 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:52.300 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3402724519999998, 2024-04-26T12:28:52.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067102822000000006, 2024-04-26T12:28:52.300 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.300 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.300 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:52.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924253+0000", 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924269+0000", 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:28:52.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924279+0000", 2024-04-26T12:28:52.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0676000000000001e-05 2024-04-26T12:28:52.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924288+0000", 2024-04-26T12:28:52.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4649999999999994e-06 2024-04-26T12:28:52.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987080+0000", 2024-04-26T12:28:52.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062792312000000003 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987132+0000", 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1712999999999998e-05 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991298+0000", 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041660539999999998 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991321+0000", 2024-04-26T12:28:52.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3575e-05 2024-04-26T12:28:52.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991357+0000", 2024-04-26T12:28:52.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5506000000000002e-05 2024-04-26T12:28:52.304 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.304 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.304 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.304 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1675 3.18 3:1e8917d7:::200.0000000e:head [write 3580446~9112 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.304 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:52.304 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3392529089999998, 2024-04-26T12:28:52.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066218224000000006, 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925273+0000", 2024-04-26T12:28:52.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925282+0000", 2024-04-26T12:28:52.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:28:52.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925291+0000", 2024-04-26T12:28:52.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2800000000000003e-06 2024-04-26T12:28:52.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925296+0000", 2024-04-26T12:28:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6080000000000003e-06 2024-04-26T12:28:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987663+0000", 2024-04-26T12:28:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062366705000000001 2024-04-26T12:28:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987729+0000", 2024-04-26T12:28:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6330999999999999e-05 2024-04-26T12:28:52.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991362+0000", 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036322820000000001 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991431+0000", 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9799e-05 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991492+0000", 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0587000000000001e-05 2024-04-26T12:28:52.308 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.309 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.309 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.309 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1676 3.18 3:1e8917d7:::200.0000000e:head [write 3589558~5068 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.309 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:52.309 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3390536730000004, 2024-04-26T12:28:52.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066120133999999997, 2024-04-26T12:28:52.309 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.309 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.309 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:52.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:52.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:52.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925479+0000", 2024-04-26T12:28:52.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.054e-06 2024-04-26T12:28:52.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925489+0000", 2024-04-26T12:28:52.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0847e-05 2024-04-26T12:28:52.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925494+0000", 2024-04-26T12:28:52.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6569999999999996e-06 2024-04-26T12:28:52.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988275+0000", 2024-04-26T12:28:52.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062780582000000001 2024-04-26T12:28:52.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988319+0000", 2024-04-26T12:28:52.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3881999999999998e-05 2024-04-26T12:28:52.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991497+0000", 2024-04-26T12:28:52.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031781520000000001 2024-04-26T12:28:52.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991519+0000", 2024-04-26T12:28:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2382e-05 2024-04-26T12:28:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991593+0000", 2024-04-26T12:28:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3987999999999997e-05 2024-04-26T12:28:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1677 3.18 3:1e8917d7:::200.0000000e:head [write 3594626~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.315 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:52.316 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3386521590000005, 2024-04-26T12:28:52.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065839106999999994, 2024-04-26T12:28:52.316 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.316 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.316 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:52.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:52.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:52.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:52.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925880+0000", 2024-04-26T12:28:52.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:28:52.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925896+0000", 2024-04-26T12:28:52.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5696999999999999e-05 2024-04-26T12:28:52.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925904+0000", 2024-04-26T12:28:52.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9619999999999993e-06 2024-04-26T12:28:52.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988800+0000", 2024-04-26T12:28:52.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062896142000000002 2024-04-26T12:28:52.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988877+0000", 2024-04-26T12:28:52.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7175999999999994e-05 2024-04-26T12:28:52.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991598+0000", 2024-04-26T12:28:52.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027209399999999998 2024-04-26T12:28:52.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991620+0000", 2024-04-26T12:28:52.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2396e-05 2024-04-26T12:28:52.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991714+0000", 2024-04-26T12:28:52.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3213000000000004e-05 2024-04-26T12:28:52.320 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.320 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.320 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.321 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1678 3.18 3:1e8917d7:::200.0000000e:head [write 3597232~4822 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.321 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:52.321 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.337715137, 2024-04-26T12:28:52.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066189707, 2024-04-26T12:28:52.321 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.321 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.321 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:52.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:52.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:52.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:52.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926819+0000", 2024-04-26T12:28:52.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:28:52.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926831+0000", 2024-04-26T12:28:52.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2300000000000001e-05 2024-04-26T12:28:52.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926839+0000", 2024-04-26T12:28:52.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9929999999999995e-06 2024-04-26T12:28:52.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989923+0000", 2024-04-26T12:28:52.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063083319999999998 2024-04-26T12:28:52.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989970+0000", 2024-04-26T12:28:52.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7290000000000003e-05 2024-04-26T12:28:52.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992907+0000", 2024-04-26T12:28:52.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029369740000000002 2024-04-26T12:28:52.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992953+0000", 2024-04-26T12:28:52.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6165000000000003e-05 2024-04-26T12:28:52.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993001+0000", 2024-04-26T12:28:52.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7984e-05 2024-04-26T12:28:52.326 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.326 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.326 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.326 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1679 3.18 3:1e8917d7:::200.0000000e:head [write 3602054~5518 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.326 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:52.326 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3376735489999998, 2024-04-26T12:28:52.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068775656000000004, 2024-04-26T12:28:52.326 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.326 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.327 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:52.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:52.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:52.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926858+0000", 2024-04-26T12:28:52.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7969999999999997e-06 2024-04-26T12:28:52.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926871+0000", 2024-04-26T12:28:52.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2965e-05 2024-04-26T12:28:52.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926878+0000", 2024-04-26T12:28:52.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9369999999999998e-06 2024-04-26T12:28:52.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990409+0000", 2024-04-26T12:28:52.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063531219999999999 2024-04-26T12:28:52.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990537+0000", 2024-04-26T12:28:52.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000127074 2024-04-26T12:28:52.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995467+0000", 2024-04-26T12:28:52.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049307190000000001 2024-04-26T12:28:52.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995519+0000", 2024-04-26T12:28:52.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1638000000000003e-05 2024-04-26T12:28:52.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995629+0000", 2024-04-26T12:28:52.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109852 2024-04-26T12:28:52.330 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.331 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.331 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.331 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1680 3.18 3:1e8917d7:::200.0000000e:head [write 3607572~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.331 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:52.331 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3376380289999998, 2024-04-26T12:28:52.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070113521999999998, 2024-04-26T12:28:52.331 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.331 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.331 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:52.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:52.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926885+0000", 2024-04-26T12:28:52.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999962 2024-04-26T12:28:52.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926893+0000", 2024-04-26T12:28:52.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6299999999999998e-06 2024-04-26T12:28:52.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926899+0000", 2024-04-26T12:28:52.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5359999999999998e-06 2024-04-26T12:28:52.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926906+0000", 2024-04-26T12:28:52.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8349999999999998e-06 2024-04-26T12:28:52.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991747+0000", 2024-04-26T12:28:52.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064841012000000003 2024-04-26T12:28:52.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991834+0000", 2024-04-26T12:28:52.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6602999999999997e-05 2024-04-26T12:28:52.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996894+0000", 2024-04-26T12:28:52.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050608850000000002 2024-04-26T12:28:52.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996954+0000", 2024-04-26T12:28:52.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9598000000000001e-05 2024-04-26T12:28:52.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997002+0000", 2024-04-26T12:28:52.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8050000000000002e-05 2024-04-26T12:28:52.336 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.336 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.336 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.336 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1681 3.18 3:1e8917d7:::200.0000000e:head [write 3609487~2938 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.336 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:52.336 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3375980350000001, 2024-04-26T12:28:52.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070147752999999993, 2024-04-26T12:28:52.336 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.336 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.337 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:52.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:52.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926928+0000", 2024-04-26T12:28:52.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926932+0000", 2024-04-26T12:28:52.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5669999999999999e-06 2024-04-26T12:28:52.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926939+0000", 2024-04-26T12:28:52.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:28:52.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926947+0000", 2024-04-26T12:28:52.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.238e-06 2024-04-26T12:28:52.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992399+0000", 2024-04-26T12:28:52.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065452859000000002 2024-04-26T12:28:52.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992484+0000", 2024-04-26T12:28:52.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4197999999999996e-05 2024-04-26T12:28:52.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997011+0000", 2024-04-26T12:28:52.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045271759999999999 2024-04-26T12:28:52.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997038+0000", 2024-04-26T12:28:52.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7684000000000001e-05 2024-04-26T12:28:52.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997076+0000", 2024-04-26T12:28:52.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7901000000000002e-05 2024-04-26T12:28:52.341 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.341 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.341 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.341 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1682 3.18 3:1e8917d7:::200.0000000e:head [write 3612425~3220 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.342 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:52.342 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3352712029999996, 2024-04-26T12:28:52.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067934001999999993, 2024-04-26T12:28:52.342 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.342 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.342 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:52.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:52.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:52.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:52.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929260+0000", 2024-04-26T12:28:52.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:28:52.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929268+0000", 2024-04-26T12:28:52.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6399999999999997e-06 2024-04-26T12:28:52.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929273+0000", 2024-04-26T12:28:52.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:28:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993049+0000", 2024-04-26T12:28:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063775736999999999 2024-04-26T12:28:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993159+0000", 2024-04-26T12:28:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000110807 2024-04-26T12:28:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997083+0000", 2024-04-26T12:28:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039233769999999996 2024-04-26T12:28:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997126+0000", 2024-04-26T12:28:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3544999999999997e-05 2024-04-26T12:28:52.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997189+0000", 2024-04-26T12:28:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3128999999999998e-05 2024-04-26T12:28:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1683 3.18 3:1e8917d7:::200.0000000e:head [write 3615645~5682 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.347 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3350240920000003, 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067807854000000001, 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929502+0000", 2024-04-26T12:28:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929510+0000", 2024-04-26T12:28:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1179999999999992e-06 2024-04-26T12:28:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929519+0000", 2024-04-26T12:28:52.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2129999999999997e-06 2024-04-26T12:28:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929531+0000", 2024-04-26T12:28:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1615e-05 2024-04-26T12:28:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993765+0000", 2024-04-26T12:28:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064233810000000002 2024-04-26T12:28:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993842+0000", 2024-04-26T12:28:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7645999999999995e-05 2024-04-26T12:28:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997198+0000", 2024-04-26T12:28:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003355977 2024-04-26T12:28:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997249+0000", 2024-04-26T12:28:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0834000000000002e-05 2024-04-26T12:28:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997310+0000", 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1408999999999994e-05 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1684 3.18 3:1e8917d7:::200.0000000e:head [write 3621327~8700 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3327275160000003, 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066650928999999998, 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931798+0000", 2024-04-26T12:28:52.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931809+0000", 2024-04-26T12:28:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0662000000000001e-05 2024-04-26T12:28:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931816+0000", 2024-04-26T12:28:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1590000000000004e-06 2024-04-26T12:28:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931821+0000", 2024-04-26T12:28:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0710000000000002e-06 2024-04-26T12:28:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994486+0000", 2024-04-26T12:28:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062664719999999993 2024-04-26T12:28:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994567+0000", 2024-04-26T12:28:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1138999999999997e-05 2024-04-26T12:28:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998343+0000", 2024-04-26T12:28:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003775769 2024-04-26T12:28:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998387+0000", 2024-04-26T12:28:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4564999999999998e-05 2024-04-26T12:28:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998450+0000", 2024-04-26T12:28:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2589999999999995e-05 2024-04-26T12:28:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.356 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1685 3.18 3:1e8917d7:::200.0000000e:head [write 3630027~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3327006460000002, 2024-04-26T12:28:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066694793000000002, 2024-04-26T12:28:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:52.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931828+0000", 2024-04-26T12:28:52.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:28:52.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931831+0000", 2024-04-26T12:28:52.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.45e-06 2024-04-26T12:28:52.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931835+0000", 2024-04-26T12:28:52.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:52.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995016+0000", 2024-04-26T12:28:52.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063180397999999999 2024-04-26T12:28:52.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995064+0000", 2024-04-26T12:28:52.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8538999999999997e-05 2024-04-26T12:28:52.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998455+0000", 2024-04-26T12:28:52.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033911000000000002 2024-04-26T12:28:52.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998478+0000", 2024-04-26T12:28:52.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2793999999999999e-05 2024-04-26T12:28:52.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998521+0000", 2024-04-26T12:28:52.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2608999999999998e-05 2024-04-26T12:28:52.361 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.361 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.361 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.362 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1687 3.18 3:1e8917d7:::200.0000000e:head [write 3636544~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:52.362 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:52.362 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3314834419999997, 2024-04-26T12:28:52.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068592686, 2024-04-26T12:28:52.362 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:52.362 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.362 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:52.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:52.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:52.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933046+0000", 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0850000000000001e-06 2024-04-26T12:28:52.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:52.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933050+0000", 2024-04-26T12:28:52.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5549999999999996e-06 2024-04-26T12:28:52.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933054+0000", 2024-04-26T12:28:52.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:28:52.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:52.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996223+0000", 2024-04-26T12:28:52.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063169004000000001 2024-04-26T12:28:52.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:52.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996307+0000", 2024-04-26T12:28:52.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3660999999999997e-05 2024-04-26T12:28:52.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:52.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001540+0000", 2024-04-26T12:28:52.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052334160000000003 2024-04-26T12:28:52.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:52.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001573+0000", 2024-04-26T12:28:52.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2981999999999997e-05 2024-04-26T12:28:52.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:52.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:52.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:52.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001636+0000", 2024-04-26T12:28:52.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2601999999999995e-05 2024-04-26T12:28:52.366 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.366 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.366 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.366 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:52.366 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:52.366 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:52.369 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:52.370 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:52.367+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:52.468 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:52.467+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:52.497 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:52.498 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:52.498 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:52.498 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:52.507 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:52.569 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:52.568+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:52.670 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:52.669+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:52.680 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:52.680 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:52.681 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:52.681 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:52.691 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:52.771 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:52.770+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:52.827 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:52.827 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:52.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:52.827 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:52.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.827 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:293 3.13 3:ceffbd45:::200.0000000a:head [write 594763~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.827 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:52.828 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9001741560000003, 2024-04-26T12:28:52.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038803585000000002, 2024-04-26T12:28:52.828 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.828 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.828 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:52.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:52.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924874+0000", 2024-04-26T12:28:52.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924877+0000", 2024-04-26T12:28:52.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7329999999999999e-06 2024-04-26T12:28:52.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924884+0000", 2024-04-26T12:28:52.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:28:52.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924890+0000", 2024-04-26T12:28:52.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:28:52.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958764+0000", 2024-04-26T12:28:52.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.033873863999999997 2024-04-26T12:28:52.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958855+0000", 2024-04-26T12:28:52.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1402000000000003e-05 2024-04-26T12:28:52.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963608+0000", 2024-04-26T12:28:52.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047529039999999996 2024-04-26T12:28:52.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963636+0000", 2024-04-26T12:28:52.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8194000000000001e-05 2024-04-26T12:28:52.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963678+0000", 2024-04-26T12:28:52.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2095999999999998e-05 2024-04-26T12:28:52.833 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.834 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.834 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.834 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:294 3.13 3:ceffbd45:::200.0000000a:head [write 596172~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.834 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:52.834 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9001294120000001, 2024-04-26T12:28:52.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041225228000000003, 2024-04-26T12:28:52.834 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.834 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.835 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:52.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:52.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924919+0000", 2024-04-26T12:28:52.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924922+0000", 2024-04-26T12:28:52.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9160000000000001e-06 2024-04-26T12:28:52.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924928+0000", 2024-04-26T12:28:52.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3929999999999996e-06 2024-04-26T12:28:52.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924933+0000", 2024-04-26T12:28:52.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7820000000000001e-06 2024-04-26T12:28:52.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959359+0000", 2024-04-26T12:28:52.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034425782000000002 2024-04-26T12:28:52.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959439+0000", 2024-04-26T12:28:52.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0275e-05 2024-04-26T12:28:52.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966079+0000", 2024-04-26T12:28:52.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0066397089999999997 2024-04-26T12:28:52.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966106+0000", 2024-04-26T12:28:52.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7178e-05 2024-04-26T12:28:52.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966145+0000", 2024-04-26T12:28:52.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8618999999999997e-05 2024-04-26T12:28:52.840 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.841 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.841 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.841 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:295 3.13 3:ceffbd45:::200.0000000a:head [write 597574~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.841 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:52.841 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.900103262, 2024-04-26T12:28:52.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041258571000000001, 2024-04-26T12:28:52.842 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.842 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.842 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:52.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:52.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924945+0000", 2024-04-26T12:28:52.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924948+0000", 2024-04-26T12:28:52.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:28:52.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924955+0000", 2024-04-26T12:28:52.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4629999999999998e-06 2024-04-26T12:28:52.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924959+0000", 2024-04-26T12:28:52.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2719999999999999e-06 2024-04-26T12:28:52.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959957+0000", 2024-04-26T12:28:52.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034997588000000003 2024-04-26T12:28:52.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960042+0000", 2024-04-26T12:28:52.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5811999999999998e-05 2024-04-26T12:28:52.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966149+0000", 2024-04-26T12:28:52.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061071650000000003 2024-04-26T12:28:52.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966171+0000", 2024-04-26T12:28:52.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1905000000000001e-05 2024-04-26T12:28:52.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966204+0000", 2024-04-26T12:28:52.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2845999999999997e-05 2024-04-26T12:28:52.850 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.850 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.850 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.850 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:296 3.13 3:ceffbd45:::200.0000000a:head [write 598977~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.851 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:52.851 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9000716319999995, 2024-04-26T12:28:52.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041282538000000001, 2024-04-26T12:28:52.851 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.851 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.851 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:52.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:52.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:52.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:52.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924979+0000", 2024-04-26T12:28:52.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3609999999999999e-06 2024-04-26T12:28:52.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924984+0000", 2024-04-26T12:28:52.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3259999999999997e-06 2024-04-26T12:28:52.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924987+0000", 2024-04-26T12:28:52.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7810000000000001e-06 2024-04-26T12:28:52.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960618+0000", 2024-04-26T12:28:52.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035631875 2024-04-26T12:28:52.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960698+0000", 2024-04-26T12:28:52.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9373000000000001e-05 2024-04-26T12:28:52.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966208+0000", 2024-04-26T12:28:52.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055104359999999996 2024-04-26T12:28:52.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966228+0000", 2024-04-26T12:28:52.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0208e-05 2024-04-26T12:28:52.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966260+0000", 2024-04-26T12:28:52.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1404e-05 2024-04-26T12:28:52.856 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.856 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.856 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.856 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:297 3.13 3:ceffbd45:::200.0000000a:head [write 600380~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.856 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:52.856 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9000347980000001, 2024-04-26T12:28:52.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041309850000000002, 2024-04-26T12:28:52.856 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.857 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.857 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:52.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:52.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:52.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925017+0000", 2024-04-26T12:28:52.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.96e-06 2024-04-26T12:28:52.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925020+0000", 2024-04-26T12:28:52.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6629999999999999e-06 2024-04-26T12:28:52.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925023+0000", 2024-04-26T12:28:52.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:28:52.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961241+0000", 2024-04-26T12:28:52.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036217390000000002 2024-04-26T12:28:52.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961335+0000", 2024-04-26T12:28:52.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4537000000000006e-05 2024-04-26T12:28:52.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966264+0000", 2024-04-26T12:28:52.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004928516 2024-04-26T12:28:52.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966290+0000", 2024-04-26T12:28:52.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5658999999999999e-05 2024-04-26T12:28:52.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966324+0000", 2024-04-26T12:28:52.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4459000000000003e-05 2024-04-26T12:28:52.862 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.862 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.862 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.862 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:298 3.13 3:ceffbd45:::200.0000000a:head [write 602634~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.862 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:52.862 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.9000022029999997, 2024-04-26T12:28:52.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046387536, 2024-04-26T12:28:52.863 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.863 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.863 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:52.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:52.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925046+0000", 2024-04-26T12:28:52.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:52.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925049+0000", 2024-04-26T12:28:52.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4770000000000002e-06 2024-04-26T12:28:52.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925057+0000", 2024-04-26T12:28:52.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9219999999999997e-06 2024-04-26T12:28:52.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925062+0000", 2024-04-26T12:28:52.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:28:52.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961918+0000", 2024-04-26T12:28:52.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036856170000000001 2024-04-26T12:28:52.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962014+0000", 2024-04-26T12:28:52.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6731999999999995e-05 2024-04-26T12:28:52.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971360+0000", 2024-04-26T12:28:52.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0093454569999999997 2024-04-26T12:28:52.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971393+0000", 2024-04-26T12:28:52.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3130999999999998e-05 2024-04-26T12:28:52.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971434+0000", 2024-04-26T12:28:52.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1244e-05 2024-04-26T12:28:52.868 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.868 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.868 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.868 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:299 3.13 3:ceffbd45:::200.0000000a:head [write 604033~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.868 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:52.868 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8999483720000008, 2024-04-26T12:28:52.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046395615000000001, 2024-04-26T12:28:52.868 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.869 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.869 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:52.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:52.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925100+0000", 2024-04-26T12:28:52.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925103+0000", 2024-04-26T12:28:52.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3520000000000001e-06 2024-04-26T12:28:52.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925108+0000", 2024-04-26T12:28:52.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6489999999999996e-06 2024-04-26T12:28:52.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925111+0000", 2024-04-26T12:28:52.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.79e-06 2024-04-26T12:28:52.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962405+0000", 2024-04-26T12:28:52.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037293953999999997 2024-04-26T12:28:52.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962457+0000", 2024-04-26T12:28:52.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2003000000000003e-05 2024-04-26T12:28:52.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971440+0000", 2024-04-26T12:28:52.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0089831719999999993 2024-04-26T12:28:52.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971463+0000", 2024-04-26T12:28:52.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3201e-05 2024-04-26T12:28:52.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971496+0000", 2024-04-26T12:28:52.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2836000000000002e-05 2024-04-26T12:28:52.875 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.875 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.875 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.875 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:300 3.13 3:ceffbd45:::200.0000000a:head [write 605436~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.875 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:52.875 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.899884514, 2024-04-26T12:28:52.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046389606999999999, 2024-04-26T12:28:52.876 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.876 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.876 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:52.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:52.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:52.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925167+0000", 2024-04-26T12:28:52.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8870000000000001e-06 2024-04-26T12:28:52.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925171+0000", 2024-04-26T12:28:52.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6049999999999998e-06 2024-04-26T12:28:52.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925173+0000", 2024-04-26T12:28:52.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8250000000000001e-06 2024-04-26T12:28:52.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962740+0000", 2024-04-26T12:28:52.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037566436000000002 2024-04-26T12:28:52.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962818+0000", 2024-04-26T12:28:52.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8231000000000004e-05 2024-04-26T12:28:52.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971501+0000", 2024-04-26T12:28:52.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008682525 2024-04-26T12:28:52.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971522+0000", 2024-04-26T12:28:52.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1673999999999999e-05 2024-04-26T12:28:52.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971554+0000", 2024-04-26T12:28:52.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1786999999999999e-05 2024-04-26T12:28:52.882 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.882 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.882 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.883 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:301 3.13 3:ceffbd45:::200.0000000a:head [write 606838~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.883 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:52.883 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8998679060000008, 2024-04-26T12:28:52.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046429455000000001, 2024-04-26T12:28:52.883 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.883 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.883 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:52.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:52.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:52.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:52.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925183+0000", 2024-04-26T12:28:52.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0150000000000002e-06 2024-04-26T12:28:52.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925186+0000", 2024-04-26T12:28:52.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2210000000000002e-06 2024-04-26T12:28:52.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925190+0000", 2024-04-26T12:28:52.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8489999999999999e-06 2024-04-26T12:28:52.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963304+0000", 2024-04-26T12:28:52.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038114207999999997 2024-04-26T12:28:52.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963356+0000", 2024-04-26T12:28:52.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1628000000000001e-05 2024-04-26T12:28:52.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971558+0000", 2024-04-26T12:28:52.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082025199999999996 2024-04-26T12:28:52.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971579+0000", 2024-04-26T12:28:52.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1019e-05 2024-04-26T12:28:52.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971610+0000", 2024-04-26T12:28:52.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1205999999999999e-05 2024-04-26T12:28:52.889 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.889 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.889 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.889 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:302 3.13 3:ceffbd45:::200.0000000a:head [write 608236~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.889 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:52.890 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8998467130000005, 2024-04-26T12:28:52.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046464057000000003, 2024-04-26T12:28:52.890 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.890 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.890 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:52.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:52.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:52.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925204+0000", 2024-04-26T12:28:52.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1270000000000001e-06 2024-04-26T12:28:52.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925207+0000", 2024-04-26T12:28:52.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3720000000000001e-06 2024-04-26T12:28:52.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925210+0000", 2024-04-26T12:28:52.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7489999999999999e-06 2024-04-26T12:28:52.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963713+0000", 2024-04-26T12:28:52.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038502508999999997 2024-04-26T12:28:52.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963792+0000", 2024-04-26T12:28:52.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9087999999999999e-05 2024-04-26T12:28:52.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971615+0000", 2024-04-26T12:28:52.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078230130000000002 2024-04-26T12:28:52.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971636+0000", 2024-04-26T12:28:52.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0996999999999999e-05 2024-04-26T12:28:52.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971666+0000", 2024-04-26T12:28:52.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0443999999999999e-05 2024-04-26T12:28:52.895 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.895 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.895 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.895 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:303 3.13 3:ceffbd45:::200.0000000a:head [write 609649~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.896 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:52.896 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8998036920000008, 2024-04-26T12:28:52.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.047363031, 2024-04-26T12:28:52.896 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.896 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.896 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:52.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:52.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:52.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925253+0000", 2024-04-26T12:28:52.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0369999999999995e-06 2024-04-26T12:28:52.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925261+0000", 2024-04-26T12:28:52.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7420000000000003e-06 2024-04-26T12:28:52.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925271+0000", 2024-04-26T12:28:52.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1589999999999999e-06 2024-04-26T12:28:52.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964198+0000", 2024-04-26T12:28:52.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038927182999999997 2024-04-26T12:28:52.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964281+0000", 2024-04-26T12:28:52.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3355000000000004e-05 2024-04-26T12:28:52.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972542+0000", 2024-04-26T12:28:52.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082607930000000006 2024-04-26T12:28:52.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972570+0000", 2024-04-26T12:28:52.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7937999999999999e-05 2024-04-26T12:28:52.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972608+0000", 2024-04-26T12:28:52.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8384999999999999e-05 2024-04-26T12:28:52.901 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.902 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.902 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.902 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:304 3.13 3:ceffbd45:::200.0000000a:head [write 611057~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.902 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:52.902 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8986380629999999, 2024-04-26T12:28:52.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046259867000000003, 2024-04-26T12:28:52.902 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.902 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.903 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:52.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:52.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926410+0000", 2024-04-26T12:28:52.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926415+0000", 2024-04-26T12:28:52.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7999999999999998e-06 2024-04-26T12:28:52.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926423+0000", 2024-04-26T12:28:52.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8569999999999995e-06 2024-04-26T12:28:52.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926429+0000", 2024-04-26T12:28:52.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.421e-06 2024-04-26T12:28:52.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964778+0000", 2024-04-26T12:28:52.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038349045999999998 2024-04-26T12:28:52.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964830+0000", 2024-04-26T12:28:52.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1309e-05 2024-04-26T12:28:52.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972614+0000", 2024-04-26T12:28:52.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077847070000000001 2024-04-26T12:28:52.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972638+0000", 2024-04-26T12:28:52.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3388999999999999e-05 2024-04-26T12:28:52.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972671+0000", 2024-04-26T12:28:52.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2999e-05 2024-04-26T12:28:52.908 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.908 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.908 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.908 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:305 3.13 3:ceffbd45:::200.0000000a:head [write 613824~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.908 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:52.909 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8985930240000002, 2024-04-26T12:28:52.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046273460000000002, 2024-04-26T12:28:52.909 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.909 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.909 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:52.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:52.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:52.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926463+0000", 2024-04-26T12:28:52.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:28:52.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926467+0000", 2024-04-26T12:28:52.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3000000000000003e-06 2024-04-26T12:28:52.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926470+0000", 2024-04-26T12:28:52.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1930000000000002e-06 2024-04-26T12:28:52.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965122+0000", 2024-04-26T12:28:52.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038652207000000001 2024-04-26T12:28:52.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965210+0000", 2024-04-26T12:28:52.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7832999999999997e-05 2024-04-26T12:28:52.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972675+0000", 2024-04-26T12:28:52.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074651450000000003 2024-04-26T12:28:52.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972696+0000", 2024-04-26T12:28:52.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0871999999999999e-05 2024-04-26T12:28:52.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972729+0000", 2024-04-26T12:28:52.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:28:52.915 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.915 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.915 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.916 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:306 3.13 3:ceffbd45:::200.0000000a:head [write 618844~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.916 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:52.916 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8977502790000003, 2024-04-26T12:28:52.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.04548866, 2024-04-26T12:28:52.916 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.917 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.917 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:52.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:52.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927298+0000", 2024-04-26T12:28:52.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927303+0000", 2024-04-26T12:28:52.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6079999999999998e-06 2024-04-26T12:28:52.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927310+0000", 2024-04-26T12:28:52.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6240000000000002e-06 2024-04-26T12:28:52.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927319+0000", 2024-04-26T12:28:52.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:28:52.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965791+0000", 2024-04-26T12:28:52.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038471350000000001 2024-04-26T12:28:52.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965839+0000", 2024-04-26T12:28:52.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8647999999999999e-05 2024-04-26T12:28:52.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972735+0000", 2024-04-26T12:28:52.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068952429999999997 2024-04-26T12:28:52.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972755+0000", 2024-04-26T12:28:52.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0219000000000001e-05 2024-04-26T12:28:52.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972787+0000", 2024-04-26T12:28:52.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2450000000000003e-05 2024-04-26T12:28:52.923 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.923 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.923 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.924 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:307 3.13 3:ceffbd45:::200.0000000a:head [write 621801~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.924 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:52.924 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8977007139999991, 2024-04-26T12:28:52.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.045498166, 2024-04-26T12:28:52.924 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.924 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.924 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:52.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:52.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:52.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927351+0000", 2024-04-26T12:28:52.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7130000000000001e-06 2024-04-26T12:28:52.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927355+0000", 2024-04-26T12:28:52.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1339999999999997e-06 2024-04-26T12:28:52.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927358+0000", 2024-04-26T12:28:52.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:28:52.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966366+0000", 2024-04-26T12:28:52.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039008207000000003 2024-04-26T12:28:52.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966457+0000", 2024-04-26T12:28:52.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1144999999999996e-05 2024-04-26T12:28:52.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972792+0000", 2024-04-26T12:28:52.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0063344819999999998 2024-04-26T12:28:52.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972815+0000", 2024-04-26T12:28:52.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3336000000000002e-05 2024-04-26T12:28:52.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972846+0000", 2024-04-26T12:28:52.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1504000000000002e-05 2024-04-26T12:28:52.929 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.929 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.930 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.930 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:308 3.13 3:ceffbd45:::200.0000000a:head [write 623718~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.930 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:52.930 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8960226690000006, 2024-04-26T12:28:52.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043878271000000003, 2024-04-26T12:28:52.930 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.930 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.930 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:52.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:52.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:52.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929042+0000", 2024-04-26T12:28:52.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6039e-05 2024-04-26T12:28:52.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929054+0000", 2024-04-26T12:28:52.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2275e-05 2024-04-26T12:28:52.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929063+0000", 2024-04-26T12:28:52.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7150000000000004e-06 2024-04-26T12:28:52.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967060+0000", 2024-04-26T12:28:52.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037996907000000003 2024-04-26T12:28:52.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967117+0000", 2024-04-26T12:28:52.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7701999999999997e-05 2024-04-26T12:28:52.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972850+0000", 2024-04-26T12:28:52.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0057332679999999997 2024-04-26T12:28:52.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972872+0000", 2024-04-26T12:28:52.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1138999999999999e-05 2024-04-26T12:28:52.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972905+0000", 2024-04-26T12:28:52.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2904999999999998e-05 2024-04-26T12:28:52.936 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.936 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.936 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.936 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:309 3.13 3:ceffbd45:::200.0000000a:head [write 638707~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.936 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:52.936 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8951995579999998, 2024-04-26T12:28:52.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043114311000000002, 2024-04-26T12:28:52.936 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.936 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.937 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:52.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:52.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:52.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929853+0000", 2024-04-26T12:28:52.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2690000000000001e-06 2024-04-26T12:28:52.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929861+0000", 2024-04-26T12:28:52.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.515e-06 2024-04-26T12:28:52.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929867+0000", 2024-04-26T12:28:52.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4640000000000003e-06 2024-04-26T12:28:52.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967590+0000", 2024-04-26T12:28:52.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037722506000000003 2024-04-26T12:28:52.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967672+0000", 2024-04-26T12:28:52.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2082000000000005e-05 2024-04-26T12:28:52.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972908+0000", 2024-04-26T12:28:52.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052366289999999996 2024-04-26T12:28:52.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972929+0000", 2024-04-26T12:28:52.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0752999999999999e-05 2024-04-26T12:28:52.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972964+0000", 2024-04-26T12:28:52.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4666999999999999e-05 2024-04-26T12:28:52.942 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.942 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.942 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.942 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:310 3.13 3:ceffbd45:::200.0000000a:head [write 641140~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.942 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:52.942 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.895152285, 2024-04-26T12:28:52.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043126171999999997, 2024-04-26T12:28:52.943 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.943 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.943 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:52.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:52.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929896+0000", 2024-04-26T12:28:52.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929899+0000", 2024-04-26T12:28:52.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-04-26T12:28:52.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929903+0000", 2024-04-26T12:28:52.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.087e-06 2024-04-26T12:28:52.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929907+0000", 2024-04-26T12:28:52.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1480000000000002e-06 2024-04-26T12:28:52.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.969962+0000", 2024-04-26T12:28:52.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040055457000000003 2024-04-26T12:28:52.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970018+0000", 2024-04-26T12:28:52.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6209999999999999e-05 2024-04-26T12:28:52.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972968+0000", 2024-04-26T12:28:52.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029501689999999999 2024-04-26T12:28:52.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972989+0000", 2024-04-26T12:28:52.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0618000000000001e-05 2024-04-26T12:28:52.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.973023+0000", 2024-04-26T12:28:52.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-26T12:28:52.948 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.949 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.949 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.949 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:312 3.13 3:ceffbd45:::200.0000000a:head [write 648907~1910 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.949 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:52.949 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8898230300000005, 2024-04-26T12:28:52.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039844011999999998, 2024-04-26T12:28:52.949 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.950 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.950 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:52.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:52.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935225+0000", 2024-04-26T12:28:52.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:52.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935229+0000", 2024-04-26T12:28:52.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1790000000000001e-06 2024-04-26T12:28:52.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935235+0000", 2024-04-26T12:28:52.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.716e-06 2024-04-26T12:28:52.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935239+0000", 2024-04-26T12:28:52.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5379999999999998e-06 2024-04-26T12:28:52.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970917+0000", 2024-04-26T12:28:52.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035678223000000002 2024-04-26T12:28:52.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971006+0000", 2024-04-26T12:28:52.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9248999999999999e-05 2024-04-26T12:28:52.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.974984+0000", 2024-04-26T12:28:52.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039776769999999998 2024-04-26T12:28:52.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975031+0000", 2024-04-26T12:28:52.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7500000000000003e-05 2024-04-26T12:28:52.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975070+0000", 2024-04-26T12:28:52.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8509e-05 2024-04-26T12:28:52.956 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.956 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.956 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.957 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:313 3.13 3:ceffbd45:::200.0000000a:head [write 650817~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:52.957 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:52.957 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8895967020000004, 2024-04-26T12:28:52.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040236782999999998, 2024-04-26T12:28:52.957 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:52.957 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:52.957 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:52.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:52.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:52.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:52.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:52.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:52.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:52.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935451+0000", 2024-04-26T12:28:52.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:52.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:52.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935457+0000", 2024-04-26T12:28:52.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5079999999999996e-06 2024-04-26T12:28:52.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:52.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935467+0000", 2024-04-26T12:28:52.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0407e-05 2024-04-26T12:28:52.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:52.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935477+0000", 2024-04-26T12:28:52.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3989999999999993e-06 2024-04-26T12:28:52.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:52.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971691+0000", 2024-04-26T12:28:52.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036214534 2024-04-26T12:28:52.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:52.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971741+0000", 2024-04-26T12:28:52.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0294000000000003e-05 2024-04-26T12:28:52.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:52.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975619+0000", 2024-04-26T12:28:52.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038779259999999999 2024-04-26T12:28:52.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:52.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975647+0000", 2024-04-26T12:28:52.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:28:52.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:52.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:52.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:52.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975689+0000", 2024-04-26T12:28:52.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2055999999999998e-05 2024-04-26T12:28:52.962 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.962 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.962 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.962 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:52.962 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:52.963 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:52.964 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:52.962+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:52.965 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:53.066 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:53.064+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:53.097 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:53.097 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:53.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.097 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:4034 3.e 3:715f5c78:::200.00000013:head [write 2528841~38983 [fadvise_dontneed] in=38983b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e55)", 2024-04-26T12:28:53.097 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:53.096467+0000", 2024-04-26T12:28:53.098 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.00034052399999999998, 2024-04-26T12:28:53.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00036057199999999998, 2024-04-26T12:28:53.098 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.098 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:53.098 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:53.096467+0000", 2024-04-26T12:28:53.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:53.096467+0000", 2024-04-26T12:28:53.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:53.096466+0000", 2024-04-26T12:28:53.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:53.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:53.096484+0000", 2024-04-26T12:28:53.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7487e-05 2024-04-26T12:28:53.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:53.096496+0000", 2024-04-26T12:28:53.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1705000000000001e-05 2024-04-26T12:28:53.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:53.096502+0000", 2024-04-26T12:28:53.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9800000000000003e-06 2024-04-26T12:28:53.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:53.096546+0000", 2024-04-26T12:28:53.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4904000000000002e-05 2024-04-26T12:28:53.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:53.096632+0000", 2024-04-26T12:28:53.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6044999999999994e-05 2024-04-26T12:28:53.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:53.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:53.096754+0000", 2024-04-26T12:28:53.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012110800000000001 2024-04-26T12:28:53.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.105 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.105 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-26T12:28:53.105 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 1 2024-04-26T12:28:53.105 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:53.108 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:53.166 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:53.165+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:53.252 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T12:28:53.253 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T12:28:53.267 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:53.265+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:53.280 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:53.280 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:53.280 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:53.281 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:53.281 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:53.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:53.367 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:53.366+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:53.469 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:53.468+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:53.485 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:53.485 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:53.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:53.485 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:53.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.485 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1668 3.18 3:1e8917d7:::200.0000000e:head [write 3543177~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.486 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:53.486 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5630908830000001, 2024-04-26T12:28:53.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067259575000000002, 2024-04-26T12:28:53.486 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.486 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.486 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:53.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:53.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:53.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:53.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919147+0000", 2024-04-26T12:28:53.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.157e-06 2024-04-26T12:28:53.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919151+0000", 2024-04-26T12:28:53.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.313e-06 2024-04-26T12:28:53.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919154+0000", 2024-04-26T12:28:53.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:28:53.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982687+0000", 2024-04-26T12:28:53.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063532694000000001 2024-04-26T12:28:53.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982750+0000", 2024-04-26T12:28:53.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:28:53.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986254+0000", 2024-04-26T12:28:53.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035043880000000002 2024-04-26T12:28:53.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986322+0000", 2024-04-26T12:28:53.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7458000000000004e-05 2024-04-26T12:28:53.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986404+0000", 2024-04-26T12:28:53.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2015000000000007e-05 2024-04-26T12:28:53.491 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.491 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.492 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.492 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1669 3.18 3:1e8917d7:::200.0000000e:head [write 3544575~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.492 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:53.492 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5630782700000001, 2024-04-26T12:28:53.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067362678999999995, 2024-04-26T12:28:53.492 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.492 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.493 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:53.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:53.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:53.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:28:53.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919158+0000", 2024-04-26T12:28:53.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.536e-06 2024-04-26T12:28:53.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919161+0000", 2024-04-26T12:28:53.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:28:53.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919164+0000", 2024-04-26T12:28:53.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:28:53.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983465+0000", 2024-04-26T12:28:53.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064301233999999999 2024-04-26T12:28:53.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983515+0000", 2024-04-26T12:28:53.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9774000000000002e-05 2024-04-26T12:28:53.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986414+0000", 2024-04-26T12:28:53.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0028991770000000002 2024-04-26T12:28:53.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986455+0000", 2024-04-26T12:28:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1090000000000001e-05 2024-04-26T12:28:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986520+0000", 2024-04-26T12:28:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4778999999999998e-05 2024-04-26T12:28:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.499 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1670 3.18 3:1e8917d7:::200.0000000e:head [write 3545973~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.499 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:53.499 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.563068994, 2024-04-26T12:28:53.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070481470000000004, 2024-04-26T12:28:53.499 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.499 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.499 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:53.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:53.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:53.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:28:53.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919172+0000", 2024-04-26T12:28:53.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:28:53.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919175+0000", 2024-04-26T12:28:53.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.942e-06 2024-04-26T12:28:53.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919177+0000", 2024-04-26T12:28:53.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5790000000000002e-06 2024-04-26T12:28:53.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983883+0000", 2024-04-26T12:28:53.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064705768999999996 2024-04-26T12:28:53.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983975+0000", 2024-04-26T12:28:53.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2219999999999995e-05 2024-04-26T12:28:53.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989262+0000", 2024-04-26T12:28:53.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052864940000000001 2024-04-26T12:28:53.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989361+0000", 2024-04-26T12:28:53.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9374000000000001e-05 2024-04-26T12:28:53.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989648+0000", 2024-04-26T12:28:53.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028677200000000003 2024-04-26T12:28:53.506 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.506 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.507 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.507 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1671 3.18 3:1e8917d7:::200.0000000e:head [write 3547932~12451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.507 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:53.507 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5617738770000003, 2024-04-26T12:28:53.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069443256999999994, 2024-04-26T12:28:53.507 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.507 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.507 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:53.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:53.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920460+0000", 2024-04-26T12:28:53.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:53.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920542+0000", 2024-04-26T12:28:53.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650999999999995e-05 2024-04-26T12:28:53.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920554+0000", 2024-04-26T12:28:53.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2228e-05 2024-04-26T12:28:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920560+0000", 2024-04-26T12:28:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8869999999999997e-06 2024-04-26T12:28:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984749+0000", 2024-04-26T12:28:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064188913 2024-04-26T12:28:53.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984795+0000", 2024-04-26T12:28:53.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5893000000000003e-05 2024-04-26T12:28:53.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989659+0000", 2024-04-26T12:28:53.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048643669999999996 2024-04-26T12:28:53.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989836+0000", 2024-04-26T12:28:53.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017699799999999999 2024-04-26T12:28:53.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989905+0000", 2024-04-26T12:28:53.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8238000000000006e-05 2024-04-26T12:28:53.513 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.513 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.513 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1672 3.18 3:1e8917d7:::200.0000000e:head [write 3560383~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5616702350000002, 2024-04-26T12:28:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070651368000000006, 2024-04-26T12:28:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920569+0000", 2024-04-26T12:28:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2610000000000004e-06 2024-04-26T12:28:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920572+0000", 2024-04-26T12:28:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6150000000000001e-06 2024-04-26T12:28:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920578+0000", 2024-04-26T12:28:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:28:53.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985287+0000", 2024-04-26T12:28:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064708946000000003 2024-04-26T12:28:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985343+0000", 2024-04-26T12:28:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6109000000000001e-05 2024-04-26T12:28:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991135+0000", 2024-04-26T12:28:53.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057923430000000001 2024-04-26T12:28:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991163+0000", 2024-04-26T12:28:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7083000000000001e-05 2024-04-26T12:28:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991216+0000", 2024-04-26T12:28:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3854999999999999e-05 2024-04-26T12:28:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1673 3.18 3:1e8917d7:::200.0000000e:head [write 3563148~4730 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5599161050000001, 2024-04-26T12:28:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068974127999999996, 2024-04-26T12:28:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922318+0000", 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922327+0000", 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.02e-06 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922336+0000", 2024-04-26T12:28:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:28:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922344+0000", 2024-04-26T12:28:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5220000000000001e-06 2024-04-26T12:28:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986575+0000", 2024-04-26T12:28:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064231885000000002 2024-04-26T12:28:53.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986628+0000", 2024-04-26T12:28:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.219e-05 2024-04-26T12:28:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991222+0000", 2024-04-26T12:28:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045942500000000002 2024-04-26T12:28:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991245+0000", 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2764000000000001e-05 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991293+0000", 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8628999999999998e-05 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:13020 4.10 4:09df41af:::1000000333c.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5589138839999999, 2024-04-26T12:28:53.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066586204999999996, 2024-04-26T12:28:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 13020 2024-04-26T12:28:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923320+0000", 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923328+0000", 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3289999999999994e-06 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923340+0000", 2024-04-26T12:28:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1891e-05 2024-04-26T12:28:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923353+0000", 2024-04-26T12:28:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3273e-05 2024-04-26T12:28:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986568+0000", 2024-04-26T12:28:53.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063214801000000001 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986686+0000", 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118009 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989908+0000", 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032213039999999999 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1674 3.18 3:1e8917d7:::200.0000000e:head [write 3567878~12568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5579811000000001, 2024-04-26T12:28:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067102822000000006, 2024-04-26T12:28:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924253+0000", 2024-04-26T12:28:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924269+0000", 2024-04-26T12:28:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:28:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924279+0000", 2024-04-26T12:28:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0676000000000001e-05 2024-04-26T12:28:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924288+0000", 2024-04-26T12:28:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4649999999999994e-06 2024-04-26T12:28:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987080+0000", 2024-04-26T12:28:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062792312000000003 2024-04-26T12:28:53.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987132+0000", 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1712999999999998e-05 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991298+0000", 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041660539999999998 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991321+0000", 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3575e-05 2024-04-26T12:28:53.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991357+0000", 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5506000000000002e-05 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1675 3.18 3:1e8917d7:::200.0000000e:head [write 3580446~9112 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5569615570000002, 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066218224000000006, 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.532 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.533 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925273+0000", 2024-04-26T12:28:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925282+0000", 2024-04-26T12:28:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:28:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925291+0000", 2024-04-26T12:28:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2800000000000003e-06 2024-04-26T12:28:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925296+0000", 2024-04-26T12:28:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6080000000000003e-06 2024-04-26T12:28:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987663+0000", 2024-04-26T12:28:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062366705000000001 2024-04-26T12:28:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987729+0000", 2024-04-26T12:28:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6330999999999999e-05 2024-04-26T12:28:53.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991362+0000", 2024-04-26T12:28:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036322820000000001 2024-04-26T12:28:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991431+0000", 2024-04-26T12:28:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9799e-05 2024-04-26T12:28:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991492+0000", 2024-04-26T12:28:53.536 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0587000000000001e-05 2024-04-26T12:28:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1676 3.18 3:1e8917d7:::200.0000000e:head [write 3589558~5068 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5567623209999999, 2024-04-26T12:28:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066120133999999997, 2024-04-26T12:28:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.537 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925479+0000", 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.054e-06 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925489+0000", 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0847e-05 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925494+0000", 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6569999999999996e-06 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988275+0000", 2024-04-26T12:28:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062780582000000001 2024-04-26T12:28:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988319+0000", 2024-04-26T12:28:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3881999999999998e-05 2024-04-26T12:28:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991497+0000", 2024-04-26T12:28:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031781520000000001 2024-04-26T12:28:53.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991519+0000", 2024-04-26T12:28:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2382e-05 2024-04-26T12:28:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991593+0000", 2024-04-26T12:28:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3987999999999997e-05 2024-04-26T12:28:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.541 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1677 3.18 3:1e8917d7:::200.0000000e:head [write 3594626~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5563608069999999, 2024-04-26T12:28:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065839106999999994, 2024-04-26T12:28:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925880+0000", 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925896+0000", 2024-04-26T12:28:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5696999999999999e-05 2024-04-26T12:28:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925904+0000", 2024-04-26T12:28:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9619999999999993e-06 2024-04-26T12:28:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988800+0000", 2024-04-26T12:28:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062896142000000002 2024-04-26T12:28:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988877+0000", 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7175999999999994e-05 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991598+0000", 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027209399999999998 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991620+0000", 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2396e-05 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.545 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991714+0000", 2024-04-26T12:28:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3213000000000004e-05 2024-04-26T12:28:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1678 3.18 3:1e8917d7:::200.0000000e:head [write 3597232~4822 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5554237850000003, 2024-04-26T12:28:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066189707, 2024-04-26T12:28:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.546 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:53.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926819+0000", 2024-04-26T12:28:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:28:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926831+0000", 2024-04-26T12:28:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2300000000000001e-05 2024-04-26T12:28:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926839+0000", 2024-04-26T12:28:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9929999999999995e-06 2024-04-26T12:28:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989923+0000", 2024-04-26T12:28:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063083319999999998 2024-04-26T12:28:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989970+0000", 2024-04-26T12:28:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7290000000000003e-05 2024-04-26T12:28:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992907+0000", 2024-04-26T12:28:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029369740000000002 2024-04-26T12:28:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992953+0000", 2024-04-26T12:28:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6165000000000003e-05 2024-04-26T12:28:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993001+0000", 2024-04-26T12:28:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7984e-05 2024-04-26T12:28:53.550 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1679 3.18 3:1e8917d7:::200.0000000e:head [write 3602054~5518 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5553821970000001, 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068775656000000004, 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:53.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926858+0000", 2024-04-26T12:28:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7969999999999997e-06 2024-04-26T12:28:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926871+0000", 2024-04-26T12:28:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2965e-05 2024-04-26T12:28:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926878+0000", 2024-04-26T12:28:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9369999999999998e-06 2024-04-26T12:28:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990409+0000", 2024-04-26T12:28:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063531219999999999 2024-04-26T12:28:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990537+0000", 2024-04-26T12:28:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000127074 2024-04-26T12:28:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995467+0000", 2024-04-26T12:28:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049307190000000001 2024-04-26T12:28:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995519+0000", 2024-04-26T12:28:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1638000000000003e-05 2024-04-26T12:28:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995629+0000", 2024-04-26T12:28:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109852 2024-04-26T12:28:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.555 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1680 3.18 3:1e8917d7:::200.0000000e:head [write 3607572~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5553466770000002, 2024-04-26T12:28:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070113521999999998, 2024-04-26T12:28:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926885+0000", 2024-04-26T12:28:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999962 2024-04-26T12:28:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926893+0000", 2024-04-26T12:28:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6299999999999998e-06 2024-04-26T12:28:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926899+0000", 2024-04-26T12:28:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5359999999999998e-06 2024-04-26T12:28:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926906+0000", 2024-04-26T12:28:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8349999999999998e-06 2024-04-26T12:28:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991747+0000", 2024-04-26T12:28:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064841012000000003 2024-04-26T12:28:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991834+0000", 2024-04-26T12:28:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6602999999999997e-05 2024-04-26T12:28:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996894+0000", 2024-04-26T12:28:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050608850000000002 2024-04-26T12:28:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996954+0000", 2024-04-26T12:28:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9598000000000001e-05 2024-04-26T12:28:53.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997002+0000", 2024-04-26T12:28:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8050000000000002e-05 2024-04-26T12:28:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.560 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1681 3.18 3:1e8917d7:::200.0000000e:head [write 3609487~2938 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5553066829999995, 2024-04-26T12:28:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070147752999999993, 2024-04-26T12:28:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926928+0000", 2024-04-26T12:28:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926932+0000", 2024-04-26T12:28:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5669999999999999e-06 2024-04-26T12:28:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926939+0000", 2024-04-26T12:28:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:28:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926947+0000", 2024-04-26T12:28:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.238e-06 2024-04-26T12:28:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992399+0000", 2024-04-26T12:28:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065452859000000002 2024-04-26T12:28:53.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992484+0000", 2024-04-26T12:28:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4197999999999996e-05 2024-04-26T12:28:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997011+0000", 2024-04-26T12:28:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045271759999999999 2024-04-26T12:28:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.564 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997038+0000", 2024-04-26T12:28:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7684000000000001e-05 2024-04-26T12:28:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997076+0000", 2024-04-26T12:28:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7901000000000002e-05 2024-04-26T12:28:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1682 3.18 3:1e8917d7:::200.0000000e:head [write 3612425~3220 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:53.565 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5529798509999999, 2024-04-26T12:28:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067934001999999993, 2024-04-26T12:28:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:53.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929260+0000", 2024-04-26T12:28:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:28:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929268+0000", 2024-04-26T12:28:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6399999999999997e-06 2024-04-26T12:28:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929273+0000", 2024-04-26T12:28:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:28:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993049+0000", 2024-04-26T12:28:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063775736999999999 2024-04-26T12:28:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993159+0000", 2024-04-26T12:28:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000110807 2024-04-26T12:28:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997083+0000", 2024-04-26T12:28:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039233769999999996 2024-04-26T12:28:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997126+0000", 2024-04-26T12:28:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3544999999999997e-05 2024-04-26T12:28:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997189+0000", 2024-04-26T12:28:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3128999999999998e-05 2024-04-26T12:28:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1683 3.18 3:1e8917d7:::200.0000000e:head [write 3615645~5682 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5527327399999997, 2024-04-26T12:28:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067807854000000001, 2024-04-26T12:28:53.570 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929502+0000", 2024-04-26T12:28:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929510+0000", 2024-04-26T12:28:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1179999999999992e-06 2024-04-26T12:28:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929519+0000", 2024-04-26T12:28:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2129999999999997e-06 2024-04-26T12:28:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929531+0000", 2024-04-26T12:28:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1615e-05 2024-04-26T12:28:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993765+0000", 2024-04-26T12:28:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064233810000000002 2024-04-26T12:28:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993842+0000", 2024-04-26T12:28:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7645999999999995e-05 2024-04-26T12:28:53.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997198+0000", 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003355977 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997249+0000", 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0834000000000002e-05 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997310+0000", 2024-04-26T12:28:53.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1408999999999994e-05 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1684 3.18 3:1e8917d7:::200.0000000e:head [write 3621327~8700 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5504361639999997, 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066650928999999998, 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931798+0000", 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:53.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931809+0000", 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0662000000000001e-05 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931816+0000", 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1590000000000004e-06 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931821+0000", 2024-04-26T12:28:53.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0710000000000002e-06 2024-04-26T12:28:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994486+0000", 2024-04-26T12:28:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062664719999999993 2024-04-26T12:28:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994567+0000", 2024-04-26T12:28:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1138999999999997e-05 2024-04-26T12:28:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998343+0000", 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003775769 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998387+0000", 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4564999999999998e-05 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998450+0000", 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2589999999999995e-05 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1685 3.18 3:1e8917d7:::200.0000000e:head [write 3630027~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5504092939999996, 2024-04-26T12:28:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066694793000000002, 2024-04-26T12:28:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931828+0000", 2024-04-26T12:28:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:28:53.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931831+0000", 2024-04-26T12:28:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.45e-06 2024-04-26T12:28:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931835+0000", 2024-04-26T12:28:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995016+0000", 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063180397999999999 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995064+0000", 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8538999999999997e-05 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998455+0000", 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033911000000000002 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998478+0000", 2024-04-26T12:28:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2793999999999999e-05 2024-04-26T12:28:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998521+0000", 2024-04-26T12:28:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2608999999999998e-05 2024-04-26T12:28:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1687 3.18 3:1e8917d7:::200.0000000e:head [write 3636544~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.54919209, 2024-04-26T12:28:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068592686, 2024-04-26T12:28:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933046+0000", 2024-04-26T12:28:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0850000000000001e-06 2024-04-26T12:28:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933050+0000", 2024-04-26T12:28:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5549999999999996e-06 2024-04-26T12:28:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933054+0000", 2024-04-26T12:28:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:28:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996223+0000", 2024-04-26T12:28:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063169004000000001 2024-04-26T12:28:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996307+0000", 2024-04-26T12:28:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3660999999999997e-05 2024-04-26T12:28:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001540+0000", 2024-04-26T12:28:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052334160000000003 2024-04-26T12:28:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001573+0000", 2024-04-26T12:28:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2981999999999997e-05 2024-04-26T12:28:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001636+0000", 2024-04-26T12:28:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2601999999999995e-05 2024-04-26T12:28:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:53.589 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:53.589 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:53.591 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:53.589+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:53.591 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:53.691 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:53.690+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:53.748 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:53.749 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:53.749 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:53.749 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:53.759 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:53.802 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:53.801+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:53.863 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:28:53.892 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:53.893 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:53.893 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:53.893 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:53.893 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:53.893 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:53.891+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:53.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:28:53.903 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:53.994 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:53.993+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:54.074 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:54.074 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:54.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:54.075 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:54.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.075 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:293 3.13 3:ceffbd45:::200.0000000a:head [write 594763~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.075 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:54.075 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.147847410000001, 2024-04-26T12:28:54.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038803585000000002, 2024-04-26T12:28:54.075 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.075 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.075 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924874+0000", 2024-04-26T12:28:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924877+0000", 2024-04-26T12:28:54.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7329999999999999e-06 2024-04-26T12:28:54.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924884+0000", 2024-04-26T12:28:54.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:28:54.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924890+0000", 2024-04-26T12:28:54.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:28:54.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958764+0000", 2024-04-26T12:28:54.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.033873863999999997 2024-04-26T12:28:54.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958855+0000", 2024-04-26T12:28:54.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1402000000000003e-05 2024-04-26T12:28:54.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963608+0000", 2024-04-26T12:28:54.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047529039999999996 2024-04-26T12:28:54.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963636+0000", 2024-04-26T12:28:54.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8194000000000001e-05 2024-04-26T12:28:54.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963678+0000", 2024-04-26T12:28:54.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2095999999999998e-05 2024-04-26T12:28:54.079 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.079 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.079 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.080 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:294 3.13 3:ceffbd45:::200.0000000a:head [write 596172~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.080 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:54.080 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.147802666, 2024-04-26T12:28:54.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041225228000000003, 2024-04-26T12:28:54.080 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.080 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.080 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:54.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:54.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924919+0000", 2024-04-26T12:28:54.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924922+0000", 2024-04-26T12:28:54.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9160000000000001e-06 2024-04-26T12:28:54.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924928+0000", 2024-04-26T12:28:54.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3929999999999996e-06 2024-04-26T12:28:54.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924933+0000", 2024-04-26T12:28:54.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7820000000000001e-06 2024-04-26T12:28:54.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959359+0000", 2024-04-26T12:28:54.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034425782000000002 2024-04-26T12:28:54.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959439+0000", 2024-04-26T12:28:54.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0275e-05 2024-04-26T12:28:54.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966079+0000", 2024-04-26T12:28:54.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0066397089999999997 2024-04-26T12:28:54.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966106+0000", 2024-04-26T12:28:54.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7178e-05 2024-04-26T12:28:54.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966145+0000", 2024-04-26T12:28:54.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8618999999999997e-05 2024-04-26T12:28:54.085 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.085 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.085 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.085 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:295 3.13 3:ceffbd45:::200.0000000a:head [write 597574~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.085 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:54.086 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.147776516, 2024-04-26T12:28:54.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041258571000000001, 2024-04-26T12:28:54.086 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.086 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.086 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:54.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:54.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924945+0000", 2024-04-26T12:28:54.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924948+0000", 2024-04-26T12:28:54.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:28:54.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924955+0000", 2024-04-26T12:28:54.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4629999999999998e-06 2024-04-26T12:28:54.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924959+0000", 2024-04-26T12:28:54.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2719999999999999e-06 2024-04-26T12:28:54.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959957+0000", 2024-04-26T12:28:54.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034997588000000003 2024-04-26T12:28:54.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960042+0000", 2024-04-26T12:28:54.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5811999999999998e-05 2024-04-26T12:28:54.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966149+0000", 2024-04-26T12:28:54.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061071650000000003 2024-04-26T12:28:54.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966171+0000", 2024-04-26T12:28:54.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1905000000000001e-05 2024-04-26T12:28:54.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966204+0000", 2024-04-26T12:28:54.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2845999999999997e-05 2024-04-26T12:28:54.091 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.091 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.091 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.091 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:296 3.13 3:ceffbd45:::200.0000000a:head [write 598977~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.091 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:54.091 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.147744886, 2024-04-26T12:28:54.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041282538000000001, 2024-04-26T12:28:54.091 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.091 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.091 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:54.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:54.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:54.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:54.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924979+0000", 2024-04-26T12:28:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3609999999999999e-06 2024-04-26T12:28:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924984+0000", 2024-04-26T12:28:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3259999999999997e-06 2024-04-26T12:28:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924987+0000", 2024-04-26T12:28:54.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7810000000000001e-06 2024-04-26T12:28:54.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960618+0000", 2024-04-26T12:28:54.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035631875 2024-04-26T12:28:54.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960698+0000", 2024-04-26T12:28:54.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9373000000000001e-05 2024-04-26T12:28:54.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966208+0000", 2024-04-26T12:28:54.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055104359999999996 2024-04-26T12:28:54.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966228+0000", 2024-04-26T12:28:54.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0208e-05 2024-04-26T12:28:54.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966260+0000", 2024-04-26T12:28:54.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1404e-05 2024-04-26T12:28:54.096 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.096 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.096 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.096 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:297 3.13 3:ceffbd45:::200.0000000a:head [write 600380~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.096 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:54.096 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.147708052, 2024-04-26T12:28:54.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041309850000000002, 2024-04-26T12:28:54.096 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.097 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.097 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:54.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:54.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:54.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925017+0000", 2024-04-26T12:28:54.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.96e-06 2024-04-26T12:28:54.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925020+0000", 2024-04-26T12:28:54.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6629999999999999e-06 2024-04-26T12:28:54.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925023+0000", 2024-04-26T12:28:54.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:28:54.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961241+0000", 2024-04-26T12:28:54.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036217390000000002 2024-04-26T12:28:54.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961335+0000", 2024-04-26T12:28:54.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4537000000000006e-05 2024-04-26T12:28:54.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966264+0000", 2024-04-26T12:28:54.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004928516 2024-04-26T12:28:54.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966290+0000", 2024-04-26T12:28:54.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5658999999999999e-05 2024-04-26T12:28:54.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966324+0000", 2024-04-26T12:28:54.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4459000000000003e-05 2024-04-26T12:28:54.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.101 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.101 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:298 3.13 3:ceffbd45:::200.0000000a:head [write 602634~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.101 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:54.101 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.147675457, 2024-04-26T12:28:54.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046387536, 2024-04-26T12:28:54.101 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.102 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.102 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:54.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:54.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925046+0000", 2024-04-26T12:28:54.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:54.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925049+0000", 2024-04-26T12:28:54.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4770000000000002e-06 2024-04-26T12:28:54.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925057+0000", 2024-04-26T12:28:54.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9219999999999997e-06 2024-04-26T12:28:54.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925062+0000", 2024-04-26T12:28:54.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:28:54.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961918+0000", 2024-04-26T12:28:54.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036856170000000001 2024-04-26T12:28:54.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962014+0000", 2024-04-26T12:28:54.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6731999999999995e-05 2024-04-26T12:28:54.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971360+0000", 2024-04-26T12:28:54.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0093454569999999997 2024-04-26T12:28:54.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971393+0000", 2024-04-26T12:28:54.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3130999999999998e-05 2024-04-26T12:28:54.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971434+0000", 2024-04-26T12:28:54.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1244e-05 2024-04-26T12:28:54.106 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.106 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.106 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.107 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:299 3.13 3:ceffbd45:::200.0000000a:head [write 604033~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.107 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:54.107 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.147621625999999, 2024-04-26T12:28:54.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046395615000000001, 2024-04-26T12:28:54.107 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.107 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.107 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:54.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:54.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925100+0000", 2024-04-26T12:28:54.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925103+0000", 2024-04-26T12:28:54.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3520000000000001e-06 2024-04-26T12:28:54.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925108+0000", 2024-04-26T12:28:54.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6489999999999996e-06 2024-04-26T12:28:54.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925111+0000", 2024-04-26T12:28:54.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.79e-06 2024-04-26T12:28:54.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962405+0000", 2024-04-26T12:28:54.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037293953999999997 2024-04-26T12:28:54.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962457+0000", 2024-04-26T12:28:54.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2003000000000003e-05 2024-04-26T12:28:54.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971440+0000", 2024-04-26T12:28:54.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0089831719999999993 2024-04-26T12:28:54.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971463+0000", 2024-04-26T12:28:54.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3201e-05 2024-04-26T12:28:54.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971496+0000", 2024-04-26T12:28:54.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2836000000000002e-05 2024-04-26T12:28:54.111 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.111 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.111 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.111 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:300 3.13 3:ceffbd45:::200.0000000a:head [write 605436~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.112 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:54.112 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.147557768, 2024-04-26T12:28:54.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046389606999999999, 2024-04-26T12:28:54.112 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.112 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.112 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:54.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:54.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:54.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925167+0000", 2024-04-26T12:28:54.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8870000000000001e-06 2024-04-26T12:28:54.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925171+0000", 2024-04-26T12:28:54.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6049999999999998e-06 2024-04-26T12:28:54.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925173+0000", 2024-04-26T12:28:54.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8250000000000001e-06 2024-04-26T12:28:54.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962740+0000", 2024-04-26T12:28:54.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037566436000000002 2024-04-26T12:28:54.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962818+0000", 2024-04-26T12:28:54.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8231000000000004e-05 2024-04-26T12:28:54.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971501+0000", 2024-04-26T12:28:54.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008682525 2024-04-26T12:28:54.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971522+0000", 2024-04-26T12:28:54.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1673999999999999e-05 2024-04-26T12:28:54.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971554+0000", 2024-04-26T12:28:54.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1786999999999999e-05 2024-04-26T12:28:54.116 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.116 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.116 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.116 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:301 3.13 3:ceffbd45:::200.0000000a:head [write 606838~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.116 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:54.116 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.147541159999999, 2024-04-26T12:28:54.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046429455000000001, 2024-04-26T12:28:54.117 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.117 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.117 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:54.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:54.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:54.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:54.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925183+0000", 2024-04-26T12:28:54.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0150000000000002e-06 2024-04-26T12:28:54.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925186+0000", 2024-04-26T12:28:54.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2210000000000002e-06 2024-04-26T12:28:54.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925190+0000", 2024-04-26T12:28:54.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8489999999999999e-06 2024-04-26T12:28:54.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963304+0000", 2024-04-26T12:28:54.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038114207999999997 2024-04-26T12:28:54.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963356+0000", 2024-04-26T12:28:54.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1628000000000001e-05 2024-04-26T12:28:54.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971558+0000", 2024-04-26T12:28:54.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082025199999999996 2024-04-26T12:28:54.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971579+0000", 2024-04-26T12:28:54.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1019e-05 2024-04-26T12:28:54.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971610+0000", 2024-04-26T12:28:54.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1205999999999999e-05 2024-04-26T12:28:54.121 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.121 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.121 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.121 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:302 3.13 3:ceffbd45:::200.0000000a:head [write 608236~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.121 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:54.121 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.147519966999999, 2024-04-26T12:28:54.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046464057000000003, 2024-04-26T12:28:54.121 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925204+0000", 2024-04-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1270000000000001e-06 2024-04-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925207+0000", 2024-04-26T12:28:54.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3720000000000001e-06 2024-04-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925210+0000", 2024-04-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7489999999999999e-06 2024-04-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963713+0000", 2024-04-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038502508999999997 2024-04-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963792+0000", 2024-04-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9087999999999999e-05 2024-04-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971615+0000", 2024-04-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078230130000000002 2024-04-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971636+0000", 2024-04-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0996999999999999e-05 2024-04-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971666+0000", 2024-04-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0443999999999999e-05 2024-04-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:303 3.13 3:ceffbd45:::200.0000000a:head [write 609649~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.147476945999999, 2024-04-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.047363031, 2024-04-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.126 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925253+0000", 2024-04-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0369999999999995e-06 2024-04-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925261+0000", 2024-04-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7420000000000003e-06 2024-04-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925271+0000", 2024-04-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1589999999999999e-06 2024-04-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964198+0000", 2024-04-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038927182999999997 2024-04-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964281+0000", 2024-04-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3355000000000004e-05 2024-04-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972542+0000", 2024-04-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082607930000000006 2024-04-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972570+0000", 2024-04-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7937999999999999e-05 2024-04-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972608+0000", 2024-04-26T12:28:54.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8384999999999999e-05 2024-04-26T12:28:54.131 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.131 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.131 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.131 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:304 3.13 3:ceffbd45:::200.0000000a:head [write 611057~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.131 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:54.131 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.146311317, 2024-04-26T12:28:54.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046259867000000003, 2024-04-26T12:28:54.131 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.131 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.131 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:54.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:54.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926410+0000", 2024-04-26T12:28:54.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926415+0000", 2024-04-26T12:28:54.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7999999999999998e-06 2024-04-26T12:28:54.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926423+0000", 2024-04-26T12:28:54.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8569999999999995e-06 2024-04-26T12:28:54.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926429+0000", 2024-04-26T12:28:54.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.421e-06 2024-04-26T12:28:54.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964778+0000", 2024-04-26T12:28:54.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038349045999999998 2024-04-26T12:28:54.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964830+0000", 2024-04-26T12:28:54.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1309e-05 2024-04-26T12:28:54.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972614+0000", 2024-04-26T12:28:54.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077847070000000001 2024-04-26T12:28:54.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972638+0000", 2024-04-26T12:28:54.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3388999999999999e-05 2024-04-26T12:28:54.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972671+0000", 2024-04-26T12:28:54.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2999e-05 2024-04-26T12:28:54.135 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.136 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.136 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.136 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:305 3.13 3:ceffbd45:::200.0000000a:head [write 613824~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.136 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:54.136 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.146266278000001, 2024-04-26T12:28:54.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046273460000000002, 2024-04-26T12:28:54.136 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.136 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.136 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:54.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:54.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:54.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926463+0000", 2024-04-26T12:28:54.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:28:54.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926467+0000", 2024-04-26T12:28:54.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3000000000000003e-06 2024-04-26T12:28:54.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926470+0000", 2024-04-26T12:28:54.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1930000000000002e-06 2024-04-26T12:28:54.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965122+0000", 2024-04-26T12:28:54.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038652207000000001 2024-04-26T12:28:54.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965210+0000", 2024-04-26T12:28:54.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7832999999999997e-05 2024-04-26T12:28:54.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972675+0000", 2024-04-26T12:28:54.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074651450000000003 2024-04-26T12:28:54.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972696+0000", 2024-04-26T12:28:54.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0871999999999999e-05 2024-04-26T12:28:54.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972729+0000", 2024-04-26T12:28:54.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:28:54.140 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.141 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.141 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.141 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:306 3.13 3:ceffbd45:::200.0000000a:head [write 618844~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.141 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:54.141 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.145423533000001, 2024-04-26T12:28:54.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.04548866, 2024-04-26T12:28:54.141 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.141 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.141 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:54.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:54.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927298+0000", 2024-04-26T12:28:54.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927303+0000", 2024-04-26T12:28:54.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6079999999999998e-06 2024-04-26T12:28:54.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927310+0000", 2024-04-26T12:28:54.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6240000000000002e-06 2024-04-26T12:28:54.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927319+0000", 2024-04-26T12:28:54.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:28:54.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965791+0000", 2024-04-26T12:28:54.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038471350000000001 2024-04-26T12:28:54.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965839+0000", 2024-04-26T12:28:54.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8647999999999999e-05 2024-04-26T12:28:54.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972735+0000", 2024-04-26T12:28:54.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068952429999999997 2024-04-26T12:28:54.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972755+0000", 2024-04-26T12:28:54.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0219000000000001e-05 2024-04-26T12:28:54.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972787+0000", 2024-04-26T12:28:54.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2450000000000003e-05 2024-04-26T12:28:54.145 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.145 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.145 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.146 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:307 3.13 3:ceffbd45:::200.0000000a:head [write 621801~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.146 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:54.146 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.145373967999999, 2024-04-26T12:28:54.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.045498166, 2024-04-26T12:28:54.146 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.146 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.146 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:54.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:54.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:54.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927351+0000", 2024-04-26T12:28:54.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7130000000000001e-06 2024-04-26T12:28:54.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927355+0000", 2024-04-26T12:28:54.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1339999999999997e-06 2024-04-26T12:28:54.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927358+0000", 2024-04-26T12:28:54.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:28:54.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966366+0000", 2024-04-26T12:28:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039008207000000003 2024-04-26T12:28:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966457+0000", 2024-04-26T12:28:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1144999999999996e-05 2024-04-26T12:28:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972792+0000", 2024-04-26T12:28:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0063344819999999998 2024-04-26T12:28:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972815+0000", 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3336000000000002e-05 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972846+0000", 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1504000000000002e-05 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.150 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:308 3.13 3:ceffbd45:::200.0000000a:head [write 623718~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.151 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:54.151 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.143695922999999, 2024-04-26T12:28:54.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043878271000000003, 2024-04-26T12:28:54.151 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.151 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.151 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:54.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:54.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:54.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929042+0000", 2024-04-26T12:28:54.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6039e-05 2024-04-26T12:28:54.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929054+0000", 2024-04-26T12:28:54.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2275e-05 2024-04-26T12:28:54.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929063+0000", 2024-04-26T12:28:54.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7150000000000004e-06 2024-04-26T12:28:54.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967060+0000", 2024-04-26T12:28:54.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037996907000000003 2024-04-26T12:28:54.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967117+0000", 2024-04-26T12:28:54.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7701999999999997e-05 2024-04-26T12:28:54.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972850+0000", 2024-04-26T12:28:54.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0057332679999999997 2024-04-26T12:28:54.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972872+0000", 2024-04-26T12:28:54.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1138999999999999e-05 2024-04-26T12:28:54.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972905+0000", 2024-04-26T12:28:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2904999999999998e-05 2024-04-26T12:28:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:309 3.13 3:ceffbd45:::200.0000000a:head [write 638707~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.142872812, 2024-04-26T12:28:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043114311000000002, 2024-04-26T12:28:54.155 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.156 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.156 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:54.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:54.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:54.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929853+0000", 2024-04-26T12:28:54.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2690000000000001e-06 2024-04-26T12:28:54.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929861+0000", 2024-04-26T12:28:54.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.515e-06 2024-04-26T12:28:54.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929867+0000", 2024-04-26T12:28:54.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4640000000000003e-06 2024-04-26T12:28:54.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967590+0000", 2024-04-26T12:28:54.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037722506000000003 2024-04-26T12:28:54.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967672+0000", 2024-04-26T12:28:54.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2082000000000005e-05 2024-04-26T12:28:54.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972908+0000", 2024-04-26T12:28:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052366289999999996 2024-04-26T12:28:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972929+0000", 2024-04-26T12:28:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0752999999999999e-05 2024-04-26T12:28:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972964+0000", 2024-04-26T12:28:54.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4666999999999999e-05 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:310 3.13 3:ceffbd45:::200.0000000a:head [write 641140~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.142825539, 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043126171999999997, 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:54.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:54.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929896+0000", 2024-04-26T12:28:54.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929899+0000", 2024-04-26T12:28:54.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-04-26T12:28:54.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929903+0000", 2024-04-26T12:28:54.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.087e-06 2024-04-26T12:28:54.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929907+0000", 2024-04-26T12:28:54.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1480000000000002e-06 2024-04-26T12:28:54.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.969962+0000", 2024-04-26T12:28:54.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040055457000000003 2024-04-26T12:28:54.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970018+0000", 2024-04-26T12:28:54.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6209999999999999e-05 2024-04-26T12:28:54.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972968+0000", 2024-04-26T12:28:54.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029501689999999999 2024-04-26T12:28:54.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972989+0000", 2024-04-26T12:28:54.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0618000000000001e-05 2024-04-26T12:28:54.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.973023+0000", 2024-04-26T12:28:54.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-26T12:28:54.164 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.164 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.164 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.165 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:312 3.13 3:ceffbd45:::200.0000000a:head [write 648907~1910 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.165 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:54.165 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.137496283999999, 2024-04-26T12:28:54.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039844011999999998, 2024-04-26T12:28:54.165 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.165 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.165 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:54.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935225+0000", 2024-04-26T12:28:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935229+0000", 2024-04-26T12:28:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1790000000000001e-06 2024-04-26T12:28:54.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935235+0000", 2024-04-26T12:28:54.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.716e-06 2024-04-26T12:28:54.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935239+0000", 2024-04-26T12:28:54.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5379999999999998e-06 2024-04-26T12:28:54.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970917+0000", 2024-04-26T12:28:54.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035678223000000002 2024-04-26T12:28:54.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971006+0000", 2024-04-26T12:28:54.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9248999999999999e-05 2024-04-26T12:28:54.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.974984+0000", 2024-04-26T12:28:54.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039776769999999998 2024-04-26T12:28:54.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975031+0000", 2024-04-26T12:28:54.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7500000000000003e-05 2024-04-26T12:28:54.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975070+0000", 2024-04-26T12:28:54.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8509e-05 2024-04-26T12:28:54.169 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.169 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.169 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.169 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:313 3.13 3:ceffbd45:::200.0000000a:head [write 650817~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:54.169 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:54.169 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 11.137269956000001, 2024-04-26T12:28:54.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040236782999999998, 2024-04-26T12:28:54.170 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:54.170 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:54.170 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:54.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:54.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:54.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:54.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:54.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:54.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:54.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935451+0000", 2024-04-26T12:28:54.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:54.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:54.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935457+0000", 2024-04-26T12:28:54.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5079999999999996e-06 2024-04-26T12:28:54.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:54.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935467+0000", 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0407e-05 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935477+0000", 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3989999999999993e-06 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971691+0000", 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036214534 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:54.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971741+0000", 2024-04-26T12:28:54.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0294000000000003e-05 2024-04-26T12:28:54.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:54.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975619+0000", 2024-04-26T12:28:54.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038779259999999999 2024-04-26T12:28:54.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:54.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975647+0000", 2024-04-26T12:28:54.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:28:54.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:54.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:54.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:54.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975689+0000", 2024-04-26T12:28:54.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2055999999999998e-05 2024-04-26T12:28:54.174 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.174 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.174 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.174 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:54.174 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:54.174 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:54.176 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:54.174+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:54.176 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:54.176 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:54.177 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:54.177 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:54.178 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:54.178 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:54.178 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:54.178 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:54.276 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:54.275+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:54.315 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:54.315 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:54.326 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:54.377 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:54.376+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:54.461 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:54.461 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:54.472 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:54.478 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:54.477+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:54.579 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:54.577+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:54.645 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:54.645 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:54.656 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:54.700 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:54.699+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:54.782 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:54.780+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:54.786 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:54.787 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:54.797 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:54.858 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2024-04-26T12:28:54.882 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:54.881+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:54.972 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:54.973 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:54.983 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:54.984 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:54.982+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:55.083 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:55.082+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:55.155 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:55.155 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:55.166 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:55.209 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:55.208+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:55.285 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:55.284+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:55.297 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:55.298 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:55.308 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:55.394 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:55.393+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:55.487 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:55.487+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:55.518 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:55.518 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:55.529 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:55.588 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:55.587+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:55.689 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:55.688+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:55.700 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:55.700 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:55.711 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:55.790 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:55.790+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:55.842 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:55.842 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:55.852 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:55.895 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:55.894+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:55.989 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:55.990 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:55.992 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:55.992+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:56.001 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:56.093 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:56.092+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:56.170 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:56.170 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:56.178 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:28:56.180 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:56.193 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:56.192+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:56.294 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:56.293+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:56.310 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:56.310 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:56.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:56.354 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:56.381 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:56.381 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:56.381 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:56.382 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:56.384 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:56.384 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:56.395 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:56.394+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:56.498 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:56.495+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:56.515 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:56.515 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:56.515 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:56.515 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:56.515 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:56.530 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:56.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2024-04-26T12:28:56.614 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:56.614+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:56.698 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:56.697+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:56.701 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:56.701 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:56.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:56.701 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1668 3.18 3:1e8917d7:::200.0000000e:head [write 3543177~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7805970020000004, 2024-04-26T12:28:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067259575000000002, 2024-04-26T12:28:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919147+0000", 2024-04-26T12:28:56.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.157e-06 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919151+0000", 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.313e-06 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919154+0000", 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982687+0000", 2024-04-26T12:28:56.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063532694000000001 2024-04-26T12:28:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982750+0000", 2024-04-26T12:28:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:28:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986254+0000", 2024-04-26T12:28:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035043880000000002 2024-04-26T12:28:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986322+0000", 2024-04-26T12:28:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7458000000000004e-05 2024-04-26T12:28:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986404+0000", 2024-04-26T12:28:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2015000000000007e-05 2024-04-26T12:28:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1669 3.18 3:1e8917d7:::200.0000000e:head [write 3544575~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7805843889999995, 2024-04-26T12:28:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067362678999999995, 2024-04-26T12:28:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919158+0000", 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.536e-06 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919161+0000", 2024-04-26T12:28:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:28:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919164+0000", 2024-04-26T12:28:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:28:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983465+0000", 2024-04-26T12:28:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064301233999999999 2024-04-26T12:28:56.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983515+0000", 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9774000000000002e-05 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986414+0000", 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0028991770000000002 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986455+0000", 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1090000000000001e-05 2024-04-26T12:28:56.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986520+0000", 2024-04-26T12:28:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4778999999999998e-05 2024-04-26T12:28:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1670 3.18 3:1e8917d7:::200.0000000e:head [write 3545973~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7805751129999994, 2024-04-26T12:28:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070481470000000004, 2024-04-26T12:28:56.711 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919172+0000", 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919175+0000", 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.942e-06 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919177+0000", 2024-04-26T12:28:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5790000000000002e-06 2024-04-26T12:28:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983883+0000", 2024-04-26T12:28:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064705768999999996 2024-04-26T12:28:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983975+0000", 2024-04-26T12:28:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2219999999999995e-05 2024-04-26T12:28:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.714 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989262+0000", 2024-04-26T12:28:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052864940000000001 2024-04-26T12:28:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989361+0000", 2024-04-26T12:28:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9374000000000001e-05 2024-04-26T12:28:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989648+0000", 2024-04-26T12:28:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028677200000000003 2024-04-26T12:28:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.715 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1671 3.18 3:1e8917d7:::200.0000000e:head [write 3547932~12451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7792799959999996, 2024-04-26T12:28:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069443256999999994, 2024-04-26T12:28:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.716 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.717 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920460+0000", 2024-04-26T12:28:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920542+0000", 2024-04-26T12:28:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650999999999995e-05 2024-04-26T12:28:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920554+0000", 2024-04-26T12:28:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2228e-05 2024-04-26T12:28:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.718 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920560+0000", 2024-04-26T12:28:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8869999999999997e-06 2024-04-26T12:28:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984749+0000", 2024-04-26T12:28:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064188913 2024-04-26T12:28:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984795+0000", 2024-04-26T12:28:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5893000000000003e-05 2024-04-26T12:28:56.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989659+0000", 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048643669999999996 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989836+0000", 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017699799999999999 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989905+0000", 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8238000000000006e-05 2024-04-26T12:28:56.720 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1672 3.18 3:1e8917d7:::200.0000000e:head [write 3560383~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7791763540000005, 2024-04-26T12:28:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070651368000000006, 2024-04-26T12:28:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.721 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.722 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920569+0000", 2024-04-26T12:28:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2610000000000004e-06 2024-04-26T12:28:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920572+0000", 2024-04-26T12:28:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6150000000000001e-06 2024-04-26T12:28:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920578+0000", 2024-04-26T12:28:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:28:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.723 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985287+0000", 2024-04-26T12:28:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064708946000000003 2024-04-26T12:28:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985343+0000", 2024-04-26T12:28:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6109000000000001e-05 2024-04-26T12:28:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991135+0000", 2024-04-26T12:28:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057923430000000001 2024-04-26T12:28:56.724 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991163+0000", 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7083000000000001e-05 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991216+0000", 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3854999999999999e-05 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.725 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1673 3.18 3:1e8917d7:::200.0000000e:head [write 3563148~4730 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7774222240000004, 2024-04-26T12:28:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068974127999999996, 2024-04-26T12:28:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.726 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922318+0000", 2024-04-26T12:28:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922327+0000", 2024-04-26T12:28:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.02e-06 2024-04-26T12:28:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.727 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922336+0000", 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922344+0000", 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5220000000000001e-06 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986575+0000", 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064231885000000002 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.728 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986628+0000", 2024-04-26T12:28:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.219e-05 2024-04-26T12:28:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991222+0000", 2024-04-26T12:28:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045942500000000002 2024-04-26T12:28:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991245+0000", 2024-04-26T12:28:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2764000000000001e-05 2024-04-26T12:28:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.729 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991293+0000", 2024-04-26T12:28:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8628999999999998e-05 2024-04-26T12:28:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:13020 4.10 4:09df41af:::1000000333c.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:28:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7764200030000001, 2024-04-26T12:28:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066586204999999996, 2024-04-26T12:28:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.730 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 13020 2024-04-26T12:28:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.731 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923320+0000", 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923328+0000", 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3289999999999994e-06 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.732 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923340+0000", 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1891e-05 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923353+0000", 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3273e-05 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986568+0000", 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063214801000000001 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.733 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986686+0000", 2024-04-26T12:28:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118009 2024-04-26T12:28:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989908+0000", 2024-04-26T12:28:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032213039999999999 2024-04-26T12:28:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1674 3.18 3:1e8917d7:::200.0000000e:head [write 3567878~12568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.734 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7754872190000004, 2024-04-26T12:28:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067102822000000006, 2024-04-26T12:28:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.735 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924253+0000", 2024-04-26T12:28:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924269+0000", 2024-04-26T12:28:56.736 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924279+0000", 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0676000000000001e-05 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924288+0000", 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4649999999999994e-06 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987080+0000", 2024-04-26T12:28:56.737 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062792312000000003 2024-04-26T12:28:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987132+0000", 2024-04-26T12:28:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1712999999999998e-05 2024-04-26T12:28:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991298+0000", 2024-04-26T12:28:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041660539999999998 2024-04-26T12:28:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.738 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991321+0000", 2024-04-26T12:28:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3575e-05 2024-04-26T12:28:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991357+0000", 2024-04-26T12:28:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5506000000000002e-05 2024-04-26T12:28:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1675 3.18 3:1e8917d7:::200.0000000e:head [write 3580446~9112 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:56.739 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7744676760000004, 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066218224000000006, 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.740 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925273+0000", 2024-04-26T12:28:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925282+0000", 2024-04-26T12:28:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:28:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925291+0000", 2024-04-26T12:28:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2800000000000003e-06 2024-04-26T12:28:56.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925296+0000", 2024-04-26T12:28:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6080000000000003e-06 2024-04-26T12:28:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987663+0000", 2024-04-26T12:28:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062366705000000001 2024-04-26T12:28:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987729+0000", 2024-04-26T12:28:56.742 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6330999999999999e-05 2024-04-26T12:28:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991362+0000", 2024-04-26T12:28:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036322820000000001 2024-04-26T12:28:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991431+0000", 2024-04-26T12:28:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9799e-05 2024-04-26T12:28:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.743 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991492+0000", 2024-04-26T12:28:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0587000000000001e-05 2024-04-26T12:28:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1676 3.18 3:1e8917d7:::200.0000000e:head [write 3589558~5068 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7742684400000002, 2024-04-26T12:28:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066120133999999997, 2024-04-26T12:28:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.744 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:56.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925479+0000", 2024-04-26T12:28:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.054e-06 2024-04-26T12:28:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925489+0000", 2024-04-26T12:28:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0847e-05 2024-04-26T12:28:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925494+0000", 2024-04-26T12:28:56.746 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6569999999999996e-06 2024-04-26T12:28:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988275+0000", 2024-04-26T12:28:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062780582000000001 2024-04-26T12:28:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988319+0000", 2024-04-26T12:28:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3881999999999998e-05 2024-04-26T12:28:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.747 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991497+0000", 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031781520000000001 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991519+0000", 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2382e-05 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991593+0000", 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3987999999999997e-05 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1677 3.18 3:1e8917d7:::200.0000000e:head [write 3594626~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7738669260000002, 2024-04-26T12:28:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065839106999999994, 2024-04-26T12:28:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.749 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925880+0000", 2024-04-26T12:28:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:28:56.750 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925896+0000", 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5696999999999999e-05 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925904+0000", 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9619999999999993e-06 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988800+0000", 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062896142000000002 2024-04-26T12:28:56.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988877+0000", 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7175999999999994e-05 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991598+0000", 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027209399999999998 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991620+0000", 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2396e-05 2024-04-26T12:28:56.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991714+0000", 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3213000000000004e-05 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1678 3.18 3:1e8917d7:::200.0000000e:head [write 3597232~4822 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7729299039999997, 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066189707, 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.753 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.754 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926819+0000", 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926831+0000", 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2300000000000001e-05 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.755 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926839+0000", 2024-04-26T12:28:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9929999999999995e-06 2024-04-26T12:28:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989923+0000", 2024-04-26T12:28:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063083319999999998 2024-04-26T12:28:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989970+0000", 2024-04-26T12:28:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7290000000000003e-05 2024-04-26T12:28:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.756 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992907+0000", 2024-04-26T12:28:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029369740000000002 2024-04-26T12:28:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992953+0000", 2024-04-26T12:28:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6165000000000003e-05 2024-04-26T12:28:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993001+0000", 2024-04-26T12:28:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7984e-05 2024-04-26T12:28:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.757 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1679 3.18 3:1e8917d7:::200.0000000e:head [write 3602054~5518 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7728883159999995, 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068775656000000004, 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:56.758 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.759 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926858+0000", 2024-04-26T12:28:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7969999999999997e-06 2024-04-26T12:28:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926871+0000", 2024-04-26T12:28:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2965e-05 2024-04-26T12:28:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926878+0000", 2024-04-26T12:28:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9369999999999998e-06 2024-04-26T12:28:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.760 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990409+0000", 2024-04-26T12:28:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063531219999999999 2024-04-26T12:28:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990537+0000", 2024-04-26T12:28:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000127074 2024-04-26T12:28:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995467+0000", 2024-04-26T12:28:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049307190000000001 2024-04-26T12:28:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.761 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995519+0000", 2024-04-26T12:28:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1638000000000003e-05 2024-04-26T12:28:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995629+0000", 2024-04-26T12:28:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109852 2024-04-26T12:28:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.762 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1680 3.18 3:1e8917d7:::200.0000000e:head [write 3607572~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7728527960000005, 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070113521999999998, 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.763 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926885+0000", 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999962 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926893+0000", 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6299999999999998e-06 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.764 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926899+0000", 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5359999999999998e-06 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926906+0000", 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8349999999999998e-06 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991747+0000", 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064841012000000003 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.765 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991834+0000", 2024-04-26T12:28:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6602999999999997e-05 2024-04-26T12:28:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996894+0000", 2024-04-26T12:28:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050608850000000002 2024-04-26T12:28:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996954+0000", 2024-04-26T12:28:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9598000000000001e-05 2024-04-26T12:28:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.766 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997002+0000", 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8050000000000002e-05 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1681 3.18 3:1e8917d7:::200.0000000e:head [write 3609487~2938 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7728128020000007, 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070147752999999993, 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926928+0000", 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926932+0000", 2024-04-26T12:28:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5669999999999999e-06 2024-04-26T12:28:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926939+0000", 2024-04-26T12:28:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:28:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926947+0000", 2024-04-26T12:28:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.238e-06 2024-04-26T12:28:56.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992399+0000", 2024-04-26T12:28:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065452859000000002 2024-04-26T12:28:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992484+0000", 2024-04-26T12:28:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4197999999999996e-05 2024-04-26T12:28:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997011+0000", 2024-04-26T12:28:56.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045271759999999999 2024-04-26T12:28:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997038+0000", 2024-04-26T12:28:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7684000000000001e-05 2024-04-26T12:28:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997076+0000", 2024-04-26T12:28:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7901000000000002e-05 2024-04-26T12:28:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1682 3.18 3:1e8917d7:::200.0000000e:head [write 3612425~3220 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7704859699999993, 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067934001999999993, 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929260+0000", 2024-04-26T12:28:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:28:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929268+0000", 2024-04-26T12:28:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6399999999999997e-06 2024-04-26T12:28:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929273+0000", 2024-04-26T12:28:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:28:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993049+0000", 2024-04-26T12:28:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063775736999999999 2024-04-26T12:28:56.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993159+0000", 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000110807 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997083+0000", 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039233769999999996 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997126+0000", 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3544999999999997e-05 2024-04-26T12:28:56.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997189+0000", 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3128999999999998e-05 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1683 3.18 3:1e8917d7:::200.0000000e:head [write 3615645~5682 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7702388589999991, 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067807854000000001, 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.776 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.777 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:56.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:56.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929502+0000", 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929510+0000", 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1179999999999992e-06 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929519+0000", 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2129999999999997e-06 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929531+0000", 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1615e-05 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993765+0000", 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064233810000000002 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993842+0000", 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7645999999999995e-05 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997198+0000", 2024-04-26T12:28:56.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003355977 2024-04-26T12:28:56.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997249+0000", 2024-04-26T12:28:56.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0834000000000002e-05 2024-04-26T12:28:56.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997310+0000", 2024-04-26T12:28:56.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1408999999999994e-05 2024-04-26T12:28:56.780 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.780 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.780 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1684 3.18 3:1e8917d7:::200.0000000e:head [write 3621327~8700 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.767942283, 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066650928999999998, 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931798+0000", 2024-04-26T12:28:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931809+0000", 2024-04-26T12:28:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0662000000000001e-05 2024-04-26T12:28:56.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931816+0000", 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1590000000000004e-06 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931821+0000", 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0710000000000002e-06 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994486+0000", 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062664719999999993 2024-04-26T12:28:56.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994567+0000", 2024-04-26T12:28:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1138999999999997e-05 2024-04-26T12:28:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998343+0000", 2024-04-26T12:28:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003775769 2024-04-26T12:28:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998387+0000", 2024-04-26T12:28:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4564999999999998e-05 2024-04-26T12:28:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998450+0000", 2024-04-26T12:28:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2589999999999995e-05 2024-04-26T12:28:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.785 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1685 3.18 3:1e8917d7:::200.0000000e:head [write 3630027~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7679154130000008, 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066694793000000002, 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:56.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931828+0000", 2024-04-26T12:28:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:28:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931831+0000", 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.45e-06 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931835+0000", 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995016+0000", 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063180397999999999 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995064+0000", 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8538999999999997e-05 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998455+0000", 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033911000000000002 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998478+0000", 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2793999999999999e-05 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998521+0000", 2024-04-26T12:28:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2608999999999998e-05 2024-04-26T12:28:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1687 3.18 3:1e8917d7:::200.0000000e:head [write 3636544~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.7666982089999994, 2024-04-26T12:28:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068592686, 2024-04-26T12:28:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:56.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:56.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933046+0000", 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0850000000000001e-06 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933050+0000", 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5549999999999996e-06 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933054+0000", 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:28:56.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996223+0000", 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063169004000000001 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996307+0000", 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3660999999999997e-05 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001540+0000", 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052334160000000003 2024-04-26T12:28:56.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001573+0000", 2024-04-26T12:28:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2981999999999997e-05 2024-04-26T12:28:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001636+0000", 2024-04-26T12:28:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2601999999999995e-05 2024-04-26T12:28:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:56.794 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:56.795 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:56.796 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:56.798 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:56.797+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:56.871 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:28:56.900 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:56.899+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:56.922 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:56.923 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:56.923 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:56.923 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:56.934 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:57.018 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:57.017+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:57.101 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:57.100+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:57.102 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:57.103 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:57.113 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:57.202 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:57.202+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:57.287 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:57.287 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:28:57.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:28:57.287 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:28:57.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.287 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:293 3.13 3:ceffbd45:::200.0000000a:head [write 594763~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.287 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:57.287 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.360250446, 2024-04-26T12:28:57.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038803585000000002, 2024-04-26T12:28:57.287 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.287 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:28:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924874+0000", 2024-04-26T12:28:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924877+0000", 2024-04-26T12:28:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7329999999999999e-06 2024-04-26T12:28:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924884+0000", 2024-04-26T12:28:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:28:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924890+0000", 2024-04-26T12:28:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:28:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958764+0000", 2024-04-26T12:28:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.033873863999999997 2024-04-26T12:28:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958855+0000", 2024-04-26T12:28:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1402000000000003e-05 2024-04-26T12:28:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963608+0000", 2024-04-26T12:28:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047529039999999996 2024-04-26T12:28:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963636+0000", 2024-04-26T12:28:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8194000000000001e-05 2024-04-26T12:28:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963678+0000", 2024-04-26T12:28:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2095999999999998e-05 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:294 3.13 3:ceffbd45:::200.0000000a:head [write 596172~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.360205702, 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041225228000000003, 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:28:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924919+0000", 2024-04-26T12:28:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924922+0000", 2024-04-26T12:28:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9160000000000001e-06 2024-04-26T12:28:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924928+0000", 2024-04-26T12:28:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3929999999999996e-06 2024-04-26T12:28:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924933+0000", 2024-04-26T12:28:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7820000000000001e-06 2024-04-26T12:28:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959359+0000", 2024-04-26T12:28:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034425782000000002 2024-04-26T12:28:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959439+0000", 2024-04-26T12:28:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0275e-05 2024-04-26T12:28:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966079+0000", 2024-04-26T12:28:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0066397089999999997 2024-04-26T12:28:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966106+0000", 2024-04-26T12:28:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7178e-05 2024-04-26T12:28:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966145+0000", 2024-04-26T12:28:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8618999999999997e-05 2024-04-26T12:28:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:295 3.13 3:ceffbd45:::200.0000000a:head [write 597574~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.360179552, 2024-04-26T12:28:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041258571000000001, 2024-04-26T12:28:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:28:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924945+0000", 2024-04-26T12:28:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924948+0000", 2024-04-26T12:28:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:28:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924955+0000", 2024-04-26T12:28:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4629999999999998e-06 2024-04-26T12:28:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924959+0000", 2024-04-26T12:28:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2719999999999999e-06 2024-04-26T12:28:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959957+0000", 2024-04-26T12:28:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034997588000000003 2024-04-26T12:28:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960042+0000", 2024-04-26T12:28:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5811999999999998e-05 2024-04-26T12:28:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966149+0000", 2024-04-26T12:28:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061071650000000003 2024-04-26T12:28:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966171+0000", 2024-04-26T12:28:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1905000000000001e-05 2024-04-26T12:28:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966204+0000", 2024-04-26T12:28:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2845999999999997e-05 2024-04-26T12:28:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:296 3.13 3:ceffbd45:::200.0000000a:head [write 598977~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.360147921999999, 2024-04-26T12:28:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041282538000000001, 2024-04-26T12:28:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:28:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924979+0000", 2024-04-26T12:28:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3609999999999999e-06 2024-04-26T12:28:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924984+0000", 2024-04-26T12:28:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3259999999999997e-06 2024-04-26T12:28:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924987+0000", 2024-04-26T12:28:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7810000000000001e-06 2024-04-26T12:28:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960618+0000", 2024-04-26T12:28:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035631875 2024-04-26T12:28:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960698+0000", 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9373000000000001e-05 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966208+0000", 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055104359999999996 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966228+0000", 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0208e-05 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966260+0000", 2024-04-26T12:28:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1404e-05 2024-04-26T12:28:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:297 3.13 3:ceffbd45:::200.0000000a:head [write 600380~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.360111088, 2024-04-26T12:28:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041309850000000002, 2024-04-26T12:28:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925017+0000", 2024-04-26T12:28:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.96e-06 2024-04-26T12:28:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925020+0000", 2024-04-26T12:28:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6629999999999999e-06 2024-04-26T12:28:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925023+0000", 2024-04-26T12:28:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:28:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961241+0000", 2024-04-26T12:28:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036217390000000002 2024-04-26T12:28:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961335+0000", 2024-04-26T12:28:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4537000000000006e-05 2024-04-26T12:28:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966264+0000", 2024-04-26T12:28:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004928516 2024-04-26T12:28:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966290+0000", 2024-04-26T12:28:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5658999999999999e-05 2024-04-26T12:28:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966324+0000", 2024-04-26T12:28:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4459000000000003e-05 2024-04-26T12:28:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:298 3.13 3:ceffbd45:::200.0000000a:head [write 602634~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.360078493, 2024-04-26T12:28:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046387536, 2024-04-26T12:28:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925046+0000", 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925049+0000", 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4770000000000002e-06 2024-04-26T12:28:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925057+0000", 2024-04-26T12:28:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9219999999999997e-06 2024-04-26T12:28:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925062+0000", 2024-04-26T12:28:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:28:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961918+0000", 2024-04-26T12:28:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036856170000000001 2024-04-26T12:28:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962014+0000", 2024-04-26T12:28:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6731999999999995e-05 2024-04-26T12:28:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971360+0000", 2024-04-26T12:28:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0093454569999999997 2024-04-26T12:28:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971393+0000", 2024-04-26T12:28:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3130999999999998e-05 2024-04-26T12:28:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971434+0000", 2024-04-26T12:28:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1244e-05 2024-04-26T12:28:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:299 3.13 3:ceffbd45:::200.0000000a:head [write 604033~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:57.316 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.360024662000001, 2024-04-26T12:28:57.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046395615000000001, 2024-04-26T12:28:57.316 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.316 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.316 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:57.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:28:57.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925100+0000", 2024-04-26T12:28:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925103+0000", 2024-04-26T12:28:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3520000000000001e-06 2024-04-26T12:28:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925108+0000", 2024-04-26T12:28:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6489999999999996e-06 2024-04-26T12:28:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925111+0000", 2024-04-26T12:28:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.79e-06 2024-04-26T12:28:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962405+0000", 2024-04-26T12:28:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037293953999999997 2024-04-26T12:28:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962457+0000", 2024-04-26T12:28:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2003000000000003e-05 2024-04-26T12:28:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971440+0000", 2024-04-26T12:28:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0089831719999999993 2024-04-26T12:28:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971463+0000", 2024-04-26T12:28:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3201e-05 2024-04-26T12:28:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971496+0000", 2024-04-26T12:28:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2836000000000002e-05 2024-04-26T12:28:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:300 3.13 3:ceffbd45:::200.0000000a:head [write 605436~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.359960804, 2024-04-26T12:28:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046389606999999999, 2024-04-26T12:28:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:28:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925167+0000", 2024-04-26T12:28:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8870000000000001e-06 2024-04-26T12:28:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925171+0000", 2024-04-26T12:28:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6049999999999998e-06 2024-04-26T12:28:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925173+0000", 2024-04-26T12:28:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8250000000000001e-06 2024-04-26T12:28:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962740+0000", 2024-04-26T12:28:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037566436000000002 2024-04-26T12:28:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962818+0000", 2024-04-26T12:28:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8231000000000004e-05 2024-04-26T12:28:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971501+0000", 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008682525 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971522+0000", 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1673999999999999e-05 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971554+0000", 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1786999999999999e-05 2024-04-26T12:28:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:301 3.13 3:ceffbd45:::200.0000000a:head [write 606838~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.359944196000001, 2024-04-26T12:28:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046429455000000001, 2024-04-26T12:28:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:28:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:28:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925183+0000", 2024-04-26T12:28:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0150000000000002e-06 2024-04-26T12:28:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925186+0000", 2024-04-26T12:28:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2210000000000002e-06 2024-04-26T12:28:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925190+0000", 2024-04-26T12:28:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8489999999999999e-06 2024-04-26T12:28:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963304+0000", 2024-04-26T12:28:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038114207999999997 2024-04-26T12:28:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963356+0000", 2024-04-26T12:28:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1628000000000001e-05 2024-04-26T12:28:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971558+0000", 2024-04-26T12:28:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082025199999999996 2024-04-26T12:28:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971579+0000", 2024-04-26T12:28:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1019e-05 2024-04-26T12:28:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971610+0000", 2024-04-26T12:28:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1205999999999999e-05 2024-04-26T12:28:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:302 3.13 3:ceffbd45:::200.0000000a:head [write 608236~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.359923003, 2024-04-26T12:28:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046464057000000003, 2024-04-26T12:28:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:28:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925204+0000", 2024-04-26T12:28:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1270000000000001e-06 2024-04-26T12:28:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925207+0000", 2024-04-26T12:28:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3720000000000001e-06 2024-04-26T12:28:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925210+0000", 2024-04-26T12:28:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7489999999999999e-06 2024-04-26T12:28:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963713+0000", 2024-04-26T12:28:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038502508999999997 2024-04-26T12:28:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963792+0000", 2024-04-26T12:28:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9087999999999999e-05 2024-04-26T12:28:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971615+0000", 2024-04-26T12:28:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078230130000000002 2024-04-26T12:28:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971636+0000", 2024-04-26T12:28:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0996999999999999e-05 2024-04-26T12:28:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971666+0000", 2024-04-26T12:28:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0443999999999999e-05 2024-04-26T12:28:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:303 3.13 3:ceffbd45:::200.0000000a:head [write 609649~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.359879982000001, 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.047363031, 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:28:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925253+0000", 2024-04-26T12:28:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0369999999999995e-06 2024-04-26T12:28:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925261+0000", 2024-04-26T12:28:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7420000000000003e-06 2024-04-26T12:28:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925271+0000", 2024-04-26T12:28:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1589999999999999e-06 2024-04-26T12:28:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964198+0000", 2024-04-26T12:28:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038927182999999997 2024-04-26T12:28:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964281+0000", 2024-04-26T12:28:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3355000000000004e-05 2024-04-26T12:28:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972542+0000", 2024-04-26T12:28:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082607930000000006 2024-04-26T12:28:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972570+0000", 2024-04-26T12:28:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7937999999999999e-05 2024-04-26T12:28:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972608+0000", 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8384999999999999e-05 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:304 3.13 3:ceffbd45:::200.0000000a:head [write 611057~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.358714353, 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046259867000000003, 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:57.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:28:57.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926410+0000", 2024-04-26T12:28:57.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926415+0000", 2024-04-26T12:28:57.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7999999999999998e-06 2024-04-26T12:28:57.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926423+0000", 2024-04-26T12:28:57.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8569999999999995e-06 2024-04-26T12:28:57.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926429+0000", 2024-04-26T12:28:57.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.421e-06 2024-04-26T12:28:57.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964778+0000", 2024-04-26T12:28:57.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038349045999999998 2024-04-26T12:28:57.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964830+0000", 2024-04-26T12:28:57.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1309e-05 2024-04-26T12:28:57.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972614+0000", 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077847070000000001 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972638+0000", 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3388999999999999e-05 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972671+0000", 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2999e-05 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:305 3.13 3:ceffbd45:::200.0000000a:head [write 613824~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.358669314, 2024-04-26T12:28:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046273460000000002, 2024-04-26T12:28:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926463+0000", 2024-04-26T12:28:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:28:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926467+0000", 2024-04-26T12:28:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3000000000000003e-06 2024-04-26T12:28:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926470+0000", 2024-04-26T12:28:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1930000000000002e-06 2024-04-26T12:28:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965122+0000", 2024-04-26T12:28:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038652207000000001 2024-04-26T12:28:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965210+0000", 2024-04-26T12:28:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7832999999999997e-05 2024-04-26T12:28:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972675+0000", 2024-04-26T12:28:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074651450000000003 2024-04-26T12:28:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972696+0000", 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0871999999999999e-05 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972729+0000", 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:306 3.13 3:ceffbd45:::200.0000000a:head [write 618844~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.357826569, 2024-04-26T12:28:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.04548866, 2024-04-26T12:28:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:28:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927298+0000", 2024-04-26T12:28:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927303+0000", 2024-04-26T12:28:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6079999999999998e-06 2024-04-26T12:28:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927310+0000", 2024-04-26T12:28:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6240000000000002e-06 2024-04-26T12:28:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927319+0000", 2024-04-26T12:28:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:28:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965791+0000", 2024-04-26T12:28:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038471350000000001 2024-04-26T12:28:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965839+0000", 2024-04-26T12:28:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8647999999999999e-05 2024-04-26T12:28:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972735+0000", 2024-04-26T12:28:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068952429999999997 2024-04-26T12:28:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972755+0000", 2024-04-26T12:28:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0219000000000001e-05 2024-04-26T12:28:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972787+0000", 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2450000000000003e-05 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:307 3.13 3:ceffbd45:::200.0000000a:head [write 621801~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.357777004000001, 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.045498166, 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:28:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927351+0000", 2024-04-26T12:28:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7130000000000001e-06 2024-04-26T12:28:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927355+0000", 2024-04-26T12:28:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1339999999999997e-06 2024-04-26T12:28:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927358+0000", 2024-04-26T12:28:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:28:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966366+0000", 2024-04-26T12:28:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039008207000000003 2024-04-26T12:28:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966457+0000", 2024-04-26T12:28:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1144999999999996e-05 2024-04-26T12:28:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972792+0000", 2024-04-26T12:28:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0063344819999999998 2024-04-26T12:28:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972815+0000", 2024-04-26T12:28:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3336000000000002e-05 2024-04-26T12:28:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972846+0000", 2024-04-26T12:28:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1504000000000002e-05 2024-04-26T12:28:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:308 3.13 3:ceffbd45:::200.0000000a:head [write 623718~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.356098959000001, 2024-04-26T12:28:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043878271000000003, 2024-04-26T12:28:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929042+0000", 2024-04-26T12:28:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6039e-05 2024-04-26T12:28:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929054+0000", 2024-04-26T12:28:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2275e-05 2024-04-26T12:28:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929063+0000", 2024-04-26T12:28:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7150000000000004e-06 2024-04-26T12:28:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967060+0000", 2024-04-26T12:28:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037996907000000003 2024-04-26T12:28:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967117+0000", 2024-04-26T12:28:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7701999999999997e-05 2024-04-26T12:28:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972850+0000", 2024-04-26T12:28:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0057332679999999997 2024-04-26T12:28:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972872+0000", 2024-04-26T12:28:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1138999999999999e-05 2024-04-26T12:28:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972905+0000", 2024-04-26T12:28:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2904999999999998e-05 2024-04-26T12:28:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:309 3.13 3:ceffbd45:::200.0000000a:head [write 638707~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.355275848, 2024-04-26T12:28:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043114311000000002, 2024-04-26T12:28:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:28:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929853+0000", 2024-04-26T12:28:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2690000000000001e-06 2024-04-26T12:28:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929861+0000", 2024-04-26T12:28:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.515e-06 2024-04-26T12:28:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929867+0000", 2024-04-26T12:28:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4640000000000003e-06 2024-04-26T12:28:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967590+0000", 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037722506000000003 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967672+0000", 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2082000000000005e-05 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972908+0000", 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052366289999999996 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972929+0000", 2024-04-26T12:28:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0752999999999999e-05 2024-04-26T12:28:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972964+0000", 2024-04-26T12:28:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4666999999999999e-05 2024-04-26T12:28:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:310 3.13 3:ceffbd45:::200.0000000a:head [write 641140~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.355228575, 2024-04-26T12:28:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043126171999999997, 2024-04-26T12:28:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:28:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929896+0000", 2024-04-26T12:28:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929899+0000", 2024-04-26T12:28:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-04-26T12:28:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929903+0000", 2024-04-26T12:28:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.087e-06 2024-04-26T12:28:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929907+0000", 2024-04-26T12:28:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1480000000000002e-06 2024-04-26T12:28:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.969962+0000", 2024-04-26T12:28:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040055457000000003 2024-04-26T12:28:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970018+0000", 2024-04-26T12:28:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6209999999999999e-05 2024-04-26T12:28:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972968+0000", 2024-04-26T12:28:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029501689999999999 2024-04-26T12:28:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972989+0000", 2024-04-26T12:28:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0618000000000001e-05 2024-04-26T12:28:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.973023+0000", 2024-04-26T12:28:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-26T12:28:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:312 3.13 3:ceffbd45:::200.0000000a:head [write 648907~1910 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.34989932, 2024-04-26T12:28:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039844011999999998, 2024-04-26T12:28:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:28:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935225+0000", 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935229+0000", 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1790000000000001e-06 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935235+0000", 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.716e-06 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935239+0000", 2024-04-26T12:28:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5379999999999998e-06 2024-04-26T12:28:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970917+0000", 2024-04-26T12:28:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035678223000000002 2024-04-26T12:28:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971006+0000", 2024-04-26T12:28:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9248999999999999e-05 2024-04-26T12:28:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.974984+0000", 2024-04-26T12:28:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039776769999999998 2024-04-26T12:28:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975031+0000", 2024-04-26T12:28:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7500000000000003e-05 2024-04-26T12:28:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975070+0000", 2024-04-26T12:28:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8509e-05 2024-04-26T12:28:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:313 3.13 3:ceffbd45:::200.0000000a:head [write 650817~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 14.349672992, 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040236782999999998, 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:28:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:28:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:28:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:28:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935451+0000", 2024-04-26T12:28:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:28:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:28:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935457+0000", 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5079999999999996e-06 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935467+0000", 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0407e-05 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935477+0000", 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3989999999999993e-06 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:28:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971691+0000", 2024-04-26T12:28:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036214534 2024-04-26T12:28:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:28:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971741+0000", 2024-04-26T12:28:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0294000000000003e-05 2024-04-26T12:28:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:28:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975619+0000", 2024-04-26T12:28:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038779259999999999 2024-04-26T12:28:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:28:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975647+0000", 2024-04-26T12:28:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:28:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:28:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:28:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:28:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975689+0000", 2024-04-26T12:28:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2055999999999998e-05 2024-04-26T12:28:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:28:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:28:57.381 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:57.383 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:57.383 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:57.381+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:57.486 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:57.484+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:57.587 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:57.584+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:57.588 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:57.588 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:57.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.588 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11368 4.1f 4:fbd0e3b3:::10000002ccd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.588 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.582889+0000", 2024-04-26T12:28:57.588 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.00159665, 2024-04-26T12:28:57.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0016226159999999999, 2024-04-26T12:28:57.588 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.588 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:57.588 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582889+0000", 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582889+0000", 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582888+0000", 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:57.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582893+0000", 2024-04-26T12:28:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8110000000000002e-06 2024-04-26T12:28:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582902+0000", 2024-04-26T12:28:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1309999999999995e-06 2024-04-26T12:28:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582909+0000", 2024-04-26T12:28:57.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0380000000000002e-06 2024-04-26T12:28:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582945+0000", 2024-04-26T12:28:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5141000000000001e-05 2024-04-26T12:28:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583056+0000", 2024-04-26T12:28:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000111288 2024-04-26T12:28:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:57.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583498+0000", 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00044211199999999998 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11369 4.17 4:eb2105fb:::10000002cce.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.582947+0000", 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.0015393570000000001, 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001655817, 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582947+0000", 2024-04-26T12:28:57.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582947+0000", 2024-04-26T12:28:57.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582946+0000", 2024-04-26T12:28:57.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582948+0000", 2024-04-26T12:28:57.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3070000000000001e-06 2024-04-26T12:28:57.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582953+0000", 2024-04-26T12:28:57.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.763e-06 2024-04-26T12:28:57.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582957+0000", 2024-04-26T12:28:57.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8999999999999999e-06 2024-04-26T12:28:57.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583462+0000", 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000504475 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583569+0000", 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107824 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583664+0000", 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4525999999999996e-05 2024-04-26T12:28:57.595 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11370 4.22 4:4726691b:::10000002ccf.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.582961+0000", 2024-04-26T12:28:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.0015251360000000001, 2024-04-26T12:28:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001731013, 2024-04-26T12:28:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582961+0000", 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582961+0000", 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582960+0000", 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582962+0000", 2024-04-26T12:28:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5179999999999999e-06 2024-04-26T12:28:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582965+0000", 2024-04-26T12:28:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.129e-06 2024-04-26T12:28:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582968+0000", 2024-04-26T12:28:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6709999999999999e-06 2024-04-26T12:28:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583510+0000", 2024-04-26T12:28:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00054218099999999998 2024-04-26T12:28:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583597+0000", 2024-04-26T12:28:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6788999999999999e-05 2024-04-26T12:28:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583690+0000", 2024-04-26T12:28:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3078999999999994e-05 2024-04-26T12:28:57.599 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11321 4.20 4:04f5fb49:::10000001e01.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.576950+0000", 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.0075361120000000002, 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078219080000000007, 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.576950+0000", 2024-04-26T12:28:57.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.576950+0000", 2024-04-26T12:28:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.576950+0000", 2024-04-26T12:28:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:28:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.576959+0000", 2024-04-26T12:28:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6479999999999998e-06 2024-04-26T12:28:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.576963+0000", 2024-04-26T12:28:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5599999999999998e-06 2024-04-26T12:28:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.576966+0000", 2024-04-26T12:28:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8150000000000002e-06 2024-04-26T12:28:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.580852+0000", 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0038868230000000002 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.580983+0000", 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013018 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.581090+0000", 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107225 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582159+0000", 2024-04-26T12:28:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010694050000000001 2024-04-26T12:28:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11371 4.15 4:abb9092d:::10000002cd0.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.583048+0000", 2024-04-26T12:28:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.001438206, 2024-04-26T12:28:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018203169999999999, 2024-04-26T12:28:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.604 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583048+0000", 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583048+0000", 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583047+0000", 2024-04-26T12:28:57.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583049+0000", 2024-04-26T12:28:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0449999999999999e-06 2024-04-26T12:28:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583054+0000", 2024-04-26T12:28:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3089999999999997e-06 2024-04-26T12:28:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583058+0000", 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9179999999999996e-06 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583431+0000", 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037350600000000001 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583544+0000", 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112612 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11323 4.20 4:05122c4e:::10000001e03.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.576980+0000", 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.0075054509999999998, 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080005930000000003, 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.576980+0000", 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.576980+0000", 2024-04-26T12:28:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.576980+0000", 2024-04-26T12:28:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:28:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.576982+0000", 2024-04-26T12:28:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.449e-06 2024-04-26T12:28:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.576985+0000", 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1250000000000001e-06 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.576987+0000", 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5270000000000001e-06 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.581456+0000", 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044687310000000001 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.581527+0000", 2024-04-26T12:28:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0755999999999998e-05 2024-04-26T12:28:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.581597+0000", 2024-04-26T12:28:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0062999999999996e-05 2024-04-26T12:28:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583624+0000", 2024-04-26T12:28:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020271070000000002 2024-04-26T12:28:57.611 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11373 4.3a 4:5e14edba:::10000002cd2.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.583091+0000", 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.0013951149999999999, 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001990215, 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583091+0000", 2024-04-26T12:28:57.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583091+0000", 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583090+0000", 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583093+0000", 2024-04-26T12:28:57.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2919999999999998e-06 2024-04-26T12:28:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584336+0000", 2024-04-26T12:28:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001243737 2024-04-26T12:28:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584344+0000", 2024-04-26T12:28:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0080000000000002e-06 2024-04-26T12:28:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584384+0000", 2024-04-26T12:28:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9863000000000001e-05 2024-04-26T12:28:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584868+0000", 2024-04-26T12:28:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00048410400000000001 2024-04-26T12:28:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584969+0000", 2024-04-26T12:28:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100615 2024-04-26T12:28:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.615 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11374 4.13 4:ca460221:::10000002cd3.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.584356+0000", 2024-04-26T12:28:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.00012997, 2024-04-26T12:28:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00080411600000000001, 2024-04-26T12:28:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584356+0000", 2024-04-26T12:28:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584356+0000", 2024-04-26T12:28:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584355+0000", 2024-04-26T12:28:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584359+0000", 2024-04-26T12:28:57.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2019999999999997e-06 2024-04-26T12:28:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584369+0000", 2024-04-26T12:28:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3700000000000001e-06 2024-04-26T12:28:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584374+0000", 2024-04-26T12:28:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6459999999999998e-06 2024-04-26T12:28:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584515+0000", 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014087099999999999 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584635+0000", 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119832 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584728+0000", 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2560999999999997e-05 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.619 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11375 4.15 4:a850ec73:::10000002cd4.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.584387+0000", 2024-04-26T12:28:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.8555999999999996e-05, 2024-04-26T12:28:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00084764499999999995, 2024-04-26T12:28:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584387+0000", 2024-04-26T12:28:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584387+0000", 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584387+0000", 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584390+0000", 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.038e-06 2024-04-26T12:28:57.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584396+0000", 2024-04-26T12:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2949999999999999e-06 2024-04-26T12:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584494+0000", 2024-04-26T12:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8016999999999993e-05 2024-04-26T12:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584616+0000", 2024-04-26T12:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000122285 2024-04-26T12:28:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584756+0000", 2024-04-26T12:28:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013911899999999999 2024-04-26T12:28:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11352 4.18 4:1a89514c:::10000001e74.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.580303+0000", 2024-04-26T12:28:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.004183132, 2024-04-26T12:28:57.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050276349999999999, 2024-04-26T12:28:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.580303+0000", 2024-04-26T12:28:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.580303+0000", 2024-04-26T12:28:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.580302+0000", 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.580304+0000", 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9920000000000002e-06 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.580310+0000", 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2549999999999997e-06 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.580314+0000", 2024-04-26T12:28:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5340000000000001e-06 2024-04-26T12:28:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584157+0000", 2024-04-26T12:28:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0038429639999999999 2024-04-26T12:28:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584234+0000", 2024-04-26T12:28:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6519000000000004e-05 2024-04-26T12:28:57.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584327+0000", 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3504000000000005e-05 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop_reply(mds.0.3:11345 4.38 e56/46)", 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.584708+0000", 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9997778, 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00071096699999999996, 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.627 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584708+0000", 2024-04-26T12:28:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584708+0000", 2024-04-26T12:28:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584707+0000", 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584711+0000", 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3239999999999999e-06 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584718+0000", 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4240000000000004e-06 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584724+0000", 2024-04-26T12:28:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7200000000000003e-06 2024-04-26T12:28:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11353 4.30 4.43bffb30 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.580320+0000", 2024-04-26T12:28:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.0041661329999999998, 2024-04-26T12:28:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051517220000000001, 2024-04-26T12:28:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.630 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.580320+0000", 2024-04-26T12:28:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.580320+0000", 2024-04-26T12:28:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.580319+0000", 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.580321+0000", 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.058e-06 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.580328+0000", 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6449999999999999e-06 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.580334+0000", 2024-04-26T12:28:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6949999999999997e-06 2024-04-26T12:28:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11376 4.37 4:eceb163d:::10000002cd5.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.584965+0000", 2024-04-26T12:28:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9995208, 2024-04-26T12:28:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00053769400000000002, 2024-04-26T12:28:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584965+0000", 2024-04-26T12:28:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584965+0000", 2024-04-26T12:28:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584964+0000", 2024-04-26T12:28:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:57.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584969+0000", 2024-04-26T12:28:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6859999999999997e-06 2024-04-26T12:28:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584978+0000", 2024-04-26T12:28:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0440000000000001e-06 2024-04-26T12:28:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584985+0000", 2024-04-26T12:28:57.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0929999999999997e-06 2024-04-26T12:28:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585022+0000", 2024-04-26T12:28:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7357999999999997e-05 2024-04-26T12:28:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585139+0000", 2024-04-26T12:28:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116624 2024-04-26T12:28:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.636 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop_reply(mds.0.3:11368 4.1f e56/46)", 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.584985+0000", 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9995008, 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00055276200000000004, 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584985+0000", 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584985+0000", 2024-04-26T12:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584984+0000", 2024-04-26T12:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584988+0000", 2024-04-26T12:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0289999999999999e-06 2024-04-26T12:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584996+0000", 2024-04-26T12:28:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5619999999999998e-06 2024-04-26T12:28:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585008+0000", 2024-04-26T12:28:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1792e-05 2024-04-26T12:28:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11377 3.14 3:2dfa4e72:::10000002cd6.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.584996+0000", 2024-04-26T12:28:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9994903, 2024-04-26T12:28:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00057694199999999999, 2024-04-26T12:28:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584996+0000", 2024-04-26T12:28:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584996+0000", 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584995+0000", 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584998+0000", 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3550000000000001e-06 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585005+0000", 2024-04-26T12:28:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3990000000000001e-06 2024-04-26T12:28:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585010+0000", 2024-04-26T12:28:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0679999999999996e-06 2024-04-26T12:28:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585300+0000", 2024-04-26T12:28:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000290196 2024-04-26T12:28:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585418+0000", 2024-04-26T12:28:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118378 2024-04-26T12:28:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11378 4.1 4:807224fc:::10000002cd7.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585019+0000", 2024-04-26T12:28:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9994664, 2024-04-26T12:28:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059729900000000003, 2024-04-26T12:28:57.643 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585019+0000", 2024-04-26T12:28:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585019+0000", 2024-04-26T12:28:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585019+0000", 2024-04-26T12:28:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585021+0000", 2024-04-26T12:28:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5780000000000001e-06 2024-04-26T12:28:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585028+0000", 2024-04-26T12:28:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4710000000000004e-06 2024-04-26T12:28:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585033+0000", 2024-04-26T12:28:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2009999999999998e-06 2024-04-26T12:28:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585063+0000", 2024-04-26T12:28:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9890999999999999e-05 2024-04-26T12:28:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585161+0000", 2024-04-26T12:28:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8318000000000003e-05 2024-04-26T12:28:57.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585242+0000", 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0241000000000006e-05 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop_reply(mds.0.3:11369 4.17 e56/46)", 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585022+0000", 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9994636, 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00063450300000000002, 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.647 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.648 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585022+0000", 2024-04-26T12:28:57.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585022+0000", 2024-04-26T12:28:57.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585022+0000", 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585025+0000", 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0290000000000001e-06 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585031+0000", 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3729999999999998e-06 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585036+0000", 2024-04-26T12:28:57.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9339999999999997e-06 2024-04-26T12:28:57.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.650 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.650 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11379 4.27 4.bf45227 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.650 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585041+0000", 2024-04-26T12:28:57.650 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9994445, 2024-04-26T12:28:57.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064588799999999995, 2024-04-26T12:28:57.650 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.650 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.650 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585041+0000", 2024-04-26T12:28:57.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585041+0000", 2024-04-26T12:28:57.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585041+0000", 2024-04-26T12:28:57.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585043+0000", 2024-04-26T12:28:57.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2579999999999998e-06 2024-04-26T12:28:57.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585050+0000", 2024-04-26T12:28:57.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7889999999999997e-06 2024-04-26T12:28:57.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585055+0000", 2024-04-26T12:28:57.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.361e-06 2024-04-26T12:28:57.653 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.653 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.653 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.653 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11337 4.0 4:0380dbbe:::10000001e11.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.653 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.577830+0000", 2024-04-26T12:28:57.653 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.0066557049999999996, 2024-04-26T12:28:57.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078873160000000001, 2024-04-26T12:28:57.653 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.653 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:57.653 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.577830+0000", 2024-04-26T12:28:57.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.577830+0000", 2024-04-26T12:28:57.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.577830+0000", 2024-04-26T12:28:57.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.577832+0000", 2024-04-26T12:28:57.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.934e-06 2024-04-26T12:28:57.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.577837+0000", 2024-04-26T12:28:57.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0499999999999999e-06 2024-04-26T12:28:57.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.577841+0000", 2024-04-26T12:28:57.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1670000000000001e-06 2024-04-26T12:28:57.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.581453+0000", 2024-04-26T12:28:57.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036121069999999998 2024-04-26T12:28:57.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.581596+0000", 2024-04-26T12:28:57.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000142707 2024-04-26T12:28:57.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:57.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.581702+0000", 2024-04-26T12:28:57.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010623 2024-04-26T12:28:57.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:57.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584121+0000", 2024-04-26T12:28:57.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024187480000000001 2024-04-26T12:28:57.657 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.657 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.657 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.658 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11380 4.23 4:c5d58db6:::10000002cd9.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.658 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585060+0000", 2024-04-26T12:28:57.658 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9994264, 2024-04-26T12:28:57.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00070260799999999997, 2024-04-26T12:28:57.658 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.658 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T12:28:57.658 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585060+0000", 2024-04-26T12:28:57.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585060+0000", 2024-04-26T12:28:57.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585059+0000", 2024-04-26T12:28:57.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585061+0000", 2024-04-26T12:28:57.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1040000000000001e-06 2024-04-26T12:28:57.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585067+0000", 2024-04-26T12:28:57.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7760000000000003e-06 2024-04-26T12:28:57.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585072+0000", 2024-04-26T12:28:57.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5889999999999996e-06 2024-04-26T12:28:57.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585361+0000", 2024-04-26T12:28:57.660 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000289504 2024-04-26T12:28:57.660 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.661 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.661 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.661 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11381 4.3e 4.7c4232be (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.661 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585078+0000", 2024-04-26T12:28:57.661 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9994078, 2024-04-26T12:28:57.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00071838900000000005, 2024-04-26T12:28:57.661 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.661 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.661 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585078+0000", 2024-04-26T12:28:57.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585078+0000", 2024-04-26T12:28:57.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585078+0000", 2024-04-26T12:28:57.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585080+0000", 2024-04-26T12:28:57.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4590000000000001e-06 2024-04-26T12:28:57.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585086+0000", 2024-04-26T12:28:57.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9599999999999997e-06 2024-04-26T12:28:57.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585091+0000", 2024-04-26T12:28:57.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1429999999999997e-06 2024-04-26T12:28:57.663 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.663 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.664 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.664 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11382 4.8 4.9e067948 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.664 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585100+0000", 2024-04-26T12:28:57.664 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9993863, 2024-04-26T12:28:57.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00072777400000000004, 2024-04-26T12:28:57.664 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.664 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.664 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585100+0000", 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585100+0000", 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585099+0000", 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585101+0000", 2024-04-26T12:28:57.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3259999999999998e-06 2024-04-26T12:28:57.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585107+0000", 2024-04-26T12:28:57.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8019999999999997e-06 2024-04-26T12:28:57.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585113+0000", 2024-04-26T12:28:57.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.378e-06 2024-04-26T12:28:57.666 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11383 4.3e 4.15da3bbe (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585117+0000", 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9993687, 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00073706200000000003, 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585117+0000", 2024-04-26T12:28:57.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585117+0000", 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585117+0000", 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585119+0000", 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3149999999999999e-06 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585126+0000", 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6529999999999997e-06 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585132+0000", 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9689999999999999e-06 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.670 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11343 4.0 4:01145b59:::10000001e6d.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.670 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.578221+0000", 2024-04-26T12:28:57.670 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.006264922, 2024-04-26T12:28:57.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076609549999999997, 2024-04-26T12:28:57.670 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.670 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:57.670 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578221+0000", 2024-04-26T12:28:57.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578221+0000", 2024-04-26T12:28:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578220+0000", 2024-04-26T12:28:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578224+0000", 2024-04-26T12:28:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9160000000000003e-06 2024-04-26T12:28:57.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578232+0000", 2024-04-26T12:28:57.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2749999999999995e-06 2024-04-26T12:28:57.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578239+0000", 2024-04-26T12:28:57.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9360000000000002e-06 2024-04-26T12:28:57.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582187+0000", 2024-04-26T12:28:57.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039474810000000001 2024-04-26T12:28:57.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582315+0000", 2024-04-26T12:28:57.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012807199999999999 2024-04-26T12:28:57.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:57.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582419+0000", 2024-04-26T12:28:57.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010415400000000001 2024-04-26T12:28:57.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:28:57.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584139+0000", 2024-04-26T12:28:57.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001719513 2024-04-26T12:28:57.674 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.674 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.674 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.674 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11384 4.3d 4:be36f9dd:::10000002cdd.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.674 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585136+0000", 2024-04-26T12:28:57.674 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9993496, 2024-04-26T12:28:57.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00079096400000000001, 2024-04-26T12:28:57.674 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.674 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:57.674 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585136+0000", 2024-04-26T12:28:57.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585136+0000", 2024-04-26T12:28:57.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585136+0000", 2024-04-26T12:28:57.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585138+0000", 2024-04-26T12:28:57.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0899999999999999e-06 2024-04-26T12:28:57.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585144+0000", 2024-04-26T12:28:57.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:28:57.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585150+0000", 2024-04-26T12:28:57.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5319999999999997e-06 2024-04-26T12:28:57.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585199+0000", 2024-04-26T12:28:57.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9268000000000003e-05 2024-04-26T12:28:57.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585319+0000", 2024-04-26T12:28:57.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000119474 2024-04-26T12:28:57.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:57.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585413+0000", 2024-04-26T12:28:57.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4851000000000004e-05 2024-04-26T12:28:57.678 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.678 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.678 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.678 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11385 4.2f 4.4a12a06f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.678 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585155+0000", 2024-04-26T12:28:57.678 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.999331, 2024-04-26T12:28:57.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00081088899999999997, 2024-04-26T12:28:57.678 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.678 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.678 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585155+0000", 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585155+0000", 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585155+0000", 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585157+0000", 2024-04-26T12:28:57.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.108e-06 2024-04-26T12:28:57.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585162+0000", 2024-04-26T12:28:57.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3210000000000004e-06 2024-04-26T12:28:57.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585167+0000", 2024-04-26T12:28:57.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.831e-06 2024-04-26T12:28:57.680 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.681 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.681 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.681 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11345 4.38 4:1c968463:::10000001e6f.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.681 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.578271+0000", 2024-04-26T12:28:57.681 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.0062145949999999998, 2024-04-26T12:28:57.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077285110000000004, 2024-04-26T12:28:57.681 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.681 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:57.681 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578271+0000", 2024-04-26T12:28:57.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578271+0000", 2024-04-26T12:28:57.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578271+0000", 2024-04-26T12:28:57.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578273+0000", 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.632e-06 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578280+0000", 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3069999999999999e-06 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578285+0000", 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.904e-06 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582735+0000", 2024-04-26T12:28:57.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044505259999999998 2024-04-26T12:28:57.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582856+0000", 2024-04-26T12:28:57.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121037 2024-04-26T12:28:57.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:57.684 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582961+0000", 2024-04-26T12:28:57.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105097 2024-04-26T12:28:57.684 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.684 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.685 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.685 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11386 4.35 4.88b215f5 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.685 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585174+0000", 2024-04-26T12:28:57.685 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9993114, 2024-04-26T12:28:57.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00087284299999999999, 2024-04-26T12:28:57.685 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.685 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.685 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585174+0000", 2024-04-26T12:28:57.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585174+0000", 2024-04-26T12:28:57.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585174+0000", 2024-04-26T12:28:57.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585176+0000", 2024-04-26T12:28:57.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2649999999999999e-06 2024-04-26T12:28:57.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585182+0000", 2024-04-26T12:28:57.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8259999999999998e-06 2024-04-26T12:28:57.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585187+0000", 2024-04-26T12:28:57.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0860000000000001e-06 2024-04-26T12:28:57.687 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.687 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.687 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.688 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11346 4.30 4:0dc0d15f:::10000001e70.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.689 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.578296+0000", 2024-04-26T12:28:57.689 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.006189857, 2024-04-26T12:28:57.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007809842, 2024-04-26T12:28:57.689 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.689 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:28:57.689 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.689 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.689 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578296+0000", 2024-04-26T12:28:57.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578296+0000", 2024-04-26T12:28:57.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578295+0000", 2024-04-26T12:28:57.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578298+0000", 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6309999999999999e-06 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578305+0000", 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.528e-06 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.578310+0000", 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1000000000000003e-06 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.583782+0000", 2024-04-26T12:28:57.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054721500000000003 2024-04-26T12:28:57.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584563+0000", 2024-04-26T12:28:57.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00078078000000000002 2024-04-26T12:28:57.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 0", 2024-04-26T12:28:57.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.584664+0000", 2024-04-26T12:28:57.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101358 2024-04-26T12:28:57.692 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.692 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11366 4.10 4.16174e10 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.582069+0000", 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.0024171829999999998, 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041161449999999999, 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582069+0000", 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582069+0000", 2024-04-26T12:28:57.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582068+0000", 2024-04-26T12:28:57.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582071+0000", 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8550000000000002e-06 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582078+0000", 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1110000000000002e-06 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582084+0000", 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5709999999999997e-06 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.696 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11387 4.1f 4.19dc041f (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.696 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585191+0000", 2024-04-26T12:28:57.696 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9992948, 2024-04-26T12:28:57.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001049024, 2024-04-26T12:28:57.696 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.696 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.696 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585191+0000", 2024-04-26T12:28:57.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585191+0000", 2024-04-26T12:28:57.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585191+0000", 2024-04-26T12:28:57.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585193+0000", 2024-04-26T12:28:57.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.889e-06 2024-04-26T12:28:57.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585198+0000", 2024-04-26T12:28:57.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:28:57.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585202+0000", 2024-04-26T12:28:57.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4880000000000001e-06 2024-04-26T12:28:57.698 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.698 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.698 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.699 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11367 4.38 4.db6a6b8 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.699 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.582089+0000", 2024-04-26T12:28:57.699 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 0.0023965589999999999, 2024-04-26T12:28:57.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042042490000000002, 2024-04-26T12:28:57.699 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.699 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.699 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582089+0000", 2024-04-26T12:28:57.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582089+0000", 2024-04-26T12:28:57.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582089+0000", 2024-04-26T12:28:57.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582091+0000", 2024-04-26T12:28:57.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3860000000000001e-06 2024-04-26T12:28:57.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582097+0000", 2024-04-26T12:28:57.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5450000000000003e-06 2024-04-26T12:28:57.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.701 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.582101+0000", 2024-04-26T12:28:57.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7589999999999997e-06 2024-04-26T12:28:57.701 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.701 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.701 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.701 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop_reply(mds.0.3:11352 4.18 e56/46 ondisk, result = 0)", 2024-04-26T12:28:57.702 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585206+0000", 2024-04-26T12:28:57.702 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.99928, 2024-04-26T12:28:57.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0011827529999999999, 2024-04-26T12:28:57.702 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.702 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:57.702 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585206+0000", 2024-04-26T12:28:57.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585206+0000", 2024-04-26T12:28:57.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585205+0000", 2024-04-26T12:28:57.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585208+0000", 2024-04-26T12:28:57.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6759999999999999e-06 2024-04-26T12:28:57.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585214+0000", 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4709999999999998e-06 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585219+0000", 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.468e-06 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.586269+0000", 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001049681 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:57.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.586277+0000", 2024-04-26T12:28:57.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9710000000000004e-06 2024-04-26T12:28:57.705 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.705 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.705 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.705 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11388 4.9 4.91582e49 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.705 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585206+0000", 2024-04-26T12:28:57.705 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9992795, 2024-04-26T12:28:57.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001248302, 2024-04-26T12:28:57.705 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.705 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.705 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585206+0000", 2024-04-26T12:28:57.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585206+0000", 2024-04-26T12:28:57.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.706 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.706 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585206+0000", 2024-04-26T12:28:57.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585208+0000", 2024-04-26T12:28:57.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.916e-06 2024-04-26T12:28:57.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585214+0000", 2024-04-26T12:28:57.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6529999999999999e-06 2024-04-26T12:28:57.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585219+0000", 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5799999999999999e-06 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:11389 4.2e 4.bc8057ae (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585224+0000", 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9992623, 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012891630000000001, 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585224+0000", 2024-04-26T12:28:57.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585224+0000", 2024-04-26T12:28:57.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585223+0000", 2024-04-26T12:28:57.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585225+0000", 2024-04-26T12:28:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2960000000000001e-06 2024-04-26T12:28:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585231+0000", 2024-04-26T12:28:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:28:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585236+0000", 2024-04-26T12:28:57.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9189999999999998e-06 2024-04-26T12:28:57.711 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.711 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.711 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.711 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.711 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_repop_reply(mds.0.3:11346 4.30 e56/46)", 2024-04-26T12:28:57.711 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:57.585355+0000", 2024-04-26T12:28:57.711 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4294967295.9991307, 2024-04-26T12:28:57.711 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001214845, 2024-04-26T12:28:57.711 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:57.711 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "queued for pg", 2024-04-26T12:28:57.711 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:57.711 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.711 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:57.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585355+0000", 2024-04-26T12:28:57.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:57.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585355+0000", 2024-04-26T12:28:57.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:57.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.712 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:57.712 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585355+0000", 2024-04-26T12:28:57.712 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:57.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.712 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:57.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585366+0000", 2024-04-26T12:28:57.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1025e-05 2024-04-26T12:28:57.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:57.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585373+0000", 2024-04-26T12:28:57.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3309999999999998e-06 2024-04-26T12:28:57.713 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:57.713 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:57.713 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:57.713 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:57.585379+0000", 2024-04-26T12:28:57.713 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.733e-06 2024-04-26T12:28:57.714 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.714 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:57.714 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.714 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:57.714 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2024-04-26T12:28:57.714 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 36 2024-04-26T12:28:57.714 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:57.715 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:57.715+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:57.716 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:57.816 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:57.815+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:57.865 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2024-04-26T12:28:57.889 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:28:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:28:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:28:57.889 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:57.900 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:57.944 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:57.944+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:58.018 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:58.017+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:58.049 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:28:58.049 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:28:58.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:28:58.049 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:28:58.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.049 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1668 3.18 3:1e8917d7:::200.0000000e:head [write 3543177~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.049 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:58.050 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.128323793, 2024-04-26T12:28:58.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067259575000000002, 2024-04-26T12:28:58.050 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.050 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.050 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:58.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:58.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:28:58.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:58.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919147+0000", 2024-04-26T12:28:58.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.157e-06 2024-04-26T12:28:58.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919151+0000", 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.313e-06 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919154+0000", 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982687+0000", 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063532694000000001 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982750+0000", 2024-04-26T12:28:58.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:28:58.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986254+0000", 2024-04-26T12:28:58.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035043880000000002 2024-04-26T12:28:58.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986322+0000", 2024-04-26T12:28:58.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7458000000000004e-05 2024-04-26T12:28:58.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986404+0000", 2024-04-26T12:28:58.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2015000000000007e-05 2024-04-26T12:28:58.054 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.054 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.054 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.054 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1669 3.18 3:1e8917d7:::200.0000000e:head [write 3544575~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.054 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:58.054 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.128311180000001, 2024-04-26T12:28:58.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067362678999999995, 2024-04-26T12:28:58.054 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.054 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.055 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:58.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:58.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919158+0000", 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.536e-06 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919161+0000", 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919164+0000", 2024-04-26T12:28:58.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:28:58.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983465+0000", 2024-04-26T12:28:58.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064301233999999999 2024-04-26T12:28:58.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983515+0000", 2024-04-26T12:28:58.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9774000000000002e-05 2024-04-26T12:28:58.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986414+0000", 2024-04-26T12:28:58.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0028991770000000002 2024-04-26T12:28:58.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986455+0000", 2024-04-26T12:28:58.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1090000000000001e-05 2024-04-26T12:28:58.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986520+0000", 2024-04-26T12:28:58.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4778999999999998e-05 2024-04-26T12:28:58.058 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.058 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1670 3.18 3:1e8917d7:::200.0000000e:head [write 3545973~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.128301904000001, 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070481470000000004, 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:58.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:28:58.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:28:58.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919172+0000", 2024-04-26T12:28:58.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:28:58.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919175+0000", 2024-04-26T12:28:58.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.942e-06 2024-04-26T12:28:58.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919177+0000", 2024-04-26T12:28:58.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5790000000000002e-06 2024-04-26T12:28:58.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983883+0000", 2024-04-26T12:28:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064705768999999996 2024-04-26T12:28:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983975+0000", 2024-04-26T12:28:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2219999999999995e-05 2024-04-26T12:28:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989262+0000", 2024-04-26T12:28:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052864940000000001 2024-04-26T12:28:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989361+0000", 2024-04-26T12:28:58.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9374000000000001e-05 2024-04-26T12:28:58.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989648+0000", 2024-04-26T12:28:58.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028677200000000003 2024-04-26T12:28:58.063 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.063 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.063 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.064 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1671 3.18 3:1e8917d7:::200.0000000e:head [write 3547932~12451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.064 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:58.064 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.127006786999999, 2024-04-26T12:28:58.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069443256999999994, 2024-04-26T12:28:58.064 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.064 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.064 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:58.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:28:58.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920460+0000", 2024-04-26T12:28:58.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:58.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920542+0000", 2024-04-26T12:28:58.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650999999999995e-05 2024-04-26T12:28:58.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920554+0000", 2024-04-26T12:28:58.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2228e-05 2024-04-26T12:28:58.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920560+0000", 2024-04-26T12:28:58.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8869999999999997e-06 2024-04-26T12:28:58.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984749+0000", 2024-04-26T12:28:58.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064188913 2024-04-26T12:28:58.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984795+0000", 2024-04-26T12:28:58.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5893000000000003e-05 2024-04-26T12:28:58.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989659+0000", 2024-04-26T12:28:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048643669999999996 2024-04-26T12:28:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989836+0000", 2024-04-26T12:28:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017699799999999999 2024-04-26T12:28:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989905+0000", 2024-04-26T12:28:58.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8238000000000006e-05 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1672 3.18 3:1e8917d7:::200.0000000e:head [write 3560383~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.126903145, 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070651368000000006, 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:58.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:58.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:28:58.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:58.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920569+0000", 2024-04-26T12:28:58.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2610000000000004e-06 2024-04-26T12:28:58.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920572+0000", 2024-04-26T12:28:58.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6150000000000001e-06 2024-04-26T12:28:58.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920578+0000", 2024-04-26T12:28:58.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:28:58.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985287+0000", 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064708946000000003 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985343+0000", 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6109000000000001e-05 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991135+0000", 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057923430000000001 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991163+0000", 2024-04-26T12:28:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7083000000000001e-05 2024-04-26T12:28:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991216+0000", 2024-04-26T12:28:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3854999999999999e-05 2024-04-26T12:28:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.073 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1673 3.18 3:1e8917d7:::200.0000000e:head [write 3563148~4730 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.125149015, 2024-04-26T12:28:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068974127999999996, 2024-04-26T12:28:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:58.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:28:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922318+0000", 2024-04-26T12:28:58.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922327+0000", 2024-04-26T12:28:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.02e-06 2024-04-26T12:28:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922336+0000", 2024-04-26T12:28:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:28:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922344+0000", 2024-04-26T12:28:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5220000000000001e-06 2024-04-26T12:28:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986575+0000", 2024-04-26T12:28:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064231885000000002 2024-04-26T12:28:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986628+0000", 2024-04-26T12:28:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.219e-05 2024-04-26T12:28:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991222+0000", 2024-04-26T12:28:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045942500000000002 2024-04-26T12:28:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991245+0000", 2024-04-26T12:28:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2764000000000001e-05 2024-04-26T12:28:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991293+0000", 2024-04-26T12:28:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8628999999999998e-05 2024-04-26T12:28:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.078 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:13020 4.10 4:09df41af:::1000000333c.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.124146794, 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066586204999999996, 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 13020 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.079 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:28:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923320+0000", 2024-04-26T12:28:58.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923328+0000", 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3289999999999994e-06 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923340+0000", 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1891e-05 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923353+0000", 2024-04-26T12:28:58.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3273e-05 2024-04-26T12:28:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986568+0000", 2024-04-26T12:28:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063214801000000001 2024-04-26T12:28:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986686+0000", 2024-04-26T12:28:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118009 2024-04-26T12:28:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989908+0000", 2024-04-26T12:28:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032213039999999999 2024-04-26T12:28:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1674 3.18 3:1e8917d7:::200.0000000e:head [write 3567878~12568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.12321401, 2024-04-26T12:28:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067102822000000006, 2024-04-26T12:28:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.083 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:28:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924253+0000", 2024-04-26T12:28:58.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924269+0000", 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924279+0000", 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0676000000000001e-05 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924288+0000", 2024-04-26T12:28:58.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4649999999999994e-06 2024-04-26T12:28:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987080+0000", 2024-04-26T12:28:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062792312000000003 2024-04-26T12:28:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987132+0000", 2024-04-26T12:28:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1712999999999998e-05 2024-04-26T12:28:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991298+0000", 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041660539999999998 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991321+0000", 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3575e-05 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991357+0000", 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5506000000000002e-05 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1675 3.18 3:1e8917d7:::200.0000000e:head [write 3580446~9112 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.122194467, 2024-04-26T12:28:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066218224000000006, 2024-04-26T12:28:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925273+0000", 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925282+0000", 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925291+0000", 2024-04-26T12:28:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2800000000000003e-06 2024-04-26T12:28:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925296+0000", 2024-04-26T12:28:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6080000000000003e-06 2024-04-26T12:28:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987663+0000", 2024-04-26T12:28:58.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062366705000000001 2024-04-26T12:28:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987729+0000", 2024-04-26T12:28:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6330999999999999e-05 2024-04-26T12:28:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991362+0000", 2024-04-26T12:28:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036322820000000001 2024-04-26T12:28:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991431+0000", 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9799e-05 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991492+0000", 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0587000000000001e-05 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1676 3.18 3:1e8917d7:::200.0000000e:head [write 3589558~5068 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.121995231, 2024-04-26T12:28:58.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066120133999999997, 2024-04-26T12:28:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:28:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925479+0000", 2024-04-26T12:28:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.054e-06 2024-04-26T12:28:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925489+0000", 2024-04-26T12:28:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0847e-05 2024-04-26T12:28:58.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925494+0000", 2024-04-26T12:28:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6569999999999996e-06 2024-04-26T12:28:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988275+0000", 2024-04-26T12:28:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062780582000000001 2024-04-26T12:28:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988319+0000", 2024-04-26T12:28:58.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3881999999999998e-05 2024-04-26T12:28:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991497+0000", 2024-04-26T12:28:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031781520000000001 2024-04-26T12:28:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991519+0000", 2024-04-26T12:28:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2382e-05 2024-04-26T12:28:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991593+0000", 2024-04-26T12:28:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3987999999999997e-05 2024-04-26T12:28:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1677 3.18 3:1e8917d7:::200.0000000e:head [write 3594626~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.121593717, 2024-04-26T12:28:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065839106999999994, 2024-04-26T12:28:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:28:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925880+0000", 2024-04-26T12:28:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:28:58.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925896+0000", 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5696999999999999e-05 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925904+0000", 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9619999999999993e-06 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988800+0000", 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062896142000000002 2024-04-26T12:28:58.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988877+0000", 2024-04-26T12:28:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7175999999999994e-05 2024-04-26T12:28:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991598+0000", 2024-04-26T12:28:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027209399999999998 2024-04-26T12:28:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991620+0000", 2024-04-26T12:28:58.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2396e-05 2024-04-26T12:28:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991714+0000", 2024-04-26T12:28:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3213000000000004e-05 2024-04-26T12:28:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1678 3.18 3:1e8917d7:::200.0000000e:head [write 3597232~4822 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.120656694999999, 2024-04-26T12:28:58.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066189707, 2024-04-26T12:28:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:28:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926819+0000", 2024-04-26T12:28:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:28:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926831+0000", 2024-04-26T12:28:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2300000000000001e-05 2024-04-26T12:28:58.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926839+0000", 2024-04-26T12:28:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9929999999999995e-06 2024-04-26T12:28:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989923+0000", 2024-04-26T12:28:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063083319999999998 2024-04-26T12:28:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989970+0000", 2024-04-26T12:28:58.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7290000000000003e-05 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992907+0000", 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029369740000000002 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992953+0000", 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6165000000000003e-05 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993001+0000", 2024-04-26T12:28:58.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7984e-05 2024-04-26T12:28:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1679 3.18 3:1e8917d7:::200.0000000e:head [write 3602054~5518 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.120615107000001, 2024-04-26T12:28:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068775656000000004, 2024-04-26T12:28:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:28:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:58.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926858+0000", 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7969999999999997e-06 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926871+0000", 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2965e-05 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926878+0000", 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9369999999999998e-06 2024-04-26T12:28:58.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990409+0000", 2024-04-26T12:28:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063531219999999999 2024-04-26T12:28:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990537+0000", 2024-04-26T12:28:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000127074 2024-04-26T12:28:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995467+0000", 2024-04-26T12:28:58.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049307190000000001 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995519+0000", 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1638000000000003e-05 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995629+0000", 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109852 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1680 3.18 3:1e8917d7:::200.0000000e:head [write 3607572~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.120579587, 2024-04-26T12:28:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070113521999999998, 2024-04-26T12:28:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:28:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926885+0000", 2024-04-26T12:28:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999962 2024-04-26T12:28:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926893+0000", 2024-04-26T12:28:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6299999999999998e-06 2024-04-26T12:28:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926899+0000", 2024-04-26T12:28:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5359999999999998e-06 2024-04-26T12:28:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926906+0000", 2024-04-26T12:28:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8349999999999998e-06 2024-04-26T12:28:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991747+0000", 2024-04-26T12:28:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064841012000000003 2024-04-26T12:28:58.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991834+0000", 2024-04-26T12:28:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6602999999999997e-05 2024-04-26T12:28:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996894+0000", 2024-04-26T12:28:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050608850000000002 2024-04-26T12:28:58.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996954+0000", 2024-04-26T12:28:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9598000000000001e-05 2024-04-26T12:28:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997002+0000", 2024-04-26T12:28:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8050000000000002e-05 2024-04-26T12:28:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.117 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1681 3.18 3:1e8917d7:::200.0000000e:head [write 3609487~2938 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.117 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:58.117 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.120539593, 2024-04-26T12:28:58.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070147752999999993, 2024-04-26T12:28:58.117 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.117 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.117 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:58.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:28:58.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926928+0000", 2024-04-26T12:28:58.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:58.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926932+0000", 2024-04-26T12:28:58.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5669999999999999e-06 2024-04-26T12:28:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926939+0000", 2024-04-26T12:28:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:28:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926947+0000", 2024-04-26T12:28:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.238e-06 2024-04-26T12:28:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992399+0000", 2024-04-26T12:28:58.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065452859000000002 2024-04-26T12:28:58.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992484+0000", 2024-04-26T12:28:58.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4197999999999996e-05 2024-04-26T12:28:58.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997011+0000", 2024-04-26T12:28:58.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045271759999999999 2024-04-26T12:28:58.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997038+0000", 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7684000000000001e-05 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997076+0000", 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7901000000000002e-05 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1682 3.18 3:1e8917d7:::200.0000000e:head [write 3612425~3220 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:58.121 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.118212761000001, 2024-04-26T12:28:58.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067934001999999993, 2024-04-26T12:28:58.122 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.122 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.122 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:58.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:58.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:28:58.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:58.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929260+0000", 2024-04-26T12:28:58.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:28:58.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929268+0000", 2024-04-26T12:28:58.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6399999999999997e-06 2024-04-26T12:28:58.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929273+0000", 2024-04-26T12:28:58.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:28:58.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993049+0000", 2024-04-26T12:28:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063775736999999999 2024-04-26T12:28:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993159+0000", 2024-04-26T12:28:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000110807 2024-04-26T12:28:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997083+0000", 2024-04-26T12:28:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039233769999999996 2024-04-26T12:28:58.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997126+0000", 2024-04-26T12:28:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3544999999999997e-05 2024-04-26T12:28:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997189+0000", 2024-04-26T12:28:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3128999999999998e-05 2024-04-26T12:28:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.127 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1683 3.18 3:1e8917d7:::200.0000000e:head [write 3615645~5682 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.127 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:58.127 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.11796565, 2024-04-26T12:28:58.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067807854000000001, 2024-04-26T12:28:58.127 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.127 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.127 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:58.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:28:58.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929502+0000", 2024-04-26T12:28:58.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:58.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929510+0000", 2024-04-26T12:28:58.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1179999999999992e-06 2024-04-26T12:28:58.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929519+0000", 2024-04-26T12:28:58.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2129999999999997e-06 2024-04-26T12:28:58.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929531+0000", 2024-04-26T12:28:58.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1615e-05 2024-04-26T12:28:58.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993765+0000", 2024-04-26T12:28:58.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064233810000000002 2024-04-26T12:28:58.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993842+0000", 2024-04-26T12:28:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7645999999999995e-05 2024-04-26T12:28:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997198+0000", 2024-04-26T12:28:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003355977 2024-04-26T12:28:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997249+0000", 2024-04-26T12:28:58.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0834000000000002e-05 2024-04-26T12:28:58.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997310+0000", 2024-04-26T12:28:58.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1408999999999994e-05 2024-04-26T12:28:58.131 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.131 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.131 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.131 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1684 3.18 3:1e8917d7:::200.0000000e:head [write 3621327~8700 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.131 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:58.131 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.115669073999999, 2024-04-26T12:28:58.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066650928999999998, 2024-04-26T12:28:58.132 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.132 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.132 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:58.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:28:58.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931798+0000", 2024-04-26T12:28:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:28:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931809+0000", 2024-04-26T12:28:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0662000000000001e-05 2024-04-26T12:28:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931816+0000", 2024-04-26T12:28:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1590000000000004e-06 2024-04-26T12:28:58.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931821+0000", 2024-04-26T12:28:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0710000000000002e-06 2024-04-26T12:28:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994486+0000", 2024-04-26T12:28:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062664719999999993 2024-04-26T12:28:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994567+0000", 2024-04-26T12:28:58.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1138999999999997e-05 2024-04-26T12:28:58.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998343+0000", 2024-04-26T12:28:58.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003775769 2024-04-26T12:28:58.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998387+0000", 2024-04-26T12:28:58.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4564999999999998e-05 2024-04-26T12:28:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998450+0000", 2024-04-26T12:28:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2589999999999995e-05 2024-04-26T12:28:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1685 3.18 3:1e8917d7:::200.0000000e:head [write 3630027~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:58.136 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.115642204, 2024-04-26T12:28:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066694793000000002, 2024-04-26T12:28:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:28:58.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:58.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931828+0000", 2024-04-26T12:28:58.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:28:58.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931831+0000", 2024-04-26T12:28:58.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.45e-06 2024-04-26T12:28:58.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931835+0000", 2024-04-26T12:28:58.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:28:58.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995016+0000", 2024-04-26T12:28:58.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063180397999999999 2024-04-26T12:28:58.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995064+0000", 2024-04-26T12:28:58.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8538999999999997e-05 2024-04-26T12:28:58.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998455+0000", 2024-04-26T12:28:58.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033911000000000002 2024-04-26T12:28:58.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998478+0000", 2024-04-26T12:28:58.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2793999999999999e-05 2024-04-26T12:28:58.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998521+0000", 2024-04-26T12:28:58.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2608999999999998e-05 2024-04-26T12:28:58.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.141 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.141 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1687 3.18 3:1e8917d7:::200.0000000e:head [write 3636544~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:28:58.141 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:58.141 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.114425000000001, 2024-04-26T12:28:58.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068592686, 2024-04-26T12:28:58.141 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:28:58.141 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:28:58.142 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:28:58.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:28:58.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:58.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:28:58.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:58.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:28:58.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:28:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:28:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:28:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:28:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933046+0000", 2024-04-26T12:28:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0850000000000001e-06 2024-04-26T12:28:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:28:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933050+0000", 2024-04-26T12:28:58.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5549999999999996e-06 2024-04-26T12:28:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:28:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933054+0000", 2024-04-26T12:28:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:28:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:28:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996223+0000", 2024-04-26T12:28:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063169004000000001 2024-04-26T12:28:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:28:58.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996307+0000", 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3660999999999997e-05 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001540+0000", 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052334160000000003 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001573+0000", 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2981999999999997e-05 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:28:58.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001636+0000", 2024-04-26T12:28:58.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2601999999999995e-05 2024-04-26T12:28:58.146 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.146 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.146 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.146 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:28:58.146 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:28:58.146 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:28:58.147 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:58.146+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:58.148 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:58.248 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:58.247+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:58.278 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:58.278 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:58.279 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:28:58.279 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:58.289 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:58.348 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:58.348+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:58.385 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:28:58.452 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:58.450+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:58.498 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:28:58.499 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:28:58.499 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:28:58.499 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:28:58.499 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:28:58.511 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:58.548 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:28:58.552 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:58.551+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:58.572 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:28:58.572 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:28:58.572 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:28:58.572 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:28:58.575 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:28:58.575 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:28:58.652 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:58.650+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:58.685 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:58.685 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:58.696 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:58.752 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:58.751+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:58.827 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:58.828 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:58.839 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:58.853 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:58.852+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:58.953 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:58.953+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:58.969 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:58.969 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:58.980 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:28:59.054 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:59.053+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:59.155 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:59.154+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:59.157 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:59.157 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:59.168 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:28:59.256 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:59.256+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:59.301 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:59.301 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:59.312 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:28:59.358 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:59.357+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:59.458 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:59.457+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:59.477 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:59.477 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:59.491 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:28:59.558 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:59.558+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:59.659 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:59.658+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:59.660 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:59.660 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:59.671 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:28:59.761 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:59.760+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:59.803 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:59.804 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:59.814 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:28:59.861 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:28:59.860+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:28:59.878 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:28:59.962 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:28:59.962+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:28:59.984 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:28:59.984 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:28:59.994 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:29:00.077 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:00.077+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:00.165 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:00.164+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:00.169 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:00.169 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:00.181 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:29:00.265 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:00.264+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:00.311 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:00.311 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:00.322 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:29:00.372 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:00.371+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:00.683 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:29:00.684 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:00.684+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:00.685 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:00.685 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:00.685 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:29:00.786 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:00.785+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:00.818 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:00.818 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:00.829 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:29:00.842 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:29:00.867 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:29:00.867 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:29:00.867 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:29:00.867 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:29:00.868 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is set 2024-04-26T12:29:00.871 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:29:00.871 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:29:00.886 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:00.886+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:00.973 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:29:00.973 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:29:00.973 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:29:00.973 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:29:00.984 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:29:01.027 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:01.026+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:01.087 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:01.086+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:01.164 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:29:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:29:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:29:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:29:01.165 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:29:01.176 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:29:01.219 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:01.219+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:01.289 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:01.289+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:01.310 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:29:01.310 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:29:01.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:29:01.310 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:29:01.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.310 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1668 3.18 3:1e8917d7:::200.0000000e:head [write 3543177~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.310 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:01.310 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.389018288999999, 2024-04-26T12:29:01.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067259575000000002, 2024-04-26T12:29:01.310 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919147+0000", 2024-04-26T12:29:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.157e-06 2024-04-26T12:29:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919151+0000", 2024-04-26T12:29:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.313e-06 2024-04-26T12:29:01.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919154+0000", 2024-04-26T12:29:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:29:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982687+0000", 2024-04-26T12:29:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063532694000000001 2024-04-26T12:29:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982750+0000", 2024-04-26T12:29:01.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:29:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986254+0000", 2024-04-26T12:29:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035043880000000002 2024-04-26T12:29:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986322+0000", 2024-04-26T12:29:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7458000000000004e-05 2024-04-26T12:29:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986404+0000", 2024-04-26T12:29:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2015000000000007e-05 2024-04-26T12:29:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1669 3.18 3:1e8917d7:::200.0000000e:head [write 3544575~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.389005676, 2024-04-26T12:29:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067362678999999995, 2024-04-26T12:29:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.315 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:29:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919158+0000", 2024-04-26T12:29:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.536e-06 2024-04-26T12:29:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919161+0000", 2024-04-26T12:29:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:29:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919164+0000", 2024-04-26T12:29:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:29:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983465+0000", 2024-04-26T12:29:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064301233999999999 2024-04-26T12:29:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983515+0000", 2024-04-26T12:29:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9774000000000002e-05 2024-04-26T12:29:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986414+0000", 2024-04-26T12:29:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0028991770000000002 2024-04-26T12:29:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986455+0000", 2024-04-26T12:29:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1090000000000001e-05 2024-04-26T12:29:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986520+0000", 2024-04-26T12:29:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4778999999999998e-05 2024-04-26T12:29:01.319 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1670 3.18 3:1e8917d7:::200.0000000e:head [write 3545973~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.3889964, 2024-04-26T12:29:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070481470000000004, 2024-04-26T12:29:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:29:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919172+0000", 2024-04-26T12:29:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:29:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919175+0000", 2024-04-26T12:29:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.942e-06 2024-04-26T12:29:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919177+0000", 2024-04-26T12:29:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5790000000000002e-06 2024-04-26T12:29:01.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983883+0000", 2024-04-26T12:29:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064705768999999996 2024-04-26T12:29:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983975+0000", 2024-04-26T12:29:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2219999999999995e-05 2024-04-26T12:29:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989262+0000", 2024-04-26T12:29:01.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052864940000000001 2024-04-26T12:29:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989361+0000", 2024-04-26T12:29:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9374000000000001e-05 2024-04-26T12:29:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989648+0000", 2024-04-26T12:29:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028677200000000003 2024-04-26T12:29:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.324 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1671 3.18 3:1e8917d7:::200.0000000e:head [write 3547932~12451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:29:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.387701283, 2024-04-26T12:29:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069443256999999994, 2024-04-26T12:29:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:29:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:29:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920460+0000", 2024-04-26T12:29:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920542+0000", 2024-04-26T12:29:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650999999999995e-05 2024-04-26T12:29:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920554+0000", 2024-04-26T12:29:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2228e-05 2024-04-26T12:29:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920560+0000", 2024-04-26T12:29:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8869999999999997e-06 2024-04-26T12:29:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984749+0000", 2024-04-26T12:29:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064188913 2024-04-26T12:29:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984795+0000", 2024-04-26T12:29:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5893000000000003e-05 2024-04-26T12:29:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989659+0000", 2024-04-26T12:29:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048643669999999996 2024-04-26T12:29:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989836+0000", 2024-04-26T12:29:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017699799999999999 2024-04-26T12:29:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989905+0000", 2024-04-26T12:29:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8238000000000006e-05 2024-04-26T12:29:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.329 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1672 3.18 3:1e8917d7:::200.0000000e:head [write 3560383~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.387597640999999, 2024-04-26T12:29:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070651368000000006, 2024-04-26T12:29:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920569+0000", 2024-04-26T12:29:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2610000000000004e-06 2024-04-26T12:29:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920572+0000", 2024-04-26T12:29:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6150000000000001e-06 2024-04-26T12:29:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920578+0000", 2024-04-26T12:29:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:29:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985287+0000", 2024-04-26T12:29:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064708946000000003 2024-04-26T12:29:01.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985343+0000", 2024-04-26T12:29:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6109000000000001e-05 2024-04-26T12:29:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991135+0000", 2024-04-26T12:29:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057923430000000001 2024-04-26T12:29:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991163+0000", 2024-04-26T12:29:01.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7083000000000001e-05 2024-04-26T12:29:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991216+0000", 2024-04-26T12:29:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3854999999999999e-05 2024-04-26T12:29:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1673 3.18 3:1e8917d7:::200.0000000e:head [write 3563148~4730 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:29:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.385843510999999, 2024-04-26T12:29:01.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068974127999999996, 2024-04-26T12:29:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:29:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:29:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922318+0000", 2024-04-26T12:29:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922327+0000", 2024-04-26T12:29:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.02e-06 2024-04-26T12:29:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922336+0000", 2024-04-26T12:29:01.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:29:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922344+0000", 2024-04-26T12:29:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5220000000000001e-06 2024-04-26T12:29:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986575+0000", 2024-04-26T12:29:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064231885000000002 2024-04-26T12:29:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986628+0000", 2024-04-26T12:29:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.219e-05 2024-04-26T12:29:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991222+0000", 2024-04-26T12:29:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045942500000000002 2024-04-26T12:29:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991245+0000", 2024-04-26T12:29:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2764000000000001e-05 2024-04-26T12:29:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991293+0000", 2024-04-26T12:29:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8628999999999998e-05 2024-04-26T12:29:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:13020 4.10 4:09df41af:::1000000333c.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:29:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:29:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.384841290000001, 2024-04-26T12:29:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066586204999999996, 2024-04-26T12:29:01.339 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:29:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:29:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:29:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:29:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 13020 2024-04-26T12:29:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:29:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:29:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923320+0000", 2024-04-26T12:29:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:29:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923328+0000", 2024-04-26T12:29:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3289999999999994e-06 2024-04-26T12:29:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923340+0000", 2024-04-26T12:29:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1891e-05 2024-04-26T12:29:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923353+0000", 2024-04-26T12:29:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3273e-05 2024-04-26T12:29:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986568+0000", 2024-04-26T12:29:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063214801000000001 2024-04-26T12:29:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986686+0000", 2024-04-26T12:29:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118009 2024-04-26T12:29:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989908+0000", 2024-04-26T12:29:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032213039999999999 2024-04-26T12:29:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.343 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1674 3.18 3:1e8917d7:::200.0000000e:head [write 3567878~12568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:29:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.383908505999999, 2024-04-26T12:29:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067102822000000006, 2024-04-26T12:29:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:29:01.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924253+0000", 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924269+0000", 2024-04-26T12:29:01.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:29:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924279+0000", 2024-04-26T12:29:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0676000000000001e-05 2024-04-26T12:29:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924288+0000", 2024-04-26T12:29:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4649999999999994e-06 2024-04-26T12:29:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987080+0000", 2024-04-26T12:29:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062792312000000003 2024-04-26T12:29:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987132+0000", 2024-04-26T12:29:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1712999999999998e-05 2024-04-26T12:29:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991298+0000", 2024-04-26T12:29:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041660539999999998 2024-04-26T12:29:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991321+0000", 2024-04-26T12:29:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3575e-05 2024-04-26T12:29:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991357+0000", 2024-04-26T12:29:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5506000000000002e-05 2024-04-26T12:29:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.348 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1675 3.18 3:1e8917d7:::200.0000000e:head [write 3580446~9112 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:29:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.382888962999999, 2024-04-26T12:29:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066218224000000006, 2024-04-26T12:29:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:29:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:29:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925273+0000", 2024-04-26T12:29:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925282+0000", 2024-04-26T12:29:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:29:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925291+0000", 2024-04-26T12:29:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2800000000000003e-06 2024-04-26T12:29:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925296+0000", 2024-04-26T12:29:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6080000000000003e-06 2024-04-26T12:29:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987663+0000", 2024-04-26T12:29:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062366705000000001 2024-04-26T12:29:01.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987729+0000", 2024-04-26T12:29:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6330999999999999e-05 2024-04-26T12:29:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991362+0000", 2024-04-26T12:29:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036322820000000001 2024-04-26T12:29:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991431+0000", 2024-04-26T12:29:01.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9799e-05 2024-04-26T12:29:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991492+0000", 2024-04-26T12:29:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0587000000000001e-05 2024-04-26T12:29:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1676 3.18 3:1e8917d7:::200.0000000e:head [write 3589558~5068 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:01.353 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.382689727000001, 2024-04-26T12:29:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066120133999999997, 2024-04-26T12:29:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:01.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925479+0000", 2024-04-26T12:29:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.054e-06 2024-04-26T12:29:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925489+0000", 2024-04-26T12:29:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0847e-05 2024-04-26T12:29:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925494+0000", 2024-04-26T12:29:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6569999999999996e-06 2024-04-26T12:29:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988275+0000", 2024-04-26T12:29:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062780582000000001 2024-04-26T12:29:01.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988319+0000", 2024-04-26T12:29:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3881999999999998e-05 2024-04-26T12:29:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991497+0000", 2024-04-26T12:29:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031781520000000001 2024-04-26T12:29:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991519+0000", 2024-04-26T12:29:01.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2382e-05 2024-04-26T12:29:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991593+0000", 2024-04-26T12:29:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3987999999999997e-05 2024-04-26T12:29:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1677 3.18 3:1e8917d7:::200.0000000e:head [write 3594626~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:01.358 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.382288213000001, 2024-04-26T12:29:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065839106999999994, 2024-04-26T12:29:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925880+0000", 2024-04-26T12:29:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:29:01.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925896+0000", 2024-04-26T12:29:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5696999999999999e-05 2024-04-26T12:29:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925904+0000", 2024-04-26T12:29:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9619999999999993e-06 2024-04-26T12:29:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988800+0000", 2024-04-26T12:29:01.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062896142000000002 2024-04-26T12:29:01.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988877+0000", 2024-04-26T12:29:01.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7175999999999994e-05 2024-04-26T12:29:01.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991598+0000", 2024-04-26T12:29:01.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027209399999999998 2024-04-26T12:29:01.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991620+0000", 2024-04-26T12:29:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2396e-05 2024-04-26T12:29:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991714+0000", 2024-04-26T12:29:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3213000000000004e-05 2024-04-26T12:29:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.363 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1678 3.18 3:1e8917d7:::200.0000000e:head [write 3597232~4822 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.381351191, 2024-04-26T12:29:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066189707, 2024-04-26T12:29:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926819+0000", 2024-04-26T12:29:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:29:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926831+0000", 2024-04-26T12:29:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2300000000000001e-05 2024-04-26T12:29:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926839+0000", 2024-04-26T12:29:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9929999999999995e-06 2024-04-26T12:29:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989923+0000", 2024-04-26T12:29:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063083319999999998 2024-04-26T12:29:01.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989970+0000", 2024-04-26T12:29:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7290000000000003e-05 2024-04-26T12:29:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992907+0000", 2024-04-26T12:29:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029369740000000002 2024-04-26T12:29:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992953+0000", 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6165000000000003e-05 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993001+0000", 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7984e-05 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1679 3.18 3:1e8917d7:::200.0000000e:head [write 3602054~5518 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.381309603, 2024-04-26T12:29:01.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068775656000000004, 2024-04-26T12:29:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926858+0000", 2024-04-26T12:29:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7969999999999997e-06 2024-04-26T12:29:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926871+0000", 2024-04-26T12:29:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2965e-05 2024-04-26T12:29:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926878+0000", 2024-04-26T12:29:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9369999999999998e-06 2024-04-26T12:29:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990409+0000", 2024-04-26T12:29:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063531219999999999 2024-04-26T12:29:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990537+0000", 2024-04-26T12:29:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000127074 2024-04-26T12:29:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995467+0000", 2024-04-26T12:29:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049307190000000001 2024-04-26T12:29:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995519+0000", 2024-04-26T12:29:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1638000000000003e-05 2024-04-26T12:29:01.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995629+0000", 2024-04-26T12:29:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109852 2024-04-26T12:29:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1680 3.18 3:1e8917d7:::200.0000000e:head [write 3607572~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:29:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.381274082999999, 2024-04-26T12:29:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070113521999999998, 2024-04-26T12:29:01.373 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:29:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:29:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926885+0000", 2024-04-26T12:29:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999962 2024-04-26T12:29:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926893+0000", 2024-04-26T12:29:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6299999999999998e-06 2024-04-26T12:29:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926899+0000", 2024-04-26T12:29:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5359999999999998e-06 2024-04-26T12:29:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926906+0000", 2024-04-26T12:29:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8349999999999998e-06 2024-04-26T12:29:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991747+0000", 2024-04-26T12:29:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064841012000000003 2024-04-26T12:29:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991834+0000", 2024-04-26T12:29:01.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6602999999999997e-05 2024-04-26T12:29:01.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996894+0000", 2024-04-26T12:29:01.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050608850000000002 2024-04-26T12:29:01.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996954+0000", 2024-04-26T12:29:01.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9598000000000001e-05 2024-04-26T12:29:01.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997002+0000", 2024-04-26T12:29:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8050000000000002e-05 2024-04-26T12:29:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1681 3.18 3:1e8917d7:::200.0000000e:head [write 3609487~2938 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:29:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.381234088999999, 2024-04-26T12:29:01.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070147752999999993, 2024-04-26T12:29:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:29:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:29:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926928+0000", 2024-04-26T12:29:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926932+0000", 2024-04-26T12:29:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5669999999999999e-06 2024-04-26T12:29:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926939+0000", 2024-04-26T12:29:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:29:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926947+0000", 2024-04-26T12:29:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.238e-06 2024-04-26T12:29:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992399+0000", 2024-04-26T12:29:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065452859000000002 2024-04-26T12:29:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992484+0000", 2024-04-26T12:29:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4197999999999996e-05 2024-04-26T12:29:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997011+0000", 2024-04-26T12:29:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045271759999999999 2024-04-26T12:29:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997038+0000", 2024-04-26T12:29:01.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7684000000000001e-05 2024-04-26T12:29:01.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997076+0000", 2024-04-26T12:29:01.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7901000000000002e-05 2024-04-26T12:29:01.384 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.384 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.384 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.384 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1682 3.18 3:1e8917d7:::200.0000000e:head [write 3612425~3220 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.378907257, 2024-04-26T12:29:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067934001999999993, 2024-04-26T12:29:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929260+0000", 2024-04-26T12:29:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:29:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929268+0000", 2024-04-26T12:29:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6399999999999997e-06 2024-04-26T12:29:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929273+0000", 2024-04-26T12:29:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:29:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993049+0000", 2024-04-26T12:29:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063775736999999999 2024-04-26T12:29:01.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993159+0000", 2024-04-26T12:29:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000110807 2024-04-26T12:29:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997083+0000", 2024-04-26T12:29:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039233769999999996 2024-04-26T12:29:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997126+0000", 2024-04-26T12:29:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3544999999999997e-05 2024-04-26T12:29:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997189+0000", 2024-04-26T12:29:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3128999999999998e-05 2024-04-26T12:29:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1683 3.18 3:1e8917d7:::200.0000000e:head [write 3615645~5682 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:29:01.389 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.378660146, 2024-04-26T12:29:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067807854000000001, 2024-04-26T12:29:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:29:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929502+0000", 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929510+0000", 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1179999999999992e-06 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929519+0000", 2024-04-26T12:29:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2129999999999997e-06 2024-04-26T12:29:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929531+0000", 2024-04-26T12:29:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1615e-05 2024-04-26T12:29:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993765+0000", 2024-04-26T12:29:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064233810000000002 2024-04-26T12:29:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993842+0000", 2024-04-26T12:29:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7645999999999995e-05 2024-04-26T12:29:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997198+0000", 2024-04-26T12:29:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003355977 2024-04-26T12:29:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997249+0000", 2024-04-26T12:29:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0834000000000002e-05 2024-04-26T12:29:01.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997310+0000", 2024-04-26T12:29:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1408999999999994e-05 2024-04-26T12:29:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1684 3.18 3:1e8917d7:::200.0000000e:head [write 3621327~8700 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:29:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.376363570000001, 2024-04-26T12:29:01.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066650928999999998, 2024-04-26T12:29:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:29:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:29:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931798+0000", 2024-04-26T12:29:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931809+0000", 2024-04-26T12:29:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0662000000000001e-05 2024-04-26T12:29:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931816+0000", 2024-04-26T12:29:01.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1590000000000004e-06 2024-04-26T12:29:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931821+0000", 2024-04-26T12:29:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0710000000000002e-06 2024-04-26T12:29:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994486+0000", 2024-04-26T12:29:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062664719999999993 2024-04-26T12:29:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994567+0000", 2024-04-26T12:29:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1138999999999997e-05 2024-04-26T12:29:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998343+0000", 2024-04-26T12:29:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003775769 2024-04-26T12:29:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998387+0000", 2024-04-26T12:29:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4564999999999998e-05 2024-04-26T12:29:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998450+0000", 2024-04-26T12:29:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2589999999999995e-05 2024-04-26T12:29:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1685 3.18 3:1e8917d7:::200.0000000e:head [write 3630027~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.3763367, 2024-04-26T12:29:01.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066694793000000002, 2024-04-26T12:29:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931828+0000", 2024-04-26T12:29:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:29:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931831+0000", 2024-04-26T12:29:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.45e-06 2024-04-26T12:29:01.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931835+0000", 2024-04-26T12:29:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:29:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995016+0000", 2024-04-26T12:29:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063180397999999999 2024-04-26T12:29:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995064+0000", 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8538999999999997e-05 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998455+0000", 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033911000000000002 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998478+0000", 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2793999999999999e-05 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998521+0000", 2024-04-26T12:29:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2608999999999998e-05 2024-04-26T12:29:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1687 3.18 3:1e8917d7:::200.0000000e:head [write 3636544~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.375119496, 2024-04-26T12:29:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068592686, 2024-04-26T12:29:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:01.404 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:01.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933046+0000", 2024-04-26T12:29:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0850000000000001e-06 2024-04-26T12:29:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933050+0000", 2024-04-26T12:29:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5549999999999996e-06 2024-04-26T12:29:01.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933054+0000", 2024-04-26T12:29:01.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:29:01.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:01.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996223+0000", 2024-04-26T12:29:01.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063169004000000001 2024-04-26T12:29:01.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:01.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996307+0000", 2024-04-26T12:29:01.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3660999999999997e-05 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001540+0000", 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052334160000000003 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001573+0000", 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2981999999999997e-05 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001636+0000", 2024-04-26T12:29:01.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2601999999999995e-05 2024-04-26T12:29:01.409 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.409 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.409 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.409 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:01.409 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:01.409 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:29:01.411 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:29:01.412 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:01.410+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:01.511 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:01.511+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:01.571 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:29:01.571 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:29:01.571 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:29:01.571 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:29:01.581 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:29:01.612 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:01.611+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:01.713 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:01.712+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:01.747 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:29:01.747 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:29:01.747 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:29:01.747 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:29:01.747 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:29:01.757 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:29:01.813 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:01.813+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:01.886 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:29:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:29:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:29:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:29:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:293 3.13 3:ceffbd45:::200.0000000a:head [write 594763~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:29:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.959119248, 2024-04-26T12:29:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038803585000000002, 2024-04-26T12:29:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:29:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:29:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924874+0000", 2024-04-26T12:29:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924877+0000", 2024-04-26T12:29:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7329999999999999e-06 2024-04-26T12:29:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924884+0000", 2024-04-26T12:29:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:29:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924890+0000", 2024-04-26T12:29:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:29:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958764+0000", 2024-04-26T12:29:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.033873863999999997 2024-04-26T12:29:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958855+0000", 2024-04-26T12:29:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1402000000000003e-05 2024-04-26T12:29:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963608+0000", 2024-04-26T12:29:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047529039999999996 2024-04-26T12:29:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963636+0000", 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8194000000000001e-05 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963678+0000", 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2095999999999998e-05 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:294 3.13 3:ceffbd45:::200.0000000a:head [write 596172~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:29:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.959074504, 2024-04-26T12:29:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041225228000000003, 2024-04-26T12:29:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:29:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:29:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924919+0000", 2024-04-26T12:29:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924922+0000", 2024-04-26T12:29:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9160000000000001e-06 2024-04-26T12:29:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924928+0000", 2024-04-26T12:29:01.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3929999999999996e-06 2024-04-26T12:29:01.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924933+0000", 2024-04-26T12:29:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7820000000000001e-06 2024-04-26T12:29:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959359+0000", 2024-04-26T12:29:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034425782000000002 2024-04-26T12:29:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959439+0000", 2024-04-26T12:29:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0275e-05 2024-04-26T12:29:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966079+0000", 2024-04-26T12:29:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0066397089999999997 2024-04-26T12:29:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966106+0000", 2024-04-26T12:29:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7178e-05 2024-04-26T12:29:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966145+0000", 2024-04-26T12:29:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8618999999999997e-05 2024-04-26T12:29:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:295 3.13 3:ceffbd45:::200.0000000a:head [write 597574~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:29:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.959048354, 2024-04-26T12:29:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041258571000000001, 2024-04-26T12:29:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:29:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:29:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924945+0000", 2024-04-26T12:29:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924948+0000", 2024-04-26T12:29:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:29:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924955+0000", 2024-04-26T12:29:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4629999999999998e-06 2024-04-26T12:29:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924959+0000", 2024-04-26T12:29:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2719999999999999e-06 2024-04-26T12:29:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959957+0000", 2024-04-26T12:29:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034997588000000003 2024-04-26T12:29:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960042+0000", 2024-04-26T12:29:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5811999999999998e-05 2024-04-26T12:29:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966149+0000", 2024-04-26T12:29:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061071650000000003 2024-04-26T12:29:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966171+0000", 2024-04-26T12:29:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1905000000000001e-05 2024-04-26T12:29:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966204+0000", 2024-04-26T12:29:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2845999999999997e-05 2024-04-26T12:29:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:296 3.13 3:ceffbd45:::200.0000000a:head [write 598977~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.959016724000001, 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041282538000000001, 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:29:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924979+0000", 2024-04-26T12:29:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3609999999999999e-06 2024-04-26T12:29:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924984+0000", 2024-04-26T12:29:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3259999999999997e-06 2024-04-26T12:29:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924987+0000", 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7810000000000001e-06 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960618+0000", 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035631875 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960698+0000", 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9373000000000001e-05 2024-04-26T12:29:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966208+0000", 2024-04-26T12:29:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055104359999999996 2024-04-26T12:29:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966228+0000", 2024-04-26T12:29:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0208e-05 2024-04-26T12:29:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966260+0000", 2024-04-26T12:29:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1404e-05 2024-04-26T12:29:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:297 3.13 3:ceffbd45:::200.0000000a:head [write 600380~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.958979889999998, 2024-04-26T12:29:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041309850000000002, 2024-04-26T12:29:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925017+0000", 2024-04-26T12:29:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.96e-06 2024-04-26T12:29:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925020+0000", 2024-04-26T12:29:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6629999999999999e-06 2024-04-26T12:29:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925023+0000", 2024-04-26T12:29:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:29:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961241+0000", 2024-04-26T12:29:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036217390000000002 2024-04-26T12:29:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961335+0000", 2024-04-26T12:29:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4537000000000006e-05 2024-04-26T12:29:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966264+0000", 2024-04-26T12:29:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004928516 2024-04-26T12:29:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966290+0000", 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5658999999999999e-05 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966324+0000", 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4459000000000003e-05 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:298 3.13 3:ceffbd45:::200.0000000a:head [write 602634~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:29:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.958947295000002, 2024-04-26T12:29:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046387536, 2024-04-26T12:29:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:29:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925046+0000", 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925049+0000", 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4770000000000002e-06 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925057+0000", 2024-04-26T12:29:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9219999999999997e-06 2024-04-26T12:29:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925062+0000", 2024-04-26T12:29:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:29:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961918+0000", 2024-04-26T12:29:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036856170000000001 2024-04-26T12:29:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962014+0000", 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6731999999999995e-05 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971360+0000", 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0093454569999999997 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971393+0000", 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3130999999999998e-05 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971434+0000", 2024-04-26T12:29:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1244e-05 2024-04-26T12:29:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:299 3.13 3:ceffbd45:::200.0000000a:head [write 604033~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:29:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.958893463999999, 2024-04-26T12:29:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046395615000000001, 2024-04-26T12:29:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925100+0000", 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925103+0000", 2024-04-26T12:29:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3520000000000001e-06 2024-04-26T12:29:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925108+0000", 2024-04-26T12:29:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6489999999999996e-06 2024-04-26T12:29:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925111+0000", 2024-04-26T12:29:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.79e-06 2024-04-26T12:29:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962405+0000", 2024-04-26T12:29:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037293953999999997 2024-04-26T12:29:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962457+0000", 2024-04-26T12:29:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2003000000000003e-05 2024-04-26T12:29:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971440+0000", 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0089831719999999993 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971463+0000", 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3201e-05 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971496+0000", 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2836000000000002e-05 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:300 3.13 3:ceffbd45:::200.0000000a:head [write 605436~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.958829605999998, 2024-04-26T12:29:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046389606999999999, 2024-04-26T12:29:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925167+0000", 2024-04-26T12:29:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8870000000000001e-06 2024-04-26T12:29:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925171+0000", 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6049999999999998e-06 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925173+0000", 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8250000000000001e-06 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962740+0000", 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037566436000000002 2024-04-26T12:29:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962818+0000", 2024-04-26T12:29:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8231000000000004e-05 2024-04-26T12:29:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971501+0000", 2024-04-26T12:29:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008682525 2024-04-26T12:29:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971522+0000", 2024-04-26T12:29:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1673999999999999e-05 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971554+0000", 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1786999999999999e-05 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:301 3.13 3:ceffbd45:::200.0000000a:head [write 606838~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.958812997999999, 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046429455000000001, 2024-04-26T12:29:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:29:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925183+0000", 2024-04-26T12:29:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0150000000000002e-06 2024-04-26T12:29:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925186+0000", 2024-04-26T12:29:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2210000000000002e-06 2024-04-26T12:29:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925190+0000", 2024-04-26T12:29:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8489999999999999e-06 2024-04-26T12:29:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963304+0000", 2024-04-26T12:29:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038114207999999997 2024-04-26T12:29:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963356+0000", 2024-04-26T12:29:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1628000000000001e-05 2024-04-26T12:29:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971558+0000", 2024-04-26T12:29:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082025199999999996 2024-04-26T12:29:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971579+0000", 2024-04-26T12:29:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1019e-05 2024-04-26T12:29:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971610+0000", 2024-04-26T12:29:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1205999999999999e-05 2024-04-26T12:29:01.930 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.930 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.930 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.930 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:302 3.13 3:ceffbd45:::200.0000000a:head [write 608236~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.930 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:01.930 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.958791805000001, 2024-04-26T12:29:01.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046464057000000003, 2024-04-26T12:29:01.930 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.930 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.930 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:01.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:01.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:01.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925204+0000", 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1270000000000001e-06 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925207+0000", 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3720000000000001e-06 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925210+0000", 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7489999999999999e-06 2024-04-26T12:29:01.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963713+0000", 2024-04-26T12:29:01.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038502508999999997 2024-04-26T12:29:01.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963792+0000", 2024-04-26T12:29:01.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9087999999999999e-05 2024-04-26T12:29:01.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971615+0000", 2024-04-26T12:29:01.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078230130000000002 2024-04-26T12:29:01.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971636+0000", 2024-04-26T12:29:01.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0996999999999999e-05 2024-04-26T12:29:01.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971666+0000", 2024-04-26T12:29:01.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0443999999999999e-05 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:303 3.13 3:ceffbd45:::200.0000000a:head [write 609649~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.958748784000001, 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.047363031, 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:01.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:01.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:01.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925253+0000", 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0369999999999995e-06 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925261+0000", 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7420000000000003e-06 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925271+0000", 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1589999999999999e-06 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964198+0000", 2024-04-26T12:29:01.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038927182999999997 2024-04-26T12:29:01.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964281+0000", 2024-04-26T12:29:01.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3355000000000004e-05 2024-04-26T12:29:01.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972542+0000", 2024-04-26T12:29:01.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082607930000000006 2024-04-26T12:29:01.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972570+0000", 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7937999999999999e-05 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972608+0000", 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8384999999999999e-05 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:304 3.13 3:ceffbd45:::200.0000000a:head [write 611057~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.939 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.957583155000002, 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046259867000000003, 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926410+0000", 2024-04-26T12:29:01.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926415+0000", 2024-04-26T12:29:01.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7999999999999998e-06 2024-04-26T12:29:01.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926423+0000", 2024-04-26T12:29:01.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8569999999999995e-06 2024-04-26T12:29:01.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926429+0000", 2024-04-26T12:29:01.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.421e-06 2024-04-26T12:29:01.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964778+0000", 2024-04-26T12:29:01.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038349045999999998 2024-04-26T12:29:01.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964830+0000", 2024-04-26T12:29:01.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1309e-05 2024-04-26T12:29:01.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972614+0000", 2024-04-26T12:29:01.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077847070000000001 2024-04-26T12:29:01.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972638+0000", 2024-04-26T12:29:01.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3388999999999999e-05 2024-04-26T12:29:01.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972671+0000", 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2999e-05 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:305 3.13 3:ceffbd45:::200.0000000a:head [write 613824~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.957538115999998, 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046273460000000002, 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:01.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:01.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:01.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926463+0000", 2024-04-26T12:29:01.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:29:01.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926467+0000", 2024-04-26T12:29:01.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3000000000000003e-06 2024-04-26T12:29:01.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926470+0000", 2024-04-26T12:29:01.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1930000000000002e-06 2024-04-26T12:29:01.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965122+0000", 2024-04-26T12:29:01.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038652207000000001 2024-04-26T12:29:01.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965210+0000", 2024-04-26T12:29:01.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7832999999999997e-05 2024-04-26T12:29:01.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972675+0000", 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074651450000000003 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972696+0000", 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0871999999999999e-05 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972729+0000", 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.948 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.949 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.949 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:306 3.13 3:ceffbd45:::200.0000000a:head [write 618844~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.949 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:29:01.949 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.956695370999999, 2024-04-26T12:29:01.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.04548866, 2024-04-26T12:29:01.949 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.949 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.949 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:29:01.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927298+0000", 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927303+0000", 2024-04-26T12:29:01.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6079999999999998e-06 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927310+0000", 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6240000000000002e-06 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927319+0000", 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965791+0000", 2024-04-26T12:29:01.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038471350000000001 2024-04-26T12:29:01.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965839+0000", 2024-04-26T12:29:01.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8647999999999999e-05 2024-04-26T12:29:01.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972735+0000", 2024-04-26T12:29:01.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068952429999999997 2024-04-26T12:29:01.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972755+0000", 2024-04-26T12:29:01.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0219000000000001e-05 2024-04-26T12:29:01.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972787+0000", 2024-04-26T12:29:01.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2450000000000003e-05 2024-04-26T12:29:01.953 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.953 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.953 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.953 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:307 3.13 3:ceffbd45:::200.0000000a:head [write 621801~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.953 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:01.953 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.956645806000001, 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.045498166, 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927351+0000", 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7130000000000001e-06 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927355+0000", 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1339999999999997e-06 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927358+0000", 2024-04-26T12:29:01.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:29:01.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966366+0000", 2024-04-26T12:29:01.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039008207000000003 2024-04-26T12:29:01.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966457+0000", 2024-04-26T12:29:01.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1144999999999996e-05 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972792+0000", 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0063344819999999998 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972815+0000", 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3336000000000002e-05 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972846+0000", 2024-04-26T12:29:01.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1504000000000002e-05 2024-04-26T12:29:01.958 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.958 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.958 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.958 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:308 3.13 3:ceffbd45:::200.0000000a:head [write 623718~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.958 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:01.958 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.954967760999999, 2024-04-26T12:29:01.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043878271000000003, 2024-04-26T12:29:01.958 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.958 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.958 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929042+0000", 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6039e-05 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929054+0000", 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2275e-05 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929063+0000", 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7150000000000004e-06 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967060+0000", 2024-04-26T12:29:01.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037996907000000003 2024-04-26T12:29:01.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967117+0000", 2024-04-26T12:29:01.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7701999999999997e-05 2024-04-26T12:29:01.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972850+0000", 2024-04-26T12:29:01.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0057332679999999997 2024-04-26T12:29:01.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972872+0000", 2024-04-26T12:29:01.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1138999999999999e-05 2024-04-26T12:29:01.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972905+0000", 2024-04-26T12:29:01.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2904999999999998e-05 2024-04-26T12:29:01.962 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.962 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.962 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:309 3.13 3:ceffbd45:::200.0000000a:head [write 638707~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.95414465, 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043114311000000002, 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929853+0000", 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2690000000000001e-06 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929861+0000", 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.515e-06 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929867+0000", 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4640000000000003e-06 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967590+0000", 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037722506000000003 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967672+0000", 2024-04-26T12:29:01.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2082000000000005e-05 2024-04-26T12:29:01.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972908+0000", 2024-04-26T12:29:01.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052366289999999996 2024-04-26T12:29:01.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972929+0000", 2024-04-26T12:29:01.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0752999999999999e-05 2024-04-26T12:29:01.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972964+0000", 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4666999999999999e-05 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:310 3.13 3:ceffbd45:::200.0000000a:head [write 641140~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.954097377, 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043126171999999997, 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:29:01.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:29:01.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929896+0000", 2024-04-26T12:29:01.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929899+0000", 2024-04-26T12:29:01.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-04-26T12:29:01.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929903+0000", 2024-04-26T12:29:01.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.087e-06 2024-04-26T12:29:01.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929907+0000", 2024-04-26T12:29:01.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1480000000000002e-06 2024-04-26T12:29:01.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.969962+0000", 2024-04-26T12:29:01.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040055457000000003 2024-04-26T12:29:01.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970018+0000", 2024-04-26T12:29:01.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6209999999999999e-05 2024-04-26T12:29:01.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972968+0000", 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029501689999999999 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972989+0000", 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0618000000000001e-05 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.973023+0000", 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.972 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:312 3.13 3:ceffbd45:::200.0000000a:head [write 648907~1910 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.972 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:29:01.972 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.948768122000001, 2024-04-26T12:29:01.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039844011999999998, 2024-04-26T12:29:01.972 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.972 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.972 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:29:01.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935225+0000", 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935229+0000", 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1790000000000001e-06 2024-04-26T12:29:01.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935235+0000", 2024-04-26T12:29:01.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.716e-06 2024-04-26T12:29:01.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935239+0000", 2024-04-26T12:29:01.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5379999999999998e-06 2024-04-26T12:29:01.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970917+0000", 2024-04-26T12:29:01.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035678223000000002 2024-04-26T12:29:01.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971006+0000", 2024-04-26T12:29:01.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9248999999999999e-05 2024-04-26T12:29:01.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.974984+0000", 2024-04-26T12:29:01.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039776769999999998 2024-04-26T12:29:01.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975031+0000", 2024-04-26T12:29:01.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7500000000000003e-05 2024-04-26T12:29:01.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975070+0000", 2024-04-26T12:29:01.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8509e-05 2024-04-26T12:29:01.976 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.976 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.976 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.976 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:313 3.13 3:ceffbd45:::200.0000000a:head [write 650817~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:01.977 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:29:01.977 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.948541794, 2024-04-26T12:29:01.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040236782999999998, 2024-04-26T12:29:01.977 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:01.977 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:01.977 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:01.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:01.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:29:01.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:01.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:29:01.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:01.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:01.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935451+0000", 2024-04-26T12:29:01.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:29:01.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:01.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935457+0000", 2024-04-26T12:29:01.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5079999999999996e-06 2024-04-26T12:29:01.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935467+0000", 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0407e-05 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935477+0000", 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3989999999999993e-06 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971691+0000", 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036214534 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971741+0000", 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0294000000000003e-05 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975619+0000", 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038779259999999999 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975647+0000", 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:01.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:01.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975689+0000", 2024-04-26T12:29:01.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2055999999999998e-05 2024-04-26T12:29:01.981 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.981 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.981 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.981 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:01.981 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:01.981 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:29:01.982 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:01.982+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:01.983 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:29:02.083 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:02.083+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:02.113 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:29:02.113 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:29:02.113 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:29:02.114 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:29:02.124 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:29:02.184 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:02.184+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:02.209 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-26T12:29:02.210 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T12:29:02.253 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:29:02.253 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:29:02.253 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:29:02.253 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:29:02.254 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:29:02.263 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:29:02.285 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:02.285+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:02.388 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:02.386+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:02.409 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:29:02.409 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:29:02.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:29:02.409 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:29:02.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.409 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1668 3.18 3:1e8917d7:::200.0000000e:head [write 3543177~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.409 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:02.409 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.482641170000001, 2024-04-26T12:29:02.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067259575000000002, 2024-04-26T12:29:02.410 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.410 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.410 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:02.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:02.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:02.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919147+0000", 2024-04-26T12:29:02.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.157e-06 2024-04-26T12:29:02.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919151+0000", 2024-04-26T12:29:02.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.313e-06 2024-04-26T12:29:02.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919154+0000", 2024-04-26T12:29:02.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:29:02.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982687+0000", 2024-04-26T12:29:02.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063532694000000001 2024-04-26T12:29:02.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982750+0000", 2024-04-26T12:29:02.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:29:02.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986254+0000", 2024-04-26T12:29:02.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035043880000000002 2024-04-26T12:29:02.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986322+0000", 2024-04-26T12:29:02.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7458000000000004e-05 2024-04-26T12:29:02.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986404+0000", 2024-04-26T12:29:02.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2015000000000007e-05 2024-04-26T12:29:02.414 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.414 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.414 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.414 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1669 3.18 3:1e8917d7:::200.0000000e:head [write 3544575~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.414 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:02.414 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.482628557, 2024-04-26T12:29:02.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067362678999999995, 2024-04-26T12:29:02.415 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.415 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.415 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:02.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:02.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:02.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:29:02.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919158+0000", 2024-04-26T12:29:02.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.536e-06 2024-04-26T12:29:02.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919161+0000", 2024-04-26T12:29:02.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:29:02.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919164+0000", 2024-04-26T12:29:02.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:29:02.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983465+0000", 2024-04-26T12:29:02.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064301233999999999 2024-04-26T12:29:02.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983515+0000", 2024-04-26T12:29:02.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9774000000000002e-05 2024-04-26T12:29:02.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986414+0000", 2024-04-26T12:29:02.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0028991770000000002 2024-04-26T12:29:02.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986455+0000", 2024-04-26T12:29:02.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1090000000000001e-05 2024-04-26T12:29:02.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986520+0000", 2024-04-26T12:29:02.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4778999999999998e-05 2024-04-26T12:29:02.419 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.419 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.419 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.419 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1670 3.18 3:1e8917d7:::200.0000000e:head [write 3545973~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.419 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:02.419 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.482619281, 2024-04-26T12:29:02.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070481470000000004, 2024-04-26T12:29:02.419 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.420 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.420 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:02.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:02.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:02.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:29:02.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919172+0000", 2024-04-26T12:29:02.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:29:02.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919175+0000", 2024-04-26T12:29:02.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.942e-06 2024-04-26T12:29:02.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919177+0000", 2024-04-26T12:29:02.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5790000000000002e-06 2024-04-26T12:29:02.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983883+0000", 2024-04-26T12:29:02.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064705768999999996 2024-04-26T12:29:02.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983975+0000", 2024-04-26T12:29:02.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2219999999999995e-05 2024-04-26T12:29:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989262+0000", 2024-04-26T12:29:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052864940000000001 2024-04-26T12:29:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989361+0000", 2024-04-26T12:29:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9374000000000001e-05 2024-04-26T12:29:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989648+0000", 2024-04-26T12:29:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028677200000000003 2024-04-26T12:29:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1671 3.18 3:1e8917d7:::200.0000000e:head [write 3547932~12451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:29:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.481324164, 2024-04-26T12:29:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069443256999999994, 2024-04-26T12:29:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.424 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920460+0000", 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:02.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920542+0000", 2024-04-26T12:29:02.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650999999999995e-05 2024-04-26T12:29:02.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920554+0000", 2024-04-26T12:29:02.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2228e-05 2024-04-26T12:29:02.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920560+0000", 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8869999999999997e-06 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984749+0000", 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064188913 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984795+0000", 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5893000000000003e-05 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989659+0000", 2024-04-26T12:29:02.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048643669999999996 2024-04-26T12:29:02.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989836+0000", 2024-04-26T12:29:02.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017699799999999999 2024-04-26T12:29:02.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989905+0000", 2024-04-26T12:29:02.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8238000000000006e-05 2024-04-26T12:29:02.428 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.428 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.429 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.429 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1672 3.18 3:1e8917d7:::200.0000000e:head [write 3560383~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.429 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:02.429 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.481220521999999, 2024-04-26T12:29:02.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070651368000000006, 2024-04-26T12:29:02.429 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.429 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.429 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:02.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:02.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:02.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920569+0000", 2024-04-26T12:29:02.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2610000000000004e-06 2024-04-26T12:29:02.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920572+0000", 2024-04-26T12:29:02.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6150000000000001e-06 2024-04-26T12:29:02.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920578+0000", 2024-04-26T12:29:02.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:29:02.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985287+0000", 2024-04-26T12:29:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064708946000000003 2024-04-26T12:29:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985343+0000", 2024-04-26T12:29:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6109000000000001e-05 2024-04-26T12:29:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991135+0000", 2024-04-26T12:29:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057923430000000001 2024-04-26T12:29:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991163+0000", 2024-04-26T12:29:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7083000000000001e-05 2024-04-26T12:29:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991216+0000", 2024-04-26T12:29:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3854999999999999e-05 2024-04-26T12:29:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.434 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1673 3.18 3:1e8917d7:::200.0000000e:head [write 3563148~4730 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.434 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:29:02.434 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.479466392000001, 2024-04-26T12:29:02.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068974127999999996, 2024-04-26T12:29:02.434 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.434 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.434 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:29:02.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:29:02.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922318+0000", 2024-04-26T12:29:02.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:02.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922327+0000", 2024-04-26T12:29:02.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.02e-06 2024-04-26T12:29:02.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922336+0000", 2024-04-26T12:29:02.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:29:02.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922344+0000", 2024-04-26T12:29:02.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5220000000000001e-06 2024-04-26T12:29:02.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986575+0000", 2024-04-26T12:29:02.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064231885000000002 2024-04-26T12:29:02.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986628+0000", 2024-04-26T12:29:02.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.219e-05 2024-04-26T12:29:02.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991222+0000", 2024-04-26T12:29:02.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045942500000000002 2024-04-26T12:29:02.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991245+0000", 2024-04-26T12:29:02.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2764000000000001e-05 2024-04-26T12:29:02.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991293+0000", 2024-04-26T12:29:02.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8628999999999998e-05 2024-04-26T12:29:02.438 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.438 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.438 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.438 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:13020 4.10 4:09df41af:::1000000333c.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:29:02.439 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:29:02.439 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.478464171000001, 2024-04-26T12:29:02.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066586204999999996, 2024-04-26T12:29:02.439 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.439 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:29:02.439 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:29:02.439 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:29:02.439 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:29:02.439 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 13020 2024-04-26T12:29:02.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.439 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:29:02.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:29:02.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923320+0000", 2024-04-26T12:29:02.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:29:02.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923328+0000", 2024-04-26T12:29:02.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3289999999999994e-06 2024-04-26T12:29:02.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923340+0000", 2024-04-26T12:29:02.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1891e-05 2024-04-26T12:29:02.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923353+0000", 2024-04-26T12:29:02.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3273e-05 2024-04-26T12:29:02.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986568+0000", 2024-04-26T12:29:02.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063214801000000001 2024-04-26T12:29:02.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986686+0000", 2024-04-26T12:29:02.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118009 2024-04-26T12:29:02.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989908+0000", 2024-04-26T12:29:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032213039999999999 2024-04-26T12:29:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1674 3.18 3:1e8917d7:::200.0000000e:head [write 3567878~12568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:29:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.477531386999999, 2024-04-26T12:29:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067102822000000006, 2024-04-26T12:29:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:29:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:29:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924253+0000", 2024-04-26T12:29:02.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:02.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924269+0000", 2024-04-26T12:29:02.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:29:02.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924279+0000", 2024-04-26T12:29:02.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0676000000000001e-05 2024-04-26T12:29:02.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924288+0000", 2024-04-26T12:29:02.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4649999999999994e-06 2024-04-26T12:29:02.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987080+0000", 2024-04-26T12:29:02.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062792312000000003 2024-04-26T12:29:02.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987132+0000", 2024-04-26T12:29:02.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1712999999999998e-05 2024-04-26T12:29:02.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991298+0000", 2024-04-26T12:29:02.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041660539999999998 2024-04-26T12:29:02.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991321+0000", 2024-04-26T12:29:02.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3575e-05 2024-04-26T12:29:02.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991357+0000", 2024-04-26T12:29:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5506000000000002e-05 2024-04-26T12:29:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1675 3.18 3:1e8917d7:::200.0000000e:head [write 3580446~9112 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:29:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.476511844000001, 2024-04-26T12:29:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066218224000000006, 2024-04-26T12:29:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.448 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925273+0000", 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925282+0000", 2024-04-26T12:29:02.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:29:02.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925291+0000", 2024-04-26T12:29:02.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2800000000000003e-06 2024-04-26T12:29:02.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925296+0000", 2024-04-26T12:29:02.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6080000000000003e-06 2024-04-26T12:29:02.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987663+0000", 2024-04-26T12:29:02.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062366705000000001 2024-04-26T12:29:02.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987729+0000", 2024-04-26T12:29:02.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6330999999999999e-05 2024-04-26T12:29:02.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991362+0000", 2024-04-26T12:29:02.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036322820000000001 2024-04-26T12:29:02.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991431+0000", 2024-04-26T12:29:02.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9799e-05 2024-04-26T12:29:02.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991492+0000", 2024-04-26T12:29:02.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0587000000000001e-05 2024-04-26T12:29:02.453 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.453 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.453 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.453 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1676 3.18 3:1e8917d7:::200.0000000e:head [write 3589558~5068 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.453 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:02.453 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.476312608000001, 2024-04-26T12:29:02.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066120133999999997, 2024-04-26T12:29:02.453 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.453 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.453 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:02.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:02.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:02.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925479+0000", 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.054e-06 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925489+0000", 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0847e-05 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925494+0000", 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6569999999999996e-06 2024-04-26T12:29:02.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988275+0000", 2024-04-26T12:29:02.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062780582000000001 2024-04-26T12:29:02.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988319+0000", 2024-04-26T12:29:02.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3881999999999998e-05 2024-04-26T12:29:02.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991497+0000", 2024-04-26T12:29:02.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031781520000000001 2024-04-26T12:29:02.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991519+0000", 2024-04-26T12:29:02.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2382e-05 2024-04-26T12:29:02.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991593+0000", 2024-04-26T12:29:02.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3987999999999997e-05 2024-04-26T12:29:02.457 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.457 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.457 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.458 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1677 3.18 3:1e8917d7:::200.0000000e:head [write 3594626~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.458 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:02.458 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.475911094000001, 2024-04-26T12:29:02.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065839106999999994, 2024-04-26T12:29:02.458 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.458 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.458 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:02.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925880+0000", 2024-04-26T12:29:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:29:02.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925896+0000", 2024-04-26T12:29:02.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5696999999999999e-05 2024-04-26T12:29:02.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925904+0000", 2024-04-26T12:29:02.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9619999999999993e-06 2024-04-26T12:29:02.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988800+0000", 2024-04-26T12:29:02.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062896142000000002 2024-04-26T12:29:02.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988877+0000", 2024-04-26T12:29:02.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7175999999999994e-05 2024-04-26T12:29:02.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991598+0000", 2024-04-26T12:29:02.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027209399999999998 2024-04-26T12:29:02.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991620+0000", 2024-04-26T12:29:02.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2396e-05 2024-04-26T12:29:02.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991714+0000", 2024-04-26T12:29:02.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3213000000000004e-05 2024-04-26T12:29:02.462 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.462 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.462 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.463 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1678 3.18 3:1e8917d7:::200.0000000e:head [write 3597232~4822 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.463 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:02.463 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.474974072, 2024-04-26T12:29:02.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066189707, 2024-04-26T12:29:02.463 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.463 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.463 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:02.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:02.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:02.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:02.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926819+0000", 2024-04-26T12:29:02.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:29:02.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926831+0000", 2024-04-26T12:29:02.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2300000000000001e-05 2024-04-26T12:29:02.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926839+0000", 2024-04-26T12:29:02.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9929999999999995e-06 2024-04-26T12:29:02.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989923+0000", 2024-04-26T12:29:02.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063083319999999998 2024-04-26T12:29:02.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989970+0000", 2024-04-26T12:29:02.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7290000000000003e-05 2024-04-26T12:29:02.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992907+0000", 2024-04-26T12:29:02.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029369740000000002 2024-04-26T12:29:02.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992953+0000", 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6165000000000003e-05 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993001+0000", 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7984e-05 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1679 3.18 3:1e8917d7:::200.0000000e:head [write 3602054~5518 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:02.467 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.474932484, 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068775656000000004, 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926858+0000", 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7969999999999997e-06 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926871+0000", 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2965e-05 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926878+0000", 2024-04-26T12:29:02.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9369999999999998e-06 2024-04-26T12:29:02.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990409+0000", 2024-04-26T12:29:02.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063531219999999999 2024-04-26T12:29:02.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990537+0000", 2024-04-26T12:29:02.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000127074 2024-04-26T12:29:02.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995467+0000", 2024-04-26T12:29:02.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049307190000000001 2024-04-26T12:29:02.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995519+0000", 2024-04-26T12:29:02.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1638000000000003e-05 2024-04-26T12:29:02.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995629+0000", 2024-04-26T12:29:02.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109852 2024-04-26T12:29:02.472 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.472 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.472 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.472 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1680 3.18 3:1e8917d7:::200.0000000e:head [write 3607572~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.472 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:29:02.472 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.474896963999999, 2024-04-26T12:29:02.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070113521999999998, 2024-04-26T12:29:02.472 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.472 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.472 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926885+0000", 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999962 2024-04-26T12:29:02.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926893+0000", 2024-04-26T12:29:02.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6299999999999998e-06 2024-04-26T12:29:02.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926899+0000", 2024-04-26T12:29:02.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5359999999999998e-06 2024-04-26T12:29:02.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926906+0000", 2024-04-26T12:29:02.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8349999999999998e-06 2024-04-26T12:29:02.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991747+0000", 2024-04-26T12:29:02.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064841012000000003 2024-04-26T12:29:02.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991834+0000", 2024-04-26T12:29:02.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6602999999999997e-05 2024-04-26T12:29:02.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996894+0000", 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050608850000000002 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996954+0000", 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9598000000000001e-05 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997002+0000", 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8050000000000002e-05 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.477 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1681 3.18 3:1e8917d7:::200.0000000e:head [write 3609487~2938 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.477 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:29:02.477 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.474856969999999, 2024-04-26T12:29:02.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070147752999999993, 2024-04-26T12:29:02.477 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.477 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.477 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:29:02.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:29:02.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926928+0000", 2024-04-26T12:29:02.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926932+0000", 2024-04-26T12:29:02.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5669999999999999e-06 2024-04-26T12:29:02.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926939+0000", 2024-04-26T12:29:02.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:29:02.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926947+0000", 2024-04-26T12:29:02.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.238e-06 2024-04-26T12:29:02.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992399+0000", 2024-04-26T12:29:02.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065452859000000002 2024-04-26T12:29:02.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992484+0000", 2024-04-26T12:29:02.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4197999999999996e-05 2024-04-26T12:29:02.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997011+0000", 2024-04-26T12:29:02.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045271759999999999 2024-04-26T12:29:02.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997038+0000", 2024-04-26T12:29:02.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7684000000000001e-05 2024-04-26T12:29:02.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997076+0000", 2024-04-26T12:29:02.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7901000000000002e-05 2024-04-26T12:29:02.481 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.481 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.481 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.482 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1682 3.18 3:1e8917d7:::200.0000000e:head [write 3612425~3220 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.482 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:02.482 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.472530138, 2024-04-26T12:29:02.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067934001999999993, 2024-04-26T12:29:02.482 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.482 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.482 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:02.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:02.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:02.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:02.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929260+0000", 2024-04-26T12:29:02.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:29:02.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929268+0000", 2024-04-26T12:29:02.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6399999999999997e-06 2024-04-26T12:29:02.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929273+0000", 2024-04-26T12:29:02.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:29:02.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993049+0000", 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063775736999999999 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993159+0000", 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000110807 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997083+0000", 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039233769999999996 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997126+0000", 2024-04-26T12:29:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3544999999999997e-05 2024-04-26T12:29:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997189+0000", 2024-04-26T12:29:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3128999999999998e-05 2024-04-26T12:29:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1683 3.18 3:1e8917d7:::200.0000000e:head [write 3615645~5682 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:29:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.472283027, 2024-04-26T12:29:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067807854000000001, 2024-04-26T12:29:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:29:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:29:02.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929502+0000", 2024-04-26T12:29:02.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:02.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929510+0000", 2024-04-26T12:29:02.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1179999999999992e-06 2024-04-26T12:29:02.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929519+0000", 2024-04-26T12:29:02.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2129999999999997e-06 2024-04-26T12:29:02.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929531+0000", 2024-04-26T12:29:02.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1615e-05 2024-04-26T12:29:02.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993765+0000", 2024-04-26T12:29:02.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064233810000000002 2024-04-26T12:29:02.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993842+0000", 2024-04-26T12:29:02.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7645999999999995e-05 2024-04-26T12:29:02.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997198+0000", 2024-04-26T12:29:02.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003355977 2024-04-26T12:29:02.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997249+0000", 2024-04-26T12:29:02.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0834000000000002e-05 2024-04-26T12:29:02.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997310+0000", 2024-04-26T12:29:02.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1408999999999994e-05 2024-04-26T12:29:02.491 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.491 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.491 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.492 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1684 3.18 3:1e8917d7:::200.0000000e:head [write 3621327~8700 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.492 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:29:02.492 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.469986451, 2024-04-26T12:29:02.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066650928999999998, 2024-04-26T12:29:02.492 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.492 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.492 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:29:02.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:29:02.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931798+0000", 2024-04-26T12:29:02.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:02.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931809+0000", 2024-04-26T12:29:02.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0662000000000001e-05 2024-04-26T12:29:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931816+0000", 2024-04-26T12:29:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1590000000000004e-06 2024-04-26T12:29:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931821+0000", 2024-04-26T12:29:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0710000000000002e-06 2024-04-26T12:29:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994486+0000", 2024-04-26T12:29:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062664719999999993 2024-04-26T12:29:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994567+0000", 2024-04-26T12:29:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1138999999999997e-05 2024-04-26T12:29:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998343+0000", 2024-04-26T12:29:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003775769 2024-04-26T12:29:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998387+0000", 2024-04-26T12:29:02.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4564999999999998e-05 2024-04-26T12:29:02.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998450+0000", 2024-04-26T12:29:02.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2589999999999995e-05 2024-04-26T12:29:02.496 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.496 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.496 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.496 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1685 3.18 3:1e8917d7:::200.0000000e:head [write 3630027~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.496 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.469959580999999, 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066694793000000002, 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:02.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931828+0000", 2024-04-26T12:29:02.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:29:02.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931831+0000", 2024-04-26T12:29:02.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.45e-06 2024-04-26T12:29:02.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931835+0000", 2024-04-26T12:29:02.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:29:02.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995016+0000", 2024-04-26T12:29:02.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063180397999999999 2024-04-26T12:29:02.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995064+0000", 2024-04-26T12:29:02.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8538999999999997e-05 2024-04-26T12:29:02.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998455+0000", 2024-04-26T12:29:02.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033911000000000002 2024-04-26T12:29:02.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998478+0000", 2024-04-26T12:29:02.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2793999999999999e-05 2024-04-26T12:29:02.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998521+0000", 2024-04-26T12:29:02.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2608999999999998e-05 2024-04-26T12:29:02.501 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.501 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.501 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.501 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1687 3.18 3:1e8917d7:::200.0000000e:head [write 3636544~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:02.501 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:02.501 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 14.468742377, 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068592686, 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933046+0000", 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0850000000000001e-06 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933050+0000", 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5549999999999996e-06 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933054+0000", 2024-04-26T12:29:02.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:29:02.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:02.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996223+0000", 2024-04-26T12:29:02.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063169004000000001 2024-04-26T12:29:02.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:02.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996307+0000", 2024-04-26T12:29:02.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3660999999999997e-05 2024-04-26T12:29:02.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001540+0000", 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052334160000000003 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001573+0000", 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2981999999999997e-05 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001636+0000", 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2601999999999995e-05 2024-04-26T12:29:02.505 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.506 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.506 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.506 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:02.506 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:02.506 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:29:02.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2024-04-26T12:29:02.507 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:02.506+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:02.508 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:29:02.510 DEBUG:teuthology.parallel:result is None 2024-04-26T12:29:02.510 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T12:29:02.540 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T12:29:02.540 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-26T12:29:02.550 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-26T12:29:02.551 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:29:02.551 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T12:29:02.600 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:29:02.600 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T12:29:02.607 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:02.607+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:02.635 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:29:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:29:02.635 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:29:02.635 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:29:02.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:29:02.658 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:29:02.708 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:02.708+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:02.771 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:29:02.771 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:29:02.771 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:29:02.771 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:29:02.771 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:29:02.781 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:29:02.809 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:02.808+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:02.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:29:02.882 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:29:02.908 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:29:02.908 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:29:02.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:29:02.909 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:29:02.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.909 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:293 3.13 3:ceffbd45:::200.0000000a:head [write 594763~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.909 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:29:02.909 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.982103936000001, 2024-04-26T12:29:02.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038803585000000002, 2024-04-26T12:29:02.909 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.909 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.909 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:29:02.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:29:02.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924874+0000", 2024-04-26T12:29:02.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924877+0000", 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7329999999999999e-06 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924884+0000", 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924890+0000", 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958764+0000", 2024-04-26T12:29:02.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.033873863999999997 2024-04-26T12:29:02.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958855+0000", 2024-04-26T12:29:02.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1402000000000003e-05 2024-04-26T12:29:02.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963608+0000", 2024-04-26T12:29:02.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047529039999999996 2024-04-26T12:29:02.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963636+0000", 2024-04-26T12:29:02.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8194000000000001e-05 2024-04-26T12:29:02.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963678+0000", 2024-04-26T12:29:02.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2095999999999998e-05 2024-04-26T12:29:02.913 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.913 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.913 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.913 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:294 3.13 3:ceffbd45:::200.0000000a:head [write 596172~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.982059192000001, 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041225228000000003, 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:29:02.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924919+0000", 2024-04-26T12:29:02.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924922+0000", 2024-04-26T12:29:02.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9160000000000001e-06 2024-04-26T12:29:02.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924928+0000", 2024-04-26T12:29:02.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3929999999999996e-06 2024-04-26T12:29:02.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924933+0000", 2024-04-26T12:29:02.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7820000000000001e-06 2024-04-26T12:29:02.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959359+0000", 2024-04-26T12:29:02.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034425782000000002 2024-04-26T12:29:02.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959439+0000", 2024-04-26T12:29:02.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0275e-05 2024-04-26T12:29:02.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966079+0000", 2024-04-26T12:29:02.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0066397089999999997 2024-04-26T12:29:02.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966106+0000", 2024-04-26T12:29:02.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7178e-05 2024-04-26T12:29:02.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966145+0000", 2024-04-26T12:29:02.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8618999999999997e-05 2024-04-26T12:29:02.918 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.918 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.918 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.918 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:295 3.13 3:ceffbd45:::200.0000000a:head [write 597574~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.918 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:29:02.918 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.982033042000001, 2024-04-26T12:29:02.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041258571000000001, 2024-04-26T12:29:02.919 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.919 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.919 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:29:02.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:29:02.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924945+0000", 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924948+0000", 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924955+0000", 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4629999999999998e-06 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924959+0000", 2024-04-26T12:29:02.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2719999999999999e-06 2024-04-26T12:29:02.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959957+0000", 2024-04-26T12:29:02.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034997588000000003 2024-04-26T12:29:02.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960042+0000", 2024-04-26T12:29:02.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5811999999999998e-05 2024-04-26T12:29:02.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966149+0000", 2024-04-26T12:29:02.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061071650000000003 2024-04-26T12:29:02.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966171+0000", 2024-04-26T12:29:02.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1905000000000001e-05 2024-04-26T12:29:02.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966204+0000", 2024-04-26T12:29:02.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2845999999999997e-05 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:296 3.13 3:ceffbd45:::200.0000000a:head [write 598977~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.982001411999999, 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041282538000000001, 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:02.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:02.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:02.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:29:02.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924979+0000", 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3609999999999999e-06 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924984+0000", 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3259999999999997e-06 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924987+0000", 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7810000000000001e-06 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960618+0000", 2024-04-26T12:29:02.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035631875 2024-04-26T12:29:02.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960698+0000", 2024-04-26T12:29:02.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9373000000000001e-05 2024-04-26T12:29:02.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966208+0000", 2024-04-26T12:29:02.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055104359999999996 2024-04-26T12:29:02.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966228+0000", 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0208e-05 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966260+0000", 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1404e-05 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:297 3.13 3:ceffbd45:::200.0000000a:head [write 600380~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.927 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.981964577999999, 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041309850000000002, 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:02.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925017+0000", 2024-04-26T12:29:02.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.96e-06 2024-04-26T12:29:02.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925020+0000", 2024-04-26T12:29:02.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6629999999999999e-06 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925023+0000", 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961241+0000", 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036217390000000002 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961335+0000", 2024-04-26T12:29:02.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4537000000000006e-05 2024-04-26T12:29:02.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966264+0000", 2024-04-26T12:29:02.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004928516 2024-04-26T12:29:02.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966290+0000", 2024-04-26T12:29:02.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5658999999999999e-05 2024-04-26T12:29:02.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966324+0000", 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4459000000000003e-05 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:298 3.13 3:ceffbd45:::200.0000000a:head [write 602634~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.981931982999999, 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046387536, 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925046+0000", 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925049+0000", 2024-04-26T12:29:02.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4770000000000002e-06 2024-04-26T12:29:02.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925057+0000", 2024-04-26T12:29:02.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9219999999999997e-06 2024-04-26T12:29:02.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925062+0000", 2024-04-26T12:29:02.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:29:02.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961918+0000", 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036856170000000001 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962014+0000", 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6731999999999995e-05 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971360+0000", 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0093454569999999997 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971393+0000", 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3130999999999998e-05 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971434+0000", 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1244e-05 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:299 3.13 3:ceffbd45:::200.0000000a:head [write 604033~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.936 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:29:02.937 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.981878152, 2024-04-26T12:29:02.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046395615000000001, 2024-04-26T12:29:02.937 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.937 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.937 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:29:02.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:29:02.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925100+0000", 2024-04-26T12:29:02.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925103+0000", 2024-04-26T12:29:02.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3520000000000001e-06 2024-04-26T12:29:02.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925108+0000", 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6489999999999996e-06 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925111+0000", 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.79e-06 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962405+0000", 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037293953999999997 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962457+0000", 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2003000000000003e-05 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971440+0000", 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0089831719999999993 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971463+0000", 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3201e-05 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971496+0000", 2024-04-26T12:29:02.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2836000000000002e-05 2024-04-26T12:29:02.941 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.941 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.941 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.941 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:300 3.13 3:ceffbd45:::200.0000000a:head [write 605436~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.941 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:02.941 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.981814293999999, 2024-04-26T12:29:02.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046389606999999999, 2024-04-26T12:29:02.941 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.941 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.941 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925167+0000", 2024-04-26T12:29:02.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8870000000000001e-06 2024-04-26T12:29:02.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925171+0000", 2024-04-26T12:29:02.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6049999999999998e-06 2024-04-26T12:29:02.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925173+0000", 2024-04-26T12:29:02.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8250000000000001e-06 2024-04-26T12:29:02.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962740+0000", 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037566436000000002 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962818+0000", 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8231000000000004e-05 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971501+0000", 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008682525 2024-04-26T12:29:02.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971522+0000", 2024-04-26T12:29:02.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1673999999999999e-05 2024-04-26T12:29:02.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971554+0000", 2024-04-26T12:29:02.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1786999999999999e-05 2024-04-26T12:29:02.945 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.945 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.945 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.946 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:301 3.13 3:ceffbd45:::200.0000000a:head [write 606838~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.946 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:02.946 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.981797686, 2024-04-26T12:29:02.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046429455000000001, 2024-04-26T12:29:02.946 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.946 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.946 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:02.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925183+0000", 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0150000000000002e-06 2024-04-26T12:29:02.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925186+0000", 2024-04-26T12:29:02.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2210000000000002e-06 2024-04-26T12:29:02.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925190+0000", 2024-04-26T12:29:02.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8489999999999999e-06 2024-04-26T12:29:02.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963304+0000", 2024-04-26T12:29:02.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038114207999999997 2024-04-26T12:29:02.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963356+0000", 2024-04-26T12:29:02.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1628000000000001e-05 2024-04-26T12:29:02.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971558+0000", 2024-04-26T12:29:02.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082025199999999996 2024-04-26T12:29:02.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971579+0000", 2024-04-26T12:29:02.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1019e-05 2024-04-26T12:29:02.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971610+0000", 2024-04-26T12:29:02.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1205999999999999e-05 2024-04-26T12:29:02.950 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.950 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.950 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.950 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:302 3.13 3:ceffbd45:::200.0000000a:head [write 608236~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.950 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:02.950 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.981776493000002, 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046464057000000003, 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:02.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925204+0000", 2024-04-26T12:29:02.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1270000000000001e-06 2024-04-26T12:29:02.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925207+0000", 2024-04-26T12:29:02.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3720000000000001e-06 2024-04-26T12:29:02.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925210+0000", 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7489999999999999e-06 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963713+0000", 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038502508999999997 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963792+0000", 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9087999999999999e-05 2024-04-26T12:29:02.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971615+0000", 2024-04-26T12:29:02.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078230130000000002 2024-04-26T12:29:02.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971636+0000", 2024-04-26T12:29:02.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0996999999999999e-05 2024-04-26T12:29:02.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971666+0000", 2024-04-26T12:29:02.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0443999999999999e-05 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:303 3.13 3:ceffbd45:::200.0000000a:head [write 609649~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.981733471999998, 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.047363031, 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:02.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:02.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:02.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925253+0000", 2024-04-26T12:29:02.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0369999999999995e-06 2024-04-26T12:29:02.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925261+0000", 2024-04-26T12:29:02.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7420000000000003e-06 2024-04-26T12:29:02.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925271+0000", 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1589999999999999e-06 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964198+0000", 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038927182999999997 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964281+0000", 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3355000000000004e-05 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972542+0000", 2024-04-26T12:29:02.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082607930000000006 2024-04-26T12:29:02.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972570+0000", 2024-04-26T12:29:02.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7937999999999999e-05 2024-04-26T12:29:02.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972608+0000", 2024-04-26T12:29:02.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8384999999999999e-05 2024-04-26T12:29:02.959 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.959 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.959 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.960 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:304 3.13 3:ceffbd45:::200.0000000a:head [write 611057~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.960 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:29:02.960 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.980567842999999, 2024-04-26T12:29:02.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046259867000000003, 2024-04-26T12:29:02.960 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.960 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.960 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:29:02.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926410+0000", 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926415+0000", 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7999999999999998e-06 2024-04-26T12:29:02.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926423+0000", 2024-04-26T12:29:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8569999999999995e-06 2024-04-26T12:29:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926429+0000", 2024-04-26T12:29:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.421e-06 2024-04-26T12:29:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964778+0000", 2024-04-26T12:29:02.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038349045999999998 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964830+0000", 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1309e-05 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972614+0000", 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077847070000000001 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972638+0000", 2024-04-26T12:29:02.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3388999999999999e-05 2024-04-26T12:29:02.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972671+0000", 2024-04-26T12:29:02.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2999e-05 2024-04-26T12:29:02.964 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.964 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.964 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.964 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:305 3.13 3:ceffbd45:::200.0000000a:head [write 613824~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.964 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:02.964 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.980522804, 2024-04-26T12:29:02.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046273460000000002, 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:02.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926463+0000", 2024-04-26T12:29:02.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:29:02.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926467+0000", 2024-04-26T12:29:02.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3000000000000003e-06 2024-04-26T12:29:02.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926470+0000", 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1930000000000002e-06 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965122+0000", 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038652207000000001 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965210+0000", 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7832999999999997e-05 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972675+0000", 2024-04-26T12:29:02.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074651450000000003 2024-04-26T12:29:02.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972696+0000", 2024-04-26T12:29:02.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0871999999999999e-05 2024-04-26T12:29:02.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972729+0000", 2024-04-26T12:29:02.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:29:02.968 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:306 3.13 3:ceffbd45:::200.0000000a:head [write 618844~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.979680059, 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.04548866, 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:29:02.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:29:02.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927298+0000", 2024-04-26T12:29:02.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927303+0000", 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6079999999999998e-06 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927310+0000", 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6240000000000002e-06 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927319+0000", 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965791+0000", 2024-04-26T12:29:02.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038471350000000001 2024-04-26T12:29:02.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965839+0000", 2024-04-26T12:29:02.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8647999999999999e-05 2024-04-26T12:29:02.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972735+0000", 2024-04-26T12:29:02.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068952429999999997 2024-04-26T12:29:02.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972755+0000", 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0219000000000001e-05 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972787+0000", 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2450000000000003e-05 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:307 3.13 3:ceffbd45:::200.0000000a:head [write 621801~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:02.973 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.979630493999998, 2024-04-26T12:29:02.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.045498166, 2024-04-26T12:29:02.974 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.974 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.974 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:02.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:02.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927351+0000", 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7130000000000001e-06 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927355+0000", 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1339999999999997e-06 2024-04-26T12:29:02.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927358+0000", 2024-04-26T12:29:02.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:29:02.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966366+0000", 2024-04-26T12:29:02.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039008207000000003 2024-04-26T12:29:02.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966457+0000", 2024-04-26T12:29:02.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1144999999999996e-05 2024-04-26T12:29:02.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972792+0000", 2024-04-26T12:29:02.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0063344819999999998 2024-04-26T12:29:02.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972815+0000", 2024-04-26T12:29:02.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3336000000000002e-05 2024-04-26T12:29:02.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972846+0000", 2024-04-26T12:29:02.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1504000000000002e-05 2024-04-26T12:29:02.978 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.978 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.978 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.978 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:308 3.13 3:ceffbd45:::200.0000000a:head [write 623718~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.978 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:02.978 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.977952449, 2024-04-26T12:29:02.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043878271000000003, 2024-04-26T12:29:02.978 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.978 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.978 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929042+0000", 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6039e-05 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929054+0000", 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2275e-05 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929063+0000", 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7150000000000004e-06 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967060+0000", 2024-04-26T12:29:02.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037996907000000003 2024-04-26T12:29:02.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967117+0000", 2024-04-26T12:29:02.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7701999999999997e-05 2024-04-26T12:29:02.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972850+0000", 2024-04-26T12:29:02.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0057332679999999997 2024-04-26T12:29:02.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972872+0000", 2024-04-26T12:29:02.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1138999999999999e-05 2024-04-26T12:29:02.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972905+0000", 2024-04-26T12:29:02.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2904999999999998e-05 2024-04-26T12:29:02.982 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.982 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.982 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:309 3.13 3:ceffbd45:::200.0000000a:head [write 638707~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.977129338000001, 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043114311000000002, 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:02.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:02.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929853+0000", 2024-04-26T12:29:02.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2690000000000001e-06 2024-04-26T12:29:02.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929861+0000", 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.515e-06 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929867+0000", 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4640000000000003e-06 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967590+0000", 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037722506000000003 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967672+0000", 2024-04-26T12:29:02.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2082000000000005e-05 2024-04-26T12:29:02.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972908+0000", 2024-04-26T12:29:02.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052366289999999996 2024-04-26T12:29:02.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972929+0000", 2024-04-26T12:29:02.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0752999999999999e-05 2024-04-26T12:29:02.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972964+0000", 2024-04-26T12:29:02.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4666999999999999e-05 2024-04-26T12:29:02.987 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.987 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.987 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.987 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:310 3.13 3:ceffbd45:::200.0000000a:head [write 641140~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.987 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:29:02.987 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.977082065000001, 2024-04-26T12:29:02.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043126171999999997, 2024-04-26T12:29:02.987 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.987 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.988 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:29:02.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:29:02.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929896+0000", 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929899+0000", 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929903+0000", 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.087e-06 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929907+0000", 2024-04-26T12:29:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1480000000000002e-06 2024-04-26T12:29:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.969962+0000", 2024-04-26T12:29:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040055457000000003 2024-04-26T12:29:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970018+0000", 2024-04-26T12:29:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6209999999999999e-05 2024-04-26T12:29:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972968+0000", 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029501689999999999 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972989+0000", 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0618000000000001e-05 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.973023+0000", 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.991 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.992 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:312 3.13 3:ceffbd45:::200.0000000a:head [write 648907~1910 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.992 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:29:02.992 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.971752810000002, 2024-04-26T12:29:02.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039844011999999998, 2024-04-26T12:29:02.992 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.992 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.992 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:29:02.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935225+0000", 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935229+0000", 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1790000000000001e-06 2024-04-26T12:29:02.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935235+0000", 2024-04-26T12:29:02.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.716e-06 2024-04-26T12:29:02.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935239+0000", 2024-04-26T12:29:02.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5379999999999998e-06 2024-04-26T12:29:02.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970917+0000", 2024-04-26T12:29:02.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035678223000000002 2024-04-26T12:29:02.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971006+0000", 2024-04-26T12:29:02.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9248999999999999e-05 2024-04-26T12:29:02.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:02.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.974984+0000", 2024-04-26T12:29:02.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039776769999999998 2024-04-26T12:29:02.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:02.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975031+0000", 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7500000000000003e-05 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975070+0000", 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8509e-05 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:313 3.13 3:ceffbd45:::200.0000000a:head [write 650817~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 19.971526482000002, 2024-04-26T12:29:02.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040236782999999998, 2024-04-26T12:29:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:29:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:29:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:02.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935451+0000", 2024-04-26T12:29:02.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:29:02.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:02.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935457+0000", 2024-04-26T12:29:02.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5079999999999996e-06 2024-04-26T12:29:02.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:02.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935467+0000", 2024-04-26T12:29:02.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0407e-05 2024-04-26T12:29:02.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:02.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935477+0000", 2024-04-26T12:29:02.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3989999999999993e-06 2024-04-26T12:29:02.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:02.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971691+0000", 2024-04-26T12:29:02.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036214534 2024-04-26T12:29:02.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:02.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:02.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:02.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971741+0000", 2024-04-26T12:29:02.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0294000000000003e-05 2024-04-26T12:29:03.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:03.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:03.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:03.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975619+0000", 2024-04-26T12:29:03.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038779259999999999 2024-04-26T12:29:03.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:03.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:03.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:03.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975647+0000", 2024-04-26T12:29:03.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:29:03.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:03.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:03.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:03.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975689+0000", 2024-04-26T12:29:03.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2055999999999998e-05 2024-04-26T12:29:03.001 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:03.001 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:03.001 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:03.001 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:03.001 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:03.001 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:29:03.003 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:29:03.003 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:03.002+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:03.025 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:29:03.044 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:29:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:29:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:29:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:29:03.049 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:29:03.049 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:29:03.050 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:29:03.051 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":58,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:29:00.860037+0000","last_up_change":"2024-04-26T12:27:47.657403+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.85364794731140137,"average_primary_affinity":0.85000002384185791,"average_primary_affinity_weighted":0.85000002384185791}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.2400000095367432,"score_stable":2.2400000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.85364794731140137,"average_primary_affinity":0.85000002384185791,"average_primary_affinity_weighted":0.85000002384185791}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:26:51.091400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.4300000667572021,"score_stable":2.4300000667572021,"optimal_score":0.67000001668930054,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":0.85364794731140137,"average_primary_affinity":0.85000002384185791,"average_primary_affinity_weighted":0.85000002384185791}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:26:52.222159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.3299999237060547,"score_stable":2.3299999237060547,"optimal_score":0.67000001668930054,"raw_score_acting":1.559999942779541,"raw_score_stable":1.559999942779541,"primary_affinity_weighted":0.85364794731140137,"average_primary_affinity":0.85000002384185791,"average_primary_affinity_weighted":0.85000002384185791}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":0.541412353515625,"primary_affinity":0.560943603515625,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":30,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":41393},{"type":"v1","addr":"172.21.15.136:6801","nonce":41393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":41393},{"type":"v1","addr":"172.21.15.136:6803","nonce":41393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":41393},{"type":"v1","addr":"172.21.15.136:6807","nonce":41393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":41393},{"type":"v1","addr":"172.21.15.136:6805","nonce":41393}]},"public_addr":"172.21.15.136:6801/41393","cluster_addr":"172.21.15.136:6803/41393","heartbeat_back_addr":"172.21.15.136:6807/41393","heartbeat_front_addr":"172.21.15.136:6805/41393","state":["exists"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":29},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.19","osds":[0,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[2,0]},{"pgid":"2.3","osds":[2,0]},{"pgid":"2.7","osds":[2,0]},{"pgid":"3.5","osds":[2,0]},{"pgid":"3.6","osds":[2,0]},{"pgid":"3.9","osds":[2,0]},{"pgid":"3.b","osds":[2,0]},{"pgid":"3.d","osds":[2,0]},{"pgid":"3.e","osds":[2,0]},{"pgid":"3.f","osds":[2,0]},{"pgid":"3.10","osds":[2,0]},{"pgid":"3.12","osds":[2,0]},{"pgid":"3.14","osds":[2,0]},{"pgid":"3.16","osds":[2,0]},{"pgid":"3.19","osds":[2,0]},{"pgid":"3.1b","osds":[2,0]},{"pgid":"3.1c","osds":[2,0]},{"pgid":"3.1f","osds":[2,0]},{"pgid":"4.0","osds":[2,0]},{"pgid":"4.a","osds":[2,0]},{"pgid":"4.c","osds":[2,0]},{"pgid":"4.d","osds":[2,0]},{"pgid":"4.13","osds":[2,0]},{"pgid":"4.16","osds":[2,0]},{"pgid":"4.17","osds":[2,0]},{"pgid":"4.18","osds":[2,0]},{"pgid":"4.1e","osds":[2,0]},{"pgid":"4.1f","osds":[2,0]},{"pgid":"4.20","osds":[2,0]},{"pgid":"4.29","osds":[2,0]},{"pgid":"4.30","osds":[2,0]},{"pgid":"4.31","osds":[2,0]},{"pgid":"4.35","osds":[2,0]},{"pgid":"4.38","osds":[2,0]},{"pgid":"4.3a","osds":[2,0]},{"pgid":"4.3d","osds":[2,0]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:29:03.066 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:26:45.341269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:26:45.839095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:26:51.091400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.430000066757202, 'score_stable': 2.430000066757202, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:26:52.222159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2.3299999237060547, 'score_stable': 2.3299999237060547, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.559999942779541, 'raw_score_stable': 1.559999942779541, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}] 2024-04-26T12:29:03.066 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:29:03.103 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:03.103+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:03.136 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:03.136 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:03.146 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:29:03.204 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:03.204+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:03.272 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:03.272 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:03.282 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:29:03.305 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:03.305+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:03.406 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:03.405+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:03.431 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:03.431 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:03.443 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:29:03.465 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-04-26T12:29:03.480 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:29:03.507 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:03.507+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:03.598 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:03.598 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:03.608 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:29:03.609 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:03.608+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:03.709 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:03.708+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:03.774 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:03.774 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:03.784 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:29:03.810 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:03.809+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:03.824 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2024-04-26T12:29:03.839 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:29:03.880 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is set 2024-04-26T12:29:03.910 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:03.910+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:03.912 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:03.912 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:03.923 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:29:04.012 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:04.011+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:04.050 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:04.050 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:04.059 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:29:04.112 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:04.112+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:04.183 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-04-26T12:29:04.184 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:04.184 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:04.194 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:29:04.198 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:29:04.213 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:04.213+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:04.314 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:04.314+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:04.320 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:04.320 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:04.330 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:29:04.415 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:04.414+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:04.461 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:04.461 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:04.471 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:29:04.516 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:04.515+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:04.537 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-04-26T12:29:04.552 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T12:29:04.597 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:04.597 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:04.606 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:29:04.616 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:04.616+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:04.717 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:04.717+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:04.732 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:04.732 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:04.742 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:29:04.819 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:04.818+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:04.869 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:04.869 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:04.879 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:29:04.909 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-04-26T12:29:04.921 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:04.920+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:04.921 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-04-26T12:29:04.922 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T12:29:04.941 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:29:05.020 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:05.020+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:05.045 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:05.045 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:05.050 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:29:05.055 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:29:05.121 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:05.121+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:05.201 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:29:05.221 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:29:05.221 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:29:05.221 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:29:05.222 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:29:05.222 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:05.221+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:05.224 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:29:05.224 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:29:05.225 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:29:05.225 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:29:05.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:29:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:29:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1668 3.18 3:1e8917d7:::200.0000000e:head [write 3543177~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.304874884, 2024-04-26T12:29:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067259575000000002, 2024-04-26T12:29:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919147+0000", 2024-04-26T12:29:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.157e-06 2024-04-26T12:29:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919151+0000", 2024-04-26T12:29:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.313e-06 2024-04-26T12:29:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919154+0000", 2024-04-26T12:29:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:29:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982687+0000", 2024-04-26T12:29:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063532694000000001 2024-04-26T12:29:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982750+0000", 2024-04-26T12:29:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:29:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986254+0000", 2024-04-26T12:29:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035043880000000002 2024-04-26T12:29:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986322+0000", 2024-04-26T12:29:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7458000000000004e-05 2024-04-26T12:29:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986404+0000", 2024-04-26T12:29:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2015000000000007e-05 2024-04-26T12:29:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1669 3.18 3:1e8917d7:::200.0000000e:head [write 3544575~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.304862271000001, 2024-04-26T12:29:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067362678999999995, 2024-04-26T12:29:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:29:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919158+0000", 2024-04-26T12:29:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.536e-06 2024-04-26T12:29:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919161+0000", 2024-04-26T12:29:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:29:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919164+0000", 2024-04-26T12:29:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:29:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983465+0000", 2024-04-26T12:29:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064301233999999999 2024-04-26T12:29:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983515+0000", 2024-04-26T12:29:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9774000000000002e-05 2024-04-26T12:29:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986414+0000", 2024-04-26T12:29:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0028991770000000002 2024-04-26T12:29:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986455+0000", 2024-04-26T12:29:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1090000000000001e-05 2024-04-26T12:29:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986520+0000", 2024-04-26T12:29:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4778999999999998e-05 2024-04-26T12:29:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1670 3.18 3:1e8917d7:::200.0000000e:head [write 3545973~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.304852995000001, 2024-04-26T12:29:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070481470000000004, 2024-04-26T12:29:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:29:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919172+0000", 2024-04-26T12:29:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:29:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919175+0000", 2024-04-26T12:29:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.942e-06 2024-04-26T12:29:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919177+0000", 2024-04-26T12:29:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5790000000000002e-06 2024-04-26T12:29:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983883+0000", 2024-04-26T12:29:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064705768999999996 2024-04-26T12:29:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983975+0000", 2024-04-26T12:29:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2219999999999995e-05 2024-04-26T12:29:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989262+0000", 2024-04-26T12:29:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052864940000000001 2024-04-26T12:29:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989361+0000", 2024-04-26T12:29:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9374000000000001e-05 2024-04-26T12:29:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989648+0000", 2024-04-26T12:29:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028677200000000003 2024-04-26T12:29:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1671 3.18 3:1e8917d7:::200.0000000e:head [write 3547932~12451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:29:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.303557877999999, 2024-04-26T12:29:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069443256999999994, 2024-04-26T12:29:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:29:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:29:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920460+0000", 2024-04-26T12:29:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920542+0000", 2024-04-26T12:29:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650999999999995e-05 2024-04-26T12:29:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920554+0000", 2024-04-26T12:29:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2228e-05 2024-04-26T12:29:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920560+0000", 2024-04-26T12:29:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8869999999999997e-06 2024-04-26T12:29:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984749+0000", 2024-04-26T12:29:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064188913 2024-04-26T12:29:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984795+0000", 2024-04-26T12:29:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5893000000000003e-05 2024-04-26T12:29:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989659+0000", 2024-04-26T12:29:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048643669999999996 2024-04-26T12:29:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989836+0000", 2024-04-26T12:29:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017699799999999999 2024-04-26T12:29:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989905+0000", 2024-04-26T12:29:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8238000000000006e-05 2024-04-26T12:29:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1672 3.18 3:1e8917d7:::200.0000000e:head [write 3560383~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.303454236, 2024-04-26T12:29:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070651368000000006, 2024-04-26T12:29:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920569+0000", 2024-04-26T12:29:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2610000000000004e-06 2024-04-26T12:29:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920572+0000", 2024-04-26T12:29:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6150000000000001e-06 2024-04-26T12:29:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920578+0000", 2024-04-26T12:29:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:29:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985287+0000", 2024-04-26T12:29:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064708946000000003 2024-04-26T12:29:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985343+0000", 2024-04-26T12:29:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6109000000000001e-05 2024-04-26T12:29:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991135+0000", 2024-04-26T12:29:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057923430000000001 2024-04-26T12:29:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991163+0000", 2024-04-26T12:29:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7083000000000001e-05 2024-04-26T12:29:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991216+0000", 2024-04-26T12:29:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3854999999999999e-05 2024-04-26T12:29:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1673 3.18 3:1e8917d7:::200.0000000e:head [write 3563148~4730 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:29:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.301700105999998, 2024-04-26T12:29:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068974127999999996, 2024-04-26T12:29:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:29:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:29:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922318+0000", 2024-04-26T12:29:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922327+0000", 2024-04-26T12:29:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.02e-06 2024-04-26T12:29:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922336+0000", 2024-04-26T12:29:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:29:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922344+0000", 2024-04-26T12:29:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5220000000000001e-06 2024-04-26T12:29:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986575+0000", 2024-04-26T12:29:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064231885000000002 2024-04-26T12:29:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986628+0000", 2024-04-26T12:29:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.219e-05 2024-04-26T12:29:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991222+0000", 2024-04-26T12:29:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045942500000000002 2024-04-26T12:29:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991245+0000", 2024-04-26T12:29:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2764000000000001e-05 2024-04-26T12:29:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991293+0000", 2024-04-26T12:29:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8628999999999998e-05 2024-04-26T12:29:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:13020 4.10 4:09df41af:::1000000333c.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:29:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:29:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.300697885000002, 2024-04-26T12:29:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066586204999999996, 2024-04-26T12:29:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:29:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:29:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:29:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:29:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 13020 2024-04-26T12:29:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:29:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:29:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923320+0000", 2024-04-26T12:29:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:29:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923328+0000", 2024-04-26T12:29:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3289999999999994e-06 2024-04-26T12:29:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923340+0000", 2024-04-26T12:29:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1891e-05 2024-04-26T12:29:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923353+0000", 2024-04-26T12:29:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3273e-05 2024-04-26T12:29:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986568+0000", 2024-04-26T12:29:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063214801000000001 2024-04-26T12:29:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986686+0000", 2024-04-26T12:29:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118009 2024-04-26T12:29:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989908+0000", 2024-04-26T12:29:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032213039999999999 2024-04-26T12:29:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1674 3.18 3:1e8917d7:::200.0000000e:head [write 3567878~12568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:29:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.299765100999998, 2024-04-26T12:29:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067102822000000006, 2024-04-26T12:29:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:29:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:29:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924253+0000", 2024-04-26T12:29:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924269+0000", 2024-04-26T12:29:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:29:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924279+0000", 2024-04-26T12:29:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0676000000000001e-05 2024-04-26T12:29:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924288+0000", 2024-04-26T12:29:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4649999999999994e-06 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987080+0000", 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062792312000000003 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987132+0000", 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1712999999999998e-05 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991298+0000", 2024-04-26T12:29:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041660539999999998 2024-04-26T12:29:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991321+0000", 2024-04-26T12:29:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3575e-05 2024-04-26T12:29:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991357+0000", 2024-04-26T12:29:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5506000000000002e-05 2024-04-26T12:29:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1675 3.18 3:1e8917d7:::200.0000000e:head [write 3580446~9112 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:29:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.298745558, 2024-04-26T12:29:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066218224000000006, 2024-04-26T12:29:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:29:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:29:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925273+0000", 2024-04-26T12:29:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925282+0000", 2024-04-26T12:29:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:29:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925291+0000", 2024-04-26T12:29:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2800000000000003e-06 2024-04-26T12:29:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925296+0000", 2024-04-26T12:29:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6080000000000003e-06 2024-04-26T12:29:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987663+0000", 2024-04-26T12:29:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062366705000000001 2024-04-26T12:29:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987729+0000", 2024-04-26T12:29:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6330999999999999e-05 2024-04-26T12:29:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991362+0000", 2024-04-26T12:29:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036322820000000001 2024-04-26T12:29:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991431+0000", 2024-04-26T12:29:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9799e-05 2024-04-26T12:29:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991492+0000", 2024-04-26T12:29:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0587000000000001e-05 2024-04-26T12:29:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1676 3.18 3:1e8917d7:::200.0000000e:head [write 3589558~5068 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.298546322, 2024-04-26T12:29:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066120133999999997, 2024-04-26T12:29:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925479+0000", 2024-04-26T12:29:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.054e-06 2024-04-26T12:29:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925489+0000", 2024-04-26T12:29:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0847e-05 2024-04-26T12:29:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925494+0000", 2024-04-26T12:29:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6569999999999996e-06 2024-04-26T12:29:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988275+0000", 2024-04-26T12:29:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062780582000000001 2024-04-26T12:29:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988319+0000", 2024-04-26T12:29:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3881999999999998e-05 2024-04-26T12:29:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991497+0000", 2024-04-26T12:29:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031781520000000001 2024-04-26T12:29:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991519+0000", 2024-04-26T12:29:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2382e-05 2024-04-26T12:29:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991593+0000", 2024-04-26T12:29:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3987999999999997e-05 2024-04-26T12:29:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1677 3.18 3:1e8917d7:::200.0000000e:head [write 3594626~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.298144808, 2024-04-26T12:29:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065839106999999994, 2024-04-26T12:29:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925880+0000", 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925896+0000", 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5696999999999999e-05 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925904+0000", 2024-04-26T12:29:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9619999999999993e-06 2024-04-26T12:29:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988800+0000", 2024-04-26T12:29:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062896142000000002 2024-04-26T12:29:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988877+0000", 2024-04-26T12:29:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7175999999999994e-05 2024-04-26T12:29:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991598+0000", 2024-04-26T12:29:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027209399999999998 2024-04-26T12:29:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991620+0000", 2024-04-26T12:29:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2396e-05 2024-04-26T12:29:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991714+0000", 2024-04-26T12:29:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3213000000000004e-05 2024-04-26T12:29:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1678 3.18 3:1e8917d7:::200.0000000e:head [write 3597232~4822 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.297207786000001, 2024-04-26T12:29:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066189707, 2024-04-26T12:29:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926819+0000", 2024-04-26T12:29:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:29:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926831+0000", 2024-04-26T12:29:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2300000000000001e-05 2024-04-26T12:29:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926839+0000", 2024-04-26T12:29:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9929999999999995e-06 2024-04-26T12:29:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989923+0000", 2024-04-26T12:29:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063083319999999998 2024-04-26T12:29:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989970+0000", 2024-04-26T12:29:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7290000000000003e-05 2024-04-26T12:29:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992907+0000", 2024-04-26T12:29:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029369740000000002 2024-04-26T12:29:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992953+0000", 2024-04-26T12:29:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6165000000000003e-05 2024-04-26T12:29:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993001+0000", 2024-04-26T12:29:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7984e-05 2024-04-26T12:29:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1679 3.18 3:1e8917d7:::200.0000000e:head [write 3602054~5518 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.297166197999999, 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068775656000000004, 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926858+0000", 2024-04-26T12:29:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7969999999999997e-06 2024-04-26T12:29:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926871+0000", 2024-04-26T12:29:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2965e-05 2024-04-26T12:29:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926878+0000", 2024-04-26T12:29:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9369999999999998e-06 2024-04-26T12:29:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990409+0000", 2024-04-26T12:29:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063531219999999999 2024-04-26T12:29:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990537+0000", 2024-04-26T12:29:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000127074 2024-04-26T12:29:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995467+0000", 2024-04-26T12:29:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049307190000000001 2024-04-26T12:29:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995519+0000", 2024-04-26T12:29:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1638000000000003e-05 2024-04-26T12:29:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995629+0000", 2024-04-26T12:29:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109852 2024-04-26T12:29:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1680 3.18 3:1e8917d7:::200.0000000e:head [write 3607572~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:29:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.297130677999998, 2024-04-26T12:29:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070113521999999998, 2024-04-26T12:29:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:29:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:29:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926885+0000", 2024-04-26T12:29:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999962 2024-04-26T12:29:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926893+0000", 2024-04-26T12:29:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6299999999999998e-06 2024-04-26T12:29:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926899+0000", 2024-04-26T12:29:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5359999999999998e-06 2024-04-26T12:29:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926906+0000", 2024-04-26T12:29:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8349999999999998e-06 2024-04-26T12:29:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991747+0000", 2024-04-26T12:29:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064841012000000003 2024-04-26T12:29:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991834+0000", 2024-04-26T12:29:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6602999999999997e-05 2024-04-26T12:29:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996894+0000", 2024-04-26T12:29:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050608850000000002 2024-04-26T12:29:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996954+0000", 2024-04-26T12:29:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9598000000000001e-05 2024-04-26T12:29:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997002+0000", 2024-04-26T12:29:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8050000000000002e-05 2024-04-26T12:29:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1681 3.18 3:1e8917d7:::200.0000000e:head [write 3609487~2938 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:29:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.297090684, 2024-04-26T12:29:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070147752999999993, 2024-04-26T12:29:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:29:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:29:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926928+0000", 2024-04-26T12:29:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926932+0000", 2024-04-26T12:29:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5669999999999999e-06 2024-04-26T12:29:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926939+0000", 2024-04-26T12:29:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:29:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926947+0000", 2024-04-26T12:29:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.238e-06 2024-04-26T12:29:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992399+0000", 2024-04-26T12:29:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065452859000000002 2024-04-26T12:29:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992484+0000", 2024-04-26T12:29:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4197999999999996e-05 2024-04-26T12:29:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997011+0000", 2024-04-26T12:29:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045271759999999999 2024-04-26T12:29:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997038+0000", 2024-04-26T12:29:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7684000000000001e-05 2024-04-26T12:29:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997076+0000", 2024-04-26T12:29:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7901000000000002e-05 2024-04-26T12:29:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1682 3.18 3:1e8917d7:::200.0000000e:head [write 3612425~3220 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.294763851999999, 2024-04-26T12:29:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067934001999999993, 2024-04-26T12:29:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929260+0000", 2024-04-26T12:29:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:29:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929268+0000", 2024-04-26T12:29:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6399999999999997e-06 2024-04-26T12:29:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929273+0000", 2024-04-26T12:29:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:29:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993049+0000", 2024-04-26T12:29:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063775736999999999 2024-04-26T12:29:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993159+0000", 2024-04-26T12:29:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000110807 2024-04-26T12:29:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997083+0000", 2024-04-26T12:29:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039233769999999996 2024-04-26T12:29:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997126+0000", 2024-04-26T12:29:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3544999999999997e-05 2024-04-26T12:29:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997189+0000", 2024-04-26T12:29:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3128999999999998e-05 2024-04-26T12:29:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1683 3.18 3:1e8917d7:::200.0000000e:head [write 3615645~5682 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:29:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.294516740999999, 2024-04-26T12:29:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067807854000000001, 2024-04-26T12:29:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:29:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:29:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929502+0000", 2024-04-26T12:29:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929510+0000", 2024-04-26T12:29:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1179999999999992e-06 2024-04-26T12:29:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929519+0000", 2024-04-26T12:29:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2129999999999997e-06 2024-04-26T12:29:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929531+0000", 2024-04-26T12:29:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1615e-05 2024-04-26T12:29:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993765+0000", 2024-04-26T12:29:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064233810000000002 2024-04-26T12:29:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993842+0000", 2024-04-26T12:29:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7645999999999995e-05 2024-04-26T12:29:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997198+0000", 2024-04-26T12:29:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003355977 2024-04-26T12:29:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997249+0000", 2024-04-26T12:29:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0834000000000002e-05 2024-04-26T12:29:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997310+0000", 2024-04-26T12:29:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1408999999999994e-05 2024-04-26T12:29:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1684 3.18 3:1e8917d7:::200.0000000e:head [write 3621327~8700 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:29:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.292220165, 2024-04-26T12:29:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066650928999999998, 2024-04-26T12:29:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:29:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:29:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931798+0000", 2024-04-26T12:29:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931809+0000", 2024-04-26T12:29:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0662000000000001e-05 2024-04-26T12:29:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931816+0000", 2024-04-26T12:29:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1590000000000004e-06 2024-04-26T12:29:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931821+0000", 2024-04-26T12:29:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0710000000000002e-06 2024-04-26T12:29:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994486+0000", 2024-04-26T12:29:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062664719999999993 2024-04-26T12:29:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994567+0000", 2024-04-26T12:29:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1138999999999997e-05 2024-04-26T12:29:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998343+0000", 2024-04-26T12:29:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003775769 2024-04-26T12:29:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998387+0000", 2024-04-26T12:29:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4564999999999998e-05 2024-04-26T12:29:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998450+0000", 2024-04-26T12:29:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2589999999999995e-05 2024-04-26T12:29:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1685 3.18 3:1e8917d7:::200.0000000e:head [write 3630027~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.292193295000001, 2024-04-26T12:29:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066694793000000002, 2024-04-26T12:29:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931828+0000", 2024-04-26T12:29:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:29:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931831+0000", 2024-04-26T12:29:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.45e-06 2024-04-26T12:29:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931835+0000", 2024-04-26T12:29:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:29:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995016+0000", 2024-04-26T12:29:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063180397999999999 2024-04-26T12:29:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995064+0000", 2024-04-26T12:29:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8538999999999997e-05 2024-04-26T12:29:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998455+0000", 2024-04-26T12:29:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033911000000000002 2024-04-26T12:29:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998478+0000", 2024-04-26T12:29:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2793999999999999e-05 2024-04-26T12:29:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998521+0000", 2024-04-26T12:29:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2608999999999998e-05 2024-04-26T12:29:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1687 3.18 3:1e8917d7:::200.0000000e:head [write 3636544~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.290976091000001, 2024-04-26T12:29:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068592686, 2024-04-26T12:29:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933046+0000", 2024-04-26T12:29:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0850000000000001e-06 2024-04-26T12:29:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933050+0000", 2024-04-26T12:29:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5549999999999996e-06 2024-04-26T12:29:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933054+0000", 2024-04-26T12:29:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:29:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996223+0000", 2024-04-26T12:29:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063169004000000001 2024-04-26T12:29:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996307+0000", 2024-04-26T12:29:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3660999999999997e-05 2024-04-26T12:29:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001540+0000", 2024-04-26T12:29:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052334160000000003 2024-04-26T12:29:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001573+0000", 2024-04-26T12:29:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2981999999999997e-05 2024-04-26T12:29:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001636+0000", 2024-04-26T12:29:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2601999999999995e-05 2024-04-26T12:29:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:05.322 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:29:05.323 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:05.322+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:05.323 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:29:05.329 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:29:05.329 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":59,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:29:03.870475+0000","last_up_change":"2024-04-26T12:27:47.657403+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5806080,"flags_set":["nodeep-scrub","noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.85364794731140137,"average_primary_affinity":0.85000002384185791,"average_primary_affinity_weighted":0.85000002384185791}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.2400000095367432,"score_stable":2.2400000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.85364794731140137,"average_primary_affinity":0.85000002384185791,"average_primary_affinity_weighted":0.85000002384185791}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:26:51.091400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.4300000667572021,"score_stable":2.4300000667572021,"optimal_score":0.67000001668930054,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":0.85364794731140137,"average_primary_affinity":0.85000002384185791,"average_primary_affinity_weighted":0.85000002384185791}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:26:52.222159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.3299999237060547,"score_stable":2.3299999237060547,"optimal_score":0.67000001668930054,"raw_score_acting":1.559999942779541,"raw_score_stable":1.559999942779541,"primary_affinity_weighted":0.85364794731140137,"average_primary_affinity":0.85000002384185791,"average_primary_affinity_weighted":0.85000002384185791}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":0.541412353515625,"primary_affinity":0.560943603515625,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":30,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":41393},{"type":"v1","addr":"172.21.15.136:6801","nonce":41393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":41393},{"type":"v1","addr":"172.21.15.136:6803","nonce":41393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":41393},{"type":"v1","addr":"172.21.15.136:6807","nonce":41393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":41393},{"type":"v1","addr":"172.21.15.136:6805","nonce":41393}]},"public_addr":"172.21.15.136:6801/41393","cluster_addr":"172.21.15.136:6803/41393","heartbeat_back_addr":"172.21.15.136:6807/41393","heartbeat_front_addr":"172.21.15.136:6805/41393","state":["exists"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":29},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.19","osds":[0,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[2,0]},{"pgid":"2.3","osds":[2,0]},{"pgid":"2.7","osds":[2,0]},{"pgid":"3.5","osds":[2,0]},{"pgid":"3.6","osds":[2,0]},{"pgid":"3.9","osds":[2,0]},{"pgid":"3.b","osds":[2,0]},{"pgid":"3.d","osds":[2,0]},{"pgid":"3.e","osds":[2,0]},{"pgid":"3.f","osds":[2,0]},{"pgid":"3.10","osds":[2,0]},{"pgid":"3.12","osds":[2,0]},{"pgid":"3.14","osds":[2,0]},{"pgid":"3.16","osds":[2,0]},{"pgid":"3.19","osds":[2,0]},{"pgid":"3.1b","osds":[2,0]},{"pgid":"3.1c","osds":[2,0]},{"pgid":"3.1f","osds":[2,0]},{"pgid":"4.0","osds":[2,0]},{"pgid":"4.a","osds":[2,0]},{"pgid":"4.c","osds":[2,0]},{"pgid":"4.d","osds":[2,0]},{"pgid":"4.13","osds":[2,0]},{"pgid":"4.16","osds":[2,0]},{"pgid":"4.17","osds":[2,0]},{"pgid":"4.18","osds":[2,0]},{"pgid":"4.1e","osds":[2,0]},{"pgid":"4.1f","osds":[2,0]},{"pgid":"4.20","osds":[2,0]},{"pgid":"4.29","osds":[2,0]},{"pgid":"4.30","osds":[2,0]},{"pgid":"4.31","osds":[2,0]},{"pgid":"4.35","osds":[2,0]},{"pgid":"4.38","osds":[2,0]},{"pgid":"4.3a","osds":[2,0]},{"pgid":"4.3d","osds":[2,0]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:29:05.344 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T12:26:45.341269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T12:26:45.839095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T12:26:51.091400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.430000066757202, 'score_stable': 2.430000066757202, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T12:26:52.222159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2.3299999237060547, 'score_stable': 2.3299999237060547, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.559999942779541, 'raw_score_stable': 1.559999942779541, 'primary_affinity_weighted': 0.8536479473114014, 'average_primary_affinity': 0.8500000238418579, 'average_primary_affinity_weighted': 0.8500000238418579}}] 2024-04-26T12:29:05.344 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T12:29:05.424 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:05.423+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:05.462 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:29:05.462 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:29:05.462 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:29:05.462 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:29:05.472 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:29:05.525 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:05.525+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:05.597 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:29:05.598 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:29:05.598 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:29:05.598 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:29:05.598 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:29:05.607 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:29:05.648 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:05.648+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:05.687 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-04-26T12:29:05.702 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T12:29:05.727 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:05.727+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:05.776 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:29:05.776 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:29:05.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:29:05.776 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:29:05.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.776 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:293 3.13 3:ceffbd45:::200.0000000a:head [write 594763~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.776 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:29:05.776 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.849602031, 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038803585000000002, 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924874+0000", 2024-04-26T12:29:05.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924877+0000", 2024-04-26T12:29:05.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7329999999999999e-06 2024-04-26T12:29:05.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924884+0000", 2024-04-26T12:29:05.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924890+0000", 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958764+0000", 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.033873863999999997 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958855+0000", 2024-04-26T12:29:05.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1402000000000003e-05 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963608+0000", 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047529039999999996 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963636+0000", 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8194000000000001e-05 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963678+0000", 2024-04-26T12:29:05.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2095999999999998e-05 2024-04-26T12:29:05.781 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.781 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.781 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.781 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:294 3.13 3:ceffbd45:::200.0000000a:head [write 596172~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.781 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:29:05.781 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.849557287, 2024-04-26T12:29:05.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041225228000000003, 2024-04-26T12:29:05.781 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.781 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.781 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:29:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:29:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924919+0000", 2024-04-26T12:29:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924922+0000", 2024-04-26T12:29:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9160000000000001e-06 2024-04-26T12:29:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924928+0000", 2024-04-26T12:29:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3929999999999996e-06 2024-04-26T12:29:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924933+0000", 2024-04-26T12:29:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7820000000000001e-06 2024-04-26T12:29:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959359+0000", 2024-04-26T12:29:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034425782000000002 2024-04-26T12:29:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959439+0000", 2024-04-26T12:29:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0275e-05 2024-04-26T12:29:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966079+0000", 2024-04-26T12:29:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0066397089999999997 2024-04-26T12:29:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966106+0000", 2024-04-26T12:29:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7178e-05 2024-04-26T12:29:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966145+0000", 2024-04-26T12:29:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8618999999999997e-05 2024-04-26T12:29:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:295 3.13 3:ceffbd45:::200.0000000a:head [write 597574~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:29:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.849531137, 2024-04-26T12:29:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041258571000000001, 2024-04-26T12:29:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:29:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924945+0000", 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924948+0000", 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:29:05.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924955+0000", 2024-04-26T12:29:05.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4629999999999998e-06 2024-04-26T12:29:05.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924959+0000", 2024-04-26T12:29:05.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2719999999999999e-06 2024-04-26T12:29:05.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959957+0000", 2024-04-26T12:29:05.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034997588000000003 2024-04-26T12:29:05.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960042+0000", 2024-04-26T12:29:05.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5811999999999998e-05 2024-04-26T12:29:05.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966149+0000", 2024-04-26T12:29:05.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061071650000000003 2024-04-26T12:29:05.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966171+0000", 2024-04-26T12:29:05.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1905000000000001e-05 2024-04-26T12:29:05.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966204+0000", 2024-04-26T12:29:05.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2845999999999997e-05 2024-04-26T12:29:05.790 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.790 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.790 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.790 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:296 3.13 3:ceffbd45:::200.0000000a:head [write 598977~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.791 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:05.791 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.849499507000001, 2024-04-26T12:29:05.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041282538000000001, 2024-04-26T12:29:05.791 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.791 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.791 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:05.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:05.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:05.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:29:05.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924979+0000", 2024-04-26T12:29:05.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3609999999999999e-06 2024-04-26T12:29:05.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924984+0000", 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3259999999999997e-06 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924987+0000", 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7810000000000001e-06 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960618+0000", 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035631875 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960698+0000", 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9373000000000001e-05 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966208+0000", 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055104359999999996 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966228+0000", 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0208e-05 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966260+0000", 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1404e-05 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:297 3.13 3:ceffbd45:::200.0000000a:head [write 600380~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.849462673000001, 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041309850000000002, 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.795 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925017+0000", 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.96e-06 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925020+0000", 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6629999999999999e-06 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925023+0000", 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961241+0000", 2024-04-26T12:29:05.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036217390000000002 2024-04-26T12:29:05.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961335+0000", 2024-04-26T12:29:05.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4537000000000006e-05 2024-04-26T12:29:05.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966264+0000", 2024-04-26T12:29:05.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004928516 2024-04-26T12:29:05.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966290+0000", 2024-04-26T12:29:05.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5658999999999999e-05 2024-04-26T12:29:05.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966324+0000", 2024-04-26T12:29:05.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4459000000000003e-05 2024-04-26T12:29:05.799 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.799 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.799 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.800 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:298 3.13 3:ceffbd45:::200.0000000a:head [write 602634~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.800 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:29:05.800 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.849430078000001, 2024-04-26T12:29:05.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046387536, 2024-04-26T12:29:05.800 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.800 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.800 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:29:05.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:29:05.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925046+0000", 2024-04-26T12:29:05.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:29:05.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925049+0000", 2024-04-26T12:29:05.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4770000000000002e-06 2024-04-26T12:29:05.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925057+0000", 2024-04-26T12:29:05.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9219999999999997e-06 2024-04-26T12:29:05.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925062+0000", 2024-04-26T12:29:05.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:29:05.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961918+0000", 2024-04-26T12:29:05.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036856170000000001 2024-04-26T12:29:05.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962014+0000", 2024-04-26T12:29:05.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6731999999999995e-05 2024-04-26T12:29:05.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971360+0000", 2024-04-26T12:29:05.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0093454569999999997 2024-04-26T12:29:05.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971393+0000", 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3130999999999998e-05 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971434+0000", 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1244e-05 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:299 3.13 3:ceffbd45:::200.0000000a:head [write 604033~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.849376246999999, 2024-04-26T12:29:05.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046395615000000001, 2024-04-26T12:29:05.805 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.805 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.805 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:29:05.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:29:05.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925100+0000", 2024-04-26T12:29:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925103+0000", 2024-04-26T12:29:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3520000000000001e-06 2024-04-26T12:29:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925108+0000", 2024-04-26T12:29:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6489999999999996e-06 2024-04-26T12:29:05.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925111+0000", 2024-04-26T12:29:05.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.79e-06 2024-04-26T12:29:05.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962405+0000", 2024-04-26T12:29:05.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037293953999999997 2024-04-26T12:29:05.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962457+0000", 2024-04-26T12:29:05.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2003000000000003e-05 2024-04-26T12:29:05.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971440+0000", 2024-04-26T12:29:05.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0089831719999999993 2024-04-26T12:29:05.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971463+0000", 2024-04-26T12:29:05.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3201e-05 2024-04-26T12:29:05.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971496+0000", 2024-04-26T12:29:05.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2836000000000002e-05 2024-04-26T12:29:05.809 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.809 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.809 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.809 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:300 3.13 3:ceffbd45:::200.0000000a:head [write 605436~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.809 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:05.809 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.849312389000001, 2024-04-26T12:29:05.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046389606999999999, 2024-04-26T12:29:05.809 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.809 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925167+0000", 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8870000000000001e-06 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925171+0000", 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6049999999999998e-06 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925173+0000", 2024-04-26T12:29:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8250000000000001e-06 2024-04-26T12:29:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962740+0000", 2024-04-26T12:29:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037566436000000002 2024-04-26T12:29:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962818+0000", 2024-04-26T12:29:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8231000000000004e-05 2024-04-26T12:29:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971501+0000", 2024-04-26T12:29:05.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008682525 2024-04-26T12:29:05.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971522+0000", 2024-04-26T12:29:05.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1673999999999999e-05 2024-04-26T12:29:05.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971554+0000", 2024-04-26T12:29:05.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1786999999999999e-05 2024-04-26T12:29:05.813 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.814 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.814 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.814 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:301 3.13 3:ceffbd45:::200.0000000a:head [write 606838~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.814 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:05.815 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.849295780999999, 2024-04-26T12:29:05.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046429455000000001, 2024-04-26T12:29:05.815 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.815 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.815 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:05.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:05.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:05.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:29:05.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925183+0000", 2024-04-26T12:29:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0150000000000002e-06 2024-04-26T12:29:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925186+0000", 2024-04-26T12:29:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2210000000000002e-06 2024-04-26T12:29:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925190+0000", 2024-04-26T12:29:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8489999999999999e-06 2024-04-26T12:29:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963304+0000", 2024-04-26T12:29:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038114207999999997 2024-04-26T12:29:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963356+0000", 2024-04-26T12:29:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1628000000000001e-05 2024-04-26T12:29:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971558+0000", 2024-04-26T12:29:05.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082025199999999996 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971579+0000", 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1019e-05 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971610+0000", 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1205999999999999e-05 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:302 3.13 3:ceffbd45:::200.0000000a:head [write 608236~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.849274588, 2024-04-26T12:29:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046464057000000003, 2024-04-26T12:29:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925204+0000", 2024-04-26T12:29:05.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1270000000000001e-06 2024-04-26T12:29:05.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925207+0000", 2024-04-26T12:29:05.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3720000000000001e-06 2024-04-26T12:29:05.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925210+0000", 2024-04-26T12:29:05.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7489999999999999e-06 2024-04-26T12:29:05.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963713+0000", 2024-04-26T12:29:05.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038502508999999997 2024-04-26T12:29:05.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963792+0000", 2024-04-26T12:29:05.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9087999999999999e-05 2024-04-26T12:29:05.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971615+0000", 2024-04-26T12:29:05.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078230130000000002 2024-04-26T12:29:05.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971636+0000", 2024-04-26T12:29:05.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0996999999999999e-05 2024-04-26T12:29:05.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971666+0000", 2024-04-26T12:29:05.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0443999999999999e-05 2024-04-26T12:29:05.824 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.824 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.824 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.824 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:303 3.13 3:ceffbd45:::200.0000000a:head [write 609649~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.825 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:05.825 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.849231567, 2024-04-26T12:29:05.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.047363031, 2024-04-26T12:29:05.825 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.825 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.825 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:05.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:05.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:05.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925253+0000", 2024-04-26T12:29:05.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0369999999999995e-06 2024-04-26T12:29:05.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925261+0000", 2024-04-26T12:29:05.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7420000000000003e-06 2024-04-26T12:29:05.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925271+0000", 2024-04-26T12:29:05.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1589999999999999e-06 2024-04-26T12:29:05.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964198+0000", 2024-04-26T12:29:05.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038927182999999997 2024-04-26T12:29:05.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964281+0000", 2024-04-26T12:29:05.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3355000000000004e-05 2024-04-26T12:29:05.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972542+0000", 2024-04-26T12:29:05.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082607930000000006 2024-04-26T12:29:05.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972570+0000", 2024-04-26T12:29:05.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7937999999999999e-05 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972608+0000", 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8384999999999999e-05 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:304 3.13 3:ceffbd45:::200.0000000a:head [write 611057~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.848065938000001, 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046259867000000003, 2024-04-26T12:29:05.829 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.830 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.830 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:29:05.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:29:05.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926410+0000", 2024-04-26T12:29:05.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926415+0000", 2024-04-26T12:29:05.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7999999999999998e-06 2024-04-26T12:29:05.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926423+0000", 2024-04-26T12:29:05.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8569999999999995e-06 2024-04-26T12:29:05.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926429+0000", 2024-04-26T12:29:05.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.421e-06 2024-04-26T12:29:05.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964778+0000", 2024-04-26T12:29:05.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038349045999999998 2024-04-26T12:29:05.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964830+0000", 2024-04-26T12:29:05.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1309e-05 2024-04-26T12:29:05.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972614+0000", 2024-04-26T12:29:05.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077847070000000001 2024-04-26T12:29:05.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972638+0000", 2024-04-26T12:29:05.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3388999999999999e-05 2024-04-26T12:29:05.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972671+0000", 2024-04-26T12:29:05.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2999e-05 2024-04-26T12:29:05.834 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.834 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.834 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.834 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:305 3.13 3:ceffbd45:::200.0000000a:head [write 613824~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.834 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:05.834 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.848020899000002, 2024-04-26T12:29:05.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046273460000000002, 2024-04-26T12:29:05.834 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.834 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.835 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:05.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:05.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:05.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926463+0000", 2024-04-26T12:29:05.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:29:05.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926467+0000", 2024-04-26T12:29:05.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3000000000000003e-06 2024-04-26T12:29:05.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926470+0000", 2024-04-26T12:29:05.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1930000000000002e-06 2024-04-26T12:29:05.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965122+0000", 2024-04-26T12:29:05.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038652207000000001 2024-04-26T12:29:05.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965210+0000", 2024-04-26T12:29:05.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7832999999999997e-05 2024-04-26T12:29:05.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972675+0000", 2024-04-26T12:29:05.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074651450000000003 2024-04-26T12:29:05.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972696+0000", 2024-04-26T12:29:05.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0871999999999999e-05 2024-04-26T12:29:05.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972729+0000", 2024-04-26T12:29:05.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:29:05.839 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.839 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.839 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.839 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:306 3.13 3:ceffbd45:::200.0000000a:head [write 618844~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.839 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:29:05.839 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.847178154000002, 2024-04-26T12:29:05.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.04548866, 2024-04-26T12:29:05.839 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.839 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.839 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:29:05.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:29:05.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927298+0000", 2024-04-26T12:29:05.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927303+0000", 2024-04-26T12:29:05.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6079999999999998e-06 2024-04-26T12:29:05.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927310+0000", 2024-04-26T12:29:05.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6240000000000002e-06 2024-04-26T12:29:05.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927319+0000", 2024-04-26T12:29:05.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:29:05.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965791+0000", 2024-04-26T12:29:05.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038471350000000001 2024-04-26T12:29:05.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965839+0000", 2024-04-26T12:29:05.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8647999999999999e-05 2024-04-26T12:29:05.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972735+0000", 2024-04-26T12:29:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068952429999999997 2024-04-26T12:29:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972755+0000", 2024-04-26T12:29:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0219000000000001e-05 2024-04-26T12:29:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972787+0000", 2024-04-26T12:29:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2450000000000003e-05 2024-04-26T12:29:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:307 3.13 3:ceffbd45:::200.0000000a:head [write 621801~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.847128589, 2024-04-26T12:29:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.045498166, 2024-04-26T12:29:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927351+0000", 2024-04-26T12:29:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7130000000000001e-06 2024-04-26T12:29:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927355+0000", 2024-04-26T12:29:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1339999999999997e-06 2024-04-26T12:29:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927358+0000", 2024-04-26T12:29:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:29:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966366+0000", 2024-04-26T12:29:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039008207000000003 2024-04-26T12:29:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966457+0000", 2024-04-26T12:29:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1144999999999996e-05 2024-04-26T12:29:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972792+0000", 2024-04-26T12:29:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0063344819999999998 2024-04-26T12:29:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972815+0000", 2024-04-26T12:29:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3336000000000002e-05 2024-04-26T12:29:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972846+0000", 2024-04-26T12:29:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1504000000000002e-05 2024-04-26T12:29:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:308 3.13 3:ceffbd45:::200.0000000a:head [write 623718~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.845450543999998, 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043878271000000003, 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929042+0000", 2024-04-26T12:29:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6039e-05 2024-04-26T12:29:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929054+0000", 2024-04-26T12:29:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2275e-05 2024-04-26T12:29:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929063+0000", 2024-04-26T12:29:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7150000000000004e-06 2024-04-26T12:29:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967060+0000", 2024-04-26T12:29:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037996907000000003 2024-04-26T12:29:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967117+0000", 2024-04-26T12:29:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7701999999999997e-05 2024-04-26T12:29:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972850+0000", 2024-04-26T12:29:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0057332679999999997 2024-04-26T12:29:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972872+0000", 2024-04-26T12:29:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1138999999999999e-05 2024-04-26T12:29:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972905+0000", 2024-04-26T12:29:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2904999999999998e-05 2024-04-26T12:29:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:309 3.13 3:ceffbd45:::200.0000000a:head [write 638707~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.844627432999999, 2024-04-26T12:29:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043114311000000002, 2024-04-26T12:29:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929853+0000", 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2690000000000001e-06 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929861+0000", 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.515e-06 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929867+0000", 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4640000000000003e-06 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967590+0000", 2024-04-26T12:29:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037722506000000003 2024-04-26T12:29:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967672+0000", 2024-04-26T12:29:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2082000000000005e-05 2024-04-26T12:29:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972908+0000", 2024-04-26T12:29:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052366289999999996 2024-04-26T12:29:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972929+0000", 2024-04-26T12:29:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0752999999999999e-05 2024-04-26T12:29:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972964+0000", 2024-04-26T12:29:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4666999999999999e-05 2024-04-26T12:29:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:310 3.13 3:ceffbd45:::200.0000000a:head [write 641140~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:29:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.84458016, 2024-04-26T12:29:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043126171999999997, 2024-04-26T12:29:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:29:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:29:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929896+0000", 2024-04-26T12:29:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929899+0000", 2024-04-26T12:29:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-04-26T12:29:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929903+0000", 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.087e-06 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929907+0000", 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1480000000000002e-06 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.969962+0000", 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040055457000000003 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970018+0000", 2024-04-26T12:29:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6209999999999999e-05 2024-04-26T12:29:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972968+0000", 2024-04-26T12:29:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029501689999999999 2024-04-26T12:29:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972989+0000", 2024-04-26T12:29:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0618000000000001e-05 2024-04-26T12:29:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.973023+0000", 2024-04-26T12:29:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-26T12:29:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:312 3.13 3:ceffbd45:::200.0000000a:head [write 648907~1910 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:29:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.839250905, 2024-04-26T12:29:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039844011999999998, 2024-04-26T12:29:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:29:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:29:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935225+0000", 2024-04-26T12:29:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935229+0000", 2024-04-26T12:29:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1790000000000001e-06 2024-04-26T12:29:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935235+0000", 2024-04-26T12:29:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.716e-06 2024-04-26T12:29:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935239+0000", 2024-04-26T12:29:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5379999999999998e-06 2024-04-26T12:29:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970917+0000", 2024-04-26T12:29:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035678223000000002 2024-04-26T12:29:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971006+0000", 2024-04-26T12:29:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9248999999999999e-05 2024-04-26T12:29:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.974984+0000", 2024-04-26T12:29:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039776769999999998 2024-04-26T12:29:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975031+0000", 2024-04-26T12:29:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7500000000000003e-05 2024-04-26T12:29:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975070+0000", 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8509e-05 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:313 3.13 3:ceffbd45:::200.0000000a:head [write 650817~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.839024577, 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040236782999999998, 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:29:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:29:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935451+0000", 2024-04-26T12:29:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:29:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935457+0000", 2024-04-26T12:29:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5079999999999996e-06 2024-04-26T12:29:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935467+0000", 2024-04-26T12:29:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0407e-05 2024-04-26T12:29:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935477+0000", 2024-04-26T12:29:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3989999999999993e-06 2024-04-26T12:29:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971691+0000", 2024-04-26T12:29:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036214534 2024-04-26T12:29:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971741+0000", 2024-04-26T12:29:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0294000000000003e-05 2024-04-26T12:29:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975619+0000", 2024-04-26T12:29:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038779259999999999 2024-04-26T12:29:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975647+0000", 2024-04-26T12:29:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:29:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975689+0000", 2024-04-26T12:29:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2055999999999998e-05 2024-04-26T12:29:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:05.873 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:29:05.874 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:29:05.875 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:05.874+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:05.893 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:29:05.974 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:05.974+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:06.004 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:29:06.004 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:29:06.004 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:29:06.004 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:29:06.014 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:29:06.059 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 8 2024-04-26T12:29:06.074 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T12:29:06.098 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:06.098+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:06.176 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:06.175+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:06.181 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:29:06.181 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:29:06.182 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:29:06.182 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:29:06.182 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:29:06.193 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:29:06.277 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:06.276+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:06.361 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:29:06.361 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T12:29:06.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T12:29:06.361 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T12:29:06.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.361 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1668 3.18 3:1e8917d7:::200.0000000e:head [write 3543177~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.439931693999998, 2024-04-26T12:29:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067259575000000002, 2024-04-26T12:29:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919144+0000", 2024-04-26T12:29:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919147+0000", 2024-04-26T12:29:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.157e-06 2024-04-26T12:29:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919151+0000", 2024-04-26T12:29:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.313e-06 2024-04-26T12:29:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919154+0000", 2024-04-26T12:29:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:29:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982687+0000", 2024-04-26T12:29:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063532694000000001 2024-04-26T12:29:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.982750+0000", 2024-04-26T12:29:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:29:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986254+0000", 2024-04-26T12:29:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035043880000000002 2024-04-26T12:29:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986322+0000", 2024-04-26T12:29:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7458000000000004e-05 2024-04-26T12:29:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986404+0000", 2024-04-26T12:29:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2015000000000007e-05 2024-04-26T12:29:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1669 3.18 3:1e8917d7:::200.0000000e:head [write 3544575~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.439919080999999, 2024-04-26T12:29:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067362678999999995, 2024-04-26T12:29:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919157+0000", 2024-04-26T12:29:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:29:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919158+0000", 2024-04-26T12:29:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.536e-06 2024-04-26T12:29:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919161+0000", 2024-04-26T12:29:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8100000000000002e-06 2024-04-26T12:29:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919164+0000", 2024-04-26T12:29:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:29:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983465+0000", 2024-04-26T12:29:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064301233999999999 2024-04-26T12:29:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983515+0000", 2024-04-26T12:29:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9774000000000002e-05 2024-04-26T12:29:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986414+0000", 2024-04-26T12:29:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0028991770000000002 2024-04-26T12:29:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986455+0000", 2024-04-26T12:29:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1090000000000001e-05 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986520+0000", 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4778999999999998e-05 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1670 3.18 3:1e8917d7:::200.0000000e:head [write 3545973~1959 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.439909804999999, 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070481470000000004, 2024-04-26T12:29:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919166+0000", 2024-04-26T12:29:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967296 2024-04-26T12:29:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919172+0000", 2024-04-26T12:29:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5280000000000003e-06 2024-04-26T12:29:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919175+0000", 2024-04-26T12:29:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.942e-06 2024-04-26T12:29:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.919177+0000", 2024-04-26T12:29:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5790000000000002e-06 2024-04-26T12:29:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983883+0000", 2024-04-26T12:29:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064705768999999996 2024-04-26T12:29:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.983975+0000", 2024-04-26T12:29:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2219999999999995e-05 2024-04-26T12:29:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989262+0000", 2024-04-26T12:29:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052864940000000001 2024-04-26T12:29:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989361+0000", 2024-04-26T12:29:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9374000000000001e-05 2024-04-26T12:29:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989648+0000", 2024-04-26T12:29:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028677200000000003 2024-04-26T12:29:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1671 3.18 3:1e8917d7:::200.0000000e:head [write 3547932~12451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:29:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.438614688000001, 2024-04-26T12:29:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069443256999999994, 2024-04-26T12:29:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:29:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920461+0000", 2024-04-26T12:29:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920460+0000", 2024-04-26T12:29:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920542+0000", 2024-04-26T12:29:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1650999999999995e-05 2024-04-26T12:29:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920554+0000", 2024-04-26T12:29:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2228e-05 2024-04-26T12:29:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920560+0000", 2024-04-26T12:29:06.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8869999999999997e-06 2024-04-26T12:29:06.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984749+0000", 2024-04-26T12:29:06.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064188913 2024-04-26T12:29:06.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.984795+0000", 2024-04-26T12:29:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5893000000000003e-05 2024-04-26T12:29:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989659+0000", 2024-04-26T12:29:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048643669999999996 2024-04-26T12:29:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989836+0000", 2024-04-26T12:29:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017699799999999999 2024-04-26T12:29:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989905+0000", 2024-04-26T12:29:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8238000000000006e-05 2024-04-26T12:29:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1672 3.18 3:1e8917d7:::200.0000000e:head [write 3560383~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.438511045999999, 2024-04-26T12:29:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070651368000000006, 2024-04-26T12:29:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920565+0000", 2024-04-26T12:29:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920569+0000", 2024-04-26T12:29:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2610000000000004e-06 2024-04-26T12:29:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920572+0000", 2024-04-26T12:29:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6150000000000001e-06 2024-04-26T12:29:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.920578+0000", 2024-04-26T12:29:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5609999999999998e-06 2024-04-26T12:29:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985287+0000", 2024-04-26T12:29:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064708946000000003 2024-04-26T12:29:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.985343+0000", 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6109000000000001e-05 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991135+0000", 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057923430000000001 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991163+0000", 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7083000000000001e-05 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991216+0000", 2024-04-26T12:29:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3854999999999999e-05 2024-04-26T12:29:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1673 3.18 3:1e8917d7:::200.0000000e:head [write 3563148~4730 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:29:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.436756916, 2024-04-26T12:29:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068974127999999996, 2024-04-26T12:29:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.387 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.387 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.387 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:29:06.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922319+0000", 2024-04-26T12:29:06.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922318+0000", 2024-04-26T12:29:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922327+0000", 2024-04-26T12:29:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.02e-06 2024-04-26T12:29:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922336+0000", 2024-04-26T12:29:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:29:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.922344+0000", 2024-04-26T12:29:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5220000000000001e-06 2024-04-26T12:29:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986575+0000", 2024-04-26T12:29:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064231885000000002 2024-04-26T12:29:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986628+0000", 2024-04-26T12:29:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.219e-05 2024-04-26T12:29:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991222+0000", 2024-04-26T12:29:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045942500000000002 2024-04-26T12:29:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991245+0000", 2024-04-26T12:29:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2764000000000001e-05 2024-04-26T12:29:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991293+0000", 2024-04-26T12:29:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8628999999999998e-05 2024-04-26T12:29:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4519.0:13020 4.10 4:09df41af:::1000000333c.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53)", 2024-04-26T12:29:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:29:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.435754695, 2024-04-26T12:29:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066586204999999996, 2024-04-26T12:29:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T12:29:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T12:29:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4519", 2024-04-26T12:29:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "192.168.0.1:0/1390773553", 2024-04-26T12:29:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 13020 2024-04-26T12:29:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:29:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923321+0000", 2024-04-26T12:29:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923320+0000", 2024-04-26T12:29:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999986 2024-04-26T12:29:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923328+0000", 2024-04-26T12:29:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3289999999999994e-06 2024-04-26T12:29:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923340+0000", 2024-04-26T12:29:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1891e-05 2024-04-26T12:29:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.923353+0000", 2024-04-26T12:29:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3273e-05 2024-04-26T12:29:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986568+0000", 2024-04-26T12:29:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063214801000000001 2024-04-26T12:29:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.986686+0000", 2024-04-26T12:29:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118009 2024-04-26T12:29:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989908+0000", 2024-04-26T12:29:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032213039999999999 2024-04-26T12:29:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1674 3.18 3:1e8917d7:::200.0000000e:head [write 3567878~12568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:29:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.434821911, 2024-04-26T12:29:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067102822000000006, 2024-04-26T12:29:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:29:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924254+0000", 2024-04-26T12:29:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924253+0000", 2024-04-26T12:29:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924269+0000", 2024-04-26T12:29:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:29:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924279+0000", 2024-04-26T12:29:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0676000000000001e-05 2024-04-26T12:29:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.924288+0000", 2024-04-26T12:29:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4649999999999994e-06 2024-04-26T12:29:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987080+0000", 2024-04-26T12:29:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062792312000000003 2024-04-26T12:29:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987132+0000", 2024-04-26T12:29:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1712999999999998e-05 2024-04-26T12:29:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991298+0000", 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041660539999999998 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991321+0000", 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3575e-05 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991357+0000", 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5506000000000002e-05 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1675 3.18 3:1e8917d7:::200.0000000e:head [write 3580446~9112 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:29:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.433802367999998, 2024-04-26T12:29:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066218224000000006, 2024-04-26T12:29:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:29:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925274+0000", 2024-04-26T12:29:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925273+0000", 2024-04-26T12:29:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925282+0000", 2024-04-26T12:29:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2690000000000005e-06 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925291+0000", 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2800000000000003e-06 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925296+0000", 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6080000000000003e-06 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987663+0000", 2024-04-26T12:29:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062366705000000001 2024-04-26T12:29:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.987729+0000", 2024-04-26T12:29:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6330999999999999e-05 2024-04-26T12:29:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991362+0000", 2024-04-26T12:29:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036322820000000001 2024-04-26T12:29:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991431+0000", 2024-04-26T12:29:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9799e-05 2024-04-26T12:29:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991492+0000", 2024-04-26T12:29:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0587000000000001e-05 2024-04-26T12:29:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1676 3.18 3:1e8917d7:::200.0000000e:head [write 3589558~5068 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.433603132000002, 2024-04-26T12:29:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066120133999999997, 2024-04-26T12:29:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:06.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925473+0000", 2024-04-26T12:29:06.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925479+0000", 2024-04-26T12:29:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.054e-06 2024-04-26T12:29:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925489+0000", 2024-04-26T12:29:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0847e-05 2024-04-26T12:29:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925494+0000", 2024-04-26T12:29:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6569999999999996e-06 2024-04-26T12:29:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988275+0000", 2024-04-26T12:29:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062780582000000001 2024-04-26T12:29:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988319+0000", 2024-04-26T12:29:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3881999999999998e-05 2024-04-26T12:29:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991497+0000", 2024-04-26T12:29:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031781520000000001 2024-04-26T12:29:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991519+0000", 2024-04-26T12:29:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2382e-05 2024-04-26T12:29:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991593+0000", 2024-04-26T12:29:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3987999999999997e-05 2024-04-26T12:29:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1677 3.18 3:1e8917d7:::200.0000000e:head [write 3594626~2606 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.433201617999998, 2024-04-26T12:29:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065839106999999994, 2024-04-26T12:29:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925874+0000", 2024-04-26T12:29:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925880+0000", 2024-04-26T12:29:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4810000000000003e-06 2024-04-26T12:29:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925896+0000", 2024-04-26T12:29:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5696999999999999e-05 2024-04-26T12:29:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.925904+0000", 2024-04-26T12:29:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9619999999999993e-06 2024-04-26T12:29:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988800+0000", 2024-04-26T12:29:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062896142000000002 2024-04-26T12:29:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.988877+0000", 2024-04-26T12:29:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7175999999999994e-05 2024-04-26T12:29:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991598+0000", 2024-04-26T12:29:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027209399999999998 2024-04-26T12:29:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991620+0000", 2024-04-26T12:29:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2396e-05 2024-04-26T12:29:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991714+0000", 2024-04-26T12:29:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3213000000000004e-05 2024-04-26T12:29:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1678 3.18 3:1e8917d7:::200.0000000e:head [write 3597232~4822 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.432264596, 2024-04-26T12:29:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066189707, 2024-04-26T12:29:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926811+0000", 2024-04-26T12:29:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926819+0000", 2024-04-26T12:29:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5979999999999997e-06 2024-04-26T12:29:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926831+0000", 2024-04-26T12:29:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2300000000000001e-05 2024-04-26T12:29:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926839+0000", 2024-04-26T12:29:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9929999999999995e-06 2024-04-26T12:29:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989923+0000", 2024-04-26T12:29:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063083319999999998 2024-04-26T12:29:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.989970+0000", 2024-04-26T12:29:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7290000000000003e-05 2024-04-26T12:29:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992907+0000", 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029369740000000002 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992953+0000", 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6165000000000003e-05 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993001+0000", 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7984e-05 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1679 3.18 3:1e8917d7:::200.0000000e:head [write 3602054~5518 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.432223008000001, 2024-04-26T12:29:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068775656000000004, 2024-04-26T12:29:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926853+0000", 2024-04-26T12:29:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926858+0000", 2024-04-26T12:29:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7969999999999997e-06 2024-04-26T12:29:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926871+0000", 2024-04-26T12:29:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2965e-05 2024-04-26T12:29:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926878+0000", 2024-04-26T12:29:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9369999999999998e-06 2024-04-26T12:29:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990409+0000", 2024-04-26T12:29:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063531219999999999 2024-04-26T12:29:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.990537+0000", 2024-04-26T12:29:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000127074 2024-04-26T12:29:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995467+0000", 2024-04-26T12:29:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049307190000000001 2024-04-26T12:29:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995519+0000", 2024-04-26T12:29:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1638000000000003e-05 2024-04-26T12:29:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995629+0000", 2024-04-26T12:29:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000109852 2024-04-26T12:29:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1680 3.18 3:1e8917d7:::200.0000000e:head [write 3607572~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.427 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:29:06.427 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.432187488, 2024-04-26T12:29:06.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070113521999999998, 2024-04-26T12:29:06.427 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.427 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.427 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:29:06.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926889+0000", 2024-04-26T12:29:06.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926885+0000", 2024-04-26T12:29:06.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999962 2024-04-26T12:29:06.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926893+0000", 2024-04-26T12:29:06.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6299999999999998e-06 2024-04-26T12:29:06.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926899+0000", 2024-04-26T12:29:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5359999999999998e-06 2024-04-26T12:29:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926906+0000", 2024-04-26T12:29:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8349999999999998e-06 2024-04-26T12:29:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991747+0000", 2024-04-26T12:29:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064841012000000003 2024-04-26T12:29:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.991834+0000", 2024-04-26T12:29:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6602999999999997e-05 2024-04-26T12:29:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996894+0000", 2024-04-26T12:29:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050608850000000002 2024-04-26T12:29:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996954+0000", 2024-04-26T12:29:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9598000000000001e-05 2024-04-26T12:29:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997002+0000", 2024-04-26T12:29:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8050000000000002e-05 2024-04-26T12:29:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1681 3.18 3:1e8917d7:::200.0000000e:head [write 3609487~2938 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:29:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.432147493999999, 2024-04-26T12:29:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.070147752999999993, 2024-04-26T12:29:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926929+0000", 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926928+0000", 2024-04-26T12:29:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926932+0000", 2024-04-26T12:29:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5669999999999999e-06 2024-04-26T12:29:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926939+0000", 2024-04-26T12:29:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5989999999999996e-06 2024-04-26T12:29:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.926947+0000", 2024-04-26T12:29:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.238e-06 2024-04-26T12:29:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992399+0000", 2024-04-26T12:29:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.065452859000000002 2024-04-26T12:29:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.992484+0000", 2024-04-26T12:29:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4197999999999996e-05 2024-04-26T12:29:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997011+0000", 2024-04-26T12:29:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045271759999999999 2024-04-26T12:29:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997038+0000", 2024-04-26T12:29:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7684000000000001e-05 2024-04-26T12:29:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997076+0000", 2024-04-26T12:29:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7901000000000002e-05 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1682 3.18 3:1e8917d7:::200.0000000e:head [write 3612425~3220 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.429820662000001, 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067934001999999993, 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929255+0000", 2024-04-26T12:29:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929260+0000", 2024-04-26T12:29:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6699999999999999e-06 2024-04-26T12:29:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929268+0000", 2024-04-26T12:29:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6399999999999997e-06 2024-04-26T12:29:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929273+0000", 2024-04-26T12:29:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8790000000000002e-06 2024-04-26T12:29:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993049+0000", 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063775736999999999 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993159+0000", 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000110807 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997083+0000", 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039233769999999996 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997126+0000", 2024-04-26T12:29:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3544999999999997e-05 2024-04-26T12:29:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997189+0000", 2024-04-26T12:29:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3128999999999998e-05 2024-04-26T12:29:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1683 3.18 3:1e8917d7:::200.0000000e:head [write 3615645~5682 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:29:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.429573551000001, 2024-04-26T12:29:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.067807854000000001, 2024-04-26T12:29:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:29:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929503+0000", 2024-04-26T12:29:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929502+0000", 2024-04-26T12:29:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929510+0000", 2024-04-26T12:29:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1179999999999992e-06 2024-04-26T12:29:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929519+0000", 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2129999999999997e-06 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.929531+0000", 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1615e-05 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993765+0000", 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.064233810000000002 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.993842+0000", 2024-04-26T12:29:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7645999999999995e-05 2024-04-26T12:29:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997198+0000", 2024-04-26T12:29:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003355977 2024-04-26T12:29:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997249+0000", 2024-04-26T12:29:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0834000000000002e-05 2024-04-26T12:29:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.997310+0000", 2024-04-26T12:29:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1408999999999994e-05 2024-04-26T12:29:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1684 3.18 3:1e8917d7:::200.0000000e:head [write 3621327~8700 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:29:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.427276975000002, 2024-04-26T12:29:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066650928999999998, 2024-04-26T12:29:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:29:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931799+0000", 2024-04-26T12:29:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931798+0000", 2024-04-26T12:29:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.999999 2024-04-26T12:29:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931809+0000", 2024-04-26T12:29:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0662000000000001e-05 2024-04-26T12:29:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931816+0000", 2024-04-26T12:29:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1590000000000004e-06 2024-04-26T12:29:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931821+0000", 2024-04-26T12:29:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0710000000000002e-06 2024-04-26T12:29:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994486+0000", 2024-04-26T12:29:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.062664719999999993 2024-04-26T12:29:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.994567+0000", 2024-04-26T12:29:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1138999999999997e-05 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998343+0000", 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003775769 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998387+0000", 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4564999999999998e-05 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998450+0000", 2024-04-26T12:29:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2589999999999995e-05 2024-04-26T12:29:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1685 3.18 3:1e8917d7:::200.0000000e:head [write 3630027~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.427250104999999, 2024-04-26T12:29:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.066694793000000002, 2024-04-26T12:29:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931826+0000", 2024-04-26T12:29:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931828+0000", 2024-04-26T12:29:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:29:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931831+0000", 2024-04-26T12:29:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.45e-06 2024-04-26T12:29:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.931835+0000", 2024-04-26T12:29:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8689999999999997e-06 2024-04-26T12:29:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995016+0000", 2024-04-26T12:29:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063180397999999999 2024-04-26T12:29:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.995064+0000", 2024-04-26T12:29:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8538999999999997e-05 2024-04-26T12:29:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998455+0000", 2024-04-26T12:29:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033911000000000002 2024-04-26T12:29:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998478+0000", 2024-04-26T12:29:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2793999999999999e-05 2024-04-26T12:29:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.998521+0000", 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2608999999999998e-05 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(mds.0.3:1687 3.18 3:1e8917d7:::200.0000000e:head [write 3636544~1915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.426032900999999, 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.068592686, 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T12:29:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T12:29:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T12:29:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T12:29:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933043+0000", 2024-04-26T12:29:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933046+0000", 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0850000000000001e-06 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933050+0000", 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5549999999999996e-06 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.933054+0000", 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:29:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T12:29:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996223+0000", 2024-04-26T12:29:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.063169004000000001 2024-04-26T12:29:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T12:29:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:47.996307+0000", 2024-04-26T12:29:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3660999999999997e-05 2024-04-26T12:29:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T12:29:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001540+0000", 2024-04-26T12:29:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052334160000000003 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001573+0000", 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2981999999999997e-05 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T12:28:48.001636+0000", 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2601999999999995e-05 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T12:29:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T12:29:06.460 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:29:06.462 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-04-26T12:29:06.462 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:06.460+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:06.462 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T12:29:06.463 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:29:06.562 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:06.561+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:06.603 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:29:06.603 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:29:06.603 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-26T12:29:06.603 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:29:06.614 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:29:06.662 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:06.662+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:06.740 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:29:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-26T12:29:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-26T12:29:06.741 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-26T12:29:06.741 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:29:06.750 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:29:06.791 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:06.791+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:06.803 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-04-26T12:29:06.818 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T12:29:06.864 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:06.863+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:06.887 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2024-04-26T12:29:06.919 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-26T12:29:06.920 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-26T12:29:06.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-26T12:29:06.920 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-26T12:29:06.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.920 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:293 3.13 3:ceffbd45:::200.0000000a:head [write 594763~1409 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.920 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:29:06.920 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.993117422000001, 2024-04-26T12:29:06.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038803585000000002, 2024-04-26T12:29:06.920 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.920 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.920 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:29:06.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924875+0000", 2024-04-26T12:29:06.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924874+0000", 2024-04-26T12:29:06.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924877+0000", 2024-04-26T12:29:06.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7329999999999999e-06 2024-04-26T12:29:06.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924884+0000", 2024-04-26T12:29:06.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4509999999999997e-06 2024-04-26T12:29:06.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924890+0000", 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2369999999999997e-06 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958764+0000", 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.033873863999999997 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.958855+0000", 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1402000000000003e-05 2024-04-26T12:29:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963608+0000", 2024-04-26T12:29:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047529039999999996 2024-04-26T12:29:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963636+0000", 2024-04-26T12:29:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8194000000000001e-05 2024-04-26T12:29:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963678+0000", 2024-04-26T12:29:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2095999999999998e-05 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:294 3.13 3:ceffbd45:::200.0000000a:head [write 596172~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.993072678000001, 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041225228000000003, 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:29:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924920+0000", 2024-04-26T12:29:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924919+0000", 2024-04-26T12:29:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924922+0000", 2024-04-26T12:29:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9160000000000001e-06 2024-04-26T12:29:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924928+0000", 2024-04-26T12:29:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3929999999999996e-06 2024-04-26T12:29:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924933+0000", 2024-04-26T12:29:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7820000000000001e-06 2024-04-26T12:29:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959359+0000", 2024-04-26T12:29:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034425782000000002 2024-04-26T12:29:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959439+0000", 2024-04-26T12:29:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0275e-05 2024-04-26T12:29:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966079+0000", 2024-04-26T12:29:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0066397089999999997 2024-04-26T12:29:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966106+0000", 2024-04-26T12:29:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7178e-05 2024-04-26T12:29:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966145+0000", 2024-04-26T12:29:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8618999999999997e-05 2024-04-26T12:29:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:295 3.13 3:ceffbd45:::200.0000000a:head [write 597574~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:29:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.993046528000001, 2024-04-26T12:29:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041258571000000001, 2024-04-26T12:29:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:29:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924946+0000", 2024-04-26T12:29:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924945+0000", 2024-04-26T12:29:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924948+0000", 2024-04-26T12:29:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:29:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924955+0000", 2024-04-26T12:29:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4629999999999998e-06 2024-04-26T12:29:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924959+0000", 2024-04-26T12:29:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2719999999999999e-06 2024-04-26T12:29:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.959957+0000", 2024-04-26T12:29:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.034997588000000003 2024-04-26T12:29:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960042+0000", 2024-04-26T12:29:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5811999999999998e-05 2024-04-26T12:29:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966149+0000", 2024-04-26T12:29:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061071650000000003 2024-04-26T12:29:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966171+0000", 2024-04-26T12:29:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1905000000000001e-05 2024-04-26T12:29:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966204+0000", 2024-04-26T12:29:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2845999999999997e-05 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:296 3.13 3:ceffbd45:::200.0000000a:head [write 598977~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.993014897999998, 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041282538000000001, 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924977+0000", 2024-04-26T12:29:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:29:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924979+0000", 2024-04-26T12:29:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3609999999999999e-06 2024-04-26T12:29:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924984+0000", 2024-04-26T12:29:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3259999999999997e-06 2024-04-26T12:29:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.924987+0000", 2024-04-26T12:29:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7810000000000001e-06 2024-04-26T12:29:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960618+0000", 2024-04-26T12:29:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035631875 2024-04-26T12:29:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.960698+0000", 2024-04-26T12:29:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9373000000000001e-05 2024-04-26T12:29:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966208+0000", 2024-04-26T12:29:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055104359999999996 2024-04-26T12:29:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966228+0000", 2024-04-26T12:29:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0208e-05 2024-04-26T12:29:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966260+0000", 2024-04-26T12:29:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1404e-05 2024-04-26T12:29:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:297 3.13 3:ceffbd45:::200.0000000a:head [write 600380~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.992978063999999, 2024-04-26T12:29:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.041309850000000002, 2024-04-26T12:29:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925014+0000", 2024-04-26T12:29:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925017+0000", 2024-04-26T12:29:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.96e-06 2024-04-26T12:29:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925020+0000", 2024-04-26T12:29:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6629999999999999e-06 2024-04-26T12:29:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925023+0000", 2024-04-26T12:29:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0189999999999998e-06 2024-04-26T12:29:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961241+0000", 2024-04-26T12:29:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036217390000000002 2024-04-26T12:29:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961335+0000", 2024-04-26T12:29:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4537000000000006e-05 2024-04-26T12:29:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966264+0000", 2024-04-26T12:29:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004928516 2024-04-26T12:29:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966290+0000", 2024-04-26T12:29:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5658999999999999e-05 2024-04-26T12:29:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966324+0000", 2024-04-26T12:29:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4459000000000003e-05 2024-04-26T12:29:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:298 3.13 3:ceffbd45:::200.0000000a:head [write 602634~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:29:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.992945468999999, 2024-04-26T12:29:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046387536, 2024-04-26T12:29:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:29:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925047+0000", 2024-04-26T12:29:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925046+0000", 2024-04-26T12:29:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:29:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925049+0000", 2024-04-26T12:29:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.4770000000000002e-06 2024-04-26T12:29:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925057+0000", 2024-04-26T12:29:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9219999999999997e-06 2024-04-26T12:29:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925062+0000", 2024-04-26T12:29:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6319999999999999e-06 2024-04-26T12:29:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.961918+0000", 2024-04-26T12:29:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036856170000000001 2024-04-26T12:29:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962014+0000", 2024-04-26T12:29:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.6731999999999995e-05 2024-04-26T12:29:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971360+0000", 2024-04-26T12:29:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0093454569999999997 2024-04-26T12:29:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971393+0000", 2024-04-26T12:29:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3130999999999998e-05 2024-04-26T12:29:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971434+0000", 2024-04-26T12:29:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1244e-05 2024-04-26T12:29:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:299 3.13 3:ceffbd45:::200.0000000a:head [write 604033~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:29:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.992891638, 2024-04-26T12:29:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046395615000000001, 2024-04-26T12:29:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:29:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925101+0000", 2024-04-26T12:29:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925100+0000", 2024-04-26T12:29:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925103+0000", 2024-04-26T12:29:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3520000000000001e-06 2024-04-26T12:29:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925108+0000", 2024-04-26T12:29:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6489999999999996e-06 2024-04-26T12:29:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925111+0000", 2024-04-26T12:29:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.79e-06 2024-04-26T12:29:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962405+0000", 2024-04-26T12:29:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037293953999999997 2024-04-26T12:29:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962457+0000", 2024-04-26T12:29:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2003000000000003e-05 2024-04-26T12:29:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971440+0000", 2024-04-26T12:29:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0089831719999999993 2024-04-26T12:29:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971463+0000", 2024-04-26T12:29:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3201e-05 2024-04-26T12:29:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971496+0000", 2024-04-26T12:29:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2836000000000002e-05 2024-04-26T12:29:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:300 3.13 3:ceffbd45:::200.0000000a:head [write 605436~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.992827779999999, 2024-04-26T12:29:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046389606999999999, 2024-04-26T12:29:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925164+0000", 2024-04-26T12:29:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925167+0000", 2024-04-26T12:29:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8870000000000001e-06 2024-04-26T12:29:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925171+0000", 2024-04-26T12:29:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6049999999999998e-06 2024-04-26T12:29:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925173+0000", 2024-04-26T12:29:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8250000000000001e-06 2024-04-26T12:29:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962740+0000", 2024-04-26T12:29:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037566436000000002 2024-04-26T12:29:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.962818+0000", 2024-04-26T12:29:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8231000000000004e-05 2024-04-26T12:29:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971501+0000", 2024-04-26T12:29:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008682525 2024-04-26T12:29:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971522+0000", 2024-04-26T12:29:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1673999999999999e-05 2024-04-26T12:29:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971554+0000", 2024-04-26T12:29:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1786999999999999e-05 2024-04-26T12:29:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:301 3.13 3:ceffbd45:::200.0000000a:head [write 606838~1398 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.992811172, 2024-04-26T12:29:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046429455000000001, 2024-04-26T12:29:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925181+0000", 2024-04-26T12:29:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967296 2024-04-26T12:29:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925183+0000", 2024-04-26T12:29:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0150000000000002e-06 2024-04-26T12:29:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925186+0000", 2024-04-26T12:29:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2210000000000002e-06 2024-04-26T12:29:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925190+0000", 2024-04-26T12:29:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8489999999999999e-06 2024-04-26T12:29:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963304+0000", 2024-04-26T12:29:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038114207999999997 2024-04-26T12:29:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963356+0000", 2024-04-26T12:29:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1628000000000001e-05 2024-04-26T12:29:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971558+0000", 2024-04-26T12:29:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082025199999999996 2024-04-26T12:29:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971579+0000", 2024-04-26T12:29:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1019e-05 2024-04-26T12:29:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971610+0000", 2024-04-26T12:29:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1205999999999999e-05 2024-04-26T12:29:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:302 3.13 3:ceffbd45:::200.0000000a:head [write 608236~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.992789979000001, 2024-04-26T12:29:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046464057000000003, 2024-04-26T12:29:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925202+0000", 2024-04-26T12:29:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925204+0000", 2024-04-26T12:29:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1270000000000001e-06 2024-04-26T12:29:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925207+0000", 2024-04-26T12:29:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3720000000000001e-06 2024-04-26T12:29:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925210+0000", 2024-04-26T12:29:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7489999999999999e-06 2024-04-26T12:29:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963713+0000", 2024-04-26T12:29:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038502508999999997 2024-04-26T12:29:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.963792+0000", 2024-04-26T12:29:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.9087999999999999e-05 2024-04-26T12:29:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971615+0000", 2024-04-26T12:29:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0078230130000000002 2024-04-26T12:29:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971636+0000", 2024-04-26T12:29:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0996999999999999e-05 2024-04-26T12:29:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971666+0000", 2024-04-26T12:29:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0443999999999999e-05 2024-04-26T12:29:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:303 3.13 3:ceffbd45:::200.0000000a:head [write 609649~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.992746958000001, 2024-04-26T12:29:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.047363031, 2024-04-26T12:29:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925245+0000", 2024-04-26T12:29:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925253+0000", 2024-04-26T12:29:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0369999999999995e-06 2024-04-26T12:29:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925261+0000", 2024-04-26T12:29:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7420000000000003e-06 2024-04-26T12:29:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.925271+0000", 2024-04-26T12:29:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1589999999999999e-06 2024-04-26T12:29:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964198+0000", 2024-04-26T12:29:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038927182999999997 2024-04-26T12:29:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964281+0000", 2024-04-26T12:29:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3355000000000004e-05 2024-04-26T12:29:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972542+0000", 2024-04-26T12:29:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0082607930000000006 2024-04-26T12:29:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972570+0000", 2024-04-26T12:29:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7937999999999999e-05 2024-04-26T12:29:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972608+0000", 2024-04-26T12:29:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8384999999999999e-05 2024-04-26T12:29:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:304 3.13 3:ceffbd45:::200.0000000a:head [write 611057~2767 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:29:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.991581328999999, 2024-04-26T12:29:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046259867000000003, 2024-04-26T12:29:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:29:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926411+0000", 2024-04-26T12:29:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926410+0000", 2024-04-26T12:29:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926415+0000", 2024-04-26T12:29:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7999999999999998e-06 2024-04-26T12:29:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926423+0000", 2024-04-26T12:29:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8569999999999995e-06 2024-04-26T12:29:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926429+0000", 2024-04-26T12:29:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.421e-06 2024-04-26T12:29:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964778+0000", 2024-04-26T12:29:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038349045999999998 2024-04-26T12:29:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.964830+0000", 2024-04-26T12:29:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1309e-05 2024-04-26T12:29:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972614+0000", 2024-04-26T12:29:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0077847070000000001 2024-04-26T12:29:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972638+0000", 2024-04-26T12:29:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3388999999999999e-05 2024-04-26T12:29:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972671+0000", 2024-04-26T12:29:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2999e-05 2024-04-26T12:29:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:305 3.13 3:ceffbd45:::200.0000000a:head [write 613824~5020 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.991536289999999, 2024-04-26T12:29:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.046273460000000002, 2024-04-26T12:29:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926456+0000", 2024-04-26T12:29:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926463+0000", 2024-04-26T12:29:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0319999999999998e-06 2024-04-26T12:29:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926467+0000", 2024-04-26T12:29:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3000000000000003e-06 2024-04-26T12:29:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.926470+0000", 2024-04-26T12:29:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1930000000000002e-06 2024-04-26T12:29:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965122+0000", 2024-04-26T12:29:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038652207000000001 2024-04-26T12:29:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965210+0000", 2024-04-26T12:29:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7832999999999997e-05 2024-04-26T12:29:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972675+0000", 2024-04-26T12:29:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0074651450000000003 2024-04-26T12:29:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972696+0000", 2024-04-26T12:29:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0871999999999999e-05 2024-04-26T12:29:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972729+0000", 2024-04-26T12:29:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3259000000000001e-05 2024-04-26T12:29:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:306 3.13 3:ceffbd45:::200.0000000a:head [write 618844~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:29:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.990693544999999, 2024-04-26T12:29:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.04548866, 2024-04-26T12:29:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:29:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927299+0000", 2024-04-26T12:29:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927298+0000", 2024-04-26T12:29:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927303+0000", 2024-04-26T12:29:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6079999999999998e-06 2024-04-26T12:29:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927310+0000", 2024-04-26T12:29:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6240000000000002e-06 2024-04-26T12:29:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927319+0000", 2024-04-26T12:29:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:29:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965791+0000", 2024-04-26T12:29:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.038471350000000001 2024-04-26T12:29:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.965839+0000", 2024-04-26T12:29:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8647999999999999e-05 2024-04-26T12:29:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972735+0000", 2024-04-26T12:29:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068952429999999997 2024-04-26T12:29:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972755+0000", 2024-04-26T12:29:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0219000000000001e-05 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972787+0000", 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2450000000000003e-05 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:307 3.13 3:ceffbd45:::200.0000000a:head [write 621801~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.990643980000002, 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.045498166, 2024-04-26T12:29:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927348+0000", 2024-04-26T12:29:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927351+0000", 2024-04-26T12:29:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7130000000000001e-06 2024-04-26T12:29:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927355+0000", 2024-04-26T12:29:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1339999999999997e-06 2024-04-26T12:29:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.927358+0000", 2024-04-26T12:29:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0230000000000001e-06 2024-04-26T12:29:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966366+0000", 2024-04-26T12:29:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039008207000000003 2024-04-26T12:29:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.966457+0000", 2024-04-26T12:29:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.1144999999999996e-05 2024-04-26T12:29:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972792+0000", 2024-04-26T12:29:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0063344819999999998 2024-04-26T12:29:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972815+0000", 2024-04-26T12:29:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.3336000000000002e-05 2024-04-26T12:29:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972846+0000", 2024-04-26T12:29:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1504000000000002e-05 2024-04-26T12:29:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:308 3.13 3:ceffbd45:::200.0000000a:head [write 623718~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.988965935, 2024-04-26T12:29:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043878271000000003, 2024-04-26T12:29:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929026+0000", 2024-04-26T12:29:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929042+0000", 2024-04-26T12:29:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6039e-05 2024-04-26T12:29:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929054+0000", 2024-04-26T12:29:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2275e-05 2024-04-26T12:29:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929063+0000", 2024-04-26T12:29:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.7150000000000004e-06 2024-04-26T12:29:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967060+0000", 2024-04-26T12:29:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037996907000000003 2024-04-26T12:29:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967117+0000", 2024-04-26T12:29:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7701999999999997e-05 2024-04-26T12:29:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972850+0000", 2024-04-26T12:29:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0057332679999999997 2024-04-26T12:29:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972872+0000", 2024-04-26T12:29:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.1138999999999999e-05 2024-04-26T12:29:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972905+0000", 2024-04-26T12:29:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2904999999999998e-05 2024-04-26T12:29:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:309 3.13 3:ceffbd45:::200.0000000a:head [write 638707~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.988142824000001, 2024-04-26T12:29:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043114311000000002, 2024-04-26T12:29:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929849+0000", 2024-04-26T12:29:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929853+0000", 2024-04-26T12:29:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2690000000000001e-06 2024-04-26T12:29:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929861+0000", 2024-04-26T12:29:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.515e-06 2024-04-26T12:29:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929867+0000", 2024-04-26T12:29:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4640000000000003e-06 2024-04-26T12:29:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967590+0000", 2024-04-26T12:29:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.037722506000000003 2024-04-26T12:29:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.967672+0000", 2024-04-26T12:29:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2082000000000005e-05 2024-04-26T12:29:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972908+0000", 2024-04-26T12:29:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0052366289999999996 2024-04-26T12:29:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972929+0000", 2024-04-26T12:29:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0752999999999999e-05 2024-04-26T12:29:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972964+0000", 2024-04-26T12:29:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4666999999999999e-05 2024-04-26T12:29:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:310 3.13 3:ceffbd45:::200.0000000a:head [write 641140~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:29:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.988095551000001, 2024-04-26T12:29:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.043126171999999997, 2024-04-26T12:29:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:29:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929897+0000", 2024-04-26T12:29:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929896+0000", 2024-04-26T12:29:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929899+0000", 2024-04-26T12:29:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0929999999999999e-06 2024-04-26T12:29:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929903+0000", 2024-04-26T12:29:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.087e-06 2024-04-26T12:29:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.929907+0000", 2024-04-26T12:29:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1480000000000002e-06 2024-04-26T12:29:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.969962+0000", 2024-04-26T12:29:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040055457000000003 2024-04-26T12:29:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970018+0000", 2024-04-26T12:29:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6209999999999999e-05 2024-04-26T12:29:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972968+0000", 2024-04-26T12:29:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029501689999999999 2024-04-26T12:29:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.972989+0000", 2024-04-26T12:29:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0618000000000001e-05 2024-04-26T12:29:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.973023+0000", 2024-04-26T12:29:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-26T12:29:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:312 3.13 3:ceffbd45:::200.0000000a:head [write 648907~1910 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:29:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.982766296000001, 2024-04-26T12:29:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.039844011999999998, 2024-04-26T12:29:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:29:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935226+0000", 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935225+0000", 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.9999995 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935229+0000", 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1790000000000001e-06 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935235+0000", 2024-04-26T12:29:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.716e-06 2024-04-26T12:29:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935239+0000", 2024-04-26T12:29:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5379999999999998e-06 2024-04-26T12:29:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.970917+0000", 2024-04-26T12:29:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.035678223000000002 2024-04-26T12:29:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971006+0000", 2024-04-26T12:29:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.9248999999999999e-05 2024-04-26T12:29:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.974984+0000", 2024-04-26T12:29:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0039776769999999998 2024-04-26T12:29:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975031+0000", 2024-04-26T12:29:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7500000000000003e-05 2024-04-26T12:29:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975070+0000", 2024-04-26T12:29:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8509e-05 2024-04-26T12:29:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:313 3.13 3:ceffbd45:::200.0000000a:head [write 650817~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T12:29:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:29:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 23.982539968000001, 2024-04-26T12:29:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.040236782999999998, 2024-04-26T12:29:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-26T12:29:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:29:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-26T12:29:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-26T12:29:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:29:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-26T12:29:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935452+0000", 2024-04-26T12:29:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-26T12:29:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-26T12:29:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935451+0000", 2024-04-26T12:29:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4294967295.999999 2024-04-26T12:29:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-26T12:29:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935457+0000", 2024-04-26T12:29:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5079999999999996e-06 2024-04-26T12:29:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-26T12:29:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935467+0000", 2024-04-26T12:29:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0407e-05 2024-04-26T12:29:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-26T12:29:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.935477+0000", 2024-04-26T12:29:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.3989999999999993e-06 2024-04-26T12:29:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-26T12:29:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971691+0000", 2024-04-26T12:29:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.036214534 2024-04-26T12:29:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-26T12:29:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.971741+0000", 2024-04-26T12:29:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0294000000000003e-05 2024-04-26T12:29:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-26T12:29:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975619+0000", 2024-04-26T12:29:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038779259999999999 2024-04-26T12:29:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-26T12:29:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975647+0000", 2024-04-26T12:29:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:29:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-26T12:29:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-26T12:29:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-26T12:29:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-26T12:28:42.975689+0000", 2024-04-26T12:29:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2055999999999998e-05 2024-04-26T12:29:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-26T12:29:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-26T12:29:07.021 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-26T12:29:07.022 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:29:07.023 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:07.022+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:07.123 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:07.123+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:07.156 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:29:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:29:07.157 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T12:29:07.157 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:29:07.166 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:29:07.177 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-04-26T12:29:07.189 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2024-04-26T12:29:07.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:29:07.189 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T12:29:07.224 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:07.224+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:07.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:29:07.228 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[45185]: fuse finished with error 0 and tester_r 0 2024-04-26T12:29:07.229 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:29:07.307 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-04-26T12:29:07.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:29:07.308 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T12:29:07.325 INFO:tasks.ceph.osd.0.smithi115.stderr:2024-04-26T12:29:07.325+0000 7f769a2e8700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41429) UID: 0 2024-04-26T12:29:07.359 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T12:29:07.359 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T12:29:07.359 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T12:29:07.359 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T12:29:07.359 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T12:29:07.369 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:29:07.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:29:07.370 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-04-26T12:29:07.381 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0: {} 2024-04-26T12:29:07.399 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T12:29:07.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:29:07.399 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T12:29:07.402 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2: {} 2024-04-26T12:29:07.402 INFO:teuthology.orchestra.run.smithi046.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:29:07.402 INFO:teuthology.orchestra.run.smithi046.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T12:29:07.402 INFO:teuthology.orchestra.run.smithi046.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:29:07.405 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:29:07.405 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:29:07.427 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:07.426+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:07.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T12:29:07.435 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-04-26T12:29:07.498 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:07.498 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:07.509 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:29:07.537 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-26T12:29:07.551 INFO:tasks.thrashosds:joining thrashosds 2024-04-26T12:29:07.552 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T12:29:07.550+0000 7fd43098b700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41545) UID: 0 2024-04-26T12:29:07.650 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:07.650 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:07.660 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:29:07.788 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:07.788 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:07.798 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:29:07.925 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:07.926 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:07.935 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:29:08.076 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:08.076 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:08.086 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:29:08.212 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:08.213 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:08.223 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:29:08.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2024-04-26T12:29:08.351 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T12:29:08.351 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:29:08.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:29:09.900 INFO:teuthology.orchestra.run.smithi046.stderr:noscrub is unset 2024-04-26T12:29:09.914 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:29:10.905 INFO:teuthology.orchestra.run.smithi046.stderr:nodeep-scrub is unset 2024-04-26T12:29:14.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2024-04-26T12:29:19.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2024-04-26T12:29:25.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~94s 2024-04-26T12:29:31.543 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~100s 2024-04-26T12:29:37.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2024-04-26T12:29:43.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~111s 2024-04-26T12:29:48.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~117s 2024-04-26T12:29:54.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~123s 2024-04-26T12:30:00.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~129s 2024-04-26T12:30:06.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~134s 2024-04-26T12:30:12.192 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2024-04-26T12:30:17.996 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~146s 2024-04-26T12:30:23.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~152s 2024-04-26T12:30:29.613 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~158s 2024-04-26T12:30:30.998 DEBUG:teuthology.orchestra.console.smithi136:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 6E 43 GUID: 00000000 0000 0000 0000 0CC47AD93B1A DHCP.-                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.136 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.136 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:6e:43)... Configuring (net0 0c:c4:7a:88:6e:43).... Configuring (net0 0c:c4:7a:88:6e:43)..... Configuring (net0 0c:c4:7a:88:6e:43)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (4.18.0-552.el8.x86_64) 8  CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8              The selected entry will be started automatically in 5s.   CentOS Stream (4.18.0-552.el8.x86_64) 8   CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8            Use the * and * keys to change the selection.  The selected entry will be started automatically in 4s.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 4.18.0-552.el8.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-21) (GCC)) #1 SMP Sun Apr 7 19:39:51 UTC 2024 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eadfff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f60000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.022 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78eae max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34b91000-0x365c0fff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D49F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078eadfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29128 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78eae000-0x78f5ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f60000-0x798adfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228723 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1756664K/33437920K available (14339K kernel code, 5957K rwdata, 8568K rodata, 2820K init, 13792K bss, 935740K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 41053 entries in 161 pages [ 0.000000] ftrace: allocated 161 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001003] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003004] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013032] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014478] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327365fbbbe, max_idle_ns: 440795313827 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.04 BogoMIPS (lpj=3500022) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022022] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024004] SELinux: Initializing. [ 0.025021] LSM support for eBPF active [ 0.030569] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033947] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.034079] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.035078] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.037116] CPU0: Thermal monitoring enabled (TM1) [ 0.038056] process: using mwait in idle threads [ 0.039002] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.040000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.041003] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.042001] Spectre V2 : Mitigation: Retpolines [ 0.043000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.044000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.045000] Speculative Store Bypass: Vulnerable [ 0.046005] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.047000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.048000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.059185] Freeing SMP alternatives memory: 36K [ 0.060191] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.163941] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.165094] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.166001] ... version: 3 [ 0.167000] ... bit width: 48 [ 0.168000] ... generic registers: 4 [ 0.169000] ... value mask: 0000ffffffffffff [ 0.170000] ... max period: 00007fffffffffff [ 0.171000] ... fixed-purpose events: 3 [ 0.172000] ... event mask: 000000070000000f [ 0.173028] rcu: Hierarchical SRCU implementation. [ 0.175048] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.176014] smp: Bringing up secondary CPUs ... [ 0.177069] x86: Booting SMP configuration: [ 0.178001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.181183] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.183001] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.184001] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.185090] #5 #6 #7 [ 0.186636] smp: Brought up 1 node, 8 CPUs [ 0.188000] smpboot: Max logical packages: 1 [ 0.189001] smpboot: Total of 8 processors activated (56000.35 BogoMIPS) [ 0.232141] node 0 deferred pages initialised in 41ms [ 0.238253] devtmpfs: initialized [ 0.239041] x86/mm: Memory block size: 128MB [ 0.242644] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 0.251081] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.261005] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.268056] pinctrl core: initialized pinctrl subsystem [ 0.273119] NET: Registered protocol family 16 [ 0.278096] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.285010] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.293007] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.301015] audit: initializing netlink subsys (disabled) [ 0.306011] audit: type=2000 audit(1714134603.306:1): state=initialized audit_enabled=0 res=1 [ 0.315002] cpuidle: using governor menu [ 0.319030] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.326001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.333052] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.342001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.349013] PCI: Using configuration type 1 for base access [ 0.356029] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.357001] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.358023] cryptd: max_cpu_qlen set to 1000 [ 0.362050] ACPI: Added _OSI(Module Device) [ 0.367001] ACPI: Added _OSI(Processor Device) [ 0.371000] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.376000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.406226] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.415144] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.426086] ACPI: Dynamic OEM Table Load: [ 0.443594] ACPI: Interpreter enabled [ 0.447010] ACPI: PM: (supports S0 S4 S5) [ 0.451000] ACPI: Using IOAPIC for interrupt routing [ 0.458107] HEST: Enabling Firmware First mode for corrected errors. [ 0.465073] HEST: Table parsing has been initialized. [ 0.470122] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 0.477002] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.487511] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.515575] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.521003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.532274] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.540541] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.548001] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.557027] PCI host bridge to bus 0000:ff [ 0.561001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.566010] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.572042] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.578033] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.584035] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.590033] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.596031] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.602030] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.608030] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.614032] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.620031] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.626031] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.632030] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.638031] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.644029] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.650032] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.656031] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.662030] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.668031] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.674031] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.680022] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.686034] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.693059] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.699042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.705043] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.711042] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.717042] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.723041] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.729032] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.735035] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.741042] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.747042] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.753042] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.759034] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.765034] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.771032] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.777032] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.783033] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.789044] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.795043] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.801043] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.807049] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.813038] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.819033] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.825033] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.831036] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.837032] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.844032] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.850033] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.856035] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.862031] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.868032] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.874026] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.880024] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.886033] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.892031] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.899853] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.906002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.916141] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.924252] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.932000] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.940488] PCI host bridge to bus 0000:00 [ 0.945002] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.951001] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.958000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.966000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.973000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.980001] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.988000] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.993024] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 0.999095] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.006042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.012087] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.018041] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.024083] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.030036] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.036078] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.042007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.049066] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.055007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.062064] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.068007] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.075078] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.081007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.088077] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.094007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.100073] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.107008] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.113080] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.119007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.126078] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.132007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.139074] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.145063] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.151081] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.157060] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.163006] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.170062] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.176107] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.182011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.187006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.193006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.199007] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.204006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.210006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.216028] pci 0000:00:11.4: PME# supported from D3hot [ 1.221079] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.227014] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.234050] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.240089] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.246013] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.253038] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.259059] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.265013] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.272026] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.278071] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.284013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.290043] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.296082] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.303066] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.309076] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.315066] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.321077] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.327038] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.333089] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.339013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.346073] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.352076] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.358156] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.364009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.369005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.375005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.381005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.386005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.392006] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.398024] pci 0000:00:1f.2: PME# supported from D3hot [ 1.403059] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.409013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.416016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.422153] acpiphp: Slot [1] registered [ 1.426013] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.431111] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.437008] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.444015] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.450003] pci 0000:02:00.0: enabling Extended Tags [ 1.455072] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.460002] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.467124] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.473010] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.481004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.486009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.493004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.500037] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.506016] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.513000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.524008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.531001] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.541082] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.547010] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.555004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.560009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.567004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.574039] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.580013] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.588001] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.598008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.605000] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.615081] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.620001] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.627001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.633002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.641030] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.646060] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.652065] pci 0000:05:00.0: enabling Extended Tags [ 1.657069] pci 0000:05:00.0: supports D1 D2 [ 1.661000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.668086] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.673002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.679002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.686040] pci_bus 0000:06: extended config space not accessible [ 1.692029] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.698022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.705012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.711012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.716095] pci 0000:06:00.0: supports D1 D2 [ 1.721001] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.727104] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.733007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.739003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.745069] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.751017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.758018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.763009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.770076] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.776035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.783000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.793021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.801001] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.811092] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.817017] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.823018] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.829009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.835114] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.841034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.849000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.859021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.866000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.876072] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.881002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.887002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.894003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.901553] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.908033] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.914036] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.920031] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.926031] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.931000] ACPI: PCI: Interrupt link LNKE disabled [ 1.936032] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.942000] ACPI: PCI: Interrupt link LNKF disabled [ 1.947031] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.953000] ACPI: PCI: Interrupt link LNKG disabled [ 1.958033] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.964001] ACPI: PCI: Interrupt link LNKH disabled [ 1.969179] iommu: Default domain type: Passthrough [ 1.974066] SCSI subsystem initialized [ 1.978014] ACPI: bus type USB registered [ 1.982007] usbcore: registered new interface driver usbfs [ 1.987005] usbcore: registered new interface driver hub [ 1.993005] usbcore: registered new device driver usb [ 1.998019] pps_core: LinuxPPS API ver. 1 registered [ 2.003000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.012001] PTP clock support registered [ 2.016013] EDAC MC: Ver: 3.0.0 [ 2.019113] PCI: Using ACPI for IRQ routing [ 2.028708] NetLabel: Initializing [ 2.032000] NetLabel: domain hash size = 128 [ 2.036000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.042014] NetLabel: unlabeled traffic allowed by default [ 2.048020] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.049000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.062001] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.068000] vgaarb: loaded [ 2.071038] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.077001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.085020] clocksource: Switched to clocksource tsc-early [ 2.100685] VFS: Disk quotas dquot_6.6.0 [ 2.104613] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.111538] pnp: PnP ACPI init [ 2.114924] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.120839] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.126755] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.132666] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.138576] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.144488] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.150400] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.157003] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.163606] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.170210] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.176816] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.183420] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.190024] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.196787] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.202704] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.208614] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.214524] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.220437] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.227043] pnp: PnP ACPI: found 5 devices [ 2.236531] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.245429] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.256896] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.264715] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.269675] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.274637] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.281418] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.288981] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.296887] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.304530] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.312520] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.320077] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.327981] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.335626] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.343617] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.351175] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.359080] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.366721] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.374713] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.382271] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.390174] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.397817] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.405809] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.410768] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.416851] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.423629] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.431361] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.436322] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.441284] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.447372] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.454163] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.459381] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.465464] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.472245] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.479983] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.487811] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.495550] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.503375] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.508329] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.514416] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.521193] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.528924] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.537953] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.544124] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.550294] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.557158] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.564022] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.570885] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.577751] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.584008] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.589572] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.595829] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.603041] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.608605] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.614863] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.620425] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.626684] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.632247] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.638505] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.645814] NET: Registered protocol family 2 [ 2.650373] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.659642] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.668501] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.676909] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.684491] TCP: Hash tables configured (established 262144 bind 65536) [ 2.691202] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.698949] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.705968] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.713430] NET: Registered protocol family 1 [ 2.717784] NET: Registered protocol family 44 [ 2.722318] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.746127] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 16209 usecs [ 2.765124] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 11281 usecs [ 2.772540] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.778981] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.787360] Unpacking initramfs... [ 3.061177] Freeing initrd memory: 26816K [ 3.065260] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.071692] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.079611] ACPI: bus type thunderbolt registered [ 3.085906] Initialise system trusted keyrings [ 3.090364] Key type blacklist registered [ 3.094397] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.102399] zbud: loaded [ 3.105241] pstore: using deflate compression [ 3.109770] Platform Keyring initialized [ 3.151998] NET: Registered protocol family 38 [ 3.156510] Key type asymmetric registered [ 3.160612] Asymmetric key parser 'x509' registered [ 3.165485] Running certificate verification selftests [ 3.195851] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.206733] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.214155] io scheduler mq-deadline registered [ 3.218681] io scheduler kyber registered [ 3.222716] io scheduler bfq registered [ 3.226614] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.233830] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.239743] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.245641] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.251508] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.257379] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.263244] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.269121] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.276459] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.284819] ACPI: Power Button [PWRB] [ 3.288507] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.295913] ACPI: Power Button [PWRF] [ 3.300698] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.308208] pstore: Registered erst as persistent store backend [ 3.314218] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.341063] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.368985] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.376653] Non-volatile memory driver v1.3 [ 3.381229] rdac: device handler registered [ 3.385469] hp_sw: device handler registered [ 3.389738] emc: device handler registered [ 3.393924] alua: device handler registered [ 3.398168] libphy: Fixed MDIO Bus: probed [ 3.402420] usbcore: registered new interface driver usbserial_generic [ 3.402582] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.408949] usbserial: USB Serial support registered for generic [ 3.414200] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.420195] i8042: PNP: No PS/2 controller found. [ 3.427566] ehci-pci 0000:00:1d.0: debug port 2 [ 3.432295] mousedev: PS/2 mouse device common for all mice [ 3.440683] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.442422] rtc_cmos 00:00: RTC can wake from S4 [ 3.452801] rtc_cmos 00:00: registered as rtc0 [ 3.454039] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.457255] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.463009] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.478876] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.486086] usb usb1: Product: EHCI Host Controller [ 3.490957] usb usb1: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.497647] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.502330] intel_pstate: Intel P-state driver initializing [ 3.502427] hub 1-0:1.0: USB hub found [ 3.511691] hub 1-0:1.0: 2 ports detected [ 3.512119] hid: raw HID events driver (C) Jiri Kosina [ 3.515821] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.520885] usbcore: registered new interface driver usbhid [ 3.526128] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.531614] usbhid: USB HID core driver [ 3.531738] drop_monitor: Initializing network drop monitor service [ 3.540133] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.542922] Initializing XFRM netlink socket [ 3.549350] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.549353] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.549386] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 3.549398] ehci-pci 0000:00:1a.0: debug port 2 [ 3.553322] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.558361] NET: Registered protocol family 10 [ 3.560037] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.560092] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.560095] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.560096] usb usb3: Product: EHCI Host Controller [ 3.560097] usb usb3: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.560098] usb usb3: SerialNumber: 0000:00:1a.0 [ 3.560176] hub 3-0:1.0: USB hub found [ 3.560179] hub 3-0:1.0: 2 ports detected [ 3.562586] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 3.567975] Segment Routing with IPv6 [ 3.573000] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.580425] NET: Registered protocol family 17 [ 3.584974] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.590687] mpls_gso: MPLS GSO support [ 3.595046] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.595047] usb usb2: Product: xHCI Host Controller [ 3.595048] usb usb2: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.692739] usb usb2: SerialNumber: 0000:00:14.0 [ 3.697508] hub 2-0:1.0: USB hub found [ 3.701289] microcode: Microcode Update Driver: v2.2. [ 3.701311] hub 2-0:1.0: 15 ports detected [ 3.710551] resctrl: L3 allocation detected [ 3.712802] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.714737] resctrl: L3 monitoring detected [ 3.722985] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.727170] AVX2 version of gcm_enc/dec engaged. [ 3.734374] usb usb4: Product: xHCI Host Controller [ 3.738983] AES CTR mode by8 optimization enabled [ 3.748569] usb usb4: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.749019] sched_clock: Marking stable (3749016032, 0)->(5623178709, -1874162677) [ 3.755279] usb usb4: SerialNumber: 0000:00:14.0 [ 3.755469] hub 4-0:1.0: USB hub found [ 3.771237] hub 4-0:1.0: 6 ports detected [ 3.771273] registered taskstats version 1 [ 3.779514] Loading compiled-in X.509 certificates [ 3.784622] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: b8c8c7a1297a11ed2e36e7913cdfd6f59248d125' [ 3.795494] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.802005] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 3.807377] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.814035] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.824172] zswap: loaded using pool lzo/zbud [ 3.835085] page_owner is disabled [ 3.842025] Key type big_key registered [ 3.847674] Key type encrypted registered [ 3.851692] ima: No TPM chip found, activating TPM-bypass! [ 3.857178] ima: Allocated hash algorithm: sha256 [ 3.861886] ima: No architecture policies found [ 3.866419] evm: Initialising EVM extended attributes: [ 3.871552] evm: security.selinux [ 3.874863] evm: security.ima [ 3.877826] evm: security.capability [ 3.881396] evm: HMAC attrs: 0x1 [ 3.884873] rtc_cmos 00:00: setting system clock to 2024-04-26 12:30:08 UTC (1714134608) [ 3.894102] Freeing unused decrypted memory: 2028K [ 3.899246] Freeing unused kernel image (initmem) memory: 2820K [ 3.911040] Write protecting the kernel read-only data: 26624k [ 3.917257] Freeing unused kernel image (text/rodata gap) memory: 2016K [ 3.924123] Freeing unused kernel image (rodata/data gap) memory: 1672K [ 3.940203] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.943399] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 3.958397] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 3.958399] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.958676] hub 1-1:1.0: USB hub found [ 3.958776] hub 1-1:1.0: 8 ports detected [ 3.974034] systemd[1]: Detected architecture x86-64. [ 3.978910] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.979038] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.986033] systemd[1]: Running in initial RAM disk. [ 4.017674] hub 3-1:1.0: USB hub found [ 4.021522] hub 3-1:1.0: 6 ports detected Welcome to CentOS Stream 8 dracut-049-224.git20230330.el8 (Initramfs)! [ 4.047149] systemd[1]: Set hostname to . [ 4.083841] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 4.096244] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 4.106242] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 4.114519] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.114617] systemd[1]: Listening on Journal Socket (/dev/log). [ 4.122266] hub 2-12:1.0: USB hub found [ 4.127724] tsc: Refined TSC clocksource calibration: 3499.993 MHz [ 4.131619] hub 2-12:1.0: 4 ports detected [ 4.137739] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734a05315, max_idle_ns: 440795202126 ns [ 4.151902] clocksource: Switched to clocksource tsc [ OK ] Listening on Journal Socket (/dev/log). [ 4.164127] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.176936] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 4.187062] systemd[1]: Reached target Timers. [ OK [[ 4.191617] fuse: init (API version 7.34) 0m] Reached target Timers. Starting Create list of required st…ce nodes for the current kernel... Starting Create Volatile Files and Directories... [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Swap. [ OK ] Reached target Slices. Starting Setup Virtual Console... Starting Journal Service... [ OK ] Started Load Kernel Modules. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting Apply Kernel Variables... [ OK ] Started Journal Service. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Star Starting dracut cmdline hook... [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device M[ 4.436093] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd anager. Startins... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Startinqueue hook... [ 4.549349] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.558234] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Starting Show Plymouth Boot Screen... [ 4.568429] dca service started, version 1.12.1 [ 4.581706] nvme nvme0: pci function 0000:02:00.0 [ 4.589174] nvme nvme0: 8/0/0lt/read/poll queues [ 4.590603] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 4.595058] nvme0n1: detected capacity change from 0 to 2000398934016 [ OK ] Reached target System Initialization. [ OK ] Started Show Ply[ 4.619548] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver mouth Boot Scree[ 4.626821] ixgbe: Copyright (c) 1999-2016 Intel Corporation. n. [ OK ] Reached[ 4.636324] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode target Paths. [ 4.644788] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.650395] igb: Intel(R) Gigabit Ethernet Network Driver [ OK [ 4.659143] igb: Copyright (c) 2007-2014 Intel Corporation. [0m] Started For[66170] ACPI: bus type drm_connector registered ward Password Re[ 4.666314] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 quests to Plymou[ 4.671073] scsi host0: ahci [ 4.671347] scsi host1: ahci [ 4.671460] scsi host2: ahci [ 4.671578] scsi host3: ahci [ 4.671628] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 43 [ 4.671631] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 43 th Directory Wat[ 4.671633] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 43 ch. [ [ 4.671636] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 43 [ 4.671887] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.671890] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst OK ] Reache[ 4.686391] scsi host4: ahci [ 4.690599] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 d target Basic S[ 4.692741] scsi host5: ahci [ 4.695582] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 ystem. [ 4.698520] scsi host6: ahci [ 4.722188] igb 0000:07:00.0: added PHC on eth0 [ 4.730846] scsi host7: ahci [ 4.746545] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.751106] scsi host8: ahci [ 4.762395] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:3b:1a [ 4.766712] scsi host9: ahci [ 4.778188] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.781840] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 4.786282] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.789178] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 4.829207] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.836437] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 4.842955] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.849491] igb 0000:07:00.1: added PHC on eth1 [ 4.849517] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.849518] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:3b:1b [ 4.849595] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.849596] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.850358] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 4.851298] igb 0000:07:00.1 eno2: renamed from eth1 [ 4.855428] ast 0000:06:00.0: [drm] Using analog VGA [ 4.859950] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 4.866854] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.873972] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 4.879260] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.938759] fbcon: astdrmfb (fb0) is primary device [ 4.939359] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.980680] ata4: SATA link down (SStatus 0 SControl 300) [ 4.981526] ata1: SATA link down (SStatus 0 SControl 300) [ 4.981735] ata2: SATA link down (SStatus 0 SControl 300) [ 4.982039] ata3: SATA link down (SStatus 0 SControl 300) [ 4.988149] Console: switching to colour frame buffer device 128x48 [ 5.061984] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 5.196788] ata7: SATA link down (SStatus 0 SControl 300) [ 5.202203] ata8: SATA link down (SStatus 0 SControl 300) [ 5.207608] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.213796] ata9: SATA link down (SStatus 0 SControl 300) [ 5.219204] ata10: SATA link down (SStatus 0 SControl 300) [ 5.224698] ata6: SATA link down (SStatus 0 SControl 300) [ 5.230870] ata5.00: NCQ Send/Recv Log not supported [ 5.235843] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.242108] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.250604] ata5.00: NCQ Send/Recv Log not supported [ 5.255570] ata5.00: configured for UDMA/133 [ 5.260005] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.273660] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.282605] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.290262] sd 4:0:0:0: [sda] Write Protect is off [ 5.295078] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.317110] sda: sda1 [ 5.319716] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 5.796303] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.806574] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.815077] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.821245] ixgbe 0000:03:00.0: 0c:c4:7a:88:6e:42 [ 5.829014] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.835644] libphy: ixgbe-mdio: probed [ 5.996248] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.006518] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.015026] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.022066] ixgbe 0000:03:00.1: 0c:c4:7a:88:6e:43 [ 6.029802] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.036382] libphy: ixgbe-mdio: probed [ 6.041264] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.055191] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…ddf-553d-41ea-8bce-5708f99a0430... [ OK ] Started File System Check on /dev/d…36ddf-553d-41ea-8bce-5708f99a0430. Mounting /sysroot... [ 6.223029] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Starting Plymouth switch root service... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target System Initialization. [ OK ] Stopped Create Volatile Files and Directories. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped target Slices. [ OK ] Stopped udev Coldplug all Devices. Starting Setup Virtual Console... [ OK ] Stopped target Local File Systems. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 6.657389] printk: systemd: 16 output lines suppressed due to ratelimiting [ 7.259481] SELinux: policy capability network_peer_controls=1 [ 7.265405] SELinux: policy capability open_perms=1 [ 7.270368] SELinux: policy capability extended_socket_class=1 [ 7.276279] SELinux: policy capability always_check_network=0 [ 7.282101] SELinux: policy capability cgroup_seclabel=1 [ 7.287494] SELinux: policy capability nnp_nosuid_transition=1 [ 7.315087] audit: type=1403 audit(1714134611.930:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.316755] systemd[1]: Successfully loaded SELinux policy in 231.425ms. [ 7.383801] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.662ms. [ 7.402844] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.437133] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 8! [ 7.451244] systemd[1]: Set hostname to . [ 8.547797] systemd[1]: initrd-switch-root.service: Succeeded. [ 8.553845] systemd[1]: Stopped Switch Root. [ OK [[ 8.558638] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 8.570130] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 8.580394] systemd[1]: Stopped Journal Service. [ OK [[ 8.586482] systemd[1]: Starting Journal Service... 0m] Stopped Jour[ 8.593159] systemd[1]: Listening on udev Control Socket. nal Service. Starting Journal Service... [ OK ] Listening on udev Control Socket. Mounting Huge Pages File System... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Listening on initctl Compatibility Named Pipe. Mounting Kernel Debug File System... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Reached target ceph target allowing…mirror@.service instances at once. Mounting POSIX Message Queue File System... [ OK ] Created slice system-getty.slice. [ OK ] Reached target Swap. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Listening on LVM2 poll daemon socket. [ 8.705750] EXT4-fs (sda1): re-mounted. Opts: (null) [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Stopped target Switch Root. Starting Setup Virtual Console... [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. [ OK ] Reached target RPC Port Mapper. Starting Load Kernel Modules... [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Starting Remount Root and Kernel File Systems... [ OK ] Stopped Plymouth switch root service. [ OK ] Listening on Process Core Dump Socket. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Remount Root and Kernel File Systems. Starting Flush Journal to Persistent Storage... Starting Load/Save Random Seed... [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Load/Save Random Seed. [ OK ] Started Setup Virtual Console. [ OK ] Started Load Kernel Modules. Starting Apply Kernel Variables... Mounting FUSE Control File System... [ OK ] Mounted FUSE Control File System. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ 9.096830] device-mapper: uevent: version 1.0.3 [ 9.101539] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started udev Kernel Device Manager. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ 9.377874] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 9.392255] igb 0000:07:00.0: DCA enabled [ 9.396302] igb 0000:07:00.1: DCA enabled [ 9.428360] IPMI message handler: version 39.2 [ 9.436600] ipmi device interface [ 9.451813] ipmi_si: IPMI System Interface driver [ 9.456646] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 9.463010] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 9.470325] ipmi_si: Adding SMBIOS-specified kcs state machine [ 9.477219] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 9.483658] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 9.493458] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 9.502154] ipmi_si: Adding ACPI-specified kcs state machine [ 9.508084] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 9.511303] power_meter ACPI000D:00: Found ACPI power meter. [ 9.523639] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 9.541120] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 9.547882] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event act[ 9.560869] mei_me 0000:00:16.0: Device doesn't have valid ME Interface ivation on device 259:0... [ 9.603016] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 9.622989] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 9.644075] iTCO_vendor_support: vendor-support=0 [ 9.649339] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 9.649441] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 9.649996] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ 9.678165] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 9.678168] RAPL PMU: hw unit of domain package 2^-14 Joules [ 9.678169] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 9.685045] ipmi_si IPI0001:00: IPMI kcs interface initialized [ OK ] Started Create Volatile File[ 9.727568] ipmi_ssif: IPMI SSIF Interface driver s and Directories. [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... Starting RPC Bind... Mounting RPC Pipe File System... Starting Security Auditing Service... [ OK ] Started LVM event activation on device 259:0. [ 9.872282] RPC: Registered named UNIX socket transport module. [ 9.878234] RPC: Registered udp transport module. [ 9.882978] RPC: Registered tcp transport module. [ 9.887707] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ 9.947769] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 9.955947] XFS (dm-4): Mounting V4 Filesystem [ 9.965596] XFS (dm-4): Ending clean mount [ OK ] Started RPC Bind. [ OK ] Mounted /var/lib/ceph. [ 10.009403] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 10.020361] EDAC sbridge: Ver: 1.1.2 [ 10.078472] intel_rapl_common: Found RAPL domain package [ 10.083792] intel_rapl_common: Found RAPL domain dram [ 10.088846] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting VDO volume services... Starting Self Monitoring and Reporting Technology (SMART) Daemon... Starting Kernel Samepage Merging... [ OK ] Started Machine Check Exception Logging Daemon. [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ OK ] Reached target User and Group Name Lookups. [ OK ] Started Updates mlocate database every day. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Run system activity accounting tool every 10 minutes. Starting Restore /run/initramfs on shutdown... [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started irqbalance daemon. Starting Authorization Manager... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started Daily Cleanup of Temporary Directories. Starting Resets System Activity Logs... [ OK ] Reached target sshd-keygen.target. Starting Login Service... Starting NTP client/server... [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. [ OK ] Started Kernel Samepage Merging. [ OK ] Started Restore /run/initramfs on shutdown. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Login Service. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started NTP client/server. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting Network Manager Wait Online... Starting Hostname Service... [ OK ] Started Authorization Manager. [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Job spooling tools. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 12.445224] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.501771] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.509422] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.565754] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.573347] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.615808] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ OK ] Started VDO volume services. [ 12.727965] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.735805] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.778617] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 12.887902] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 13.003476] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 13.207110] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.214968] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started Dynamic System Tuning Daemon. [* ] A start job is running for Network …nager Wait Online (10s / no limit) [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting System Logging Service... Starting Notify NFS peers of a restart... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started System Logging Service. + myips=172.21.15.136 + attempts=1 + sleep 1 Starting SETroubleshoot daemon for …cessing new SELinux denial logs... + '[' 172.21.15.136 '!=' '' ']' + set -e + '[' -n 172.21.15.136 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.136 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.136 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi136.front.sepia.ceph.com + '[' -n smithi136.front.sepia.ceph.com ']' + hostname smithi136.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi136 + echo smithi136 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.136 smithi136.front.sepia.ceph.com smithi136/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T12:30:30.999 DEBUG:teuthology.orchestra.console.smithi136:expect after: smithi136 login: 2024-04-26T12:30:31.051 DEBUG:teuthology.orchestra.console.smithi136:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 6E 43 GUID: 00000000 0000 0000 0000 0CC47AD93B1A DHCP.-                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.136 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.136 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:6e:43)... Configuring (net0 0c:c4:7a:88:6e:43).... Configuring (net0 0c:c4:7a:88:6e:43)..... Configuring (net0 0c:c4:7a:88:6e:43)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (4.18.0-552.el8.x86_64) 8  CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8              The selected entry will be started automatically in 5s.   CentOS Stream (4.18.0-552.el8.x86_64) 8   CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8            Use the * and * keys to change the selection.  The selected entry will be started automatically in 4s.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 4.18.0-552.el8.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-21) (GCC)) #1 SMP Sun Apr 7 19:39:51 UTC 2024 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eadfff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f60000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.022 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78eae max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34b91000-0x365c0fff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D49F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078eadfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29128 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78eae000-0x78f5ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f60000-0x798adfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228723 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1756664K/33437920K available (14339K kernel code, 5957K rwdata, 8568K rodata, 2820K init, 13792K bss, 935740K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 41053 entries in 161 pages [ 0.000000] ftrace: allocated 161 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001003] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003004] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013032] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014478] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327365fbbbe, max_idle_ns: 440795313827 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.04 BogoMIPS (lpj=3500022) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022022] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024004] SELinux: Initializing. [ 0.025021] LSM support for eBPF active [ 0.030569] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033947] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.034079] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.035078] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.037116] CPU0: Thermal monitoring enabled (TM1) [ 0.038056] process: using mwait in idle threads [ 0.039002] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.040000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.041003] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.042001] Spectre V2 : Mitigation: Retpolines [ 0.043000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.044000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.045000] Speculative Store Bypass: Vulnerable [ 0.046005] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.047000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.048000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.059185] Freeing SMP alternatives memory: 36K [ 0.060191] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.163941] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.165094] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.166001] ... version: 3 [ 0.167000] ... bit width: 48 [ 0.168000] ... generic registers: 4 [ 0.169000] ... value mask: 0000ffffffffffff [ 0.170000] ... max period: 00007fffffffffff [ 0.171000] ... fixed-purpose events: 3 [ 0.172000] ... event mask: 000000070000000f [ 0.173028] rcu: Hierarchical SRCU implementation. [ 0.175048] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.176014] smp: Bringing up secondary CPUs ... [ 0.177069] x86: Booting SMP configuration: [ 0.178001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.181183] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.183001] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.184001] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.185090] #5 #6 #7 [ 0.186636] smp: Brought up 1 node, 8 CPUs [ 0.188000] smpboot: Max logical packages: 1 [ 0.189001] smpboot: Total of 8 processors activated (56000.35 BogoMIPS) [ 0.232141] node 0 deferred pages initialised in 41ms [ 0.238253] devtmpfs: initialized [ 0.239041] x86/mm: Memory block size: 128MB [ 0.242644] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 0.251081] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.261005] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.268056] pinctrl core: initialized pinctrl subsystem [ 0.273119] NET: Registered protocol family 16 [ 0.278096] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.285010] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.293007] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.301015] audit: initializing netlink subsys (disabled) [ 0.306011] audit: type=2000 audit(1714134603.306:1): state=initialized audit_enabled=0 res=1 [ 0.315002] cpuidle: using governor menu [ 0.319030] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.326001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.333052] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.342001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.349013] PCI: Using configuration type 1 for base access [ 0.356029] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.357001] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.358023] cryptd: max_cpu_qlen set to 1000 [ 0.362050] ACPI: Added _OSI(Module Device) [ 0.367001] ACPI: Added _OSI(Processor Device) [ 0.371000] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.376000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.406226] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.415144] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.426086] ACPI: Dynamic OEM Table Load: [ 0.443594] ACPI: Interpreter enabled [ 0.447010] ACPI: PM: (supports S0 S4 S5) [ 0.451000] ACPI: Using IOAPIC for interrupt routing [ 0.458107] HEST: Enabling Firmware First mode for corrected errors. [ 0.465073] HEST: Table parsing has been initialized. [ 0.470122] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 0.477002] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.487511] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.515575] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.521003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.532274] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.540541] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.548001] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.557027] PCI host bridge to bus 0000:ff [ 0.561001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.566010] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.572042] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.578033] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.584035] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.590033] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.596031] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.602030] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.608030] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.614032] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.620031] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.626031] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.632030] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.638031] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.644029] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.650032] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.656031] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.662030] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.668031] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.674031] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.680022] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.686034] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.693059] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.699042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.705043] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.711042] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.717042] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.723041] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.729032] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.735035] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.741042] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.747042] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.753042] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.759034] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.765034] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.771032] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.777032] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.783033] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.789044] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.795043] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.801043] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.807049] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.813038] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.819033] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.825033] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.831036] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.837032] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.844032] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.850033] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.856035] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.862031] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.868032] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.874026] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.880024] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.886033] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.892031] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.899853] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.906002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.916141] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.924252] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.932000] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.940488] PCI host bridge to bus 0000:00 [ 0.945002] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.951001] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.958000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.966000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.973000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.980001] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.988000] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.993024] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 0.999095] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.006042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.012087] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.018041] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.024083] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.030036] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.036078] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.042007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.049066] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.055007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.062064] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.068007] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.075078] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.081007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.088077] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.094007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.100073] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.107008] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.113080] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.119007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.126078] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.132007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.139074] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.145063] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.151081] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.157060] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.163006] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.170062] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.176107] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.182011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.187006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.193006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.199007] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.204006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.210006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.216028] pci 0000:00:11.4: PME# supported from D3hot [ 1.221079] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.227014] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.234050] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.240089] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.246013] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.253038] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.259059] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.265013] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.272026] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.278071] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.284013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.290043] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.296082] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.303066] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.309076] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.315066] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.321077] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.327038] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.333089] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.339013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.346073] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.352076] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.358156] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.364009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.369005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.375005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.381005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.386005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.392006] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.398024] pci 0000:00:1f.2: PME# supported from D3hot [ 1.403059] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.409013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.416016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.422153] acpiphp: Slot [1] registered [ 1.426013] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.431111] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.437008] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.444015] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.450003] pci 0000:02:00.0: enabling Extended Tags [ 1.455072] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.460002] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.467124] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.473010] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.481004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.486009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.493004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.500037] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.506016] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.513000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.524008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.531001] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.541082] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.547010] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.555004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.560009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.567004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.574039] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.580013] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.588001] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.598008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.605000] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.615081] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.620001] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.627001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.633002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.641030] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.646060] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.652065] pci 0000:05:00.0: enabling Extended Tags [ 1.657069] pci 0000:05:00.0: supports D1 D2 [ 1.661000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.668086] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.673002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.679002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.686040] pci_bus 0000:06: extended config space not accessible [ 1.692029] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.698022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.705012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.711012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.716095] pci 0000:06:00.0: supports D1 D2 [ 1.721001] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.727104] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.733007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.739003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.745069] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.751017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.758018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.763009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.770076] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.776035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.783000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.793021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.801001] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.811092] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.817017] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.823018] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.829009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.835114] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.841034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.849000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.859021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.866000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.876072] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.881002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.887002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.894003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.901553] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.908033] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.914036] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.920031] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.926031] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.931000] ACPI: PCI: Interrupt link LNKE disabled [ 1.936032] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.942000] ACPI: PCI: Interrupt link LNKF disabled [ 1.947031] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.953000] ACPI: PCI: Interrupt link LNKG disabled [ 1.958033] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.964001] ACPI: PCI: Interrupt link LNKH disabled [ 1.969179] iommu: Default domain type: Passthrough [ 1.974066] SCSI subsystem initialized [ 1.978014] ACPI: bus type USB registered [ 1.982007] usbcore: registered new interface driver usbfs [ 1.987005] usbcore: registered new interface driver hub [ 1.993005] usbcore: registered new device driver usb [ 1.998019] pps_core: LinuxPPS API ver. 1 registered [ 2.003000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.012001] PTP clock support registered [ 2.016013] EDAC MC: Ver: 3.0.0 [ 2.019113] PCI: Using ACPI for IRQ routing [ 2.028708] NetLabel: Initializing [ 2.032000] NetLabel: domain hash size = 128 [ 2.036000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.042014] NetLabel: unlabeled traffic allowed by default [ 2.048020] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.049000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.062001] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.068000] vgaarb: loaded [ 2.071038] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.077001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.085020] clocksource: Switched to clocksource tsc-early [ 2.100685] VFS: Disk quotas dquot_6.6.0 [ 2.104613] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.111538] pnp: PnP ACPI init [ 2.114924] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.120839] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.126755] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.132666] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.138576] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.144488] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.150400] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.157003] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.163606] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.170210] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.176816] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.183420] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.190024] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.196787] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.202704] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.208614] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.214524] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.220437] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.227043] pnp: PnP ACPI: found 5 devices [ 2.236531] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.245429] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.256896] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.264715] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.269675] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.274637] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.281418] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.288981] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.296887] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.304530] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.312520] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.320077] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.327981] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.335626] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.343617] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.351175] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.359080] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.366721] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.374713] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.382271] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.390174] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.397817] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.405809] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.410768] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.416851] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.423629] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.431361] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.436322] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.441284] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.447372] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.454163] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.459381] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.465464] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.472245] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.479983] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.487811] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.495550] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.503375] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.508329] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.514416] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.521193] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.528924] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.537953] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.544124] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.550294] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.557158] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.564022] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.570885] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.577751] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.584008] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.589572] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.595829] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.603041] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.608605] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.614863] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.620425] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.626684] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.632247] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.638505] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.645814] NET: Registered protocol family 2 [ 2.650373] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.659642] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.668501] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.676909] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.684491] TCP: Hash tables configured (established 262144 bind 65536) [ 2.691202] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.698949] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.705968] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.713430] NET: Registered protocol family 1 [ 2.717784] NET: Registered protocol family 44 [ 2.722318] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.746127] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 16209 usecs [ 2.765124] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 11281 usecs [ 2.772540] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.778981] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.787360] Unpacking initramfs... [ 3.061177] Freeing initrd memory: 26816K [ 3.065260] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.071692] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.079611] ACPI: bus type thunderbolt registered [ 3.085906] Initialise system trusted keyrings [ 3.090364] Key type blacklist registered [ 3.094397] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.102399] zbud: loaded [ 3.105241] pstore: using deflate compression [ 3.109770] Platform Keyring initialized [ 3.151998] NET: Registered protocol family 38 [ 3.156510] Key type asymmetric registered [ 3.160612] Asymmetric key parser 'x509' registered [ 3.165485] Running certificate verification selftests [ 3.195851] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.206733] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.214155] io scheduler mq-deadline registered [ 3.218681] io scheduler kyber registered [ 3.222716] io scheduler bfq registered [ 3.226614] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.233830] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.239743] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.245641] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.251508] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.257379] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.263244] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.269121] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.276459] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.284819] ACPI: Power Button [PWRB] [ 3.288507] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.295913] ACPI: Power Button [PWRF] [ 3.300698] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.308208] pstore: Registered erst as persistent store backend [ 3.314218] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.341063] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.368985] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.376653] Non-volatile memory driver v1.3 [ 3.381229] rdac: device handler registered [ 3.385469] hp_sw: device handler registered [ 3.389738] emc: device handler registered [ 3.393924] alua: device handler registered [ 3.398168] libphy: Fixed MDIO Bus: probed [ 3.402420] usbcore: registered new interface driver usbserial_generic [ 3.402582] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.408949] usbserial: USB Serial support registered for generic [ 3.414200] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.420195] i8042: PNP: No PS/2 controller found. [ 3.427566] ehci-pci 0000:00:1d.0: debug port 2 [ 3.432295] mousedev: PS/2 mouse device common for all mice [ 3.440683] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.442422] rtc_cmos 00:00: RTC can wake from S4 [ 3.452801] rtc_cmos 00:00: registered as rtc0 [ 3.454039] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.457255] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.463009] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.478876] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.486086] usb usb1: Product: EHCI Host Controller [ 3.490957] usb usb1: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.497647] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.502330] intel_pstate: Intel P-state driver initializing [ 3.502427] hub 1-0:1.0: USB hub found [ 3.511691] hub 1-0:1.0: 2 ports detected [ 3.512119] hid: raw HID events driver (C) Jiri Kosina [ 3.515821] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.520885] usbcore: registered new interface driver usbhid [ 3.526128] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.531614] usbhid: USB HID core driver [ 3.531738] drop_monitor: Initializing network drop monitor service [ 3.540133] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.542922] Initializing XFRM netlink socket [ 3.549350] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.549353] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.549386] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 3.549398] ehci-pci 0000:00:1a.0: debug port 2 [ 3.553322] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.558361] NET: Registered protocol family 10 [ 3.560037] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.560092] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.560095] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.560096] usb usb3: Product: EHCI Host Controller [ 3.560097] usb usb3: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.560098] usb usb3: SerialNumber: 0000:00:1a.0 [ 3.560176] hub 3-0:1.0: USB hub found [ 3.560179] hub 3-0:1.0: 2 ports detected [ 3.562586] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 3.567975] Segment Routing with IPv6 [ 3.573000] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.580425] NET: Registered protocol family 17 [ 3.584974] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.590687] mpls_gso: MPLS GSO support [ 3.595046] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.595047] usb usb2: Product: xHCI Host Controller [ 3.595048] usb usb2: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.692739] usb usb2: SerialNumber: 0000:00:14.0 [ 3.697508] hub 2-0:1.0: USB hub found [ 3.701289] microcode: Microcode Update Driver: v2.2. [ 3.701311] hub 2-0:1.0: 15 ports detected [ 3.710551] resctrl: L3 allocation detected [ 3.712802] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.714737] resctrl: L3 monitoring detected [ 3.722985] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.727170] AVX2 version of gcm_enc/dec engaged. [ 3.734374] usb usb4: Product: xHCI Host Controller [ 3.738983] AES CTR mode by8 optimization enabled [ 3.748569] usb usb4: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.749019] sched_clock: Marking stable (3749016032, 0)->(5623178709, -1874162677) [ 3.755279] usb usb4: SerialNumber: 0000:00:14.0 [ 3.755469] hub 4-0:1.0: USB hub found [ 3.771237] hub 4-0:1.0: 6 ports detected [ 3.771273] registered taskstats version 1 [ 3.779514] Loading compiled-in X.509 certificates [ 3.784622] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: b8c8c7a1297a11ed2e36e7913cdfd6f59248d125' [ 3.795494] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.802005] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 3.807377] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.814035] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.824172] zswap: loaded using pool lzo/zbud [ 3.835085] page_owner is disabled [ 3.842025] Key type big_key registered [ 3.847674] Key type encrypted registered [ 3.851692] ima: No TPM chip found, activating TPM-bypass! [ 3.857178] ima: Allocated hash algorithm: sha256 [ 3.861886] ima: No architecture policies found [ 3.866419] evm: Initialising EVM extended attributes: [ 3.871552] evm: security.selinux [ 3.874863] evm: security.ima [ 3.877826] evm: security.capability [ 3.881396] evm: HMAC attrs: 0x1 [ 3.884873] rtc_cmos 00:00: setting system clock to 2024-04-26 12:30:08 UTC (1714134608) [ 3.894102] Freeing unused decrypted memory: 2028K [ 3.899246] Freeing unused kernel image (initmem) memory: 2820K [ 3.911040] Write protecting the kernel read-only data: 26624k [ 3.917257] Freeing unused kernel image (text/rodata gap) memory: 2016K [ 3.924123] Freeing unused kernel image (rodata/data gap) memory: 1672K [ 3.940203] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.943399] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 3.958397] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 3.958399] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.958676] hub 1-1:1.0: USB hub found [ 3.958776] hub 1-1:1.0: 8 ports detected [ 3.974034] systemd[1]: Detected architecture x86-64. [ 3.978910] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.979038] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.986033] systemd[1]: Running in initial RAM disk. [ 4.017674] hub 3-1:1.0: USB hub found [ 4.021522] hub 3-1:1.0: 6 ports detected Welcome to CentOS Stream 8 dracut-049-224.git20230330.el8 (Initramfs)! [ 4.047149] systemd[1]: Set hostname to . [ 4.083841] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ 4.096244] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 4.106242] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 4.114519] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.114617] systemd[1]: Listening on Journal Socket (/dev/log). [ 4.122266] hub 2-12:1.0: USB hub found [ 4.127724] tsc: Refined TSC clocksource calibration: 3499.993 MHz [ 4.131619] hub 2-12:1.0: 4 ports detected [ 4.137739] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734a05315, max_idle_ns: 440795202126 ns [ 4.151902] clocksource: Switched to clocksource tsc [ OK ] Listening on Journal Socket (/dev/log). [ 4.164127] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.176936] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 4.187062] systemd[1]: Reached target Timers. [ OK [[ 4.191617] fuse: init (API version 7.34) 0m] Reached target Timers. Starting Create list of required st…ce nodes for the current kernel... Starting Create Volatile Files and Directories... [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. [ OK ] Started Memstrack Anylazing Service. [ OK ] Reached target Swap. [ OK ] Reached target Slices. Starting Setup Virtual Console... Starting Journal Service... [ OK ] Started Load Kernel Modules. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting Apply Kernel Variables... [ OK ] Started Journal Service. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Star Starting dracut cmdline hook... [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device M[ 4.436093] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd anager. Startins... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Startinqueue hook... [ 4.549349] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.558234] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Starting Show Plymouth Boot Screen... [ 4.568429] dca service started, version 1.12.1 [ 4.581706] nvme nvme0: pci function 0000:02:00.0 [ 4.589174] nvme nvme0: 8/0/0lt/read/poll queues [ 4.590603] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 4.595058] nvme0n1: detected capacity change from 0 to 2000398934016 [ OK ] Reached target System Initialization. [ OK ] Started Show Ply[ 4.619548] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver mouth Boot Scree[ 4.626821] ixgbe: Copyright (c) 1999-2016 Intel Corporation. n. [ OK ] Reached[ 4.636324] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode target Paths. [ 4.644788] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.650395] igb: Intel(R) Gigabit Ethernet Network Driver [ OK [ 4.659143] igb: Copyright (c) 2007-2014 Intel Corporation. [0m] Started For[66170] ACPI: bus type drm_connector registered ward Password Re[ 4.666314] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 quests to Plymou[ 4.671073] scsi host0: ahci [ 4.671347] scsi host1: ahci [ 4.671460] scsi host2: ahci [ 4.671578] scsi host3: ahci [ 4.671628] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 43 [ 4.671631] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 43 th Directory Wat[ 4.671633] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 43 ch. [ [ 4.671636] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 43 [ 4.671887] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.671890] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst OK ] Reache[ 4.686391] scsi host4: ahci [ 4.690599] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 d target Basic S[ 4.692741] scsi host5: ahci [ 4.695582] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 ystem. [ 4.698520] scsi host6: ahci [ 4.722188] igb 0000:07:00.0: added PHC on eth0 [ 4.730846] scsi host7: ahci [ 4.746545] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.751106] scsi host8: ahci [ 4.762395] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:3b:1a [ 4.766712] scsi host9: ahci [ 4.778188] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.781840] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 4.786282] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.789178] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 4.829207] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.836437] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 4.842955] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.849491] igb 0000:07:00.1: added PHC on eth1 [ 4.849517] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.849518] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:3b:1b [ 4.849595] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.849596] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.850358] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 4.851298] igb 0000:07:00.1 eno2: renamed from eth1 [ 4.855428] ast 0000:06:00.0: [drm] Using analog VGA [ 4.859950] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 4.866854] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.873972] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 4.879260] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.938759] fbcon: astdrmfb (fb0) is primary device [ 4.939359] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.980680] ata4: SATA link down (SStatus 0 SControl 300) [ 4.981526] ata1: SATA link down (SStatus 0 SControl 300) [ 4.981735] ata2: SATA link down (SStatus 0 SControl 300) [ 4.982039] ata3: SATA link down (SStatus 0 SControl 300) [ 4.988149] Console: switching to colour frame buffer device 128x48 [ 5.061984] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 5.196788] ata7: SATA link down (SStatus 0 SControl 300) [ 5.202203] ata8: SATA link down (SStatus 0 SControl 300) [ 5.207608] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.213796] ata9: SATA link down (SStatus 0 SControl 300) [ 5.219204] ata10: SATA link down (SStatus 0 SControl 300) [ 5.224698] ata6: SATA link down (SStatus 0 SControl 300) [ 5.230870] ata5.00: NCQ Send/Recv Log not supported [ 5.235843] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.242108] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.250604] ata5.00: NCQ Send/Recv Log not supported [ 5.255570] ata5.00: configured for UDMA/133 [ 5.260005] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.273660] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.282605] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.290262] sd 4:0:0:0: [sda] Write Protect is off [ 5.295078] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.317110] sda: sda1 [ 5.319716] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 5.796303] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.806574] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.815077] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.821245] ixgbe 0000:03:00.0: 0c:c4:7a:88:6e:42 [ 5.829014] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.835644] libphy: ixgbe-mdio: probed [ 5.996248] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.006518] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.015026] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.022066] ixgbe 0000:03:00.1: 0c:c4:7a:88:6e:43 [ 6.029802] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.036382] libphy: ixgbe-mdio: probed [ 6.041264] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.055191] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…ddf-553d-41ea-8bce-5708f99a0430... [ OK ] Started File System Check on /dev/d…36ddf-553d-41ea-8bce-5708f99a0430. Mounting /sysroot... [ 6.223029] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Starting Plymouth switch root service... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target System Initialization. [ OK ] Stopped Create Volatile Files and Directories. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped target Slices. [ OK ] Stopped udev Coldplug all Devices. Starting Setup Virtual Console... [ OK ] Stopped target Local File Systems. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 6.657389] printk: systemd: 16 output lines suppressed due to ratelimiting [ 7.259481] SELinux: policy capability network_peer_controls=1 [ 7.265405] SELinux: policy capability open_perms=1 [ 7.270368] SELinux: policy capability extended_socket_class=1 [ 7.276279] SELinux: policy capability always_check_network=0 [ 7.282101] SELinux: policy capability cgroup_seclabel=1 [ 7.287494] SELinux: policy capability nnp_nosuid_transition=1 [ 7.315087] audit: type=1403 audit(1714134611.930:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.316755] systemd[1]: Successfully loaded SELinux policy in 231.425ms. [ 7.383801] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.662ms. [ 7.402844] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.437133] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 8! [ 7.451244] systemd[1]: Set hostname to . [ 8.547797] systemd[1]: initrd-switch-root.service: Succeeded. [ 8.553845] systemd[1]: Stopped Switch Root. [ OK [[ 8.558638] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 8.570130] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 8.580394] systemd[1]: Stopped Journal Service. [ OK [[ 8.586482] systemd[1]: Starting Journal Service... 0m] Stopped Jour[ 8.593159] systemd[1]: Listening on udev Control Socket. nal Service. Starting Journal Service... [ OK ] Listening on udev Control Socket. Mounting Huge Pages File System... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Listening on initctl Compatibility Named Pipe. Mounting Kernel Debug File System... [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Reached target ceph target allowing…mirror@.service instances at once. Mounting POSIX Message Queue File System... [ OK ] Created slice system-getty.slice. [ OK ] Reached target Swap. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Listening on LVM2 poll daemon socket. [ 8.705750] EXT4-fs (sda1): re-mounted. Opts: (null) [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Stopped target Switch Root. Starting Setup Virtual Console... [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. [ OK ] Reached target RPC Port Mapper. Starting Load Kernel Modules... [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Starting Remount Root and Kernel File Systems... [ OK ] Stopped Plymouth switch root service. [ OK ] Listening on Process Core Dump Socket. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Remount Root and Kernel File Systems. Starting Flush Journal to Persistent Storage... Starting Load/Save Random Seed... [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Create Static Device Nodes in /dev... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Load/Save Random Seed. [ OK ] Started Setup Virtual Console. [ OK ] Started Load Kernel Modules. Starting Apply Kernel Variables... Mounting FUSE Control File System... [ OK ] Mounted FUSE Control File System. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ 9.096830] device-mapper: uevent: version 1.0.3 [ 9.101539] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started udev Kernel Device Manager. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ 9.377874] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 9.392255] igb 0000:07:00.0: DCA enabled [ 9.396302] igb 0000:07:00.1: DCA enabled [ 9.428360] IPMI message handler: version 39.2 [ 9.436600] ipmi device interface [ 9.451813] ipmi_si: IPMI System Interface driver [ 9.456646] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 9.463010] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 9.470325] ipmi_si: Adding SMBIOS-specified kcs state machine [ 9.477219] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 9.483658] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 9.493458] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 9.502154] ipmi_si: Adding ACPI-specified kcs state machine [ 9.508084] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 9.511303] power_meter ACPI000D:00: Found ACPI power meter. [ 9.523639] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 9.541120] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 9.547882] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event act[ 9.560869] mei_me 0000:00:16.0: Device doesn't have valid ME Interface ivation on device 259:0... [ 9.603016] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 9.622989] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 9.644075] iTCO_vendor_support: vendor-support=0 [ 9.649339] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 9.649441] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 9.649996] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ 9.678165] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 9.678168] RAPL PMU: hw unit of domain package 2^-14 Joules [ 9.678169] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 9.685045] ipmi_si IPI0001:00: IPMI kcs interface initialized [ OK ] Started Create Volatile File[ 9.727568] ipmi_ssif: IPMI SSIF Interface driver s and Directories. [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... Starting RPC Bind... Mounting RPC Pipe File System... Starting Security Auditing Service... [ OK ] Started LVM event activation on device 259:0. [ 9.872282] RPC: Registered named UNIX socket transport module. [ 9.878234] RPC: Registered udp transport module. [ 9.882978] RPC: Registered tcp transport module. [ 9.887707] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ 9.947769] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 9.955947] XFS (dm-4): Mounting V4 Filesystem [ 9.965596] XFS (dm-4): Ending clean mount [ OK ] Started RPC Bind. [ OK ] Mounted /var/lib/ceph. [ 10.009403] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 10.020361] EDAC sbridge: Ver: 1.1.2 [ 10.078472] intel_rapl_common: Found RAPL domain package [ 10.083792] intel_rapl_common: Found RAPL domain dram [ 10.088846] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting VDO volume services... Starting Self Monitoring and Reporting Technology (SMART) Daemon... Starting Kernel Samepage Merging... [ OK ] Started Machine Check Exception Logging Daemon. [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ OK ] Reached target User and Group Name Lookups. [ OK ] Started Updates mlocate database every day. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Run system activity accounting tool every 10 minutes. Starting Restore /run/initramfs on shutdown... [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started irqbalance daemon. Starting Authorization Manager... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started Daily Cleanup of Temporary Directories. Starting Resets System Activity Logs... [ OK ] Reached target sshd-keygen.target. Starting Login Service... Starting NTP client/server... [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Reached target Timers. [ OK ] Started Kernel Samepage Merging. [ OK ] Started Restore /run/initramfs on shutdown. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Login Service. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started NTP client/server. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting Network Manager Wait Online... Starting Hostname Service... [ OK ] Started Authorization Manager. [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Job spooling tools. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 12.445224] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.501771] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.509422] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.565754] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.573347] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.615808] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ OK ] Started VDO volume services. [ 12.727965] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.735805] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.778617] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 12.887902] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 13.003476] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 13.207110] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.214968] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started Dynamic System Tuning Daemon. [* ] A start job is running for Network …nager Wait Online (10s / no limit) [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting System Logging Service... Starting Notify NFS peers of a restart... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started System Logging Service. + myips=172.21.15.136 + attempts=1 + sleep 1 Starting SETroubleshoot daemon for …cessing new SELinux denial logs... + '[' 172.21.15.136 '!=' '' ']' + set -e + '[' -n 172.21.15.136 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.136 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.136 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi136.front.sepia.ceph.com + '[' -n smithi136.front.sepia.ceph.com ']' + hostname smithi136.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi136 + echo smithi136 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.136 smithi136.front.sepia.ceph.com smithi136/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi136 login: [disconnect] 2024-04-26T12:30:31.153 INFO:teuthology.misc:Re-opening connections... 2024-04-26T12:30:31.154 INFO:teuthology.misc:trying to connect to ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T12:30:31.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T12:30:31.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:30:32.448 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-04-26T12:30:33.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T12:30:33.250 DEBUG:teuthology.misc:waited 2.096750259399414 2024-04-26T12:30:34.252 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T12:30:34.252 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi136.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2024-04-26T12:30:34.252 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T12:30:34.349 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:30:34.385 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T12:30:34.385 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T12:30:34.427 INFO:tasks.ceph.osd.1:Started 2024-04-26T12:30:34.428 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:30:34.575 INFO:teuthology.orchestra.run.smithi136.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-26T12:30:34.577 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:30:34.577 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-26T12:30:35.316 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:30:35.315+0000 7f9b33561800 -1 Falling back to public interface 2024-04-26T12:30:35.523 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-26T12:30:38.933 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:30:38.932+0000 7f9b33561800 -1 osd.1 29 log_to_monitors true 2024-04-26T12:30:39.018 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T12:30:39.016+0000 7f9b1f4dc700 -1 osd.1 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:30:39.578 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:30:39.713 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T12:30:39.713 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T12:30:39.713 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T12:30:39.713 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T12:30:44.724 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-26T12:30:44.891 INFO:teuthology.orchestra.run.smithi046.stdout:mon.a: {} 2024-04-26T12:30:44.900 INFO:teuthology.orchestra.run.smithi046.stdout:mon.b: {} 2024-04-26T12:30:44.909 INFO:teuthology.orchestra.run.smithi046.stdout:mon.c: {} 2024-04-26T12:30:44.911 INFO:teuthology.orchestra.run.smithi046.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:30:44.911 INFO:teuthology.orchestra.run.smithi046.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:30:44.911 INFO:teuthology.orchestra.run.smithi046.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:30:44.922 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:30:46.024 INFO:teuthology.orchestra.run.smithi046.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:30:46.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T12:30:47.076 INFO:teuthology.orchestra.run.smithi046.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T12:30:47.091 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:30:48.082 INFO:teuthology.orchestra.run.smithi046.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:30:48.097 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T12:30:49.085 INFO:teuthology.orchestra.run.smithi046.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T12:30:49.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:30:50.086 INFO:teuthology.orchestra.run.smithi046.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:30:50.102 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T12:30:51.077 INFO:teuthology.orchestra.run.smithi046.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T12:30:51.091 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-26T12:30:51.091 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-26T12:30:51.091 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-26T12:30:51.091 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-26T12:30:51.092 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T12:30:51.092 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:51.437 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:30:51.437 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":76,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:30:51.068383+0000","last_up_change":"2024-04-26T12:30:39.998401+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:26:51.091400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:26:52.222159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5900000333786011,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.5900000333786011,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":29,"up_from":64,"up_thru":75,"down_at":30,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":6156},{"type":"v1","addr":"172.21.15.136:6801","nonce":6156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":6156},{"type":"v1","addr":"172.21.15.136:6803","nonce":6156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":6156},{"type":"v1","addr":"172.21.15.136:6807","nonce":6156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":6156},{"type":"v1","addr":"172.21.15.136:6805","nonce":6156}]},"public_addr":"172.21.15.136:6801/6156","cluster_addr":"172.21.15.136:6803/6156","heartbeat_back_addr":"172.21.15.136:6807/6156","heartbeat_front_addr":"172.21.15.136:6805/6156","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":29},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.19","osds":[0,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.0","osds":[2,0]},{"pgid":"4.6","osds":[2]},{"pgid":"4.7","osds":[2]},{"pgid":"4.f","osds":[2]},{"pgid":"4.10","osds":[2]},{"pgid":"4.16","osds":[2,0]},{"pgid":"4.17","osds":[2,0]},{"pgid":"4.1c","osds":[2]},{"pgid":"4.1e","osds":[2,0]},{"pgid":"4.20","osds":[0]},{"pgid":"4.21","osds":[2]},{"pgid":"4.28","osds":[2]},{"pgid":"4.29","osds":[2,0]},{"pgid":"4.2e","osds":[2]},{"pgid":"4.2f","osds":[2]},{"pgid":"4.36","osds":[2]},{"pgid":"4.37","osds":[2]},{"pgid":"4.3e","osds":[2]},{"pgid":"4.3f","osds":[2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:51.452 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T12:30:51.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:30:51.790 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:30:51.791 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":76,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:30:51.068383+0000","last_up_change":"2024-04-26T12:30:39.998401+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:26:51.091400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:26:52.222159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5900000333786011,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.5900000333786011,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":29,"up_from":64,"up_thru":75,"down_at":30,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":6156},{"type":"v1","addr":"172.21.15.136:6801","nonce":6156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":6156},{"type":"v1","addr":"172.21.15.136:6803","nonce":6156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":6156},{"type":"v1","addr":"172.21.15.136:6807","nonce":6156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":6156},{"type":"v1","addr":"172.21.15.136:6805","nonce":6156}]},"public_addr":"172.21.15.136:6801/6156","cluster_addr":"172.21.15.136:6803/6156","heartbeat_back_addr":"172.21.15.136:6807/6156","heartbeat_front_addr":"172.21.15.136:6805/6156","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":29},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.19","osds":[0,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.0","osds":[2,0]},{"pgid":"4.6","osds":[2]},{"pgid":"4.7","osds":[2]},{"pgid":"4.f","osds":[2]},{"pgid":"4.10","osds":[2]},{"pgid":"4.16","osds":[2,0]},{"pgid":"4.17","osds":[2,0]},{"pgid":"4.1c","osds":[2]},{"pgid":"4.1e","osds":[2,0]},{"pgid":"4.20","osds":[0]},{"pgid":"4.21","osds":[2]},{"pgid":"4.28","osds":[2]},{"pgid":"4.29","osds":[2,0]},{"pgid":"4.2e","osds":[2]},{"pgid":"4.2f","osds":[2]},{"pgid":"4.36","osds":[2]},{"pgid":"4.37","osds":[2]},{"pgid":"4.3e","osds":[2]},{"pgid":"4.3f","osds":[2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:30:51.805 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T12:30:51.805 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T12:30:51.806 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T12:30:51.978 INFO:teuthology.orchestra.run.smithi046.stdout:34359738421 2024-04-26T12:30:51.978 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:30:51.979 INFO:teuthology.orchestra.run.smithi046.stdout:274877906948 2024-04-26T12:30:51.980 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:30:51.981 INFO:teuthology.orchestra.run.smithi046.stdout:34359738421 2024-04-26T12:30:51.981 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:30:52.378 INFO:teuthology.orchestra.run.smithi046.stdout:34359738420 2024-04-26T12:30:52.379 INFO:teuthology.orchestra.run.smithi046.stdout:274877906947 2024-04-26T12:30:52.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738420 for osd.2 2024-04-26T12:30:52.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 274877906948 got 274877906947 for osd.1 2024-04-26T12:30:52.418 INFO:teuthology.orchestra.run.smithi046.stdout:34359738420 2024-04-26T12:30:52.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738420 for osd.0 2024-04-26T12:30:53.395 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:30:53.396 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:30:53.433 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:30:53.761 INFO:teuthology.orchestra.run.smithi046.stdout:274877906947 2024-04-26T12:30:53.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 274877906948 got 274877906947 for osd.1 2024-04-26T12:30:53.777 INFO:teuthology.orchestra.run.smithi046.stdout:34359738420 2024-04-26T12:30:53.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738420 for osd.2 2024-04-26T12:30:53.808 INFO:teuthology.orchestra.run.smithi046.stdout:34359738420 2024-04-26T12:30:53.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738420 for osd.0 2024-04-26T12:30:54.778 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:30:54.793 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:30:54.824 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:30:55.170 INFO:teuthology.orchestra.run.smithi046.stdout:274877906948 2024-04-26T12:30:55.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 274877906948 got 274877906948 for osd.1 2024-04-26T12:30:55.185 DEBUG:teuthology.parallel:result is None 2024-04-26T12:30:55.190 INFO:teuthology.orchestra.run.smithi046.stdout:34359738421 2024-04-26T12:30:55.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738421 for osd.2 2024-04-26T12:30:55.205 DEBUG:teuthology.parallel:result is None 2024-04-26T12:30:55.211 INFO:teuthology.orchestra.run.smithi046.stdout:34359738421 2024-04-26T12:30:55.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738421 got 34359738421 for osd.0 2024-04-26T12:30:55.226 DEBUG:teuthology.parallel:result is None 2024-04-26T12:30:55.226 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:30:55.226 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:30:55.614 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:30:55.616 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:30:55.625 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-04-26T12:30:55.357528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1828,"num_objects_misplaced":893,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4375,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34345,"ondisk_log_size":34345,"up":210,"acting":199,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":232,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":332792,"kb_used_data":90568,"kb_used_omap":9,"kb_used_meta":242166,"kb_avail":282782728,"statfs":{"total":289910292480,"available":289569513472,"internally_reserved":0,"allocated":92741632,"data_stored":288047442,"data_compressed":42932925,"data_compressed_allocated":54034432,"data_compressed_original":250695680,"omap_allocated":10125,"internal_metadata":247978099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":944,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000840"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":523,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.082633+0000","last_change":"2024-04-26T12:30:42.154734+0000","last_active":"2024-04-26T12:30:50.082633+0000","last_peered":"2024-04-26T12:30:50.082633+0000","last_clean":"2024-04-26T12:27:45.659014+0000","last_became_active":"2024-04-26T12:30:42.152053+0000","last_became_peered":"2024-04-26T12:30:42.152053+0000","last_unstale":"2024-04-26T12:30:50.082633+0000","last_undegraded":"2024-04-26T12:30:42.028217+0000","last_fullsized":"2024-04-26T12:30:42.007364+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:39.479842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":573,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081630+0000","last_change":"2024-04-26T12:30:42.158082+0000","last_active":"2024-04-26T12:30:50.081630+0000","last_peered":"2024-04-26T12:30:50.081630+0000","last_clean":"2024-04-26T12:27:45.658708+0000","last_became_active":"2024-04-26T12:30:42.155649+0000","last_became_peered":"2024-04-26T12:30:42.155649+0000","last_unstale":"2024-04-26T12:30:50.081630+0000","last_undegraded":"2024-04-26T12:30:42.040463+0000","last_fullsized":"2024-04-26T12:30:42.024179+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:34.362023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":490,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076853+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:30:54.076853+0000","last_peered":"2024-04-26T12:30:54.076853+0000","last_clean":"2024-04-26T12:30:54.076853+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:30:54.076853+0000","last_undegraded":"2024-04-26T12:30:54.076853+0000","last_fullsized":"2024-04-26T12:30:54.076853+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:55.616144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":862,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.078603+0000","last_change":"2024-04-26T12:30:48.089842+0000","last_active":"2024-04-26T12:30:55.078603+0000","last_peered":"2024-04-26T12:30:55.078603+0000","last_clean":"2024-04-26T12:30:55.078603+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:30:55.078603+0000","last_undegraded":"2024-04-26T12:30:55.078603+0000","last_fullsized":"2024-04-26T12:30:55.078603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:13.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":930,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080467+0000","last_change":"2024-04-26T12:30:48.089460+0000","last_active":"2024-04-26T12:30:50.080467+0000","last_peered":"2024-04-26T12:30:50.080467+0000","last_clean":"2024-04-26T12:30:50.080467+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:30:50.080467+0000","last_undegraded":"2024-04-26T12:30:50.080467+0000","last_fullsized":"2024-04-26T12:30:50.080467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":472,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075962+0000","last_change":"2024-04-26T12:30:48.090606+0000","last_active":"2024-04-26T12:30:54.075962+0000","last_peered":"2024-04-26T12:30:54.075962+0000","last_clean":"2024-04-26T12:30:54.075962+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:30:54.075962+0000","last_undegraded":"2024-04-26T12:30:54.075962+0000","last_fullsized":"2024-04-26T12:30:54.075962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:57.446858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1023,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076470+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:30:54.076470+0000","last_peered":"2024-04-26T12:30:54.076470+0000","last_clean":"2024-04-26T12:30:54.076470+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:30:54.076470+0000","last_undegraded":"2024-04-26T12:30:54.076470+0000","last_fullsized":"2024-04-26T12:30:54.076470+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:06.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":762,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075764+0000","last_change":"2024-04-26T12:30:49.082511+0000","last_active":"2024-04-26T12:30:54.075764+0000","last_peered":"2024-04-26T12:30:54.075764+0000","last_clean":"2024-04-26T12:30:54.075764+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:30:54.075764+0000","last_undegraded":"2024-04-26T12:30:54.075764+0000","last_fullsized":"2024-04-26T12:30:54.075764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:54.832086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":499,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081910+0000","last_change":"2024-04-26T12:30:42.158818+0000","last_active":"2024-04-26T12:30:50.081910+0000","last_peered":"2024-04-26T12:30:50.081910+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:30:42.157705+0000","last_became_peered":"2024-04-26T12:30:42.157705+0000","last_unstale":"2024-04-26T12:30:50.081910+0000","last_undegraded":"2024-04-26T12:30:42.043686+0000","last_fullsized":"2024-04-26T12:30:42.036742+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:54.251271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":552,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081921+0000","last_change":"2024-04-26T12:30:42.158203+0000","last_active":"2024-04-26T12:30:50.081921+0000","last_peered":"2024-04-26T12:30:50.081921+0000","last_clean":"2024-04-26T12:27:45.658876+0000","last_became_active":"2024-04-26T12:30:42.156989+0000","last_became_peered":"2024-04-26T12:30:42.156989+0000","last_unstale":"2024-04-26T12:30:50.081921+0000","last_undegraded":"2024-04-26T12:30:42.043424+0000","last_fullsized":"2024-04-26T12:30:42.037394+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:56.779235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":589,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076569+0000","last_change":"2024-04-26T12:30:50.085026+0000","last_active":"2024-04-26T12:30:54.076569+0000","last_peered":"2024-04-26T12:30:54.076569+0000","last_clean":"2024-04-26T12:30:54.076569+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:30:54.076569+0000","last_undegraded":"2024-04-26T12:30:54.076569+0000","last_fullsized":"2024-04-26T12:30:54.076569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:31.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":503,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081004+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:30:50.081004+0000","last_peered":"2024-04-26T12:30:50.081004+0000","last_clean":"2024-04-26T12:30:50.081004+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:30:50.081004+0000","last_undegraded":"2024-04-26T12:30:50.081004+0000","last_fullsized":"2024-04-26T12:30:50.081004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":874,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080831+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:30:50.080831+0000","last_peered":"2024-04-26T12:30:50.080831+0000","last_clean":"2024-04-26T12:30:50.080831+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:30:50.080831+0000","last_undegraded":"2024-04-26T12:30:50.080831+0000","last_fullsized":"2024-04-26T12:30:50.080831+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:00.467106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":515,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076440+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:30:54.076440+0000","last_peered":"2024-04-26T12:30:54.076440+0000","last_clean":"2024-04-26T12:30:54.076440+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:30:54.076440+0000","last_undegraded":"2024-04-26T12:30:54.076440+0000","last_fullsized":"2024-04-26T12:30:54.076440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":535,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075874+0000","last_change":"2024-04-26T12:30:47.080645+0000","last_active":"2024-04-26T12:30:54.075874+0000","last_peered":"2024-04-26T12:30:54.075874+0000","last_clean":"2024-04-26T12:30:54.075874+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:30:54.075874+0000","last_undegraded":"2024-04-26T12:30:54.075874+0000","last_fullsized":"2024-04-26T12:30:54.075874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:11.047331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":921,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075792+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:30:54.075792+0000","last_peered":"2024-04-26T12:30:54.075792+0000","last_clean":"2024-04-26T12:30:54.075792+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:30:54.075792+0000","last_undegraded":"2024-04-26T12:30:54.075792+0000","last_fullsized":"2024-04-26T12:30:54.075792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:18.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":493,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081779+0000","last_change":"2024-04-26T12:30:42.154835+0000","last_active":"2024-04-26T12:30:50.081779+0000","last_peered":"2024-04-26T12:30:50.081779+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:30:42.153333+0000","last_became_peered":"2024-04-26T12:30:42.153333+0000","last_unstale":"2024-04-26T12:30:50.081779+0000","last_undegraded":"2024-04-26T12:30:42.037452+0000","last_fullsized":"2024-04-26T12:30:42.029386+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:35.304869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":533,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.082579+0000","last_change":"2024-04-26T12:30:42.164164+0000","last_active":"2024-04-26T12:30:50.082579+0000","last_peered":"2024-04-26T12:30:50.082579+0000","last_clean":"2024-04-26T12:27:45.658959+0000","last_became_active":"2024-04-26T12:30:42.163023+0000","last_became_peered":"2024-04-26T12:30:42.163023+0000","last_unstale":"2024-04-26T12:30:50.082579+0000","last_undegraded":"2024-04-26T12:30:42.047375+0000","last_fullsized":"2024-04-26T12:30:42.044616+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:50.561555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":519,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075637+0000","last_change":"2024-04-26T12:30:51.076894+0000","last_active":"2024-04-26T12:30:52.075637+0000","last_peered":"2024-04-26T12:30:52.075637+0000","last_clean":"2024-04-26T12:30:52.075637+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:30:52.075637+0000","last_undegraded":"2024-04-26T12:30:52.075637+0000","last_fullsized":"2024-04-26T12:30:52.075637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:50.091007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1065,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076706+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:30:54.076706+0000","last_peered":"2024-04-26T12:30:54.076706+0000","last_clean":"2024-04-26T12:30:54.076706+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:30:54.076706+0000","last_undegraded":"2024-04-26T12:30:54.076706+0000","last_fullsized":"2024-04-26T12:30:54.076706+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:26.268194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":947,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076191+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:30:54.076191+0000","last_peered":"2024-04-26T12:30:54.076191+0000","last_clean":"2024-04-26T12:30:54.076191+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:30:54.076191+0000","last_undegraded":"2024-04-26T12:30:54.076191+0000","last_fullsized":"2024-04-26T12:30:54.076191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:12.535434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":571,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080614+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:30:50.080614+0000","last_peered":"2024-04-26T12:30:50.080614+0000","last_clean":"2024-04-26T12:30:50.080614+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:30:50.080614+0000","last_undegraded":"2024-04-26T12:30:50.080614+0000","last_fullsized":"2024-04-26T12:30:50.080614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":510,"reported_epoch":75,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:50.080259+0000","last_change":"2024-04-26T12:30:47.082934+0000","last_active":"2024-04-26T12:30:50.080259+0000","last_peered":"2024-04-26T12:30:50.080259+0000","last_clean":"2024-04-26T12:30:39.001294+0000","last_became_active":"2024-04-26T12:30:47.081126+0000","last_became_peered":"2024-04-26T12:30:47.081126+0000","last_unstale":"2024-04-26T12:30:50.080259+0000","last_undegraded":"2024-04-26T12:30:50.080259+0000","last_fullsized":"2024-04-26T12:30:50.080259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:47.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":179,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":606,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081617+0000","last_change":"2024-04-26T12:30:42.168459+0000","last_active":"2024-04-26T12:30:50.081617+0000","last_peered":"2024-04-26T12:30:50.081617+0000","last_clean":"2024-04-26T12:27:45.658199+0000","last_became_active":"2024-04-26T12:30:42.163138+0000","last_became_peered":"2024-04-26T12:30:42.163138+0000","last_unstale":"2024-04-26T12:30:50.081617+0000","last_undegraded":"2024-04-26T12:30:42.014270+0000","last_fullsized":"2024-04-26T12:30:42.005688+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:33.001689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":539,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.082560+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:30:50.082560+0000","last_peered":"2024-04-26T12:30:50.082560+0000","last_clean":"2024-04-26T12:30:50.082560+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:30:50.082560+0000","last_undegraded":"2024-04-26T12:30:50.082560+0000","last_fullsized":"2024-04-26T12:30:50.082560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":578,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075968+0000","last_change":"2024-04-26T12:30:46.089997+0000","last_active":"2024-04-26T12:30:52.075968+0000","last_peered":"2024-04-26T12:30:52.075968+0000","last_clean":"2024-04-26T12:30:52.075968+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:30:52.075968+0000","last_undegraded":"2024-04-26T12:30:52.075968+0000","last_fullsized":"2024-04-26T12:30:52.075968+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:08.843126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":508,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076720+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:30:54.076720+0000","last_peered":"2024-04-26T12:30:54.076720+0000","last_clean":"2024-04-26T12:30:54.076720+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:30:54.076720+0000","last_undegraded":"2024-04-26T12:30:54.076720+0000","last_fullsized":"2024-04-26T12:30:54.076720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":558,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080554+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:30:50.080554+0000","last_peered":"2024-04-26T12:30:50.080554+0000","last_clean":"2024-04-26T12:30:50.080554+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:30:50.080554+0000","last_undegraded":"2024-04-26T12:30:50.080554+0000","last_fullsized":"2024-04-26T12:30:50.080554+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:21.302173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":473,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081392+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:30:50.081392+0000","last_peered":"2024-04-26T12:30:50.081392+0000","last_clean":"2024-04-26T12:30:50.081392+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:30:50.081392+0000","last_undegraded":"2024-04-26T12:30:50.081392+0000","last_fullsized":"2024-04-26T12:30:50.081392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":403,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075077+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:30:52.075077+0000","last_peered":"2024-04-26T12:30:52.075077+0000","last_clean":"2024-04-26T12:30:52.075077+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:30:52.075077+0000","last_undegraded":"2024-04-26T12:30:52.075077+0000","last_fullsized":"2024-04-26T12:30:52.075077+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.762427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":489,"reported_epoch":75,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:50.080838+0000","last_change":"2024-04-26T12:30:47.080820+0000","last_active":"2024-04-26T12:30:50.080838+0000","last_peered":"2024-04-26T12:30:50.080838+0000","last_clean":"2024-04-26T12:30:39.002004+0000","last_became_active":"2024-04-26T12:30:47.079644+0000","last_became_peered":"2024-04-26T12:30:47.079644+0000","last_unstale":"2024-04-26T12:30:50.080838+0000","last_undegraded":"2024-04-26T12:30:50.080838+0000","last_fullsized":"2024-04-26T12:30:50.080838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:52.807804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":167,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"58'708","reported_seq":771,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.074970+0000","last_change":"2024-04-26T12:30:44.022038+0000","last_active":"2024-04-26T12:30:52.074970+0000","last_peered":"2024-04-26T12:30:52.074970+0000","last_clean":"2024-04-26T12:30:52.074970+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:30:52.074970+0000","last_undegraded":"2024-04-26T12:30:52.074970+0000","last_fullsized":"2024-04-26T12:30:52.074970+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:30.369118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":490,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081994+0000","last_change":"2024-04-26T12:30:47.081417+0000","last_active":"2024-04-26T12:30:50.081994+0000","last_peered":"2024-04-26T12:30:50.081994+0000","last_clean":"2024-04-26T12:30:50.081994+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:30:50.081994+0000","last_undegraded":"2024-04-26T12:30:50.081994+0000","last_fullsized":"2024-04-26T12:30:50.081994+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:17.628933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075927+0000","last_change":"2024-04-26T12:30:41.018067+0000","last_active":"2024-04-26T12:30:52.075927+0000","last_peered":"2024-04-26T12:30:52.075927+0000","last_clean":"2024-04-26T12:30:52.075927+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:30:52.075927+0000","last_undegraded":"2024-04-26T12:30:52.075927+0000","last_fullsized":"2024-04-26T12:30:52.075927+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:33.684743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":597,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.080363+0000","last_change":"2024-04-26T12:30:42.170928+0000","last_active":"2024-04-26T12:30:50.080363+0000","last_peered":"2024-04-26T12:30:50.080363+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:30:42.168445+0000","last_became_peered":"2024-04-26T12:30:42.168445+0000","last_unstale":"2024-04-26T12:30:50.080363+0000","last_undegraded":"2024-04-26T12:30:42.048666+0000","last_fullsized":"2024-04-26T12:30:42.040503+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:27.519673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"58'355","reported_seq":372,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076603+0000","last_change":"2024-04-26T12:30:48.086933+0000","last_active":"2024-04-26T12:30:54.076603+0000","last_peered":"2024-04-26T12:30:54.076603+0000","last_clean":"2024-04-26T12:30:54.076603+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:30:54.076603+0000","last_undegraded":"2024-04-26T12:30:54.076603+0000","last_fullsized":"2024-04-26T12:30:54.076603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:49.737283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":713,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075022+0000","last_change":"2024-04-26T12:30:46.034642+0000","last_active":"2024-04-26T12:30:52.075022+0000","last_peered":"2024-04-26T12:30:52.075022+0000","last_clean":"2024-04-26T12:30:52.075022+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:30:52.075022+0000","last_undegraded":"2024-04-26T12:30:52.075022+0000","last_fullsized":"2024-04-26T12:30:52.075022+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.961343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":158,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081051+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:30:50.081051+0000","last_peered":"2024-04-26T12:30:50.081051+0000","last_clean":"2024-04-26T12:30:50.081051+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:30:50.081051+0000","last_undegraded":"2024-04-26T12:30:50.081051+0000","last_fullsized":"2024-04-26T12:30:50.081051+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":504,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075279+0000","last_change":"2024-04-26T12:30:45.022716+0000","last_active":"2024-04-26T12:30:52.075279+0000","last_peered":"2024-04-26T12:30:52.075279+0000","last_clean":"2024-04-26T12:30:52.075279+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:30:52.075279+0000","last_undegraded":"2024-04-26T12:30:52.075279+0000","last_fullsized":"2024-04-26T12:30:52.075279+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:01.269901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'374","reported_seq":434,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076492+0000","last_change":"2024-04-26T12:30:46.079618+0000","last_active":"2024-04-26T12:30:54.076492+0000","last_peered":"2024-04-26T12:30:54.076492+0000","last_clean":"2024-04-26T12:30:54.076492+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:30:54.076492+0000","last_undegraded":"2024-04-26T12:30:54.076492+0000","last_fullsized":"2024-04-26T12:30:54.076492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:48.209628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":501,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076690+0000","last_change":"2024-04-26T12:30:47.082596+0000","last_active":"2024-04-26T12:30:54.076690+0000","last_peered":"2024-04-26T12:30:54.076690+0000","last_clean":"2024-04-26T12:30:54.076690+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:30:54.076690+0000","last_undegraded":"2024-04-26T12:30:54.076690+0000","last_fullsized":"2024-04-26T12:30:54.076690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:34.688913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":643,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076568+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:30:54.076568+0000","last_peered":"2024-04-26T12:30:54.076568+0000","last_clean":"2024-04-26T12:30:54.076568+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:30:54.076568+0000","last_undegraded":"2024-04-26T12:30:54.076568+0000","last_fullsized":"2024-04-26T12:30:54.076568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:50.674218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":785,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081095+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:30:50.081095+0000","last_peered":"2024-04-26T12:30:50.081095+0000","last_clean":"2024-04-26T12:30:50.081095+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:30:50.081095+0000","last_undegraded":"2024-04-26T12:30:50.081095+0000","last_fullsized":"2024-04-26T12:30:50.081095+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:11.548975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075120+0000","last_change":"2024-04-26T12:30:46.089052+0000","last_active":"2024-04-26T12:30:52.075120+0000","last_peered":"2024-04-26T12:30:52.075120+0000","last_clean":"2024-04-26T12:30:52.075120+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:30:52.075120+0000","last_undegraded":"2024-04-26T12:30:52.075120+0000","last_fullsized":"2024-04-26T12:30:52.075120+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:28.433853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":851,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.086989+0000","last_change":"2024-04-26T12:30:50.086492+0000","last_active":"2024-04-26T12:30:50.086989+0000","last_peered":"2024-04-26T12:30:50.086989+0000","last_clean":"2024-04-26T12:30:50.086989+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:30:50.086989+0000","last_undegraded":"2024-04-26T12:30:50.086989+0000","last_fullsized":"2024-04-26T12:30:50.086989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:18.705037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":129,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080805+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:30:50.080805+0000","last_peered":"2024-04-26T12:30:50.080805+0000","last_clean":"2024-04-26T12:30:50.080805+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:30:50.080805+0000","last_undegraded":"2024-04-26T12:30:50.080805+0000","last_fullsized":"2024-04-26T12:30:50.080805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":513,"reported_epoch":75,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:50.081543+0000","last_change":"2024-04-26T12:30:47.081736+0000","last_active":"2024-04-26T12:30:50.081543+0000","last_peered":"2024-04-26T12:30:50.081543+0000","last_clean":"2024-04-26T12:30:39.001966+0000","last_became_active":"2024-04-26T12:30:47.079760+0000","last_became_peered":"2024-04-26T12:30:47.079760+0000","last_unstale":"2024-04-26T12:30:50.081543+0000","last_undegraded":"2024-04-26T12:30:50.081543+0000","last_fullsized":"2024-04-26T12:30:50.081543+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:49.432476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":190,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"59'54","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076213+0000","last_change":"2024-04-26T12:30:46.082166+0000","last_active":"2024-04-26T12:30:54.076213+0000","last_peered":"2024-04-26T12:30:54.076213+0000","last_clean":"2024-04-26T12:30:54.076213+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:30:54.076213+0000","last_undegraded":"2024-04-26T12:30:54.076213+0000","last_fullsized":"2024-04-26T12:30:54.076213+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:28.037535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":551,"reported_epoch":75,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:50.080923+0000","last_change":"2024-04-26T12:30:47.081110+0000","last_active":"2024-04-26T12:30:50.080923+0000","last_peered":"2024-04-26T12:30:50.080923+0000","last_clean":"2024-04-26T12:30:39.002391+0000","last_became_active":"2024-04-26T12:30:47.079796+0000","last_became_peered":"2024-04-26T12:30:47.079796+0000","last_unstale":"2024-04-26T12:30:50.080923+0000","last_undegraded":"2024-04-26T12:30:50.080923+0000","last_fullsized":"2024-04-26T12:30:50.080923+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:20.060030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":173,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"58'186","reported_seq":204,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076622+0000","last_change":"2024-04-26T12:30:46.080074+0000","last_active":"2024-04-26T12:30:54.076622+0000","last_peered":"2024-04-26T12:30:54.076622+0000","last_clean":"2024-04-26T12:30:54.076622+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:30:54.076622+0000","last_undegraded":"2024-04-26T12:30:54.076622+0000","last_fullsized":"2024-04-26T12:30:54.076622+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:24.562647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":522,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080157+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:30:50.080157+0000","last_peered":"2024-04-26T12:30:50.080157+0000","last_clean":"2024-04-26T12:30:50.080157+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:30:50.080157+0000","last_undegraded":"2024-04-26T12:30:50.080157+0000","last_fullsized":"2024-04-26T12:30:50.080157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":431,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081749+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:30:50.081749+0000","last_peered":"2024-04-26T12:30:50.081749+0000","last_clean":"2024-04-26T12:30:50.081749+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:30:50.081749+0000","last_undegraded":"2024-04-26T12:30:50.081749+0000","last_fullsized":"2024-04-26T12:30:50.081749+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:40.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":960,"reported_epoch":76,"state":"peering","last_fresh":"2024-04-26T12:30:51.072934+0000","last_change":"2024-04-26T12:30:51.073102+0000","last_active":"2024-04-26T12:30:51.072934+0000","last_peered":"2024-04-26T12:30:50.532087+0000","last_clean":"2024-04-26T12:27:45.658276+0000","last_became_active":"2024-04-26T12:30:42.147813+0000","last_became_peered":"2024-04-26T12:30:42.147813+0000","last_unstale":"2024-04-26T12:30:51.072934+0000","last_undegraded":"2024-04-26T12:30:51.072934+0000","last_fullsized":"2024-04-26T12:30:51.072934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:20.494198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":509,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076714+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:30:54.076714+0000","last_peered":"2024-04-26T12:30:54.076714+0000","last_clean":"2024-04-26T12:30:54.076714+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:30:54.076714+0000","last_undegraded":"2024-04-26T12:30:54.076714+0000","last_fullsized":"2024-04-26T12:30:54.076714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:18.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":486,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076194+0000","last_change":"2024-04-26T12:30:48.089200+0000","last_active":"2024-04-26T12:30:54.076194+0000","last_peered":"2024-04-26T12:30:54.076194+0000","last_clean":"2024-04-26T12:30:54.076194+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:30:54.076194+0000","last_undegraded":"2024-04-26T12:30:54.076194+0000","last_fullsized":"2024-04-26T12:30:54.076194+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:04.588329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076209+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:54.076209+0000","last_peered":"2024-04-26T12:30:54.076209+0000","last_clean":"2024-04-26T12:30:54.076209+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:30:54.076209+0000","last_undegraded":"2024-04-26T12:30:54.076209+0000","last_fullsized":"2024-04-26T12:30:54.076209+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:40.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":552,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075256+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:30:52.075256+0000","last_peered":"2024-04-26T12:30:52.075256+0000","last_clean":"2024-04-26T12:30:52.075256+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:30:52.075256+0000","last_undegraded":"2024-04-26T12:30:52.075256+0000","last_fullsized":"2024-04-26T12:30:52.075256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.230823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":245,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075103+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:30:52.075103+0000","last_peered":"2024-04-26T12:30:52.075103+0000","last_clean":"2024-04-26T12:30:52.075103+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:30:52.075103+0000","last_undegraded":"2024-04-26T12:30:52.075103+0000","last_fullsized":"2024-04-26T12:30:52.075103+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:30.864621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":532,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076248+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:30:54.076248+0000","last_peered":"2024-04-26T12:30:54.076248+0000","last_clean":"2024-04-26T12:30:54.076248+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:30:54.076248+0000","last_undegraded":"2024-04-26T12:30:54.076248+0000","last_fullsized":"2024-04-26T12:30:54.076248+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:13.427584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076054+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:30:54.076054+0000","last_peered":"2024-04-26T12:30:54.076054+0000","last_clean":"2024-04-26T12:30:54.076054+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:30:54.076054+0000","last_undegraded":"2024-04-26T12:30:54.076054+0000","last_fullsized":"2024-04-26T12:30:54.076054+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:16.260550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":478,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076963+0000","last_change":"2024-04-26T12:30:47.083054+0000","last_active":"2024-04-26T12:30:54.076963+0000","last_peered":"2024-04-26T12:30:54.076963+0000","last_clean":"2024-04-26T12:30:54.076963+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:30:54.076963+0000","last_undegraded":"2024-04-26T12:30:54.076963+0000","last_fullsized":"2024-04-26T12:30:54.076963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.645638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":153,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080401+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:30:50.080401+0000","last_peered":"2024-04-26T12:30:50.080401+0000","last_clean":"2024-04-26T12:30:50.080401+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:30:50.080401+0000","last_undegraded":"2024-04-26T12:30:50.080401+0000","last_fullsized":"2024-04-26T12:30:50.080401+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:20.988072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":487,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076864+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:30:54.076864+0000","last_peered":"2024-04-26T12:30:54.076864+0000","last_clean":"2024-04-26T12:30:54.076864+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:30:54.076864+0000","last_undegraded":"2024-04-26T12:30:54.076864+0000","last_fullsized":"2024-04-26T12:30:54.076864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":579,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080923+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:30:50.080923+0000","last_peered":"2024-04-26T12:30:50.080923+0000","last_clean":"2024-04-26T12:30:50.080923+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:30:50.080923+0000","last_undegraded":"2024-04-26T12:30:50.080923+0000","last_fullsized":"2024-04-26T12:30:50.080923+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:25.266771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":498,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081587+0000","last_change":"2024-04-26T12:30:42.154775+0000","last_active":"2024-04-26T12:30:50.081587+0000","last_peered":"2024-04-26T12:30:50.081587+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:30:42.152745+0000","last_became_peered":"2024-04-26T12:30:42.152745+0000","last_unstale":"2024-04-26T12:30:50.081587+0000","last_undegraded":"2024-04-26T12:30:42.035068+0000","last_fullsized":"2024-04-26T12:30:42.028082+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:45.201289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075773+0000","last_change":"2024-04-26T12:30:41.026049+0000","last_active":"2024-04-26T12:30:52.075773+0000","last_peered":"2024-04-26T12:30:52.075773+0000","last_clean":"2024-04-26T12:30:52.075773+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:30:52.075773+0000","last_undegraded":"2024-04-26T12:30:52.075773+0000","last_fullsized":"2024-04-26T12:30:52.075773+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.409817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"58'454","reported_seq":475,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076846+0000","last_change":"2024-04-26T12:30:46.079367+0000","last_active":"2024-04-26T12:30:54.076846+0000","last_peered":"2024-04-26T12:30:54.076846+0000","last_clean":"2024-04-26T12:30:54.076846+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:30:54.076846+0000","last_undegraded":"2024-04-26T12:30:54.076846+0000","last_fullsized":"2024-04-26T12:30:54.076846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:00.950370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":463,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080714+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:30:50.080714+0000","last_peered":"2024-04-26T12:30:50.080714+0000","last_clean":"2024-04-26T12:30:50.080714+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:30:50.080714+0000","last_undegraded":"2024-04-26T12:30:50.080714+0000","last_fullsized":"2024-04-26T12:30:50.080714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076309+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:30:54.076309+0000","last_peered":"2024-04-26T12:30:54.076309+0000","last_clean":"2024-04-26T12:30:54.076309+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:30:54.076309+0000","last_undegraded":"2024-04-26T12:30:54.076309+0000","last_fullsized":"2024-04-26T12:30:54.076309+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:16.686041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076322+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:54.076322+0000","last_peered":"2024-04-26T12:30:54.076322+0000","last_clean":"2024-04-26T12:30:54.076322+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:30:54.076322+0000","last_undegraded":"2024-04-26T12:30:54.076322+0000","last_fullsized":"2024-04-26T12:30:54.076322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:18.069937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":492,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075604+0000","last_change":"2024-04-26T12:30:46.033999+0000","last_active":"2024-04-26T12:30:52.075604+0000","last_peered":"2024-04-26T12:30:52.075604+0000","last_clean":"2024-04-26T12:30:52.075604+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:30:52.075604+0000","last_undegraded":"2024-04-26T12:30:52.075604+0000","last_fullsized":"2024-04-26T12:30:52.075604+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:33.235467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075182+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:30:52.075182+0000","last_peered":"2024-04-26T12:30:52.075182+0000","last_clean":"2024-04-26T12:30:52.075182+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:30:52.075182+0000","last_undegraded":"2024-04-26T12:30:52.075182+0000","last_fullsized":"2024-04-26T12:30:52.075182+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:20.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":388,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080466+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:30:50.080466+0000","last_peered":"2024-04-26T12:30:50.080466+0000","last_clean":"2024-04-26T12:30:50.080466+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:30:50.080466+0000","last_undegraded":"2024-04-26T12:30:50.080466+0000","last_fullsized":"2024-04-26T12:30:50.080466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":418,"reported_epoch":78,"state":"peering","last_fresh":"2024-04-26T12:30:53.076814+0000","last_change":"2024-04-26T12:30:53.076814+0000","last_active":"2024-04-26T12:30:41.011738+0000","last_peered":"2024-04-26T12:30:39.002765+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.669503+0000","last_became_peered":"2024-04-26T12:27:48.669503+0000","last_unstale":"2024-04-26T12:30:53.076814+0000","last_undegraded":"2024-04-26T12:30:53.076814+0000","last_fullsized":"2024-04-26T12:30:53.076814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:59.008757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076582+0000","last_change":"2024-04-26T12:30:46.082961+0000","last_active":"2024-04-26T12:30:54.076582+0000","last_peered":"2024-04-26T12:30:54.076582+0000","last_clean":"2024-04-26T12:30:54.076582+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:30:54.076582+0000","last_undegraded":"2024-04-26T12:30:54.076582+0000","last_fullsized":"2024-04-26T12:30:54.076582+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:10.764587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":258,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075901+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:30:54.075901+0000","last_peered":"2024-04-26T12:30:54.075901+0000","last_clean":"2024-04-26T12:30:54.075901+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:30:54.075901+0000","last_undegraded":"2024-04-26T12:30:54.075901+0000","last_fullsized":"2024-04-26T12:30:54.075901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:23.542209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":591,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075325+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:30:52.075325+0000","last_peered":"2024-04-26T12:30:52.075325+0000","last_clean":"2024-04-26T12:30:52.075325+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:30:52.075325+0000","last_undegraded":"2024-04-26T12:30:52.075325+0000","last_fullsized":"2024-04-26T12:30:52.075325+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:05.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":559,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076976+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:30:54.076976+0000","last_peered":"2024-04-26T12:30:54.076976+0000","last_clean":"2024-04-26T12:30:54.076976+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:30:54.076976+0000","last_undegraded":"2024-04-26T12:30:54.076976+0000","last_fullsized":"2024-04-26T12:30:54.076976+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075904+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:30:54.075904+0000","last_peered":"2024-04-26T12:30:54.075904+0000","last_clean":"2024-04-26T12:30:54.075904+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:30:54.075904+0000","last_undegraded":"2024-04-26T12:30:54.075904+0000","last_fullsized":"2024-04-26T12:30:54.075904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'105","reported_seq":215,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075351+0000","last_change":"2024-04-26T12:30:44.028851+0000","last_active":"2024-04-26T12:30:52.075351+0000","last_peered":"2024-04-26T12:30:52.075351+0000","last_clean":"2024-04-26T12:30:52.075351+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:30:52.075351+0000","last_undegraded":"2024-04-26T12:30:52.075351+0000","last_fullsized":"2024-04-26T12:30:52.075351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:13.939165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":572,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081988+0000","last_change":"2024-04-26T12:30:42.158989+0000","last_active":"2024-04-26T12:30:50.081988+0000","last_peered":"2024-04-26T12:30:50.081988+0000","last_clean":"2024-04-26T12:27:45.658919+0000","last_became_active":"2024-04-26T12:30:42.157001+0000","last_became_peered":"2024-04-26T12:30:42.157001+0000","last_unstale":"2024-04-26T12:30:50.081988+0000","last_undegraded":"2024-04-26T12:30:42.046089+0000","last_fullsized":"2024-04-26T12:30:42.041964+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:06.285978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081486+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:30:50.081486+0000","last_peered":"2024-04-26T12:30:50.081486+0000","last_clean":"2024-04-26T12:30:50.081486+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:30:50.081486+0000","last_undegraded":"2024-04-26T12:30:50.081486+0000","last_fullsized":"2024-04-26T12:30:50.081486+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:31.181549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075854+0000","last_change":"2024-04-26T12:30:41.026137+0000","last_active":"2024-04-26T12:30:52.075854+0000","last_peered":"2024-04-26T12:30:52.075854+0000","last_clean":"2024-04-26T12:30:52.075854+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:30:52.075854+0000","last_undegraded":"2024-04-26T12:30:52.075854+0000","last_fullsized":"2024-04-26T12:30:52.075854+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:08.225745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":510,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080733+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:30:50.080733+0000","last_peered":"2024-04-26T12:30:50.080733+0000","last_clean":"2024-04-26T12:30:50.080733+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:30:50.080733+0000","last_undegraded":"2024-04-26T12:30:50.080733+0000","last_fullsized":"2024-04-26T12:30:50.080733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":35,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075773+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:30:52.075773+0000","last_peered":"2024-04-26T12:30:52.075773+0000","last_clean":"2024-04-26T12:30:52.075773+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:30:52.075773+0000","last_undegraded":"2024-04-26T12:30:52.075773+0000","last_fullsized":"2024-04-26T12:30:52.075773+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:51.609322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075713+0000","last_change":"2024-04-26T12:30:41.030157+0000","last_active":"2024-04-26T12:30:52.075713+0000","last_peered":"2024-04-26T12:30:52.075713+0000","last_clean":"2024-04-26T12:30:52.075713+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:52.075713+0000","last_undegraded":"2024-04-26T12:30:52.075713+0000","last_fullsized":"2024-04-26T12:30:52.075713+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:32.867679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":514,"reported_epoch":75,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:50.080119+0000","last_change":"2024-04-26T12:30:47.084724+0000","last_active":"2024-04-26T12:30:50.080119+0000","last_peered":"2024-04-26T12:30:50.080119+0000","last_clean":"2024-04-26T12:30:39.001153+0000","last_became_active":"2024-04-26T12:30:47.083601+0000","last_became_peered":"2024-04-26T12:30:47.083601+0000","last_unstale":"2024-04-26T12:30:50.080119+0000","last_undegraded":"2024-04-26T12:30:50.080119+0000","last_fullsized":"2024-04-26T12:30:50.080119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:00.234562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":184,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076673+0000","last_change":"2024-04-26T12:30:46.080509+0000","last_active":"2024-04-26T12:30:54.076673+0000","last_peered":"2024-04-26T12:30:54.076673+0000","last_clean":"2024-04-26T12:30:54.076673+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:30:54.076673+0000","last_undegraded":"2024-04-26T12:30:54.076673+0000","last_fullsized":"2024-04-26T12:30:54.076673+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:40.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'82","reported_seq":54,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075920+0000","last_change":"2024-04-26T12:30:46.086027+0000","last_active":"2024-04-26T12:30:52.075920+0000","last_peered":"2024-04-26T12:30:52.075920+0000","last_clean":"2024-04-26T12:30:52.075920+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:30:52.075920+0000","last_undegraded":"2024-04-26T12:30:52.075920+0000","last_fullsized":"2024-04-26T12:30:52.075920+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:13.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":596,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081437+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:30:50.081437+0000","last_peered":"2024-04-26T12:30:50.081437+0000","last_clean":"2024-04-26T12:30:50.081437+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:30:50.081437+0000","last_undegraded":"2024-04-26T12:30:50.081437+0000","last_fullsized":"2024-04-26T12:30:50.081437+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":164,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080723+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:30:50.080723+0000","last_peered":"2024-04-26T12:30:50.080723+0000","last_clean":"2024-04-26T12:30:50.080723+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:30:50.080723+0000","last_undegraded":"2024-04-26T12:30:50.080723+0000","last_fullsized":"2024-04-26T12:30:50.080723+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.312112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":838,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:30:51.265782+0000","last_change":"2024-04-26T12:30:51.265921+0000","last_active":"2024-04-26T12:30:51.265782+0000","last_peered":"2024-04-26T12:30:51.265782+0000","last_clean":"2024-04-26T12:27:45.658753+0000","last_became_active":"2024-04-26T12:30:42.150170+0000","last_became_peered":"2024-04-26T12:30:42.150170+0000","last_unstale":"2024-04-26T12:30:51.265782+0000","last_undegraded":"2024-04-26T12:30:51.265782+0000","last_fullsized":"2024-04-26T12:30:42.029605+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:27.247271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076362+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:30:54.076362+0000","last_peered":"2024-04-26T12:30:54.076362+0000","last_clean":"2024-04-26T12:30:54.076362+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:30:54.076362+0000","last_undegraded":"2024-04-26T12:30:54.076362+0000","last_fullsized":"2024-04-26T12:30:54.076362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:43.044883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":793,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076256+0000","last_change":"2024-04-26T12:30:48.088039+0000","last_active":"2024-04-26T12:30:54.076256+0000","last_peered":"2024-04-26T12:30:54.076256+0000","last_clean":"2024-04-26T12:30:54.076256+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:30:54.076256+0000","last_undegraded":"2024-04-26T12:30:54.076256+0000","last_fullsized":"2024-04-26T12:30:54.076256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:03.967118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"58'314","reported_seq":386,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081227+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:30:50.081227+0000","last_peered":"2024-04-26T12:30:50.081227+0000","last_clean":"2024-04-26T12:30:50.081227+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:30:50.081227+0000","last_undegraded":"2024-04-26T12:30:50.081227+0000","last_fullsized":"2024-04-26T12:30:50.081227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":867,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076084+0000","last_change":"2024-04-26T12:30:52.079092+0000","last_active":"2024-04-26T12:30:54.076084+0000","last_peered":"2024-04-26T12:30:54.076084+0000","last_clean":"2024-04-26T12:30:54.076084+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:30:54.076084+0000","last_undegraded":"2024-04-26T12:30:54.076084+0000","last_fullsized":"2024-04-26T12:30:54.076084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:10.253347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"58'76","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075789+0000","last_change":"2024-04-26T12:30:41.050653+0000","last_active":"2024-04-26T12:30:52.075789+0000","last_peered":"2024-04-26T12:30:52.075789+0000","last_clean":"2024-04-26T12:30:52.075789+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:52.075789+0000","last_undegraded":"2024-04-26T12:30:52.075789+0000","last_fullsized":"2024-04-26T12:30:52.075789+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:17.874875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":537,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075764+0000","last_change":"2024-04-26T12:28:00.707724+0000","last_active":"2024-04-26T12:30:54.075764+0000","last_peered":"2024-04-26T12:30:54.075764+0000","last_clean":"2024-04-26T12:30:54.075764+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:30:54.075764+0000","last_undegraded":"2024-04-26T12:30:54.075764+0000","last_fullsized":"2024-04-26T12:30:54.075764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:20.384961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":45,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.076003+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:30:52.076003+0000","last_peered":"2024-04-26T12:30:52.076003+0000","last_clean":"2024-04-26T12:30:52.076003+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:30:52.076003+0000","last_undegraded":"2024-04-26T12:30:52.076003+0000","last_fullsized":"2024-04-26T12:30:52.076003+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:40.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":962,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076157+0000","last_change":"2024-04-26T12:30:51.076207+0000","last_active":"2024-04-26T12:30:54.076157+0000","last_peered":"2024-04-26T12:30:54.076157+0000","last_clean":"2024-04-26T12:30:54.076157+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:30:54.076157+0000","last_undegraded":"2024-04-26T12:30:54.076157+0000","last_fullsized":"2024-04-26T12:30:54.076157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:05.869282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":858,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076035+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:30:54.076035+0000","last_peered":"2024-04-26T12:30:54.076035+0000","last_clean":"2024-04-26T12:30:54.076035+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:30:54.076035+0000","last_undegraded":"2024-04-26T12:30:54.076035+0000","last_fullsized":"2024-04-26T12:30:54.076035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:50.433671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":514,"reported_epoch":78,"state":"peering","last_fresh":"2024-04-26T12:30:53.076275+0000","last_change":"2024-04-26T12:30:53.076275+0000","last_active":"2024-04-26T12:30:41.011793+0000","last_peered":"2024-04-26T12:30:39.001968+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.666218+0000","last_became_peered":"2024-04-26T12:27:48.666218+0000","last_unstale":"2024-04-26T12:30:53.076275+0000","last_undegraded":"2024-04-26T12:30:53.076275+0000","last_fullsized":"2024-04-26T12:30:53.076275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:11.913441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":619,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080789+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:30:50.080789+0000","last_peered":"2024-04-26T12:30:50.080789+0000","last_clean":"2024-04-26T12:30:50.080789+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:30:50.080789+0000","last_undegraded":"2024-04-26T12:30:50.080789+0000","last_fullsized":"2024-04-26T12:30:50.080789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":508,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075431+0000","last_change":"2024-04-26T12:30:50.086765+0000","last_active":"2024-04-26T12:30:52.075431+0000","last_peered":"2024-04-26T12:30:52.075431+0000","last_clean":"2024-04-26T12:30:52.075431+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:30:52.075431+0000","last_undegraded":"2024-04-26T12:30:52.075431+0000","last_fullsized":"2024-04-26T12:30:52.075431+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:36.313767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":502,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081508+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:30:50.081508+0000","last_peered":"2024-04-26T12:30:50.081508+0000","last_clean":"2024-04-26T12:30:50.081508+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:30:50.081508+0000","last_undegraded":"2024-04-26T12:30:50.081508+0000","last_fullsized":"2024-04-26T12:30:50.081508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1828,"num_objects_misplaced":893,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4348,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":117,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90275840,"data_stored":285809728,"data_compressed":42864631,"data_compressed_allocated":53944320,"data_compressed_original":249548800,"omap_allocated":5343,"internal_metadata":0},"log_size":7508,"ondisk_log_size":7508,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738421,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140900,"kb_used_data":41752,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94230940,"statfs":{"total":96636764160,"available":96492482560,"internally_reserved":0,"allocated":42754048,"data_stored":115105444,"data_compressed":16083079,"data_compressed_allocated":21016576,"data_compressed_original":93810688,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41799999999999998,"15min":0.434},"min":{"1min":0.22500000000000001,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41399999999999998,"15min":0.42599999999999999},"min":{"1min":0.20799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.35099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113232,"kb_used_data":32128,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94258608,"statfs":{"total":96636764160,"available":96520814592,"internally_reserved":0,"allocated":32899072,"data_stored":91424707,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.317},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:30:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.30399999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.625,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.496},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.44600000000000001}]}]},{"osd":1,"up_from":64,"seq":274877906949,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78660,"kb_used_data":16688,"kb_used_omap":6,"kb_used_meta":61945,"kb_avail":94293180,"statfs":{"total":96636764160,"available":96556216320,"internally_reserved":0,"allocated":17088512,"data_stored":81517291,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":63431911},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41930752,"data_stored":114170599,"data_compressed":16048932,"data_compressed_allocated":20971520,"data_compressed_original":93237248,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:30:55.629 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:30:56.011 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:30:56.013 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:30:56.023 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-04-26T12:30:55.357528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1828,"num_objects_misplaced":893,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4375,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34345,"ondisk_log_size":34345,"up":210,"acting":199,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":232,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":332792,"kb_used_data":90568,"kb_used_omap":9,"kb_used_meta":242166,"kb_avail":282782728,"statfs":{"total":289910292480,"available":289569513472,"internally_reserved":0,"allocated":92741632,"data_stored":288047442,"data_compressed":42932925,"data_compressed_allocated":54034432,"data_compressed_original":250695680,"omap_allocated":10125,"internal_metadata":247978099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":944,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000840"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":523,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.082633+0000","last_change":"2024-04-26T12:30:42.154734+0000","last_active":"2024-04-26T12:30:50.082633+0000","last_peered":"2024-04-26T12:30:50.082633+0000","last_clean":"2024-04-26T12:27:45.659014+0000","last_became_active":"2024-04-26T12:30:42.152053+0000","last_became_peered":"2024-04-26T12:30:42.152053+0000","last_unstale":"2024-04-26T12:30:50.082633+0000","last_undegraded":"2024-04-26T12:30:42.028217+0000","last_fullsized":"2024-04-26T12:30:42.007364+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:39.479842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":573,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081630+0000","last_change":"2024-04-26T12:30:42.158082+0000","last_active":"2024-04-26T12:30:50.081630+0000","last_peered":"2024-04-26T12:30:50.081630+0000","last_clean":"2024-04-26T12:27:45.658708+0000","last_became_active":"2024-04-26T12:30:42.155649+0000","last_became_peered":"2024-04-26T12:30:42.155649+0000","last_unstale":"2024-04-26T12:30:50.081630+0000","last_undegraded":"2024-04-26T12:30:42.040463+0000","last_fullsized":"2024-04-26T12:30:42.024179+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:34.362023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":490,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076853+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:30:54.076853+0000","last_peered":"2024-04-26T12:30:54.076853+0000","last_clean":"2024-04-26T12:30:54.076853+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:30:54.076853+0000","last_undegraded":"2024-04-26T12:30:54.076853+0000","last_fullsized":"2024-04-26T12:30:54.076853+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:55.616144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":862,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.078603+0000","last_change":"2024-04-26T12:30:48.089842+0000","last_active":"2024-04-26T12:30:55.078603+0000","last_peered":"2024-04-26T12:30:55.078603+0000","last_clean":"2024-04-26T12:30:55.078603+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:30:55.078603+0000","last_undegraded":"2024-04-26T12:30:55.078603+0000","last_fullsized":"2024-04-26T12:30:55.078603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:13.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":930,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080467+0000","last_change":"2024-04-26T12:30:48.089460+0000","last_active":"2024-04-26T12:30:50.080467+0000","last_peered":"2024-04-26T12:30:50.080467+0000","last_clean":"2024-04-26T12:30:50.080467+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:30:50.080467+0000","last_undegraded":"2024-04-26T12:30:50.080467+0000","last_fullsized":"2024-04-26T12:30:50.080467+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":472,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075962+0000","last_change":"2024-04-26T12:30:48.090606+0000","last_active":"2024-04-26T12:30:54.075962+0000","last_peered":"2024-04-26T12:30:54.075962+0000","last_clean":"2024-04-26T12:30:54.075962+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:30:54.075962+0000","last_undegraded":"2024-04-26T12:30:54.075962+0000","last_fullsized":"2024-04-26T12:30:54.075962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:57.446858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1023,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076470+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:30:54.076470+0000","last_peered":"2024-04-26T12:30:54.076470+0000","last_clean":"2024-04-26T12:30:54.076470+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:30:54.076470+0000","last_undegraded":"2024-04-26T12:30:54.076470+0000","last_fullsized":"2024-04-26T12:30:54.076470+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:06.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":762,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075764+0000","last_change":"2024-04-26T12:30:49.082511+0000","last_active":"2024-04-26T12:30:54.075764+0000","last_peered":"2024-04-26T12:30:54.075764+0000","last_clean":"2024-04-26T12:30:54.075764+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:30:54.075764+0000","last_undegraded":"2024-04-26T12:30:54.075764+0000","last_fullsized":"2024-04-26T12:30:54.075764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:54.832086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":499,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081910+0000","last_change":"2024-04-26T12:30:42.158818+0000","last_active":"2024-04-26T12:30:50.081910+0000","last_peered":"2024-04-26T12:30:50.081910+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:30:42.157705+0000","last_became_peered":"2024-04-26T12:30:42.157705+0000","last_unstale":"2024-04-26T12:30:50.081910+0000","last_undegraded":"2024-04-26T12:30:42.043686+0000","last_fullsized":"2024-04-26T12:30:42.036742+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:54.251271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":552,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081921+0000","last_change":"2024-04-26T12:30:42.158203+0000","last_active":"2024-04-26T12:30:50.081921+0000","last_peered":"2024-04-26T12:30:50.081921+0000","last_clean":"2024-04-26T12:27:45.658876+0000","last_became_active":"2024-04-26T12:30:42.156989+0000","last_became_peered":"2024-04-26T12:30:42.156989+0000","last_unstale":"2024-04-26T12:30:50.081921+0000","last_undegraded":"2024-04-26T12:30:42.043424+0000","last_fullsized":"2024-04-26T12:30:42.037394+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:56.779235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":589,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076569+0000","last_change":"2024-04-26T12:30:50.085026+0000","last_active":"2024-04-26T12:30:54.076569+0000","last_peered":"2024-04-26T12:30:54.076569+0000","last_clean":"2024-04-26T12:30:54.076569+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:30:54.076569+0000","last_undegraded":"2024-04-26T12:30:54.076569+0000","last_fullsized":"2024-04-26T12:30:54.076569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:31.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":503,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081004+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:30:50.081004+0000","last_peered":"2024-04-26T12:30:50.081004+0000","last_clean":"2024-04-26T12:30:50.081004+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:30:50.081004+0000","last_undegraded":"2024-04-26T12:30:50.081004+0000","last_fullsized":"2024-04-26T12:30:50.081004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":874,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080831+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:30:50.080831+0000","last_peered":"2024-04-26T12:30:50.080831+0000","last_clean":"2024-04-26T12:30:50.080831+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:30:50.080831+0000","last_undegraded":"2024-04-26T12:30:50.080831+0000","last_fullsized":"2024-04-26T12:30:50.080831+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:00.467106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":515,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076440+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:30:54.076440+0000","last_peered":"2024-04-26T12:30:54.076440+0000","last_clean":"2024-04-26T12:30:54.076440+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:30:54.076440+0000","last_undegraded":"2024-04-26T12:30:54.076440+0000","last_fullsized":"2024-04-26T12:30:54.076440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":535,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075874+0000","last_change":"2024-04-26T12:30:47.080645+0000","last_active":"2024-04-26T12:30:54.075874+0000","last_peered":"2024-04-26T12:30:54.075874+0000","last_clean":"2024-04-26T12:30:54.075874+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:30:54.075874+0000","last_undegraded":"2024-04-26T12:30:54.075874+0000","last_fullsized":"2024-04-26T12:30:54.075874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:11.047331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":921,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075792+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:30:54.075792+0000","last_peered":"2024-04-26T12:30:54.075792+0000","last_clean":"2024-04-26T12:30:54.075792+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:30:54.075792+0000","last_undegraded":"2024-04-26T12:30:54.075792+0000","last_fullsized":"2024-04-26T12:30:54.075792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:18.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":493,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081779+0000","last_change":"2024-04-26T12:30:42.154835+0000","last_active":"2024-04-26T12:30:50.081779+0000","last_peered":"2024-04-26T12:30:50.081779+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:30:42.153333+0000","last_became_peered":"2024-04-26T12:30:42.153333+0000","last_unstale":"2024-04-26T12:30:50.081779+0000","last_undegraded":"2024-04-26T12:30:42.037452+0000","last_fullsized":"2024-04-26T12:30:42.029386+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:35.304869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":533,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.082579+0000","last_change":"2024-04-26T12:30:42.164164+0000","last_active":"2024-04-26T12:30:50.082579+0000","last_peered":"2024-04-26T12:30:50.082579+0000","last_clean":"2024-04-26T12:27:45.658959+0000","last_became_active":"2024-04-26T12:30:42.163023+0000","last_became_peered":"2024-04-26T12:30:42.163023+0000","last_unstale":"2024-04-26T12:30:50.082579+0000","last_undegraded":"2024-04-26T12:30:42.047375+0000","last_fullsized":"2024-04-26T12:30:42.044616+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:50.561555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":519,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075637+0000","last_change":"2024-04-26T12:30:51.076894+0000","last_active":"2024-04-26T12:30:52.075637+0000","last_peered":"2024-04-26T12:30:52.075637+0000","last_clean":"2024-04-26T12:30:52.075637+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:30:52.075637+0000","last_undegraded":"2024-04-26T12:30:52.075637+0000","last_fullsized":"2024-04-26T12:30:52.075637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:50.091007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1065,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076706+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:30:54.076706+0000","last_peered":"2024-04-26T12:30:54.076706+0000","last_clean":"2024-04-26T12:30:54.076706+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:30:54.076706+0000","last_undegraded":"2024-04-26T12:30:54.076706+0000","last_fullsized":"2024-04-26T12:30:54.076706+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:26.268194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":947,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076191+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:30:54.076191+0000","last_peered":"2024-04-26T12:30:54.076191+0000","last_clean":"2024-04-26T12:30:54.076191+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:30:54.076191+0000","last_undegraded":"2024-04-26T12:30:54.076191+0000","last_fullsized":"2024-04-26T12:30:54.076191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:12.535434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":571,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080614+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:30:50.080614+0000","last_peered":"2024-04-26T12:30:50.080614+0000","last_clean":"2024-04-26T12:30:50.080614+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:30:50.080614+0000","last_undegraded":"2024-04-26T12:30:50.080614+0000","last_fullsized":"2024-04-26T12:30:50.080614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":510,"reported_epoch":75,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:50.080259+0000","last_change":"2024-04-26T12:30:47.082934+0000","last_active":"2024-04-26T12:30:50.080259+0000","last_peered":"2024-04-26T12:30:50.080259+0000","last_clean":"2024-04-26T12:30:39.001294+0000","last_became_active":"2024-04-26T12:30:47.081126+0000","last_became_peered":"2024-04-26T12:30:47.081126+0000","last_unstale":"2024-04-26T12:30:50.080259+0000","last_undegraded":"2024-04-26T12:30:50.080259+0000","last_fullsized":"2024-04-26T12:30:50.080259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:47.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":179,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":606,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081617+0000","last_change":"2024-04-26T12:30:42.168459+0000","last_active":"2024-04-26T12:30:50.081617+0000","last_peered":"2024-04-26T12:30:50.081617+0000","last_clean":"2024-04-26T12:27:45.658199+0000","last_became_active":"2024-04-26T12:30:42.163138+0000","last_became_peered":"2024-04-26T12:30:42.163138+0000","last_unstale":"2024-04-26T12:30:50.081617+0000","last_undegraded":"2024-04-26T12:30:42.014270+0000","last_fullsized":"2024-04-26T12:30:42.005688+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:33.001689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":539,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.082560+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:30:50.082560+0000","last_peered":"2024-04-26T12:30:50.082560+0000","last_clean":"2024-04-26T12:30:50.082560+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:30:50.082560+0000","last_undegraded":"2024-04-26T12:30:50.082560+0000","last_fullsized":"2024-04-26T12:30:50.082560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":578,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075968+0000","last_change":"2024-04-26T12:30:46.089997+0000","last_active":"2024-04-26T12:30:52.075968+0000","last_peered":"2024-04-26T12:30:52.075968+0000","last_clean":"2024-04-26T12:30:52.075968+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:30:52.075968+0000","last_undegraded":"2024-04-26T12:30:52.075968+0000","last_fullsized":"2024-04-26T12:30:52.075968+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:08.843126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":508,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076720+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:30:54.076720+0000","last_peered":"2024-04-26T12:30:54.076720+0000","last_clean":"2024-04-26T12:30:54.076720+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:30:54.076720+0000","last_undegraded":"2024-04-26T12:30:54.076720+0000","last_fullsized":"2024-04-26T12:30:54.076720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":558,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080554+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:30:50.080554+0000","last_peered":"2024-04-26T12:30:50.080554+0000","last_clean":"2024-04-26T12:30:50.080554+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:30:50.080554+0000","last_undegraded":"2024-04-26T12:30:50.080554+0000","last_fullsized":"2024-04-26T12:30:50.080554+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:21.302173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":473,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081392+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:30:50.081392+0000","last_peered":"2024-04-26T12:30:50.081392+0000","last_clean":"2024-04-26T12:30:50.081392+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:30:50.081392+0000","last_undegraded":"2024-04-26T12:30:50.081392+0000","last_fullsized":"2024-04-26T12:30:50.081392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":403,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075077+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:30:52.075077+0000","last_peered":"2024-04-26T12:30:52.075077+0000","last_clean":"2024-04-26T12:30:52.075077+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:30:52.075077+0000","last_undegraded":"2024-04-26T12:30:52.075077+0000","last_fullsized":"2024-04-26T12:30:52.075077+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.762427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":489,"reported_epoch":75,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:50.080838+0000","last_change":"2024-04-26T12:30:47.080820+0000","last_active":"2024-04-26T12:30:50.080838+0000","last_peered":"2024-04-26T12:30:50.080838+0000","last_clean":"2024-04-26T12:30:39.002004+0000","last_became_active":"2024-04-26T12:30:47.079644+0000","last_became_peered":"2024-04-26T12:30:47.079644+0000","last_unstale":"2024-04-26T12:30:50.080838+0000","last_undegraded":"2024-04-26T12:30:50.080838+0000","last_fullsized":"2024-04-26T12:30:50.080838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:52.807804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":167,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"58'708","reported_seq":771,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.074970+0000","last_change":"2024-04-26T12:30:44.022038+0000","last_active":"2024-04-26T12:30:52.074970+0000","last_peered":"2024-04-26T12:30:52.074970+0000","last_clean":"2024-04-26T12:30:52.074970+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:30:52.074970+0000","last_undegraded":"2024-04-26T12:30:52.074970+0000","last_fullsized":"2024-04-26T12:30:52.074970+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:30.369118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":490,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081994+0000","last_change":"2024-04-26T12:30:47.081417+0000","last_active":"2024-04-26T12:30:50.081994+0000","last_peered":"2024-04-26T12:30:50.081994+0000","last_clean":"2024-04-26T12:30:50.081994+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:30:50.081994+0000","last_undegraded":"2024-04-26T12:30:50.081994+0000","last_fullsized":"2024-04-26T12:30:50.081994+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:17.628933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075927+0000","last_change":"2024-04-26T12:30:41.018067+0000","last_active":"2024-04-26T12:30:52.075927+0000","last_peered":"2024-04-26T12:30:52.075927+0000","last_clean":"2024-04-26T12:30:52.075927+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:30:52.075927+0000","last_undegraded":"2024-04-26T12:30:52.075927+0000","last_fullsized":"2024-04-26T12:30:52.075927+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:33.684743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":597,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.080363+0000","last_change":"2024-04-26T12:30:42.170928+0000","last_active":"2024-04-26T12:30:50.080363+0000","last_peered":"2024-04-26T12:30:50.080363+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:30:42.168445+0000","last_became_peered":"2024-04-26T12:30:42.168445+0000","last_unstale":"2024-04-26T12:30:50.080363+0000","last_undegraded":"2024-04-26T12:30:42.048666+0000","last_fullsized":"2024-04-26T12:30:42.040503+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:27.519673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"58'355","reported_seq":372,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076603+0000","last_change":"2024-04-26T12:30:48.086933+0000","last_active":"2024-04-26T12:30:54.076603+0000","last_peered":"2024-04-26T12:30:54.076603+0000","last_clean":"2024-04-26T12:30:54.076603+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:30:54.076603+0000","last_undegraded":"2024-04-26T12:30:54.076603+0000","last_fullsized":"2024-04-26T12:30:54.076603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:49.737283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":713,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075022+0000","last_change":"2024-04-26T12:30:46.034642+0000","last_active":"2024-04-26T12:30:52.075022+0000","last_peered":"2024-04-26T12:30:52.075022+0000","last_clean":"2024-04-26T12:30:52.075022+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:30:52.075022+0000","last_undegraded":"2024-04-26T12:30:52.075022+0000","last_fullsized":"2024-04-26T12:30:52.075022+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.961343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":158,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081051+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:30:50.081051+0000","last_peered":"2024-04-26T12:30:50.081051+0000","last_clean":"2024-04-26T12:30:50.081051+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:30:50.081051+0000","last_undegraded":"2024-04-26T12:30:50.081051+0000","last_fullsized":"2024-04-26T12:30:50.081051+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":504,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075279+0000","last_change":"2024-04-26T12:30:45.022716+0000","last_active":"2024-04-26T12:30:52.075279+0000","last_peered":"2024-04-26T12:30:52.075279+0000","last_clean":"2024-04-26T12:30:52.075279+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:30:52.075279+0000","last_undegraded":"2024-04-26T12:30:52.075279+0000","last_fullsized":"2024-04-26T12:30:52.075279+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:01.269901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'374","reported_seq":434,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076492+0000","last_change":"2024-04-26T12:30:46.079618+0000","last_active":"2024-04-26T12:30:54.076492+0000","last_peered":"2024-04-26T12:30:54.076492+0000","last_clean":"2024-04-26T12:30:54.076492+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:30:54.076492+0000","last_undegraded":"2024-04-26T12:30:54.076492+0000","last_fullsized":"2024-04-26T12:30:54.076492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:48.209628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":501,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076690+0000","last_change":"2024-04-26T12:30:47.082596+0000","last_active":"2024-04-26T12:30:54.076690+0000","last_peered":"2024-04-26T12:30:54.076690+0000","last_clean":"2024-04-26T12:30:54.076690+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:30:54.076690+0000","last_undegraded":"2024-04-26T12:30:54.076690+0000","last_fullsized":"2024-04-26T12:30:54.076690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:34.688913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":643,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076568+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:30:54.076568+0000","last_peered":"2024-04-26T12:30:54.076568+0000","last_clean":"2024-04-26T12:30:54.076568+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:30:54.076568+0000","last_undegraded":"2024-04-26T12:30:54.076568+0000","last_fullsized":"2024-04-26T12:30:54.076568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:50.674218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":785,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081095+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:30:50.081095+0000","last_peered":"2024-04-26T12:30:50.081095+0000","last_clean":"2024-04-26T12:30:50.081095+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:30:50.081095+0000","last_undegraded":"2024-04-26T12:30:50.081095+0000","last_fullsized":"2024-04-26T12:30:50.081095+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:11.548975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075120+0000","last_change":"2024-04-26T12:30:46.089052+0000","last_active":"2024-04-26T12:30:52.075120+0000","last_peered":"2024-04-26T12:30:52.075120+0000","last_clean":"2024-04-26T12:30:52.075120+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:30:52.075120+0000","last_undegraded":"2024-04-26T12:30:52.075120+0000","last_fullsized":"2024-04-26T12:30:52.075120+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:28.433853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":851,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.086989+0000","last_change":"2024-04-26T12:30:50.086492+0000","last_active":"2024-04-26T12:30:50.086989+0000","last_peered":"2024-04-26T12:30:50.086989+0000","last_clean":"2024-04-26T12:30:50.086989+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:30:50.086989+0000","last_undegraded":"2024-04-26T12:30:50.086989+0000","last_fullsized":"2024-04-26T12:30:50.086989+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:18.705037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":129,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080805+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:30:50.080805+0000","last_peered":"2024-04-26T12:30:50.080805+0000","last_clean":"2024-04-26T12:30:50.080805+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:30:50.080805+0000","last_undegraded":"2024-04-26T12:30:50.080805+0000","last_fullsized":"2024-04-26T12:30:50.080805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":513,"reported_epoch":75,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:50.081543+0000","last_change":"2024-04-26T12:30:47.081736+0000","last_active":"2024-04-26T12:30:50.081543+0000","last_peered":"2024-04-26T12:30:50.081543+0000","last_clean":"2024-04-26T12:30:39.001966+0000","last_became_active":"2024-04-26T12:30:47.079760+0000","last_became_peered":"2024-04-26T12:30:47.079760+0000","last_unstale":"2024-04-26T12:30:50.081543+0000","last_undegraded":"2024-04-26T12:30:50.081543+0000","last_fullsized":"2024-04-26T12:30:50.081543+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:49.432476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":190,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"59'54","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076213+0000","last_change":"2024-04-26T12:30:46.082166+0000","last_active":"2024-04-26T12:30:54.076213+0000","last_peered":"2024-04-26T12:30:54.076213+0000","last_clean":"2024-04-26T12:30:54.076213+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:30:54.076213+0000","last_undegraded":"2024-04-26T12:30:54.076213+0000","last_fullsized":"2024-04-26T12:30:54.076213+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:28.037535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":551,"reported_epoch":75,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:50.080923+0000","last_change":"2024-04-26T12:30:47.081110+0000","last_active":"2024-04-26T12:30:50.080923+0000","last_peered":"2024-04-26T12:30:50.080923+0000","last_clean":"2024-04-26T12:30:39.002391+0000","last_became_active":"2024-04-26T12:30:47.079796+0000","last_became_peered":"2024-04-26T12:30:47.079796+0000","last_unstale":"2024-04-26T12:30:50.080923+0000","last_undegraded":"2024-04-26T12:30:50.080923+0000","last_fullsized":"2024-04-26T12:30:50.080923+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:20.060030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":173,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"58'186","reported_seq":204,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076622+0000","last_change":"2024-04-26T12:30:46.080074+0000","last_active":"2024-04-26T12:30:54.076622+0000","last_peered":"2024-04-26T12:30:54.076622+0000","last_clean":"2024-04-26T12:30:54.076622+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:30:54.076622+0000","last_undegraded":"2024-04-26T12:30:54.076622+0000","last_fullsized":"2024-04-26T12:30:54.076622+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:24.562647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":522,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080157+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:30:50.080157+0000","last_peered":"2024-04-26T12:30:50.080157+0000","last_clean":"2024-04-26T12:30:50.080157+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:30:50.080157+0000","last_undegraded":"2024-04-26T12:30:50.080157+0000","last_fullsized":"2024-04-26T12:30:50.080157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":431,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081749+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:30:50.081749+0000","last_peered":"2024-04-26T12:30:50.081749+0000","last_clean":"2024-04-26T12:30:50.081749+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:30:50.081749+0000","last_undegraded":"2024-04-26T12:30:50.081749+0000","last_fullsized":"2024-04-26T12:30:50.081749+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:40.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":960,"reported_epoch":76,"state":"peering","last_fresh":"2024-04-26T12:30:51.072934+0000","last_change":"2024-04-26T12:30:51.073102+0000","last_active":"2024-04-26T12:30:51.072934+0000","last_peered":"2024-04-26T12:30:50.532087+0000","last_clean":"2024-04-26T12:27:45.658276+0000","last_became_active":"2024-04-26T12:30:42.147813+0000","last_became_peered":"2024-04-26T12:30:42.147813+0000","last_unstale":"2024-04-26T12:30:51.072934+0000","last_undegraded":"2024-04-26T12:30:51.072934+0000","last_fullsized":"2024-04-26T12:30:51.072934+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:20.494198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":509,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076714+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:30:54.076714+0000","last_peered":"2024-04-26T12:30:54.076714+0000","last_clean":"2024-04-26T12:30:54.076714+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:30:54.076714+0000","last_undegraded":"2024-04-26T12:30:54.076714+0000","last_fullsized":"2024-04-26T12:30:54.076714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:18.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":486,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076194+0000","last_change":"2024-04-26T12:30:48.089200+0000","last_active":"2024-04-26T12:30:54.076194+0000","last_peered":"2024-04-26T12:30:54.076194+0000","last_clean":"2024-04-26T12:30:54.076194+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:30:54.076194+0000","last_undegraded":"2024-04-26T12:30:54.076194+0000","last_fullsized":"2024-04-26T12:30:54.076194+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:04.588329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076209+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:54.076209+0000","last_peered":"2024-04-26T12:30:54.076209+0000","last_clean":"2024-04-26T12:30:54.076209+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:30:54.076209+0000","last_undegraded":"2024-04-26T12:30:54.076209+0000","last_fullsized":"2024-04-26T12:30:54.076209+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:40.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":552,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075256+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:30:52.075256+0000","last_peered":"2024-04-26T12:30:52.075256+0000","last_clean":"2024-04-26T12:30:52.075256+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:30:52.075256+0000","last_undegraded":"2024-04-26T12:30:52.075256+0000","last_fullsized":"2024-04-26T12:30:52.075256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.230823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":245,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075103+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:30:52.075103+0000","last_peered":"2024-04-26T12:30:52.075103+0000","last_clean":"2024-04-26T12:30:52.075103+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:30:52.075103+0000","last_undegraded":"2024-04-26T12:30:52.075103+0000","last_fullsized":"2024-04-26T12:30:52.075103+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:30.864621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":532,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076248+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:30:54.076248+0000","last_peered":"2024-04-26T12:30:54.076248+0000","last_clean":"2024-04-26T12:30:54.076248+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:30:54.076248+0000","last_undegraded":"2024-04-26T12:30:54.076248+0000","last_fullsized":"2024-04-26T12:30:54.076248+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:13.427584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076054+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:30:54.076054+0000","last_peered":"2024-04-26T12:30:54.076054+0000","last_clean":"2024-04-26T12:30:54.076054+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:30:54.076054+0000","last_undegraded":"2024-04-26T12:30:54.076054+0000","last_fullsized":"2024-04-26T12:30:54.076054+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:16.260550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":478,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076963+0000","last_change":"2024-04-26T12:30:47.083054+0000","last_active":"2024-04-26T12:30:54.076963+0000","last_peered":"2024-04-26T12:30:54.076963+0000","last_clean":"2024-04-26T12:30:54.076963+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:30:54.076963+0000","last_undegraded":"2024-04-26T12:30:54.076963+0000","last_fullsized":"2024-04-26T12:30:54.076963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.645638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":153,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080401+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:30:50.080401+0000","last_peered":"2024-04-26T12:30:50.080401+0000","last_clean":"2024-04-26T12:30:50.080401+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:30:50.080401+0000","last_undegraded":"2024-04-26T12:30:50.080401+0000","last_fullsized":"2024-04-26T12:30:50.080401+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:20.988072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":487,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076864+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:30:54.076864+0000","last_peered":"2024-04-26T12:30:54.076864+0000","last_clean":"2024-04-26T12:30:54.076864+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:30:54.076864+0000","last_undegraded":"2024-04-26T12:30:54.076864+0000","last_fullsized":"2024-04-26T12:30:54.076864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":579,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080923+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:30:50.080923+0000","last_peered":"2024-04-26T12:30:50.080923+0000","last_clean":"2024-04-26T12:30:50.080923+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:30:50.080923+0000","last_undegraded":"2024-04-26T12:30:50.080923+0000","last_fullsized":"2024-04-26T12:30:50.080923+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:25.266771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":498,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081587+0000","last_change":"2024-04-26T12:30:42.154775+0000","last_active":"2024-04-26T12:30:50.081587+0000","last_peered":"2024-04-26T12:30:50.081587+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:30:42.152745+0000","last_became_peered":"2024-04-26T12:30:42.152745+0000","last_unstale":"2024-04-26T12:30:50.081587+0000","last_undegraded":"2024-04-26T12:30:42.035068+0000","last_fullsized":"2024-04-26T12:30:42.028082+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:45.201289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075773+0000","last_change":"2024-04-26T12:30:41.026049+0000","last_active":"2024-04-26T12:30:52.075773+0000","last_peered":"2024-04-26T12:30:52.075773+0000","last_clean":"2024-04-26T12:30:52.075773+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:30:52.075773+0000","last_undegraded":"2024-04-26T12:30:52.075773+0000","last_fullsized":"2024-04-26T12:30:52.075773+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.409817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"58'454","reported_seq":475,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076846+0000","last_change":"2024-04-26T12:30:46.079367+0000","last_active":"2024-04-26T12:30:54.076846+0000","last_peered":"2024-04-26T12:30:54.076846+0000","last_clean":"2024-04-26T12:30:54.076846+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:30:54.076846+0000","last_undegraded":"2024-04-26T12:30:54.076846+0000","last_fullsized":"2024-04-26T12:30:54.076846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:00.950370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":463,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080714+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:30:50.080714+0000","last_peered":"2024-04-26T12:30:50.080714+0000","last_clean":"2024-04-26T12:30:50.080714+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:30:50.080714+0000","last_undegraded":"2024-04-26T12:30:50.080714+0000","last_fullsized":"2024-04-26T12:30:50.080714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076309+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:30:54.076309+0000","last_peered":"2024-04-26T12:30:54.076309+0000","last_clean":"2024-04-26T12:30:54.076309+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:30:54.076309+0000","last_undegraded":"2024-04-26T12:30:54.076309+0000","last_fullsized":"2024-04-26T12:30:54.076309+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:16.686041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076322+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:54.076322+0000","last_peered":"2024-04-26T12:30:54.076322+0000","last_clean":"2024-04-26T12:30:54.076322+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:30:54.076322+0000","last_undegraded":"2024-04-26T12:30:54.076322+0000","last_fullsized":"2024-04-26T12:30:54.076322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:18.069937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":492,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075604+0000","last_change":"2024-04-26T12:30:46.033999+0000","last_active":"2024-04-26T12:30:52.075604+0000","last_peered":"2024-04-26T12:30:52.075604+0000","last_clean":"2024-04-26T12:30:52.075604+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:30:52.075604+0000","last_undegraded":"2024-04-26T12:30:52.075604+0000","last_fullsized":"2024-04-26T12:30:52.075604+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:33.235467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075182+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:30:52.075182+0000","last_peered":"2024-04-26T12:30:52.075182+0000","last_clean":"2024-04-26T12:30:52.075182+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:30:52.075182+0000","last_undegraded":"2024-04-26T12:30:52.075182+0000","last_fullsized":"2024-04-26T12:30:52.075182+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:20.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":388,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080466+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:30:50.080466+0000","last_peered":"2024-04-26T12:30:50.080466+0000","last_clean":"2024-04-26T12:30:50.080466+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:30:50.080466+0000","last_undegraded":"2024-04-26T12:30:50.080466+0000","last_fullsized":"2024-04-26T12:30:50.080466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":418,"reported_epoch":78,"state":"peering","last_fresh":"2024-04-26T12:30:53.076814+0000","last_change":"2024-04-26T12:30:53.076814+0000","last_active":"2024-04-26T12:30:41.011738+0000","last_peered":"2024-04-26T12:30:39.002765+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.669503+0000","last_became_peered":"2024-04-26T12:27:48.669503+0000","last_unstale":"2024-04-26T12:30:53.076814+0000","last_undegraded":"2024-04-26T12:30:53.076814+0000","last_fullsized":"2024-04-26T12:30:53.076814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:59.008757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076582+0000","last_change":"2024-04-26T12:30:46.082961+0000","last_active":"2024-04-26T12:30:54.076582+0000","last_peered":"2024-04-26T12:30:54.076582+0000","last_clean":"2024-04-26T12:30:54.076582+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:30:54.076582+0000","last_undegraded":"2024-04-26T12:30:54.076582+0000","last_fullsized":"2024-04-26T12:30:54.076582+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:10.764587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":258,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075901+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:30:54.075901+0000","last_peered":"2024-04-26T12:30:54.075901+0000","last_clean":"2024-04-26T12:30:54.075901+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:30:54.075901+0000","last_undegraded":"2024-04-26T12:30:54.075901+0000","last_fullsized":"2024-04-26T12:30:54.075901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:23.542209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":591,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075325+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:30:52.075325+0000","last_peered":"2024-04-26T12:30:52.075325+0000","last_clean":"2024-04-26T12:30:52.075325+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:30:52.075325+0000","last_undegraded":"2024-04-26T12:30:52.075325+0000","last_fullsized":"2024-04-26T12:30:52.075325+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:05.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":559,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076976+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:30:54.076976+0000","last_peered":"2024-04-26T12:30:54.076976+0000","last_clean":"2024-04-26T12:30:54.076976+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:30:54.076976+0000","last_undegraded":"2024-04-26T12:30:54.076976+0000","last_fullsized":"2024-04-26T12:30:54.076976+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075904+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:30:54.075904+0000","last_peered":"2024-04-26T12:30:54.075904+0000","last_clean":"2024-04-26T12:30:54.075904+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:30:54.075904+0000","last_undegraded":"2024-04-26T12:30:54.075904+0000","last_fullsized":"2024-04-26T12:30:54.075904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'105","reported_seq":215,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075351+0000","last_change":"2024-04-26T12:30:44.028851+0000","last_active":"2024-04-26T12:30:52.075351+0000","last_peered":"2024-04-26T12:30:52.075351+0000","last_clean":"2024-04-26T12:30:52.075351+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:30:52.075351+0000","last_undegraded":"2024-04-26T12:30:52.075351+0000","last_fullsized":"2024-04-26T12:30:52.075351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:13.939165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":572,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081988+0000","last_change":"2024-04-26T12:30:42.158989+0000","last_active":"2024-04-26T12:30:50.081988+0000","last_peered":"2024-04-26T12:30:50.081988+0000","last_clean":"2024-04-26T12:27:45.658919+0000","last_became_active":"2024-04-26T12:30:42.157001+0000","last_became_peered":"2024-04-26T12:30:42.157001+0000","last_unstale":"2024-04-26T12:30:50.081988+0000","last_undegraded":"2024-04-26T12:30:42.046089+0000","last_fullsized":"2024-04-26T12:30:42.041964+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:06.285978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":188,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081486+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:30:50.081486+0000","last_peered":"2024-04-26T12:30:50.081486+0000","last_clean":"2024-04-26T12:30:50.081486+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:30:50.081486+0000","last_undegraded":"2024-04-26T12:30:50.081486+0000","last_fullsized":"2024-04-26T12:30:50.081486+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:31.181549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075854+0000","last_change":"2024-04-26T12:30:41.026137+0000","last_active":"2024-04-26T12:30:52.075854+0000","last_peered":"2024-04-26T12:30:52.075854+0000","last_clean":"2024-04-26T12:30:52.075854+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:30:52.075854+0000","last_undegraded":"2024-04-26T12:30:52.075854+0000","last_fullsized":"2024-04-26T12:30:52.075854+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:08.225745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":510,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080733+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:30:50.080733+0000","last_peered":"2024-04-26T12:30:50.080733+0000","last_clean":"2024-04-26T12:30:50.080733+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:30:50.080733+0000","last_undegraded":"2024-04-26T12:30:50.080733+0000","last_fullsized":"2024-04-26T12:30:50.080733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":35,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075773+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:30:52.075773+0000","last_peered":"2024-04-26T12:30:52.075773+0000","last_clean":"2024-04-26T12:30:52.075773+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:30:52.075773+0000","last_undegraded":"2024-04-26T12:30:52.075773+0000","last_fullsized":"2024-04-26T12:30:52.075773+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:51.609322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075713+0000","last_change":"2024-04-26T12:30:41.030157+0000","last_active":"2024-04-26T12:30:52.075713+0000","last_peered":"2024-04-26T12:30:52.075713+0000","last_clean":"2024-04-26T12:30:52.075713+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:52.075713+0000","last_undegraded":"2024-04-26T12:30:52.075713+0000","last_fullsized":"2024-04-26T12:30:52.075713+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:32.867679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":514,"reported_epoch":75,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:50.080119+0000","last_change":"2024-04-26T12:30:47.084724+0000","last_active":"2024-04-26T12:30:50.080119+0000","last_peered":"2024-04-26T12:30:50.080119+0000","last_clean":"2024-04-26T12:30:39.001153+0000","last_became_active":"2024-04-26T12:30:47.083601+0000","last_became_peered":"2024-04-26T12:30:47.083601+0000","last_unstale":"2024-04-26T12:30:50.080119+0000","last_undegraded":"2024-04-26T12:30:50.080119+0000","last_fullsized":"2024-04-26T12:30:50.080119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:00.234562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":184,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076673+0000","last_change":"2024-04-26T12:30:46.080509+0000","last_active":"2024-04-26T12:30:54.076673+0000","last_peered":"2024-04-26T12:30:54.076673+0000","last_clean":"2024-04-26T12:30:54.076673+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:30:54.076673+0000","last_undegraded":"2024-04-26T12:30:54.076673+0000","last_fullsized":"2024-04-26T12:30:54.076673+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:40.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'82","reported_seq":54,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075920+0000","last_change":"2024-04-26T12:30:46.086027+0000","last_active":"2024-04-26T12:30:52.075920+0000","last_peered":"2024-04-26T12:30:52.075920+0000","last_clean":"2024-04-26T12:30:52.075920+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:30:52.075920+0000","last_undegraded":"2024-04-26T12:30:52.075920+0000","last_fullsized":"2024-04-26T12:30:52.075920+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:13.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":596,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081437+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:30:50.081437+0000","last_peered":"2024-04-26T12:30:50.081437+0000","last_clean":"2024-04-26T12:30:50.081437+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:30:50.081437+0000","last_undegraded":"2024-04-26T12:30:50.081437+0000","last_fullsized":"2024-04-26T12:30:50.081437+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":164,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080723+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:30:50.080723+0000","last_peered":"2024-04-26T12:30:50.080723+0000","last_clean":"2024-04-26T12:30:50.080723+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:30:50.080723+0000","last_undegraded":"2024-04-26T12:30:50.080723+0000","last_fullsized":"2024-04-26T12:30:50.080723+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.312112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":838,"reported_epoch":76,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:30:51.265782+0000","last_change":"2024-04-26T12:30:51.265921+0000","last_active":"2024-04-26T12:30:51.265782+0000","last_peered":"2024-04-26T12:30:51.265782+0000","last_clean":"2024-04-26T12:27:45.658753+0000","last_became_active":"2024-04-26T12:30:42.150170+0000","last_became_peered":"2024-04-26T12:30:42.150170+0000","last_unstale":"2024-04-26T12:30:51.265782+0000","last_undegraded":"2024-04-26T12:30:51.265782+0000","last_fullsized":"2024-04-26T12:30:42.029605+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:27.247271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076362+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:30:54.076362+0000","last_peered":"2024-04-26T12:30:54.076362+0000","last_clean":"2024-04-26T12:30:54.076362+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:30:54.076362+0000","last_undegraded":"2024-04-26T12:30:54.076362+0000","last_fullsized":"2024-04-26T12:30:54.076362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:43.044883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":793,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076256+0000","last_change":"2024-04-26T12:30:48.088039+0000","last_active":"2024-04-26T12:30:54.076256+0000","last_peered":"2024-04-26T12:30:54.076256+0000","last_clean":"2024-04-26T12:30:54.076256+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:30:54.076256+0000","last_undegraded":"2024-04-26T12:30:54.076256+0000","last_fullsized":"2024-04-26T12:30:54.076256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:03.967118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"58'314","reported_seq":386,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081227+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:30:50.081227+0000","last_peered":"2024-04-26T12:30:50.081227+0000","last_clean":"2024-04-26T12:30:50.081227+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:30:50.081227+0000","last_undegraded":"2024-04-26T12:30:50.081227+0000","last_fullsized":"2024-04-26T12:30:50.081227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":867,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076084+0000","last_change":"2024-04-26T12:30:52.079092+0000","last_active":"2024-04-26T12:30:54.076084+0000","last_peered":"2024-04-26T12:30:54.076084+0000","last_clean":"2024-04-26T12:30:54.076084+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:30:54.076084+0000","last_undegraded":"2024-04-26T12:30:54.076084+0000","last_fullsized":"2024-04-26T12:30:54.076084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:10.253347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"58'76","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075789+0000","last_change":"2024-04-26T12:30:41.050653+0000","last_active":"2024-04-26T12:30:52.075789+0000","last_peered":"2024-04-26T12:30:52.075789+0000","last_clean":"2024-04-26T12:30:52.075789+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:52.075789+0000","last_undegraded":"2024-04-26T12:30:52.075789+0000","last_fullsized":"2024-04-26T12:30:52.075789+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:17.874875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":537,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075764+0000","last_change":"2024-04-26T12:28:00.707724+0000","last_active":"2024-04-26T12:30:54.075764+0000","last_peered":"2024-04-26T12:30:54.075764+0000","last_clean":"2024-04-26T12:30:54.075764+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:30:54.075764+0000","last_undegraded":"2024-04-26T12:30:54.075764+0000","last_fullsized":"2024-04-26T12:30:54.075764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:20.384961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":45,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.076003+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:30:52.076003+0000","last_peered":"2024-04-26T12:30:52.076003+0000","last_clean":"2024-04-26T12:30:52.076003+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:30:52.076003+0000","last_undegraded":"2024-04-26T12:30:52.076003+0000","last_fullsized":"2024-04-26T12:30:52.076003+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:40.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":962,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076157+0000","last_change":"2024-04-26T12:30:51.076207+0000","last_active":"2024-04-26T12:30:54.076157+0000","last_peered":"2024-04-26T12:30:54.076157+0000","last_clean":"2024-04-26T12:30:54.076157+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:30:54.076157+0000","last_undegraded":"2024-04-26T12:30:54.076157+0000","last_fullsized":"2024-04-26T12:30:54.076157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:05.869282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":858,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076035+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:30:54.076035+0000","last_peered":"2024-04-26T12:30:54.076035+0000","last_clean":"2024-04-26T12:30:54.076035+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:30:54.076035+0000","last_undegraded":"2024-04-26T12:30:54.076035+0000","last_fullsized":"2024-04-26T12:30:54.076035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:50.433671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":514,"reported_epoch":78,"state":"peering","last_fresh":"2024-04-26T12:30:53.076275+0000","last_change":"2024-04-26T12:30:53.076275+0000","last_active":"2024-04-26T12:30:41.011793+0000","last_peered":"2024-04-26T12:30:39.001968+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.666218+0000","last_became_peered":"2024-04-26T12:27:48.666218+0000","last_unstale":"2024-04-26T12:30:53.076275+0000","last_undegraded":"2024-04-26T12:30:53.076275+0000","last_fullsized":"2024-04-26T12:30:53.076275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:11.913441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":619,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.080789+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:30:50.080789+0000","last_peered":"2024-04-26T12:30:50.080789+0000","last_clean":"2024-04-26T12:30:50.080789+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:30:50.080789+0000","last_undegraded":"2024-04-26T12:30:50.080789+0000","last_fullsized":"2024-04-26T12:30:50.080789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":508,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075431+0000","last_change":"2024-04-26T12:30:50.086765+0000","last_active":"2024-04-26T12:30:52.075431+0000","last_peered":"2024-04-26T12:30:52.075431+0000","last_clean":"2024-04-26T12:30:52.075431+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:30:52.075431+0000","last_undegraded":"2024-04-26T12:30:52.075431+0000","last_fullsized":"2024-04-26T12:30:52.075431+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:36.313767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":502,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-04-26T12:30:50.081508+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:30:50.081508+0000","last_peered":"2024-04-26T12:30:50.081508+0000","last_clean":"2024-04-26T12:30:50.081508+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:30:50.081508+0000","last_undegraded":"2024-04-26T12:30:50.081508+0000","last_fullsized":"2024-04-26T12:30:50.081508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1828,"num_objects_misplaced":893,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4348,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":117,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90275840,"data_stored":285809728,"data_compressed":42864631,"data_compressed_allocated":53944320,"data_compressed_original":249548800,"omap_allocated":5343,"internal_metadata":0},"log_size":7508,"ondisk_log_size":7508,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738421,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140900,"kb_used_data":41752,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94230940,"statfs":{"total":96636764160,"available":96492482560,"internally_reserved":0,"allocated":42754048,"data_stored":115105444,"data_compressed":16083079,"data_compressed_allocated":21016576,"data_compressed_original":93810688,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.41799999999999998,"15min":0.434},"min":{"1min":0.22500000000000001,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41399999999999998,"15min":0.42599999999999999},"min":{"1min":0.20799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52700000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.35099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113232,"kb_used_data":32128,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94258608,"statfs":{"total":96636764160,"available":96520814592,"internally_reserved":0,"allocated":32899072,"data_stored":91424707,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.317},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:30:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.30399999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.625,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.496},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.44600000000000001}]}]},{"osd":1,"up_from":64,"seq":274877906949,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78660,"kb_used_data":16688,"kb_used_omap":6,"kb_used_meta":61945,"kb_avail":94293180,"statfs":{"total":96636764160,"available":96556216320,"internally_reserved":0,"allocated":17088512,"data_stored":81517291,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":63431911},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41930752,"data_stored":114170599,"data_compressed":16048932,"data_compressed_allocated":20971520,"data_compressed_original":93237248,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:30:56.027 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T12:30:56.489 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:30:56.489 INFO:teuthology.orchestra.run.smithi046.stdout:{"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1828/110 objects degraded (1661.818%), 10 pgs degraded","count":10},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":259,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":81,"num_osds":3,"num_up_osds":3,"osd_up_since":1714134639,"num_in_osds":3,"osd_in_since":1714134397,"num_remapped_pgs":7},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":86},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":10},{"state_name":"active+recovery_wait+remapped","count":5},{"state_name":"peering","count":3},{"state_name":"active+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":128814877,"bytes_used":340779008,"bytes_avail":289569513472,"bytes_total":289910292480,"inactive_pgs_ratio":0.02857142873108387,"degraded_objects":1828,"degraded_total":110,"degraded_ratio":16.618181818181817,"misplaced_objects":893,"misplaced_total":110,"misplaced_ratio":8.1181818181818191,"recovering_objects_per_sec":235,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":944,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":14150}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-26T12:27:59.302941+0000","services":{}},"progress_events":{}} 2024-04-26T12:30:56.503 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T12:30:56.504 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:30:56.848 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:30:56.850 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:30:56.860 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-04-26T12:30:56.071333+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":929,"num_objects_misplaced":893,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5101,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34345,"ondisk_log_size":34345,"up":210,"acting":203,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":232,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":332828,"kb_used_data":90604,"kb_used_omap":9,"kb_used_meta":242166,"kb_avail":282782692,"statfs":{"total":289910292480,"available":289569476608,"internally_reserved":0,"allocated":92778496,"data_stored":288061531,"data_compressed":42932925,"data_compressed_allocated":54034432,"data_compressed_original":250695680,"omap_allocated":10125,"internal_metadata":247978099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1050,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":618,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.997420"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":895,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.086290+0000","last_change":"2024-04-26T12:30:54.081113+0000","last_active":"2024-04-26T12:30:54.086290+0000","last_peered":"2024-04-26T12:30:54.086290+0000","last_clean":"2024-04-26T12:30:54.086290+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:30:54.086290+0000","last_undegraded":"2024-04-26T12:30:54.086290+0000","last_fullsized":"2024-04-26T12:30:54.086290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.062347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":944,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-26T12:30:55.077802+0000","last_change":"2024-04-26T12:30:55.077898+0000","last_active":"2024-04-26T12:30:55.077802+0000","last_peered":"2024-04-26T12:30:54.110525+0000","last_clean":"2024-04-26T12:27:45.658708+0000","last_became_active":"2024-04-26T12:30:42.155649+0000","last_became_peered":"2024-04-26T12:30:42.155649+0000","last_unstale":"2024-04-26T12:30:55.077802+0000","last_undegraded":"2024-04-26T12:30:55.077802+0000","last_fullsized":"2024-04-26T12:30:55.077802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:44.815117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":490,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076853+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:30:54.076853+0000","last_peered":"2024-04-26T12:30:54.076853+0000","last_clean":"2024-04-26T12:30:54.076853+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:30:54.076853+0000","last_undegraded":"2024-04-26T12:30:54.076853+0000","last_fullsized":"2024-04-26T12:30:54.076853+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:55.616144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":862,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.078603+0000","last_change":"2024-04-26T12:30:48.089842+0000","last_active":"2024-04-26T12:30:55.078603+0000","last_peered":"2024-04-26T12:30:55.078603+0000","last_clean":"2024-04-26T12:30:55.078603+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:30:55.078603+0000","last_undegraded":"2024-04-26T12:30:55.078603+0000","last_fullsized":"2024-04-26T12:30:55.078603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:13.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":934,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075664+0000","last_change":"2024-04-26T12:30:48.089460+0000","last_active":"2024-04-26T12:30:54.075664+0000","last_peered":"2024-04-26T12:30:54.075664+0000","last_clean":"2024-04-26T12:30:54.075664+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:30:54.075664+0000","last_undegraded":"2024-04-26T12:30:54.075664+0000","last_fullsized":"2024-04-26T12:30:54.075664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":472,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075962+0000","last_change":"2024-04-26T12:30:48.090606+0000","last_active":"2024-04-26T12:30:54.075962+0000","last_peered":"2024-04-26T12:30:54.075962+0000","last_clean":"2024-04-26T12:30:54.075962+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:30:54.075962+0000","last_undegraded":"2024-04-26T12:30:54.075962+0000","last_fullsized":"2024-04-26T12:30:54.075962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:57.446858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1023,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076470+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:30:54.076470+0000","last_peered":"2024-04-26T12:30:54.076470+0000","last_clean":"2024-04-26T12:30:54.076470+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:30:54.076470+0000","last_undegraded":"2024-04-26T12:30:54.076470+0000","last_fullsized":"2024-04-26T12:30:54.076470+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:06.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":762,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075764+0000","last_change":"2024-04-26T12:30:49.082511+0000","last_active":"2024-04-26T12:30:54.075764+0000","last_peered":"2024-04-26T12:30:54.075764+0000","last_clean":"2024-04-26T12:30:54.075764+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:30:54.075764+0000","last_undegraded":"2024-04-26T12:30:54.075764+0000","last_fullsized":"2024-04-26T12:30:54.075764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:54.832086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":499,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081910+0000","last_change":"2024-04-26T12:30:42.158818+0000","last_active":"2024-04-26T12:30:50.081910+0000","last_peered":"2024-04-26T12:30:50.081910+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:30:42.157705+0000","last_became_peered":"2024-04-26T12:30:42.157705+0000","last_unstale":"2024-04-26T12:30:50.081910+0000","last_undegraded":"2024-04-26T12:30:42.043686+0000","last_fullsized":"2024-04-26T12:30:42.036742+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:45:54.251271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":182,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":899,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-26T12:30:55.078045+0000","last_change":"2024-04-26T12:30:55.078136+0000","last_active":"2024-04-26T12:30:55.078045+0000","last_peered":"2024-04-26T12:30:54.514835+0000","last_clean":"2024-04-26T12:27:45.658876+0000","last_became_active":"2024-04-26T12:30:42.156989+0000","last_became_peered":"2024-04-26T12:30:42.156989+0000","last_unstale":"2024-04-26T12:30:55.078045+0000","last_undegraded":"2024-04-26T12:30:55.078045+0000","last_fullsized":"2024-04-26T12:30:55.078045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:52.462411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":589,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076569+0000","last_change":"2024-04-26T12:30:50.085026+0000","last_active":"2024-04-26T12:30:54.076569+0000","last_peered":"2024-04-26T12:30:54.076569+0000","last_clean":"2024-04-26T12:30:54.076569+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:30:54.076569+0000","last_undegraded":"2024-04-26T12:30:54.076569+0000","last_fullsized":"2024-04-26T12:30:54.076569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:31.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":507,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075519+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:30:54.075519+0000","last_peered":"2024-04-26T12:30:54.075519+0000","last_clean":"2024-04-26T12:30:54.075519+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:30:54.075519+0000","last_undegraded":"2024-04-26T12:30:54.075519+0000","last_fullsized":"2024-04-26T12:30:54.075519+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":878,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075751+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:30:54.075751+0000","last_peered":"2024-04-26T12:30:54.075751+0000","last_clean":"2024-04-26T12:30:54.075751+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:30:54.075751+0000","last_undegraded":"2024-04-26T12:30:54.075751+0000","last_fullsized":"2024-04-26T12:30:54.075751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:00.467106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":515,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076440+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:30:54.076440+0000","last_peered":"2024-04-26T12:30:54.076440+0000","last_clean":"2024-04-26T12:30:54.076440+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:30:54.076440+0000","last_undegraded":"2024-04-26T12:30:54.076440+0000","last_fullsized":"2024-04-26T12:30:54.076440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":535,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075874+0000","last_change":"2024-04-26T12:30:47.080645+0000","last_active":"2024-04-26T12:30:54.075874+0000","last_peered":"2024-04-26T12:30:54.075874+0000","last_clean":"2024-04-26T12:30:54.075874+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:30:54.075874+0000","last_undegraded":"2024-04-26T12:30:54.075874+0000","last_fullsized":"2024-04-26T12:30:54.075874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:11.047331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":921,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075792+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:30:54.075792+0000","last_peered":"2024-04-26T12:30:54.075792+0000","last_clean":"2024-04-26T12:30:54.075792+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:30:54.075792+0000","last_undegraded":"2024-04-26T12:30:54.075792+0000","last_fullsized":"2024-04-26T12:30:54.075792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:18.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":493,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081779+0000","last_change":"2024-04-26T12:30:42.154835+0000","last_active":"2024-04-26T12:30:50.081779+0000","last_peered":"2024-04-26T12:30:50.081779+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:30:42.153333+0000","last_became_peered":"2024-04-26T12:30:42.153333+0000","last_unstale":"2024-04-26T12:30:50.081779+0000","last_undegraded":"2024-04-26T12:30:42.037452+0000","last_fullsized":"2024-04-26T12:30:42.029386+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:35.304869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":179,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":552,"reported_epoch":80,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T12:30:55.362795+0000","last_change":"2024-04-26T12:30:55.356468+0000","last_active":"2024-04-26T12:30:55.362795+0000","last_peered":"2024-04-26T12:30:55.362795+0000","last_clean":"2024-04-26T12:27:45.658959+0000","last_became_active":"2024-04-26T12:30:42.163023+0000","last_became_peered":"2024-04-26T12:30:42.163023+0000","last_unstale":"2024-04-26T12:30:55.362795+0000","last_undegraded":"2024-04-26T12:30:55.362795+0000","last_fullsized":"2024-04-26T12:30:42.044616+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:50.561555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":519,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075637+0000","last_change":"2024-04-26T12:30:51.076894+0000","last_active":"2024-04-26T12:30:52.075637+0000","last_peered":"2024-04-26T12:30:52.075637+0000","last_clean":"2024-04-26T12:30:52.075637+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:30:52.075637+0000","last_undegraded":"2024-04-26T12:30:52.075637+0000","last_fullsized":"2024-04-26T12:30:52.075637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:50.091007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1065,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076706+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:30:54.076706+0000","last_peered":"2024-04-26T12:30:54.076706+0000","last_clean":"2024-04-26T12:30:54.076706+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:30:54.076706+0000","last_undegraded":"2024-04-26T12:30:54.076706+0000","last_fullsized":"2024-04-26T12:30:54.076706+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:26.268194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":947,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076191+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:30:54.076191+0000","last_peered":"2024-04-26T12:30:54.076191+0000","last_clean":"2024-04-26T12:30:54.076191+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:30:54.076191+0000","last_undegraded":"2024-04-26T12:30:54.076191+0000","last_fullsized":"2024-04-26T12:30:54.076191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:12.535434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":575,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075781+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:30:54.075781+0000","last_peered":"2024-04-26T12:30:54.075781+0000","last_clean":"2024-04-26T12:30:54.075781+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:30:54.075781+0000","last_undegraded":"2024-04-26T12:30:54.075781+0000","last_fullsized":"2024-04-26T12:30:54.075781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":514,"reported_epoch":79,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:54.075270+0000","last_change":"2024-04-26T12:30:47.082934+0000","last_active":"2024-04-26T12:30:54.075270+0000","last_peered":"2024-04-26T12:30:54.075270+0000","last_clean":"2024-04-26T12:30:39.001294+0000","last_became_active":"2024-04-26T12:30:47.081126+0000","last_became_peered":"2024-04-26T12:30:47.081126+0000","last_unstale":"2024-04-26T12:30:54.075270+0000","last_undegraded":"2024-04-26T12:30:54.075270+0000","last_fullsized":"2024-04-26T12:30:54.075270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:47.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":179,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":610,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:54.076689+0000","last_change":"2024-04-26T12:30:42.168459+0000","last_active":"2024-04-26T12:30:54.076689+0000","last_peered":"2024-04-26T12:30:54.076689+0000","last_clean":"2024-04-26T12:27:45.658199+0000","last_became_active":"2024-04-26T12:30:42.163138+0000","last_became_peered":"2024-04-26T12:30:42.163138+0000","last_unstale":"2024-04-26T12:30:54.076689+0000","last_undegraded":"2024-04-26T12:30:42.014270+0000","last_fullsized":"2024-04-26T12:30:42.005688+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:33.001689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":543,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.077149+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:30:54.077149+0000","last_peered":"2024-04-26T12:30:54.077149+0000","last_clean":"2024-04-26T12:30:54.077149+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:30:54.077149+0000","last_undegraded":"2024-04-26T12:30:54.077149+0000","last_fullsized":"2024-04-26T12:30:54.077149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":578,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075968+0000","last_change":"2024-04-26T12:30:46.089997+0000","last_active":"2024-04-26T12:30:52.075968+0000","last_peered":"2024-04-26T12:30:52.075968+0000","last_clean":"2024-04-26T12:30:52.075968+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:30:52.075968+0000","last_undegraded":"2024-04-26T12:30:52.075968+0000","last_fullsized":"2024-04-26T12:30:52.075968+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:08.843126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":508,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076720+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:30:54.076720+0000","last_peered":"2024-04-26T12:30:54.076720+0000","last_clean":"2024-04-26T12:30:54.076720+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:30:54.076720+0000","last_undegraded":"2024-04-26T12:30:54.076720+0000","last_fullsized":"2024-04-26T12:30:54.076720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":562,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075734+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:30:54.075734+0000","last_peered":"2024-04-26T12:30:54.075734+0000","last_clean":"2024-04-26T12:30:54.075734+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:30:54.075734+0000","last_undegraded":"2024-04-26T12:30:54.075734+0000","last_fullsized":"2024-04-26T12:30:54.075734+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:21.302173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":477,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076616+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:30:54.076616+0000","last_peered":"2024-04-26T12:30:54.076616+0000","last_clean":"2024-04-26T12:30:54.076616+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:30:54.076616+0000","last_undegraded":"2024-04-26T12:30:54.076616+0000","last_fullsized":"2024-04-26T12:30:54.076616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":403,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075077+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:30:52.075077+0000","last_peered":"2024-04-26T12:30:52.075077+0000","last_clean":"2024-04-26T12:30:52.075077+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:30:52.075077+0000","last_undegraded":"2024-04-26T12:30:52.075077+0000","last_fullsized":"2024-04-26T12:30:52.075077+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.762427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":493,"reported_epoch":79,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:54.075997+0000","last_change":"2024-04-26T12:30:47.080820+0000","last_active":"2024-04-26T12:30:54.075997+0000","last_peered":"2024-04-26T12:30:54.075997+0000","last_clean":"2024-04-26T12:30:39.002004+0000","last_became_active":"2024-04-26T12:30:47.079644+0000","last_became_peered":"2024-04-26T12:30:47.079644+0000","last_unstale":"2024-04-26T12:30:54.075997+0000","last_undegraded":"2024-04-26T12:30:54.075997+0000","last_fullsized":"2024-04-26T12:30:54.075997+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:52.807804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":167,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"58'708","reported_seq":771,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.074970+0000","last_change":"2024-04-26T12:30:44.022038+0000","last_active":"2024-04-26T12:30:52.074970+0000","last_peered":"2024-04-26T12:30:52.074970+0000","last_clean":"2024-04-26T12:30:52.074970+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:30:52.074970+0000","last_undegraded":"2024-04-26T12:30:52.074970+0000","last_fullsized":"2024-04-26T12:30:52.074970+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:30.369118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":494,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.077110+0000","last_change":"2024-04-26T12:30:47.081417+0000","last_active":"2024-04-26T12:30:54.077110+0000","last_peered":"2024-04-26T12:30:54.077110+0000","last_clean":"2024-04-26T12:30:54.077110+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:30:54.077110+0000","last_undegraded":"2024-04-26T12:30:54.077110+0000","last_fullsized":"2024-04-26T12:30:54.077110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:17.628933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075927+0000","last_change":"2024-04-26T12:30:41.018067+0000","last_active":"2024-04-26T12:30:52.075927+0000","last_peered":"2024-04-26T12:30:52.075927+0000","last_clean":"2024-04-26T12:30:52.075927+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:30:52.075927+0000","last_undegraded":"2024-04-26T12:30:52.075927+0000","last_fullsized":"2024-04-26T12:30:52.075927+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:33.684743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":601,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:54.075985+0000","last_change":"2024-04-26T12:30:42.170928+0000","last_active":"2024-04-26T12:30:54.075985+0000","last_peered":"2024-04-26T12:30:54.075985+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:30:42.168445+0000","last_became_peered":"2024-04-26T12:30:42.168445+0000","last_unstale":"2024-04-26T12:30:54.075985+0000","last_undegraded":"2024-04-26T12:30:42.048666+0000","last_fullsized":"2024-04-26T12:30:42.040503+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:27.519673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":200,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"58'355","reported_seq":372,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076603+0000","last_change":"2024-04-26T12:30:48.086933+0000","last_active":"2024-04-26T12:30:54.076603+0000","last_peered":"2024-04-26T12:30:54.076603+0000","last_clean":"2024-04-26T12:30:54.076603+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:30:54.076603+0000","last_undegraded":"2024-04-26T12:30:54.076603+0000","last_fullsized":"2024-04-26T12:30:54.076603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:49.737283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":713,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075022+0000","last_change":"2024-04-26T12:30:46.034642+0000","last_active":"2024-04-26T12:30:52.075022+0000","last_peered":"2024-04-26T12:30:52.075022+0000","last_clean":"2024-04-26T12:30:52.075022+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:30:52.075022+0000","last_undegraded":"2024-04-26T12:30:52.075022+0000","last_fullsized":"2024-04-26T12:30:52.075022+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.961343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":162,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076632+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:30:54.076632+0000","last_peered":"2024-04-26T12:30:54.076632+0000","last_clean":"2024-04-26T12:30:54.076632+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:30:54.076632+0000","last_undegraded":"2024-04-26T12:30:54.076632+0000","last_fullsized":"2024-04-26T12:30:54.076632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":504,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075279+0000","last_change":"2024-04-26T12:30:45.022716+0000","last_active":"2024-04-26T12:30:52.075279+0000","last_peered":"2024-04-26T12:30:52.075279+0000","last_clean":"2024-04-26T12:30:52.075279+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:30:52.075279+0000","last_undegraded":"2024-04-26T12:30:52.075279+0000","last_fullsized":"2024-04-26T12:30:52.075279+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:01.269901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'374","reported_seq":434,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076492+0000","last_change":"2024-04-26T12:30:46.079618+0000","last_active":"2024-04-26T12:30:54.076492+0000","last_peered":"2024-04-26T12:30:54.076492+0000","last_clean":"2024-04-26T12:30:54.076492+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:30:54.076492+0000","last_undegraded":"2024-04-26T12:30:54.076492+0000","last_fullsized":"2024-04-26T12:30:54.076492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:48.209628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":501,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076690+0000","last_change":"2024-04-26T12:30:47.082596+0000","last_active":"2024-04-26T12:30:54.076690+0000","last_peered":"2024-04-26T12:30:54.076690+0000","last_clean":"2024-04-26T12:30:54.076690+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:30:54.076690+0000","last_undegraded":"2024-04-26T12:30:54.076690+0000","last_fullsized":"2024-04-26T12:30:54.076690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:34.688913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":643,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076568+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:30:54.076568+0000","last_peered":"2024-04-26T12:30:54.076568+0000","last_clean":"2024-04-26T12:30:54.076568+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:30:54.076568+0000","last_undegraded":"2024-04-26T12:30:54.076568+0000","last_fullsized":"2024-04-26T12:30:54.076568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:50.674218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":789,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075625+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:30:54.075625+0000","last_peered":"2024-04-26T12:30:54.075625+0000","last_clean":"2024-04-26T12:30:54.075625+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:30:54.075625+0000","last_undegraded":"2024-04-26T12:30:54.075625+0000","last_fullsized":"2024-04-26T12:30:54.075625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:11.548975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075120+0000","last_change":"2024-04-26T12:30:46.089052+0000","last_active":"2024-04-26T12:30:52.075120+0000","last_peered":"2024-04-26T12:30:52.075120+0000","last_clean":"2024-04-26T12:30:52.075120+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:30:52.075120+0000","last_undegraded":"2024-04-26T12:30:52.075120+0000","last_fullsized":"2024-04-26T12:30:52.075120+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:28.433853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":855,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076324+0000","last_change":"2024-04-26T12:30:50.086492+0000","last_active":"2024-04-26T12:30:54.076324+0000","last_peered":"2024-04-26T12:30:54.076324+0000","last_clean":"2024-04-26T12:30:54.076324+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:30:54.076324+0000","last_undegraded":"2024-04-26T12:30:54.076324+0000","last_fullsized":"2024-04-26T12:30:54.076324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:18.705037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075615+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:30:54.075615+0000","last_peered":"2024-04-26T12:30:54.075615+0000","last_clean":"2024-04-26T12:30:54.075615+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:30:54.075615+0000","last_undegraded":"2024-04-26T12:30:54.075615+0000","last_fullsized":"2024-04-26T12:30:54.075615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":518,"reported_epoch":80,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:55.077153+0000","last_change":"2024-04-26T12:30:47.081736+0000","last_active":"2024-04-26T12:30:55.077153+0000","last_peered":"2024-04-26T12:30:55.077153+0000","last_clean":"2024-04-26T12:30:39.001966+0000","last_became_active":"2024-04-26T12:30:47.079760+0000","last_became_peered":"2024-04-26T12:30:47.079760+0000","last_unstale":"2024-04-26T12:30:55.077153+0000","last_undegraded":"2024-04-26T12:30:55.077153+0000","last_fullsized":"2024-04-26T12:30:55.077153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:49.432476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":190,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"59'54","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076213+0000","last_change":"2024-04-26T12:30:46.082166+0000","last_active":"2024-04-26T12:30:54.076213+0000","last_peered":"2024-04-26T12:30:54.076213+0000","last_clean":"2024-04-26T12:30:54.076213+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:30:54.076213+0000","last_undegraded":"2024-04-26T12:30:54.076213+0000","last_fullsized":"2024-04-26T12:30:54.076213+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:28.037535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":556,"reported_epoch":80,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:55.077224+0000","last_change":"2024-04-26T12:30:47.081110+0000","last_active":"2024-04-26T12:30:55.077224+0000","last_peered":"2024-04-26T12:30:55.077224+0000","last_clean":"2024-04-26T12:30:39.002391+0000","last_became_active":"2024-04-26T12:30:47.079796+0000","last_became_peered":"2024-04-26T12:30:47.079796+0000","last_unstale":"2024-04-26T12:30:55.077224+0000","last_undegraded":"2024-04-26T12:30:55.077224+0000","last_fullsized":"2024-04-26T12:30:55.077224+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:20.060030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":173,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"58'186","reported_seq":204,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076622+0000","last_change":"2024-04-26T12:30:46.080074+0000","last_active":"2024-04-26T12:30:54.076622+0000","last_peered":"2024-04-26T12:30:54.076622+0000","last_clean":"2024-04-26T12:30:54.076622+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:30:54.076622+0000","last_undegraded":"2024-04-26T12:30:54.076622+0000","last_fullsized":"2024-04-26T12:30:54.076622+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:24.562647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":526,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075238+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:30:54.075238+0000","last_peered":"2024-04-26T12:30:54.075238+0000","last_clean":"2024-04-26T12:30:54.075238+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:30:54.075238+0000","last_undegraded":"2024-04-26T12:30:54.075238+0000","last_fullsized":"2024-04-26T12:30:54.075238+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":435,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076300+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:30:54.076300+0000","last_peered":"2024-04-26T12:30:54.076300+0000","last_clean":"2024-04-26T12:30:54.076300+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:30:54.076300+0000","last_undegraded":"2024-04-26T12:30:54.076300+0000","last_fullsized":"2024-04-26T12:30:54.076300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:40.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":971,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075907+0000","last_change":"2024-04-26T12:30:52.078990+0000","last_active":"2024-04-26T12:30:54.075907+0000","last_peered":"2024-04-26T12:30:54.075907+0000","last_clean":"2024-04-26T12:30:54.075907+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:30:54.075907+0000","last_undegraded":"2024-04-26T12:30:54.075907+0000","last_fullsized":"2024-04-26T12:30:54.075907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.697122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":509,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076714+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:30:54.076714+0000","last_peered":"2024-04-26T12:30:54.076714+0000","last_clean":"2024-04-26T12:30:54.076714+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:30:54.076714+0000","last_undegraded":"2024-04-26T12:30:54.076714+0000","last_fullsized":"2024-04-26T12:30:54.076714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:18.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":486,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076194+0000","last_change":"2024-04-26T12:30:48.089200+0000","last_active":"2024-04-26T12:30:54.076194+0000","last_peered":"2024-04-26T12:30:54.076194+0000","last_clean":"2024-04-26T12:30:54.076194+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:30:54.076194+0000","last_undegraded":"2024-04-26T12:30:54.076194+0000","last_fullsized":"2024-04-26T12:30:54.076194+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:04.588329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076209+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:54.076209+0000","last_peered":"2024-04-26T12:30:54.076209+0000","last_clean":"2024-04-26T12:30:54.076209+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:30:54.076209+0000","last_undegraded":"2024-04-26T12:30:54.076209+0000","last_fullsized":"2024-04-26T12:30:54.076209+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:40.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":552,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075256+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:30:52.075256+0000","last_peered":"2024-04-26T12:30:52.075256+0000","last_clean":"2024-04-26T12:30:52.075256+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:30:52.075256+0000","last_undegraded":"2024-04-26T12:30:52.075256+0000","last_fullsized":"2024-04-26T12:30:52.075256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.230823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":245,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075103+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:30:52.075103+0000","last_peered":"2024-04-26T12:30:52.075103+0000","last_clean":"2024-04-26T12:30:52.075103+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:30:52.075103+0000","last_undegraded":"2024-04-26T12:30:52.075103+0000","last_fullsized":"2024-04-26T12:30:52.075103+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:30.864621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":532,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076248+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:30:54.076248+0000","last_peered":"2024-04-26T12:30:54.076248+0000","last_clean":"2024-04-26T12:30:54.076248+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:30:54.076248+0000","last_undegraded":"2024-04-26T12:30:54.076248+0000","last_fullsized":"2024-04-26T12:30:54.076248+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:13.427584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076054+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:30:54.076054+0000","last_peered":"2024-04-26T12:30:54.076054+0000","last_clean":"2024-04-26T12:30:54.076054+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:30:54.076054+0000","last_undegraded":"2024-04-26T12:30:54.076054+0000","last_fullsized":"2024-04-26T12:30:54.076054+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:16.260550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":478,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076963+0000","last_change":"2024-04-26T12:30:47.083054+0000","last_active":"2024-04-26T12:30:54.076963+0000","last_peered":"2024-04-26T12:30:54.076963+0000","last_clean":"2024-04-26T12:30:54.076963+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:30:54.076963+0000","last_undegraded":"2024-04-26T12:30:54.076963+0000","last_fullsized":"2024-04-26T12:30:54.076963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.645638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":157,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075339+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:30:54.075339+0000","last_peered":"2024-04-26T12:30:54.075339+0000","last_clean":"2024-04-26T12:30:54.075339+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:30:54.075339+0000","last_undegraded":"2024-04-26T12:30:54.075339+0000","last_fullsized":"2024-04-26T12:30:54.075339+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:20.988072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":487,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076864+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:30:54.076864+0000","last_peered":"2024-04-26T12:30:54.076864+0000","last_clean":"2024-04-26T12:30:54.076864+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:30:54.076864+0000","last_undegraded":"2024-04-26T12:30:54.076864+0000","last_fullsized":"2024-04-26T12:30:54.076864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":583,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076124+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:30:54.076124+0000","last_peered":"2024-04-26T12:30:54.076124+0000","last_clean":"2024-04-26T12:30:54.076124+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:30:54.076124+0000","last_undegraded":"2024-04-26T12:30:54.076124+0000","last_fullsized":"2024-04-26T12:30:54.076124+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:25.266771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":498,"reported_epoch":75,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:50.081587+0000","last_change":"2024-04-26T12:30:42.154775+0000","last_active":"2024-04-26T12:30:50.081587+0000","last_peered":"2024-04-26T12:30:50.081587+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:30:42.152745+0000","last_became_peered":"2024-04-26T12:30:42.152745+0000","last_unstale":"2024-04-26T12:30:50.081587+0000","last_undegraded":"2024-04-26T12:30:42.035068+0000","last_fullsized":"2024-04-26T12:30:42.028082+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:45.201289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":172,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075773+0000","last_change":"2024-04-26T12:30:41.026049+0000","last_active":"2024-04-26T12:30:52.075773+0000","last_peered":"2024-04-26T12:30:52.075773+0000","last_clean":"2024-04-26T12:30:52.075773+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:30:52.075773+0000","last_undegraded":"2024-04-26T12:30:52.075773+0000","last_fullsized":"2024-04-26T12:30:52.075773+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.409817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"58'454","reported_seq":475,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076846+0000","last_change":"2024-04-26T12:30:46.079367+0000","last_active":"2024-04-26T12:30:54.076846+0000","last_peered":"2024-04-26T12:30:54.076846+0000","last_clean":"2024-04-26T12:30:54.076846+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:30:54.076846+0000","last_undegraded":"2024-04-26T12:30:54.076846+0000","last_fullsized":"2024-04-26T12:30:54.076846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:00.950370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":467,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075820+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:30:54.075820+0000","last_peered":"2024-04-26T12:30:54.075820+0000","last_clean":"2024-04-26T12:30:54.075820+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:30:54.075820+0000","last_undegraded":"2024-04-26T12:30:54.075820+0000","last_fullsized":"2024-04-26T12:30:54.075820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076309+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:30:54.076309+0000","last_peered":"2024-04-26T12:30:54.076309+0000","last_clean":"2024-04-26T12:30:54.076309+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:30:54.076309+0000","last_undegraded":"2024-04-26T12:30:54.076309+0000","last_fullsized":"2024-04-26T12:30:54.076309+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:16.686041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076322+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:54.076322+0000","last_peered":"2024-04-26T12:30:54.076322+0000","last_clean":"2024-04-26T12:30:54.076322+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:30:54.076322+0000","last_undegraded":"2024-04-26T12:30:54.076322+0000","last_fullsized":"2024-04-26T12:30:54.076322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:18.069937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":492,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075604+0000","last_change":"2024-04-26T12:30:46.033999+0000","last_active":"2024-04-26T12:30:52.075604+0000","last_peered":"2024-04-26T12:30:52.075604+0000","last_clean":"2024-04-26T12:30:52.075604+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:30:52.075604+0000","last_undegraded":"2024-04-26T12:30:52.075604+0000","last_fullsized":"2024-04-26T12:30:52.075604+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:33.235467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075182+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:30:52.075182+0000","last_peered":"2024-04-26T12:30:52.075182+0000","last_clean":"2024-04-26T12:30:52.075182+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:30:52.075182+0000","last_undegraded":"2024-04-26T12:30:52.075182+0000","last_fullsized":"2024-04-26T12:30:52.075182+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:20.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":393,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.076477+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:30:55.076477+0000","last_peered":"2024-04-26T12:30:55.076477+0000","last_clean":"2024-04-26T12:30:55.076477+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:30:55.076477+0000","last_undegraded":"2024-04-26T12:30:55.076477+0000","last_fullsized":"2024-04-26T12:30:55.076477+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":418,"reported_epoch":78,"state":"peering","last_fresh":"2024-04-26T12:30:53.076814+0000","last_change":"2024-04-26T12:30:53.076814+0000","last_active":"2024-04-26T12:30:41.011738+0000","last_peered":"2024-04-26T12:30:39.002765+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.669503+0000","last_became_peered":"2024-04-26T12:27:48.669503+0000","last_unstale":"2024-04-26T12:30:53.076814+0000","last_undegraded":"2024-04-26T12:30:53.076814+0000","last_fullsized":"2024-04-26T12:30:53.076814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:59.008757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076582+0000","last_change":"2024-04-26T12:30:46.082961+0000","last_active":"2024-04-26T12:30:54.076582+0000","last_peered":"2024-04-26T12:30:54.076582+0000","last_clean":"2024-04-26T12:30:54.076582+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:30:54.076582+0000","last_undegraded":"2024-04-26T12:30:54.076582+0000","last_fullsized":"2024-04-26T12:30:54.076582+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:10.764587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":258,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075901+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:30:54.075901+0000","last_peered":"2024-04-26T12:30:54.075901+0000","last_clean":"2024-04-26T12:30:54.075901+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:30:54.075901+0000","last_undegraded":"2024-04-26T12:30:54.075901+0000","last_fullsized":"2024-04-26T12:30:54.075901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:23.542209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":591,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075325+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:30:52.075325+0000","last_peered":"2024-04-26T12:30:52.075325+0000","last_clean":"2024-04-26T12:30:52.075325+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:30:52.075325+0000","last_undegraded":"2024-04-26T12:30:52.075325+0000","last_fullsized":"2024-04-26T12:30:52.075325+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:05.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":559,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076976+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:30:54.076976+0000","last_peered":"2024-04-26T12:30:54.076976+0000","last_clean":"2024-04-26T12:30:54.076976+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:30:54.076976+0000","last_undegraded":"2024-04-26T12:30:54.076976+0000","last_fullsized":"2024-04-26T12:30:54.076976+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075904+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:30:54.075904+0000","last_peered":"2024-04-26T12:30:54.075904+0000","last_clean":"2024-04-26T12:30:54.075904+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:30:54.075904+0000","last_undegraded":"2024-04-26T12:30:54.075904+0000","last_fullsized":"2024-04-26T12:30:54.075904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'105","reported_seq":215,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075351+0000","last_change":"2024-04-26T12:30:44.028851+0000","last_active":"2024-04-26T12:30:52.075351+0000","last_peered":"2024-04-26T12:30:52.075351+0000","last_clean":"2024-04-26T12:30:52.075351+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:30:52.075351+0000","last_undegraded":"2024-04-26T12:30:52.075351+0000","last_fullsized":"2024-04-26T12:30:52.075351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:13.939165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":954,"reported_epoch":80,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:30:55.354831+0000","last_change":"2024-04-26T12:30:55.355011+0000","last_active":"2024-04-26T12:30:55.354831+0000","last_peered":"2024-04-26T12:30:55.354831+0000","last_clean":"2024-04-26T12:27:45.658919+0000","last_became_active":"2024-04-26T12:30:42.157001+0000","last_became_peered":"2024-04-26T12:30:42.157001+0000","last_unstale":"2024-04-26T12:30:55.354831+0000","last_undegraded":"2024-04-26T12:30:55.354831+0000","last_fullsized":"2024-04-26T12:30:42.041964+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:06.285978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076790+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:30:54.076790+0000","last_peered":"2024-04-26T12:30:54.076790+0000","last_clean":"2024-04-26T12:30:54.076790+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:30:54.076790+0000","last_undegraded":"2024-04-26T12:30:54.076790+0000","last_fullsized":"2024-04-26T12:30:54.076790+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:31.181549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075854+0000","last_change":"2024-04-26T12:30:41.026137+0000","last_active":"2024-04-26T12:30:52.075854+0000","last_peered":"2024-04-26T12:30:52.075854+0000","last_clean":"2024-04-26T12:30:52.075854+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:30:52.075854+0000","last_undegraded":"2024-04-26T12:30:52.075854+0000","last_fullsized":"2024-04-26T12:30:52.075854+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:08.225745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":514,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075635+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:30:54.075635+0000","last_peered":"2024-04-26T12:30:54.075635+0000","last_clean":"2024-04-26T12:30:54.075635+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:30:54.075635+0000","last_undegraded":"2024-04-26T12:30:54.075635+0000","last_fullsized":"2024-04-26T12:30:54.075635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":35,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075773+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:30:52.075773+0000","last_peered":"2024-04-26T12:30:52.075773+0000","last_clean":"2024-04-26T12:30:52.075773+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:30:52.075773+0000","last_undegraded":"2024-04-26T12:30:52.075773+0000","last_fullsized":"2024-04-26T12:30:52.075773+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:51.609322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075713+0000","last_change":"2024-04-26T12:30:41.030157+0000","last_active":"2024-04-26T12:30:52.075713+0000","last_peered":"2024-04-26T12:30:52.075713+0000","last_clean":"2024-04-26T12:30:52.075713+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:52.075713+0000","last_undegraded":"2024-04-26T12:30:52.075713+0000","last_fullsized":"2024-04-26T12:30:52.075713+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:32.867679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":518,"reported_epoch":79,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:54.075180+0000","last_change":"2024-04-26T12:30:47.084724+0000","last_active":"2024-04-26T12:30:54.075180+0000","last_peered":"2024-04-26T12:30:54.075180+0000","last_clean":"2024-04-26T12:30:39.001153+0000","last_became_active":"2024-04-26T12:30:47.083601+0000","last_became_peered":"2024-04-26T12:30:47.083601+0000","last_unstale":"2024-04-26T12:30:54.075180+0000","last_undegraded":"2024-04-26T12:30:54.075180+0000","last_fullsized":"2024-04-26T12:30:54.075180+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:00.234562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":184,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076673+0000","last_change":"2024-04-26T12:30:46.080509+0000","last_active":"2024-04-26T12:30:54.076673+0000","last_peered":"2024-04-26T12:30:54.076673+0000","last_clean":"2024-04-26T12:30:54.076673+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:30:54.076673+0000","last_undegraded":"2024-04-26T12:30:54.076673+0000","last_fullsized":"2024-04-26T12:30:54.076673+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:40.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'82","reported_seq":54,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075920+0000","last_change":"2024-04-26T12:30:46.086027+0000","last_active":"2024-04-26T12:30:52.075920+0000","last_peered":"2024-04-26T12:30:52.075920+0000","last_clean":"2024-04-26T12:30:52.075920+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:30:52.075920+0000","last_undegraded":"2024-04-26T12:30:52.075920+0000","last_fullsized":"2024-04-26T12:30:52.075920+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:13.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":600,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075626+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:30:54.075626+0000","last_peered":"2024-04-26T12:30:54.075626+0000","last_clean":"2024-04-26T12:30:54.075626+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:30:54.075626+0000","last_undegraded":"2024-04-26T12:30:54.075626+0000","last_fullsized":"2024-04-26T12:30:54.075626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":168,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075750+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:30:54.075750+0000","last_peered":"2024-04-26T12:30:54.075750+0000","last_clean":"2024-04-26T12:30:54.075750+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:30:54.075750+0000","last_undegraded":"2024-04-26T12:30:54.075750+0000","last_fullsized":"2024-04-26T12:30:54.075750+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.312112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":850,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075851+0000","last_change":"2024-04-26T12:30:53.079043+0000","last_active":"2024-04-26T12:30:54.075851+0000","last_peered":"2024-04-26T12:30:54.075851+0000","last_clean":"2024-04-26T12:30:54.075851+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:30:54.075851+0000","last_undegraded":"2024-04-26T12:30:54.075851+0000","last_fullsized":"2024-04-26T12:30:54.075851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:00.091756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076362+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:30:54.076362+0000","last_peered":"2024-04-26T12:30:54.076362+0000","last_clean":"2024-04-26T12:30:54.076362+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:30:54.076362+0000","last_undegraded":"2024-04-26T12:30:54.076362+0000","last_fullsized":"2024-04-26T12:30:54.076362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:43.044883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":793,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076256+0000","last_change":"2024-04-26T12:30:48.088039+0000","last_active":"2024-04-26T12:30:54.076256+0000","last_peered":"2024-04-26T12:30:54.076256+0000","last_clean":"2024-04-26T12:30:54.076256+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:30:54.076256+0000","last_undegraded":"2024-04-26T12:30:54.076256+0000","last_fullsized":"2024-04-26T12:30:54.076256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:03.967118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"58'314","reported_seq":390,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076238+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:30:54.076238+0000","last_peered":"2024-04-26T12:30:54.076238+0000","last_clean":"2024-04-26T12:30:54.076238+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:30:54.076238+0000","last_undegraded":"2024-04-26T12:30:54.076238+0000","last_fullsized":"2024-04-26T12:30:54.076238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":867,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076084+0000","last_change":"2024-04-26T12:30:52.079092+0000","last_active":"2024-04-26T12:30:54.076084+0000","last_peered":"2024-04-26T12:30:54.076084+0000","last_clean":"2024-04-26T12:30:54.076084+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:30:54.076084+0000","last_undegraded":"2024-04-26T12:30:54.076084+0000","last_fullsized":"2024-04-26T12:30:54.076084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:10.253347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"58'76","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075789+0000","last_change":"2024-04-26T12:30:41.050653+0000","last_active":"2024-04-26T12:30:52.075789+0000","last_peered":"2024-04-26T12:30:52.075789+0000","last_clean":"2024-04-26T12:30:52.075789+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:52.075789+0000","last_undegraded":"2024-04-26T12:30:52.075789+0000","last_fullsized":"2024-04-26T12:30:52.075789+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:17.874875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":537,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075764+0000","last_change":"2024-04-26T12:28:00.707724+0000","last_active":"2024-04-26T12:30:54.075764+0000","last_peered":"2024-04-26T12:30:54.075764+0000","last_clean":"2024-04-26T12:30:54.075764+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:30:54.075764+0000","last_undegraded":"2024-04-26T12:30:54.075764+0000","last_fullsized":"2024-04-26T12:30:54.075764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:20.384961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":45,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.076003+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:30:52.076003+0000","last_peered":"2024-04-26T12:30:52.076003+0000","last_clean":"2024-04-26T12:30:52.076003+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:30:52.076003+0000","last_undegraded":"2024-04-26T12:30:52.076003+0000","last_fullsized":"2024-04-26T12:30:52.076003+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:40.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":962,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076157+0000","last_change":"2024-04-26T12:30:51.076207+0000","last_active":"2024-04-26T12:30:54.076157+0000","last_peered":"2024-04-26T12:30:54.076157+0000","last_clean":"2024-04-26T12:30:54.076157+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:30:54.076157+0000","last_undegraded":"2024-04-26T12:30:54.076157+0000","last_fullsized":"2024-04-26T12:30:54.076157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:05.869282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":858,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076035+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:30:54.076035+0000","last_peered":"2024-04-26T12:30:54.076035+0000","last_clean":"2024-04-26T12:30:54.076035+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:30:54.076035+0000","last_undegraded":"2024-04-26T12:30:54.076035+0000","last_fullsized":"2024-04-26T12:30:54.076035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:50.433671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":514,"reported_epoch":78,"state":"peering","last_fresh":"2024-04-26T12:30:53.076275+0000","last_change":"2024-04-26T12:30:53.076275+0000","last_active":"2024-04-26T12:30:41.011793+0000","last_peered":"2024-04-26T12:30:39.001968+0000","last_clean":"2024-04-26T12:26:52.819811+0000","last_became_active":"2024-04-26T12:27:48.666218+0000","last_became_peered":"2024-04-26T12:27:48.666218+0000","last_unstale":"2024-04-26T12:30:53.076275+0000","last_undegraded":"2024-04-26T12:30:53.076275+0000","last_fullsized":"2024-04-26T12:30:53.076275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:11.913441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":623,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075891+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:30:54.075891+0000","last_peered":"2024-04-26T12:30:54.075891+0000","last_clean":"2024-04-26T12:30:54.075891+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:30:54.075891+0000","last_undegraded":"2024-04-26T12:30:54.075891+0000","last_fullsized":"2024-04-26T12:30:54.075891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":508,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-26T12:30:52.075431+0000","last_change":"2024-04-26T12:30:50.086765+0000","last_active":"2024-04-26T12:30:52.075431+0000","last_peered":"2024-04-26T12:30:52.075431+0000","last_clean":"2024-04-26T12:30:52.075431+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:30:52.075431+0000","last_undegraded":"2024-04-26T12:30:52.075431+0000","last_fullsized":"2024-04-26T12:30:52.075431+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:36.313767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":506,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075936+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:30:54.075936+0000","last_peered":"2024-04-26T12:30:54.075936+0000","last_clean":"2024-04-26T12:30:54.075936+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:30:54.075936+0000","last_undegraded":"2024-04-26T12:30:54.075936+0000","last_fullsized":"2024-04-26T12:30:54.075936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":929,"num_objects_misplaced":893,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5074,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":121,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90275840,"data_stored":285809728,"data_compressed":42864631,"data_compressed_allocated":53944320,"data_compressed_original":249548800,"omap_allocated":5343,"internal_metadata":0},"log_size":7508,"ondisk_log_size":7508,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738422,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140936,"kb_used_data":41788,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94230904,"statfs":{"total":96636764160,"available":96492445696,"internally_reserved":0,"allocated":42790912,"data_stored":115119533,"data_compressed":16083079,"data_compressed_allocated":21016576,"data_compressed_original":93810688,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.23599999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.38800000000000001}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.312},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.33500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113232,"kb_used_data":32128,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94258608,"statfs":{"total":96636764160,"available":96520814592,"internally_reserved":0,"allocated":32899072,"data_stored":91424707,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.317},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:30:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.30399999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.625,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.496},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.44600000000000001}]}]},{"osd":1,"up_from":64,"seq":274877906949,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78660,"kb_used_data":16688,"kb_used_omap":6,"kb_used_meta":61945,"kb_avail":94293180,"statfs":{"total":96636764160,"available":96556216320,"internally_reserved":0,"allocated":17088512,"data_stored":81517291,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":63431911},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41930752,"data_stored":114170599,"data_compressed":16048932,"data_compressed_allocated":20971520,"data_compressed_original":93237248,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:30:59.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:00.225 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:31:00.227 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:31:00.237 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-04-26T12:31:00.078090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":363,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6177,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34345,"ondisk_log_size":34345,"up":210,"acting":207,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":232,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":316496,"kb_used_data":90660,"kb_used_omap":9,"kb_used_meta":225782,"kb_avail":282799024,"statfs":{"total":289910292480,"available":289586200576,"internally_reserved":0,"allocated":92835840,"data_stored":288084054,"data_compressed":42932925,"data_compressed_allocated":54034432,"data_compressed_original":250695680,"omap_allocated":10125,"internal_metadata":231200883},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-733,"num_objects_misplaced":-530,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1076,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.006756"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":895,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.086290+0000","last_change":"2024-04-26T12:30:54.081113+0000","last_active":"2024-04-26T12:30:54.086290+0000","last_peered":"2024-04-26T12:30:54.086290+0000","last_clean":"2024-04-26T12:30:54.086290+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:30:54.086290+0000","last_undegraded":"2024-04-26T12:30:54.086290+0000","last_fullsized":"2024-04-26T12:30:54.086290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.062347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":944,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-26T12:30:55.077802+0000","last_change":"2024-04-26T12:30:55.077898+0000","last_active":"2024-04-26T12:30:55.077802+0000","last_peered":"2024-04-26T12:30:54.110525+0000","last_clean":"2024-04-26T12:27:45.658708+0000","last_became_active":"2024-04-26T12:30:42.155649+0000","last_became_peered":"2024-04-26T12:30:42.155649+0000","last_unstale":"2024-04-26T12:30:55.077802+0000","last_undegraded":"2024-04-26T12:30:55.077802+0000","last_fullsized":"2024-04-26T12:30:55.077802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:44.815117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":490,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076853+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:30:54.076853+0000","last_peered":"2024-04-26T12:30:54.076853+0000","last_clean":"2024-04-26T12:30:54.076853+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:30:54.076853+0000","last_undegraded":"2024-04-26T12:30:54.076853+0000","last_fullsized":"2024-04-26T12:30:54.076853+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:55.616144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":862,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.078603+0000","last_change":"2024-04-26T12:30:48.089842+0000","last_active":"2024-04-26T12:30:55.078603+0000","last_peered":"2024-04-26T12:30:55.078603+0000","last_clean":"2024-04-26T12:30:55.078603+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:30:55.078603+0000","last_undegraded":"2024-04-26T12:30:55.078603+0000","last_fullsized":"2024-04-26T12:30:55.078603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:13.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":934,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075664+0000","last_change":"2024-04-26T12:30:48.089460+0000","last_active":"2024-04-26T12:30:54.075664+0000","last_peered":"2024-04-26T12:30:54.075664+0000","last_clean":"2024-04-26T12:30:54.075664+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:30:54.075664+0000","last_undegraded":"2024-04-26T12:30:54.075664+0000","last_fullsized":"2024-04-26T12:30:54.075664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":472,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075962+0000","last_change":"2024-04-26T12:30:48.090606+0000","last_active":"2024-04-26T12:30:54.075962+0000","last_peered":"2024-04-26T12:30:54.075962+0000","last_clean":"2024-04-26T12:30:54.075962+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:30:54.075962+0000","last_undegraded":"2024-04-26T12:30:54.075962+0000","last_fullsized":"2024-04-26T12:30:54.075962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:57.446858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1023,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076470+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:30:54.076470+0000","last_peered":"2024-04-26T12:30:54.076470+0000","last_clean":"2024-04-26T12:30:54.076470+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:30:54.076470+0000","last_undegraded":"2024-04-26T12:30:54.076470+0000","last_fullsized":"2024-04-26T12:30:54.076470+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:06.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":762,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075764+0000","last_change":"2024-04-26T12:30:49.082511+0000","last_active":"2024-04-26T12:30:54.075764+0000","last_peered":"2024-04-26T12:30:54.075764+0000","last_clean":"2024-04-26T12:30:54.075764+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:30:54.075764+0000","last_undegraded":"2024-04-26T12:30:54.075764+0000","last_fullsized":"2024-04-26T12:30:54.075764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:54.832086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":496,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074978+0000","last_change":"2024-04-26T12:30:56.079114+0000","last_active":"2024-04-26T12:30:57.074978+0000","last_peered":"2024-04-26T12:30:57.074978+0000","last_clean":"2024-04-26T12:30:57.074978+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:30:57.074978+0000","last_undegraded":"2024-04-26T12:30:57.074978+0000","last_fullsized":"2024-04-26T12:30:57.074978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:37.907357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":899,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-26T12:30:55.078045+0000","last_change":"2024-04-26T12:30:55.078136+0000","last_active":"2024-04-26T12:30:55.078045+0000","last_peered":"2024-04-26T12:30:54.514835+0000","last_clean":"2024-04-26T12:27:45.658876+0000","last_became_active":"2024-04-26T12:30:42.156989+0000","last_became_peered":"2024-04-26T12:30:42.156989+0000","last_unstale":"2024-04-26T12:30:55.078045+0000","last_undegraded":"2024-04-26T12:30:55.078045+0000","last_fullsized":"2024-04-26T12:30:55.078045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:52.462411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":589,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076569+0000","last_change":"2024-04-26T12:30:50.085026+0000","last_active":"2024-04-26T12:30:54.076569+0000","last_peered":"2024-04-26T12:30:54.076569+0000","last_clean":"2024-04-26T12:30:54.076569+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:30:54.076569+0000","last_undegraded":"2024-04-26T12:30:54.076569+0000","last_fullsized":"2024-04-26T12:30:54.076569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:31.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":507,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075519+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:30:54.075519+0000","last_peered":"2024-04-26T12:30:54.075519+0000","last_clean":"2024-04-26T12:30:54.075519+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:30:54.075519+0000","last_undegraded":"2024-04-26T12:30:54.075519+0000","last_fullsized":"2024-04-26T12:30:54.075519+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":878,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075751+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:30:54.075751+0000","last_peered":"2024-04-26T12:30:54.075751+0000","last_clean":"2024-04-26T12:30:54.075751+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:30:54.075751+0000","last_undegraded":"2024-04-26T12:30:54.075751+0000","last_fullsized":"2024-04-26T12:30:54.075751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:00.467106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":515,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076440+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:30:54.076440+0000","last_peered":"2024-04-26T12:30:54.076440+0000","last_clean":"2024-04-26T12:30:54.076440+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:30:54.076440+0000","last_undegraded":"2024-04-26T12:30:54.076440+0000","last_fullsized":"2024-04-26T12:30:54.076440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":535,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075874+0000","last_change":"2024-04-26T12:30:47.080645+0000","last_active":"2024-04-26T12:30:54.075874+0000","last_peered":"2024-04-26T12:30:54.075874+0000","last_clean":"2024-04-26T12:30:54.075874+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:30:54.075874+0000","last_undegraded":"2024-04-26T12:30:54.075874+0000","last_fullsized":"2024-04-26T12:30:54.075874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:11.047331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":921,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075792+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:30:54.075792+0000","last_peered":"2024-04-26T12:30:54.075792+0000","last_clean":"2024-04-26T12:30:54.075792+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:30:54.075792+0000","last_undegraded":"2024-04-26T12:30:54.075792+0000","last_fullsized":"2024-04-26T12:30:54.075792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:18.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":491,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074910+0000","last_change":"2024-04-26T12:30:55.090347+0000","last_active":"2024-04-26T12:30:57.074910+0000","last_peered":"2024-04-26T12:30:57.074910+0000","last_clean":"2024-04-26T12:30:57.074910+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:30:57.074910+0000","last_undegraded":"2024-04-26T12:30:57.074910+0000","last_fullsized":"2024-04-26T12:30:57.074910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:18.689900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":552,"reported_epoch":80,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T12:30:55.362795+0000","last_change":"2024-04-26T12:30:55.356468+0000","last_active":"2024-04-26T12:30:55.362795+0000","last_peered":"2024-04-26T12:30:55.362795+0000","last_clean":"2024-04-26T12:27:45.658959+0000","last_became_active":"2024-04-26T12:30:42.163023+0000","last_became_peered":"2024-04-26T12:30:42.163023+0000","last_unstale":"2024-04-26T12:30:55.362795+0000","last_undegraded":"2024-04-26T12:30:55.362795+0000","last_fullsized":"2024-04-26T12:30:42.044616+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:50.561555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":524,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074493+0000","last_change":"2024-04-26T12:30:51.076894+0000","last_active":"2024-04-26T12:30:57.074493+0000","last_peered":"2024-04-26T12:30:57.074493+0000","last_clean":"2024-04-26T12:30:57.074493+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:30:57.074493+0000","last_undegraded":"2024-04-26T12:30:57.074493+0000","last_fullsized":"2024-04-26T12:30:57.074493+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:50.091007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1065,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076706+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:30:54.076706+0000","last_peered":"2024-04-26T12:30:54.076706+0000","last_clean":"2024-04-26T12:30:54.076706+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:30:54.076706+0000","last_undegraded":"2024-04-26T12:30:54.076706+0000","last_fullsized":"2024-04-26T12:30:54.076706+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:26.268194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":947,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076191+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:30:54.076191+0000","last_peered":"2024-04-26T12:30:54.076191+0000","last_clean":"2024-04-26T12:30:54.076191+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:30:54.076191+0000","last_undegraded":"2024-04-26T12:30:54.076191+0000","last_fullsized":"2024-04-26T12:30:54.076191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:12.535434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":575,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075781+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:30:54.075781+0000","last_peered":"2024-04-26T12:30:54.075781+0000","last_clean":"2024-04-26T12:30:54.075781+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:30:54.075781+0000","last_undegraded":"2024-04-26T12:30:54.075781+0000","last_fullsized":"2024-04-26T12:30:54.075781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":514,"reported_epoch":79,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:54.075270+0000","last_change":"2024-04-26T12:30:47.082934+0000","last_active":"2024-04-26T12:30:54.075270+0000","last_peered":"2024-04-26T12:30:54.075270+0000","last_clean":"2024-04-26T12:30:39.001294+0000","last_became_active":"2024-04-26T12:30:47.081126+0000","last_became_peered":"2024-04-26T12:30:47.081126+0000","last_unstale":"2024-04-26T12:30:54.075270+0000","last_undegraded":"2024-04-26T12:30:54.075270+0000","last_fullsized":"2024-04-26T12:30:54.075270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:47.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":179,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":610,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:54.076689+0000","last_change":"2024-04-26T12:30:42.168459+0000","last_active":"2024-04-26T12:30:54.076689+0000","last_peered":"2024-04-26T12:30:54.076689+0000","last_clean":"2024-04-26T12:27:45.658199+0000","last_became_active":"2024-04-26T12:30:42.163138+0000","last_became_peered":"2024-04-26T12:30:42.163138+0000","last_unstale":"2024-04-26T12:30:54.076689+0000","last_undegraded":"2024-04-26T12:30:42.014270+0000","last_fullsized":"2024-04-26T12:30:42.005688+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:33.001689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":543,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.077149+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:30:54.077149+0000","last_peered":"2024-04-26T12:30:54.077149+0000","last_clean":"2024-04-26T12:30:54.077149+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:30:54.077149+0000","last_undegraded":"2024-04-26T12:30:54.077149+0000","last_fullsized":"2024-04-26T12:30:54.077149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":583,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.075344+0000","last_change":"2024-04-26T12:30:46.089997+0000","last_active":"2024-04-26T12:30:57.075344+0000","last_peered":"2024-04-26T12:30:57.075344+0000","last_clean":"2024-04-26T12:30:57.075344+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:30:57.075344+0000","last_undegraded":"2024-04-26T12:30:57.075344+0000","last_fullsized":"2024-04-26T12:30:57.075344+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:08.843126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":508,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076720+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:30:54.076720+0000","last_peered":"2024-04-26T12:30:54.076720+0000","last_clean":"2024-04-26T12:30:54.076720+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:30:54.076720+0000","last_undegraded":"2024-04-26T12:30:54.076720+0000","last_fullsized":"2024-04-26T12:30:54.076720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":562,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075734+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:30:54.075734+0000","last_peered":"2024-04-26T12:30:54.075734+0000","last_clean":"2024-04-26T12:30:54.075734+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:30:54.075734+0000","last_undegraded":"2024-04-26T12:30:54.075734+0000","last_fullsized":"2024-04-26T12:30:54.075734+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:21.302173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":477,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076616+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:30:54.076616+0000","last_peered":"2024-04-26T12:30:54.076616+0000","last_clean":"2024-04-26T12:30:54.076616+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:30:54.076616+0000","last_undegraded":"2024-04-26T12:30:54.076616+0000","last_fullsized":"2024-04-26T12:30:54.076616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":408,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073705+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:30:57.073705+0000","last_peered":"2024-04-26T12:30:57.073705+0000","last_clean":"2024-04-26T12:30:57.073705+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:30:57.073705+0000","last_undegraded":"2024-04-26T12:30:57.073705+0000","last_fullsized":"2024-04-26T12:30:57.073705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.762427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:30:58.081169+0000","last_change":"2024-04-26T12:30:58.081169+0000","last_active":"2024-04-26T12:30:58.081169+0000","last_peered":"2024-04-26T12:30:58.081169+0000","last_clean":"2024-04-26T12:30:58.081169+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:30:58.081169+0000","last_undegraded":"2024-04-26T12:30:58.081169+0000","last_fullsized":"2024-04-26T12:30:58.081169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:42.618440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"58'708","reported_seq":776,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073660+0000","last_change":"2024-04-26T12:30:44.022038+0000","last_active":"2024-04-26T12:30:57.073660+0000","last_peered":"2024-04-26T12:30:57.073660+0000","last_clean":"2024-04-26T12:30:57.073660+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:30:57.073660+0000","last_undegraded":"2024-04-26T12:30:57.073660+0000","last_fullsized":"2024-04-26T12:30:57.073660+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:30.369118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":494,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.077110+0000","last_change":"2024-04-26T12:30:47.081417+0000","last_active":"2024-04-26T12:30:54.077110+0000","last_peered":"2024-04-26T12:30:54.077110+0000","last_clean":"2024-04-26T12:30:54.077110+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:30:54.077110+0000","last_undegraded":"2024-04-26T12:30:54.077110+0000","last_fullsized":"2024-04-26T12:30:54.077110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:17.628933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074746+0000","last_change":"2024-04-26T12:30:41.018067+0000","last_active":"2024-04-26T12:30:57.074746+0000","last_peered":"2024-04-26T12:30:57.074746+0000","last_clean":"2024-04-26T12:30:57.074746+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:30:57.074746+0000","last_undegraded":"2024-04-26T12:30:57.074746+0000","last_fullsized":"2024-04-26T12:30:57.074746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:33.684743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":592,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:30:58.081823+0000","last_change":"2024-04-26T12:30:58.081823+0000","last_active":"2024-04-26T12:30:58.081823+0000","last_peered":"2024-04-26T12:30:58.081823+0000","last_clean":"2024-04-26T12:30:58.081823+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:30:58.081823+0000","last_undegraded":"2024-04-26T12:30:58.081823+0000","last_fullsized":"2024-04-26T12:30:58.081823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.109302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"58'355","reported_seq":372,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076603+0000","last_change":"2024-04-26T12:30:48.086933+0000","last_active":"2024-04-26T12:30:54.076603+0000","last_peered":"2024-04-26T12:30:54.076603+0000","last_clean":"2024-04-26T12:30:54.076603+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:30:54.076603+0000","last_undegraded":"2024-04-26T12:30:54.076603+0000","last_fullsized":"2024-04-26T12:30:54.076603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:49.737283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":718,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073774+0000","last_change":"2024-04-26T12:30:46.034642+0000","last_active":"2024-04-26T12:30:57.073774+0000","last_peered":"2024-04-26T12:30:57.073774+0000","last_clean":"2024-04-26T12:30:57.073774+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:30:57.073774+0000","last_undegraded":"2024-04-26T12:30:57.073774+0000","last_fullsized":"2024-04-26T12:30:57.073774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.961343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":162,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076632+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:30:54.076632+0000","last_peered":"2024-04-26T12:30:54.076632+0000","last_clean":"2024-04-26T12:30:54.076632+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:30:54.076632+0000","last_undegraded":"2024-04-26T12:30:54.076632+0000","last_fullsized":"2024-04-26T12:30:54.076632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":509,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073886+0000","last_change":"2024-04-26T12:30:45.022716+0000","last_active":"2024-04-26T12:30:57.073886+0000","last_peered":"2024-04-26T12:30:57.073886+0000","last_clean":"2024-04-26T12:30:57.073886+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:30:57.073886+0000","last_undegraded":"2024-04-26T12:30:57.073886+0000","last_fullsized":"2024-04-26T12:30:57.073886+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:01.269901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'374","reported_seq":434,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076492+0000","last_change":"2024-04-26T12:30:46.079618+0000","last_active":"2024-04-26T12:30:54.076492+0000","last_peered":"2024-04-26T12:30:54.076492+0000","last_clean":"2024-04-26T12:30:54.076492+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:30:54.076492+0000","last_undegraded":"2024-04-26T12:30:54.076492+0000","last_fullsized":"2024-04-26T12:30:54.076492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:48.209628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":501,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076690+0000","last_change":"2024-04-26T12:30:47.082596+0000","last_active":"2024-04-26T12:30:54.076690+0000","last_peered":"2024-04-26T12:30:54.076690+0000","last_clean":"2024-04-26T12:30:54.076690+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:30:54.076690+0000","last_undegraded":"2024-04-26T12:30:54.076690+0000","last_fullsized":"2024-04-26T12:30:54.076690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:34.688913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":643,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076568+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:30:54.076568+0000","last_peered":"2024-04-26T12:30:54.076568+0000","last_clean":"2024-04-26T12:30:54.076568+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:30:54.076568+0000","last_undegraded":"2024-04-26T12:30:54.076568+0000","last_fullsized":"2024-04-26T12:30:54.076568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:50.674218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":789,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075625+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:30:54.075625+0000","last_peered":"2024-04-26T12:30:54.075625+0000","last_clean":"2024-04-26T12:30:54.075625+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:30:54.075625+0000","last_undegraded":"2024-04-26T12:30:54.075625+0000","last_fullsized":"2024-04-26T12:30:54.075625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:11.548975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073840+0000","last_change":"2024-04-26T12:30:46.089052+0000","last_active":"2024-04-26T12:30:57.073840+0000","last_peered":"2024-04-26T12:30:57.073840+0000","last_clean":"2024-04-26T12:30:57.073840+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:30:57.073840+0000","last_undegraded":"2024-04-26T12:30:57.073840+0000","last_fullsized":"2024-04-26T12:30:57.073840+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:28.433853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":855,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076324+0000","last_change":"2024-04-26T12:30:50.086492+0000","last_active":"2024-04-26T12:30:54.076324+0000","last_peered":"2024-04-26T12:30:54.076324+0000","last_clean":"2024-04-26T12:30:54.076324+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:30:54.076324+0000","last_undegraded":"2024-04-26T12:30:54.076324+0000","last_fullsized":"2024-04-26T12:30:54.076324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:18.705037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075615+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:30:54.075615+0000","last_peered":"2024-04-26T12:30:54.075615+0000","last_clean":"2024-04-26T12:30:54.075615+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:30:54.075615+0000","last_undegraded":"2024-04-26T12:30:54.075615+0000","last_fullsized":"2024-04-26T12:30:54.075615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":491,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-26T12:30:58.077112+0000","last_change":"2024-04-26T12:30:58.077112+0000","last_active":"2024-04-26T12:30:40.012414+0000","last_peered":"2024-04-26T12:30:39.001966+0000","last_clean":"2024-04-26T12:30:39.001966+0000","last_became_active":"2024-04-26T12:28:29.803352+0000","last_became_peered":"2024-04-26T12:28:29.803352+0000","last_unstale":"2024-04-26T12:30:58.077112+0000","last_undegraded":"2024-04-26T12:30:58.077112+0000","last_fullsized":"2024-04-26T12:30:58.077112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:12.256084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'54","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076213+0000","last_change":"2024-04-26T12:30:46.082166+0000","last_active":"2024-04-26T12:30:54.076213+0000","last_peered":"2024-04-26T12:30:54.076213+0000","last_clean":"2024-04-26T12:30:54.076213+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:30:54.076213+0000","last_undegraded":"2024-04-26T12:30:54.076213+0000","last_fullsized":"2024-04-26T12:30:54.076213+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:28.037535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":529,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-26T12:30:58.077156+0000","last_change":"2024-04-26T12:30:58.077156+0000","last_active":"2024-04-26T12:30:40.009415+0000","last_peered":"2024-04-26T12:30:39.002391+0000","last_clean":"2024-04-26T12:30:39.002391+0000","last_became_active":"2024-04-26T12:28:29.803545+0000","last_became_peered":"2024-04-26T12:28:29.803545+0000","last_unstale":"2024-04-26T12:30:58.077156+0000","last_undegraded":"2024-04-26T12:30:58.077156+0000","last_fullsized":"2024-04-26T12:30:58.077156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:17.958035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'186","reported_seq":204,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076622+0000","last_change":"2024-04-26T12:30:46.080074+0000","last_active":"2024-04-26T12:30:54.076622+0000","last_peered":"2024-04-26T12:30:54.076622+0000","last_clean":"2024-04-26T12:30:54.076622+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:30:54.076622+0000","last_undegraded":"2024-04-26T12:30:54.076622+0000","last_fullsized":"2024-04-26T12:30:54.076622+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:24.562647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":526,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075238+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:30:54.075238+0000","last_peered":"2024-04-26T12:30:54.075238+0000","last_clean":"2024-04-26T12:30:54.075238+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:30:54.075238+0000","last_undegraded":"2024-04-26T12:30:54.075238+0000","last_fullsized":"2024-04-26T12:30:54.075238+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":435,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076300+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:30:54.076300+0000","last_peered":"2024-04-26T12:30:54.076300+0000","last_clean":"2024-04-26T12:30:54.076300+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:30:54.076300+0000","last_undegraded":"2024-04-26T12:30:54.076300+0000","last_fullsized":"2024-04-26T12:30:54.076300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:40.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":971,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075907+0000","last_change":"2024-04-26T12:30:52.078990+0000","last_active":"2024-04-26T12:30:54.075907+0000","last_peered":"2024-04-26T12:30:54.075907+0000","last_clean":"2024-04-26T12:30:54.075907+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:30:54.075907+0000","last_undegraded":"2024-04-26T12:30:54.075907+0000","last_fullsized":"2024-04-26T12:30:54.075907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.697122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":509,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076714+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:30:54.076714+0000","last_peered":"2024-04-26T12:30:54.076714+0000","last_clean":"2024-04-26T12:30:54.076714+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:30:54.076714+0000","last_undegraded":"2024-04-26T12:30:54.076714+0000","last_fullsized":"2024-04-26T12:30:54.076714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:18.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":486,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076194+0000","last_change":"2024-04-26T12:30:48.089200+0000","last_active":"2024-04-26T12:30:54.076194+0000","last_peered":"2024-04-26T12:30:54.076194+0000","last_clean":"2024-04-26T12:30:54.076194+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:30:54.076194+0000","last_undegraded":"2024-04-26T12:30:54.076194+0000","last_fullsized":"2024-04-26T12:30:54.076194+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:04.588329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076209+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:54.076209+0000","last_peered":"2024-04-26T12:30:54.076209+0000","last_clean":"2024-04-26T12:30:54.076209+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:30:54.076209+0000","last_undegraded":"2024-04-26T12:30:54.076209+0000","last_fullsized":"2024-04-26T12:30:54.076209+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:40.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":557,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074143+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:30:57.074143+0000","last_peered":"2024-04-26T12:30:57.074143+0000","last_clean":"2024-04-26T12:30:57.074143+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:30:57.074143+0000","last_undegraded":"2024-04-26T12:30:57.074143+0000","last_fullsized":"2024-04-26T12:30:57.074143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.230823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":250,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074084+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:30:57.074084+0000","last_peered":"2024-04-26T12:30:57.074084+0000","last_clean":"2024-04-26T12:30:57.074084+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:30:57.074084+0000","last_undegraded":"2024-04-26T12:30:57.074084+0000","last_fullsized":"2024-04-26T12:30:57.074084+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:30.864621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":532,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076248+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:30:54.076248+0000","last_peered":"2024-04-26T12:30:54.076248+0000","last_clean":"2024-04-26T12:30:54.076248+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:30:54.076248+0000","last_undegraded":"2024-04-26T12:30:54.076248+0000","last_fullsized":"2024-04-26T12:30:54.076248+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:13.427584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076054+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:30:54.076054+0000","last_peered":"2024-04-26T12:30:54.076054+0000","last_clean":"2024-04-26T12:30:54.076054+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:30:54.076054+0000","last_undegraded":"2024-04-26T12:30:54.076054+0000","last_fullsized":"2024-04-26T12:30:54.076054+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:16.260550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":478,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076963+0000","last_change":"2024-04-26T12:30:47.083054+0000","last_active":"2024-04-26T12:30:54.076963+0000","last_peered":"2024-04-26T12:30:54.076963+0000","last_clean":"2024-04-26T12:30:54.076963+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:30:54.076963+0000","last_undegraded":"2024-04-26T12:30:54.076963+0000","last_fullsized":"2024-04-26T12:30:54.076963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.645638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":157,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075339+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:30:54.075339+0000","last_peered":"2024-04-26T12:30:54.075339+0000","last_clean":"2024-04-26T12:30:54.075339+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:30:54.075339+0000","last_undegraded":"2024-04-26T12:30:54.075339+0000","last_fullsized":"2024-04-26T12:30:54.075339+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:20.988072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":487,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076864+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:30:54.076864+0000","last_peered":"2024-04-26T12:30:54.076864+0000","last_clean":"2024-04-26T12:30:54.076864+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:30:54.076864+0000","last_undegraded":"2024-04-26T12:30:54.076864+0000","last_fullsized":"2024-04-26T12:30:54.076864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":583,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076124+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:30:54.076124+0000","last_peered":"2024-04-26T12:30:54.076124+0000","last_clean":"2024-04-26T12:30:54.076124+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:30:54.076124+0000","last_undegraded":"2024-04-26T12:30:54.076124+0000","last_fullsized":"2024-04-26T12:30:54.076124+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:25.266771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":496,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074845+0000","last_change":"2024-04-26T12:30:55.090354+0000","last_active":"2024-04-26T12:30:57.074845+0000","last_peered":"2024-04-26T12:30:57.074845+0000","last_clean":"2024-04-26T12:30:57.074845+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:30:57.074845+0000","last_undegraded":"2024-04-26T12:30:57.074845+0000","last_fullsized":"2024-04-26T12:30:57.074845+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:14.455369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074352+0000","last_change":"2024-04-26T12:30:41.026049+0000","last_active":"2024-04-26T12:30:57.074352+0000","last_peered":"2024-04-26T12:30:57.074352+0000","last_clean":"2024-04-26T12:30:57.074352+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:30:57.074352+0000","last_undegraded":"2024-04-26T12:30:57.074352+0000","last_fullsized":"2024-04-26T12:30:57.074352+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.409817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"58'454","reported_seq":475,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076846+0000","last_change":"2024-04-26T12:30:46.079367+0000","last_active":"2024-04-26T12:30:54.076846+0000","last_peered":"2024-04-26T12:30:54.076846+0000","last_clean":"2024-04-26T12:30:54.076846+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:30:54.076846+0000","last_undegraded":"2024-04-26T12:30:54.076846+0000","last_fullsized":"2024-04-26T12:30:54.076846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:00.950370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":467,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075820+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:30:54.075820+0000","last_peered":"2024-04-26T12:30:54.075820+0000","last_clean":"2024-04-26T12:30:54.075820+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:30:54.075820+0000","last_undegraded":"2024-04-26T12:30:54.075820+0000","last_fullsized":"2024-04-26T12:30:54.075820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076309+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:30:54.076309+0000","last_peered":"2024-04-26T12:30:54.076309+0000","last_clean":"2024-04-26T12:30:54.076309+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:30:54.076309+0000","last_undegraded":"2024-04-26T12:30:54.076309+0000","last_fullsized":"2024-04-26T12:30:54.076309+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:16.686041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076322+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:54.076322+0000","last_peered":"2024-04-26T12:30:54.076322+0000","last_clean":"2024-04-26T12:30:54.076322+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:30:54.076322+0000","last_undegraded":"2024-04-26T12:30:54.076322+0000","last_fullsized":"2024-04-26T12:30:54.076322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:18.069937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":497,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074267+0000","last_change":"2024-04-26T12:30:46.033999+0000","last_active":"2024-04-26T12:30:57.074267+0000","last_peered":"2024-04-26T12:30:57.074267+0000","last_clean":"2024-04-26T12:30:57.074267+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:30:57.074267+0000","last_undegraded":"2024-04-26T12:30:57.074267+0000","last_fullsized":"2024-04-26T12:30:57.074267+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:33.235467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073919+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:30:57.073919+0000","last_peered":"2024-04-26T12:30:57.073919+0000","last_clean":"2024-04-26T12:30:57.073919+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:30:57.073919+0000","last_undegraded":"2024-04-26T12:30:57.073919+0000","last_fullsized":"2024-04-26T12:30:57.073919+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:20.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":393,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.076477+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:30:55.076477+0000","last_peered":"2024-04-26T12:30:55.076477+0000","last_clean":"2024-04-26T12:30:55.076477+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:30:55.076477+0000","last_undegraded":"2024-04-26T12:30:55.076477+0000","last_fullsized":"2024-04-26T12:30:55.076477+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":430,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074784+0000","last_change":"2024-04-26T12:30:54.081099+0000","last_active":"2024-04-26T12:30:57.074784+0000","last_peered":"2024-04-26T12:30:57.074784+0000","last_clean":"2024-04-26T12:30:57.074784+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:30:57.074784+0000","last_undegraded":"2024-04-26T12:30:57.074784+0000","last_fullsized":"2024-04-26T12:30:57.074784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:29.507250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076582+0000","last_change":"2024-04-26T12:30:46.082961+0000","last_active":"2024-04-26T12:30:54.076582+0000","last_peered":"2024-04-26T12:30:54.076582+0000","last_clean":"2024-04-26T12:30:54.076582+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:30:54.076582+0000","last_undegraded":"2024-04-26T12:30:54.076582+0000","last_fullsized":"2024-04-26T12:30:54.076582+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:10.764587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":258,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075901+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:30:54.075901+0000","last_peered":"2024-04-26T12:30:54.075901+0000","last_clean":"2024-04-26T12:30:54.075901+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:30:54.075901+0000","last_undegraded":"2024-04-26T12:30:54.075901+0000","last_fullsized":"2024-04-26T12:30:54.075901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:23.542209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":596,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073940+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:30:57.073940+0000","last_peered":"2024-04-26T12:30:57.073940+0000","last_clean":"2024-04-26T12:30:57.073940+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:30:57.073940+0000","last_undegraded":"2024-04-26T12:30:57.073940+0000","last_fullsized":"2024-04-26T12:30:57.073940+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:05.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":559,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076976+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:30:54.076976+0000","last_peered":"2024-04-26T12:30:54.076976+0000","last_clean":"2024-04-26T12:30:54.076976+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:30:54.076976+0000","last_undegraded":"2024-04-26T12:30:54.076976+0000","last_fullsized":"2024-04-26T12:30:54.076976+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075904+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:30:54.075904+0000","last_peered":"2024-04-26T12:30:54.075904+0000","last_clean":"2024-04-26T12:30:54.075904+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:30:54.075904+0000","last_undegraded":"2024-04-26T12:30:54.075904+0000","last_fullsized":"2024-04-26T12:30:54.075904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'105","reported_seq":220,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074099+0000","last_change":"2024-04-26T12:30:44.028851+0000","last_active":"2024-04-26T12:30:57.074099+0000","last_peered":"2024-04-26T12:30:57.074099+0000","last_clean":"2024-04-26T12:30:57.074099+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:30:57.074099+0000","last_undegraded":"2024-04-26T12:30:57.074099+0000","last_fullsized":"2024-04-26T12:30:57.074099+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:13.939165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":954,"reported_epoch":80,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:30:55.354831+0000","last_change":"2024-04-26T12:30:55.355011+0000","last_active":"2024-04-26T12:30:55.354831+0000","last_peered":"2024-04-26T12:30:55.354831+0000","last_clean":"2024-04-26T12:27:45.658919+0000","last_became_active":"2024-04-26T12:30:42.157001+0000","last_became_peered":"2024-04-26T12:30:42.157001+0000","last_unstale":"2024-04-26T12:30:55.354831+0000","last_undegraded":"2024-04-26T12:30:55.354831+0000","last_fullsized":"2024-04-26T12:30:42.041964+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:06.285978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076790+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:30:54.076790+0000","last_peered":"2024-04-26T12:30:54.076790+0000","last_clean":"2024-04-26T12:30:54.076790+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:30:54.076790+0000","last_undegraded":"2024-04-26T12:30:54.076790+0000","last_fullsized":"2024-04-26T12:30:54.076790+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:31.181549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074439+0000","last_change":"2024-04-26T12:30:41.026137+0000","last_active":"2024-04-26T12:30:57.074439+0000","last_peered":"2024-04-26T12:30:57.074439+0000","last_clean":"2024-04-26T12:30:57.074439+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:30:57.074439+0000","last_undegraded":"2024-04-26T12:30:57.074439+0000","last_fullsized":"2024-04-26T12:30:57.074439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:08.225745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":514,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075635+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:30:54.075635+0000","last_peered":"2024-04-26T12:30:54.075635+0000","last_clean":"2024-04-26T12:30:54.075635+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:30:54.075635+0000","last_undegraded":"2024-04-26T12:30:54.075635+0000","last_fullsized":"2024-04-26T12:30:54.075635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074635+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:30:57.074635+0000","last_peered":"2024-04-26T12:30:57.074635+0000","last_clean":"2024-04-26T12:30:57.074635+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:30:57.074635+0000","last_undegraded":"2024-04-26T12:30:57.074635+0000","last_fullsized":"2024-04-26T12:30:57.074635+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:51.609322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074557+0000","last_change":"2024-04-26T12:30:41.030157+0000","last_active":"2024-04-26T12:30:57.074557+0000","last_peered":"2024-04-26T12:30:57.074557+0000","last_clean":"2024-04-26T12:30:57.074557+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:57.074557+0000","last_undegraded":"2024-04-26T12:30:57.074557+0000","last_fullsized":"2024-04-26T12:30:57.074557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:32.867679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":518,"reported_epoch":79,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:54.075180+0000","last_change":"2024-04-26T12:30:47.084724+0000","last_active":"2024-04-26T12:30:54.075180+0000","last_peered":"2024-04-26T12:30:54.075180+0000","last_clean":"2024-04-26T12:30:39.001153+0000","last_became_active":"2024-04-26T12:30:47.083601+0000","last_became_peered":"2024-04-26T12:30:47.083601+0000","last_unstale":"2024-04-26T12:30:54.075180+0000","last_undegraded":"2024-04-26T12:30:54.075180+0000","last_fullsized":"2024-04-26T12:30:54.075180+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:00.234562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":184,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076673+0000","last_change":"2024-04-26T12:30:46.080509+0000","last_active":"2024-04-26T12:30:54.076673+0000","last_peered":"2024-04-26T12:30:54.076673+0000","last_clean":"2024-04-26T12:30:54.076673+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:30:54.076673+0000","last_undegraded":"2024-04-26T12:30:54.076673+0000","last_fullsized":"2024-04-26T12:30:54.076673+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:40.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'82","reported_seq":59,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074820+0000","last_change":"2024-04-26T12:30:46.086027+0000","last_active":"2024-04-26T12:30:57.074820+0000","last_peered":"2024-04-26T12:30:57.074820+0000","last_clean":"2024-04-26T12:30:57.074820+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:30:57.074820+0000","last_undegraded":"2024-04-26T12:30:57.074820+0000","last_fullsized":"2024-04-26T12:30:57.074820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:13.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":600,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075626+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:30:54.075626+0000","last_peered":"2024-04-26T12:30:54.075626+0000","last_clean":"2024-04-26T12:30:54.075626+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:30:54.075626+0000","last_undegraded":"2024-04-26T12:30:54.075626+0000","last_fullsized":"2024-04-26T12:30:54.075626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":168,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075750+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:30:54.075750+0000","last_peered":"2024-04-26T12:30:54.075750+0000","last_clean":"2024-04-26T12:30:54.075750+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:30:54.075750+0000","last_undegraded":"2024-04-26T12:30:54.075750+0000","last_fullsized":"2024-04-26T12:30:54.075750+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.312112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":850,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075851+0000","last_change":"2024-04-26T12:30:53.079043+0000","last_active":"2024-04-26T12:30:54.075851+0000","last_peered":"2024-04-26T12:30:54.075851+0000","last_clean":"2024-04-26T12:30:54.075851+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:30:54.075851+0000","last_undegraded":"2024-04-26T12:30:54.075851+0000","last_fullsized":"2024-04-26T12:30:54.075851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:00.091756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076362+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:30:54.076362+0000","last_peered":"2024-04-26T12:30:54.076362+0000","last_clean":"2024-04-26T12:30:54.076362+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:30:54.076362+0000","last_undegraded":"2024-04-26T12:30:54.076362+0000","last_fullsized":"2024-04-26T12:30:54.076362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:43.044883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":793,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076256+0000","last_change":"2024-04-26T12:30:48.088039+0000","last_active":"2024-04-26T12:30:54.076256+0000","last_peered":"2024-04-26T12:30:54.076256+0000","last_clean":"2024-04-26T12:30:54.076256+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:30:54.076256+0000","last_undegraded":"2024-04-26T12:30:54.076256+0000","last_fullsized":"2024-04-26T12:30:54.076256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:03.967118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"58'314","reported_seq":390,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076238+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:30:54.076238+0000","last_peered":"2024-04-26T12:30:54.076238+0000","last_clean":"2024-04-26T12:30:54.076238+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:30:54.076238+0000","last_undegraded":"2024-04-26T12:30:54.076238+0000","last_fullsized":"2024-04-26T12:30:54.076238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":867,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076084+0000","last_change":"2024-04-26T12:30:52.079092+0000","last_active":"2024-04-26T12:30:54.076084+0000","last_peered":"2024-04-26T12:30:54.076084+0000","last_clean":"2024-04-26T12:30:54.076084+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:30:54.076084+0000","last_undegraded":"2024-04-26T12:30:54.076084+0000","last_fullsized":"2024-04-26T12:30:54.076084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:10.253347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"58'76","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074650+0000","last_change":"2024-04-26T12:30:41.050653+0000","last_active":"2024-04-26T12:30:57.074650+0000","last_peered":"2024-04-26T12:30:57.074650+0000","last_clean":"2024-04-26T12:30:57.074650+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:57.074650+0000","last_undegraded":"2024-04-26T12:30:57.074650+0000","last_fullsized":"2024-04-26T12:30:57.074650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:17.874875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":537,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075764+0000","last_change":"2024-04-26T12:28:00.707724+0000","last_active":"2024-04-26T12:30:54.075764+0000","last_peered":"2024-04-26T12:30:54.075764+0000","last_clean":"2024-04-26T12:30:54.075764+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:30:54.075764+0000","last_undegraded":"2024-04-26T12:30:54.075764+0000","last_fullsized":"2024-04-26T12:30:54.075764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:20.384961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074845+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:30:57.074845+0000","last_peered":"2024-04-26T12:30:57.074845+0000","last_clean":"2024-04-26T12:30:57.074845+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:30:57.074845+0000","last_undegraded":"2024-04-26T12:30:57.074845+0000","last_fullsized":"2024-04-26T12:30:57.074845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:40.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":962,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076157+0000","last_change":"2024-04-26T12:30:51.076207+0000","last_active":"2024-04-26T12:30:54.076157+0000","last_peered":"2024-04-26T12:30:54.076157+0000","last_clean":"2024-04-26T12:30:54.076157+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:30:54.076157+0000","last_undegraded":"2024-04-26T12:30:54.076157+0000","last_fullsized":"2024-04-26T12:30:54.076157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:05.869282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":858,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076035+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:30:54.076035+0000","last_peered":"2024-04-26T12:30:54.076035+0000","last_clean":"2024-04-26T12:30:54.076035+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:30:54.076035+0000","last_undegraded":"2024-04-26T12:30:54.076035+0000","last_fullsized":"2024-04-26T12:30:54.076035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:50.433671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":526,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074008+0000","last_change":"2024-04-26T12:30:54.080153+0000","last_active":"2024-04-26T12:30:57.074008+0000","last_peered":"2024-04-26T12:30:57.074008+0000","last_clean":"2024-04-26T12:30:57.074008+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:30:57.074008+0000","last_undegraded":"2024-04-26T12:30:57.074008+0000","last_fullsized":"2024-04-26T12:30:57.074008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:48.057283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":623,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075891+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:30:54.075891+0000","last_peered":"2024-04-26T12:30:54.075891+0000","last_clean":"2024-04-26T12:30:54.075891+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:30:54.075891+0000","last_undegraded":"2024-04-26T12:30:54.075891+0000","last_fullsized":"2024-04-26T12:30:54.075891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":513,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074363+0000","last_change":"2024-04-26T12:30:50.086765+0000","last_active":"2024-04-26T12:30:57.074363+0000","last_peered":"2024-04-26T12:30:57.074363+0000","last_clean":"2024-04-26T12:30:57.074363+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:30:57.074363+0000","last_undegraded":"2024-04-26T12:30:57.074363+0000","last_fullsized":"2024-04-26T12:30:57.074363+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:36.313767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":506,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075936+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:30:54.075936+0000","last_peered":"2024-04-26T12:30:54.075936+0000","last_clean":"2024-04-26T12:30:54.075936+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:30:54.075936+0000","last_undegraded":"2024-04-26T12:30:54.075936+0000","last_fullsized":"2024-04-26T12:30:54.075936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":363,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6150,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":125,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90275840,"data_stored":285809728,"data_compressed":42864631,"data_compressed_allocated":53944320,"data_compressed_original":249548800,"omap_allocated":5343,"internal_metadata":0},"log_size":7508,"ondisk_log_size":7508,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738422,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140936,"kb_used_data":41788,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94230904,"statfs":{"total":96636764160,"available":96492445696,"internally_reserved":0,"allocated":42790912,"data_stored":115119533,"data_compressed":16083079,"data_compressed_allocated":21016576,"data_compressed_original":93810688,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.23599999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.38800000000000001}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.312},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.33500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113232,"kb_used_data":32128,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94258608,"statfs":{"total":96636764160,"available":96520814592,"internally_reserved":0,"allocated":32899072,"data_stored":91424707,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.317},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:30:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.30399999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.625,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.496},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.44600000000000001}]}]},{"osd":1,"up_from":64,"seq":274877906950,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62328,"kb_used_data":16744,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309512,"statfs":{"total":96636764160,"available":96572940288,"internally_reserved":0,"allocated":17145856,"data_stored":81539814,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41930752,"data_stored":114170599,"data_compressed":16048932,"data_compressed_allocated":20971520,"data_compressed_original":93237248,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:00.241 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T12:31:00.701 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:31:00.702 INFO:teuthology.orchestra.run.smithi046.stdout:{"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 196/110 objects degraded (178.182%), 1 pg degraded","count":1},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":263,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":85,"num_osds":3,"num_up_osds":3,"osd_up_since":1714134639,"num_in_osds":3,"osd_in_since":1714134397,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"peering","count":4},{"state_name":"active+recovery_wait+remapped","count":2},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":1},{"state_name":"active+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":128814877,"bytes_used":324091904,"bytes_avail":289586200576,"bytes_total":289910292480,"inactive_pgs_ratio":0.038095239549875259,"degraded_objects":196,"degraded_total":110,"degraded_ratio":1.781818181818182,"misplaced_objects":363,"misplaced_total":110,"misplaced_ratio":3.2999999999999998,"recovering_objects_per_sec":450,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1802,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":14150}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-26T12:27:59.302941+0000","services":{}},"progress_events":{}} 2024-04-26T12:31:00.716 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T12:31:00.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:01.060 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:31:01.062 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:31:01.072 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-04-26T12:31:00.078090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":363,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6177,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34345,"ondisk_log_size":34345,"up":210,"acting":207,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":232,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":316496,"kb_used_data":90660,"kb_used_omap":9,"kb_used_meta":225782,"kb_avail":282799024,"statfs":{"total":289910292480,"available":289586200576,"internally_reserved":0,"allocated":92835840,"data_stored":288084054,"data_compressed":42932925,"data_compressed_allocated":54034432,"data_compressed_original":250695680,"omap_allocated":10125,"internal_metadata":231200883},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-733,"num_objects_misplaced":-530,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1076,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.006756"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":895,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.086290+0000","last_change":"2024-04-26T12:30:54.081113+0000","last_active":"2024-04-26T12:30:54.086290+0000","last_peered":"2024-04-26T12:30:54.086290+0000","last_clean":"2024-04-26T12:30:54.086290+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:30:54.086290+0000","last_undegraded":"2024-04-26T12:30:54.086290+0000","last_fullsized":"2024-04-26T12:30:54.086290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.062347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":944,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-26T12:30:55.077802+0000","last_change":"2024-04-26T12:30:55.077898+0000","last_active":"2024-04-26T12:30:55.077802+0000","last_peered":"2024-04-26T12:30:54.110525+0000","last_clean":"2024-04-26T12:27:45.658708+0000","last_became_active":"2024-04-26T12:30:42.155649+0000","last_became_peered":"2024-04-26T12:30:42.155649+0000","last_unstale":"2024-04-26T12:30:55.077802+0000","last_undegraded":"2024-04-26T12:30:55.077802+0000","last_fullsized":"2024-04-26T12:30:55.077802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:44.815117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":490,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076853+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:30:54.076853+0000","last_peered":"2024-04-26T12:30:54.076853+0000","last_clean":"2024-04-26T12:30:54.076853+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:30:54.076853+0000","last_undegraded":"2024-04-26T12:30:54.076853+0000","last_fullsized":"2024-04-26T12:30:54.076853+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:55.616144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":862,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.078603+0000","last_change":"2024-04-26T12:30:48.089842+0000","last_active":"2024-04-26T12:30:55.078603+0000","last_peered":"2024-04-26T12:30:55.078603+0000","last_clean":"2024-04-26T12:30:55.078603+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:30:55.078603+0000","last_undegraded":"2024-04-26T12:30:55.078603+0000","last_fullsized":"2024-04-26T12:30:55.078603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:13.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":934,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075664+0000","last_change":"2024-04-26T12:30:48.089460+0000","last_active":"2024-04-26T12:30:54.075664+0000","last_peered":"2024-04-26T12:30:54.075664+0000","last_clean":"2024-04-26T12:30:54.075664+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:30:54.075664+0000","last_undegraded":"2024-04-26T12:30:54.075664+0000","last_fullsized":"2024-04-26T12:30:54.075664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":472,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075962+0000","last_change":"2024-04-26T12:30:48.090606+0000","last_active":"2024-04-26T12:30:54.075962+0000","last_peered":"2024-04-26T12:30:54.075962+0000","last_clean":"2024-04-26T12:30:54.075962+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:30:54.075962+0000","last_undegraded":"2024-04-26T12:30:54.075962+0000","last_fullsized":"2024-04-26T12:30:54.075962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:57.446858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1023,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076470+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:30:54.076470+0000","last_peered":"2024-04-26T12:30:54.076470+0000","last_clean":"2024-04-26T12:30:54.076470+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:30:54.076470+0000","last_undegraded":"2024-04-26T12:30:54.076470+0000","last_fullsized":"2024-04-26T12:30:54.076470+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:06.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":762,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075764+0000","last_change":"2024-04-26T12:30:49.082511+0000","last_active":"2024-04-26T12:30:54.075764+0000","last_peered":"2024-04-26T12:30:54.075764+0000","last_clean":"2024-04-26T12:30:54.075764+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:30:54.075764+0000","last_undegraded":"2024-04-26T12:30:54.075764+0000","last_fullsized":"2024-04-26T12:30:54.075764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:54.832086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":496,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074978+0000","last_change":"2024-04-26T12:30:56.079114+0000","last_active":"2024-04-26T12:30:57.074978+0000","last_peered":"2024-04-26T12:30:57.074978+0000","last_clean":"2024-04-26T12:30:57.074978+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:30:57.074978+0000","last_undegraded":"2024-04-26T12:30:57.074978+0000","last_fullsized":"2024-04-26T12:30:57.074978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:37.907357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":899,"reported_epoch":80,"state":"peering","last_fresh":"2024-04-26T12:30:55.078045+0000","last_change":"2024-04-26T12:30:55.078136+0000","last_active":"2024-04-26T12:30:55.078045+0000","last_peered":"2024-04-26T12:30:54.514835+0000","last_clean":"2024-04-26T12:27:45.658876+0000","last_became_active":"2024-04-26T12:30:42.156989+0000","last_became_peered":"2024-04-26T12:30:42.156989+0000","last_unstale":"2024-04-26T12:30:55.078045+0000","last_undegraded":"2024-04-26T12:30:55.078045+0000","last_fullsized":"2024-04-26T12:30:55.078045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:52.462411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":589,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076569+0000","last_change":"2024-04-26T12:30:50.085026+0000","last_active":"2024-04-26T12:30:54.076569+0000","last_peered":"2024-04-26T12:30:54.076569+0000","last_clean":"2024-04-26T12:30:54.076569+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:30:54.076569+0000","last_undegraded":"2024-04-26T12:30:54.076569+0000","last_fullsized":"2024-04-26T12:30:54.076569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:31.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":507,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075519+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:30:54.075519+0000","last_peered":"2024-04-26T12:30:54.075519+0000","last_clean":"2024-04-26T12:30:54.075519+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:30:54.075519+0000","last_undegraded":"2024-04-26T12:30:54.075519+0000","last_fullsized":"2024-04-26T12:30:54.075519+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":878,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075751+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:30:54.075751+0000","last_peered":"2024-04-26T12:30:54.075751+0000","last_clean":"2024-04-26T12:30:54.075751+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:30:54.075751+0000","last_undegraded":"2024-04-26T12:30:54.075751+0000","last_fullsized":"2024-04-26T12:30:54.075751+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:00.467106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":515,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076440+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:30:54.076440+0000","last_peered":"2024-04-26T12:30:54.076440+0000","last_clean":"2024-04-26T12:30:54.076440+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:30:54.076440+0000","last_undegraded":"2024-04-26T12:30:54.076440+0000","last_fullsized":"2024-04-26T12:30:54.076440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":535,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075874+0000","last_change":"2024-04-26T12:30:47.080645+0000","last_active":"2024-04-26T12:30:54.075874+0000","last_peered":"2024-04-26T12:30:54.075874+0000","last_clean":"2024-04-26T12:30:54.075874+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:30:54.075874+0000","last_undegraded":"2024-04-26T12:30:54.075874+0000","last_fullsized":"2024-04-26T12:30:54.075874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:11.047331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":921,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075792+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:30:54.075792+0000","last_peered":"2024-04-26T12:30:54.075792+0000","last_clean":"2024-04-26T12:30:54.075792+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:30:54.075792+0000","last_undegraded":"2024-04-26T12:30:54.075792+0000","last_fullsized":"2024-04-26T12:30:54.075792+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:18.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":491,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074910+0000","last_change":"2024-04-26T12:30:55.090347+0000","last_active":"2024-04-26T12:30:57.074910+0000","last_peered":"2024-04-26T12:30:57.074910+0000","last_clean":"2024-04-26T12:30:57.074910+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:30:57.074910+0000","last_undegraded":"2024-04-26T12:30:57.074910+0000","last_fullsized":"2024-04-26T12:30:57.074910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:18.689900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":552,"reported_epoch":80,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T12:30:55.362795+0000","last_change":"2024-04-26T12:30:55.356468+0000","last_active":"2024-04-26T12:30:55.362795+0000","last_peered":"2024-04-26T12:30:55.362795+0000","last_clean":"2024-04-26T12:27:45.658959+0000","last_became_active":"2024-04-26T12:30:42.163023+0000","last_became_peered":"2024-04-26T12:30:42.163023+0000","last_unstale":"2024-04-26T12:30:55.362795+0000","last_undegraded":"2024-04-26T12:30:55.362795+0000","last_fullsized":"2024-04-26T12:30:42.044616+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:50.561555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":524,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074493+0000","last_change":"2024-04-26T12:30:51.076894+0000","last_active":"2024-04-26T12:30:57.074493+0000","last_peered":"2024-04-26T12:30:57.074493+0000","last_clean":"2024-04-26T12:30:57.074493+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:30:57.074493+0000","last_undegraded":"2024-04-26T12:30:57.074493+0000","last_fullsized":"2024-04-26T12:30:57.074493+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:50.091007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1065,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076706+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:30:54.076706+0000","last_peered":"2024-04-26T12:30:54.076706+0000","last_clean":"2024-04-26T12:30:54.076706+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:30:54.076706+0000","last_undegraded":"2024-04-26T12:30:54.076706+0000","last_fullsized":"2024-04-26T12:30:54.076706+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:26.268194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":947,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076191+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:30:54.076191+0000","last_peered":"2024-04-26T12:30:54.076191+0000","last_clean":"2024-04-26T12:30:54.076191+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:30:54.076191+0000","last_undegraded":"2024-04-26T12:30:54.076191+0000","last_fullsized":"2024-04-26T12:30:54.076191+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:12.535434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":575,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075781+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:30:54.075781+0000","last_peered":"2024-04-26T12:30:54.075781+0000","last_clean":"2024-04-26T12:30:54.075781+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:30:54.075781+0000","last_undegraded":"2024-04-26T12:30:54.075781+0000","last_fullsized":"2024-04-26T12:30:54.075781+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":514,"reported_epoch":79,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:54.075270+0000","last_change":"2024-04-26T12:30:47.082934+0000","last_active":"2024-04-26T12:30:54.075270+0000","last_peered":"2024-04-26T12:30:54.075270+0000","last_clean":"2024-04-26T12:30:39.001294+0000","last_became_active":"2024-04-26T12:30:47.081126+0000","last_became_peered":"2024-04-26T12:30:47.081126+0000","last_unstale":"2024-04-26T12:30:54.075270+0000","last_undegraded":"2024-04-26T12:30:54.075270+0000","last_fullsized":"2024-04-26T12:30:54.075270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:47.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":179,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":610,"reported_epoch":79,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T12:30:54.076689+0000","last_change":"2024-04-26T12:30:42.168459+0000","last_active":"2024-04-26T12:30:54.076689+0000","last_peered":"2024-04-26T12:30:54.076689+0000","last_clean":"2024-04-26T12:27:45.658199+0000","last_became_active":"2024-04-26T12:30:42.163138+0000","last_became_peered":"2024-04-26T12:30:42.163138+0000","last_unstale":"2024-04-26T12:30:54.076689+0000","last_undegraded":"2024-04-26T12:30:42.014270+0000","last_fullsized":"2024-04-26T12:30:42.005688+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:33.001689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":543,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.077149+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:30:54.077149+0000","last_peered":"2024-04-26T12:30:54.077149+0000","last_clean":"2024-04-26T12:30:54.077149+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:30:54.077149+0000","last_undegraded":"2024-04-26T12:30:54.077149+0000","last_fullsized":"2024-04-26T12:30:54.077149+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":583,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.075344+0000","last_change":"2024-04-26T12:30:46.089997+0000","last_active":"2024-04-26T12:30:57.075344+0000","last_peered":"2024-04-26T12:30:57.075344+0000","last_clean":"2024-04-26T12:30:57.075344+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:30:57.075344+0000","last_undegraded":"2024-04-26T12:30:57.075344+0000","last_fullsized":"2024-04-26T12:30:57.075344+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:08.843126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":508,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076720+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:30:54.076720+0000","last_peered":"2024-04-26T12:30:54.076720+0000","last_clean":"2024-04-26T12:30:54.076720+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:30:54.076720+0000","last_undegraded":"2024-04-26T12:30:54.076720+0000","last_fullsized":"2024-04-26T12:30:54.076720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":562,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075734+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:30:54.075734+0000","last_peered":"2024-04-26T12:30:54.075734+0000","last_clean":"2024-04-26T12:30:54.075734+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:30:54.075734+0000","last_undegraded":"2024-04-26T12:30:54.075734+0000","last_fullsized":"2024-04-26T12:30:54.075734+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:21.302173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":477,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076616+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:30:54.076616+0000","last_peered":"2024-04-26T12:30:54.076616+0000","last_clean":"2024-04-26T12:30:54.076616+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:30:54.076616+0000","last_undegraded":"2024-04-26T12:30:54.076616+0000","last_fullsized":"2024-04-26T12:30:54.076616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":408,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073705+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:30:57.073705+0000","last_peered":"2024-04-26T12:30:57.073705+0000","last_clean":"2024-04-26T12:30:57.073705+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:30:57.073705+0000","last_undegraded":"2024-04-26T12:30:57.073705+0000","last_fullsized":"2024-04-26T12:30:57.073705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.762427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:30:58.081169+0000","last_change":"2024-04-26T12:30:58.081169+0000","last_active":"2024-04-26T12:30:58.081169+0000","last_peered":"2024-04-26T12:30:58.081169+0000","last_clean":"2024-04-26T12:30:58.081169+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:30:58.081169+0000","last_undegraded":"2024-04-26T12:30:58.081169+0000","last_fullsized":"2024-04-26T12:30:58.081169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:42.618440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"58'708","reported_seq":776,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073660+0000","last_change":"2024-04-26T12:30:44.022038+0000","last_active":"2024-04-26T12:30:57.073660+0000","last_peered":"2024-04-26T12:30:57.073660+0000","last_clean":"2024-04-26T12:30:57.073660+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:30:57.073660+0000","last_undegraded":"2024-04-26T12:30:57.073660+0000","last_fullsized":"2024-04-26T12:30:57.073660+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:30.369118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":494,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.077110+0000","last_change":"2024-04-26T12:30:47.081417+0000","last_active":"2024-04-26T12:30:54.077110+0000","last_peered":"2024-04-26T12:30:54.077110+0000","last_clean":"2024-04-26T12:30:54.077110+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:30:54.077110+0000","last_undegraded":"2024-04-26T12:30:54.077110+0000","last_fullsized":"2024-04-26T12:30:54.077110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:17.628933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074746+0000","last_change":"2024-04-26T12:30:41.018067+0000","last_active":"2024-04-26T12:30:57.074746+0000","last_peered":"2024-04-26T12:30:57.074746+0000","last_clean":"2024-04-26T12:30:57.074746+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:30:57.074746+0000","last_undegraded":"2024-04-26T12:30:57.074746+0000","last_fullsized":"2024-04-26T12:30:57.074746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:33.684743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":592,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:30:58.081823+0000","last_change":"2024-04-26T12:30:58.081823+0000","last_active":"2024-04-26T12:30:58.081823+0000","last_peered":"2024-04-26T12:30:58.081823+0000","last_clean":"2024-04-26T12:30:58.081823+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:30:58.081823+0000","last_undegraded":"2024-04-26T12:30:58.081823+0000","last_fullsized":"2024-04-26T12:30:58.081823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.109302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"58'355","reported_seq":372,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076603+0000","last_change":"2024-04-26T12:30:48.086933+0000","last_active":"2024-04-26T12:30:54.076603+0000","last_peered":"2024-04-26T12:30:54.076603+0000","last_clean":"2024-04-26T12:30:54.076603+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:30:54.076603+0000","last_undegraded":"2024-04-26T12:30:54.076603+0000","last_fullsized":"2024-04-26T12:30:54.076603+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:49.737283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":718,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073774+0000","last_change":"2024-04-26T12:30:46.034642+0000","last_active":"2024-04-26T12:30:57.073774+0000","last_peered":"2024-04-26T12:30:57.073774+0000","last_clean":"2024-04-26T12:30:57.073774+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:30:57.073774+0000","last_undegraded":"2024-04-26T12:30:57.073774+0000","last_fullsized":"2024-04-26T12:30:57.073774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.961343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":162,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076632+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:30:54.076632+0000","last_peered":"2024-04-26T12:30:54.076632+0000","last_clean":"2024-04-26T12:30:54.076632+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:30:54.076632+0000","last_undegraded":"2024-04-26T12:30:54.076632+0000","last_fullsized":"2024-04-26T12:30:54.076632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":509,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073886+0000","last_change":"2024-04-26T12:30:45.022716+0000","last_active":"2024-04-26T12:30:57.073886+0000","last_peered":"2024-04-26T12:30:57.073886+0000","last_clean":"2024-04-26T12:30:57.073886+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:30:57.073886+0000","last_undegraded":"2024-04-26T12:30:57.073886+0000","last_fullsized":"2024-04-26T12:30:57.073886+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:01.269901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'374","reported_seq":434,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076492+0000","last_change":"2024-04-26T12:30:46.079618+0000","last_active":"2024-04-26T12:30:54.076492+0000","last_peered":"2024-04-26T12:30:54.076492+0000","last_clean":"2024-04-26T12:30:54.076492+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:30:54.076492+0000","last_undegraded":"2024-04-26T12:30:54.076492+0000","last_fullsized":"2024-04-26T12:30:54.076492+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:48.209628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":501,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076690+0000","last_change":"2024-04-26T12:30:47.082596+0000","last_active":"2024-04-26T12:30:54.076690+0000","last_peered":"2024-04-26T12:30:54.076690+0000","last_clean":"2024-04-26T12:30:54.076690+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:30:54.076690+0000","last_undegraded":"2024-04-26T12:30:54.076690+0000","last_fullsized":"2024-04-26T12:30:54.076690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:34.688913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":643,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076568+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:30:54.076568+0000","last_peered":"2024-04-26T12:30:54.076568+0000","last_clean":"2024-04-26T12:30:54.076568+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:30:54.076568+0000","last_undegraded":"2024-04-26T12:30:54.076568+0000","last_fullsized":"2024-04-26T12:30:54.076568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:50.674218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":789,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075625+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:30:54.075625+0000","last_peered":"2024-04-26T12:30:54.075625+0000","last_clean":"2024-04-26T12:30:54.075625+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:30:54.075625+0000","last_undegraded":"2024-04-26T12:30:54.075625+0000","last_fullsized":"2024-04-26T12:30:54.075625+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:11.548975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073840+0000","last_change":"2024-04-26T12:30:46.089052+0000","last_active":"2024-04-26T12:30:57.073840+0000","last_peered":"2024-04-26T12:30:57.073840+0000","last_clean":"2024-04-26T12:30:57.073840+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:30:57.073840+0000","last_undegraded":"2024-04-26T12:30:57.073840+0000","last_fullsized":"2024-04-26T12:30:57.073840+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:28.433853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":855,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076324+0000","last_change":"2024-04-26T12:30:50.086492+0000","last_active":"2024-04-26T12:30:54.076324+0000","last_peered":"2024-04-26T12:30:54.076324+0000","last_clean":"2024-04-26T12:30:54.076324+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:30:54.076324+0000","last_undegraded":"2024-04-26T12:30:54.076324+0000","last_fullsized":"2024-04-26T12:30:54.076324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:18.705037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075615+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:30:54.075615+0000","last_peered":"2024-04-26T12:30:54.075615+0000","last_clean":"2024-04-26T12:30:54.075615+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:30:54.075615+0000","last_undegraded":"2024-04-26T12:30:54.075615+0000","last_fullsized":"2024-04-26T12:30:54.075615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":491,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-26T12:30:58.077112+0000","last_change":"2024-04-26T12:30:58.077112+0000","last_active":"2024-04-26T12:30:40.012414+0000","last_peered":"2024-04-26T12:30:39.001966+0000","last_clean":"2024-04-26T12:30:39.001966+0000","last_became_active":"2024-04-26T12:28:29.803352+0000","last_became_peered":"2024-04-26T12:28:29.803352+0000","last_unstale":"2024-04-26T12:30:58.077112+0000","last_undegraded":"2024-04-26T12:30:58.077112+0000","last_fullsized":"2024-04-26T12:30:58.077112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:12.256084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'54","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076213+0000","last_change":"2024-04-26T12:30:46.082166+0000","last_active":"2024-04-26T12:30:54.076213+0000","last_peered":"2024-04-26T12:30:54.076213+0000","last_clean":"2024-04-26T12:30:54.076213+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:30:54.076213+0000","last_undegraded":"2024-04-26T12:30:54.076213+0000","last_fullsized":"2024-04-26T12:30:54.076213+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:28.037535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":529,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-26T12:30:58.077156+0000","last_change":"2024-04-26T12:30:58.077156+0000","last_active":"2024-04-26T12:30:40.009415+0000","last_peered":"2024-04-26T12:30:39.002391+0000","last_clean":"2024-04-26T12:30:39.002391+0000","last_became_active":"2024-04-26T12:28:29.803545+0000","last_became_peered":"2024-04-26T12:28:29.803545+0000","last_unstale":"2024-04-26T12:30:58.077156+0000","last_undegraded":"2024-04-26T12:30:58.077156+0000","last_fullsized":"2024-04-26T12:30:58.077156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:17.958035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'186","reported_seq":204,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076622+0000","last_change":"2024-04-26T12:30:46.080074+0000","last_active":"2024-04-26T12:30:54.076622+0000","last_peered":"2024-04-26T12:30:54.076622+0000","last_clean":"2024-04-26T12:30:54.076622+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:30:54.076622+0000","last_undegraded":"2024-04-26T12:30:54.076622+0000","last_fullsized":"2024-04-26T12:30:54.076622+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:24.562647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":526,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075238+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:30:54.075238+0000","last_peered":"2024-04-26T12:30:54.075238+0000","last_clean":"2024-04-26T12:30:54.075238+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:30:54.075238+0000","last_undegraded":"2024-04-26T12:30:54.075238+0000","last_fullsized":"2024-04-26T12:30:54.075238+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":435,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076300+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:30:54.076300+0000","last_peered":"2024-04-26T12:30:54.076300+0000","last_clean":"2024-04-26T12:30:54.076300+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:30:54.076300+0000","last_undegraded":"2024-04-26T12:30:54.076300+0000","last_fullsized":"2024-04-26T12:30:54.076300+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:40.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":971,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075907+0000","last_change":"2024-04-26T12:30:52.078990+0000","last_active":"2024-04-26T12:30:54.075907+0000","last_peered":"2024-04-26T12:30:54.075907+0000","last_clean":"2024-04-26T12:30:54.075907+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:30:54.075907+0000","last_undegraded":"2024-04-26T12:30:54.075907+0000","last_fullsized":"2024-04-26T12:30:54.075907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.697122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":509,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076714+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:30:54.076714+0000","last_peered":"2024-04-26T12:30:54.076714+0000","last_clean":"2024-04-26T12:30:54.076714+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:30:54.076714+0000","last_undegraded":"2024-04-26T12:30:54.076714+0000","last_fullsized":"2024-04-26T12:30:54.076714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:18.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":486,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076194+0000","last_change":"2024-04-26T12:30:48.089200+0000","last_active":"2024-04-26T12:30:54.076194+0000","last_peered":"2024-04-26T12:30:54.076194+0000","last_clean":"2024-04-26T12:30:54.076194+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:30:54.076194+0000","last_undegraded":"2024-04-26T12:30:54.076194+0000","last_fullsized":"2024-04-26T12:30:54.076194+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:04.588329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076209+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:54.076209+0000","last_peered":"2024-04-26T12:30:54.076209+0000","last_clean":"2024-04-26T12:30:54.076209+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:30:54.076209+0000","last_undegraded":"2024-04-26T12:30:54.076209+0000","last_fullsized":"2024-04-26T12:30:54.076209+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:40.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":557,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074143+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:30:57.074143+0000","last_peered":"2024-04-26T12:30:57.074143+0000","last_clean":"2024-04-26T12:30:57.074143+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:30:57.074143+0000","last_undegraded":"2024-04-26T12:30:57.074143+0000","last_fullsized":"2024-04-26T12:30:57.074143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.230823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":250,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074084+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:30:57.074084+0000","last_peered":"2024-04-26T12:30:57.074084+0000","last_clean":"2024-04-26T12:30:57.074084+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:30:57.074084+0000","last_undegraded":"2024-04-26T12:30:57.074084+0000","last_fullsized":"2024-04-26T12:30:57.074084+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:30.864621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":532,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076248+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:30:54.076248+0000","last_peered":"2024-04-26T12:30:54.076248+0000","last_clean":"2024-04-26T12:30:54.076248+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:30:54.076248+0000","last_undegraded":"2024-04-26T12:30:54.076248+0000","last_fullsized":"2024-04-26T12:30:54.076248+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:13.427584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076054+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:30:54.076054+0000","last_peered":"2024-04-26T12:30:54.076054+0000","last_clean":"2024-04-26T12:30:54.076054+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:30:54.076054+0000","last_undegraded":"2024-04-26T12:30:54.076054+0000","last_fullsized":"2024-04-26T12:30:54.076054+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:16.260550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":478,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076963+0000","last_change":"2024-04-26T12:30:47.083054+0000","last_active":"2024-04-26T12:30:54.076963+0000","last_peered":"2024-04-26T12:30:54.076963+0000","last_clean":"2024-04-26T12:30:54.076963+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:30:54.076963+0000","last_undegraded":"2024-04-26T12:30:54.076963+0000","last_fullsized":"2024-04-26T12:30:54.076963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.645638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":157,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075339+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:30:54.075339+0000","last_peered":"2024-04-26T12:30:54.075339+0000","last_clean":"2024-04-26T12:30:54.075339+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:30:54.075339+0000","last_undegraded":"2024-04-26T12:30:54.075339+0000","last_fullsized":"2024-04-26T12:30:54.075339+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:20.988072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":487,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076864+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:30:54.076864+0000","last_peered":"2024-04-26T12:30:54.076864+0000","last_clean":"2024-04-26T12:30:54.076864+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:30:54.076864+0000","last_undegraded":"2024-04-26T12:30:54.076864+0000","last_fullsized":"2024-04-26T12:30:54.076864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":583,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076124+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:30:54.076124+0000","last_peered":"2024-04-26T12:30:54.076124+0000","last_clean":"2024-04-26T12:30:54.076124+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:30:54.076124+0000","last_undegraded":"2024-04-26T12:30:54.076124+0000","last_fullsized":"2024-04-26T12:30:54.076124+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:25.266771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":496,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074845+0000","last_change":"2024-04-26T12:30:55.090354+0000","last_active":"2024-04-26T12:30:57.074845+0000","last_peered":"2024-04-26T12:30:57.074845+0000","last_clean":"2024-04-26T12:30:57.074845+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:30:57.074845+0000","last_undegraded":"2024-04-26T12:30:57.074845+0000","last_fullsized":"2024-04-26T12:30:57.074845+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:14.455369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074352+0000","last_change":"2024-04-26T12:30:41.026049+0000","last_active":"2024-04-26T12:30:57.074352+0000","last_peered":"2024-04-26T12:30:57.074352+0000","last_clean":"2024-04-26T12:30:57.074352+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:30:57.074352+0000","last_undegraded":"2024-04-26T12:30:57.074352+0000","last_fullsized":"2024-04-26T12:30:57.074352+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.409817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"58'454","reported_seq":475,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076846+0000","last_change":"2024-04-26T12:30:46.079367+0000","last_active":"2024-04-26T12:30:54.076846+0000","last_peered":"2024-04-26T12:30:54.076846+0000","last_clean":"2024-04-26T12:30:54.076846+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:30:54.076846+0000","last_undegraded":"2024-04-26T12:30:54.076846+0000","last_fullsized":"2024-04-26T12:30:54.076846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:00.950370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":467,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075820+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:30:54.075820+0000","last_peered":"2024-04-26T12:30:54.075820+0000","last_clean":"2024-04-26T12:30:54.075820+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:30:54.075820+0000","last_undegraded":"2024-04-26T12:30:54.075820+0000","last_fullsized":"2024-04-26T12:30:54.075820+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076309+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:30:54.076309+0000","last_peered":"2024-04-26T12:30:54.076309+0000","last_clean":"2024-04-26T12:30:54.076309+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:30:54.076309+0000","last_undegraded":"2024-04-26T12:30:54.076309+0000","last_fullsized":"2024-04-26T12:30:54.076309+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:16.686041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076322+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:54.076322+0000","last_peered":"2024-04-26T12:30:54.076322+0000","last_clean":"2024-04-26T12:30:54.076322+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:30:54.076322+0000","last_undegraded":"2024-04-26T12:30:54.076322+0000","last_fullsized":"2024-04-26T12:30:54.076322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:18.069937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":497,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074267+0000","last_change":"2024-04-26T12:30:46.033999+0000","last_active":"2024-04-26T12:30:57.074267+0000","last_peered":"2024-04-26T12:30:57.074267+0000","last_clean":"2024-04-26T12:30:57.074267+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:30:57.074267+0000","last_undegraded":"2024-04-26T12:30:57.074267+0000","last_fullsized":"2024-04-26T12:30:57.074267+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:33.235467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073919+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:30:57.073919+0000","last_peered":"2024-04-26T12:30:57.073919+0000","last_clean":"2024-04-26T12:30:57.073919+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:30:57.073919+0000","last_undegraded":"2024-04-26T12:30:57.073919+0000","last_fullsized":"2024-04-26T12:30:57.073919+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:20.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":393,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T12:30:55.076477+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:30:55.076477+0000","last_peered":"2024-04-26T12:30:55.076477+0000","last_clean":"2024-04-26T12:30:55.076477+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:30:55.076477+0000","last_undegraded":"2024-04-26T12:30:55.076477+0000","last_fullsized":"2024-04-26T12:30:55.076477+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":430,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074784+0000","last_change":"2024-04-26T12:30:54.081099+0000","last_active":"2024-04-26T12:30:57.074784+0000","last_peered":"2024-04-26T12:30:57.074784+0000","last_clean":"2024-04-26T12:30:57.074784+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:30:57.074784+0000","last_undegraded":"2024-04-26T12:30:57.074784+0000","last_fullsized":"2024-04-26T12:30:57.074784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:29.507250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076582+0000","last_change":"2024-04-26T12:30:46.082961+0000","last_active":"2024-04-26T12:30:54.076582+0000","last_peered":"2024-04-26T12:30:54.076582+0000","last_clean":"2024-04-26T12:30:54.076582+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:30:54.076582+0000","last_undegraded":"2024-04-26T12:30:54.076582+0000","last_fullsized":"2024-04-26T12:30:54.076582+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:10.764587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":258,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075901+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:30:54.075901+0000","last_peered":"2024-04-26T12:30:54.075901+0000","last_clean":"2024-04-26T12:30:54.075901+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:30:54.075901+0000","last_undegraded":"2024-04-26T12:30:54.075901+0000","last_fullsized":"2024-04-26T12:30:54.075901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:23.542209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":596,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073940+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:30:57.073940+0000","last_peered":"2024-04-26T12:30:57.073940+0000","last_clean":"2024-04-26T12:30:57.073940+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:30:57.073940+0000","last_undegraded":"2024-04-26T12:30:57.073940+0000","last_fullsized":"2024-04-26T12:30:57.073940+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:05.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":559,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076976+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:30:54.076976+0000","last_peered":"2024-04-26T12:30:54.076976+0000","last_clean":"2024-04-26T12:30:54.076976+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:30:54.076976+0000","last_undegraded":"2024-04-26T12:30:54.076976+0000","last_fullsized":"2024-04-26T12:30:54.076976+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075904+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:30:54.075904+0000","last_peered":"2024-04-26T12:30:54.075904+0000","last_clean":"2024-04-26T12:30:54.075904+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:30:54.075904+0000","last_undegraded":"2024-04-26T12:30:54.075904+0000","last_fullsized":"2024-04-26T12:30:54.075904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'105","reported_seq":220,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074099+0000","last_change":"2024-04-26T12:30:44.028851+0000","last_active":"2024-04-26T12:30:57.074099+0000","last_peered":"2024-04-26T12:30:57.074099+0000","last_clean":"2024-04-26T12:30:57.074099+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:30:57.074099+0000","last_undegraded":"2024-04-26T12:30:57.074099+0000","last_fullsized":"2024-04-26T12:30:57.074099+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:13.939165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":954,"reported_epoch":80,"state":"active+undersized+remapped","last_fresh":"2024-04-26T12:30:55.354831+0000","last_change":"2024-04-26T12:30:55.355011+0000","last_active":"2024-04-26T12:30:55.354831+0000","last_peered":"2024-04-26T12:30:55.354831+0000","last_clean":"2024-04-26T12:27:45.658919+0000","last_became_active":"2024-04-26T12:30:42.157001+0000","last_became_peered":"2024-04-26T12:30:42.157001+0000","last_unstale":"2024-04-26T12:30:55.354831+0000","last_undegraded":"2024-04-26T12:30:55.354831+0000","last_fullsized":"2024-04-26T12:30:42.041964+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:06.285978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076790+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:30:54.076790+0000","last_peered":"2024-04-26T12:30:54.076790+0000","last_clean":"2024-04-26T12:30:54.076790+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:30:54.076790+0000","last_undegraded":"2024-04-26T12:30:54.076790+0000","last_fullsized":"2024-04-26T12:30:54.076790+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:31.181549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074439+0000","last_change":"2024-04-26T12:30:41.026137+0000","last_active":"2024-04-26T12:30:57.074439+0000","last_peered":"2024-04-26T12:30:57.074439+0000","last_clean":"2024-04-26T12:30:57.074439+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:30:57.074439+0000","last_undegraded":"2024-04-26T12:30:57.074439+0000","last_fullsized":"2024-04-26T12:30:57.074439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:08.225745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":514,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075635+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:30:54.075635+0000","last_peered":"2024-04-26T12:30:54.075635+0000","last_clean":"2024-04-26T12:30:54.075635+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:30:54.075635+0000","last_undegraded":"2024-04-26T12:30:54.075635+0000","last_fullsized":"2024-04-26T12:30:54.075635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074635+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:30:57.074635+0000","last_peered":"2024-04-26T12:30:57.074635+0000","last_clean":"2024-04-26T12:30:57.074635+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:30:57.074635+0000","last_undegraded":"2024-04-26T12:30:57.074635+0000","last_fullsized":"2024-04-26T12:30:57.074635+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:51.609322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074557+0000","last_change":"2024-04-26T12:30:41.030157+0000","last_active":"2024-04-26T12:30:57.074557+0000","last_peered":"2024-04-26T12:30:57.074557+0000","last_clean":"2024-04-26T12:30:57.074557+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:57.074557+0000","last_undegraded":"2024-04-26T12:30:57.074557+0000","last_fullsized":"2024-04-26T12:30:57.074557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:32.867679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":518,"reported_epoch":79,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:54.075180+0000","last_change":"2024-04-26T12:30:47.084724+0000","last_active":"2024-04-26T12:30:54.075180+0000","last_peered":"2024-04-26T12:30:54.075180+0000","last_clean":"2024-04-26T12:30:39.001153+0000","last_became_active":"2024-04-26T12:30:47.083601+0000","last_became_peered":"2024-04-26T12:30:47.083601+0000","last_unstale":"2024-04-26T12:30:54.075180+0000","last_undegraded":"2024-04-26T12:30:54.075180+0000","last_fullsized":"2024-04-26T12:30:54.075180+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:00.234562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":184,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076673+0000","last_change":"2024-04-26T12:30:46.080509+0000","last_active":"2024-04-26T12:30:54.076673+0000","last_peered":"2024-04-26T12:30:54.076673+0000","last_clean":"2024-04-26T12:30:54.076673+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:30:54.076673+0000","last_undegraded":"2024-04-26T12:30:54.076673+0000","last_fullsized":"2024-04-26T12:30:54.076673+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:40.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'82","reported_seq":59,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074820+0000","last_change":"2024-04-26T12:30:46.086027+0000","last_active":"2024-04-26T12:30:57.074820+0000","last_peered":"2024-04-26T12:30:57.074820+0000","last_clean":"2024-04-26T12:30:57.074820+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:30:57.074820+0000","last_undegraded":"2024-04-26T12:30:57.074820+0000","last_fullsized":"2024-04-26T12:30:57.074820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:13.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":600,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075626+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:30:54.075626+0000","last_peered":"2024-04-26T12:30:54.075626+0000","last_clean":"2024-04-26T12:30:54.075626+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:30:54.075626+0000","last_undegraded":"2024-04-26T12:30:54.075626+0000","last_fullsized":"2024-04-26T12:30:54.075626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":168,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075750+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:30:54.075750+0000","last_peered":"2024-04-26T12:30:54.075750+0000","last_clean":"2024-04-26T12:30:54.075750+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:30:54.075750+0000","last_undegraded":"2024-04-26T12:30:54.075750+0000","last_fullsized":"2024-04-26T12:30:54.075750+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.312112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":850,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075851+0000","last_change":"2024-04-26T12:30:53.079043+0000","last_active":"2024-04-26T12:30:54.075851+0000","last_peered":"2024-04-26T12:30:54.075851+0000","last_clean":"2024-04-26T12:30:54.075851+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:30:54.075851+0000","last_undegraded":"2024-04-26T12:30:54.075851+0000","last_fullsized":"2024-04-26T12:30:54.075851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:00.091756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076362+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:30:54.076362+0000","last_peered":"2024-04-26T12:30:54.076362+0000","last_clean":"2024-04-26T12:30:54.076362+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:30:54.076362+0000","last_undegraded":"2024-04-26T12:30:54.076362+0000","last_fullsized":"2024-04-26T12:30:54.076362+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:43.044883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":793,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076256+0000","last_change":"2024-04-26T12:30:48.088039+0000","last_active":"2024-04-26T12:30:54.076256+0000","last_peered":"2024-04-26T12:30:54.076256+0000","last_clean":"2024-04-26T12:30:54.076256+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:30:54.076256+0000","last_undegraded":"2024-04-26T12:30:54.076256+0000","last_fullsized":"2024-04-26T12:30:54.076256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:03.967118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"58'314","reported_seq":390,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076238+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:30:54.076238+0000","last_peered":"2024-04-26T12:30:54.076238+0000","last_clean":"2024-04-26T12:30:54.076238+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:30:54.076238+0000","last_undegraded":"2024-04-26T12:30:54.076238+0000","last_fullsized":"2024-04-26T12:30:54.076238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":867,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076084+0000","last_change":"2024-04-26T12:30:52.079092+0000","last_active":"2024-04-26T12:30:54.076084+0000","last_peered":"2024-04-26T12:30:54.076084+0000","last_clean":"2024-04-26T12:30:54.076084+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:30:54.076084+0000","last_undegraded":"2024-04-26T12:30:54.076084+0000","last_fullsized":"2024-04-26T12:30:54.076084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:10.253347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"58'76","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074650+0000","last_change":"2024-04-26T12:30:41.050653+0000","last_active":"2024-04-26T12:30:57.074650+0000","last_peered":"2024-04-26T12:30:57.074650+0000","last_clean":"2024-04-26T12:30:57.074650+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:57.074650+0000","last_undegraded":"2024-04-26T12:30:57.074650+0000","last_fullsized":"2024-04-26T12:30:57.074650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:17.874875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":537,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075764+0000","last_change":"2024-04-26T12:28:00.707724+0000","last_active":"2024-04-26T12:30:54.075764+0000","last_peered":"2024-04-26T12:30:54.075764+0000","last_clean":"2024-04-26T12:30:54.075764+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:30:54.075764+0000","last_undegraded":"2024-04-26T12:30:54.075764+0000","last_fullsized":"2024-04-26T12:30:54.075764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:20.384961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074845+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:30:57.074845+0000","last_peered":"2024-04-26T12:30:57.074845+0000","last_clean":"2024-04-26T12:30:57.074845+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:30:57.074845+0000","last_undegraded":"2024-04-26T12:30:57.074845+0000","last_fullsized":"2024-04-26T12:30:57.074845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:40.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":962,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076157+0000","last_change":"2024-04-26T12:30:51.076207+0000","last_active":"2024-04-26T12:30:54.076157+0000","last_peered":"2024-04-26T12:30:54.076157+0000","last_clean":"2024-04-26T12:30:54.076157+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:30:54.076157+0000","last_undegraded":"2024-04-26T12:30:54.076157+0000","last_fullsized":"2024-04-26T12:30:54.076157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:05.869282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":858,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.076035+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:30:54.076035+0000","last_peered":"2024-04-26T12:30:54.076035+0000","last_clean":"2024-04-26T12:30:54.076035+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:30:54.076035+0000","last_undegraded":"2024-04-26T12:30:54.076035+0000","last_fullsized":"2024-04-26T12:30:54.076035+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:50.433671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":526,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074008+0000","last_change":"2024-04-26T12:30:54.080153+0000","last_active":"2024-04-26T12:30:57.074008+0000","last_peered":"2024-04-26T12:30:57.074008+0000","last_clean":"2024-04-26T12:30:57.074008+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:30:57.074008+0000","last_undegraded":"2024-04-26T12:30:57.074008+0000","last_fullsized":"2024-04-26T12:30:57.074008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:48.057283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":623,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075891+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:30:54.075891+0000","last_peered":"2024-04-26T12:30:54.075891+0000","last_clean":"2024-04-26T12:30:54.075891+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:30:54.075891+0000","last_undegraded":"2024-04-26T12:30:54.075891+0000","last_fullsized":"2024-04-26T12:30:54.075891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":513,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074363+0000","last_change":"2024-04-26T12:30:50.086765+0000","last_active":"2024-04-26T12:30:57.074363+0000","last_peered":"2024-04-26T12:30:57.074363+0000","last_clean":"2024-04-26T12:30:57.074363+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:30:57.074363+0000","last_undegraded":"2024-04-26T12:30:57.074363+0000","last_fullsized":"2024-04-26T12:30:57.074363+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:36.313767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":506,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:30:54.075936+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:30:54.075936+0000","last_peered":"2024-04-26T12:30:54.075936+0000","last_clean":"2024-04-26T12:30:54.075936+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:30:54.075936+0000","last_undegraded":"2024-04-26T12:30:54.075936+0000","last_fullsized":"2024-04-26T12:30:54.075936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":196,"num_objects_misplaced":363,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6150,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":125,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90275840,"data_stored":285809728,"data_compressed":42864631,"data_compressed_allocated":53944320,"data_compressed_original":249548800,"omap_allocated":5343,"internal_metadata":0},"log_size":7508,"ondisk_log_size":7508,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738422,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140936,"kb_used_data":41788,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94230904,"statfs":{"total":96636764160,"available":96492445696,"internally_reserved":0,"allocated":42790912,"data_stored":115119533,"data_compressed":16083079,"data_compressed_allocated":21016576,"data_compressed_original":93810688,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.23599999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.38800000000000001}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.312},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.33500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113232,"kb_used_data":32128,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94258608,"statfs":{"total":96636764160,"available":96520814592,"internally_reserved":0,"allocated":32899072,"data_stored":91424707,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.317},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:30:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.30399999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.625,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.496},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.44600000000000001}]}]},{"osd":1,"up_from":64,"seq":274877906950,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62328,"kb_used_data":16744,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309512,"statfs":{"total":96636764160,"available":96572940288,"internally_reserved":0,"allocated":17145856,"data_stored":81539814,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41930752,"data_stored":114170599,"data_compressed":16048932,"data_compressed_allocated":20971520,"data_compressed_original":93237248,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:04.077 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:04.438 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:31:04.440 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:31:04.450 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2024-04-26T12:31:03.359624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":363,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6546,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34345,"ondisk_log_size":34345,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":232,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":323772,"kb_used_data":79884,"kb_used_omap":9,"kb_used_meta":243830,"kb_avail":282791748,"statfs":{"total":289910292480,"available":289578749952,"internally_reserved":0,"allocated":81801216,"data_stored":258767750,"data_compressed":38912668,"data_compressed_allocated":48783360,"data_compressed_original":227221504,"omap_allocated":10125,"internal_metadata":249682035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-929,"num_objects_misplaced":-530,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1445,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001605"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":900,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078535+0000","last_change":"2024-04-26T12:30:54.081113+0000","last_active":"2024-04-26T12:30:59.078535+0000","last_peered":"2024-04-26T12:30:59.078535+0000","last_clean":"2024-04-26T12:30:59.078535+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:30:59.078535+0000","last_undegraded":"2024-04-26T12:30:59.078535+0000","last_fullsized":"2024-04-26T12:30:59.078535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.062347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":956,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078130+0000","last_change":"2024-04-26T12:30:56.085870+0000","last_active":"2024-04-26T12:30:59.078130+0000","last_peered":"2024-04-26T12:30:59.078130+0000","last_clean":"2024-04-26T12:30:59.078130+0000","last_became_active":"2024-04-26T12:30:56.084642+0000","last_became_peered":"2024-04-26T12:30:56.084642+0000","last_unstale":"2024-04-26T12:30:59.078130+0000","last_undegraded":"2024-04-26T12:30:59.078130+0000","last_fullsized":"2024-04-26T12:30:59.078130+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:41.346086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":495,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078491+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:30:59.078491+0000","last_peered":"2024-04-26T12:30:59.078491+0000","last_clean":"2024-04-26T12:30:59.078491+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:30:59.078491+0000","last_undegraded":"2024-04-26T12:30:59.078491+0000","last_fullsized":"2024-04-26T12:30:59.078491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:55.616144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":867,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078158+0000","last_change":"2024-04-26T12:30:48.089842+0000","last_active":"2024-04-26T12:30:59.078158+0000","last_peered":"2024-04-26T12:30:59.078158+0000","last_clean":"2024-04-26T12:30:59.078158+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:30:59.078158+0000","last_undegraded":"2024-04-26T12:30:59.078158+0000","last_fullsized":"2024-04-26T12:30:59.078158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:13.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":939,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077433+0000","last_change":"2024-04-26T12:30:48.089460+0000","last_active":"2024-04-26T12:30:59.077433+0000","last_peered":"2024-04-26T12:30:59.077433+0000","last_clean":"2024-04-26T12:30:59.077433+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:30:59.077433+0000","last_undegraded":"2024-04-26T12:30:59.077433+0000","last_fullsized":"2024-04-26T12:30:59.077433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077152+0000","last_change":"2024-04-26T12:30:48.090606+0000","last_active":"2024-04-26T12:30:59.077152+0000","last_peered":"2024-04-26T12:30:59.077152+0000","last_clean":"2024-04-26T12:30:59.077152+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:30:59.077152+0000","last_undegraded":"2024-04-26T12:30:59.077152+0000","last_fullsized":"2024-04-26T12:30:59.077152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:57.446858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1028,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077423+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:30:59.077423+0000","last_peered":"2024-04-26T12:30:59.077423+0000","last_clean":"2024-04-26T12:30:59.077423+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:30:59.077423+0000","last_undegraded":"2024-04-26T12:30:59.077423+0000","last_fullsized":"2024-04-26T12:30:59.077423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:06.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":767,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076901+0000","last_change":"2024-04-26T12:30:49.082511+0000","last_active":"2024-04-26T12:30:59.076901+0000","last_peered":"2024-04-26T12:30:59.076901+0000","last_clean":"2024-04-26T12:30:59.076901+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:30:59.076901+0000","last_undegraded":"2024-04-26T12:30:59.076901+0000","last_fullsized":"2024-04-26T12:30:59.076901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:54.832086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":496,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074978+0000","last_change":"2024-04-26T12:30:56.079114+0000","last_active":"2024-04-26T12:30:57.074978+0000","last_peered":"2024-04-26T12:30:57.074978+0000","last_clean":"2024-04-26T12:30:57.074978+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:30:57.074978+0000","last_undegraded":"2024-04-26T12:30:57.074978+0000","last_fullsized":"2024-04-26T12:30:57.074978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:37.907357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":911,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078367+0000","last_change":"2024-04-26T12:30:56.087672+0000","last_active":"2024-04-26T12:30:59.078367+0000","last_peered":"2024-04-26T12:30:59.078367+0000","last_clean":"2024-04-26T12:30:59.078367+0000","last_became_active":"2024-04-26T12:30:56.085904+0000","last_became_peered":"2024-04-26T12:30:56.085904+0000","last_unstale":"2024-04-26T12:30:59.078367+0000","last_undegraded":"2024-04-26T12:30:59.078367+0000","last_fullsized":"2024-04-26T12:30:59.078367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:53.993298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":594,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078178+0000","last_change":"2024-04-26T12:30:50.085026+0000","last_active":"2024-04-26T12:30:59.078178+0000","last_peered":"2024-04-26T12:30:59.078178+0000","last_clean":"2024-04-26T12:30:59.078178+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:30:59.078178+0000","last_undegraded":"2024-04-26T12:30:59.078178+0000","last_fullsized":"2024-04-26T12:30:59.078178+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:31.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077591+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:30:59.077591+0000","last_peered":"2024-04-26T12:30:59.077591+0000","last_clean":"2024-04-26T12:30:59.077591+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:30:59.077591+0000","last_undegraded":"2024-04-26T12:30:59.077591+0000","last_fullsized":"2024-04-26T12:30:59.077591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":883,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077635+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:30:59.077635+0000","last_peered":"2024-04-26T12:30:59.077635+0000","last_clean":"2024-04-26T12:30:59.077635+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:30:59.077635+0000","last_undegraded":"2024-04-26T12:30:59.077635+0000","last_fullsized":"2024-04-26T12:30:59.077635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:00.467106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":520,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077571+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:30:59.077571+0000","last_peered":"2024-04-26T12:30:59.077571+0000","last_clean":"2024-04-26T12:30:59.077571+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:30:59.077571+0000","last_undegraded":"2024-04-26T12:30:59.077571+0000","last_fullsized":"2024-04-26T12:30:59.077571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":540,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077003+0000","last_change":"2024-04-26T12:30:47.080645+0000","last_active":"2024-04-26T12:30:59.077003+0000","last_peered":"2024-04-26T12:30:59.077003+0000","last_clean":"2024-04-26T12:30:59.077003+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:30:59.077003+0000","last_undegraded":"2024-04-26T12:30:59.077003+0000","last_fullsized":"2024-04-26T12:30:59.077003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:11.047331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":926,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077140+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:30:59.077140+0000","last_peered":"2024-04-26T12:30:59.077140+0000","last_clean":"2024-04-26T12:30:59.077140+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:30:59.077140+0000","last_undegraded":"2024-04-26T12:30:59.077140+0000","last_fullsized":"2024-04-26T12:30:59.077140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:18.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":491,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074910+0000","last_change":"2024-04-26T12:30:55.090347+0000","last_active":"2024-04-26T12:30:57.074910+0000","last_peered":"2024-04-26T12:30:57.074910+0000","last_clean":"2024-04-26T12:30:57.074910+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:30:57.074910+0000","last_undegraded":"2024-04-26T12:30:57.074910+0000","last_fullsized":"2024-04-26T12:30:57.074910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:18.689900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":912,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078455+0000","last_change":"2024-04-26T12:30:57.084445+0000","last_active":"2024-04-26T12:30:59.078455+0000","last_peered":"2024-04-26T12:30:59.078455+0000","last_clean":"2024-04-26T12:30:59.078455+0000","last_became_active":"2024-04-26T12:30:57.083026+0000","last_became_peered":"2024-04-26T12:30:57.083026+0000","last_unstale":"2024-04-26T12:30:59.078455+0000","last_undegraded":"2024-04-26T12:30:59.078455+0000","last_fullsized":"2024-04-26T12:30:59.078455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:26.231571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":524,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074493+0000","last_change":"2024-04-26T12:30:51.076894+0000","last_active":"2024-04-26T12:30:57.074493+0000","last_peered":"2024-04-26T12:30:57.074493+0000","last_clean":"2024-04-26T12:30:57.074493+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:30:57.074493+0000","last_undegraded":"2024-04-26T12:30:57.074493+0000","last_fullsized":"2024-04-26T12:30:57.074493+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:50.091007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1070,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078148+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:30:59.078148+0000","last_peered":"2024-04-26T12:30:59.078148+0000","last_clean":"2024-04-26T12:30:59.078148+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:30:59.078148+0000","last_undegraded":"2024-04-26T12:30:59.078148+0000","last_fullsized":"2024-04-26T12:30:59.078148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:26.268194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":952,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077199+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:30:59.077199+0000","last_peered":"2024-04-26T12:30:59.077199+0000","last_clean":"2024-04-26T12:30:59.077199+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:30:59.077199+0000","last_undegraded":"2024-04-26T12:30:59.077199+0000","last_fullsized":"2024-04-26T12:30:59.077199+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:12.535434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":580,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077653+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:30:59.077653+0000","last_peered":"2024-04-26T12:30:59.077653+0000","last_clean":"2024-04-26T12:30:59.077653+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:30:59.077653+0000","last_undegraded":"2024-04-26T12:30:59.077653+0000","last_fullsized":"2024-04-26T12:30:59.077653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":514,"reported_epoch":79,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:54.075270+0000","last_change":"2024-04-26T12:30:47.082934+0000","last_active":"2024-04-26T12:30:54.075270+0000","last_peered":"2024-04-26T12:30:54.075270+0000","last_clean":"2024-04-26T12:30:39.001294+0000","last_became_active":"2024-04-26T12:30:47.081126+0000","last_became_peered":"2024-04-26T12:30:47.081126+0000","last_unstale":"2024-04-26T12:30:54.075270+0000","last_undegraded":"2024-04-26T12:30:54.075270+0000","last_fullsized":"2024-04-26T12:30:54.075270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:47.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":179,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":1017,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078556+0000","last_change":"2024-04-26T12:30:58.079466+0000","last_active":"2024-04-26T12:30:59.078556+0000","last_peered":"2024-04-26T12:30:59.078556+0000","last_clean":"2024-04-26T12:30:59.078556+0000","last_became_active":"2024-04-26T12:30:58.078211+0000","last_became_peered":"2024-04-26T12:30:58.078211+0000","last_unstale":"2024-04-26T12:30:59.078556+0000","last_undegraded":"2024-04-26T12:30:59.078556+0000","last_fullsized":"2024-04-26T12:30:59.078556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:42.746789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078438+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:30:59.078438+0000","last_peered":"2024-04-26T12:30:59.078438+0000","last_clean":"2024-04-26T12:30:59.078438+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:30:59.078438+0000","last_undegraded":"2024-04-26T12:30:59.078438+0000","last_fullsized":"2024-04-26T12:30:59.078438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":583,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.075344+0000","last_change":"2024-04-26T12:30:46.089997+0000","last_active":"2024-04-26T12:30:57.075344+0000","last_peered":"2024-04-26T12:30:57.075344+0000","last_clean":"2024-04-26T12:30:57.075344+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:30:57.075344+0000","last_undegraded":"2024-04-26T12:30:57.075344+0000","last_fullsized":"2024-04-26T12:30:57.075344+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:08.843126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078301+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:30:59.078301+0000","last_peered":"2024-04-26T12:30:59.078301+0000","last_clean":"2024-04-26T12:30:59.078301+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:30:59.078301+0000","last_undegraded":"2024-04-26T12:30:59.078301+0000","last_fullsized":"2024-04-26T12:30:59.078301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077517+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:30:59.077517+0000","last_peered":"2024-04-26T12:30:59.077517+0000","last_clean":"2024-04-26T12:30:59.077517+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:30:59.077517+0000","last_undegraded":"2024-04-26T12:30:59.077517+0000","last_fullsized":"2024-04-26T12:30:59.077517+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:21.302173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078191+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:30:59.078191+0000","last_peered":"2024-04-26T12:30:59.078191+0000","last_clean":"2024-04-26T12:30:59.078191+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:30:59.078191+0000","last_undegraded":"2024-04-26T12:30:59.078191+0000","last_fullsized":"2024-04-26T12:30:59.078191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":408,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073705+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:30:57.073705+0000","last_peered":"2024-04-26T12:30:57.073705+0000","last_clean":"2024-04-26T12:30:57.073705+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:30:57.073705+0000","last_undegraded":"2024-04-26T12:30:57.073705+0000","last_fullsized":"2024-04-26T12:30:57.073705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.762427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:30:58.081169+0000","last_change":"2024-04-26T12:30:58.081169+0000","last_active":"2024-04-26T12:30:58.081169+0000","last_peered":"2024-04-26T12:30:58.081169+0000","last_clean":"2024-04-26T12:30:58.081169+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:30:58.081169+0000","last_undegraded":"2024-04-26T12:30:58.081169+0000","last_fullsized":"2024-04-26T12:30:58.081169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:42.618440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"58'708","reported_seq":776,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073660+0000","last_change":"2024-04-26T12:30:44.022038+0000","last_active":"2024-04-26T12:30:57.073660+0000","last_peered":"2024-04-26T12:30:57.073660+0000","last_clean":"2024-04-26T12:30:57.073660+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:30:57.073660+0000","last_undegraded":"2024-04-26T12:30:57.073660+0000","last_fullsized":"2024-04-26T12:30:57.073660+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:30.369118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078436+0000","last_change":"2024-04-26T12:30:47.081417+0000","last_active":"2024-04-26T12:30:59.078436+0000","last_peered":"2024-04-26T12:30:59.078436+0000","last_clean":"2024-04-26T12:30:59.078436+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:30:59.078436+0000","last_undegraded":"2024-04-26T12:30:59.078436+0000","last_fullsized":"2024-04-26T12:30:59.078436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:17.628933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074746+0000","last_change":"2024-04-26T12:30:41.018067+0000","last_active":"2024-04-26T12:30:57.074746+0000","last_peered":"2024-04-26T12:30:57.074746+0000","last_clean":"2024-04-26T12:30:57.074746+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:30:57.074746+0000","last_undegraded":"2024-04-26T12:30:57.074746+0000","last_fullsized":"2024-04-26T12:30:57.074746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:33.684743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":592,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:30:58.081823+0000","last_change":"2024-04-26T12:30:58.081823+0000","last_active":"2024-04-26T12:30:58.081823+0000","last_peered":"2024-04-26T12:30:58.081823+0000","last_clean":"2024-04-26T12:30:58.081823+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:30:58.081823+0000","last_undegraded":"2024-04-26T12:30:58.081823+0000","last_fullsized":"2024-04-26T12:30:58.081823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.109302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"58'355","reported_seq":377,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078258+0000","last_change":"2024-04-26T12:30:48.086933+0000","last_active":"2024-04-26T12:30:59.078258+0000","last_peered":"2024-04-26T12:30:59.078258+0000","last_clean":"2024-04-26T12:30:59.078258+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:30:59.078258+0000","last_undegraded":"2024-04-26T12:30:59.078258+0000","last_fullsized":"2024-04-26T12:30:59.078258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:49.737283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":718,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073774+0000","last_change":"2024-04-26T12:30:46.034642+0000","last_active":"2024-04-26T12:30:57.073774+0000","last_peered":"2024-04-26T12:30:57.073774+0000","last_clean":"2024-04-26T12:30:57.073774+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:30:57.073774+0000","last_undegraded":"2024-04-26T12:30:57.073774+0000","last_fullsized":"2024-04-26T12:30:57.073774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.961343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077954+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:30:59.077954+0000","last_peered":"2024-04-26T12:30:59.077954+0000","last_clean":"2024-04-26T12:30:59.077954+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:30:59.077954+0000","last_undegraded":"2024-04-26T12:30:59.077954+0000","last_fullsized":"2024-04-26T12:30:59.077954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":509,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073886+0000","last_change":"2024-04-26T12:30:45.022716+0000","last_active":"2024-04-26T12:30:57.073886+0000","last_peered":"2024-04-26T12:30:57.073886+0000","last_clean":"2024-04-26T12:30:57.073886+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:30:57.073886+0000","last_undegraded":"2024-04-26T12:30:57.073886+0000","last_fullsized":"2024-04-26T12:30:57.073886+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:01.269901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'374","reported_seq":439,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078040+0000","last_change":"2024-04-26T12:30:46.079618+0000","last_active":"2024-04-26T12:30:59.078040+0000","last_peered":"2024-04-26T12:30:59.078040+0000","last_clean":"2024-04-26T12:30:59.078040+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:30:59.078040+0000","last_undegraded":"2024-04-26T12:30:59.078040+0000","last_fullsized":"2024-04-26T12:30:59.078040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:48.209628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":506,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077751+0000","last_change":"2024-04-26T12:30:47.082596+0000","last_active":"2024-04-26T12:30:59.077751+0000","last_peered":"2024-04-26T12:30:59.077751+0000","last_clean":"2024-04-26T12:30:59.077751+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:30:59.077751+0000","last_undegraded":"2024-04-26T12:30:59.077751+0000","last_fullsized":"2024-04-26T12:30:59.077751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:34.688913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":648,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077638+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:30:59.077638+0000","last_peered":"2024-04-26T12:30:59.077638+0000","last_clean":"2024-04-26T12:30:59.077638+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:30:59.077638+0000","last_undegraded":"2024-04-26T12:30:59.077638+0000","last_fullsized":"2024-04-26T12:30:59.077638+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:50.674218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":794,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078066+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:30:59.078066+0000","last_peered":"2024-04-26T12:30:59.078066+0000","last_clean":"2024-04-26T12:30:59.078066+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:30:59.078066+0000","last_undegraded":"2024-04-26T12:30:59.078066+0000","last_fullsized":"2024-04-26T12:30:59.078066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:11.548975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073840+0000","last_change":"2024-04-26T12:30:46.089052+0000","last_active":"2024-04-26T12:30:57.073840+0000","last_peered":"2024-04-26T12:30:57.073840+0000","last_clean":"2024-04-26T12:30:57.073840+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:30:57.073840+0000","last_undegraded":"2024-04-26T12:30:57.073840+0000","last_fullsized":"2024-04-26T12:30:57.073840+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:28.433853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":860,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078103+0000","last_change":"2024-04-26T12:30:50.086492+0000","last_active":"2024-04-26T12:30:59.078103+0000","last_peered":"2024-04-26T12:30:59.078103+0000","last_clean":"2024-04-26T12:30:59.078103+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:30:59.078103+0000","last_undegraded":"2024-04-26T12:30:59.078103+0000","last_fullsized":"2024-04-26T12:30:59.078103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:18.705037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077626+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:30:59.077626+0000","last_peered":"2024-04-26T12:30:59.077626+0000","last_clean":"2024-04-26T12:30:59.077626+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:30:59.077626+0000","last_undegraded":"2024-04-26T12:30:59.077626+0000","last_fullsized":"2024-04-26T12:30:59.077626+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":491,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-26T12:30:58.077112+0000","last_change":"2024-04-26T12:30:58.077112+0000","last_active":"2024-04-26T12:30:40.012414+0000","last_peered":"2024-04-26T12:30:39.001966+0000","last_clean":"2024-04-26T12:30:39.001966+0000","last_became_active":"2024-04-26T12:28:29.803352+0000","last_became_peered":"2024-04-26T12:28:29.803352+0000","last_unstale":"2024-04-26T12:30:58.077112+0000","last_undegraded":"2024-04-26T12:30:58.077112+0000","last_fullsized":"2024-04-26T12:30:58.077112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:12.256084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'54","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077588+0000","last_change":"2024-04-26T12:30:46.082166+0000","last_active":"2024-04-26T12:30:59.077588+0000","last_peered":"2024-04-26T12:30:59.077588+0000","last_clean":"2024-04-26T12:30:59.077588+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:30:59.077588+0000","last_undegraded":"2024-04-26T12:30:59.077588+0000","last_fullsized":"2024-04-26T12:30:59.077588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:28.037535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":529,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-26T12:30:58.077156+0000","last_change":"2024-04-26T12:30:58.077156+0000","last_active":"2024-04-26T12:30:40.009415+0000","last_peered":"2024-04-26T12:30:39.002391+0000","last_clean":"2024-04-26T12:30:39.002391+0000","last_became_active":"2024-04-26T12:28:29.803545+0000","last_became_peered":"2024-04-26T12:28:29.803545+0000","last_unstale":"2024-04-26T12:30:58.077156+0000","last_undegraded":"2024-04-26T12:30:58.077156+0000","last_fullsized":"2024-04-26T12:30:58.077156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:17.958035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'186","reported_seq":209,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078288+0000","last_change":"2024-04-26T12:30:46.080074+0000","last_active":"2024-04-26T12:30:59.078288+0000","last_peered":"2024-04-26T12:30:59.078288+0000","last_clean":"2024-04-26T12:30:59.078288+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:30:59.078288+0000","last_undegraded":"2024-04-26T12:30:59.078288+0000","last_fullsized":"2024-04-26T12:30:59.078288+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:24.562647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":531,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077193+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:30:59.077193+0000","last_peered":"2024-04-26T12:30:59.077193+0000","last_clean":"2024-04-26T12:30:59.077193+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:30:59.077193+0000","last_undegraded":"2024-04-26T12:30:59.077193+0000","last_fullsized":"2024-04-26T12:30:59.077193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078244+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:30:59.078244+0000","last_peered":"2024-04-26T12:30:59.078244+0000","last_clean":"2024-04-26T12:30:59.078244+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:30:59.078244+0000","last_undegraded":"2024-04-26T12:30:59.078244+0000","last_fullsized":"2024-04-26T12:30:59.078244+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:40.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":976,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077821+0000","last_change":"2024-04-26T12:30:52.078990+0000","last_active":"2024-04-26T12:30:59.077821+0000","last_peered":"2024-04-26T12:30:59.077821+0000","last_clean":"2024-04-26T12:30:59.077821+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:30:59.077821+0000","last_undegraded":"2024-04-26T12:30:59.077821+0000","last_fullsized":"2024-04-26T12:30:59.077821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.697122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":514,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078332+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:30:59.078332+0000","last_peered":"2024-04-26T12:30:59.078332+0000","last_clean":"2024-04-26T12:30:59.078332+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:30:59.078332+0000","last_undegraded":"2024-04-26T12:30:59.078332+0000","last_fullsized":"2024-04-26T12:30:59.078332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:18.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077374+0000","last_change":"2024-04-26T12:30:48.089200+0000","last_active":"2024-04-26T12:30:59.077374+0000","last_peered":"2024-04-26T12:30:59.077374+0000","last_clean":"2024-04-26T12:30:59.077374+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:30:59.077374+0000","last_undegraded":"2024-04-26T12:30:59.077374+0000","last_fullsized":"2024-04-26T12:30:59.077374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:04.588329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077619+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:59.077619+0000","last_peered":"2024-04-26T12:30:59.077619+0000","last_clean":"2024-04-26T12:30:59.077619+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:30:59.077619+0000","last_undegraded":"2024-04-26T12:30:59.077619+0000","last_fullsized":"2024-04-26T12:30:59.077619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:40.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":557,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074143+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:30:57.074143+0000","last_peered":"2024-04-26T12:30:57.074143+0000","last_clean":"2024-04-26T12:30:57.074143+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:30:57.074143+0000","last_undegraded":"2024-04-26T12:30:57.074143+0000","last_fullsized":"2024-04-26T12:30:57.074143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.230823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":250,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074084+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:30:57.074084+0000","last_peered":"2024-04-26T12:30:57.074084+0000","last_clean":"2024-04-26T12:30:57.074084+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:30:57.074084+0000","last_undegraded":"2024-04-26T12:30:57.074084+0000","last_fullsized":"2024-04-26T12:30:57.074084+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:30.864621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":537,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077889+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:30:59.077889+0000","last_peered":"2024-04-26T12:30:59.077889+0000","last_clean":"2024-04-26T12:30:59.077889+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:30:59.077889+0000","last_undegraded":"2024-04-26T12:30:59.077889+0000","last_fullsized":"2024-04-26T12:30:59.077889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:13.427584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":268,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077250+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:30:59.077250+0000","last_peered":"2024-04-26T12:30:59.077250+0000","last_clean":"2024-04-26T12:30:59.077250+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:30:59.077250+0000","last_undegraded":"2024-04-26T12:30:59.077250+0000","last_fullsized":"2024-04-26T12:30:59.077250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:16.260550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078751+0000","last_change":"2024-04-26T12:30:47.083054+0000","last_active":"2024-04-26T12:30:59.078751+0000","last_peered":"2024-04-26T12:30:59.078751+0000","last_clean":"2024-04-26T12:30:59.078751+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:30:59.078751+0000","last_undegraded":"2024-04-26T12:30:59.078751+0000","last_fullsized":"2024-04-26T12:30:59.078751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.645638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":162,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077348+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:30:59.077348+0000","last_peered":"2024-04-26T12:30:59.077348+0000","last_clean":"2024-04-26T12:30:59.077348+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:30:59.077348+0000","last_undegraded":"2024-04-26T12:30:59.077348+0000","last_fullsized":"2024-04-26T12:30:59.077348+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:20.988072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":492,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078566+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:30:59.078566+0000","last_peered":"2024-04-26T12:30:59.078566+0000","last_clean":"2024-04-26T12:30:59.078566+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:30:59.078566+0000","last_undegraded":"2024-04-26T12:30:59.078566+0000","last_fullsized":"2024-04-26T12:30:59.078566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":588,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078399+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:30:59.078399+0000","last_peered":"2024-04-26T12:30:59.078399+0000","last_clean":"2024-04-26T12:30:59.078399+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:30:59.078399+0000","last_undegraded":"2024-04-26T12:30:59.078399+0000","last_fullsized":"2024-04-26T12:30:59.078399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:25.266771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":496,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074845+0000","last_change":"2024-04-26T12:30:55.090354+0000","last_active":"2024-04-26T12:30:57.074845+0000","last_peered":"2024-04-26T12:30:57.074845+0000","last_clean":"2024-04-26T12:30:57.074845+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:30:57.074845+0000","last_undegraded":"2024-04-26T12:30:57.074845+0000","last_fullsized":"2024-04-26T12:30:57.074845+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:14.455369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074352+0000","last_change":"2024-04-26T12:30:41.026049+0000","last_active":"2024-04-26T12:30:57.074352+0000","last_peered":"2024-04-26T12:30:57.074352+0000","last_clean":"2024-04-26T12:30:57.074352+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:30:57.074352+0000","last_undegraded":"2024-04-26T12:30:57.074352+0000","last_fullsized":"2024-04-26T12:30:57.074352+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.409817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"58'454","reported_seq":480,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078638+0000","last_change":"2024-04-26T12:30:46.079367+0000","last_active":"2024-04-26T12:30:59.078638+0000","last_peered":"2024-04-26T12:30:59.078638+0000","last_clean":"2024-04-26T12:30:59.078638+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:30:59.078638+0000","last_undegraded":"2024-04-26T12:30:59.078638+0000","last_fullsized":"2024-04-26T12:30:59.078638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:00.950370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":472,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077726+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:30:59.077726+0000","last_peered":"2024-04-26T12:30:59.077726+0000","last_clean":"2024-04-26T12:30:59.077726+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:30:59.077726+0000","last_undegraded":"2024-04-26T12:30:59.077726+0000","last_fullsized":"2024-04-26T12:30:59.077726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078680+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:31:00.078680+0000","last_peered":"2024-04-26T12:31:00.078680+0000","last_clean":"2024-04-26T12:31:00.078680+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:31:00.078680+0000","last_undegraded":"2024-04-26T12:31:00.078680+0000","last_fullsized":"2024-04-26T12:31:00.078680+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:16.686041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077333+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:59.077333+0000","last_peered":"2024-04-26T12:30:59.077333+0000","last_clean":"2024-04-26T12:30:59.077333+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:30:59.077333+0000","last_undegraded":"2024-04-26T12:30:59.077333+0000","last_fullsized":"2024-04-26T12:30:59.077333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:18.069937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":497,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074267+0000","last_change":"2024-04-26T12:30:46.033999+0000","last_active":"2024-04-26T12:30:57.074267+0000","last_peered":"2024-04-26T12:30:57.074267+0000","last_clean":"2024-04-26T12:30:57.074267+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:30:57.074267+0000","last_undegraded":"2024-04-26T12:30:57.074267+0000","last_fullsized":"2024-04-26T12:30:57.074267+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:33.235467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073919+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:30:57.073919+0000","last_peered":"2024-04-26T12:30:57.073919+0000","last_clean":"2024-04-26T12:30:57.073919+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:30:57.073919+0000","last_undegraded":"2024-04-26T12:30:57.073919+0000","last_fullsized":"2024-04-26T12:30:57.073919+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:20.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":398,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077980+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:30:59.077980+0000","last_peered":"2024-04-26T12:30:59.077980+0000","last_clean":"2024-04-26T12:30:59.077980+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:30:59.077980+0000","last_undegraded":"2024-04-26T12:30:59.077980+0000","last_fullsized":"2024-04-26T12:30:59.077980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":430,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074784+0000","last_change":"2024-04-26T12:30:54.081099+0000","last_active":"2024-04-26T12:30:57.074784+0000","last_peered":"2024-04-26T12:30:57.074784+0000","last_clean":"2024-04-26T12:30:57.074784+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:30:57.074784+0000","last_undegraded":"2024-04-26T12:30:57.074784+0000","last_fullsized":"2024-04-26T12:30:57.074784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:29.507250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077511+0000","last_change":"2024-04-26T12:30:46.082961+0000","last_active":"2024-04-26T12:30:59.077511+0000","last_peered":"2024-04-26T12:30:59.077511+0000","last_clean":"2024-04-26T12:30:59.077511+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:30:59.077511+0000","last_undegraded":"2024-04-26T12:30:59.077511+0000","last_fullsized":"2024-04-26T12:30:59.077511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:10.764587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":263,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077256+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:30:59.077256+0000","last_peered":"2024-04-26T12:30:59.077256+0000","last_clean":"2024-04-26T12:30:59.077256+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:30:59.077256+0000","last_undegraded":"2024-04-26T12:30:59.077256+0000","last_fullsized":"2024-04-26T12:30:59.077256+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:23.542209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":596,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073940+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:30:57.073940+0000","last_peered":"2024-04-26T12:30:57.073940+0000","last_clean":"2024-04-26T12:30:57.073940+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:30:57.073940+0000","last_undegraded":"2024-04-26T12:30:57.073940+0000","last_fullsized":"2024-04-26T12:30:57.073940+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:05.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":564,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078645+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:30:59.078645+0000","last_peered":"2024-04-26T12:30:59.078645+0000","last_clean":"2024-04-26T12:30:59.078645+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:30:59.078645+0000","last_undegraded":"2024-04-26T12:30:59.078645+0000","last_fullsized":"2024-04-26T12:30:59.078645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077378+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:30:59.077378+0000","last_peered":"2024-04-26T12:30:59.077378+0000","last_clean":"2024-04-26T12:30:59.077378+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:30:59.077378+0000","last_undegraded":"2024-04-26T12:30:59.077378+0000","last_fullsized":"2024-04-26T12:30:59.077378+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'105","reported_seq":220,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074099+0000","last_change":"2024-04-26T12:30:44.028851+0000","last_active":"2024-04-26T12:30:57.074099+0000","last_peered":"2024-04-26T12:30:57.074099+0000","last_clean":"2024-04-26T12:30:57.074099+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:30:57.074099+0000","last_undegraded":"2024-04-26T12:30:57.074099+0000","last_fullsized":"2024-04-26T12:30:57.074099+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:13.939165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078426+0000","last_change":"2024-04-26T12:30:57.078892+0000","last_active":"2024-04-26T12:30:59.078426+0000","last_peered":"2024-04-26T12:30:59.078426+0000","last_clean":"2024-04-26T12:30:59.078426+0000","last_became_active":"2024-04-26T12:30:57.077779+0000","last_became_peered":"2024-04-26T12:30:57.077779+0000","last_unstale":"2024-04-26T12:30:59.078426+0000","last_undegraded":"2024-04-26T12:30:59.078426+0000","last_fullsized":"2024-04-26T12:30:59.078426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:07.812506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078778+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:31:00.078778+0000","last_peered":"2024-04-26T12:31:00.078778+0000","last_clean":"2024-04-26T12:31:00.078778+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:31:00.078778+0000","last_undegraded":"2024-04-26T12:31:00.078778+0000","last_fullsized":"2024-04-26T12:31:00.078778+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:31.181549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074439+0000","last_change":"2024-04-26T12:30:41.026137+0000","last_active":"2024-04-26T12:30:57.074439+0000","last_peered":"2024-04-26T12:30:57.074439+0000","last_clean":"2024-04-26T12:30:57.074439+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:30:57.074439+0000","last_undegraded":"2024-04-26T12:30:57.074439+0000","last_fullsized":"2024-04-26T12:30:57.074439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:08.225745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":519,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077500+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:30:59.077500+0000","last_peered":"2024-04-26T12:30:59.077500+0000","last_clean":"2024-04-26T12:30:59.077500+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:30:59.077500+0000","last_undegraded":"2024-04-26T12:30:59.077500+0000","last_fullsized":"2024-04-26T12:30:59.077500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074635+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:30:57.074635+0000","last_peered":"2024-04-26T12:30:57.074635+0000","last_clean":"2024-04-26T12:30:57.074635+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:30:57.074635+0000","last_undegraded":"2024-04-26T12:30:57.074635+0000","last_fullsized":"2024-04-26T12:30:57.074635+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:51.609322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074557+0000","last_change":"2024-04-26T12:30:41.030157+0000","last_active":"2024-04-26T12:30:57.074557+0000","last_peered":"2024-04-26T12:30:57.074557+0000","last_clean":"2024-04-26T12:30:57.074557+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:57.074557+0000","last_undegraded":"2024-04-26T12:30:57.074557+0000","last_fullsized":"2024-04-26T12:30:57.074557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:32.867679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":518,"reported_epoch":79,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:54.075180+0000","last_change":"2024-04-26T12:30:47.084724+0000","last_active":"2024-04-26T12:30:54.075180+0000","last_peered":"2024-04-26T12:30:54.075180+0000","last_clean":"2024-04-26T12:30:39.001153+0000","last_became_active":"2024-04-26T12:30:47.083601+0000","last_became_peered":"2024-04-26T12:30:47.083601+0000","last_unstale":"2024-04-26T12:30:54.075180+0000","last_undegraded":"2024-04-26T12:30:54.075180+0000","last_fullsized":"2024-04-26T12:30:54.075180+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:00.234562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":184,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078428+0000","last_change":"2024-04-26T12:30:46.080509+0000","last_active":"2024-04-26T12:30:59.078428+0000","last_peered":"2024-04-26T12:30:59.078428+0000","last_clean":"2024-04-26T12:30:59.078428+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:30:59.078428+0000","last_undegraded":"2024-04-26T12:30:59.078428+0000","last_fullsized":"2024-04-26T12:30:59.078428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:40.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'82","reported_seq":59,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074820+0000","last_change":"2024-04-26T12:30:46.086027+0000","last_active":"2024-04-26T12:30:57.074820+0000","last_peered":"2024-04-26T12:30:57.074820+0000","last_clean":"2024-04-26T12:30:57.074820+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:30:57.074820+0000","last_undegraded":"2024-04-26T12:30:57.074820+0000","last_fullsized":"2024-04-26T12:30:57.074820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:13.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":605,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077718+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:30:59.077718+0000","last_peered":"2024-04-26T12:30:59.077718+0000","last_clean":"2024-04-26T12:30:59.077718+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:30:59.077718+0000","last_undegraded":"2024-04-26T12:30:59.077718+0000","last_fullsized":"2024-04-26T12:30:59.077718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077612+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:30:59.077612+0000","last_peered":"2024-04-26T12:30:59.077612+0000","last_clean":"2024-04-26T12:30:59.077612+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:30:59.077612+0000","last_undegraded":"2024-04-26T12:30:59.077612+0000","last_fullsized":"2024-04-26T12:30:59.077612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.312112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":855,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078064+0000","last_change":"2024-04-26T12:30:53.079043+0000","last_active":"2024-04-26T12:30:59.078064+0000","last_peered":"2024-04-26T12:30:59.078064+0000","last_clean":"2024-04-26T12:30:59.078064+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:30:59.078064+0000","last_undegraded":"2024-04-26T12:30:59.078064+0000","last_fullsized":"2024-04-26T12:30:59.078064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:00.091756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":311,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078038+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:30:59.078038+0000","last_peered":"2024-04-26T12:30:59.078038+0000","last_clean":"2024-04-26T12:30:59.078038+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:30:59.078038+0000","last_undegraded":"2024-04-26T12:30:59.078038+0000","last_fullsized":"2024-04-26T12:30:59.078038+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:43.044883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":798,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077365+0000","last_change":"2024-04-26T12:30:48.088039+0000","last_active":"2024-04-26T12:30:59.077365+0000","last_peered":"2024-04-26T12:30:59.077365+0000","last_clean":"2024-04-26T12:30:59.077365+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:30:59.077365+0000","last_undegraded":"2024-04-26T12:30:59.077365+0000","last_fullsized":"2024-04-26T12:30:59.077365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:03.967118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"58'314","reported_seq":395,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077986+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:30:59.077986+0000","last_peered":"2024-04-26T12:30:59.077986+0000","last_clean":"2024-04-26T12:30:59.077986+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:30:59.077986+0000","last_undegraded":"2024-04-26T12:30:59.077986+0000","last_fullsized":"2024-04-26T12:30:59.077986+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":872,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077302+0000","last_change":"2024-04-26T12:30:52.079092+0000","last_active":"2024-04-26T12:30:59.077302+0000","last_peered":"2024-04-26T12:30:59.077302+0000","last_clean":"2024-04-26T12:30:59.077302+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:30:59.077302+0000","last_undegraded":"2024-04-26T12:30:59.077302+0000","last_fullsized":"2024-04-26T12:30:59.077302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:10.253347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"58'76","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074650+0000","last_change":"2024-04-26T12:30:41.050653+0000","last_active":"2024-04-26T12:30:57.074650+0000","last_peered":"2024-04-26T12:30:57.074650+0000","last_clean":"2024-04-26T12:30:57.074650+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:57.074650+0000","last_undegraded":"2024-04-26T12:30:57.074650+0000","last_fullsized":"2024-04-26T12:30:57.074650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:17.874875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":542,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076883+0000","last_change":"2024-04-26T12:28:00.707724+0000","last_active":"2024-04-26T12:30:59.076883+0000","last_peered":"2024-04-26T12:30:59.076883+0000","last_clean":"2024-04-26T12:30:59.076883+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:30:59.076883+0000","last_undegraded":"2024-04-26T12:30:59.076883+0000","last_fullsized":"2024-04-26T12:30:59.076883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:20.384961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074845+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:30:57.074845+0000","last_peered":"2024-04-26T12:30:57.074845+0000","last_clean":"2024-04-26T12:30:57.074845+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:30:57.074845+0000","last_undegraded":"2024-04-26T12:30:57.074845+0000","last_fullsized":"2024-04-26T12:30:57.074845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:40.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077689+0000","last_change":"2024-04-26T12:30:51.076207+0000","last_active":"2024-04-26T12:30:59.077689+0000","last_peered":"2024-04-26T12:30:59.077689+0000","last_clean":"2024-04-26T12:30:59.077689+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:30:59.077689+0000","last_undegraded":"2024-04-26T12:30:59.077689+0000","last_fullsized":"2024-04-26T12:30:59.077689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:05.869282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":863,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077482+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:30:59.077482+0000","last_peered":"2024-04-26T12:30:59.077482+0000","last_clean":"2024-04-26T12:30:59.077482+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:30:59.077482+0000","last_undegraded":"2024-04-26T12:30:59.077482+0000","last_fullsized":"2024-04-26T12:30:59.077482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:50.433671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":526,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074008+0000","last_change":"2024-04-26T12:30:54.080153+0000","last_active":"2024-04-26T12:30:57.074008+0000","last_peered":"2024-04-26T12:30:57.074008+0000","last_clean":"2024-04-26T12:30:57.074008+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:30:57.074008+0000","last_undegraded":"2024-04-26T12:30:57.074008+0000","last_fullsized":"2024-04-26T12:30:57.074008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:48.057283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":628,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077875+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:30:59.077875+0000","last_peered":"2024-04-26T12:30:59.077875+0000","last_clean":"2024-04-26T12:30:59.077875+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:30:59.077875+0000","last_undegraded":"2024-04-26T12:30:59.077875+0000","last_fullsized":"2024-04-26T12:30:59.077875+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":513,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074363+0000","last_change":"2024-04-26T12:30:50.086765+0000","last_active":"2024-04-26T12:30:57.074363+0000","last_peered":"2024-04-26T12:30:57.074363+0000","last_clean":"2024-04-26T12:30:57.074363+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:30:57.074363+0000","last_undegraded":"2024-04-26T12:30:57.074363+0000","last_fullsized":"2024-04-26T12:30:57.074363+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:36.313767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078165+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:30:59.078165+0000","last_peered":"2024-04-26T12:30:59.078165+0000","last_clean":"2024-04-26T12:30:59.078165+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:30:59.078165+0000","last_undegraded":"2024-04-26T12:30:59.078165+0000","last_fullsized":"2024-04-26T12:30:59.078165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":363,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79134720,"data_stored":256449018,"data_compressed":38844374,"data_compressed_allocated":48693248,"data_compressed_original":226074624,"omap_allocated":5343,"internal_metadata":0},"log_size":7508,"ondisk_log_size":7508,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738423,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130116,"kb_used_data":30960,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94241724,"statfs":{"total":96636764160,"available":96503525376,"internally_reserved":0,"allocated":31703040,"data_stored":85781026,"data_compressed":12062822,"data_compressed_allocated":15765504,"data_compressed_original":70336512,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.23599999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.48299999999999998}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.26300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738423,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131328,"kb_used_data":32180,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94240512,"statfs":{"total":96636764160,"available":96502284288,"internally_reserved":0,"allocated":32952320,"data_stored":91446910,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Apr 26 12:30:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.30399999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.625,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42499999999999999}]}]},{"osd":1,"up_from":64,"seq":274877906950,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62328,"kb_used_data":16744,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309512,"statfs":{"total":96636764160,"available":96572940288,"internally_reserved":0,"allocated":17145856,"data_stored":81539814,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30789632,"data_stored":84809889,"data_compressed":12028675,"data_compressed_allocated":15720448,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:04.454 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T12:31:04.915 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:31:04.915 INFO:teuthology.orchestra.run.smithi046.stdout:{"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":267,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":85,"num_osds":3,"num_up_osds":3,"osd_up_since":1714134639,"num_in_osds":3,"osd_in_since":1714134397,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":101},{"state_name":"peering","count":2},{"state_name":"active+recovery_wait+remapped","count":2}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":128814877,"bytes_used":331542528,"bytes_avail":289578749952,"bytes_total":289910292480,"inactive_pgs_ratio":0.01904761977493763,"misplaced_objects":363,"misplaced_total":110,"misplaced_ratio":3.2999999999999998,"recovering_objects_per_sec":240,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1445,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":14150}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-26T12:27:59.302941+0000","services":{}},"progress_events":{}} 2024-04-26T12:31:04.929 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T12:31:04.929 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:05.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:31:05.275 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:31:05.286 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":210,"stamp":"2024-04-26T12:31:03.359624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":363,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6546,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34345,"ondisk_log_size":34345,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":232,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":323772,"kb_used_data":79884,"kb_used_omap":9,"kb_used_meta":243830,"kb_avail":282791748,"statfs":{"total":289910292480,"available":289578749952,"internally_reserved":0,"allocated":81801216,"data_stored":258767750,"data_compressed":38912668,"data_compressed_allocated":48783360,"data_compressed_original":227221504,"omap_allocated":10125,"internal_metadata":249682035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-929,"num_objects_misplaced":-530,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1445,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001605"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":900,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078535+0000","last_change":"2024-04-26T12:30:54.081113+0000","last_active":"2024-04-26T12:30:59.078535+0000","last_peered":"2024-04-26T12:30:59.078535+0000","last_clean":"2024-04-26T12:30:59.078535+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:30:59.078535+0000","last_undegraded":"2024-04-26T12:30:59.078535+0000","last_fullsized":"2024-04-26T12:30:59.078535+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.062347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":956,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078130+0000","last_change":"2024-04-26T12:30:56.085870+0000","last_active":"2024-04-26T12:30:59.078130+0000","last_peered":"2024-04-26T12:30:59.078130+0000","last_clean":"2024-04-26T12:30:59.078130+0000","last_became_active":"2024-04-26T12:30:56.084642+0000","last_became_peered":"2024-04-26T12:30:56.084642+0000","last_unstale":"2024-04-26T12:30:59.078130+0000","last_undegraded":"2024-04-26T12:30:59.078130+0000","last_fullsized":"2024-04-26T12:30:59.078130+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:41.346086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":495,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078491+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:30:59.078491+0000","last_peered":"2024-04-26T12:30:59.078491+0000","last_clean":"2024-04-26T12:30:59.078491+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:30:59.078491+0000","last_undegraded":"2024-04-26T12:30:59.078491+0000","last_fullsized":"2024-04-26T12:30:59.078491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:55.616144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":867,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078158+0000","last_change":"2024-04-26T12:30:48.089842+0000","last_active":"2024-04-26T12:30:59.078158+0000","last_peered":"2024-04-26T12:30:59.078158+0000","last_clean":"2024-04-26T12:30:59.078158+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:30:59.078158+0000","last_undegraded":"2024-04-26T12:30:59.078158+0000","last_fullsized":"2024-04-26T12:30:59.078158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:13.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":939,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077433+0000","last_change":"2024-04-26T12:30:48.089460+0000","last_active":"2024-04-26T12:30:59.077433+0000","last_peered":"2024-04-26T12:30:59.077433+0000","last_clean":"2024-04-26T12:30:59.077433+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:30:59.077433+0000","last_undegraded":"2024-04-26T12:30:59.077433+0000","last_fullsized":"2024-04-26T12:30:59.077433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077152+0000","last_change":"2024-04-26T12:30:48.090606+0000","last_active":"2024-04-26T12:30:59.077152+0000","last_peered":"2024-04-26T12:30:59.077152+0000","last_clean":"2024-04-26T12:30:59.077152+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:30:59.077152+0000","last_undegraded":"2024-04-26T12:30:59.077152+0000","last_fullsized":"2024-04-26T12:30:59.077152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:57.446858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1028,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077423+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:30:59.077423+0000","last_peered":"2024-04-26T12:30:59.077423+0000","last_clean":"2024-04-26T12:30:59.077423+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:30:59.077423+0000","last_undegraded":"2024-04-26T12:30:59.077423+0000","last_fullsized":"2024-04-26T12:30:59.077423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:06.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":767,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076901+0000","last_change":"2024-04-26T12:30:49.082511+0000","last_active":"2024-04-26T12:30:59.076901+0000","last_peered":"2024-04-26T12:30:59.076901+0000","last_clean":"2024-04-26T12:30:59.076901+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:30:59.076901+0000","last_undegraded":"2024-04-26T12:30:59.076901+0000","last_fullsized":"2024-04-26T12:30:59.076901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:54.832086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":496,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074978+0000","last_change":"2024-04-26T12:30:56.079114+0000","last_active":"2024-04-26T12:30:57.074978+0000","last_peered":"2024-04-26T12:30:57.074978+0000","last_clean":"2024-04-26T12:30:57.074978+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:30:57.074978+0000","last_undegraded":"2024-04-26T12:30:57.074978+0000","last_fullsized":"2024-04-26T12:30:57.074978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:37.907357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":911,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078367+0000","last_change":"2024-04-26T12:30:56.087672+0000","last_active":"2024-04-26T12:30:59.078367+0000","last_peered":"2024-04-26T12:30:59.078367+0000","last_clean":"2024-04-26T12:30:59.078367+0000","last_became_active":"2024-04-26T12:30:56.085904+0000","last_became_peered":"2024-04-26T12:30:56.085904+0000","last_unstale":"2024-04-26T12:30:59.078367+0000","last_undegraded":"2024-04-26T12:30:59.078367+0000","last_fullsized":"2024-04-26T12:30:59.078367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:53.993298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":594,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078178+0000","last_change":"2024-04-26T12:30:50.085026+0000","last_active":"2024-04-26T12:30:59.078178+0000","last_peered":"2024-04-26T12:30:59.078178+0000","last_clean":"2024-04-26T12:30:59.078178+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:30:59.078178+0000","last_undegraded":"2024-04-26T12:30:59.078178+0000","last_fullsized":"2024-04-26T12:30:59.078178+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:31.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077591+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:30:59.077591+0000","last_peered":"2024-04-26T12:30:59.077591+0000","last_clean":"2024-04-26T12:30:59.077591+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:30:59.077591+0000","last_undegraded":"2024-04-26T12:30:59.077591+0000","last_fullsized":"2024-04-26T12:30:59.077591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":883,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077635+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:30:59.077635+0000","last_peered":"2024-04-26T12:30:59.077635+0000","last_clean":"2024-04-26T12:30:59.077635+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:30:59.077635+0000","last_undegraded":"2024-04-26T12:30:59.077635+0000","last_fullsized":"2024-04-26T12:30:59.077635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:00.467106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":520,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077571+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:30:59.077571+0000","last_peered":"2024-04-26T12:30:59.077571+0000","last_clean":"2024-04-26T12:30:59.077571+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:30:59.077571+0000","last_undegraded":"2024-04-26T12:30:59.077571+0000","last_fullsized":"2024-04-26T12:30:59.077571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":540,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077003+0000","last_change":"2024-04-26T12:30:47.080645+0000","last_active":"2024-04-26T12:30:59.077003+0000","last_peered":"2024-04-26T12:30:59.077003+0000","last_clean":"2024-04-26T12:30:59.077003+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:30:59.077003+0000","last_undegraded":"2024-04-26T12:30:59.077003+0000","last_fullsized":"2024-04-26T12:30:59.077003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:11.047331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":926,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077140+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:30:59.077140+0000","last_peered":"2024-04-26T12:30:59.077140+0000","last_clean":"2024-04-26T12:30:59.077140+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:30:59.077140+0000","last_undegraded":"2024-04-26T12:30:59.077140+0000","last_fullsized":"2024-04-26T12:30:59.077140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:18.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":491,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074910+0000","last_change":"2024-04-26T12:30:55.090347+0000","last_active":"2024-04-26T12:30:57.074910+0000","last_peered":"2024-04-26T12:30:57.074910+0000","last_clean":"2024-04-26T12:30:57.074910+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:30:57.074910+0000","last_undegraded":"2024-04-26T12:30:57.074910+0000","last_fullsized":"2024-04-26T12:30:57.074910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:18.689900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":912,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078455+0000","last_change":"2024-04-26T12:30:57.084445+0000","last_active":"2024-04-26T12:30:59.078455+0000","last_peered":"2024-04-26T12:30:59.078455+0000","last_clean":"2024-04-26T12:30:59.078455+0000","last_became_active":"2024-04-26T12:30:57.083026+0000","last_became_peered":"2024-04-26T12:30:57.083026+0000","last_unstale":"2024-04-26T12:30:59.078455+0000","last_undegraded":"2024-04-26T12:30:59.078455+0000","last_fullsized":"2024-04-26T12:30:59.078455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:26.231571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":524,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074493+0000","last_change":"2024-04-26T12:30:51.076894+0000","last_active":"2024-04-26T12:30:57.074493+0000","last_peered":"2024-04-26T12:30:57.074493+0000","last_clean":"2024-04-26T12:30:57.074493+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:30:57.074493+0000","last_undegraded":"2024-04-26T12:30:57.074493+0000","last_fullsized":"2024-04-26T12:30:57.074493+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:50.091007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1070,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078148+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:30:59.078148+0000","last_peered":"2024-04-26T12:30:59.078148+0000","last_clean":"2024-04-26T12:30:59.078148+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:30:59.078148+0000","last_undegraded":"2024-04-26T12:30:59.078148+0000","last_fullsized":"2024-04-26T12:30:59.078148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:26.268194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":952,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077199+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:30:59.077199+0000","last_peered":"2024-04-26T12:30:59.077199+0000","last_clean":"2024-04-26T12:30:59.077199+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:30:59.077199+0000","last_undegraded":"2024-04-26T12:30:59.077199+0000","last_fullsized":"2024-04-26T12:30:59.077199+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:12.535434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":580,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077653+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:30:59.077653+0000","last_peered":"2024-04-26T12:30:59.077653+0000","last_clean":"2024-04-26T12:30:59.077653+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:30:59.077653+0000","last_undegraded":"2024-04-26T12:30:59.077653+0000","last_fullsized":"2024-04-26T12:30:59.077653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":514,"reported_epoch":79,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:54.075270+0000","last_change":"2024-04-26T12:30:47.082934+0000","last_active":"2024-04-26T12:30:54.075270+0000","last_peered":"2024-04-26T12:30:54.075270+0000","last_clean":"2024-04-26T12:30:39.001294+0000","last_became_active":"2024-04-26T12:30:47.081126+0000","last_became_peered":"2024-04-26T12:30:47.081126+0000","last_unstale":"2024-04-26T12:30:54.075270+0000","last_undegraded":"2024-04-26T12:30:54.075270+0000","last_fullsized":"2024-04-26T12:30:54.075270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:47.194202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":179,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":1017,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078556+0000","last_change":"2024-04-26T12:30:58.079466+0000","last_active":"2024-04-26T12:30:59.078556+0000","last_peered":"2024-04-26T12:30:59.078556+0000","last_clean":"2024-04-26T12:30:59.078556+0000","last_became_active":"2024-04-26T12:30:58.078211+0000","last_became_peered":"2024-04-26T12:30:58.078211+0000","last_unstale":"2024-04-26T12:30:59.078556+0000","last_undegraded":"2024-04-26T12:30:59.078556+0000","last_fullsized":"2024-04-26T12:30:59.078556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:42.746789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078438+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:30:59.078438+0000","last_peered":"2024-04-26T12:30:59.078438+0000","last_clean":"2024-04-26T12:30:59.078438+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:30:59.078438+0000","last_undegraded":"2024-04-26T12:30:59.078438+0000","last_fullsized":"2024-04-26T12:30:59.078438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":583,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.075344+0000","last_change":"2024-04-26T12:30:46.089997+0000","last_active":"2024-04-26T12:30:57.075344+0000","last_peered":"2024-04-26T12:30:57.075344+0000","last_clean":"2024-04-26T12:30:57.075344+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:30:57.075344+0000","last_undegraded":"2024-04-26T12:30:57.075344+0000","last_fullsized":"2024-04-26T12:30:57.075344+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:08.843126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078301+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:30:59.078301+0000","last_peered":"2024-04-26T12:30:59.078301+0000","last_clean":"2024-04-26T12:30:59.078301+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:30:59.078301+0000","last_undegraded":"2024-04-26T12:30:59.078301+0000","last_fullsized":"2024-04-26T12:30:59.078301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077517+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:30:59.077517+0000","last_peered":"2024-04-26T12:30:59.077517+0000","last_clean":"2024-04-26T12:30:59.077517+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:30:59.077517+0000","last_undegraded":"2024-04-26T12:30:59.077517+0000","last_fullsized":"2024-04-26T12:30:59.077517+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:21.302173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078191+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:30:59.078191+0000","last_peered":"2024-04-26T12:30:59.078191+0000","last_clean":"2024-04-26T12:30:59.078191+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:30:59.078191+0000","last_undegraded":"2024-04-26T12:30:59.078191+0000","last_fullsized":"2024-04-26T12:30:59.078191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":408,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073705+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:30:57.073705+0000","last_peered":"2024-04-26T12:30:57.073705+0000","last_clean":"2024-04-26T12:30:57.073705+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:30:57.073705+0000","last_undegraded":"2024-04-26T12:30:57.073705+0000","last_fullsized":"2024-04-26T12:30:57.073705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.762427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:30:58.081169+0000","last_change":"2024-04-26T12:30:58.081169+0000","last_active":"2024-04-26T12:30:58.081169+0000","last_peered":"2024-04-26T12:30:58.081169+0000","last_clean":"2024-04-26T12:30:58.081169+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:30:58.081169+0000","last_undegraded":"2024-04-26T12:30:58.081169+0000","last_fullsized":"2024-04-26T12:30:58.081169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:42.618440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"58'708","reported_seq":776,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073660+0000","last_change":"2024-04-26T12:30:44.022038+0000","last_active":"2024-04-26T12:30:57.073660+0000","last_peered":"2024-04-26T12:30:57.073660+0000","last_clean":"2024-04-26T12:30:57.073660+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:30:57.073660+0000","last_undegraded":"2024-04-26T12:30:57.073660+0000","last_fullsized":"2024-04-26T12:30:57.073660+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:30.369118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078436+0000","last_change":"2024-04-26T12:30:47.081417+0000","last_active":"2024-04-26T12:30:59.078436+0000","last_peered":"2024-04-26T12:30:59.078436+0000","last_clean":"2024-04-26T12:30:59.078436+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:30:59.078436+0000","last_undegraded":"2024-04-26T12:30:59.078436+0000","last_fullsized":"2024-04-26T12:30:59.078436+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:17.628933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074746+0000","last_change":"2024-04-26T12:30:41.018067+0000","last_active":"2024-04-26T12:30:57.074746+0000","last_peered":"2024-04-26T12:30:57.074746+0000","last_clean":"2024-04-26T12:30:57.074746+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:30:57.074746+0000","last_undegraded":"2024-04-26T12:30:57.074746+0000","last_fullsized":"2024-04-26T12:30:57.074746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:33.684743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":592,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T12:30:58.081823+0000","last_change":"2024-04-26T12:30:58.081823+0000","last_active":"2024-04-26T12:30:58.081823+0000","last_peered":"2024-04-26T12:30:58.081823+0000","last_clean":"2024-04-26T12:30:58.081823+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:30:58.081823+0000","last_undegraded":"2024-04-26T12:30:58.081823+0000","last_fullsized":"2024-04-26T12:30:58.081823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.109302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"58'355","reported_seq":377,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078258+0000","last_change":"2024-04-26T12:30:48.086933+0000","last_active":"2024-04-26T12:30:59.078258+0000","last_peered":"2024-04-26T12:30:59.078258+0000","last_clean":"2024-04-26T12:30:59.078258+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:30:59.078258+0000","last_undegraded":"2024-04-26T12:30:59.078258+0000","last_fullsized":"2024-04-26T12:30:59.078258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:49.737283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":718,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073774+0000","last_change":"2024-04-26T12:30:46.034642+0000","last_active":"2024-04-26T12:30:57.073774+0000","last_peered":"2024-04-26T12:30:57.073774+0000","last_clean":"2024-04-26T12:30:57.073774+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:30:57.073774+0000","last_undegraded":"2024-04-26T12:30:57.073774+0000","last_fullsized":"2024-04-26T12:30:57.073774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.961343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077954+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:30:59.077954+0000","last_peered":"2024-04-26T12:30:59.077954+0000","last_clean":"2024-04-26T12:30:59.077954+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:30:59.077954+0000","last_undegraded":"2024-04-26T12:30:59.077954+0000","last_fullsized":"2024-04-26T12:30:59.077954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":509,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073886+0000","last_change":"2024-04-26T12:30:45.022716+0000","last_active":"2024-04-26T12:30:57.073886+0000","last_peered":"2024-04-26T12:30:57.073886+0000","last_clean":"2024-04-26T12:30:57.073886+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:30:57.073886+0000","last_undegraded":"2024-04-26T12:30:57.073886+0000","last_fullsized":"2024-04-26T12:30:57.073886+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:01.269901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'374","reported_seq":439,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078040+0000","last_change":"2024-04-26T12:30:46.079618+0000","last_active":"2024-04-26T12:30:59.078040+0000","last_peered":"2024-04-26T12:30:59.078040+0000","last_clean":"2024-04-26T12:30:59.078040+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:30:59.078040+0000","last_undegraded":"2024-04-26T12:30:59.078040+0000","last_fullsized":"2024-04-26T12:30:59.078040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:48.209628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":506,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077751+0000","last_change":"2024-04-26T12:30:47.082596+0000","last_active":"2024-04-26T12:30:59.077751+0000","last_peered":"2024-04-26T12:30:59.077751+0000","last_clean":"2024-04-26T12:30:59.077751+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:30:59.077751+0000","last_undegraded":"2024-04-26T12:30:59.077751+0000","last_fullsized":"2024-04-26T12:30:59.077751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:34.688913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":648,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077638+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:30:59.077638+0000","last_peered":"2024-04-26T12:30:59.077638+0000","last_clean":"2024-04-26T12:30:59.077638+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:30:59.077638+0000","last_undegraded":"2024-04-26T12:30:59.077638+0000","last_fullsized":"2024-04-26T12:30:59.077638+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:50.674218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":794,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078066+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:30:59.078066+0000","last_peered":"2024-04-26T12:30:59.078066+0000","last_clean":"2024-04-26T12:30:59.078066+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:30:59.078066+0000","last_undegraded":"2024-04-26T12:30:59.078066+0000","last_fullsized":"2024-04-26T12:30:59.078066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:11.548975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073840+0000","last_change":"2024-04-26T12:30:46.089052+0000","last_active":"2024-04-26T12:30:57.073840+0000","last_peered":"2024-04-26T12:30:57.073840+0000","last_clean":"2024-04-26T12:30:57.073840+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:30:57.073840+0000","last_undegraded":"2024-04-26T12:30:57.073840+0000","last_fullsized":"2024-04-26T12:30:57.073840+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:28.433853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":860,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078103+0000","last_change":"2024-04-26T12:30:50.086492+0000","last_active":"2024-04-26T12:30:59.078103+0000","last_peered":"2024-04-26T12:30:59.078103+0000","last_clean":"2024-04-26T12:30:59.078103+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:30:59.078103+0000","last_undegraded":"2024-04-26T12:30:59.078103+0000","last_fullsized":"2024-04-26T12:30:59.078103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:18.705037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077626+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:30:59.077626+0000","last_peered":"2024-04-26T12:30:59.077626+0000","last_clean":"2024-04-26T12:30:59.077626+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:30:59.077626+0000","last_undegraded":"2024-04-26T12:30:59.077626+0000","last_fullsized":"2024-04-26T12:30:59.077626+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":491,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-26T12:30:58.077112+0000","last_change":"2024-04-26T12:30:58.077112+0000","last_active":"2024-04-26T12:30:40.012414+0000","last_peered":"2024-04-26T12:30:39.001966+0000","last_clean":"2024-04-26T12:30:39.001966+0000","last_became_active":"2024-04-26T12:28:29.803352+0000","last_became_peered":"2024-04-26T12:28:29.803352+0000","last_unstale":"2024-04-26T12:30:58.077112+0000","last_undegraded":"2024-04-26T12:30:58.077112+0000","last_fullsized":"2024-04-26T12:30:58.077112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:12.256084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'54","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077588+0000","last_change":"2024-04-26T12:30:46.082166+0000","last_active":"2024-04-26T12:30:59.077588+0000","last_peered":"2024-04-26T12:30:59.077588+0000","last_clean":"2024-04-26T12:30:59.077588+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:30:59.077588+0000","last_undegraded":"2024-04-26T12:30:59.077588+0000","last_fullsized":"2024-04-26T12:30:59.077588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:28.037535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":529,"reported_epoch":83,"state":"peering","last_fresh":"2024-04-26T12:30:58.077156+0000","last_change":"2024-04-26T12:30:58.077156+0000","last_active":"2024-04-26T12:30:40.009415+0000","last_peered":"2024-04-26T12:30:39.002391+0000","last_clean":"2024-04-26T12:30:39.002391+0000","last_became_active":"2024-04-26T12:28:29.803545+0000","last_became_peered":"2024-04-26T12:28:29.803545+0000","last_unstale":"2024-04-26T12:30:58.077156+0000","last_undegraded":"2024-04-26T12:30:58.077156+0000","last_fullsized":"2024-04-26T12:30:58.077156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:17.958035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'186","reported_seq":209,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078288+0000","last_change":"2024-04-26T12:30:46.080074+0000","last_active":"2024-04-26T12:30:59.078288+0000","last_peered":"2024-04-26T12:30:59.078288+0000","last_clean":"2024-04-26T12:30:59.078288+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:30:59.078288+0000","last_undegraded":"2024-04-26T12:30:59.078288+0000","last_fullsized":"2024-04-26T12:30:59.078288+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:24.562647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":531,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077193+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:30:59.077193+0000","last_peered":"2024-04-26T12:30:59.077193+0000","last_clean":"2024-04-26T12:30:59.077193+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:30:59.077193+0000","last_undegraded":"2024-04-26T12:30:59.077193+0000","last_fullsized":"2024-04-26T12:30:59.077193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078244+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:30:59.078244+0000","last_peered":"2024-04-26T12:30:59.078244+0000","last_clean":"2024-04-26T12:30:59.078244+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:30:59.078244+0000","last_undegraded":"2024-04-26T12:30:59.078244+0000","last_fullsized":"2024-04-26T12:30:59.078244+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:40.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":976,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077821+0000","last_change":"2024-04-26T12:30:52.078990+0000","last_active":"2024-04-26T12:30:59.077821+0000","last_peered":"2024-04-26T12:30:59.077821+0000","last_clean":"2024-04-26T12:30:59.077821+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:30:59.077821+0000","last_undegraded":"2024-04-26T12:30:59.077821+0000","last_fullsized":"2024-04-26T12:30:59.077821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.697122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":514,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078332+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:30:59.078332+0000","last_peered":"2024-04-26T12:30:59.078332+0000","last_clean":"2024-04-26T12:30:59.078332+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:30:59.078332+0000","last_undegraded":"2024-04-26T12:30:59.078332+0000","last_fullsized":"2024-04-26T12:30:59.078332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:18.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077374+0000","last_change":"2024-04-26T12:30:48.089200+0000","last_active":"2024-04-26T12:30:59.077374+0000","last_peered":"2024-04-26T12:30:59.077374+0000","last_clean":"2024-04-26T12:30:59.077374+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:30:59.077374+0000","last_undegraded":"2024-04-26T12:30:59.077374+0000","last_fullsized":"2024-04-26T12:30:59.077374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:04.588329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077619+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:59.077619+0000","last_peered":"2024-04-26T12:30:59.077619+0000","last_clean":"2024-04-26T12:30:59.077619+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:30:59.077619+0000","last_undegraded":"2024-04-26T12:30:59.077619+0000","last_fullsized":"2024-04-26T12:30:59.077619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:40.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":557,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074143+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:30:57.074143+0000","last_peered":"2024-04-26T12:30:57.074143+0000","last_clean":"2024-04-26T12:30:57.074143+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:30:57.074143+0000","last_undegraded":"2024-04-26T12:30:57.074143+0000","last_fullsized":"2024-04-26T12:30:57.074143+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.230823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":250,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074084+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:30:57.074084+0000","last_peered":"2024-04-26T12:30:57.074084+0000","last_clean":"2024-04-26T12:30:57.074084+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:30:57.074084+0000","last_undegraded":"2024-04-26T12:30:57.074084+0000","last_fullsized":"2024-04-26T12:30:57.074084+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:30.864621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":537,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077889+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:30:59.077889+0000","last_peered":"2024-04-26T12:30:59.077889+0000","last_clean":"2024-04-26T12:30:59.077889+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:30:59.077889+0000","last_undegraded":"2024-04-26T12:30:59.077889+0000","last_fullsized":"2024-04-26T12:30:59.077889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:13.427584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":268,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077250+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:30:59.077250+0000","last_peered":"2024-04-26T12:30:59.077250+0000","last_clean":"2024-04-26T12:30:59.077250+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:30:59.077250+0000","last_undegraded":"2024-04-26T12:30:59.077250+0000","last_fullsized":"2024-04-26T12:30:59.077250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:16.260550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078751+0000","last_change":"2024-04-26T12:30:47.083054+0000","last_active":"2024-04-26T12:30:59.078751+0000","last_peered":"2024-04-26T12:30:59.078751+0000","last_clean":"2024-04-26T12:30:59.078751+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:30:59.078751+0000","last_undegraded":"2024-04-26T12:30:59.078751+0000","last_fullsized":"2024-04-26T12:30:59.078751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.645638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":162,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077348+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:30:59.077348+0000","last_peered":"2024-04-26T12:30:59.077348+0000","last_clean":"2024-04-26T12:30:59.077348+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:30:59.077348+0000","last_undegraded":"2024-04-26T12:30:59.077348+0000","last_fullsized":"2024-04-26T12:30:59.077348+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:20.988072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":492,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078566+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:30:59.078566+0000","last_peered":"2024-04-26T12:30:59.078566+0000","last_clean":"2024-04-26T12:30:59.078566+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:30:59.078566+0000","last_undegraded":"2024-04-26T12:30:59.078566+0000","last_fullsized":"2024-04-26T12:30:59.078566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":588,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078399+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:30:59.078399+0000","last_peered":"2024-04-26T12:30:59.078399+0000","last_clean":"2024-04-26T12:30:59.078399+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:30:59.078399+0000","last_undegraded":"2024-04-26T12:30:59.078399+0000","last_fullsized":"2024-04-26T12:30:59.078399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:25.266771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":496,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074845+0000","last_change":"2024-04-26T12:30:55.090354+0000","last_active":"2024-04-26T12:30:57.074845+0000","last_peered":"2024-04-26T12:30:57.074845+0000","last_clean":"2024-04-26T12:30:57.074845+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:30:57.074845+0000","last_undegraded":"2024-04-26T12:30:57.074845+0000","last_fullsized":"2024-04-26T12:30:57.074845+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:14.455369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074352+0000","last_change":"2024-04-26T12:30:41.026049+0000","last_active":"2024-04-26T12:30:57.074352+0000","last_peered":"2024-04-26T12:30:57.074352+0000","last_clean":"2024-04-26T12:30:57.074352+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:30:57.074352+0000","last_undegraded":"2024-04-26T12:30:57.074352+0000","last_fullsized":"2024-04-26T12:30:57.074352+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.409817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"58'454","reported_seq":480,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078638+0000","last_change":"2024-04-26T12:30:46.079367+0000","last_active":"2024-04-26T12:30:59.078638+0000","last_peered":"2024-04-26T12:30:59.078638+0000","last_clean":"2024-04-26T12:30:59.078638+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:30:59.078638+0000","last_undegraded":"2024-04-26T12:30:59.078638+0000","last_fullsized":"2024-04-26T12:30:59.078638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:00.950370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":472,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077726+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:30:59.077726+0000","last_peered":"2024-04-26T12:30:59.077726+0000","last_clean":"2024-04-26T12:30:59.077726+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:30:59.077726+0000","last_undegraded":"2024-04-26T12:30:59.077726+0000","last_fullsized":"2024-04-26T12:30:59.077726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078680+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:31:00.078680+0000","last_peered":"2024-04-26T12:31:00.078680+0000","last_clean":"2024-04-26T12:31:00.078680+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:31:00.078680+0000","last_undegraded":"2024-04-26T12:31:00.078680+0000","last_fullsized":"2024-04-26T12:31:00.078680+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:16.686041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":141,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077333+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:59.077333+0000","last_peered":"2024-04-26T12:30:59.077333+0000","last_clean":"2024-04-26T12:30:59.077333+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:30:59.077333+0000","last_undegraded":"2024-04-26T12:30:59.077333+0000","last_fullsized":"2024-04-26T12:30:59.077333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:18.069937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":497,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074267+0000","last_change":"2024-04-26T12:30:46.033999+0000","last_active":"2024-04-26T12:30:57.074267+0000","last_peered":"2024-04-26T12:30:57.074267+0000","last_clean":"2024-04-26T12:30:57.074267+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:30:57.074267+0000","last_undegraded":"2024-04-26T12:30:57.074267+0000","last_fullsized":"2024-04-26T12:30:57.074267+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:33.235467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073919+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:30:57.073919+0000","last_peered":"2024-04-26T12:30:57.073919+0000","last_clean":"2024-04-26T12:30:57.073919+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:30:57.073919+0000","last_undegraded":"2024-04-26T12:30:57.073919+0000","last_fullsized":"2024-04-26T12:30:57.073919+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:20.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":398,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077980+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:30:59.077980+0000","last_peered":"2024-04-26T12:30:59.077980+0000","last_clean":"2024-04-26T12:30:59.077980+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:30:59.077980+0000","last_undegraded":"2024-04-26T12:30:59.077980+0000","last_fullsized":"2024-04-26T12:30:59.077980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":430,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074784+0000","last_change":"2024-04-26T12:30:54.081099+0000","last_active":"2024-04-26T12:30:57.074784+0000","last_peered":"2024-04-26T12:30:57.074784+0000","last_clean":"2024-04-26T12:30:57.074784+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:30:57.074784+0000","last_undegraded":"2024-04-26T12:30:57.074784+0000","last_fullsized":"2024-04-26T12:30:57.074784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:29.507250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077511+0000","last_change":"2024-04-26T12:30:46.082961+0000","last_active":"2024-04-26T12:30:59.077511+0000","last_peered":"2024-04-26T12:30:59.077511+0000","last_clean":"2024-04-26T12:30:59.077511+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:30:59.077511+0000","last_undegraded":"2024-04-26T12:30:59.077511+0000","last_fullsized":"2024-04-26T12:30:59.077511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:10.764587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":263,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077256+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:30:59.077256+0000","last_peered":"2024-04-26T12:30:59.077256+0000","last_clean":"2024-04-26T12:30:59.077256+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:30:59.077256+0000","last_undegraded":"2024-04-26T12:30:59.077256+0000","last_fullsized":"2024-04-26T12:30:59.077256+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:23.542209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":596,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.073940+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:30:57.073940+0000","last_peered":"2024-04-26T12:30:57.073940+0000","last_clean":"2024-04-26T12:30:57.073940+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:30:57.073940+0000","last_undegraded":"2024-04-26T12:30:57.073940+0000","last_fullsized":"2024-04-26T12:30:57.073940+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:05.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":564,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078645+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:30:59.078645+0000","last_peered":"2024-04-26T12:30:59.078645+0000","last_clean":"2024-04-26T12:30:59.078645+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:30:59.078645+0000","last_undegraded":"2024-04-26T12:30:59.078645+0000","last_fullsized":"2024-04-26T12:30:59.078645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077378+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:30:59.077378+0000","last_peered":"2024-04-26T12:30:59.077378+0000","last_clean":"2024-04-26T12:30:59.077378+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:30:59.077378+0000","last_undegraded":"2024-04-26T12:30:59.077378+0000","last_fullsized":"2024-04-26T12:30:59.077378+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'105","reported_seq":220,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074099+0000","last_change":"2024-04-26T12:30:44.028851+0000","last_active":"2024-04-26T12:30:57.074099+0000","last_peered":"2024-04-26T12:30:57.074099+0000","last_clean":"2024-04-26T12:30:57.074099+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:30:57.074099+0000","last_undegraded":"2024-04-26T12:30:57.074099+0000","last_fullsized":"2024-04-26T12:30:57.074099+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:13.939165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078426+0000","last_change":"2024-04-26T12:30:57.078892+0000","last_active":"2024-04-26T12:30:59.078426+0000","last_peered":"2024-04-26T12:30:59.078426+0000","last_clean":"2024-04-26T12:30:59.078426+0000","last_became_active":"2024-04-26T12:30:57.077779+0000","last_became_peered":"2024-04-26T12:30:57.077779+0000","last_unstale":"2024-04-26T12:30:59.078426+0000","last_undegraded":"2024-04-26T12:30:59.078426+0000","last_fullsized":"2024-04-26T12:30:59.078426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:07.812506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078778+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:31:00.078778+0000","last_peered":"2024-04-26T12:31:00.078778+0000","last_clean":"2024-04-26T12:31:00.078778+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:31:00.078778+0000","last_undegraded":"2024-04-26T12:31:00.078778+0000","last_fullsized":"2024-04-26T12:31:00.078778+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:31.181549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074439+0000","last_change":"2024-04-26T12:30:41.026137+0000","last_active":"2024-04-26T12:30:57.074439+0000","last_peered":"2024-04-26T12:30:57.074439+0000","last_clean":"2024-04-26T12:30:57.074439+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:30:57.074439+0000","last_undegraded":"2024-04-26T12:30:57.074439+0000","last_fullsized":"2024-04-26T12:30:57.074439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:08.225745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":519,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077500+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:30:59.077500+0000","last_peered":"2024-04-26T12:30:59.077500+0000","last_clean":"2024-04-26T12:30:59.077500+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:30:59.077500+0000","last_undegraded":"2024-04-26T12:30:59.077500+0000","last_fullsized":"2024-04-26T12:30:59.077500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074635+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:30:57.074635+0000","last_peered":"2024-04-26T12:30:57.074635+0000","last_clean":"2024-04-26T12:30:57.074635+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:30:57.074635+0000","last_undegraded":"2024-04-26T12:30:57.074635+0000","last_fullsized":"2024-04-26T12:30:57.074635+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:51.609322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074557+0000","last_change":"2024-04-26T12:30:41.030157+0000","last_active":"2024-04-26T12:30:57.074557+0000","last_peered":"2024-04-26T12:30:57.074557+0000","last_clean":"2024-04-26T12:30:57.074557+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:57.074557+0000","last_undegraded":"2024-04-26T12:30:57.074557+0000","last_fullsized":"2024-04-26T12:30:57.074557+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:32.867679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":518,"reported_epoch":79,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T12:30:54.075180+0000","last_change":"2024-04-26T12:30:47.084724+0000","last_active":"2024-04-26T12:30:54.075180+0000","last_peered":"2024-04-26T12:30:54.075180+0000","last_clean":"2024-04-26T12:30:39.001153+0000","last_became_active":"2024-04-26T12:30:47.083601+0000","last_became_peered":"2024-04-26T12:30:47.083601+0000","last_unstale":"2024-04-26T12:30:54.075180+0000","last_undegraded":"2024-04-26T12:30:54.075180+0000","last_fullsized":"2024-04-26T12:30:54.075180+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:00.234562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":184,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078428+0000","last_change":"2024-04-26T12:30:46.080509+0000","last_active":"2024-04-26T12:30:59.078428+0000","last_peered":"2024-04-26T12:30:59.078428+0000","last_clean":"2024-04-26T12:30:59.078428+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:30:59.078428+0000","last_undegraded":"2024-04-26T12:30:59.078428+0000","last_fullsized":"2024-04-26T12:30:59.078428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:40.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'82","reported_seq":59,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074820+0000","last_change":"2024-04-26T12:30:46.086027+0000","last_active":"2024-04-26T12:30:57.074820+0000","last_peered":"2024-04-26T12:30:57.074820+0000","last_clean":"2024-04-26T12:30:57.074820+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:30:57.074820+0000","last_undegraded":"2024-04-26T12:30:57.074820+0000","last_fullsized":"2024-04-26T12:30:57.074820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:13.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":605,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077718+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:30:59.077718+0000","last_peered":"2024-04-26T12:30:59.077718+0000","last_clean":"2024-04-26T12:30:59.077718+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:30:59.077718+0000","last_undegraded":"2024-04-26T12:30:59.077718+0000","last_fullsized":"2024-04-26T12:30:59.077718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077612+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:30:59.077612+0000","last_peered":"2024-04-26T12:30:59.077612+0000","last_clean":"2024-04-26T12:30:59.077612+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:30:59.077612+0000","last_undegraded":"2024-04-26T12:30:59.077612+0000","last_fullsized":"2024-04-26T12:30:59.077612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.312112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":855,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078064+0000","last_change":"2024-04-26T12:30:53.079043+0000","last_active":"2024-04-26T12:30:59.078064+0000","last_peered":"2024-04-26T12:30:59.078064+0000","last_clean":"2024-04-26T12:30:59.078064+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:30:59.078064+0000","last_undegraded":"2024-04-26T12:30:59.078064+0000","last_fullsized":"2024-04-26T12:30:59.078064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:00.091756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":311,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078038+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:30:59.078038+0000","last_peered":"2024-04-26T12:30:59.078038+0000","last_clean":"2024-04-26T12:30:59.078038+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:30:59.078038+0000","last_undegraded":"2024-04-26T12:30:59.078038+0000","last_fullsized":"2024-04-26T12:30:59.078038+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:43.044883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":798,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077365+0000","last_change":"2024-04-26T12:30:48.088039+0000","last_active":"2024-04-26T12:30:59.077365+0000","last_peered":"2024-04-26T12:30:59.077365+0000","last_clean":"2024-04-26T12:30:59.077365+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:30:59.077365+0000","last_undegraded":"2024-04-26T12:30:59.077365+0000","last_fullsized":"2024-04-26T12:30:59.077365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:03.967118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"58'314","reported_seq":395,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077986+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:30:59.077986+0000","last_peered":"2024-04-26T12:30:59.077986+0000","last_clean":"2024-04-26T12:30:59.077986+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:30:59.077986+0000","last_undegraded":"2024-04-26T12:30:59.077986+0000","last_fullsized":"2024-04-26T12:30:59.077986+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":872,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077302+0000","last_change":"2024-04-26T12:30:52.079092+0000","last_active":"2024-04-26T12:30:59.077302+0000","last_peered":"2024-04-26T12:30:59.077302+0000","last_clean":"2024-04-26T12:30:59.077302+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:30:59.077302+0000","last_undegraded":"2024-04-26T12:30:59.077302+0000","last_fullsized":"2024-04-26T12:30:59.077302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:10.253347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"58'76","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074650+0000","last_change":"2024-04-26T12:30:41.050653+0000","last_active":"2024-04-26T12:30:57.074650+0000","last_peered":"2024-04-26T12:30:57.074650+0000","last_clean":"2024-04-26T12:30:57.074650+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:57.074650+0000","last_undegraded":"2024-04-26T12:30:57.074650+0000","last_fullsized":"2024-04-26T12:30:57.074650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:17.874875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":542,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076883+0000","last_change":"2024-04-26T12:28:00.707724+0000","last_active":"2024-04-26T12:30:59.076883+0000","last_peered":"2024-04-26T12:30:59.076883+0000","last_clean":"2024-04-26T12:30:59.076883+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:30:59.076883+0000","last_undegraded":"2024-04-26T12:30:59.076883+0000","last_fullsized":"2024-04-26T12:30:59.076883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:20.384961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074845+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:30:57.074845+0000","last_peered":"2024-04-26T12:30:57.074845+0000","last_clean":"2024-04-26T12:30:57.074845+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:30:57.074845+0000","last_undegraded":"2024-04-26T12:30:57.074845+0000","last_fullsized":"2024-04-26T12:30:57.074845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:40.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077689+0000","last_change":"2024-04-26T12:30:51.076207+0000","last_active":"2024-04-26T12:30:59.077689+0000","last_peered":"2024-04-26T12:30:59.077689+0000","last_clean":"2024-04-26T12:30:59.077689+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:30:59.077689+0000","last_undegraded":"2024-04-26T12:30:59.077689+0000","last_fullsized":"2024-04-26T12:30:59.077689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:05.869282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":863,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077482+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:30:59.077482+0000","last_peered":"2024-04-26T12:30:59.077482+0000","last_clean":"2024-04-26T12:30:59.077482+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:30:59.077482+0000","last_undegraded":"2024-04-26T12:30:59.077482+0000","last_fullsized":"2024-04-26T12:30:59.077482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:50.433671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":526,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074008+0000","last_change":"2024-04-26T12:30:54.080153+0000","last_active":"2024-04-26T12:30:57.074008+0000","last_peered":"2024-04-26T12:30:57.074008+0000","last_clean":"2024-04-26T12:30:57.074008+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:30:57.074008+0000","last_undegraded":"2024-04-26T12:30:57.074008+0000","last_fullsized":"2024-04-26T12:30:57.074008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:48.057283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":628,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077875+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:30:59.077875+0000","last_peered":"2024-04-26T12:30:59.077875+0000","last_clean":"2024-04-26T12:30:59.077875+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:30:59.077875+0000","last_undegraded":"2024-04-26T12:30:59.077875+0000","last_fullsized":"2024-04-26T12:30:59.077875+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":513,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T12:30:57.074363+0000","last_change":"2024-04-26T12:30:50.086765+0000","last_active":"2024-04-26T12:30:57.074363+0000","last_peered":"2024-04-26T12:30:57.074363+0000","last_clean":"2024-04-26T12:30:57.074363+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:30:57.074363+0000","last_undegraded":"2024-04-26T12:30:57.074363+0000","last_fullsized":"2024-04-26T12:30:57.074363+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:36.313767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078165+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:30:59.078165+0000","last_peered":"2024-04-26T12:30:59.078165+0000","last_clean":"2024-04-26T12:30:59.078165+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:30:59.078165+0000","last_undegraded":"2024-04-26T12:30:59.078165+0000","last_fullsized":"2024-04-26T12:30:59.078165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":363,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79134720,"data_stored":256449018,"data_compressed":38844374,"data_compressed_allocated":48693248,"data_compressed_original":226074624,"omap_allocated":5343,"internal_metadata":0},"log_size":7508,"ondisk_log_size":7508,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738423,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130116,"kb_used_data":30960,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94241724,"statfs":{"total":96636764160,"available":96503525376,"internally_reserved":0,"allocated":31703040,"data_stored":85781026,"data_compressed":12062822,"data_compressed_allocated":15765504,"data_compressed_original":70336512,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.23599999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.48299999999999998}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.26300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738423,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131328,"kb_used_data":32180,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94240512,"statfs":{"total":96636764160,"available":96502284288,"internally_reserved":0,"allocated":32952320,"data_stored":91446910,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Apr 26 12:30:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.30399999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.625,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.42499999999999999}]}]},{"osd":1,"up_from":64,"seq":274877906950,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62328,"kb_used_data":16744,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309512,"statfs":{"total":96636764160,"available":96572940288,"internally_reserved":0,"allocated":17145856,"data_stored":81539814,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30789632,"data_stored":84809889,"data_compressed":12028675,"data_compressed_allocated":15720448,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:08.290 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:08.652 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:31:08.654 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:31:08.665 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-04-26T12:31:07.360354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6546,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34345,"ondisk_log_size":34345,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":323796,"kb_used_data":79916,"kb_used_omap":9,"kb_used_meta":243830,"kb_avail":282791724,"statfs":{"total":289910292480,"available":289578725376,"internally_reserved":0,"allocated":81833984,"data_stored":258784844,"data_compressed":38912668,"data_compressed_allocated":48783360,"data_compressed_original":227221504,"omap_allocated":10125,"internal_metadata":249682035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-196,"num_objects_misplaced":-363,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.285293"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":901,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078865+0000","last_change":"2024-04-26T12:30:54.081113+0000","last_active":"2024-04-26T12:31:00.078865+0000","last_peered":"2024-04-26T12:31:00.078865+0000","last_clean":"2024-04-26T12:31:00.078865+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:31:00.078865+0000","last_undegraded":"2024-04-26T12:31:00.078865+0000","last_fullsized":"2024-04-26T12:31:00.078865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.062347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":957,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078333+0000","last_change":"2024-04-26T12:30:56.085870+0000","last_active":"2024-04-26T12:31:00.078333+0000","last_peered":"2024-04-26T12:31:00.078333+0000","last_clean":"2024-04-26T12:31:00.078333+0000","last_became_active":"2024-04-26T12:30:56.084642+0000","last_became_peered":"2024-04-26T12:30:56.084642+0000","last_unstale":"2024-04-26T12:31:00.078333+0000","last_undegraded":"2024-04-26T12:31:00.078333+0000","last_fullsized":"2024-04-26T12:31:00.078333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:41.346086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":495,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078491+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:30:59.078491+0000","last_peered":"2024-04-26T12:30:59.078491+0000","last_clean":"2024-04-26T12:30:59.078491+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:30:59.078491+0000","last_undegraded":"2024-04-26T12:30:59.078491+0000","last_fullsized":"2024-04-26T12:30:59.078491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:55.616144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":867,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078158+0000","last_change":"2024-04-26T12:30:48.089842+0000","last_active":"2024-04-26T12:30:59.078158+0000","last_peered":"2024-04-26T12:30:59.078158+0000","last_clean":"2024-04-26T12:30:59.078158+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:30:59.078158+0000","last_undegraded":"2024-04-26T12:30:59.078158+0000","last_fullsized":"2024-04-26T12:30:59.078158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:13.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":939,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077433+0000","last_change":"2024-04-26T12:30:48.089460+0000","last_active":"2024-04-26T12:30:59.077433+0000","last_peered":"2024-04-26T12:30:59.077433+0000","last_clean":"2024-04-26T12:30:59.077433+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:30:59.077433+0000","last_undegraded":"2024-04-26T12:30:59.077433+0000","last_fullsized":"2024-04-26T12:30:59.077433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077152+0000","last_change":"2024-04-26T12:30:48.090606+0000","last_active":"2024-04-26T12:30:59.077152+0000","last_peered":"2024-04-26T12:30:59.077152+0000","last_clean":"2024-04-26T12:30:59.077152+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:30:59.077152+0000","last_undegraded":"2024-04-26T12:30:59.077152+0000","last_fullsized":"2024-04-26T12:30:59.077152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:57.446858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1028,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077423+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:30:59.077423+0000","last_peered":"2024-04-26T12:30:59.077423+0000","last_clean":"2024-04-26T12:30:59.077423+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:30:59.077423+0000","last_undegraded":"2024-04-26T12:30:59.077423+0000","last_fullsized":"2024-04-26T12:30:59.077423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:06.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":767,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076901+0000","last_change":"2024-04-26T12:30:49.082511+0000","last_active":"2024-04-26T12:30:59.076901+0000","last_peered":"2024-04-26T12:30:59.076901+0000","last_clean":"2024-04-26T12:30:59.076901+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:30:59.076901+0000","last_undegraded":"2024-04-26T12:30:59.076901+0000","last_fullsized":"2024-04-26T12:30:59.076901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:54.832086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077579+0000","last_change":"2024-04-26T12:30:56.079114+0000","last_active":"2024-04-26T12:30:59.077579+0000","last_peered":"2024-04-26T12:30:59.077579+0000","last_clean":"2024-04-26T12:30:59.077579+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:30:59.077579+0000","last_undegraded":"2024-04-26T12:30:59.077579+0000","last_fullsized":"2024-04-26T12:30:59.077579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:37.907357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":911,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078367+0000","last_change":"2024-04-26T12:30:56.087672+0000","last_active":"2024-04-26T12:30:59.078367+0000","last_peered":"2024-04-26T12:30:59.078367+0000","last_clean":"2024-04-26T12:30:59.078367+0000","last_became_active":"2024-04-26T12:30:56.085904+0000","last_became_peered":"2024-04-26T12:30:56.085904+0000","last_unstale":"2024-04-26T12:30:59.078367+0000","last_undegraded":"2024-04-26T12:30:59.078367+0000","last_fullsized":"2024-04-26T12:30:59.078367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:53.993298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":594,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078178+0000","last_change":"2024-04-26T12:30:50.085026+0000","last_active":"2024-04-26T12:30:59.078178+0000","last_peered":"2024-04-26T12:30:59.078178+0000","last_clean":"2024-04-26T12:30:59.078178+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:30:59.078178+0000","last_undegraded":"2024-04-26T12:30:59.078178+0000","last_fullsized":"2024-04-26T12:30:59.078178+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:31.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077591+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:30:59.077591+0000","last_peered":"2024-04-26T12:30:59.077591+0000","last_clean":"2024-04-26T12:30:59.077591+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:30:59.077591+0000","last_undegraded":"2024-04-26T12:30:59.077591+0000","last_fullsized":"2024-04-26T12:30:59.077591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":883,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077635+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:30:59.077635+0000","last_peered":"2024-04-26T12:30:59.077635+0000","last_clean":"2024-04-26T12:30:59.077635+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:30:59.077635+0000","last_undegraded":"2024-04-26T12:30:59.077635+0000","last_fullsized":"2024-04-26T12:30:59.077635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:00.467106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":520,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077571+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:30:59.077571+0000","last_peered":"2024-04-26T12:30:59.077571+0000","last_clean":"2024-04-26T12:30:59.077571+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:30:59.077571+0000","last_undegraded":"2024-04-26T12:30:59.077571+0000","last_fullsized":"2024-04-26T12:30:59.077571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":540,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077003+0000","last_change":"2024-04-26T12:30:47.080645+0000","last_active":"2024-04-26T12:30:59.077003+0000","last_peered":"2024-04-26T12:30:59.077003+0000","last_clean":"2024-04-26T12:30:59.077003+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:30:59.077003+0000","last_undegraded":"2024-04-26T12:30:59.077003+0000","last_fullsized":"2024-04-26T12:30:59.077003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:11.047331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":926,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077140+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:30:59.077140+0000","last_peered":"2024-04-26T12:30:59.077140+0000","last_clean":"2024-04-26T12:30:59.077140+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:30:59.077140+0000","last_undegraded":"2024-04-26T12:30:59.077140+0000","last_fullsized":"2024-04-26T12:30:59.077140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:18.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":493,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077499+0000","last_change":"2024-04-26T12:30:55.090347+0000","last_active":"2024-04-26T12:30:59.077499+0000","last_peered":"2024-04-26T12:30:59.077499+0000","last_clean":"2024-04-26T12:30:59.077499+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:30:59.077499+0000","last_undegraded":"2024-04-26T12:30:59.077499+0000","last_fullsized":"2024-04-26T12:30:59.077499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:18.689900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":912,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078455+0000","last_change":"2024-04-26T12:30:57.084445+0000","last_active":"2024-04-26T12:30:59.078455+0000","last_peered":"2024-04-26T12:30:59.078455+0000","last_clean":"2024-04-26T12:30:59.078455+0000","last_became_active":"2024-04-26T12:30:57.083026+0000","last_became_peered":"2024-04-26T12:30:57.083026+0000","last_unstale":"2024-04-26T12:30:59.078455+0000","last_undegraded":"2024-04-26T12:30:59.078455+0000","last_fullsized":"2024-04-26T12:30:59.078455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:26.231571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076908+0000","last_change":"2024-04-26T12:30:51.076894+0000","last_active":"2024-04-26T12:30:59.076908+0000","last_peered":"2024-04-26T12:30:59.076908+0000","last_clean":"2024-04-26T12:30:59.076908+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:30:59.076908+0000","last_undegraded":"2024-04-26T12:30:59.076908+0000","last_fullsized":"2024-04-26T12:30:59.076908+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:50.091007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1070,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078148+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:30:59.078148+0000","last_peered":"2024-04-26T12:30:59.078148+0000","last_clean":"2024-04-26T12:30:59.078148+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:30:59.078148+0000","last_undegraded":"2024-04-26T12:30:59.078148+0000","last_fullsized":"2024-04-26T12:30:59.078148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:26.268194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":952,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077199+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:30:59.077199+0000","last_peered":"2024-04-26T12:30:59.077199+0000","last_clean":"2024-04-26T12:30:59.077199+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:30:59.077199+0000","last_undegraded":"2024-04-26T12:30:59.077199+0000","last_fullsized":"2024-04-26T12:30:59.077199+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:12.535434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":580,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077653+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:30:59.077653+0000","last_peered":"2024-04-26T12:30:59.077653+0000","last_clean":"2024-04-26T12:30:59.077653+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:30:59.077653+0000","last_undegraded":"2024-04-26T12:30:59.077653+0000","last_fullsized":"2024-04-26T12:30:59.077653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.082038+0000","last_change":"2024-04-26T12:31:00.082038+0000","last_active":"2024-04-26T12:31:00.082038+0000","last_peered":"2024-04-26T12:31:00.082038+0000","last_clean":"2024-04-26T12:31:00.082038+0000","last_became_active":"2024-04-26T12:31:00.079766+0000","last_became_peered":"2024-04-26T12:31:00.079766+0000","last_unstale":"2024-04-26T12:31:00.082038+0000","last_undegraded":"2024-04-26T12:31:00.082038+0000","last_fullsized":"2024-04-26T12:31:00.082038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:29.495060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":1017,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078556+0000","last_change":"2024-04-26T12:30:58.079466+0000","last_active":"2024-04-26T12:30:59.078556+0000","last_peered":"2024-04-26T12:30:59.078556+0000","last_clean":"2024-04-26T12:30:59.078556+0000","last_became_active":"2024-04-26T12:30:58.078211+0000","last_became_peered":"2024-04-26T12:30:58.078211+0000","last_unstale":"2024-04-26T12:30:59.078556+0000","last_undegraded":"2024-04-26T12:30:59.078556+0000","last_fullsized":"2024-04-26T12:30:59.078556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:42.746789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078438+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:30:59.078438+0000","last_peered":"2024-04-26T12:30:59.078438+0000","last_clean":"2024-04-26T12:30:59.078438+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:30:59.078438+0000","last_undegraded":"2024-04-26T12:30:59.078438+0000","last_fullsized":"2024-04-26T12:30:59.078438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":585,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077533+0000","last_change":"2024-04-26T12:30:46.089997+0000","last_active":"2024-04-26T12:30:59.077533+0000","last_peered":"2024-04-26T12:30:59.077533+0000","last_clean":"2024-04-26T12:30:59.077533+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:30:59.077533+0000","last_undegraded":"2024-04-26T12:30:59.077533+0000","last_fullsized":"2024-04-26T12:30:59.077533+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:08.843126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078301+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:30:59.078301+0000","last_peered":"2024-04-26T12:30:59.078301+0000","last_clean":"2024-04-26T12:30:59.078301+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:30:59.078301+0000","last_undegraded":"2024-04-26T12:30:59.078301+0000","last_fullsized":"2024-04-26T12:30:59.078301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077517+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:30:59.077517+0000","last_peered":"2024-04-26T12:30:59.077517+0000","last_clean":"2024-04-26T12:30:59.077517+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:30:59.077517+0000","last_undegraded":"2024-04-26T12:30:59.077517+0000","last_fullsized":"2024-04-26T12:30:59.077517+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:21.302173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078191+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:30:59.078191+0000","last_peered":"2024-04-26T12:30:59.078191+0000","last_clean":"2024-04-26T12:30:59.078191+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:30:59.078191+0000","last_undegraded":"2024-04-26T12:30:59.078191+0000","last_fullsized":"2024-04-26T12:30:59.078191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":410,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076264+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:30:59.076264+0000","last_peered":"2024-04-26T12:30:59.076264+0000","last_clean":"2024-04-26T12:30:59.076264+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:30:59.076264+0000","last_undegraded":"2024-04-26T12:30:59.076264+0000","last_fullsized":"2024-04-26T12:30:59.076264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.762427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077325+0000","last_change":"2024-04-26T12:30:58.081169+0000","last_active":"2024-04-26T12:30:59.077325+0000","last_peered":"2024-04-26T12:30:59.077325+0000","last_clean":"2024-04-26T12:30:59.077325+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:30:59.077325+0000","last_undegraded":"2024-04-26T12:30:59.077325+0000","last_fullsized":"2024-04-26T12:30:59.077325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:42.618440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"58'708","reported_seq":778,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076197+0000","last_change":"2024-04-26T12:30:44.022038+0000","last_active":"2024-04-26T12:30:59.076197+0000","last_peered":"2024-04-26T12:30:59.076197+0000","last_clean":"2024-04-26T12:30:59.076197+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:30:59.076197+0000","last_undegraded":"2024-04-26T12:30:59.076197+0000","last_fullsized":"2024-04-26T12:30:59.076197+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:30.369118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":500,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078749+0000","last_change":"2024-04-26T12:30:47.081417+0000","last_active":"2024-04-26T12:31:00.078749+0000","last_peered":"2024-04-26T12:31:00.078749+0000","last_clean":"2024-04-26T12:31:00.078749+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:31:00.078749+0000","last_undegraded":"2024-04-26T12:31:00.078749+0000","last_fullsized":"2024-04-26T12:31:00.078749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:17.628933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077196+0000","last_change":"2024-04-26T12:30:41.018067+0000","last_active":"2024-04-26T12:30:59.077196+0000","last_peered":"2024-04-26T12:30:59.077196+0000","last_clean":"2024-04-26T12:30:59.077196+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:30:59.077196+0000","last_undegraded":"2024-04-26T12:30:59.077196+0000","last_fullsized":"2024-04-26T12:30:59.077196+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:33.684743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":594,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076422+0000","last_change":"2024-04-26T12:30:58.081823+0000","last_active":"2024-04-26T12:30:59.076422+0000","last_peered":"2024-04-26T12:30:59.076422+0000","last_clean":"2024-04-26T12:30:59.076422+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:30:59.076422+0000","last_undegraded":"2024-04-26T12:30:59.076422+0000","last_fullsized":"2024-04-26T12:30:59.076422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.109302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"58'355","reported_seq":377,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078258+0000","last_change":"2024-04-26T12:30:48.086933+0000","last_active":"2024-04-26T12:30:59.078258+0000","last_peered":"2024-04-26T12:30:59.078258+0000","last_clean":"2024-04-26T12:30:59.078258+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:30:59.078258+0000","last_undegraded":"2024-04-26T12:30:59.078258+0000","last_fullsized":"2024-04-26T12:30:59.078258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:49.737283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":720,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076317+0000","last_change":"2024-04-26T12:30:46.034642+0000","last_active":"2024-04-26T12:30:59.076317+0000","last_peered":"2024-04-26T12:30:59.076317+0000","last_clean":"2024-04-26T12:30:59.076317+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:30:59.076317+0000","last_undegraded":"2024-04-26T12:30:59.076317+0000","last_fullsized":"2024-04-26T12:30:59.076317+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.961343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077954+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:30:59.077954+0000","last_peered":"2024-04-26T12:30:59.077954+0000","last_clean":"2024-04-26T12:30:59.077954+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:30:59.077954+0000","last_undegraded":"2024-04-26T12:30:59.077954+0000","last_fullsized":"2024-04-26T12:30:59.077954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076500+0000","last_change":"2024-04-26T12:30:45.022716+0000","last_active":"2024-04-26T12:30:59.076500+0000","last_peered":"2024-04-26T12:30:59.076500+0000","last_clean":"2024-04-26T12:30:59.076500+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:30:59.076500+0000","last_undegraded":"2024-04-26T12:30:59.076500+0000","last_fullsized":"2024-04-26T12:30:59.076500+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:01.269901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'374","reported_seq":439,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078040+0000","last_change":"2024-04-26T12:30:46.079618+0000","last_active":"2024-04-26T12:30:59.078040+0000","last_peered":"2024-04-26T12:30:59.078040+0000","last_clean":"2024-04-26T12:30:59.078040+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:30:59.078040+0000","last_undegraded":"2024-04-26T12:30:59.078040+0000","last_fullsized":"2024-04-26T12:30:59.078040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:48.209628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":506,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077751+0000","last_change":"2024-04-26T12:30:47.082596+0000","last_active":"2024-04-26T12:30:59.077751+0000","last_peered":"2024-04-26T12:30:59.077751+0000","last_clean":"2024-04-26T12:30:59.077751+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:30:59.077751+0000","last_undegraded":"2024-04-26T12:30:59.077751+0000","last_fullsized":"2024-04-26T12:30:59.077751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:34.688913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":648,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077638+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:30:59.077638+0000","last_peered":"2024-04-26T12:30:59.077638+0000","last_clean":"2024-04-26T12:30:59.077638+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:30:59.077638+0000","last_undegraded":"2024-04-26T12:30:59.077638+0000","last_fullsized":"2024-04-26T12:30:59.077638+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:50.674218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":794,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078066+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:30:59.078066+0000","last_peered":"2024-04-26T12:30:59.078066+0000","last_clean":"2024-04-26T12:30:59.078066+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:30:59.078066+0000","last_undegraded":"2024-04-26T12:30:59.078066+0000","last_fullsized":"2024-04-26T12:30:59.078066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:11.548975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076400+0000","last_change":"2024-04-26T12:30:46.089052+0000","last_active":"2024-04-26T12:30:59.076400+0000","last_peered":"2024-04-26T12:30:59.076400+0000","last_clean":"2024-04-26T12:30:59.076400+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:30:59.076400+0000","last_undegraded":"2024-04-26T12:30:59.076400+0000","last_fullsized":"2024-04-26T12:30:59.076400+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:28.433853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":860,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078103+0000","last_change":"2024-04-26T12:30:50.086492+0000","last_active":"2024-04-26T12:30:59.078103+0000","last_peered":"2024-04-26T12:30:59.078103+0000","last_clean":"2024-04-26T12:30:59.078103+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:30:59.078103+0000","last_undegraded":"2024-04-26T12:30:59.078103+0000","last_fullsized":"2024-04-26T12:30:59.078103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:18.705037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077626+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:30:59.077626+0000","last_peered":"2024-04-26T12:30:59.077626+0000","last_clean":"2024-04-26T12:30:59.077626+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:30:59.077626+0000","last_undegraded":"2024-04-26T12:30:59.077626+0000","last_fullsized":"2024-04-26T12:30:59.077626+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":500,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.086763+0000","last_change":"2024-04-26T12:30:59.083411+0000","last_active":"2024-04-26T12:30:59.086763+0000","last_peered":"2024-04-26T12:30:59.086763+0000","last_clean":"2024-04-26T12:30:59.086763+0000","last_became_active":"2024-04-26T12:30:59.081424+0000","last_became_peered":"2024-04-26T12:30:59.081424+0000","last_unstale":"2024-04-26T12:30:59.086763+0000","last_undegraded":"2024-04-26T12:30:59.086763+0000","last_fullsized":"2024-04-26T12:30:59.086763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:09.181871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'54","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077588+0000","last_change":"2024-04-26T12:30:46.082166+0000","last_active":"2024-04-26T12:30:59.077588+0000","last_peered":"2024-04-26T12:30:59.077588+0000","last_clean":"2024-04-26T12:30:59.077588+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:30:59.077588+0000","last_undegraded":"2024-04-26T12:30:59.077588+0000","last_fullsized":"2024-04-26T12:30:59.077588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:28.037535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":538,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.089343+0000","last_change":"2024-04-26T12:30:59.084548+0000","last_active":"2024-04-26T12:30:59.089343+0000","last_peered":"2024-04-26T12:30:59.089343+0000","last_clean":"2024-04-26T12:30:59.089343+0000","last_became_active":"2024-04-26T12:30:59.081463+0000","last_became_peered":"2024-04-26T12:30:59.081463+0000","last_unstale":"2024-04-26T12:30:59.089343+0000","last_undegraded":"2024-04-26T12:30:59.089343+0000","last_fullsized":"2024-04-26T12:30:59.089343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:51.815050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'186","reported_seq":209,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078288+0000","last_change":"2024-04-26T12:30:46.080074+0000","last_active":"2024-04-26T12:30:59.078288+0000","last_peered":"2024-04-26T12:30:59.078288+0000","last_clean":"2024-04-26T12:30:59.078288+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:30:59.078288+0000","last_undegraded":"2024-04-26T12:30:59.078288+0000","last_fullsized":"2024-04-26T12:30:59.078288+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:24.562647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":531,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077193+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:30:59.077193+0000","last_peered":"2024-04-26T12:30:59.077193+0000","last_clean":"2024-04-26T12:30:59.077193+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:30:59.077193+0000","last_undegraded":"2024-04-26T12:30:59.077193+0000","last_fullsized":"2024-04-26T12:30:59.077193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078244+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:30:59.078244+0000","last_peered":"2024-04-26T12:30:59.078244+0000","last_clean":"2024-04-26T12:30:59.078244+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:30:59.078244+0000","last_undegraded":"2024-04-26T12:30:59.078244+0000","last_fullsized":"2024-04-26T12:30:59.078244+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:40.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":976,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077821+0000","last_change":"2024-04-26T12:30:52.078990+0000","last_active":"2024-04-26T12:30:59.077821+0000","last_peered":"2024-04-26T12:30:59.077821+0000","last_clean":"2024-04-26T12:30:59.077821+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:30:59.077821+0000","last_undegraded":"2024-04-26T12:30:59.077821+0000","last_fullsized":"2024-04-26T12:30:59.077821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.697122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":514,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078332+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:30:59.078332+0000","last_peered":"2024-04-26T12:30:59.078332+0000","last_clean":"2024-04-26T12:30:59.078332+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:30:59.078332+0000","last_undegraded":"2024-04-26T12:30:59.078332+0000","last_fullsized":"2024-04-26T12:30:59.078332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:18.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077374+0000","last_change":"2024-04-26T12:30:48.089200+0000","last_active":"2024-04-26T12:30:59.077374+0000","last_peered":"2024-04-26T12:30:59.077374+0000","last_clean":"2024-04-26T12:30:59.077374+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:30:59.077374+0000","last_undegraded":"2024-04-26T12:30:59.077374+0000","last_fullsized":"2024-04-26T12:30:59.077374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:04.588329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077619+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:59.077619+0000","last_peered":"2024-04-26T12:30:59.077619+0000","last_clean":"2024-04-26T12:30:59.077619+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:30:59.077619+0000","last_undegraded":"2024-04-26T12:30:59.077619+0000","last_fullsized":"2024-04-26T12:30:59.077619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:40.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":559,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076624+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:30:59.076624+0000","last_peered":"2024-04-26T12:30:59.076624+0000","last_clean":"2024-04-26T12:30:59.076624+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:30:59.076624+0000","last_undegraded":"2024-04-26T12:30:59.076624+0000","last_fullsized":"2024-04-26T12:30:59.076624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.230823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":252,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076455+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:30:59.076455+0000","last_peered":"2024-04-26T12:30:59.076455+0000","last_clean":"2024-04-26T12:30:59.076455+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:30:59.076455+0000","last_undegraded":"2024-04-26T12:30:59.076455+0000","last_fullsized":"2024-04-26T12:30:59.076455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:30.864621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":537,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077889+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:30:59.077889+0000","last_peered":"2024-04-26T12:30:59.077889+0000","last_clean":"2024-04-26T12:30:59.077889+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:30:59.077889+0000","last_undegraded":"2024-04-26T12:30:59.077889+0000","last_fullsized":"2024-04-26T12:30:59.077889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:13.427584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":268,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077250+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:30:59.077250+0000","last_peered":"2024-04-26T12:30:59.077250+0000","last_clean":"2024-04-26T12:30:59.077250+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:30:59.077250+0000","last_undegraded":"2024-04-26T12:30:59.077250+0000","last_fullsized":"2024-04-26T12:30:59.077250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:16.260550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078751+0000","last_change":"2024-04-26T12:30:47.083054+0000","last_active":"2024-04-26T12:30:59.078751+0000","last_peered":"2024-04-26T12:30:59.078751+0000","last_clean":"2024-04-26T12:30:59.078751+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:30:59.078751+0000","last_undegraded":"2024-04-26T12:30:59.078751+0000","last_fullsized":"2024-04-26T12:30:59.078751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.645638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":162,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077348+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:30:59.077348+0000","last_peered":"2024-04-26T12:30:59.077348+0000","last_clean":"2024-04-26T12:30:59.077348+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:30:59.077348+0000","last_undegraded":"2024-04-26T12:30:59.077348+0000","last_fullsized":"2024-04-26T12:30:59.077348+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:20.988072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":492,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078566+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:30:59.078566+0000","last_peered":"2024-04-26T12:30:59.078566+0000","last_clean":"2024-04-26T12:30:59.078566+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:30:59.078566+0000","last_undegraded":"2024-04-26T12:30:59.078566+0000","last_fullsized":"2024-04-26T12:30:59.078566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":588,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078399+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:30:59.078399+0000","last_peered":"2024-04-26T12:30:59.078399+0000","last_clean":"2024-04-26T12:30:59.078399+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:30:59.078399+0000","last_undegraded":"2024-04-26T12:30:59.078399+0000","last_fullsized":"2024-04-26T12:30:59.078399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:25.266771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077354+0000","last_change":"2024-04-26T12:30:55.090354+0000","last_active":"2024-04-26T12:30:59.077354+0000","last_peered":"2024-04-26T12:30:59.077354+0000","last_clean":"2024-04-26T12:30:59.077354+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:30:59.077354+0000","last_undegraded":"2024-04-26T12:30:59.077354+0000","last_fullsized":"2024-04-26T12:30:59.077354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:14.455369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076944+0000","last_change":"2024-04-26T12:30:41.026049+0000","last_active":"2024-04-26T12:30:59.076944+0000","last_peered":"2024-04-26T12:30:59.076944+0000","last_clean":"2024-04-26T12:30:59.076944+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:30:59.076944+0000","last_undegraded":"2024-04-26T12:30:59.076944+0000","last_fullsized":"2024-04-26T12:30:59.076944+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.409817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"58'454","reported_seq":480,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078638+0000","last_change":"2024-04-26T12:30:46.079367+0000","last_active":"2024-04-26T12:30:59.078638+0000","last_peered":"2024-04-26T12:30:59.078638+0000","last_clean":"2024-04-26T12:30:59.078638+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:30:59.078638+0000","last_undegraded":"2024-04-26T12:30:59.078638+0000","last_fullsized":"2024-04-26T12:30:59.078638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:00.950370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":473,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078369+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:31:00.078369+0000","last_peered":"2024-04-26T12:31:00.078369+0000","last_clean":"2024-04-26T12:31:00.078369+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:31:00.078369+0000","last_undegraded":"2024-04-26T12:31:00.078369+0000","last_fullsized":"2024-04-26T12:31:00.078369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078680+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:31:00.078680+0000","last_peered":"2024-04-26T12:31:00.078680+0000","last_clean":"2024-04-26T12:31:00.078680+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:31:00.078680+0000","last_undegraded":"2024-04-26T12:31:00.078680+0000","last_fullsized":"2024-04-26T12:31:00.078680+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:16.686041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078300+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:00.078300+0000","last_peered":"2024-04-26T12:31:00.078300+0000","last_clean":"2024-04-26T12:31:00.078300+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:31:00.078300+0000","last_undegraded":"2024-04-26T12:31:00.078300+0000","last_fullsized":"2024-04-26T12:31:00.078300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:18.069937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076887+0000","last_change":"2024-04-26T12:30:46.033999+0000","last_active":"2024-04-26T12:30:59.076887+0000","last_peered":"2024-04-26T12:30:59.076887+0000","last_clean":"2024-04-26T12:30:59.076887+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:30:59.076887+0000","last_undegraded":"2024-04-26T12:30:59.076887+0000","last_fullsized":"2024-04-26T12:30:59.076887+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:33.235467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076629+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:30:59.076629+0000","last_peered":"2024-04-26T12:30:59.076629+0000","last_clean":"2024-04-26T12:30:59.076629+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:30:59.076629+0000","last_undegraded":"2024-04-26T12:30:59.076629+0000","last_fullsized":"2024-04-26T12:30:59.076629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:20.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":398,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077980+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:30:59.077980+0000","last_peered":"2024-04-26T12:30:59.077980+0000","last_clean":"2024-04-26T12:30:59.077980+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:30:59.077980+0000","last_undegraded":"2024-04-26T12:30:59.077980+0000","last_fullsized":"2024-04-26T12:30:59.077980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":432,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077237+0000","last_change":"2024-04-26T12:30:54.081099+0000","last_active":"2024-04-26T12:30:59.077237+0000","last_peered":"2024-04-26T12:30:59.077237+0000","last_clean":"2024-04-26T12:30:59.077237+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:30:59.077237+0000","last_undegraded":"2024-04-26T12:30:59.077237+0000","last_fullsized":"2024-04-26T12:30:59.077237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:29.507250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077511+0000","last_change":"2024-04-26T12:30:46.082961+0000","last_active":"2024-04-26T12:30:59.077511+0000","last_peered":"2024-04-26T12:30:59.077511+0000","last_clean":"2024-04-26T12:30:59.077511+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:30:59.077511+0000","last_undegraded":"2024-04-26T12:30:59.077511+0000","last_fullsized":"2024-04-26T12:30:59.077511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:10.764587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":263,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077256+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:30:59.077256+0000","last_peered":"2024-04-26T12:30:59.077256+0000","last_clean":"2024-04-26T12:30:59.077256+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:30:59.077256+0000","last_undegraded":"2024-04-26T12:30:59.077256+0000","last_fullsized":"2024-04-26T12:30:59.077256+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:23.542209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":598,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076589+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:30:59.076589+0000","last_peered":"2024-04-26T12:30:59.076589+0000","last_clean":"2024-04-26T12:30:59.076589+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:30:59.076589+0000","last_undegraded":"2024-04-26T12:30:59.076589+0000","last_fullsized":"2024-04-26T12:30:59.076589+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:05.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":565,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078891+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:31:00.078891+0000","last_peered":"2024-04-26T12:31:00.078891+0000","last_clean":"2024-04-26T12:31:00.078891+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:31:00.078891+0000","last_undegraded":"2024-04-26T12:31:00.078891+0000","last_fullsized":"2024-04-26T12:31:00.078891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077378+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:30:59.077378+0000","last_peered":"2024-04-26T12:30:59.077378+0000","last_clean":"2024-04-26T12:30:59.077378+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:30:59.077378+0000","last_undegraded":"2024-04-26T12:30:59.077378+0000","last_fullsized":"2024-04-26T12:30:59.077378+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'105","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077011+0000","last_change":"2024-04-26T12:30:44.028851+0000","last_active":"2024-04-26T12:30:59.077011+0000","last_peered":"2024-04-26T12:30:59.077011+0000","last_clean":"2024-04-26T12:30:59.077011+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:30:59.077011+0000","last_undegraded":"2024-04-26T12:30:59.077011+0000","last_fullsized":"2024-04-26T12:30:59.077011+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:13.939165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078426+0000","last_change":"2024-04-26T12:30:57.078892+0000","last_active":"2024-04-26T12:30:59.078426+0000","last_peered":"2024-04-26T12:30:59.078426+0000","last_clean":"2024-04-26T12:30:59.078426+0000","last_became_active":"2024-04-26T12:30:57.077779+0000","last_became_peered":"2024-04-26T12:30:57.077779+0000","last_unstale":"2024-04-26T12:30:59.078426+0000","last_undegraded":"2024-04-26T12:30:59.078426+0000","last_fullsized":"2024-04-26T12:30:59.078426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:07.812506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078778+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:31:00.078778+0000","last_peered":"2024-04-26T12:31:00.078778+0000","last_clean":"2024-04-26T12:31:00.078778+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:31:00.078778+0000","last_undegraded":"2024-04-26T12:31:00.078778+0000","last_fullsized":"2024-04-26T12:31:00.078778+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:31.181549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077119+0000","last_change":"2024-04-26T12:30:41.026137+0000","last_active":"2024-04-26T12:30:59.077119+0000","last_peered":"2024-04-26T12:30:59.077119+0000","last_clean":"2024-04-26T12:30:59.077119+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:30:59.077119+0000","last_undegraded":"2024-04-26T12:30:59.077119+0000","last_fullsized":"2024-04-26T12:30:59.077119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:08.225745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":520,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077810+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:31:00.077810+0000","last_peered":"2024-04-26T12:31:00.077810+0000","last_clean":"2024-04-26T12:31:00.077810+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:31:00.077810+0000","last_undegraded":"2024-04-26T12:31:00.077810+0000","last_fullsized":"2024-04-26T12:31:00.077810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077074+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:30:59.077074+0000","last_peered":"2024-04-26T12:30:59.077074+0000","last_clean":"2024-04-26T12:30:59.077074+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:30:59.077074+0000","last_undegraded":"2024-04-26T12:30:59.077074+0000","last_fullsized":"2024-04-26T12:30:59.077074+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:51.609322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076973+0000","last_change":"2024-04-26T12:30:41.030157+0000","last_active":"2024-04-26T12:30:59.076973+0000","last_peered":"2024-04-26T12:30:59.076973+0000","last_clean":"2024-04-26T12:30:59.076973+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:59.076973+0000","last_undegraded":"2024-04-26T12:30:59.076973+0000","last_fullsized":"2024-04-26T12:30:59.076973+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:32.867679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":500,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.081711+0000","last_change":"2024-04-26T12:31:00.081711+0000","last_active":"2024-04-26T12:31:00.081711+0000","last_peered":"2024-04-26T12:31:00.081711+0000","last_clean":"2024-04-26T12:31:00.081711+0000","last_became_active":"2024-04-26T12:31:00.079504+0000","last_became_peered":"2024-04-26T12:31:00.079504+0000","last_unstale":"2024-04-26T12:31:00.081711+0000","last_undegraded":"2024-04-26T12:31:00.081711+0000","last_fullsized":"2024-04-26T12:31:00.081711+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:17.125482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078428+0000","last_change":"2024-04-26T12:30:46.080509+0000","last_active":"2024-04-26T12:30:59.078428+0000","last_peered":"2024-04-26T12:30:59.078428+0000","last_clean":"2024-04-26T12:30:59.078428+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:30:59.078428+0000","last_undegraded":"2024-04-26T12:30:59.078428+0000","last_fullsized":"2024-04-26T12:30:59.078428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:40.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'82","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077350+0000","last_change":"2024-04-26T12:30:46.086027+0000","last_active":"2024-04-26T12:30:59.077350+0000","last_peered":"2024-04-26T12:30:59.077350+0000","last_clean":"2024-04-26T12:30:59.077350+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:30:59.077350+0000","last_undegraded":"2024-04-26T12:30:59.077350+0000","last_fullsized":"2024-04-26T12:30:59.077350+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:13.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":606,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077942+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:31:00.077942+0000","last_peered":"2024-04-26T12:31:00.077942+0000","last_clean":"2024-04-26T12:31:00.077942+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:31:00.077942+0000","last_undegraded":"2024-04-26T12:31:00.077942+0000","last_fullsized":"2024-04-26T12:31:00.077942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077612+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:30:59.077612+0000","last_peered":"2024-04-26T12:30:59.077612+0000","last_clean":"2024-04-26T12:30:59.077612+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:30:59.077612+0000","last_undegraded":"2024-04-26T12:30:59.077612+0000","last_fullsized":"2024-04-26T12:30:59.077612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.312112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":855,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078064+0000","last_change":"2024-04-26T12:30:53.079043+0000","last_active":"2024-04-26T12:30:59.078064+0000","last_peered":"2024-04-26T12:30:59.078064+0000","last_clean":"2024-04-26T12:30:59.078064+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:30:59.078064+0000","last_undegraded":"2024-04-26T12:30:59.078064+0000","last_fullsized":"2024-04-26T12:30:59.078064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:00.091756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":311,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078038+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:30:59.078038+0000","last_peered":"2024-04-26T12:30:59.078038+0000","last_clean":"2024-04-26T12:30:59.078038+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:30:59.078038+0000","last_undegraded":"2024-04-26T12:30:59.078038+0000","last_fullsized":"2024-04-26T12:30:59.078038+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:43.044883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":798,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077365+0000","last_change":"2024-04-26T12:30:48.088039+0000","last_active":"2024-04-26T12:30:59.077365+0000","last_peered":"2024-04-26T12:30:59.077365+0000","last_clean":"2024-04-26T12:30:59.077365+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:30:59.077365+0000","last_undegraded":"2024-04-26T12:30:59.077365+0000","last_fullsized":"2024-04-26T12:30:59.077365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:03.967118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"58'314","reported_seq":395,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077986+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:30:59.077986+0000","last_peered":"2024-04-26T12:30:59.077986+0000","last_clean":"2024-04-26T12:30:59.077986+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:30:59.077986+0000","last_undegraded":"2024-04-26T12:30:59.077986+0000","last_fullsized":"2024-04-26T12:30:59.077986+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":872,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077302+0000","last_change":"2024-04-26T12:30:52.079092+0000","last_active":"2024-04-26T12:30:59.077302+0000","last_peered":"2024-04-26T12:30:59.077302+0000","last_clean":"2024-04-26T12:30:59.077302+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:30:59.077302+0000","last_undegraded":"2024-04-26T12:30:59.077302+0000","last_fullsized":"2024-04-26T12:30:59.077302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:10.253347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"58'76","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077223+0000","last_change":"2024-04-26T12:30:41.050653+0000","last_active":"2024-04-26T12:30:59.077223+0000","last_peered":"2024-04-26T12:30:59.077223+0000","last_clean":"2024-04-26T12:30:59.077223+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:59.077223+0000","last_undegraded":"2024-04-26T12:30:59.077223+0000","last_fullsized":"2024-04-26T12:30:59.077223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:17.874875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":542,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076883+0000","last_change":"2024-04-26T12:28:00.707724+0000","last_active":"2024-04-26T12:30:59.076883+0000","last_peered":"2024-04-26T12:30:59.076883+0000","last_clean":"2024-04-26T12:30:59.076883+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:30:59.076883+0000","last_undegraded":"2024-04-26T12:30:59.076883+0000","last_fullsized":"2024-04-26T12:30:59.076883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:20.384961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077310+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:30:59.077310+0000","last_peered":"2024-04-26T12:30:59.077310+0000","last_clean":"2024-04-26T12:30:59.077310+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:30:59.077310+0000","last_undegraded":"2024-04-26T12:30:59.077310+0000","last_fullsized":"2024-04-26T12:30:59.077310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:40.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077689+0000","last_change":"2024-04-26T12:30:51.076207+0000","last_active":"2024-04-26T12:30:59.077689+0000","last_peered":"2024-04-26T12:30:59.077689+0000","last_clean":"2024-04-26T12:30:59.077689+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:30:59.077689+0000","last_undegraded":"2024-04-26T12:30:59.077689+0000","last_fullsized":"2024-04-26T12:30:59.077689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:05.869282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":863,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077482+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:30:59.077482+0000","last_peered":"2024-04-26T12:30:59.077482+0000","last_clean":"2024-04-26T12:30:59.077482+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:30:59.077482+0000","last_undegraded":"2024-04-26T12:30:59.077482+0000","last_fullsized":"2024-04-26T12:30:59.077482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:50.433671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076889+0000","last_change":"2024-04-26T12:30:54.080153+0000","last_active":"2024-04-26T12:30:59.076889+0000","last_peered":"2024-04-26T12:30:59.076889+0000","last_clean":"2024-04-26T12:30:59.076889+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:30:59.076889+0000","last_undegraded":"2024-04-26T12:30:59.076889+0000","last_fullsized":"2024-04-26T12:30:59.076889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:48.057283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":629,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078217+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:31:00.078217+0000","last_peered":"2024-04-26T12:31:00.078217+0000","last_clean":"2024-04-26T12:31:00.078217+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:31:00.078217+0000","last_undegraded":"2024-04-26T12:31:00.078217+0000","last_fullsized":"2024-04-26T12:31:00.078217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":515,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076733+0000","last_change":"2024-04-26T12:30:50.086765+0000","last_active":"2024-04-26T12:30:59.076733+0000","last_peered":"2024-04-26T12:30:59.076733+0000","last_clean":"2024-04-26T12:30:59.076733+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:30:59.076733+0000","last_undegraded":"2024-04-26T12:30:59.076733+0000","last_fullsized":"2024-04-26T12:30:59.076733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:36.313767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078165+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:30:59.078165+0000","last_peered":"2024-04-26T12:30:59.078165+0000","last_clean":"2024-04-26T12:30:59.078165+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:30:59.078165+0000","last_undegraded":"2024-04-26T12:30:59.078165+0000","last_fullsized":"2024-04-26T12:30:59.078165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79134720,"data_stored":256449018,"data_compressed":38844374,"data_compressed_allocated":48693248,"data_compressed_original":226074624,"omap_allocated":5343,"internal_metadata":0},"log_size":7508,"ondisk_log_size":7508,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738424,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130116,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94241724,"statfs":{"total":96636764160,"available":96503525376,"internally_reserved":0,"allocated":31711232,"data_stored":85785287,"data_compressed":12062822,"data_compressed_allocated":15765504,"data_compressed_original":70336512,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.23599999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.54500000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131340,"kb_used_data":32188,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94240500,"statfs":{"total":96636764160,"available":96502272000,"internally_reserved":0,"allocated":32960512,"data_stored":91451171,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:30:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.30399999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.625,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.53300000000000003}]}]},{"osd":1,"up_from":64,"seq":274877906951,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62340,"kb_used_data":16760,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309500,"statfs":{"total":96636764160,"available":96572928000,"internally_reserved":0,"allocated":17162240,"data_stored":81548386,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30789632,"data_stored":84809889,"data_compressed":12028675,"data_compressed_allocated":15720448,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:08.669 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:31:08.670 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-26T12:31:09.065 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T12:31:09.075 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:31:09.075 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:09.423 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:31:09.424 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:31:09.434 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-04-26T12:31:09.360759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6546,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34345,"ondisk_log_size":34345,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":323796,"kb_used_data":79916,"kb_used_omap":9,"kb_used_meta":243830,"kb_avail":282791724,"statfs":{"total":289910292480,"available":289578725376,"internally_reserved":0,"allocated":81833984,"data_stored":258784844,"data_compressed":38912668,"data_compressed_allocated":48783360,"data_compressed_original":227221504,"omap_allocated":10125,"internal_metadata":249682035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-196,"num_objects_misplaced":-363,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002189"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":901,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078865+0000","last_change":"2024-04-26T12:30:54.081113+0000","last_active":"2024-04-26T12:31:00.078865+0000","last_peered":"2024-04-26T12:31:00.078865+0000","last_clean":"2024-04-26T12:31:00.078865+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:31:00.078865+0000","last_undegraded":"2024-04-26T12:31:00.078865+0000","last_fullsized":"2024-04-26T12:31:00.078865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.062347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":957,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078333+0000","last_change":"2024-04-26T12:30:56.085870+0000","last_active":"2024-04-26T12:31:00.078333+0000","last_peered":"2024-04-26T12:31:00.078333+0000","last_clean":"2024-04-26T12:31:00.078333+0000","last_became_active":"2024-04-26T12:30:56.084642+0000","last_became_peered":"2024-04-26T12:30:56.084642+0000","last_unstale":"2024-04-26T12:31:00.078333+0000","last_undegraded":"2024-04-26T12:31:00.078333+0000","last_fullsized":"2024-04-26T12:31:00.078333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:41.346086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":495,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078491+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:30:59.078491+0000","last_peered":"2024-04-26T12:30:59.078491+0000","last_clean":"2024-04-26T12:30:59.078491+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:30:59.078491+0000","last_undegraded":"2024-04-26T12:30:59.078491+0000","last_fullsized":"2024-04-26T12:30:59.078491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:55.616144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":867,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078158+0000","last_change":"2024-04-26T12:30:48.089842+0000","last_active":"2024-04-26T12:30:59.078158+0000","last_peered":"2024-04-26T12:30:59.078158+0000","last_clean":"2024-04-26T12:30:59.078158+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:30:59.078158+0000","last_undegraded":"2024-04-26T12:30:59.078158+0000","last_fullsized":"2024-04-26T12:30:59.078158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:13.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":939,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077433+0000","last_change":"2024-04-26T12:30:48.089460+0000","last_active":"2024-04-26T12:30:59.077433+0000","last_peered":"2024-04-26T12:30:59.077433+0000","last_clean":"2024-04-26T12:30:59.077433+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:30:59.077433+0000","last_undegraded":"2024-04-26T12:30:59.077433+0000","last_fullsized":"2024-04-26T12:30:59.077433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077152+0000","last_change":"2024-04-26T12:30:48.090606+0000","last_active":"2024-04-26T12:30:59.077152+0000","last_peered":"2024-04-26T12:30:59.077152+0000","last_clean":"2024-04-26T12:30:59.077152+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:30:59.077152+0000","last_undegraded":"2024-04-26T12:30:59.077152+0000","last_fullsized":"2024-04-26T12:30:59.077152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:57.446858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1028,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077423+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:30:59.077423+0000","last_peered":"2024-04-26T12:30:59.077423+0000","last_clean":"2024-04-26T12:30:59.077423+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:30:59.077423+0000","last_undegraded":"2024-04-26T12:30:59.077423+0000","last_fullsized":"2024-04-26T12:30:59.077423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:06.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":767,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076901+0000","last_change":"2024-04-26T12:30:49.082511+0000","last_active":"2024-04-26T12:30:59.076901+0000","last_peered":"2024-04-26T12:30:59.076901+0000","last_clean":"2024-04-26T12:30:59.076901+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:30:59.076901+0000","last_undegraded":"2024-04-26T12:30:59.076901+0000","last_fullsized":"2024-04-26T12:30:59.076901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:54.832086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077579+0000","last_change":"2024-04-26T12:30:56.079114+0000","last_active":"2024-04-26T12:30:59.077579+0000","last_peered":"2024-04-26T12:30:59.077579+0000","last_clean":"2024-04-26T12:30:59.077579+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:30:59.077579+0000","last_undegraded":"2024-04-26T12:30:59.077579+0000","last_fullsized":"2024-04-26T12:30:59.077579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:37.907357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":911,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078367+0000","last_change":"2024-04-26T12:30:56.087672+0000","last_active":"2024-04-26T12:30:59.078367+0000","last_peered":"2024-04-26T12:30:59.078367+0000","last_clean":"2024-04-26T12:30:59.078367+0000","last_became_active":"2024-04-26T12:30:56.085904+0000","last_became_peered":"2024-04-26T12:30:56.085904+0000","last_unstale":"2024-04-26T12:30:59.078367+0000","last_undegraded":"2024-04-26T12:30:59.078367+0000","last_fullsized":"2024-04-26T12:30:59.078367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:53.993298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":594,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078178+0000","last_change":"2024-04-26T12:30:50.085026+0000","last_active":"2024-04-26T12:30:59.078178+0000","last_peered":"2024-04-26T12:30:59.078178+0000","last_clean":"2024-04-26T12:30:59.078178+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:30:59.078178+0000","last_undegraded":"2024-04-26T12:30:59.078178+0000","last_fullsized":"2024-04-26T12:30:59.078178+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:31.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077591+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:30:59.077591+0000","last_peered":"2024-04-26T12:30:59.077591+0000","last_clean":"2024-04-26T12:30:59.077591+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:30:59.077591+0000","last_undegraded":"2024-04-26T12:30:59.077591+0000","last_fullsized":"2024-04-26T12:30:59.077591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":883,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077635+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:30:59.077635+0000","last_peered":"2024-04-26T12:30:59.077635+0000","last_clean":"2024-04-26T12:30:59.077635+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:30:59.077635+0000","last_undegraded":"2024-04-26T12:30:59.077635+0000","last_fullsized":"2024-04-26T12:30:59.077635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:00.467106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":520,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077571+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:30:59.077571+0000","last_peered":"2024-04-26T12:30:59.077571+0000","last_clean":"2024-04-26T12:30:59.077571+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:30:59.077571+0000","last_undegraded":"2024-04-26T12:30:59.077571+0000","last_fullsized":"2024-04-26T12:30:59.077571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":540,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077003+0000","last_change":"2024-04-26T12:30:47.080645+0000","last_active":"2024-04-26T12:30:59.077003+0000","last_peered":"2024-04-26T12:30:59.077003+0000","last_clean":"2024-04-26T12:30:59.077003+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:30:59.077003+0000","last_undegraded":"2024-04-26T12:30:59.077003+0000","last_fullsized":"2024-04-26T12:30:59.077003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:11.047331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":926,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077140+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:30:59.077140+0000","last_peered":"2024-04-26T12:30:59.077140+0000","last_clean":"2024-04-26T12:30:59.077140+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:30:59.077140+0000","last_undegraded":"2024-04-26T12:30:59.077140+0000","last_fullsized":"2024-04-26T12:30:59.077140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:18.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":493,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077499+0000","last_change":"2024-04-26T12:30:55.090347+0000","last_active":"2024-04-26T12:30:59.077499+0000","last_peered":"2024-04-26T12:30:59.077499+0000","last_clean":"2024-04-26T12:30:59.077499+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:30:59.077499+0000","last_undegraded":"2024-04-26T12:30:59.077499+0000","last_fullsized":"2024-04-26T12:30:59.077499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:18.689900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":912,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078455+0000","last_change":"2024-04-26T12:30:57.084445+0000","last_active":"2024-04-26T12:30:59.078455+0000","last_peered":"2024-04-26T12:30:59.078455+0000","last_clean":"2024-04-26T12:30:59.078455+0000","last_became_active":"2024-04-26T12:30:57.083026+0000","last_became_peered":"2024-04-26T12:30:57.083026+0000","last_unstale":"2024-04-26T12:30:59.078455+0000","last_undegraded":"2024-04-26T12:30:59.078455+0000","last_fullsized":"2024-04-26T12:30:59.078455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:26.231571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076908+0000","last_change":"2024-04-26T12:30:51.076894+0000","last_active":"2024-04-26T12:30:59.076908+0000","last_peered":"2024-04-26T12:30:59.076908+0000","last_clean":"2024-04-26T12:30:59.076908+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:30:59.076908+0000","last_undegraded":"2024-04-26T12:30:59.076908+0000","last_fullsized":"2024-04-26T12:30:59.076908+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:50.091007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1070,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078148+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:30:59.078148+0000","last_peered":"2024-04-26T12:30:59.078148+0000","last_clean":"2024-04-26T12:30:59.078148+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:30:59.078148+0000","last_undegraded":"2024-04-26T12:30:59.078148+0000","last_fullsized":"2024-04-26T12:30:59.078148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:26.268194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":952,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077199+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:30:59.077199+0000","last_peered":"2024-04-26T12:30:59.077199+0000","last_clean":"2024-04-26T12:30:59.077199+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:30:59.077199+0000","last_undegraded":"2024-04-26T12:30:59.077199+0000","last_fullsized":"2024-04-26T12:30:59.077199+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:12.535434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":580,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077653+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:30:59.077653+0000","last_peered":"2024-04-26T12:30:59.077653+0000","last_clean":"2024-04-26T12:30:59.077653+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:30:59.077653+0000","last_undegraded":"2024-04-26T12:30:59.077653+0000","last_fullsized":"2024-04-26T12:30:59.077653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.082038+0000","last_change":"2024-04-26T12:31:00.082038+0000","last_active":"2024-04-26T12:31:00.082038+0000","last_peered":"2024-04-26T12:31:00.082038+0000","last_clean":"2024-04-26T12:31:00.082038+0000","last_became_active":"2024-04-26T12:31:00.079766+0000","last_became_peered":"2024-04-26T12:31:00.079766+0000","last_unstale":"2024-04-26T12:31:00.082038+0000","last_undegraded":"2024-04-26T12:31:00.082038+0000","last_fullsized":"2024-04-26T12:31:00.082038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:29.495060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":1017,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078556+0000","last_change":"2024-04-26T12:30:58.079466+0000","last_active":"2024-04-26T12:30:59.078556+0000","last_peered":"2024-04-26T12:30:59.078556+0000","last_clean":"2024-04-26T12:30:59.078556+0000","last_became_active":"2024-04-26T12:30:58.078211+0000","last_became_peered":"2024-04-26T12:30:58.078211+0000","last_unstale":"2024-04-26T12:30:59.078556+0000","last_undegraded":"2024-04-26T12:30:59.078556+0000","last_fullsized":"2024-04-26T12:30:59.078556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:42.746789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078438+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:30:59.078438+0000","last_peered":"2024-04-26T12:30:59.078438+0000","last_clean":"2024-04-26T12:30:59.078438+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:30:59.078438+0000","last_undegraded":"2024-04-26T12:30:59.078438+0000","last_fullsized":"2024-04-26T12:30:59.078438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":585,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077533+0000","last_change":"2024-04-26T12:30:46.089997+0000","last_active":"2024-04-26T12:30:59.077533+0000","last_peered":"2024-04-26T12:30:59.077533+0000","last_clean":"2024-04-26T12:30:59.077533+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:30:59.077533+0000","last_undegraded":"2024-04-26T12:30:59.077533+0000","last_fullsized":"2024-04-26T12:30:59.077533+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:08.843126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078301+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:30:59.078301+0000","last_peered":"2024-04-26T12:30:59.078301+0000","last_clean":"2024-04-26T12:30:59.078301+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:30:59.078301+0000","last_undegraded":"2024-04-26T12:30:59.078301+0000","last_fullsized":"2024-04-26T12:30:59.078301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077517+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:30:59.077517+0000","last_peered":"2024-04-26T12:30:59.077517+0000","last_clean":"2024-04-26T12:30:59.077517+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:30:59.077517+0000","last_undegraded":"2024-04-26T12:30:59.077517+0000","last_fullsized":"2024-04-26T12:30:59.077517+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:21.302173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078191+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:30:59.078191+0000","last_peered":"2024-04-26T12:30:59.078191+0000","last_clean":"2024-04-26T12:30:59.078191+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:30:59.078191+0000","last_undegraded":"2024-04-26T12:30:59.078191+0000","last_fullsized":"2024-04-26T12:30:59.078191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":410,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076264+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:30:59.076264+0000","last_peered":"2024-04-26T12:30:59.076264+0000","last_clean":"2024-04-26T12:30:59.076264+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:30:59.076264+0000","last_undegraded":"2024-04-26T12:30:59.076264+0000","last_fullsized":"2024-04-26T12:30:59.076264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.762427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077325+0000","last_change":"2024-04-26T12:30:58.081169+0000","last_active":"2024-04-26T12:30:59.077325+0000","last_peered":"2024-04-26T12:30:59.077325+0000","last_clean":"2024-04-26T12:30:59.077325+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:30:59.077325+0000","last_undegraded":"2024-04-26T12:30:59.077325+0000","last_fullsized":"2024-04-26T12:30:59.077325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:42.618440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"58'708","reported_seq":778,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076197+0000","last_change":"2024-04-26T12:30:44.022038+0000","last_active":"2024-04-26T12:30:59.076197+0000","last_peered":"2024-04-26T12:30:59.076197+0000","last_clean":"2024-04-26T12:30:59.076197+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:30:59.076197+0000","last_undegraded":"2024-04-26T12:30:59.076197+0000","last_fullsized":"2024-04-26T12:30:59.076197+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:30.369118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":500,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078749+0000","last_change":"2024-04-26T12:30:47.081417+0000","last_active":"2024-04-26T12:31:00.078749+0000","last_peered":"2024-04-26T12:31:00.078749+0000","last_clean":"2024-04-26T12:31:00.078749+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:31:00.078749+0000","last_undegraded":"2024-04-26T12:31:00.078749+0000","last_fullsized":"2024-04-26T12:31:00.078749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:17.628933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077196+0000","last_change":"2024-04-26T12:30:41.018067+0000","last_active":"2024-04-26T12:30:59.077196+0000","last_peered":"2024-04-26T12:30:59.077196+0000","last_clean":"2024-04-26T12:30:59.077196+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:30:59.077196+0000","last_undegraded":"2024-04-26T12:30:59.077196+0000","last_fullsized":"2024-04-26T12:30:59.077196+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:33.684743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":594,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076422+0000","last_change":"2024-04-26T12:30:58.081823+0000","last_active":"2024-04-26T12:30:59.076422+0000","last_peered":"2024-04-26T12:30:59.076422+0000","last_clean":"2024-04-26T12:30:59.076422+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:30:59.076422+0000","last_undegraded":"2024-04-26T12:30:59.076422+0000","last_fullsized":"2024-04-26T12:30:59.076422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.109302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"58'355","reported_seq":377,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078258+0000","last_change":"2024-04-26T12:30:48.086933+0000","last_active":"2024-04-26T12:30:59.078258+0000","last_peered":"2024-04-26T12:30:59.078258+0000","last_clean":"2024-04-26T12:30:59.078258+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:30:59.078258+0000","last_undegraded":"2024-04-26T12:30:59.078258+0000","last_fullsized":"2024-04-26T12:30:59.078258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:49.737283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":720,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076317+0000","last_change":"2024-04-26T12:30:46.034642+0000","last_active":"2024-04-26T12:30:59.076317+0000","last_peered":"2024-04-26T12:30:59.076317+0000","last_clean":"2024-04-26T12:30:59.076317+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:30:59.076317+0000","last_undegraded":"2024-04-26T12:30:59.076317+0000","last_fullsized":"2024-04-26T12:30:59.076317+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.961343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077954+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:30:59.077954+0000","last_peered":"2024-04-26T12:30:59.077954+0000","last_clean":"2024-04-26T12:30:59.077954+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:30:59.077954+0000","last_undegraded":"2024-04-26T12:30:59.077954+0000","last_fullsized":"2024-04-26T12:30:59.077954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076500+0000","last_change":"2024-04-26T12:30:45.022716+0000","last_active":"2024-04-26T12:30:59.076500+0000","last_peered":"2024-04-26T12:30:59.076500+0000","last_clean":"2024-04-26T12:30:59.076500+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:30:59.076500+0000","last_undegraded":"2024-04-26T12:30:59.076500+0000","last_fullsized":"2024-04-26T12:30:59.076500+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:01.269901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'374","reported_seq":439,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078040+0000","last_change":"2024-04-26T12:30:46.079618+0000","last_active":"2024-04-26T12:30:59.078040+0000","last_peered":"2024-04-26T12:30:59.078040+0000","last_clean":"2024-04-26T12:30:59.078040+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:30:59.078040+0000","last_undegraded":"2024-04-26T12:30:59.078040+0000","last_fullsized":"2024-04-26T12:30:59.078040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:48.209628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":506,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077751+0000","last_change":"2024-04-26T12:30:47.082596+0000","last_active":"2024-04-26T12:30:59.077751+0000","last_peered":"2024-04-26T12:30:59.077751+0000","last_clean":"2024-04-26T12:30:59.077751+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:30:59.077751+0000","last_undegraded":"2024-04-26T12:30:59.077751+0000","last_fullsized":"2024-04-26T12:30:59.077751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:34.688913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":648,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077638+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:30:59.077638+0000","last_peered":"2024-04-26T12:30:59.077638+0000","last_clean":"2024-04-26T12:30:59.077638+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:30:59.077638+0000","last_undegraded":"2024-04-26T12:30:59.077638+0000","last_fullsized":"2024-04-26T12:30:59.077638+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:50.674218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":794,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078066+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:30:59.078066+0000","last_peered":"2024-04-26T12:30:59.078066+0000","last_clean":"2024-04-26T12:30:59.078066+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:30:59.078066+0000","last_undegraded":"2024-04-26T12:30:59.078066+0000","last_fullsized":"2024-04-26T12:30:59.078066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:11.548975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076400+0000","last_change":"2024-04-26T12:30:46.089052+0000","last_active":"2024-04-26T12:30:59.076400+0000","last_peered":"2024-04-26T12:30:59.076400+0000","last_clean":"2024-04-26T12:30:59.076400+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:30:59.076400+0000","last_undegraded":"2024-04-26T12:30:59.076400+0000","last_fullsized":"2024-04-26T12:30:59.076400+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:28.433853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":860,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078103+0000","last_change":"2024-04-26T12:30:50.086492+0000","last_active":"2024-04-26T12:30:59.078103+0000","last_peered":"2024-04-26T12:30:59.078103+0000","last_clean":"2024-04-26T12:30:59.078103+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:30:59.078103+0000","last_undegraded":"2024-04-26T12:30:59.078103+0000","last_fullsized":"2024-04-26T12:30:59.078103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:18.705037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077626+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:30:59.077626+0000","last_peered":"2024-04-26T12:30:59.077626+0000","last_clean":"2024-04-26T12:30:59.077626+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:30:59.077626+0000","last_undegraded":"2024-04-26T12:30:59.077626+0000","last_fullsized":"2024-04-26T12:30:59.077626+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":500,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.086763+0000","last_change":"2024-04-26T12:30:59.083411+0000","last_active":"2024-04-26T12:30:59.086763+0000","last_peered":"2024-04-26T12:30:59.086763+0000","last_clean":"2024-04-26T12:30:59.086763+0000","last_became_active":"2024-04-26T12:30:59.081424+0000","last_became_peered":"2024-04-26T12:30:59.081424+0000","last_unstale":"2024-04-26T12:30:59.086763+0000","last_undegraded":"2024-04-26T12:30:59.086763+0000","last_fullsized":"2024-04-26T12:30:59.086763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:09.181871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'54","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077588+0000","last_change":"2024-04-26T12:30:46.082166+0000","last_active":"2024-04-26T12:30:59.077588+0000","last_peered":"2024-04-26T12:30:59.077588+0000","last_clean":"2024-04-26T12:30:59.077588+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:30:59.077588+0000","last_undegraded":"2024-04-26T12:30:59.077588+0000","last_fullsized":"2024-04-26T12:30:59.077588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:28.037535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":538,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.089343+0000","last_change":"2024-04-26T12:30:59.084548+0000","last_active":"2024-04-26T12:30:59.089343+0000","last_peered":"2024-04-26T12:30:59.089343+0000","last_clean":"2024-04-26T12:30:59.089343+0000","last_became_active":"2024-04-26T12:30:59.081463+0000","last_became_peered":"2024-04-26T12:30:59.081463+0000","last_unstale":"2024-04-26T12:30:59.089343+0000","last_undegraded":"2024-04-26T12:30:59.089343+0000","last_fullsized":"2024-04-26T12:30:59.089343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:51.815050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'186","reported_seq":209,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078288+0000","last_change":"2024-04-26T12:30:46.080074+0000","last_active":"2024-04-26T12:30:59.078288+0000","last_peered":"2024-04-26T12:30:59.078288+0000","last_clean":"2024-04-26T12:30:59.078288+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:30:59.078288+0000","last_undegraded":"2024-04-26T12:30:59.078288+0000","last_fullsized":"2024-04-26T12:30:59.078288+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:24.562647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":531,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077193+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:30:59.077193+0000","last_peered":"2024-04-26T12:30:59.077193+0000","last_clean":"2024-04-26T12:30:59.077193+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:30:59.077193+0000","last_undegraded":"2024-04-26T12:30:59.077193+0000","last_fullsized":"2024-04-26T12:30:59.077193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078244+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:30:59.078244+0000","last_peered":"2024-04-26T12:30:59.078244+0000","last_clean":"2024-04-26T12:30:59.078244+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:30:59.078244+0000","last_undegraded":"2024-04-26T12:30:59.078244+0000","last_fullsized":"2024-04-26T12:30:59.078244+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:40.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":976,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077821+0000","last_change":"2024-04-26T12:30:52.078990+0000","last_active":"2024-04-26T12:30:59.077821+0000","last_peered":"2024-04-26T12:30:59.077821+0000","last_clean":"2024-04-26T12:30:59.077821+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:30:59.077821+0000","last_undegraded":"2024-04-26T12:30:59.077821+0000","last_fullsized":"2024-04-26T12:30:59.077821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.697122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":514,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078332+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:30:59.078332+0000","last_peered":"2024-04-26T12:30:59.078332+0000","last_clean":"2024-04-26T12:30:59.078332+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:30:59.078332+0000","last_undegraded":"2024-04-26T12:30:59.078332+0000","last_fullsized":"2024-04-26T12:30:59.078332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:18.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077374+0000","last_change":"2024-04-26T12:30:48.089200+0000","last_active":"2024-04-26T12:30:59.077374+0000","last_peered":"2024-04-26T12:30:59.077374+0000","last_clean":"2024-04-26T12:30:59.077374+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:30:59.077374+0000","last_undegraded":"2024-04-26T12:30:59.077374+0000","last_fullsized":"2024-04-26T12:30:59.077374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:04.588329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077619+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:59.077619+0000","last_peered":"2024-04-26T12:30:59.077619+0000","last_clean":"2024-04-26T12:30:59.077619+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:30:59.077619+0000","last_undegraded":"2024-04-26T12:30:59.077619+0000","last_fullsized":"2024-04-26T12:30:59.077619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:40.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":559,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076624+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:30:59.076624+0000","last_peered":"2024-04-26T12:30:59.076624+0000","last_clean":"2024-04-26T12:30:59.076624+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:30:59.076624+0000","last_undegraded":"2024-04-26T12:30:59.076624+0000","last_fullsized":"2024-04-26T12:30:59.076624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.230823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":252,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076455+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:30:59.076455+0000","last_peered":"2024-04-26T12:30:59.076455+0000","last_clean":"2024-04-26T12:30:59.076455+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:30:59.076455+0000","last_undegraded":"2024-04-26T12:30:59.076455+0000","last_fullsized":"2024-04-26T12:30:59.076455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:30.864621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":537,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077889+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:30:59.077889+0000","last_peered":"2024-04-26T12:30:59.077889+0000","last_clean":"2024-04-26T12:30:59.077889+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:30:59.077889+0000","last_undegraded":"2024-04-26T12:30:59.077889+0000","last_fullsized":"2024-04-26T12:30:59.077889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:13.427584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":268,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077250+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:30:59.077250+0000","last_peered":"2024-04-26T12:30:59.077250+0000","last_clean":"2024-04-26T12:30:59.077250+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:30:59.077250+0000","last_undegraded":"2024-04-26T12:30:59.077250+0000","last_fullsized":"2024-04-26T12:30:59.077250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:16.260550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078751+0000","last_change":"2024-04-26T12:30:47.083054+0000","last_active":"2024-04-26T12:30:59.078751+0000","last_peered":"2024-04-26T12:30:59.078751+0000","last_clean":"2024-04-26T12:30:59.078751+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:30:59.078751+0000","last_undegraded":"2024-04-26T12:30:59.078751+0000","last_fullsized":"2024-04-26T12:30:59.078751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.645638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":162,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077348+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:30:59.077348+0000","last_peered":"2024-04-26T12:30:59.077348+0000","last_clean":"2024-04-26T12:30:59.077348+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:30:59.077348+0000","last_undegraded":"2024-04-26T12:30:59.077348+0000","last_fullsized":"2024-04-26T12:30:59.077348+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:20.988072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":492,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078566+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:30:59.078566+0000","last_peered":"2024-04-26T12:30:59.078566+0000","last_clean":"2024-04-26T12:30:59.078566+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:30:59.078566+0000","last_undegraded":"2024-04-26T12:30:59.078566+0000","last_fullsized":"2024-04-26T12:30:59.078566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":588,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078399+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:30:59.078399+0000","last_peered":"2024-04-26T12:30:59.078399+0000","last_clean":"2024-04-26T12:30:59.078399+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:30:59.078399+0000","last_undegraded":"2024-04-26T12:30:59.078399+0000","last_fullsized":"2024-04-26T12:30:59.078399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:25.266771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077354+0000","last_change":"2024-04-26T12:30:55.090354+0000","last_active":"2024-04-26T12:30:59.077354+0000","last_peered":"2024-04-26T12:30:59.077354+0000","last_clean":"2024-04-26T12:30:59.077354+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:30:59.077354+0000","last_undegraded":"2024-04-26T12:30:59.077354+0000","last_fullsized":"2024-04-26T12:30:59.077354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:14.455369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076944+0000","last_change":"2024-04-26T12:30:41.026049+0000","last_active":"2024-04-26T12:30:59.076944+0000","last_peered":"2024-04-26T12:30:59.076944+0000","last_clean":"2024-04-26T12:30:59.076944+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:30:59.076944+0000","last_undegraded":"2024-04-26T12:30:59.076944+0000","last_fullsized":"2024-04-26T12:30:59.076944+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.409817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"58'454","reported_seq":480,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078638+0000","last_change":"2024-04-26T12:30:46.079367+0000","last_active":"2024-04-26T12:30:59.078638+0000","last_peered":"2024-04-26T12:30:59.078638+0000","last_clean":"2024-04-26T12:30:59.078638+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:30:59.078638+0000","last_undegraded":"2024-04-26T12:30:59.078638+0000","last_fullsized":"2024-04-26T12:30:59.078638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:00.950370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":473,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078369+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:31:00.078369+0000","last_peered":"2024-04-26T12:31:00.078369+0000","last_clean":"2024-04-26T12:31:00.078369+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:31:00.078369+0000","last_undegraded":"2024-04-26T12:31:00.078369+0000","last_fullsized":"2024-04-26T12:31:00.078369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078680+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:31:00.078680+0000","last_peered":"2024-04-26T12:31:00.078680+0000","last_clean":"2024-04-26T12:31:00.078680+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:31:00.078680+0000","last_undegraded":"2024-04-26T12:31:00.078680+0000","last_fullsized":"2024-04-26T12:31:00.078680+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:16.686041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078300+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:00.078300+0000","last_peered":"2024-04-26T12:31:00.078300+0000","last_clean":"2024-04-26T12:31:00.078300+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:31:00.078300+0000","last_undegraded":"2024-04-26T12:31:00.078300+0000","last_fullsized":"2024-04-26T12:31:00.078300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:18.069937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076887+0000","last_change":"2024-04-26T12:30:46.033999+0000","last_active":"2024-04-26T12:30:59.076887+0000","last_peered":"2024-04-26T12:30:59.076887+0000","last_clean":"2024-04-26T12:30:59.076887+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:30:59.076887+0000","last_undegraded":"2024-04-26T12:30:59.076887+0000","last_fullsized":"2024-04-26T12:30:59.076887+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:33.235467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076629+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:30:59.076629+0000","last_peered":"2024-04-26T12:30:59.076629+0000","last_clean":"2024-04-26T12:30:59.076629+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:30:59.076629+0000","last_undegraded":"2024-04-26T12:30:59.076629+0000","last_fullsized":"2024-04-26T12:30:59.076629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:20.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":398,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077980+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:30:59.077980+0000","last_peered":"2024-04-26T12:30:59.077980+0000","last_clean":"2024-04-26T12:30:59.077980+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:30:59.077980+0000","last_undegraded":"2024-04-26T12:30:59.077980+0000","last_fullsized":"2024-04-26T12:30:59.077980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":432,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077237+0000","last_change":"2024-04-26T12:30:54.081099+0000","last_active":"2024-04-26T12:30:59.077237+0000","last_peered":"2024-04-26T12:30:59.077237+0000","last_clean":"2024-04-26T12:30:59.077237+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:30:59.077237+0000","last_undegraded":"2024-04-26T12:30:59.077237+0000","last_fullsized":"2024-04-26T12:30:59.077237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:29.507250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077511+0000","last_change":"2024-04-26T12:30:46.082961+0000","last_active":"2024-04-26T12:30:59.077511+0000","last_peered":"2024-04-26T12:30:59.077511+0000","last_clean":"2024-04-26T12:30:59.077511+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:30:59.077511+0000","last_undegraded":"2024-04-26T12:30:59.077511+0000","last_fullsized":"2024-04-26T12:30:59.077511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:10.764587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":263,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077256+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:30:59.077256+0000","last_peered":"2024-04-26T12:30:59.077256+0000","last_clean":"2024-04-26T12:30:59.077256+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:30:59.077256+0000","last_undegraded":"2024-04-26T12:30:59.077256+0000","last_fullsized":"2024-04-26T12:30:59.077256+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:23.542209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":598,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076589+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:30:59.076589+0000","last_peered":"2024-04-26T12:30:59.076589+0000","last_clean":"2024-04-26T12:30:59.076589+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:30:59.076589+0000","last_undegraded":"2024-04-26T12:30:59.076589+0000","last_fullsized":"2024-04-26T12:30:59.076589+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:05.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":565,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078891+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:31:00.078891+0000","last_peered":"2024-04-26T12:31:00.078891+0000","last_clean":"2024-04-26T12:31:00.078891+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:31:00.078891+0000","last_undegraded":"2024-04-26T12:31:00.078891+0000","last_fullsized":"2024-04-26T12:31:00.078891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077378+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:30:59.077378+0000","last_peered":"2024-04-26T12:30:59.077378+0000","last_clean":"2024-04-26T12:30:59.077378+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:30:59.077378+0000","last_undegraded":"2024-04-26T12:30:59.077378+0000","last_fullsized":"2024-04-26T12:30:59.077378+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'105","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077011+0000","last_change":"2024-04-26T12:30:44.028851+0000","last_active":"2024-04-26T12:30:59.077011+0000","last_peered":"2024-04-26T12:30:59.077011+0000","last_clean":"2024-04-26T12:30:59.077011+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:30:59.077011+0000","last_undegraded":"2024-04-26T12:30:59.077011+0000","last_fullsized":"2024-04-26T12:30:59.077011+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:13.939165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078426+0000","last_change":"2024-04-26T12:30:57.078892+0000","last_active":"2024-04-26T12:30:59.078426+0000","last_peered":"2024-04-26T12:30:59.078426+0000","last_clean":"2024-04-26T12:30:59.078426+0000","last_became_active":"2024-04-26T12:30:57.077779+0000","last_became_peered":"2024-04-26T12:30:57.077779+0000","last_unstale":"2024-04-26T12:30:59.078426+0000","last_undegraded":"2024-04-26T12:30:59.078426+0000","last_fullsized":"2024-04-26T12:30:59.078426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:07.812506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078778+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:31:00.078778+0000","last_peered":"2024-04-26T12:31:00.078778+0000","last_clean":"2024-04-26T12:31:00.078778+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:31:00.078778+0000","last_undegraded":"2024-04-26T12:31:00.078778+0000","last_fullsized":"2024-04-26T12:31:00.078778+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:31.181549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077119+0000","last_change":"2024-04-26T12:30:41.026137+0000","last_active":"2024-04-26T12:30:59.077119+0000","last_peered":"2024-04-26T12:30:59.077119+0000","last_clean":"2024-04-26T12:30:59.077119+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:30:59.077119+0000","last_undegraded":"2024-04-26T12:30:59.077119+0000","last_fullsized":"2024-04-26T12:30:59.077119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:08.225745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":520,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077810+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:31:00.077810+0000","last_peered":"2024-04-26T12:31:00.077810+0000","last_clean":"2024-04-26T12:31:00.077810+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:31:00.077810+0000","last_undegraded":"2024-04-26T12:31:00.077810+0000","last_fullsized":"2024-04-26T12:31:00.077810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077074+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:30:59.077074+0000","last_peered":"2024-04-26T12:30:59.077074+0000","last_clean":"2024-04-26T12:30:59.077074+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:30:59.077074+0000","last_undegraded":"2024-04-26T12:30:59.077074+0000","last_fullsized":"2024-04-26T12:30:59.077074+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:51.609322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076973+0000","last_change":"2024-04-26T12:30:41.030157+0000","last_active":"2024-04-26T12:30:59.076973+0000","last_peered":"2024-04-26T12:30:59.076973+0000","last_clean":"2024-04-26T12:30:59.076973+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:59.076973+0000","last_undegraded":"2024-04-26T12:30:59.076973+0000","last_fullsized":"2024-04-26T12:30:59.076973+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:32.867679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":500,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.081711+0000","last_change":"2024-04-26T12:31:00.081711+0000","last_active":"2024-04-26T12:31:00.081711+0000","last_peered":"2024-04-26T12:31:00.081711+0000","last_clean":"2024-04-26T12:31:00.081711+0000","last_became_active":"2024-04-26T12:31:00.079504+0000","last_became_peered":"2024-04-26T12:31:00.079504+0000","last_unstale":"2024-04-26T12:31:00.081711+0000","last_undegraded":"2024-04-26T12:31:00.081711+0000","last_fullsized":"2024-04-26T12:31:00.081711+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:17.125482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078428+0000","last_change":"2024-04-26T12:30:46.080509+0000","last_active":"2024-04-26T12:30:59.078428+0000","last_peered":"2024-04-26T12:30:59.078428+0000","last_clean":"2024-04-26T12:30:59.078428+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:30:59.078428+0000","last_undegraded":"2024-04-26T12:30:59.078428+0000","last_fullsized":"2024-04-26T12:30:59.078428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:40.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'82","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077350+0000","last_change":"2024-04-26T12:30:46.086027+0000","last_active":"2024-04-26T12:30:59.077350+0000","last_peered":"2024-04-26T12:30:59.077350+0000","last_clean":"2024-04-26T12:30:59.077350+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:30:59.077350+0000","last_undegraded":"2024-04-26T12:30:59.077350+0000","last_fullsized":"2024-04-26T12:30:59.077350+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:13.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":606,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077942+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:31:00.077942+0000","last_peered":"2024-04-26T12:31:00.077942+0000","last_clean":"2024-04-26T12:31:00.077942+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:31:00.077942+0000","last_undegraded":"2024-04-26T12:31:00.077942+0000","last_fullsized":"2024-04-26T12:31:00.077942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077612+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:30:59.077612+0000","last_peered":"2024-04-26T12:30:59.077612+0000","last_clean":"2024-04-26T12:30:59.077612+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:30:59.077612+0000","last_undegraded":"2024-04-26T12:30:59.077612+0000","last_fullsized":"2024-04-26T12:30:59.077612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.312112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":855,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078064+0000","last_change":"2024-04-26T12:30:53.079043+0000","last_active":"2024-04-26T12:30:59.078064+0000","last_peered":"2024-04-26T12:30:59.078064+0000","last_clean":"2024-04-26T12:30:59.078064+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:30:59.078064+0000","last_undegraded":"2024-04-26T12:30:59.078064+0000","last_fullsized":"2024-04-26T12:30:59.078064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:00.091756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":311,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078038+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:30:59.078038+0000","last_peered":"2024-04-26T12:30:59.078038+0000","last_clean":"2024-04-26T12:30:59.078038+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:30:59.078038+0000","last_undegraded":"2024-04-26T12:30:59.078038+0000","last_fullsized":"2024-04-26T12:30:59.078038+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:43.044883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":798,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077365+0000","last_change":"2024-04-26T12:30:48.088039+0000","last_active":"2024-04-26T12:30:59.077365+0000","last_peered":"2024-04-26T12:30:59.077365+0000","last_clean":"2024-04-26T12:30:59.077365+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:30:59.077365+0000","last_undegraded":"2024-04-26T12:30:59.077365+0000","last_fullsized":"2024-04-26T12:30:59.077365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:03.967118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"58'314","reported_seq":395,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077986+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:30:59.077986+0000","last_peered":"2024-04-26T12:30:59.077986+0000","last_clean":"2024-04-26T12:30:59.077986+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:30:59.077986+0000","last_undegraded":"2024-04-26T12:30:59.077986+0000","last_fullsized":"2024-04-26T12:30:59.077986+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":872,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077302+0000","last_change":"2024-04-26T12:30:52.079092+0000","last_active":"2024-04-26T12:30:59.077302+0000","last_peered":"2024-04-26T12:30:59.077302+0000","last_clean":"2024-04-26T12:30:59.077302+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:30:59.077302+0000","last_undegraded":"2024-04-26T12:30:59.077302+0000","last_fullsized":"2024-04-26T12:30:59.077302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:10.253347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"58'76","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077223+0000","last_change":"2024-04-26T12:30:41.050653+0000","last_active":"2024-04-26T12:30:59.077223+0000","last_peered":"2024-04-26T12:30:59.077223+0000","last_clean":"2024-04-26T12:30:59.077223+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:59.077223+0000","last_undegraded":"2024-04-26T12:30:59.077223+0000","last_fullsized":"2024-04-26T12:30:59.077223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:17.874875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":542,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076883+0000","last_change":"2024-04-26T12:28:00.707724+0000","last_active":"2024-04-26T12:30:59.076883+0000","last_peered":"2024-04-26T12:30:59.076883+0000","last_clean":"2024-04-26T12:30:59.076883+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:30:59.076883+0000","last_undegraded":"2024-04-26T12:30:59.076883+0000","last_fullsized":"2024-04-26T12:30:59.076883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:20.384961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077310+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:30:59.077310+0000","last_peered":"2024-04-26T12:30:59.077310+0000","last_clean":"2024-04-26T12:30:59.077310+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:30:59.077310+0000","last_undegraded":"2024-04-26T12:30:59.077310+0000","last_fullsized":"2024-04-26T12:30:59.077310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:40.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077689+0000","last_change":"2024-04-26T12:30:51.076207+0000","last_active":"2024-04-26T12:30:59.077689+0000","last_peered":"2024-04-26T12:30:59.077689+0000","last_clean":"2024-04-26T12:30:59.077689+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:30:59.077689+0000","last_undegraded":"2024-04-26T12:30:59.077689+0000","last_fullsized":"2024-04-26T12:30:59.077689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:05.869282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":863,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077482+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:30:59.077482+0000","last_peered":"2024-04-26T12:30:59.077482+0000","last_clean":"2024-04-26T12:30:59.077482+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:30:59.077482+0000","last_undegraded":"2024-04-26T12:30:59.077482+0000","last_fullsized":"2024-04-26T12:30:59.077482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:50.433671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076889+0000","last_change":"2024-04-26T12:30:54.080153+0000","last_active":"2024-04-26T12:30:59.076889+0000","last_peered":"2024-04-26T12:30:59.076889+0000","last_clean":"2024-04-26T12:30:59.076889+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:30:59.076889+0000","last_undegraded":"2024-04-26T12:30:59.076889+0000","last_fullsized":"2024-04-26T12:30:59.076889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:48.057283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":629,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078217+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:31:00.078217+0000","last_peered":"2024-04-26T12:31:00.078217+0000","last_clean":"2024-04-26T12:31:00.078217+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:31:00.078217+0000","last_undegraded":"2024-04-26T12:31:00.078217+0000","last_fullsized":"2024-04-26T12:31:00.078217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":515,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076733+0000","last_change":"2024-04-26T12:30:50.086765+0000","last_active":"2024-04-26T12:30:59.076733+0000","last_peered":"2024-04-26T12:30:59.076733+0000","last_clean":"2024-04-26T12:30:59.076733+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:30:59.076733+0000","last_undegraded":"2024-04-26T12:30:59.076733+0000","last_fullsized":"2024-04-26T12:30:59.076733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:36.313767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078165+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:30:59.078165+0000","last_peered":"2024-04-26T12:30:59.078165+0000","last_clean":"2024-04-26T12:30:59.078165+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:30:59.078165+0000","last_undegraded":"2024-04-26T12:30:59.078165+0000","last_fullsized":"2024-04-26T12:30:59.078165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79134720,"data_stored":256449018,"data_compressed":38844374,"data_compressed_allocated":48693248,"data_compressed_original":226074624,"omap_allocated":5343,"internal_metadata":0},"log_size":7508,"ondisk_log_size":7508,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738424,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130116,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94241724,"statfs":{"total":96636764160,"available":96503525376,"internally_reserved":0,"allocated":31711232,"data_stored":85785287,"data_compressed":12062822,"data_compressed_allocated":15765504,"data_compressed_original":70336512,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.23599999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.54500000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131340,"kb_used_data":32188,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94240500,"statfs":{"total":96636764160,"available":96502272000,"internally_reserved":0,"allocated":32960512,"data_stored":91451171,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:30:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.30399999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.625,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.53300000000000003}]}]},{"osd":1,"up_from":64,"seq":274877906952,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62340,"kb_used_data":16760,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309500,"statfs":{"total":96636764160,"available":96572928000,"internally_reserved":0,"allocated":17162240,"data_stored":81548386,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30789632,"data_stored":84809889,"data_compressed":12028675,"data_compressed_allocated":15720448,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:09.439 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:09.817 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:31:09.819 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:31:09.829 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-04-26T12:31:09.360759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6546,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34345,"ondisk_log_size":34345,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":323796,"kb_used_data":79916,"kb_used_omap":9,"kb_used_meta":243830,"kb_avail":282791724,"statfs":{"total":289910292480,"available":289578725376,"internally_reserved":0,"allocated":81833984,"data_stored":258784844,"data_compressed":38912668,"data_compressed_allocated":48783360,"data_compressed_original":227221504,"omap_allocated":10125,"internal_metadata":249682035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-196,"num_objects_misplaced":-363,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002189"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":901,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078865+0000","last_change":"2024-04-26T12:30:54.081113+0000","last_active":"2024-04-26T12:31:00.078865+0000","last_peered":"2024-04-26T12:31:00.078865+0000","last_clean":"2024-04-26T12:31:00.078865+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:31:00.078865+0000","last_undegraded":"2024-04-26T12:31:00.078865+0000","last_fullsized":"2024-04-26T12:31:00.078865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.062347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":957,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078333+0000","last_change":"2024-04-26T12:30:56.085870+0000","last_active":"2024-04-26T12:31:00.078333+0000","last_peered":"2024-04-26T12:31:00.078333+0000","last_clean":"2024-04-26T12:31:00.078333+0000","last_became_active":"2024-04-26T12:30:56.084642+0000","last_became_peered":"2024-04-26T12:30:56.084642+0000","last_unstale":"2024-04-26T12:31:00.078333+0000","last_undegraded":"2024-04-26T12:31:00.078333+0000","last_fullsized":"2024-04-26T12:31:00.078333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:41.346086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":495,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078491+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:30:59.078491+0000","last_peered":"2024-04-26T12:30:59.078491+0000","last_clean":"2024-04-26T12:30:59.078491+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:30:59.078491+0000","last_undegraded":"2024-04-26T12:30:59.078491+0000","last_fullsized":"2024-04-26T12:30:59.078491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:55.616144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":867,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078158+0000","last_change":"2024-04-26T12:30:48.089842+0000","last_active":"2024-04-26T12:30:59.078158+0000","last_peered":"2024-04-26T12:30:59.078158+0000","last_clean":"2024-04-26T12:30:59.078158+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:30:59.078158+0000","last_undegraded":"2024-04-26T12:30:59.078158+0000","last_fullsized":"2024-04-26T12:30:59.078158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:13.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":939,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077433+0000","last_change":"2024-04-26T12:30:48.089460+0000","last_active":"2024-04-26T12:30:59.077433+0000","last_peered":"2024-04-26T12:30:59.077433+0000","last_clean":"2024-04-26T12:30:59.077433+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:30:59.077433+0000","last_undegraded":"2024-04-26T12:30:59.077433+0000","last_fullsized":"2024-04-26T12:30:59.077433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077152+0000","last_change":"2024-04-26T12:30:48.090606+0000","last_active":"2024-04-26T12:30:59.077152+0000","last_peered":"2024-04-26T12:30:59.077152+0000","last_clean":"2024-04-26T12:30:59.077152+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:30:59.077152+0000","last_undegraded":"2024-04-26T12:30:59.077152+0000","last_fullsized":"2024-04-26T12:30:59.077152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:57.446858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1028,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077423+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:30:59.077423+0000","last_peered":"2024-04-26T12:30:59.077423+0000","last_clean":"2024-04-26T12:30:59.077423+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:30:59.077423+0000","last_undegraded":"2024-04-26T12:30:59.077423+0000","last_fullsized":"2024-04-26T12:30:59.077423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:06.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":767,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076901+0000","last_change":"2024-04-26T12:30:49.082511+0000","last_active":"2024-04-26T12:30:59.076901+0000","last_peered":"2024-04-26T12:30:59.076901+0000","last_clean":"2024-04-26T12:30:59.076901+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:30:59.076901+0000","last_undegraded":"2024-04-26T12:30:59.076901+0000","last_fullsized":"2024-04-26T12:30:59.076901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:54.832086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077579+0000","last_change":"2024-04-26T12:30:56.079114+0000","last_active":"2024-04-26T12:30:59.077579+0000","last_peered":"2024-04-26T12:30:59.077579+0000","last_clean":"2024-04-26T12:30:59.077579+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:30:59.077579+0000","last_undegraded":"2024-04-26T12:30:59.077579+0000","last_fullsized":"2024-04-26T12:30:59.077579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:37.907357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":911,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078367+0000","last_change":"2024-04-26T12:30:56.087672+0000","last_active":"2024-04-26T12:30:59.078367+0000","last_peered":"2024-04-26T12:30:59.078367+0000","last_clean":"2024-04-26T12:30:59.078367+0000","last_became_active":"2024-04-26T12:30:56.085904+0000","last_became_peered":"2024-04-26T12:30:56.085904+0000","last_unstale":"2024-04-26T12:30:59.078367+0000","last_undegraded":"2024-04-26T12:30:59.078367+0000","last_fullsized":"2024-04-26T12:30:59.078367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:53.993298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":594,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078178+0000","last_change":"2024-04-26T12:30:50.085026+0000","last_active":"2024-04-26T12:30:59.078178+0000","last_peered":"2024-04-26T12:30:59.078178+0000","last_clean":"2024-04-26T12:30:59.078178+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:30:59.078178+0000","last_undegraded":"2024-04-26T12:30:59.078178+0000","last_fullsized":"2024-04-26T12:30:59.078178+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:31.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077591+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:30:59.077591+0000","last_peered":"2024-04-26T12:30:59.077591+0000","last_clean":"2024-04-26T12:30:59.077591+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:30:59.077591+0000","last_undegraded":"2024-04-26T12:30:59.077591+0000","last_fullsized":"2024-04-26T12:30:59.077591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":883,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077635+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:30:59.077635+0000","last_peered":"2024-04-26T12:30:59.077635+0000","last_clean":"2024-04-26T12:30:59.077635+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:30:59.077635+0000","last_undegraded":"2024-04-26T12:30:59.077635+0000","last_fullsized":"2024-04-26T12:30:59.077635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:00.467106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":520,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077571+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:30:59.077571+0000","last_peered":"2024-04-26T12:30:59.077571+0000","last_clean":"2024-04-26T12:30:59.077571+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:30:59.077571+0000","last_undegraded":"2024-04-26T12:30:59.077571+0000","last_fullsized":"2024-04-26T12:30:59.077571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":540,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077003+0000","last_change":"2024-04-26T12:30:47.080645+0000","last_active":"2024-04-26T12:30:59.077003+0000","last_peered":"2024-04-26T12:30:59.077003+0000","last_clean":"2024-04-26T12:30:59.077003+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:30:59.077003+0000","last_undegraded":"2024-04-26T12:30:59.077003+0000","last_fullsized":"2024-04-26T12:30:59.077003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:11.047331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":926,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077140+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:30:59.077140+0000","last_peered":"2024-04-26T12:30:59.077140+0000","last_clean":"2024-04-26T12:30:59.077140+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:30:59.077140+0000","last_undegraded":"2024-04-26T12:30:59.077140+0000","last_fullsized":"2024-04-26T12:30:59.077140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:18.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":493,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077499+0000","last_change":"2024-04-26T12:30:55.090347+0000","last_active":"2024-04-26T12:30:59.077499+0000","last_peered":"2024-04-26T12:30:59.077499+0000","last_clean":"2024-04-26T12:30:59.077499+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:30:59.077499+0000","last_undegraded":"2024-04-26T12:30:59.077499+0000","last_fullsized":"2024-04-26T12:30:59.077499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:18.689900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":912,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078455+0000","last_change":"2024-04-26T12:30:57.084445+0000","last_active":"2024-04-26T12:30:59.078455+0000","last_peered":"2024-04-26T12:30:59.078455+0000","last_clean":"2024-04-26T12:30:59.078455+0000","last_became_active":"2024-04-26T12:30:57.083026+0000","last_became_peered":"2024-04-26T12:30:57.083026+0000","last_unstale":"2024-04-26T12:30:59.078455+0000","last_undegraded":"2024-04-26T12:30:59.078455+0000","last_fullsized":"2024-04-26T12:30:59.078455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:26.231571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076908+0000","last_change":"2024-04-26T12:30:51.076894+0000","last_active":"2024-04-26T12:30:59.076908+0000","last_peered":"2024-04-26T12:30:59.076908+0000","last_clean":"2024-04-26T12:30:59.076908+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:30:59.076908+0000","last_undegraded":"2024-04-26T12:30:59.076908+0000","last_fullsized":"2024-04-26T12:30:59.076908+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:50.091007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1070,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078148+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:30:59.078148+0000","last_peered":"2024-04-26T12:30:59.078148+0000","last_clean":"2024-04-26T12:30:59.078148+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:30:59.078148+0000","last_undegraded":"2024-04-26T12:30:59.078148+0000","last_fullsized":"2024-04-26T12:30:59.078148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:26.268194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":952,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077199+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:30:59.077199+0000","last_peered":"2024-04-26T12:30:59.077199+0000","last_clean":"2024-04-26T12:30:59.077199+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:30:59.077199+0000","last_undegraded":"2024-04-26T12:30:59.077199+0000","last_fullsized":"2024-04-26T12:30:59.077199+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:12.535434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":580,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077653+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:30:59.077653+0000","last_peered":"2024-04-26T12:30:59.077653+0000","last_clean":"2024-04-26T12:30:59.077653+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:30:59.077653+0000","last_undegraded":"2024-04-26T12:30:59.077653+0000","last_fullsized":"2024-04-26T12:30:59.077653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.082038+0000","last_change":"2024-04-26T12:31:00.082038+0000","last_active":"2024-04-26T12:31:00.082038+0000","last_peered":"2024-04-26T12:31:00.082038+0000","last_clean":"2024-04-26T12:31:00.082038+0000","last_became_active":"2024-04-26T12:31:00.079766+0000","last_became_peered":"2024-04-26T12:31:00.079766+0000","last_unstale":"2024-04-26T12:31:00.082038+0000","last_undegraded":"2024-04-26T12:31:00.082038+0000","last_fullsized":"2024-04-26T12:31:00.082038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:29.495060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":1017,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078556+0000","last_change":"2024-04-26T12:30:58.079466+0000","last_active":"2024-04-26T12:30:59.078556+0000","last_peered":"2024-04-26T12:30:59.078556+0000","last_clean":"2024-04-26T12:30:59.078556+0000","last_became_active":"2024-04-26T12:30:58.078211+0000","last_became_peered":"2024-04-26T12:30:58.078211+0000","last_unstale":"2024-04-26T12:30:59.078556+0000","last_undegraded":"2024-04-26T12:30:59.078556+0000","last_fullsized":"2024-04-26T12:30:59.078556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:42.746789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078438+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:30:59.078438+0000","last_peered":"2024-04-26T12:30:59.078438+0000","last_clean":"2024-04-26T12:30:59.078438+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:30:59.078438+0000","last_undegraded":"2024-04-26T12:30:59.078438+0000","last_fullsized":"2024-04-26T12:30:59.078438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":585,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077533+0000","last_change":"2024-04-26T12:30:46.089997+0000","last_active":"2024-04-26T12:30:59.077533+0000","last_peered":"2024-04-26T12:30:59.077533+0000","last_clean":"2024-04-26T12:30:59.077533+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:30:59.077533+0000","last_undegraded":"2024-04-26T12:30:59.077533+0000","last_fullsized":"2024-04-26T12:30:59.077533+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:08.843126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078301+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:30:59.078301+0000","last_peered":"2024-04-26T12:30:59.078301+0000","last_clean":"2024-04-26T12:30:59.078301+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:30:59.078301+0000","last_undegraded":"2024-04-26T12:30:59.078301+0000","last_fullsized":"2024-04-26T12:30:59.078301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077517+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:30:59.077517+0000","last_peered":"2024-04-26T12:30:59.077517+0000","last_clean":"2024-04-26T12:30:59.077517+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:30:59.077517+0000","last_undegraded":"2024-04-26T12:30:59.077517+0000","last_fullsized":"2024-04-26T12:30:59.077517+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:21.302173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078191+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:30:59.078191+0000","last_peered":"2024-04-26T12:30:59.078191+0000","last_clean":"2024-04-26T12:30:59.078191+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:30:59.078191+0000","last_undegraded":"2024-04-26T12:30:59.078191+0000","last_fullsized":"2024-04-26T12:30:59.078191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":410,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076264+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:30:59.076264+0000","last_peered":"2024-04-26T12:30:59.076264+0000","last_clean":"2024-04-26T12:30:59.076264+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:30:59.076264+0000","last_undegraded":"2024-04-26T12:30:59.076264+0000","last_fullsized":"2024-04-26T12:30:59.076264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.762427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077325+0000","last_change":"2024-04-26T12:30:58.081169+0000","last_active":"2024-04-26T12:30:59.077325+0000","last_peered":"2024-04-26T12:30:59.077325+0000","last_clean":"2024-04-26T12:30:59.077325+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:30:59.077325+0000","last_undegraded":"2024-04-26T12:30:59.077325+0000","last_fullsized":"2024-04-26T12:30:59.077325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:42.618440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"58'708","reported_seq":778,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076197+0000","last_change":"2024-04-26T12:30:44.022038+0000","last_active":"2024-04-26T12:30:59.076197+0000","last_peered":"2024-04-26T12:30:59.076197+0000","last_clean":"2024-04-26T12:30:59.076197+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:30:59.076197+0000","last_undegraded":"2024-04-26T12:30:59.076197+0000","last_fullsized":"2024-04-26T12:30:59.076197+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:30.369118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":500,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078749+0000","last_change":"2024-04-26T12:30:47.081417+0000","last_active":"2024-04-26T12:31:00.078749+0000","last_peered":"2024-04-26T12:31:00.078749+0000","last_clean":"2024-04-26T12:31:00.078749+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:31:00.078749+0000","last_undegraded":"2024-04-26T12:31:00.078749+0000","last_fullsized":"2024-04-26T12:31:00.078749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:17.628933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077196+0000","last_change":"2024-04-26T12:30:41.018067+0000","last_active":"2024-04-26T12:30:59.077196+0000","last_peered":"2024-04-26T12:30:59.077196+0000","last_clean":"2024-04-26T12:30:59.077196+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:30:59.077196+0000","last_undegraded":"2024-04-26T12:30:59.077196+0000","last_fullsized":"2024-04-26T12:30:59.077196+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:33.684743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":594,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076422+0000","last_change":"2024-04-26T12:30:58.081823+0000","last_active":"2024-04-26T12:30:59.076422+0000","last_peered":"2024-04-26T12:30:59.076422+0000","last_clean":"2024-04-26T12:30:59.076422+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:30:59.076422+0000","last_undegraded":"2024-04-26T12:30:59.076422+0000","last_fullsized":"2024-04-26T12:30:59.076422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.109302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"58'355","reported_seq":377,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078258+0000","last_change":"2024-04-26T12:30:48.086933+0000","last_active":"2024-04-26T12:30:59.078258+0000","last_peered":"2024-04-26T12:30:59.078258+0000","last_clean":"2024-04-26T12:30:59.078258+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:30:59.078258+0000","last_undegraded":"2024-04-26T12:30:59.078258+0000","last_fullsized":"2024-04-26T12:30:59.078258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:49.737283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":720,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076317+0000","last_change":"2024-04-26T12:30:46.034642+0000","last_active":"2024-04-26T12:30:59.076317+0000","last_peered":"2024-04-26T12:30:59.076317+0000","last_clean":"2024-04-26T12:30:59.076317+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:30:59.076317+0000","last_undegraded":"2024-04-26T12:30:59.076317+0000","last_fullsized":"2024-04-26T12:30:59.076317+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.961343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077954+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:30:59.077954+0000","last_peered":"2024-04-26T12:30:59.077954+0000","last_clean":"2024-04-26T12:30:59.077954+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:30:59.077954+0000","last_undegraded":"2024-04-26T12:30:59.077954+0000","last_fullsized":"2024-04-26T12:30:59.077954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076500+0000","last_change":"2024-04-26T12:30:45.022716+0000","last_active":"2024-04-26T12:30:59.076500+0000","last_peered":"2024-04-26T12:30:59.076500+0000","last_clean":"2024-04-26T12:30:59.076500+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:30:59.076500+0000","last_undegraded":"2024-04-26T12:30:59.076500+0000","last_fullsized":"2024-04-26T12:30:59.076500+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:01.269901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'374","reported_seq":439,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078040+0000","last_change":"2024-04-26T12:30:46.079618+0000","last_active":"2024-04-26T12:30:59.078040+0000","last_peered":"2024-04-26T12:30:59.078040+0000","last_clean":"2024-04-26T12:30:59.078040+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:30:59.078040+0000","last_undegraded":"2024-04-26T12:30:59.078040+0000","last_fullsized":"2024-04-26T12:30:59.078040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:48.209628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":506,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077751+0000","last_change":"2024-04-26T12:30:47.082596+0000","last_active":"2024-04-26T12:30:59.077751+0000","last_peered":"2024-04-26T12:30:59.077751+0000","last_clean":"2024-04-26T12:30:59.077751+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:30:59.077751+0000","last_undegraded":"2024-04-26T12:30:59.077751+0000","last_fullsized":"2024-04-26T12:30:59.077751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:34.688913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":648,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077638+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:30:59.077638+0000","last_peered":"2024-04-26T12:30:59.077638+0000","last_clean":"2024-04-26T12:30:59.077638+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:30:59.077638+0000","last_undegraded":"2024-04-26T12:30:59.077638+0000","last_fullsized":"2024-04-26T12:30:59.077638+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:50.674218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":794,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078066+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:30:59.078066+0000","last_peered":"2024-04-26T12:30:59.078066+0000","last_clean":"2024-04-26T12:30:59.078066+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:30:59.078066+0000","last_undegraded":"2024-04-26T12:30:59.078066+0000","last_fullsized":"2024-04-26T12:30:59.078066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:11.548975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076400+0000","last_change":"2024-04-26T12:30:46.089052+0000","last_active":"2024-04-26T12:30:59.076400+0000","last_peered":"2024-04-26T12:30:59.076400+0000","last_clean":"2024-04-26T12:30:59.076400+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:30:59.076400+0000","last_undegraded":"2024-04-26T12:30:59.076400+0000","last_fullsized":"2024-04-26T12:30:59.076400+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:28.433853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":860,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078103+0000","last_change":"2024-04-26T12:30:50.086492+0000","last_active":"2024-04-26T12:30:59.078103+0000","last_peered":"2024-04-26T12:30:59.078103+0000","last_clean":"2024-04-26T12:30:59.078103+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:30:59.078103+0000","last_undegraded":"2024-04-26T12:30:59.078103+0000","last_fullsized":"2024-04-26T12:30:59.078103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:18.705037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077626+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:30:59.077626+0000","last_peered":"2024-04-26T12:30:59.077626+0000","last_clean":"2024-04-26T12:30:59.077626+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:30:59.077626+0000","last_undegraded":"2024-04-26T12:30:59.077626+0000","last_fullsized":"2024-04-26T12:30:59.077626+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":500,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.086763+0000","last_change":"2024-04-26T12:30:59.083411+0000","last_active":"2024-04-26T12:30:59.086763+0000","last_peered":"2024-04-26T12:30:59.086763+0000","last_clean":"2024-04-26T12:30:59.086763+0000","last_became_active":"2024-04-26T12:30:59.081424+0000","last_became_peered":"2024-04-26T12:30:59.081424+0000","last_unstale":"2024-04-26T12:30:59.086763+0000","last_undegraded":"2024-04-26T12:30:59.086763+0000","last_fullsized":"2024-04-26T12:30:59.086763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:09.181871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'54","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077588+0000","last_change":"2024-04-26T12:30:46.082166+0000","last_active":"2024-04-26T12:30:59.077588+0000","last_peered":"2024-04-26T12:30:59.077588+0000","last_clean":"2024-04-26T12:30:59.077588+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:30:59.077588+0000","last_undegraded":"2024-04-26T12:30:59.077588+0000","last_fullsized":"2024-04-26T12:30:59.077588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:28.037535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":538,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.089343+0000","last_change":"2024-04-26T12:30:59.084548+0000","last_active":"2024-04-26T12:30:59.089343+0000","last_peered":"2024-04-26T12:30:59.089343+0000","last_clean":"2024-04-26T12:30:59.089343+0000","last_became_active":"2024-04-26T12:30:59.081463+0000","last_became_peered":"2024-04-26T12:30:59.081463+0000","last_unstale":"2024-04-26T12:30:59.089343+0000","last_undegraded":"2024-04-26T12:30:59.089343+0000","last_fullsized":"2024-04-26T12:30:59.089343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:51.815050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'186","reported_seq":209,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078288+0000","last_change":"2024-04-26T12:30:46.080074+0000","last_active":"2024-04-26T12:30:59.078288+0000","last_peered":"2024-04-26T12:30:59.078288+0000","last_clean":"2024-04-26T12:30:59.078288+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:30:59.078288+0000","last_undegraded":"2024-04-26T12:30:59.078288+0000","last_fullsized":"2024-04-26T12:30:59.078288+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:24.562647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":531,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077193+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:30:59.077193+0000","last_peered":"2024-04-26T12:30:59.077193+0000","last_clean":"2024-04-26T12:30:59.077193+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:30:59.077193+0000","last_undegraded":"2024-04-26T12:30:59.077193+0000","last_fullsized":"2024-04-26T12:30:59.077193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078244+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:30:59.078244+0000","last_peered":"2024-04-26T12:30:59.078244+0000","last_clean":"2024-04-26T12:30:59.078244+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:30:59.078244+0000","last_undegraded":"2024-04-26T12:30:59.078244+0000","last_fullsized":"2024-04-26T12:30:59.078244+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:40.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":976,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077821+0000","last_change":"2024-04-26T12:30:52.078990+0000","last_active":"2024-04-26T12:30:59.077821+0000","last_peered":"2024-04-26T12:30:59.077821+0000","last_clean":"2024-04-26T12:30:59.077821+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:30:59.077821+0000","last_undegraded":"2024-04-26T12:30:59.077821+0000","last_fullsized":"2024-04-26T12:30:59.077821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.697122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":514,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078332+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:30:59.078332+0000","last_peered":"2024-04-26T12:30:59.078332+0000","last_clean":"2024-04-26T12:30:59.078332+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:30:59.078332+0000","last_undegraded":"2024-04-26T12:30:59.078332+0000","last_fullsized":"2024-04-26T12:30:59.078332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:18.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077374+0000","last_change":"2024-04-26T12:30:48.089200+0000","last_active":"2024-04-26T12:30:59.077374+0000","last_peered":"2024-04-26T12:30:59.077374+0000","last_clean":"2024-04-26T12:30:59.077374+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:30:59.077374+0000","last_undegraded":"2024-04-26T12:30:59.077374+0000","last_fullsized":"2024-04-26T12:30:59.077374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:04.588329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077619+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:59.077619+0000","last_peered":"2024-04-26T12:30:59.077619+0000","last_clean":"2024-04-26T12:30:59.077619+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:30:59.077619+0000","last_undegraded":"2024-04-26T12:30:59.077619+0000","last_fullsized":"2024-04-26T12:30:59.077619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:40.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":559,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076624+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:30:59.076624+0000","last_peered":"2024-04-26T12:30:59.076624+0000","last_clean":"2024-04-26T12:30:59.076624+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:30:59.076624+0000","last_undegraded":"2024-04-26T12:30:59.076624+0000","last_fullsized":"2024-04-26T12:30:59.076624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.230823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":252,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076455+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:30:59.076455+0000","last_peered":"2024-04-26T12:30:59.076455+0000","last_clean":"2024-04-26T12:30:59.076455+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:30:59.076455+0000","last_undegraded":"2024-04-26T12:30:59.076455+0000","last_fullsized":"2024-04-26T12:30:59.076455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:30.864621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":537,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077889+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:30:59.077889+0000","last_peered":"2024-04-26T12:30:59.077889+0000","last_clean":"2024-04-26T12:30:59.077889+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:30:59.077889+0000","last_undegraded":"2024-04-26T12:30:59.077889+0000","last_fullsized":"2024-04-26T12:30:59.077889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:13.427584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":268,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077250+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:30:59.077250+0000","last_peered":"2024-04-26T12:30:59.077250+0000","last_clean":"2024-04-26T12:30:59.077250+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:30:59.077250+0000","last_undegraded":"2024-04-26T12:30:59.077250+0000","last_fullsized":"2024-04-26T12:30:59.077250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:16.260550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078751+0000","last_change":"2024-04-26T12:30:47.083054+0000","last_active":"2024-04-26T12:30:59.078751+0000","last_peered":"2024-04-26T12:30:59.078751+0000","last_clean":"2024-04-26T12:30:59.078751+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:30:59.078751+0000","last_undegraded":"2024-04-26T12:30:59.078751+0000","last_fullsized":"2024-04-26T12:30:59.078751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.645638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":162,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077348+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:30:59.077348+0000","last_peered":"2024-04-26T12:30:59.077348+0000","last_clean":"2024-04-26T12:30:59.077348+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:30:59.077348+0000","last_undegraded":"2024-04-26T12:30:59.077348+0000","last_fullsized":"2024-04-26T12:30:59.077348+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:20.988072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":492,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078566+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:30:59.078566+0000","last_peered":"2024-04-26T12:30:59.078566+0000","last_clean":"2024-04-26T12:30:59.078566+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:30:59.078566+0000","last_undegraded":"2024-04-26T12:30:59.078566+0000","last_fullsized":"2024-04-26T12:30:59.078566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":588,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078399+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:30:59.078399+0000","last_peered":"2024-04-26T12:30:59.078399+0000","last_clean":"2024-04-26T12:30:59.078399+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:30:59.078399+0000","last_undegraded":"2024-04-26T12:30:59.078399+0000","last_fullsized":"2024-04-26T12:30:59.078399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:25.266771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077354+0000","last_change":"2024-04-26T12:30:55.090354+0000","last_active":"2024-04-26T12:30:59.077354+0000","last_peered":"2024-04-26T12:30:59.077354+0000","last_clean":"2024-04-26T12:30:59.077354+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:30:59.077354+0000","last_undegraded":"2024-04-26T12:30:59.077354+0000","last_fullsized":"2024-04-26T12:30:59.077354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:14.455369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076944+0000","last_change":"2024-04-26T12:30:41.026049+0000","last_active":"2024-04-26T12:30:59.076944+0000","last_peered":"2024-04-26T12:30:59.076944+0000","last_clean":"2024-04-26T12:30:59.076944+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:30:59.076944+0000","last_undegraded":"2024-04-26T12:30:59.076944+0000","last_fullsized":"2024-04-26T12:30:59.076944+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.409817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"58'454","reported_seq":480,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078638+0000","last_change":"2024-04-26T12:30:46.079367+0000","last_active":"2024-04-26T12:30:59.078638+0000","last_peered":"2024-04-26T12:30:59.078638+0000","last_clean":"2024-04-26T12:30:59.078638+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:30:59.078638+0000","last_undegraded":"2024-04-26T12:30:59.078638+0000","last_fullsized":"2024-04-26T12:30:59.078638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:00.950370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":473,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078369+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:31:00.078369+0000","last_peered":"2024-04-26T12:31:00.078369+0000","last_clean":"2024-04-26T12:31:00.078369+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:31:00.078369+0000","last_undegraded":"2024-04-26T12:31:00.078369+0000","last_fullsized":"2024-04-26T12:31:00.078369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078680+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:31:00.078680+0000","last_peered":"2024-04-26T12:31:00.078680+0000","last_clean":"2024-04-26T12:31:00.078680+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:31:00.078680+0000","last_undegraded":"2024-04-26T12:31:00.078680+0000","last_fullsized":"2024-04-26T12:31:00.078680+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:16.686041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078300+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:00.078300+0000","last_peered":"2024-04-26T12:31:00.078300+0000","last_clean":"2024-04-26T12:31:00.078300+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:31:00.078300+0000","last_undegraded":"2024-04-26T12:31:00.078300+0000","last_fullsized":"2024-04-26T12:31:00.078300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:18.069937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076887+0000","last_change":"2024-04-26T12:30:46.033999+0000","last_active":"2024-04-26T12:30:59.076887+0000","last_peered":"2024-04-26T12:30:59.076887+0000","last_clean":"2024-04-26T12:30:59.076887+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:30:59.076887+0000","last_undegraded":"2024-04-26T12:30:59.076887+0000","last_fullsized":"2024-04-26T12:30:59.076887+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:33.235467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076629+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:30:59.076629+0000","last_peered":"2024-04-26T12:30:59.076629+0000","last_clean":"2024-04-26T12:30:59.076629+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:30:59.076629+0000","last_undegraded":"2024-04-26T12:30:59.076629+0000","last_fullsized":"2024-04-26T12:30:59.076629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:20.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":398,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077980+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:30:59.077980+0000","last_peered":"2024-04-26T12:30:59.077980+0000","last_clean":"2024-04-26T12:30:59.077980+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:30:59.077980+0000","last_undegraded":"2024-04-26T12:30:59.077980+0000","last_fullsized":"2024-04-26T12:30:59.077980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":432,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077237+0000","last_change":"2024-04-26T12:30:54.081099+0000","last_active":"2024-04-26T12:30:59.077237+0000","last_peered":"2024-04-26T12:30:59.077237+0000","last_clean":"2024-04-26T12:30:59.077237+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:30:59.077237+0000","last_undegraded":"2024-04-26T12:30:59.077237+0000","last_fullsized":"2024-04-26T12:30:59.077237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:29.507250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077511+0000","last_change":"2024-04-26T12:30:46.082961+0000","last_active":"2024-04-26T12:30:59.077511+0000","last_peered":"2024-04-26T12:30:59.077511+0000","last_clean":"2024-04-26T12:30:59.077511+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:30:59.077511+0000","last_undegraded":"2024-04-26T12:30:59.077511+0000","last_fullsized":"2024-04-26T12:30:59.077511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:10.764587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":263,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077256+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:30:59.077256+0000","last_peered":"2024-04-26T12:30:59.077256+0000","last_clean":"2024-04-26T12:30:59.077256+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:30:59.077256+0000","last_undegraded":"2024-04-26T12:30:59.077256+0000","last_fullsized":"2024-04-26T12:30:59.077256+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:23.542209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":598,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076589+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:30:59.076589+0000","last_peered":"2024-04-26T12:30:59.076589+0000","last_clean":"2024-04-26T12:30:59.076589+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:30:59.076589+0000","last_undegraded":"2024-04-26T12:30:59.076589+0000","last_fullsized":"2024-04-26T12:30:59.076589+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:05.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":565,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078891+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:31:00.078891+0000","last_peered":"2024-04-26T12:31:00.078891+0000","last_clean":"2024-04-26T12:31:00.078891+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:31:00.078891+0000","last_undegraded":"2024-04-26T12:31:00.078891+0000","last_fullsized":"2024-04-26T12:31:00.078891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077378+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:30:59.077378+0000","last_peered":"2024-04-26T12:30:59.077378+0000","last_clean":"2024-04-26T12:30:59.077378+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:30:59.077378+0000","last_undegraded":"2024-04-26T12:30:59.077378+0000","last_fullsized":"2024-04-26T12:30:59.077378+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'105","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077011+0000","last_change":"2024-04-26T12:30:44.028851+0000","last_active":"2024-04-26T12:30:59.077011+0000","last_peered":"2024-04-26T12:30:59.077011+0000","last_clean":"2024-04-26T12:30:59.077011+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:30:59.077011+0000","last_undegraded":"2024-04-26T12:30:59.077011+0000","last_fullsized":"2024-04-26T12:30:59.077011+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:13.939165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078426+0000","last_change":"2024-04-26T12:30:57.078892+0000","last_active":"2024-04-26T12:30:59.078426+0000","last_peered":"2024-04-26T12:30:59.078426+0000","last_clean":"2024-04-26T12:30:59.078426+0000","last_became_active":"2024-04-26T12:30:57.077779+0000","last_became_peered":"2024-04-26T12:30:57.077779+0000","last_unstale":"2024-04-26T12:30:59.078426+0000","last_undegraded":"2024-04-26T12:30:59.078426+0000","last_fullsized":"2024-04-26T12:30:59.078426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:07.812506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078778+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:31:00.078778+0000","last_peered":"2024-04-26T12:31:00.078778+0000","last_clean":"2024-04-26T12:31:00.078778+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:31:00.078778+0000","last_undegraded":"2024-04-26T12:31:00.078778+0000","last_fullsized":"2024-04-26T12:31:00.078778+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:31.181549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077119+0000","last_change":"2024-04-26T12:30:41.026137+0000","last_active":"2024-04-26T12:30:59.077119+0000","last_peered":"2024-04-26T12:30:59.077119+0000","last_clean":"2024-04-26T12:30:59.077119+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:30:59.077119+0000","last_undegraded":"2024-04-26T12:30:59.077119+0000","last_fullsized":"2024-04-26T12:30:59.077119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:08.225745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":520,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077810+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:31:00.077810+0000","last_peered":"2024-04-26T12:31:00.077810+0000","last_clean":"2024-04-26T12:31:00.077810+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:31:00.077810+0000","last_undegraded":"2024-04-26T12:31:00.077810+0000","last_fullsized":"2024-04-26T12:31:00.077810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077074+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:30:59.077074+0000","last_peered":"2024-04-26T12:30:59.077074+0000","last_clean":"2024-04-26T12:30:59.077074+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:30:59.077074+0000","last_undegraded":"2024-04-26T12:30:59.077074+0000","last_fullsized":"2024-04-26T12:30:59.077074+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:51.609322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076973+0000","last_change":"2024-04-26T12:30:41.030157+0000","last_active":"2024-04-26T12:30:59.076973+0000","last_peered":"2024-04-26T12:30:59.076973+0000","last_clean":"2024-04-26T12:30:59.076973+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:59.076973+0000","last_undegraded":"2024-04-26T12:30:59.076973+0000","last_fullsized":"2024-04-26T12:30:59.076973+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:32.867679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":500,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.081711+0000","last_change":"2024-04-26T12:31:00.081711+0000","last_active":"2024-04-26T12:31:00.081711+0000","last_peered":"2024-04-26T12:31:00.081711+0000","last_clean":"2024-04-26T12:31:00.081711+0000","last_became_active":"2024-04-26T12:31:00.079504+0000","last_became_peered":"2024-04-26T12:31:00.079504+0000","last_unstale":"2024-04-26T12:31:00.081711+0000","last_undegraded":"2024-04-26T12:31:00.081711+0000","last_fullsized":"2024-04-26T12:31:00.081711+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:17.125482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078428+0000","last_change":"2024-04-26T12:30:46.080509+0000","last_active":"2024-04-26T12:30:59.078428+0000","last_peered":"2024-04-26T12:30:59.078428+0000","last_clean":"2024-04-26T12:30:59.078428+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:30:59.078428+0000","last_undegraded":"2024-04-26T12:30:59.078428+0000","last_fullsized":"2024-04-26T12:30:59.078428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:40.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'82","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077350+0000","last_change":"2024-04-26T12:30:46.086027+0000","last_active":"2024-04-26T12:30:59.077350+0000","last_peered":"2024-04-26T12:30:59.077350+0000","last_clean":"2024-04-26T12:30:59.077350+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:30:59.077350+0000","last_undegraded":"2024-04-26T12:30:59.077350+0000","last_fullsized":"2024-04-26T12:30:59.077350+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:13.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":606,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077942+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:31:00.077942+0000","last_peered":"2024-04-26T12:31:00.077942+0000","last_clean":"2024-04-26T12:31:00.077942+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:31:00.077942+0000","last_undegraded":"2024-04-26T12:31:00.077942+0000","last_fullsized":"2024-04-26T12:31:00.077942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077612+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:30:59.077612+0000","last_peered":"2024-04-26T12:30:59.077612+0000","last_clean":"2024-04-26T12:30:59.077612+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:30:59.077612+0000","last_undegraded":"2024-04-26T12:30:59.077612+0000","last_fullsized":"2024-04-26T12:30:59.077612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.312112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":855,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078064+0000","last_change":"2024-04-26T12:30:53.079043+0000","last_active":"2024-04-26T12:30:59.078064+0000","last_peered":"2024-04-26T12:30:59.078064+0000","last_clean":"2024-04-26T12:30:59.078064+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:30:59.078064+0000","last_undegraded":"2024-04-26T12:30:59.078064+0000","last_fullsized":"2024-04-26T12:30:59.078064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:00.091756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":311,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078038+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:30:59.078038+0000","last_peered":"2024-04-26T12:30:59.078038+0000","last_clean":"2024-04-26T12:30:59.078038+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:30:59.078038+0000","last_undegraded":"2024-04-26T12:30:59.078038+0000","last_fullsized":"2024-04-26T12:30:59.078038+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:43.044883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":798,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077365+0000","last_change":"2024-04-26T12:30:48.088039+0000","last_active":"2024-04-26T12:30:59.077365+0000","last_peered":"2024-04-26T12:30:59.077365+0000","last_clean":"2024-04-26T12:30:59.077365+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:30:59.077365+0000","last_undegraded":"2024-04-26T12:30:59.077365+0000","last_fullsized":"2024-04-26T12:30:59.077365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:03.967118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"58'314","reported_seq":395,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077986+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:30:59.077986+0000","last_peered":"2024-04-26T12:30:59.077986+0000","last_clean":"2024-04-26T12:30:59.077986+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:30:59.077986+0000","last_undegraded":"2024-04-26T12:30:59.077986+0000","last_fullsized":"2024-04-26T12:30:59.077986+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":872,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077302+0000","last_change":"2024-04-26T12:30:52.079092+0000","last_active":"2024-04-26T12:30:59.077302+0000","last_peered":"2024-04-26T12:30:59.077302+0000","last_clean":"2024-04-26T12:30:59.077302+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:30:59.077302+0000","last_undegraded":"2024-04-26T12:30:59.077302+0000","last_fullsized":"2024-04-26T12:30:59.077302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:10.253347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"58'76","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077223+0000","last_change":"2024-04-26T12:30:41.050653+0000","last_active":"2024-04-26T12:30:59.077223+0000","last_peered":"2024-04-26T12:30:59.077223+0000","last_clean":"2024-04-26T12:30:59.077223+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:59.077223+0000","last_undegraded":"2024-04-26T12:30:59.077223+0000","last_fullsized":"2024-04-26T12:30:59.077223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:17.874875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":542,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076883+0000","last_change":"2024-04-26T12:28:00.707724+0000","last_active":"2024-04-26T12:30:59.076883+0000","last_peered":"2024-04-26T12:30:59.076883+0000","last_clean":"2024-04-26T12:30:59.076883+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:30:59.076883+0000","last_undegraded":"2024-04-26T12:30:59.076883+0000","last_fullsized":"2024-04-26T12:30:59.076883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:20.384961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077310+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:30:59.077310+0000","last_peered":"2024-04-26T12:30:59.077310+0000","last_clean":"2024-04-26T12:30:59.077310+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:30:59.077310+0000","last_undegraded":"2024-04-26T12:30:59.077310+0000","last_fullsized":"2024-04-26T12:30:59.077310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:40.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077689+0000","last_change":"2024-04-26T12:30:51.076207+0000","last_active":"2024-04-26T12:30:59.077689+0000","last_peered":"2024-04-26T12:30:59.077689+0000","last_clean":"2024-04-26T12:30:59.077689+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:30:59.077689+0000","last_undegraded":"2024-04-26T12:30:59.077689+0000","last_fullsized":"2024-04-26T12:30:59.077689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:05.869282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":863,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077482+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:30:59.077482+0000","last_peered":"2024-04-26T12:30:59.077482+0000","last_clean":"2024-04-26T12:30:59.077482+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:30:59.077482+0000","last_undegraded":"2024-04-26T12:30:59.077482+0000","last_fullsized":"2024-04-26T12:30:59.077482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:50.433671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076889+0000","last_change":"2024-04-26T12:30:54.080153+0000","last_active":"2024-04-26T12:30:59.076889+0000","last_peered":"2024-04-26T12:30:59.076889+0000","last_clean":"2024-04-26T12:30:59.076889+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:30:59.076889+0000","last_undegraded":"2024-04-26T12:30:59.076889+0000","last_fullsized":"2024-04-26T12:30:59.076889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:48.057283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":629,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078217+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:31:00.078217+0000","last_peered":"2024-04-26T12:31:00.078217+0000","last_clean":"2024-04-26T12:31:00.078217+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:31:00.078217+0000","last_undegraded":"2024-04-26T12:31:00.078217+0000","last_fullsized":"2024-04-26T12:31:00.078217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":515,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076733+0000","last_change":"2024-04-26T12:30:50.086765+0000","last_active":"2024-04-26T12:30:59.076733+0000","last_peered":"2024-04-26T12:30:59.076733+0000","last_clean":"2024-04-26T12:30:59.076733+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:30:59.076733+0000","last_undegraded":"2024-04-26T12:30:59.076733+0000","last_fullsized":"2024-04-26T12:30:59.076733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:36.313767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078165+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:30:59.078165+0000","last_peered":"2024-04-26T12:30:59.078165+0000","last_clean":"2024-04-26T12:30:59.078165+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:30:59.078165+0000","last_undegraded":"2024-04-26T12:30:59.078165+0000","last_fullsized":"2024-04-26T12:30:59.078165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79134720,"data_stored":256449018,"data_compressed":38844374,"data_compressed_allocated":48693248,"data_compressed_original":226074624,"omap_allocated":5343,"internal_metadata":0},"log_size":7508,"ondisk_log_size":7508,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738424,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130116,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94241724,"statfs":{"total":96636764160,"available":96503525376,"internally_reserved":0,"allocated":31711232,"data_stored":85785287,"data_compressed":12062822,"data_compressed_allocated":15765504,"data_compressed_original":70336512,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.23599999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.54500000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131340,"kb_used_data":32188,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94240500,"statfs":{"total":96636764160,"available":96502272000,"internally_reserved":0,"allocated":32960512,"data_stored":91451171,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:30:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.30399999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.625,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.53300000000000003}]}]},{"osd":1,"up_from":64,"seq":274877906952,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62340,"kb_used_data":16760,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309500,"statfs":{"total":96636764160,"available":96572928000,"internally_reserved":0,"allocated":17162240,"data_stored":81548386,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30789632,"data_stored":84809889,"data_compressed":12028675,"data_compressed_allocated":15720448,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:09.833 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:31:09.833 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:10.217 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:31:10.219 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:31:10.228 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-04-26T12:31:09.360759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6546,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34345,"ondisk_log_size":34345,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":323796,"kb_used_data":79916,"kb_used_omap":9,"kb_used_meta":243830,"kb_avail":282791724,"statfs":{"total":289910292480,"available":289578725376,"internally_reserved":0,"allocated":81833984,"data_stored":258784844,"data_compressed":38912668,"data_compressed_allocated":48783360,"data_compressed_original":227221504,"omap_allocated":10125,"internal_metadata":249682035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-196,"num_objects_misplaced":-363,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002189"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":901,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078865+0000","last_change":"2024-04-26T12:30:54.081113+0000","last_active":"2024-04-26T12:31:00.078865+0000","last_peered":"2024-04-26T12:31:00.078865+0000","last_clean":"2024-04-26T12:31:00.078865+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:31:00.078865+0000","last_undegraded":"2024-04-26T12:31:00.078865+0000","last_fullsized":"2024-04-26T12:31:00.078865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.062347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":957,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078333+0000","last_change":"2024-04-26T12:30:56.085870+0000","last_active":"2024-04-26T12:31:00.078333+0000","last_peered":"2024-04-26T12:31:00.078333+0000","last_clean":"2024-04-26T12:31:00.078333+0000","last_became_active":"2024-04-26T12:30:56.084642+0000","last_became_peered":"2024-04-26T12:30:56.084642+0000","last_unstale":"2024-04-26T12:31:00.078333+0000","last_undegraded":"2024-04-26T12:31:00.078333+0000","last_fullsized":"2024-04-26T12:31:00.078333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:41.346086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":495,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078491+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:30:59.078491+0000","last_peered":"2024-04-26T12:30:59.078491+0000","last_clean":"2024-04-26T12:30:59.078491+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:30:59.078491+0000","last_undegraded":"2024-04-26T12:30:59.078491+0000","last_fullsized":"2024-04-26T12:30:59.078491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:55.616144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":867,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078158+0000","last_change":"2024-04-26T12:30:48.089842+0000","last_active":"2024-04-26T12:30:59.078158+0000","last_peered":"2024-04-26T12:30:59.078158+0000","last_clean":"2024-04-26T12:30:59.078158+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:30:59.078158+0000","last_undegraded":"2024-04-26T12:30:59.078158+0000","last_fullsized":"2024-04-26T12:30:59.078158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:13.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":939,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077433+0000","last_change":"2024-04-26T12:30:48.089460+0000","last_active":"2024-04-26T12:30:59.077433+0000","last_peered":"2024-04-26T12:30:59.077433+0000","last_clean":"2024-04-26T12:30:59.077433+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:30:59.077433+0000","last_undegraded":"2024-04-26T12:30:59.077433+0000","last_fullsized":"2024-04-26T12:30:59.077433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077152+0000","last_change":"2024-04-26T12:30:48.090606+0000","last_active":"2024-04-26T12:30:59.077152+0000","last_peered":"2024-04-26T12:30:59.077152+0000","last_clean":"2024-04-26T12:30:59.077152+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:30:59.077152+0000","last_undegraded":"2024-04-26T12:30:59.077152+0000","last_fullsized":"2024-04-26T12:30:59.077152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:57.446858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1028,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077423+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:30:59.077423+0000","last_peered":"2024-04-26T12:30:59.077423+0000","last_clean":"2024-04-26T12:30:59.077423+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:30:59.077423+0000","last_undegraded":"2024-04-26T12:30:59.077423+0000","last_fullsized":"2024-04-26T12:30:59.077423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:06.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":767,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076901+0000","last_change":"2024-04-26T12:30:49.082511+0000","last_active":"2024-04-26T12:30:59.076901+0000","last_peered":"2024-04-26T12:30:59.076901+0000","last_clean":"2024-04-26T12:30:59.076901+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:30:59.076901+0000","last_undegraded":"2024-04-26T12:30:59.076901+0000","last_fullsized":"2024-04-26T12:30:59.076901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:54.832086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077579+0000","last_change":"2024-04-26T12:30:56.079114+0000","last_active":"2024-04-26T12:30:59.077579+0000","last_peered":"2024-04-26T12:30:59.077579+0000","last_clean":"2024-04-26T12:30:59.077579+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:30:59.077579+0000","last_undegraded":"2024-04-26T12:30:59.077579+0000","last_fullsized":"2024-04-26T12:30:59.077579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:37.907357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":911,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078367+0000","last_change":"2024-04-26T12:30:56.087672+0000","last_active":"2024-04-26T12:30:59.078367+0000","last_peered":"2024-04-26T12:30:59.078367+0000","last_clean":"2024-04-26T12:30:59.078367+0000","last_became_active":"2024-04-26T12:30:56.085904+0000","last_became_peered":"2024-04-26T12:30:56.085904+0000","last_unstale":"2024-04-26T12:30:59.078367+0000","last_undegraded":"2024-04-26T12:30:59.078367+0000","last_fullsized":"2024-04-26T12:30:59.078367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:53.993298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":594,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078178+0000","last_change":"2024-04-26T12:30:50.085026+0000","last_active":"2024-04-26T12:30:59.078178+0000","last_peered":"2024-04-26T12:30:59.078178+0000","last_clean":"2024-04-26T12:30:59.078178+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:30:59.078178+0000","last_undegraded":"2024-04-26T12:30:59.078178+0000","last_fullsized":"2024-04-26T12:30:59.078178+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:31.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077591+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:30:59.077591+0000","last_peered":"2024-04-26T12:30:59.077591+0000","last_clean":"2024-04-26T12:30:59.077591+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:30:59.077591+0000","last_undegraded":"2024-04-26T12:30:59.077591+0000","last_fullsized":"2024-04-26T12:30:59.077591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":883,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077635+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:30:59.077635+0000","last_peered":"2024-04-26T12:30:59.077635+0000","last_clean":"2024-04-26T12:30:59.077635+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:30:59.077635+0000","last_undegraded":"2024-04-26T12:30:59.077635+0000","last_fullsized":"2024-04-26T12:30:59.077635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:00.467106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":520,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077571+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:30:59.077571+0000","last_peered":"2024-04-26T12:30:59.077571+0000","last_clean":"2024-04-26T12:30:59.077571+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:30:59.077571+0000","last_undegraded":"2024-04-26T12:30:59.077571+0000","last_fullsized":"2024-04-26T12:30:59.077571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":540,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077003+0000","last_change":"2024-04-26T12:30:47.080645+0000","last_active":"2024-04-26T12:30:59.077003+0000","last_peered":"2024-04-26T12:30:59.077003+0000","last_clean":"2024-04-26T12:30:59.077003+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:30:59.077003+0000","last_undegraded":"2024-04-26T12:30:59.077003+0000","last_fullsized":"2024-04-26T12:30:59.077003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:11.047331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":926,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077140+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:30:59.077140+0000","last_peered":"2024-04-26T12:30:59.077140+0000","last_clean":"2024-04-26T12:30:59.077140+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:30:59.077140+0000","last_undegraded":"2024-04-26T12:30:59.077140+0000","last_fullsized":"2024-04-26T12:30:59.077140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:18.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":493,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077499+0000","last_change":"2024-04-26T12:30:55.090347+0000","last_active":"2024-04-26T12:30:59.077499+0000","last_peered":"2024-04-26T12:30:59.077499+0000","last_clean":"2024-04-26T12:30:59.077499+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:30:59.077499+0000","last_undegraded":"2024-04-26T12:30:59.077499+0000","last_fullsized":"2024-04-26T12:30:59.077499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:18.689900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":912,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078455+0000","last_change":"2024-04-26T12:30:57.084445+0000","last_active":"2024-04-26T12:30:59.078455+0000","last_peered":"2024-04-26T12:30:59.078455+0000","last_clean":"2024-04-26T12:30:59.078455+0000","last_became_active":"2024-04-26T12:30:57.083026+0000","last_became_peered":"2024-04-26T12:30:57.083026+0000","last_unstale":"2024-04-26T12:30:59.078455+0000","last_undegraded":"2024-04-26T12:30:59.078455+0000","last_fullsized":"2024-04-26T12:30:59.078455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:26.231571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076908+0000","last_change":"2024-04-26T12:30:51.076894+0000","last_active":"2024-04-26T12:30:59.076908+0000","last_peered":"2024-04-26T12:30:59.076908+0000","last_clean":"2024-04-26T12:30:59.076908+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:30:59.076908+0000","last_undegraded":"2024-04-26T12:30:59.076908+0000","last_fullsized":"2024-04-26T12:30:59.076908+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:50.091007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1070,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078148+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:30:59.078148+0000","last_peered":"2024-04-26T12:30:59.078148+0000","last_clean":"2024-04-26T12:30:59.078148+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:30:59.078148+0000","last_undegraded":"2024-04-26T12:30:59.078148+0000","last_fullsized":"2024-04-26T12:30:59.078148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:26.268194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":952,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077199+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:30:59.077199+0000","last_peered":"2024-04-26T12:30:59.077199+0000","last_clean":"2024-04-26T12:30:59.077199+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:30:59.077199+0000","last_undegraded":"2024-04-26T12:30:59.077199+0000","last_fullsized":"2024-04-26T12:30:59.077199+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:12.535434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":580,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077653+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:30:59.077653+0000","last_peered":"2024-04-26T12:30:59.077653+0000","last_clean":"2024-04-26T12:30:59.077653+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:30:59.077653+0000","last_undegraded":"2024-04-26T12:30:59.077653+0000","last_fullsized":"2024-04-26T12:30:59.077653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.082038+0000","last_change":"2024-04-26T12:31:00.082038+0000","last_active":"2024-04-26T12:31:00.082038+0000","last_peered":"2024-04-26T12:31:00.082038+0000","last_clean":"2024-04-26T12:31:00.082038+0000","last_became_active":"2024-04-26T12:31:00.079766+0000","last_became_peered":"2024-04-26T12:31:00.079766+0000","last_unstale":"2024-04-26T12:31:00.082038+0000","last_undegraded":"2024-04-26T12:31:00.082038+0000","last_fullsized":"2024-04-26T12:31:00.082038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:29.495060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":1017,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078556+0000","last_change":"2024-04-26T12:30:58.079466+0000","last_active":"2024-04-26T12:30:59.078556+0000","last_peered":"2024-04-26T12:30:59.078556+0000","last_clean":"2024-04-26T12:30:59.078556+0000","last_became_active":"2024-04-26T12:30:58.078211+0000","last_became_peered":"2024-04-26T12:30:58.078211+0000","last_unstale":"2024-04-26T12:30:59.078556+0000","last_undegraded":"2024-04-26T12:30:59.078556+0000","last_fullsized":"2024-04-26T12:30:59.078556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:42.746789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078438+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:30:59.078438+0000","last_peered":"2024-04-26T12:30:59.078438+0000","last_clean":"2024-04-26T12:30:59.078438+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:30:59.078438+0000","last_undegraded":"2024-04-26T12:30:59.078438+0000","last_fullsized":"2024-04-26T12:30:59.078438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":585,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077533+0000","last_change":"2024-04-26T12:30:46.089997+0000","last_active":"2024-04-26T12:30:59.077533+0000","last_peered":"2024-04-26T12:30:59.077533+0000","last_clean":"2024-04-26T12:30:59.077533+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:30:59.077533+0000","last_undegraded":"2024-04-26T12:30:59.077533+0000","last_fullsized":"2024-04-26T12:30:59.077533+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:08.843126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078301+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:30:59.078301+0000","last_peered":"2024-04-26T12:30:59.078301+0000","last_clean":"2024-04-26T12:30:59.078301+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:30:59.078301+0000","last_undegraded":"2024-04-26T12:30:59.078301+0000","last_fullsized":"2024-04-26T12:30:59.078301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077517+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:30:59.077517+0000","last_peered":"2024-04-26T12:30:59.077517+0000","last_clean":"2024-04-26T12:30:59.077517+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:30:59.077517+0000","last_undegraded":"2024-04-26T12:30:59.077517+0000","last_fullsized":"2024-04-26T12:30:59.077517+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:21.302173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078191+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:30:59.078191+0000","last_peered":"2024-04-26T12:30:59.078191+0000","last_clean":"2024-04-26T12:30:59.078191+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:30:59.078191+0000","last_undegraded":"2024-04-26T12:30:59.078191+0000","last_fullsized":"2024-04-26T12:30:59.078191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":410,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076264+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:30:59.076264+0000","last_peered":"2024-04-26T12:30:59.076264+0000","last_clean":"2024-04-26T12:30:59.076264+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:30:59.076264+0000","last_undegraded":"2024-04-26T12:30:59.076264+0000","last_fullsized":"2024-04-26T12:30:59.076264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.762427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077325+0000","last_change":"2024-04-26T12:30:58.081169+0000","last_active":"2024-04-26T12:30:59.077325+0000","last_peered":"2024-04-26T12:30:59.077325+0000","last_clean":"2024-04-26T12:30:59.077325+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:30:59.077325+0000","last_undegraded":"2024-04-26T12:30:59.077325+0000","last_fullsized":"2024-04-26T12:30:59.077325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:42.618440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"58'708","reported_seq":778,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076197+0000","last_change":"2024-04-26T12:30:44.022038+0000","last_active":"2024-04-26T12:30:59.076197+0000","last_peered":"2024-04-26T12:30:59.076197+0000","last_clean":"2024-04-26T12:30:59.076197+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:30:59.076197+0000","last_undegraded":"2024-04-26T12:30:59.076197+0000","last_fullsized":"2024-04-26T12:30:59.076197+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:30.369118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":500,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078749+0000","last_change":"2024-04-26T12:30:47.081417+0000","last_active":"2024-04-26T12:31:00.078749+0000","last_peered":"2024-04-26T12:31:00.078749+0000","last_clean":"2024-04-26T12:31:00.078749+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:31:00.078749+0000","last_undegraded":"2024-04-26T12:31:00.078749+0000","last_fullsized":"2024-04-26T12:31:00.078749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:17.628933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077196+0000","last_change":"2024-04-26T12:30:41.018067+0000","last_active":"2024-04-26T12:30:59.077196+0000","last_peered":"2024-04-26T12:30:59.077196+0000","last_clean":"2024-04-26T12:30:59.077196+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:30:59.077196+0000","last_undegraded":"2024-04-26T12:30:59.077196+0000","last_fullsized":"2024-04-26T12:30:59.077196+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:33.684743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":594,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076422+0000","last_change":"2024-04-26T12:30:58.081823+0000","last_active":"2024-04-26T12:30:59.076422+0000","last_peered":"2024-04-26T12:30:59.076422+0000","last_clean":"2024-04-26T12:30:59.076422+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:30:59.076422+0000","last_undegraded":"2024-04-26T12:30:59.076422+0000","last_fullsized":"2024-04-26T12:30:59.076422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.109302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"58'355","reported_seq":377,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078258+0000","last_change":"2024-04-26T12:30:48.086933+0000","last_active":"2024-04-26T12:30:59.078258+0000","last_peered":"2024-04-26T12:30:59.078258+0000","last_clean":"2024-04-26T12:30:59.078258+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:30:59.078258+0000","last_undegraded":"2024-04-26T12:30:59.078258+0000","last_fullsized":"2024-04-26T12:30:59.078258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:49.737283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":720,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076317+0000","last_change":"2024-04-26T12:30:46.034642+0000","last_active":"2024-04-26T12:30:59.076317+0000","last_peered":"2024-04-26T12:30:59.076317+0000","last_clean":"2024-04-26T12:30:59.076317+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:30:59.076317+0000","last_undegraded":"2024-04-26T12:30:59.076317+0000","last_fullsized":"2024-04-26T12:30:59.076317+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.961343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077954+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:30:59.077954+0000","last_peered":"2024-04-26T12:30:59.077954+0000","last_clean":"2024-04-26T12:30:59.077954+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:30:59.077954+0000","last_undegraded":"2024-04-26T12:30:59.077954+0000","last_fullsized":"2024-04-26T12:30:59.077954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076500+0000","last_change":"2024-04-26T12:30:45.022716+0000","last_active":"2024-04-26T12:30:59.076500+0000","last_peered":"2024-04-26T12:30:59.076500+0000","last_clean":"2024-04-26T12:30:59.076500+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:30:59.076500+0000","last_undegraded":"2024-04-26T12:30:59.076500+0000","last_fullsized":"2024-04-26T12:30:59.076500+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:01.269901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'374","reported_seq":439,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078040+0000","last_change":"2024-04-26T12:30:46.079618+0000","last_active":"2024-04-26T12:30:59.078040+0000","last_peered":"2024-04-26T12:30:59.078040+0000","last_clean":"2024-04-26T12:30:59.078040+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:30:59.078040+0000","last_undegraded":"2024-04-26T12:30:59.078040+0000","last_fullsized":"2024-04-26T12:30:59.078040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:48.209628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":506,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077751+0000","last_change":"2024-04-26T12:30:47.082596+0000","last_active":"2024-04-26T12:30:59.077751+0000","last_peered":"2024-04-26T12:30:59.077751+0000","last_clean":"2024-04-26T12:30:59.077751+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:30:59.077751+0000","last_undegraded":"2024-04-26T12:30:59.077751+0000","last_fullsized":"2024-04-26T12:30:59.077751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:34.688913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":648,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077638+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:30:59.077638+0000","last_peered":"2024-04-26T12:30:59.077638+0000","last_clean":"2024-04-26T12:30:59.077638+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:30:59.077638+0000","last_undegraded":"2024-04-26T12:30:59.077638+0000","last_fullsized":"2024-04-26T12:30:59.077638+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:50.674218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":794,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078066+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:30:59.078066+0000","last_peered":"2024-04-26T12:30:59.078066+0000","last_clean":"2024-04-26T12:30:59.078066+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:30:59.078066+0000","last_undegraded":"2024-04-26T12:30:59.078066+0000","last_fullsized":"2024-04-26T12:30:59.078066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:11.548975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076400+0000","last_change":"2024-04-26T12:30:46.089052+0000","last_active":"2024-04-26T12:30:59.076400+0000","last_peered":"2024-04-26T12:30:59.076400+0000","last_clean":"2024-04-26T12:30:59.076400+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:30:59.076400+0000","last_undegraded":"2024-04-26T12:30:59.076400+0000","last_fullsized":"2024-04-26T12:30:59.076400+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:28.433853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":860,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078103+0000","last_change":"2024-04-26T12:30:50.086492+0000","last_active":"2024-04-26T12:30:59.078103+0000","last_peered":"2024-04-26T12:30:59.078103+0000","last_clean":"2024-04-26T12:30:59.078103+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:30:59.078103+0000","last_undegraded":"2024-04-26T12:30:59.078103+0000","last_fullsized":"2024-04-26T12:30:59.078103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:18.705037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077626+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:30:59.077626+0000","last_peered":"2024-04-26T12:30:59.077626+0000","last_clean":"2024-04-26T12:30:59.077626+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:30:59.077626+0000","last_undegraded":"2024-04-26T12:30:59.077626+0000","last_fullsized":"2024-04-26T12:30:59.077626+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":500,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.086763+0000","last_change":"2024-04-26T12:30:59.083411+0000","last_active":"2024-04-26T12:30:59.086763+0000","last_peered":"2024-04-26T12:30:59.086763+0000","last_clean":"2024-04-26T12:30:59.086763+0000","last_became_active":"2024-04-26T12:30:59.081424+0000","last_became_peered":"2024-04-26T12:30:59.081424+0000","last_unstale":"2024-04-26T12:30:59.086763+0000","last_undegraded":"2024-04-26T12:30:59.086763+0000","last_fullsized":"2024-04-26T12:30:59.086763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:09.181871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'54","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077588+0000","last_change":"2024-04-26T12:30:46.082166+0000","last_active":"2024-04-26T12:30:59.077588+0000","last_peered":"2024-04-26T12:30:59.077588+0000","last_clean":"2024-04-26T12:30:59.077588+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:30:59.077588+0000","last_undegraded":"2024-04-26T12:30:59.077588+0000","last_fullsized":"2024-04-26T12:30:59.077588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:28.037535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":538,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.089343+0000","last_change":"2024-04-26T12:30:59.084548+0000","last_active":"2024-04-26T12:30:59.089343+0000","last_peered":"2024-04-26T12:30:59.089343+0000","last_clean":"2024-04-26T12:30:59.089343+0000","last_became_active":"2024-04-26T12:30:59.081463+0000","last_became_peered":"2024-04-26T12:30:59.081463+0000","last_unstale":"2024-04-26T12:30:59.089343+0000","last_undegraded":"2024-04-26T12:30:59.089343+0000","last_fullsized":"2024-04-26T12:30:59.089343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:51.815050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'186","reported_seq":209,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078288+0000","last_change":"2024-04-26T12:30:46.080074+0000","last_active":"2024-04-26T12:30:59.078288+0000","last_peered":"2024-04-26T12:30:59.078288+0000","last_clean":"2024-04-26T12:30:59.078288+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:30:59.078288+0000","last_undegraded":"2024-04-26T12:30:59.078288+0000","last_fullsized":"2024-04-26T12:30:59.078288+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:24.562647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":531,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077193+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:30:59.077193+0000","last_peered":"2024-04-26T12:30:59.077193+0000","last_clean":"2024-04-26T12:30:59.077193+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:30:59.077193+0000","last_undegraded":"2024-04-26T12:30:59.077193+0000","last_fullsized":"2024-04-26T12:30:59.077193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078244+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:30:59.078244+0000","last_peered":"2024-04-26T12:30:59.078244+0000","last_clean":"2024-04-26T12:30:59.078244+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:30:59.078244+0000","last_undegraded":"2024-04-26T12:30:59.078244+0000","last_fullsized":"2024-04-26T12:30:59.078244+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:40.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":976,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077821+0000","last_change":"2024-04-26T12:30:52.078990+0000","last_active":"2024-04-26T12:30:59.077821+0000","last_peered":"2024-04-26T12:30:59.077821+0000","last_clean":"2024-04-26T12:30:59.077821+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:30:59.077821+0000","last_undegraded":"2024-04-26T12:30:59.077821+0000","last_fullsized":"2024-04-26T12:30:59.077821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.697122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":514,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078332+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:30:59.078332+0000","last_peered":"2024-04-26T12:30:59.078332+0000","last_clean":"2024-04-26T12:30:59.078332+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:30:59.078332+0000","last_undegraded":"2024-04-26T12:30:59.078332+0000","last_fullsized":"2024-04-26T12:30:59.078332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:18.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077374+0000","last_change":"2024-04-26T12:30:48.089200+0000","last_active":"2024-04-26T12:30:59.077374+0000","last_peered":"2024-04-26T12:30:59.077374+0000","last_clean":"2024-04-26T12:30:59.077374+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:30:59.077374+0000","last_undegraded":"2024-04-26T12:30:59.077374+0000","last_fullsized":"2024-04-26T12:30:59.077374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:04.588329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077619+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:59.077619+0000","last_peered":"2024-04-26T12:30:59.077619+0000","last_clean":"2024-04-26T12:30:59.077619+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:30:59.077619+0000","last_undegraded":"2024-04-26T12:30:59.077619+0000","last_fullsized":"2024-04-26T12:30:59.077619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:40.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":559,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076624+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:30:59.076624+0000","last_peered":"2024-04-26T12:30:59.076624+0000","last_clean":"2024-04-26T12:30:59.076624+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:30:59.076624+0000","last_undegraded":"2024-04-26T12:30:59.076624+0000","last_fullsized":"2024-04-26T12:30:59.076624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.230823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":252,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076455+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:30:59.076455+0000","last_peered":"2024-04-26T12:30:59.076455+0000","last_clean":"2024-04-26T12:30:59.076455+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:30:59.076455+0000","last_undegraded":"2024-04-26T12:30:59.076455+0000","last_fullsized":"2024-04-26T12:30:59.076455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:30.864621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":537,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077889+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:30:59.077889+0000","last_peered":"2024-04-26T12:30:59.077889+0000","last_clean":"2024-04-26T12:30:59.077889+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:30:59.077889+0000","last_undegraded":"2024-04-26T12:30:59.077889+0000","last_fullsized":"2024-04-26T12:30:59.077889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:13.427584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":268,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077250+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:30:59.077250+0000","last_peered":"2024-04-26T12:30:59.077250+0000","last_clean":"2024-04-26T12:30:59.077250+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:30:59.077250+0000","last_undegraded":"2024-04-26T12:30:59.077250+0000","last_fullsized":"2024-04-26T12:30:59.077250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:16.260550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078751+0000","last_change":"2024-04-26T12:30:47.083054+0000","last_active":"2024-04-26T12:30:59.078751+0000","last_peered":"2024-04-26T12:30:59.078751+0000","last_clean":"2024-04-26T12:30:59.078751+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:30:59.078751+0000","last_undegraded":"2024-04-26T12:30:59.078751+0000","last_fullsized":"2024-04-26T12:30:59.078751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.645638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":162,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077348+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:30:59.077348+0000","last_peered":"2024-04-26T12:30:59.077348+0000","last_clean":"2024-04-26T12:30:59.077348+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:30:59.077348+0000","last_undegraded":"2024-04-26T12:30:59.077348+0000","last_fullsized":"2024-04-26T12:30:59.077348+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:20.988072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":492,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078566+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:30:59.078566+0000","last_peered":"2024-04-26T12:30:59.078566+0000","last_clean":"2024-04-26T12:30:59.078566+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:30:59.078566+0000","last_undegraded":"2024-04-26T12:30:59.078566+0000","last_fullsized":"2024-04-26T12:30:59.078566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":588,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078399+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:30:59.078399+0000","last_peered":"2024-04-26T12:30:59.078399+0000","last_clean":"2024-04-26T12:30:59.078399+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:30:59.078399+0000","last_undegraded":"2024-04-26T12:30:59.078399+0000","last_fullsized":"2024-04-26T12:30:59.078399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:25.266771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077354+0000","last_change":"2024-04-26T12:30:55.090354+0000","last_active":"2024-04-26T12:30:59.077354+0000","last_peered":"2024-04-26T12:30:59.077354+0000","last_clean":"2024-04-26T12:30:59.077354+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:30:59.077354+0000","last_undegraded":"2024-04-26T12:30:59.077354+0000","last_fullsized":"2024-04-26T12:30:59.077354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:14.455369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076944+0000","last_change":"2024-04-26T12:30:41.026049+0000","last_active":"2024-04-26T12:30:59.076944+0000","last_peered":"2024-04-26T12:30:59.076944+0000","last_clean":"2024-04-26T12:30:59.076944+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:30:59.076944+0000","last_undegraded":"2024-04-26T12:30:59.076944+0000","last_fullsized":"2024-04-26T12:30:59.076944+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.409817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"58'454","reported_seq":480,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078638+0000","last_change":"2024-04-26T12:30:46.079367+0000","last_active":"2024-04-26T12:30:59.078638+0000","last_peered":"2024-04-26T12:30:59.078638+0000","last_clean":"2024-04-26T12:30:59.078638+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:30:59.078638+0000","last_undegraded":"2024-04-26T12:30:59.078638+0000","last_fullsized":"2024-04-26T12:30:59.078638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:00.950370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":473,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078369+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:31:00.078369+0000","last_peered":"2024-04-26T12:31:00.078369+0000","last_clean":"2024-04-26T12:31:00.078369+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:31:00.078369+0000","last_undegraded":"2024-04-26T12:31:00.078369+0000","last_fullsized":"2024-04-26T12:31:00.078369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078680+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:31:00.078680+0000","last_peered":"2024-04-26T12:31:00.078680+0000","last_clean":"2024-04-26T12:31:00.078680+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:31:00.078680+0000","last_undegraded":"2024-04-26T12:31:00.078680+0000","last_fullsized":"2024-04-26T12:31:00.078680+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:16.686041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078300+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:00.078300+0000","last_peered":"2024-04-26T12:31:00.078300+0000","last_clean":"2024-04-26T12:31:00.078300+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:31:00.078300+0000","last_undegraded":"2024-04-26T12:31:00.078300+0000","last_fullsized":"2024-04-26T12:31:00.078300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:18.069937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076887+0000","last_change":"2024-04-26T12:30:46.033999+0000","last_active":"2024-04-26T12:30:59.076887+0000","last_peered":"2024-04-26T12:30:59.076887+0000","last_clean":"2024-04-26T12:30:59.076887+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:30:59.076887+0000","last_undegraded":"2024-04-26T12:30:59.076887+0000","last_fullsized":"2024-04-26T12:30:59.076887+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:33.235467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076629+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:30:59.076629+0000","last_peered":"2024-04-26T12:30:59.076629+0000","last_clean":"2024-04-26T12:30:59.076629+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:30:59.076629+0000","last_undegraded":"2024-04-26T12:30:59.076629+0000","last_fullsized":"2024-04-26T12:30:59.076629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:20.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":398,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077980+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:30:59.077980+0000","last_peered":"2024-04-26T12:30:59.077980+0000","last_clean":"2024-04-26T12:30:59.077980+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:30:59.077980+0000","last_undegraded":"2024-04-26T12:30:59.077980+0000","last_fullsized":"2024-04-26T12:30:59.077980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":432,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077237+0000","last_change":"2024-04-26T12:30:54.081099+0000","last_active":"2024-04-26T12:30:59.077237+0000","last_peered":"2024-04-26T12:30:59.077237+0000","last_clean":"2024-04-26T12:30:59.077237+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:30:59.077237+0000","last_undegraded":"2024-04-26T12:30:59.077237+0000","last_fullsized":"2024-04-26T12:30:59.077237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:29.507250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077511+0000","last_change":"2024-04-26T12:30:46.082961+0000","last_active":"2024-04-26T12:30:59.077511+0000","last_peered":"2024-04-26T12:30:59.077511+0000","last_clean":"2024-04-26T12:30:59.077511+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:30:59.077511+0000","last_undegraded":"2024-04-26T12:30:59.077511+0000","last_fullsized":"2024-04-26T12:30:59.077511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:10.764587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":263,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077256+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:30:59.077256+0000","last_peered":"2024-04-26T12:30:59.077256+0000","last_clean":"2024-04-26T12:30:59.077256+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:30:59.077256+0000","last_undegraded":"2024-04-26T12:30:59.077256+0000","last_fullsized":"2024-04-26T12:30:59.077256+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:23.542209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":598,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076589+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:30:59.076589+0000","last_peered":"2024-04-26T12:30:59.076589+0000","last_clean":"2024-04-26T12:30:59.076589+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:30:59.076589+0000","last_undegraded":"2024-04-26T12:30:59.076589+0000","last_fullsized":"2024-04-26T12:30:59.076589+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:05.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":565,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078891+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:31:00.078891+0000","last_peered":"2024-04-26T12:31:00.078891+0000","last_clean":"2024-04-26T12:31:00.078891+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:31:00.078891+0000","last_undegraded":"2024-04-26T12:31:00.078891+0000","last_fullsized":"2024-04-26T12:31:00.078891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077378+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:30:59.077378+0000","last_peered":"2024-04-26T12:30:59.077378+0000","last_clean":"2024-04-26T12:30:59.077378+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:30:59.077378+0000","last_undegraded":"2024-04-26T12:30:59.077378+0000","last_fullsized":"2024-04-26T12:30:59.077378+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'105","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077011+0000","last_change":"2024-04-26T12:30:44.028851+0000","last_active":"2024-04-26T12:30:59.077011+0000","last_peered":"2024-04-26T12:30:59.077011+0000","last_clean":"2024-04-26T12:30:59.077011+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:30:59.077011+0000","last_undegraded":"2024-04-26T12:30:59.077011+0000","last_fullsized":"2024-04-26T12:30:59.077011+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:13.939165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078426+0000","last_change":"2024-04-26T12:30:57.078892+0000","last_active":"2024-04-26T12:30:59.078426+0000","last_peered":"2024-04-26T12:30:59.078426+0000","last_clean":"2024-04-26T12:30:59.078426+0000","last_became_active":"2024-04-26T12:30:57.077779+0000","last_became_peered":"2024-04-26T12:30:57.077779+0000","last_unstale":"2024-04-26T12:30:59.078426+0000","last_undegraded":"2024-04-26T12:30:59.078426+0000","last_fullsized":"2024-04-26T12:30:59.078426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:07.812506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078778+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:31:00.078778+0000","last_peered":"2024-04-26T12:31:00.078778+0000","last_clean":"2024-04-26T12:31:00.078778+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:31:00.078778+0000","last_undegraded":"2024-04-26T12:31:00.078778+0000","last_fullsized":"2024-04-26T12:31:00.078778+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:31.181549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077119+0000","last_change":"2024-04-26T12:30:41.026137+0000","last_active":"2024-04-26T12:30:59.077119+0000","last_peered":"2024-04-26T12:30:59.077119+0000","last_clean":"2024-04-26T12:30:59.077119+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:30:59.077119+0000","last_undegraded":"2024-04-26T12:30:59.077119+0000","last_fullsized":"2024-04-26T12:30:59.077119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:08.225745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":520,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077810+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:31:00.077810+0000","last_peered":"2024-04-26T12:31:00.077810+0000","last_clean":"2024-04-26T12:31:00.077810+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:31:00.077810+0000","last_undegraded":"2024-04-26T12:31:00.077810+0000","last_fullsized":"2024-04-26T12:31:00.077810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077074+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:30:59.077074+0000","last_peered":"2024-04-26T12:30:59.077074+0000","last_clean":"2024-04-26T12:30:59.077074+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:30:59.077074+0000","last_undegraded":"2024-04-26T12:30:59.077074+0000","last_fullsized":"2024-04-26T12:30:59.077074+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:51.609322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076973+0000","last_change":"2024-04-26T12:30:41.030157+0000","last_active":"2024-04-26T12:30:59.076973+0000","last_peered":"2024-04-26T12:30:59.076973+0000","last_clean":"2024-04-26T12:30:59.076973+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:59.076973+0000","last_undegraded":"2024-04-26T12:30:59.076973+0000","last_fullsized":"2024-04-26T12:30:59.076973+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:32.867679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":500,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.081711+0000","last_change":"2024-04-26T12:31:00.081711+0000","last_active":"2024-04-26T12:31:00.081711+0000","last_peered":"2024-04-26T12:31:00.081711+0000","last_clean":"2024-04-26T12:31:00.081711+0000","last_became_active":"2024-04-26T12:31:00.079504+0000","last_became_peered":"2024-04-26T12:31:00.079504+0000","last_unstale":"2024-04-26T12:31:00.081711+0000","last_undegraded":"2024-04-26T12:31:00.081711+0000","last_fullsized":"2024-04-26T12:31:00.081711+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:17.125482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078428+0000","last_change":"2024-04-26T12:30:46.080509+0000","last_active":"2024-04-26T12:30:59.078428+0000","last_peered":"2024-04-26T12:30:59.078428+0000","last_clean":"2024-04-26T12:30:59.078428+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:30:59.078428+0000","last_undegraded":"2024-04-26T12:30:59.078428+0000","last_fullsized":"2024-04-26T12:30:59.078428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:40.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'82","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077350+0000","last_change":"2024-04-26T12:30:46.086027+0000","last_active":"2024-04-26T12:30:59.077350+0000","last_peered":"2024-04-26T12:30:59.077350+0000","last_clean":"2024-04-26T12:30:59.077350+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:30:59.077350+0000","last_undegraded":"2024-04-26T12:30:59.077350+0000","last_fullsized":"2024-04-26T12:30:59.077350+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:13.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":606,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077942+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:31:00.077942+0000","last_peered":"2024-04-26T12:31:00.077942+0000","last_clean":"2024-04-26T12:31:00.077942+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:31:00.077942+0000","last_undegraded":"2024-04-26T12:31:00.077942+0000","last_fullsized":"2024-04-26T12:31:00.077942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077612+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:30:59.077612+0000","last_peered":"2024-04-26T12:30:59.077612+0000","last_clean":"2024-04-26T12:30:59.077612+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:30:59.077612+0000","last_undegraded":"2024-04-26T12:30:59.077612+0000","last_fullsized":"2024-04-26T12:30:59.077612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.312112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":855,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078064+0000","last_change":"2024-04-26T12:30:53.079043+0000","last_active":"2024-04-26T12:30:59.078064+0000","last_peered":"2024-04-26T12:30:59.078064+0000","last_clean":"2024-04-26T12:30:59.078064+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:30:59.078064+0000","last_undegraded":"2024-04-26T12:30:59.078064+0000","last_fullsized":"2024-04-26T12:30:59.078064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:00.091756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":311,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078038+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:30:59.078038+0000","last_peered":"2024-04-26T12:30:59.078038+0000","last_clean":"2024-04-26T12:30:59.078038+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:30:59.078038+0000","last_undegraded":"2024-04-26T12:30:59.078038+0000","last_fullsized":"2024-04-26T12:30:59.078038+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:43.044883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":798,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077365+0000","last_change":"2024-04-26T12:30:48.088039+0000","last_active":"2024-04-26T12:30:59.077365+0000","last_peered":"2024-04-26T12:30:59.077365+0000","last_clean":"2024-04-26T12:30:59.077365+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:30:59.077365+0000","last_undegraded":"2024-04-26T12:30:59.077365+0000","last_fullsized":"2024-04-26T12:30:59.077365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:03.967118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"58'314","reported_seq":395,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077986+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:30:59.077986+0000","last_peered":"2024-04-26T12:30:59.077986+0000","last_clean":"2024-04-26T12:30:59.077986+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:30:59.077986+0000","last_undegraded":"2024-04-26T12:30:59.077986+0000","last_fullsized":"2024-04-26T12:30:59.077986+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":872,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077302+0000","last_change":"2024-04-26T12:30:52.079092+0000","last_active":"2024-04-26T12:30:59.077302+0000","last_peered":"2024-04-26T12:30:59.077302+0000","last_clean":"2024-04-26T12:30:59.077302+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:30:59.077302+0000","last_undegraded":"2024-04-26T12:30:59.077302+0000","last_fullsized":"2024-04-26T12:30:59.077302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:10.253347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"58'76","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077223+0000","last_change":"2024-04-26T12:30:41.050653+0000","last_active":"2024-04-26T12:30:59.077223+0000","last_peered":"2024-04-26T12:30:59.077223+0000","last_clean":"2024-04-26T12:30:59.077223+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:59.077223+0000","last_undegraded":"2024-04-26T12:30:59.077223+0000","last_fullsized":"2024-04-26T12:30:59.077223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:17.874875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":542,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076883+0000","last_change":"2024-04-26T12:28:00.707724+0000","last_active":"2024-04-26T12:30:59.076883+0000","last_peered":"2024-04-26T12:30:59.076883+0000","last_clean":"2024-04-26T12:30:59.076883+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:30:59.076883+0000","last_undegraded":"2024-04-26T12:30:59.076883+0000","last_fullsized":"2024-04-26T12:30:59.076883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:20.384961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077310+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:30:59.077310+0000","last_peered":"2024-04-26T12:30:59.077310+0000","last_clean":"2024-04-26T12:30:59.077310+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:30:59.077310+0000","last_undegraded":"2024-04-26T12:30:59.077310+0000","last_fullsized":"2024-04-26T12:30:59.077310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:40.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077689+0000","last_change":"2024-04-26T12:30:51.076207+0000","last_active":"2024-04-26T12:30:59.077689+0000","last_peered":"2024-04-26T12:30:59.077689+0000","last_clean":"2024-04-26T12:30:59.077689+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:30:59.077689+0000","last_undegraded":"2024-04-26T12:30:59.077689+0000","last_fullsized":"2024-04-26T12:30:59.077689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:05.869282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":863,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077482+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:30:59.077482+0000","last_peered":"2024-04-26T12:30:59.077482+0000","last_clean":"2024-04-26T12:30:59.077482+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:30:59.077482+0000","last_undegraded":"2024-04-26T12:30:59.077482+0000","last_fullsized":"2024-04-26T12:30:59.077482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:50.433671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076889+0000","last_change":"2024-04-26T12:30:54.080153+0000","last_active":"2024-04-26T12:30:59.076889+0000","last_peered":"2024-04-26T12:30:59.076889+0000","last_clean":"2024-04-26T12:30:59.076889+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:30:59.076889+0000","last_undegraded":"2024-04-26T12:30:59.076889+0000","last_fullsized":"2024-04-26T12:30:59.076889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:48.057283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":629,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078217+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:31:00.078217+0000","last_peered":"2024-04-26T12:31:00.078217+0000","last_clean":"2024-04-26T12:31:00.078217+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:31:00.078217+0000","last_undegraded":"2024-04-26T12:31:00.078217+0000","last_fullsized":"2024-04-26T12:31:00.078217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":515,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076733+0000","last_change":"2024-04-26T12:30:50.086765+0000","last_active":"2024-04-26T12:30:59.076733+0000","last_peered":"2024-04-26T12:30:59.076733+0000","last_clean":"2024-04-26T12:30:59.076733+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:30:59.076733+0000","last_undegraded":"2024-04-26T12:30:59.076733+0000","last_fullsized":"2024-04-26T12:30:59.076733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:36.313767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078165+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:30:59.078165+0000","last_peered":"2024-04-26T12:30:59.078165+0000","last_clean":"2024-04-26T12:30:59.078165+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:30:59.078165+0000","last_undegraded":"2024-04-26T12:30:59.078165+0000","last_fullsized":"2024-04-26T12:30:59.078165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79134720,"data_stored":256449018,"data_compressed":38844374,"data_compressed_allocated":48693248,"data_compressed_original":226074624,"omap_allocated":5343,"internal_metadata":0},"log_size":7508,"ondisk_log_size":7508,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738424,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130116,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94241724,"statfs":{"total":96636764160,"available":96503525376,"internally_reserved":0,"allocated":31711232,"data_stored":85785287,"data_compressed":12062822,"data_compressed_allocated":15765504,"data_compressed_original":70336512,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.23599999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.54500000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131340,"kb_used_data":32188,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94240500,"statfs":{"total":96636764160,"available":96502272000,"internally_reserved":0,"allocated":32960512,"data_stored":91451171,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:30:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.30399999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.625,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.53300000000000003}]}]},{"osd":1,"up_from":64,"seq":274877906952,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62340,"kb_used_data":16760,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309500,"statfs":{"total":96636764160,"available":96572928000,"internally_reserved":0,"allocated":17162240,"data_stored":81548386,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30789632,"data_stored":84809889,"data_compressed":12028675,"data_compressed_allocated":15720448,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:10.233 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:31:10.611 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:31:10.611 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":85,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:31:00.074154+0000","last_up_change":"2024-04-26T12:30:39.998401+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:26:51.091400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:26:52.222159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":29,"up_from":64,"up_thru":84,"down_at":30,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":6156},{"type":"v1","addr":"172.21.15.136:6801","nonce":6156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":6156},{"type":"v1","addr":"172.21.15.136:6803","nonce":6156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":6156},{"type":"v1","addr":"172.21.15.136:6807","nonce":6156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":6156},{"type":"v1","addr":"172.21.15.136:6805","nonce":6156}]},"public_addr":"172.21.15.136:6801/6156","cluster_addr":"172.21.15.136:6803/6156","heartbeat_back_addr":"172.21.15.136:6807/6156","heartbeat_front_addr":"172.21.15.136:6805/6156","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":29},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.19","osds":[0,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:31:11.627 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T12:31:11.627 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:31:11.793 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-04-26T12:31:11.794 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:31:11.794 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-04-26T12:31:11.806 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T12:31:12.152 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T12:31:12.163 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T12:31:12.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:31:12.315 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-04-26T12:31:12.315 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-26T12:31:12.315 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-04-26T12:31:12.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T12:31:12.670 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T12:31:12.680 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T12:31:12.681 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:31:12.832 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-04-26T12:31:12.832 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:31:12.833 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-04-26T12:31:12.845 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T12:31:13.186 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T12:31:13.198 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:13.543 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:31:13.544 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:31:13.555 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-04-26T12:31:13.361564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6546,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34345,"ondisk_log_size":34345,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":323796,"kb_used_data":79916,"kb_used_omap":9,"kb_used_meta":243830,"kb_avail":282791724,"statfs":{"total":289910292480,"available":289578725376,"internally_reserved":0,"allocated":81833984,"data_stored":258784844,"data_compressed":38912668,"data_compressed_allocated":48783360,"data_compressed_original":227221504,"omap_allocated":10125,"internal_metadata":249682035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-363,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002543"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":901,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078865+0000","last_change":"2024-04-26T12:30:54.081113+0000","last_active":"2024-04-26T12:31:00.078865+0000","last_peered":"2024-04-26T12:31:00.078865+0000","last_clean":"2024-04-26T12:31:00.078865+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:31:00.078865+0000","last_undegraded":"2024-04-26T12:31:00.078865+0000","last_fullsized":"2024-04-26T12:31:00.078865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.062347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":957,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078333+0000","last_change":"2024-04-26T12:30:56.085870+0000","last_active":"2024-04-26T12:31:00.078333+0000","last_peered":"2024-04-26T12:31:00.078333+0000","last_clean":"2024-04-26T12:31:00.078333+0000","last_became_active":"2024-04-26T12:30:56.084642+0000","last_became_peered":"2024-04-26T12:30:56.084642+0000","last_unstale":"2024-04-26T12:31:00.078333+0000","last_undegraded":"2024-04-26T12:31:00.078333+0000","last_fullsized":"2024-04-26T12:31:00.078333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:41.346086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":495,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078491+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:30:59.078491+0000","last_peered":"2024-04-26T12:30:59.078491+0000","last_clean":"2024-04-26T12:30:59.078491+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:30:59.078491+0000","last_undegraded":"2024-04-26T12:30:59.078491+0000","last_fullsized":"2024-04-26T12:30:59.078491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:55.616144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":867,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078158+0000","last_change":"2024-04-26T12:30:48.089842+0000","last_active":"2024-04-26T12:30:59.078158+0000","last_peered":"2024-04-26T12:30:59.078158+0000","last_clean":"2024-04-26T12:30:59.078158+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:30:59.078158+0000","last_undegraded":"2024-04-26T12:30:59.078158+0000","last_fullsized":"2024-04-26T12:30:59.078158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:13.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":939,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077433+0000","last_change":"2024-04-26T12:30:48.089460+0000","last_active":"2024-04-26T12:30:59.077433+0000","last_peered":"2024-04-26T12:30:59.077433+0000","last_clean":"2024-04-26T12:30:59.077433+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:30:59.077433+0000","last_undegraded":"2024-04-26T12:30:59.077433+0000","last_fullsized":"2024-04-26T12:30:59.077433+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:34:29.911599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077152+0000","last_change":"2024-04-26T12:30:48.090606+0000","last_active":"2024-04-26T12:30:59.077152+0000","last_peered":"2024-04-26T12:30:59.077152+0000","last_clean":"2024-04-26T12:30:59.077152+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:30:59.077152+0000","last_undegraded":"2024-04-26T12:30:59.077152+0000","last_fullsized":"2024-04-26T12:30:59.077152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:57.446858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1028,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077423+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:30:59.077423+0000","last_peered":"2024-04-26T12:30:59.077423+0000","last_clean":"2024-04-26T12:30:59.077423+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:30:59.077423+0000","last_undegraded":"2024-04-26T12:30:59.077423+0000","last_fullsized":"2024-04-26T12:30:59.077423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:06.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":767,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076901+0000","last_change":"2024-04-26T12:30:49.082511+0000","last_active":"2024-04-26T12:30:59.076901+0000","last_peered":"2024-04-26T12:30:59.076901+0000","last_clean":"2024-04-26T12:30:59.076901+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:30:59.076901+0000","last_undegraded":"2024-04-26T12:30:59.076901+0000","last_fullsized":"2024-04-26T12:30:59.076901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:54.832086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077579+0000","last_change":"2024-04-26T12:30:56.079114+0000","last_active":"2024-04-26T12:30:59.077579+0000","last_peered":"2024-04-26T12:30:59.077579+0000","last_clean":"2024-04-26T12:30:59.077579+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:30:59.077579+0000","last_undegraded":"2024-04-26T12:30:59.077579+0000","last_fullsized":"2024-04-26T12:30:59.077579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:37.907357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":911,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078367+0000","last_change":"2024-04-26T12:30:56.087672+0000","last_active":"2024-04-26T12:30:59.078367+0000","last_peered":"2024-04-26T12:30:59.078367+0000","last_clean":"2024-04-26T12:30:59.078367+0000","last_became_active":"2024-04-26T12:30:56.085904+0000","last_became_peered":"2024-04-26T12:30:56.085904+0000","last_unstale":"2024-04-26T12:30:59.078367+0000","last_undegraded":"2024-04-26T12:30:59.078367+0000","last_fullsized":"2024-04-26T12:30:59.078367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:53.993298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":594,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078178+0000","last_change":"2024-04-26T12:30:50.085026+0000","last_active":"2024-04-26T12:30:59.078178+0000","last_peered":"2024-04-26T12:30:59.078178+0000","last_clean":"2024-04-26T12:30:59.078178+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:30:59.078178+0000","last_undegraded":"2024-04-26T12:30:59.078178+0000","last_fullsized":"2024-04-26T12:30:59.078178+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:31.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":512,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077591+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:30:59.077591+0000","last_peered":"2024-04-26T12:30:59.077591+0000","last_clean":"2024-04-26T12:30:59.077591+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:30:59.077591+0000","last_undegraded":"2024-04-26T12:30:59.077591+0000","last_fullsized":"2024-04-26T12:30:59.077591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:42.744715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":883,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077635+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:30:59.077635+0000","last_peered":"2024-04-26T12:30:59.077635+0000","last_clean":"2024-04-26T12:30:59.077635+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:30:59.077635+0000","last_undegraded":"2024-04-26T12:30:59.077635+0000","last_fullsized":"2024-04-26T12:30:59.077635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:00.467106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":520,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077571+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:30:59.077571+0000","last_peered":"2024-04-26T12:30:59.077571+0000","last_clean":"2024-04-26T12:30:59.077571+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:30:59.077571+0000","last_undegraded":"2024-04-26T12:30:59.077571+0000","last_fullsized":"2024-04-26T12:30:59.077571+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":540,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077003+0000","last_change":"2024-04-26T12:30:47.080645+0000","last_active":"2024-04-26T12:30:59.077003+0000","last_peered":"2024-04-26T12:30:59.077003+0000","last_clean":"2024-04-26T12:30:59.077003+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:30:59.077003+0000","last_undegraded":"2024-04-26T12:30:59.077003+0000","last_fullsized":"2024-04-26T12:30:59.077003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:11.047331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":926,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077140+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:30:59.077140+0000","last_peered":"2024-04-26T12:30:59.077140+0000","last_clean":"2024-04-26T12:30:59.077140+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:30:59.077140+0000","last_undegraded":"2024-04-26T12:30:59.077140+0000","last_fullsized":"2024-04-26T12:30:59.077140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:18.459711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":493,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077499+0000","last_change":"2024-04-26T12:30:55.090347+0000","last_active":"2024-04-26T12:30:59.077499+0000","last_peered":"2024-04-26T12:30:59.077499+0000","last_clean":"2024-04-26T12:30:59.077499+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:30:59.077499+0000","last_undegraded":"2024-04-26T12:30:59.077499+0000","last_fullsized":"2024-04-26T12:30:59.077499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:18.689900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":912,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078455+0000","last_change":"2024-04-26T12:30:57.084445+0000","last_active":"2024-04-26T12:30:59.078455+0000","last_peered":"2024-04-26T12:30:59.078455+0000","last_clean":"2024-04-26T12:30:59.078455+0000","last_became_active":"2024-04-26T12:30:57.083026+0000","last_became_peered":"2024-04-26T12:30:57.083026+0000","last_unstale":"2024-04-26T12:30:59.078455+0000","last_undegraded":"2024-04-26T12:30:59.078455+0000","last_fullsized":"2024-04-26T12:30:59.078455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:26.231571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076908+0000","last_change":"2024-04-26T12:30:51.076894+0000","last_active":"2024-04-26T12:30:59.076908+0000","last_peered":"2024-04-26T12:30:59.076908+0000","last_clean":"2024-04-26T12:30:59.076908+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:30:59.076908+0000","last_undegraded":"2024-04-26T12:30:59.076908+0000","last_fullsized":"2024-04-26T12:30:59.076908+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:50.091007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1070,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078148+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:30:59.078148+0000","last_peered":"2024-04-26T12:30:59.078148+0000","last_clean":"2024-04-26T12:30:59.078148+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:30:59.078148+0000","last_undegraded":"2024-04-26T12:30:59.078148+0000","last_fullsized":"2024-04-26T12:30:59.078148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:26.268194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":952,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077199+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:30:59.077199+0000","last_peered":"2024-04-26T12:30:59.077199+0000","last_clean":"2024-04-26T12:30:59.077199+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:30:59.077199+0000","last_undegraded":"2024-04-26T12:30:59.077199+0000","last_fullsized":"2024-04-26T12:30:59.077199+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:12.535434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":580,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077653+0000","last_change":"2024-04-26T12:26:53.260465+0000","last_active":"2024-04-26T12:30:59.077653+0000","last_peered":"2024-04-26T12:30:59.077653+0000","last_clean":"2024-04-26T12:30:59.077653+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:30:59.077653+0000","last_undegraded":"2024-04-26T12:30:59.077653+0000","last_fullsized":"2024-04-26T12:30:59.077653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:51.068495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.082038+0000","last_change":"2024-04-26T12:31:00.082038+0000","last_active":"2024-04-26T12:31:00.082038+0000","last_peered":"2024-04-26T12:31:00.082038+0000","last_clean":"2024-04-26T12:31:00.082038+0000","last_became_active":"2024-04-26T12:31:00.079766+0000","last_became_peered":"2024-04-26T12:31:00.079766+0000","last_unstale":"2024-04-26T12:31:00.082038+0000","last_undegraded":"2024-04-26T12:31:00.082038+0000","last_fullsized":"2024-04-26T12:31:00.082038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:29.495060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":1017,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078556+0000","last_change":"2024-04-26T12:30:58.079466+0000","last_active":"2024-04-26T12:30:59.078556+0000","last_peered":"2024-04-26T12:30:59.078556+0000","last_clean":"2024-04-26T12:30:59.078556+0000","last_became_active":"2024-04-26T12:30:58.078211+0000","last_became_peered":"2024-04-26T12:30:58.078211+0000","last_unstale":"2024-04-26T12:30:59.078556+0000","last_undegraded":"2024-04-26T12:30:59.078556+0000","last_fullsized":"2024-04-26T12:30:59.078556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:42.746789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078438+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:30:59.078438+0000","last_peered":"2024-04-26T12:30:59.078438+0000","last_clean":"2024-04-26T12:30:59.078438+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:30:59.078438+0000","last_undegraded":"2024-04-26T12:30:59.078438+0000","last_fullsized":"2024-04-26T12:30:59.078438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:57.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":585,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077533+0000","last_change":"2024-04-26T12:30:46.089997+0000","last_active":"2024-04-26T12:30:59.077533+0000","last_peered":"2024-04-26T12:30:59.077533+0000","last_clean":"2024-04-26T12:30:59.077533+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:30:59.077533+0000","last_undegraded":"2024-04-26T12:30:59.077533+0000","last_fullsized":"2024-04-26T12:30:59.077533+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:08.843126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078301+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:30:59.078301+0000","last_peered":"2024-04-26T12:30:59.078301+0000","last_clean":"2024-04-26T12:30:59.078301+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:30:59.078301+0000","last_undegraded":"2024-04-26T12:30:59.078301+0000","last_fullsized":"2024-04-26T12:30:59.078301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:19.109601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077517+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:30:59.077517+0000","last_peered":"2024-04-26T12:30:59.077517+0000","last_clean":"2024-04-26T12:30:59.077517+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:30:59.077517+0000","last_undegraded":"2024-04-26T12:30:59.077517+0000","last_fullsized":"2024-04-26T12:30:59.077517+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:21.302173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078191+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:30:59.078191+0000","last_peered":"2024-04-26T12:30:59.078191+0000","last_clean":"2024-04-26T12:30:59.078191+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:30:59.078191+0000","last_undegraded":"2024-04-26T12:30:59.078191+0000","last_fullsized":"2024-04-26T12:30:59.078191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:24.652612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":410,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076264+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:30:59.076264+0000","last_peered":"2024-04-26T12:30:59.076264+0000","last_clean":"2024-04-26T12:30:59.076264+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:30:59.076264+0000","last_undegraded":"2024-04-26T12:30:59.076264+0000","last_fullsized":"2024-04-26T12:30:59.076264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.762427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077325+0000","last_change":"2024-04-26T12:30:58.081169+0000","last_active":"2024-04-26T12:30:59.077325+0000","last_peered":"2024-04-26T12:30:59.077325+0000","last_clean":"2024-04-26T12:30:59.077325+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:30:59.077325+0000","last_undegraded":"2024-04-26T12:30:59.077325+0000","last_fullsized":"2024-04-26T12:30:59.077325+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:42.618440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"58'708","reported_seq":778,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076197+0000","last_change":"2024-04-26T12:30:44.022038+0000","last_active":"2024-04-26T12:30:59.076197+0000","last_peered":"2024-04-26T12:30:59.076197+0000","last_clean":"2024-04-26T12:30:59.076197+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:30:59.076197+0000","last_undegraded":"2024-04-26T12:30:59.076197+0000","last_fullsized":"2024-04-26T12:30:59.076197+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:30.369118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":500,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078749+0000","last_change":"2024-04-26T12:30:47.081417+0000","last_active":"2024-04-26T12:31:00.078749+0000","last_peered":"2024-04-26T12:31:00.078749+0000","last_clean":"2024-04-26T12:31:00.078749+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:31:00.078749+0000","last_undegraded":"2024-04-26T12:31:00.078749+0000","last_fullsized":"2024-04-26T12:31:00.078749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:17.628933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077196+0000","last_change":"2024-04-26T12:30:41.018067+0000","last_active":"2024-04-26T12:30:59.077196+0000","last_peered":"2024-04-26T12:30:59.077196+0000","last_clean":"2024-04-26T12:30:59.077196+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:30:59.077196+0000","last_undegraded":"2024-04-26T12:30:59.077196+0000","last_fullsized":"2024-04-26T12:30:59.077196+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:33.684743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":594,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076422+0000","last_change":"2024-04-26T12:30:58.081823+0000","last_active":"2024-04-26T12:30:59.076422+0000","last_peered":"2024-04-26T12:30:59.076422+0000","last_clean":"2024-04-26T12:30:59.076422+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:30:59.076422+0000","last_undegraded":"2024-04-26T12:30:59.076422+0000","last_fullsized":"2024-04-26T12:30:59.076422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:17.109302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"58'355","reported_seq":377,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078258+0000","last_change":"2024-04-26T12:30:48.086933+0000","last_active":"2024-04-26T12:30:59.078258+0000","last_peered":"2024-04-26T12:30:59.078258+0000","last_clean":"2024-04-26T12:30:59.078258+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:30:59.078258+0000","last_undegraded":"2024-04-26T12:30:59.078258+0000","last_fullsized":"2024-04-26T12:30:59.078258+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:04:49.737283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":720,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076317+0000","last_change":"2024-04-26T12:30:46.034642+0000","last_active":"2024-04-26T12:30:59.076317+0000","last_peered":"2024-04-26T12:30:59.076317+0000","last_clean":"2024-04-26T12:30:59.076317+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:30:59.076317+0000","last_undegraded":"2024-04-26T12:30:59.076317+0000","last_fullsized":"2024-04-26T12:30:59.076317+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.961343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":167,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077954+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:30:59.077954+0000","last_peered":"2024-04-26T12:30:59.077954+0000","last_clean":"2024-04-26T12:30:59.077954+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:30:59.077954+0000","last_undegraded":"2024-04-26T12:30:59.077954+0000","last_fullsized":"2024-04-26T12:30:59.077954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:59.674471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076500+0000","last_change":"2024-04-26T12:30:45.022716+0000","last_active":"2024-04-26T12:30:59.076500+0000","last_peered":"2024-04-26T12:30:59.076500+0000","last_clean":"2024-04-26T12:30:59.076500+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:30:59.076500+0000","last_undegraded":"2024-04-26T12:30:59.076500+0000","last_fullsized":"2024-04-26T12:30:59.076500+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:01.269901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'374","reported_seq":439,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078040+0000","last_change":"2024-04-26T12:30:46.079618+0000","last_active":"2024-04-26T12:30:59.078040+0000","last_peered":"2024-04-26T12:30:59.078040+0000","last_clean":"2024-04-26T12:30:59.078040+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:30:59.078040+0000","last_undegraded":"2024-04-26T12:30:59.078040+0000","last_fullsized":"2024-04-26T12:30:59.078040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:48.209628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":506,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077751+0000","last_change":"2024-04-26T12:30:47.082596+0000","last_active":"2024-04-26T12:30:59.077751+0000","last_peered":"2024-04-26T12:30:59.077751+0000","last_clean":"2024-04-26T12:30:59.077751+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:30:59.077751+0000","last_undegraded":"2024-04-26T12:30:59.077751+0000","last_fullsized":"2024-04-26T12:30:59.077751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:00:34.688913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":648,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077638+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:30:59.077638+0000","last_peered":"2024-04-26T12:30:59.077638+0000","last_clean":"2024-04-26T12:30:59.077638+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:30:59.077638+0000","last_undegraded":"2024-04-26T12:30:59.077638+0000","last_fullsized":"2024-04-26T12:30:59.077638+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:50.674218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":794,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078066+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:30:59.078066+0000","last_peered":"2024-04-26T12:30:59.078066+0000","last_clean":"2024-04-26T12:30:59.078066+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:30:59.078066+0000","last_undegraded":"2024-04-26T12:30:59.078066+0000","last_fullsized":"2024-04-26T12:30:59.078066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:11.548975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076400+0000","last_change":"2024-04-26T12:30:46.089052+0000","last_active":"2024-04-26T12:30:59.076400+0000","last_peered":"2024-04-26T12:30:59.076400+0000","last_clean":"2024-04-26T12:30:59.076400+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:30:59.076400+0000","last_undegraded":"2024-04-26T12:30:59.076400+0000","last_fullsized":"2024-04-26T12:30:59.076400+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:28.433853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":860,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078103+0000","last_change":"2024-04-26T12:30:50.086492+0000","last_active":"2024-04-26T12:30:59.078103+0000","last_peered":"2024-04-26T12:30:59.078103+0000","last_clean":"2024-04-26T12:30:59.078103+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:30:59.078103+0000","last_undegraded":"2024-04-26T12:30:59.078103+0000","last_fullsized":"2024-04-26T12:30:59.078103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:18.705037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077626+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:30:59.077626+0000","last_peered":"2024-04-26T12:30:59.077626+0000","last_clean":"2024-04-26T12:30:59.077626+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:30:59.077626+0000","last_undegraded":"2024-04-26T12:30:59.077626+0000","last_fullsized":"2024-04-26T12:30:59.077626+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:46.181204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":500,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.086763+0000","last_change":"2024-04-26T12:30:59.083411+0000","last_active":"2024-04-26T12:30:59.086763+0000","last_peered":"2024-04-26T12:30:59.086763+0000","last_clean":"2024-04-26T12:30:59.086763+0000","last_became_active":"2024-04-26T12:30:59.081424+0000","last_became_peered":"2024-04-26T12:30:59.081424+0000","last_unstale":"2024-04-26T12:30:59.086763+0000","last_undegraded":"2024-04-26T12:30:59.086763+0000","last_fullsized":"2024-04-26T12:30:59.086763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:09.181871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'54","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077588+0000","last_change":"2024-04-26T12:30:46.082166+0000","last_active":"2024-04-26T12:30:59.077588+0000","last_peered":"2024-04-26T12:30:59.077588+0000","last_clean":"2024-04-26T12:30:59.077588+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:30:59.077588+0000","last_undegraded":"2024-04-26T12:30:59.077588+0000","last_fullsized":"2024-04-26T12:30:59.077588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:28.037535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":538,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.089343+0000","last_change":"2024-04-26T12:30:59.084548+0000","last_active":"2024-04-26T12:30:59.089343+0000","last_peered":"2024-04-26T12:30:59.089343+0000","last_clean":"2024-04-26T12:30:59.089343+0000","last_became_active":"2024-04-26T12:30:59.081463+0000","last_became_peered":"2024-04-26T12:30:59.081463+0000","last_unstale":"2024-04-26T12:30:59.089343+0000","last_undegraded":"2024-04-26T12:30:59.089343+0000","last_fullsized":"2024-04-26T12:30:59.089343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:51.815050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'186","reported_seq":209,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078288+0000","last_change":"2024-04-26T12:30:46.080074+0000","last_active":"2024-04-26T12:30:59.078288+0000","last_peered":"2024-04-26T12:30:59.078288+0000","last_clean":"2024-04-26T12:30:59.078288+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:30:59.078288+0000","last_undegraded":"2024-04-26T12:30:59.078288+0000","last_fullsized":"2024-04-26T12:30:59.078288+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:24.562647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":531,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077193+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:30:59.077193+0000","last_peered":"2024-04-26T12:30:59.077193+0000","last_clean":"2024-04-26T12:30:59.077193+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:30:59.077193+0000","last_undegraded":"2024-04-26T12:30:59.077193+0000","last_fullsized":"2024-04-26T12:30:59.077193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:22.925728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078244+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:30:59.078244+0000","last_peered":"2024-04-26T12:30:59.078244+0000","last_clean":"2024-04-26T12:30:59.078244+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:30:59.078244+0000","last_undegraded":"2024-04-26T12:30:59.078244+0000","last_fullsized":"2024-04-26T12:30:59.078244+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:34:40.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":976,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077821+0000","last_change":"2024-04-26T12:30:52.078990+0000","last_active":"2024-04-26T12:30:59.077821+0000","last_peered":"2024-04-26T12:30:59.077821+0000","last_clean":"2024-04-26T12:30:59.077821+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:30:59.077821+0000","last_undegraded":"2024-04-26T12:30:59.077821+0000","last_fullsized":"2024-04-26T12:30:59.077821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:37.697122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":514,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078332+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:30:59.078332+0000","last_peered":"2024-04-26T12:30:59.078332+0000","last_clean":"2024-04-26T12:30:59.078332+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:30:59.078332+0000","last_undegraded":"2024-04-26T12:30:59.078332+0000","last_fullsized":"2024-04-26T12:30:59.078332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:18.562011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077374+0000","last_change":"2024-04-26T12:30:48.089200+0000","last_active":"2024-04-26T12:30:59.077374+0000","last_peered":"2024-04-26T12:30:59.077374+0000","last_clean":"2024-04-26T12:30:59.077374+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:30:59.077374+0000","last_undegraded":"2024-04-26T12:30:59.077374+0000","last_fullsized":"2024-04-26T12:30:59.077374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:04.588329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077619+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:30:59.077619+0000","last_peered":"2024-04-26T12:30:59.077619+0000","last_clean":"2024-04-26T12:30:59.077619+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:30:59.077619+0000","last_undegraded":"2024-04-26T12:30:59.077619+0000","last_fullsized":"2024-04-26T12:30:59.077619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:40.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":559,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076624+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:30:59.076624+0000","last_peered":"2024-04-26T12:30:59.076624+0000","last_clean":"2024-04-26T12:30:59.076624+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:30:59.076624+0000","last_undegraded":"2024-04-26T12:30:59.076624+0000","last_fullsized":"2024-04-26T12:30:59.076624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:21.230823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":252,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076455+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:30:59.076455+0000","last_peered":"2024-04-26T12:30:59.076455+0000","last_clean":"2024-04-26T12:30:59.076455+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:30:59.076455+0000","last_undegraded":"2024-04-26T12:30:59.076455+0000","last_fullsized":"2024-04-26T12:30:59.076455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:15:30.864621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":537,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077889+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:30:59.077889+0000","last_peered":"2024-04-26T12:30:59.077889+0000","last_clean":"2024-04-26T12:30:59.077889+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:30:59.077889+0000","last_undegraded":"2024-04-26T12:30:59.077889+0000","last_fullsized":"2024-04-26T12:30:59.077889+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:13.427584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":268,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077250+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:30:59.077250+0000","last_peered":"2024-04-26T12:30:59.077250+0000","last_clean":"2024-04-26T12:30:59.077250+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:30:59.077250+0000","last_undegraded":"2024-04-26T12:30:59.077250+0000","last_fullsized":"2024-04-26T12:30:59.077250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:16.260550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078751+0000","last_change":"2024-04-26T12:30:47.083054+0000","last_active":"2024-04-26T12:30:59.078751+0000","last_peered":"2024-04-26T12:30:59.078751+0000","last_clean":"2024-04-26T12:30:59.078751+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:30:59.078751+0000","last_undegraded":"2024-04-26T12:30:59.078751+0000","last_fullsized":"2024-04-26T12:30:59.078751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.645638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":162,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077348+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:30:59.077348+0000","last_peered":"2024-04-26T12:30:59.077348+0000","last_clean":"2024-04-26T12:30:59.077348+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:30:59.077348+0000","last_undegraded":"2024-04-26T12:30:59.077348+0000","last_fullsized":"2024-04-26T12:30:59.077348+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:20.988072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":492,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078566+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:30:59.078566+0000","last_peered":"2024-04-26T12:30:59.078566+0000","last_clean":"2024-04-26T12:30:59.078566+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:30:59.078566+0000","last_undegraded":"2024-04-26T12:30:59.078566+0000","last_fullsized":"2024-04-26T12:30:59.078566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:05.693217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":588,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078399+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:30:59.078399+0000","last_peered":"2024-04-26T12:30:59.078399+0000","last_clean":"2024-04-26T12:30:59.078399+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:30:59.078399+0000","last_undegraded":"2024-04-26T12:30:59.078399+0000","last_fullsized":"2024-04-26T12:30:59.078399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:25.266771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077354+0000","last_change":"2024-04-26T12:30:55.090354+0000","last_active":"2024-04-26T12:30:59.077354+0000","last_peered":"2024-04-26T12:30:59.077354+0000","last_clean":"2024-04-26T12:30:59.077354+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:30:59.077354+0000","last_undegraded":"2024-04-26T12:30:59.077354+0000","last_fullsized":"2024-04-26T12:30:59.077354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:14.455369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076944+0000","last_change":"2024-04-26T12:30:41.026049+0000","last_active":"2024-04-26T12:30:59.076944+0000","last_peered":"2024-04-26T12:30:59.076944+0000","last_clean":"2024-04-26T12:30:59.076944+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:30:59.076944+0000","last_undegraded":"2024-04-26T12:30:59.076944+0000","last_fullsized":"2024-04-26T12:30:59.076944+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.409817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"58'454","reported_seq":480,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078638+0000","last_change":"2024-04-26T12:30:46.079367+0000","last_active":"2024-04-26T12:30:59.078638+0000","last_peered":"2024-04-26T12:30:59.078638+0000","last_clean":"2024-04-26T12:30:59.078638+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:30:59.078638+0000","last_undegraded":"2024-04-26T12:30:59.078638+0000","last_fullsized":"2024-04-26T12:30:59.078638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:00.950370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":473,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078369+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:31:00.078369+0000","last_peered":"2024-04-26T12:31:00.078369+0000","last_clean":"2024-04-26T12:31:00.078369+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:31:00.078369+0000","last_undegraded":"2024-04-26T12:31:00.078369+0000","last_fullsized":"2024-04-26T12:31:00.078369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:10.697823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078680+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:31:00.078680+0000","last_peered":"2024-04-26T12:31:00.078680+0000","last_clean":"2024-04-26T12:31:00.078680+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:31:00.078680+0000","last_undegraded":"2024-04-26T12:31:00.078680+0000","last_fullsized":"2024-04-26T12:31:00.078680+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:46:16.686041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078300+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:00.078300+0000","last_peered":"2024-04-26T12:31:00.078300+0000","last_clean":"2024-04-26T12:31:00.078300+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:31:00.078300+0000","last_undegraded":"2024-04-26T12:31:00.078300+0000","last_fullsized":"2024-04-26T12:31:00.078300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:18.069937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076887+0000","last_change":"2024-04-26T12:30:46.033999+0000","last_active":"2024-04-26T12:30:59.076887+0000","last_peered":"2024-04-26T12:30:59.076887+0000","last_clean":"2024-04-26T12:30:59.076887+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:30:59.076887+0000","last_undegraded":"2024-04-26T12:30:59.076887+0000","last_fullsized":"2024-04-26T12:30:59.076887+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:33.235467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076629+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:30:59.076629+0000","last_peered":"2024-04-26T12:30:59.076629+0000","last_clean":"2024-04-26T12:30:59.076629+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:30:59.076629+0000","last_undegraded":"2024-04-26T12:30:59.076629+0000","last_fullsized":"2024-04-26T12:30:59.076629+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:20.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":398,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077980+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:30:59.077980+0000","last_peered":"2024-04-26T12:30:59.077980+0000","last_clean":"2024-04-26T12:30:59.077980+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:30:59.077980+0000","last_undegraded":"2024-04-26T12:30:59.077980+0000","last_fullsized":"2024-04-26T12:30:59.077980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:57.132442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":432,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077237+0000","last_change":"2024-04-26T12:30:54.081099+0000","last_active":"2024-04-26T12:30:59.077237+0000","last_peered":"2024-04-26T12:30:59.077237+0000","last_clean":"2024-04-26T12:30:59.077237+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:30:59.077237+0000","last_undegraded":"2024-04-26T12:30:59.077237+0000","last_fullsized":"2024-04-26T12:30:59.077237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:29.507250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":73,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077511+0000","last_change":"2024-04-26T12:30:46.082961+0000","last_active":"2024-04-26T12:30:59.077511+0000","last_peered":"2024-04-26T12:30:59.077511+0000","last_clean":"2024-04-26T12:30:59.077511+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:30:59.077511+0000","last_undegraded":"2024-04-26T12:30:59.077511+0000","last_fullsized":"2024-04-26T12:30:59.077511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:10.764587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":263,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077256+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:30:59.077256+0000","last_peered":"2024-04-26T12:30:59.077256+0000","last_clean":"2024-04-26T12:30:59.077256+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:30:59.077256+0000","last_undegraded":"2024-04-26T12:30:59.077256+0000","last_fullsized":"2024-04-26T12:30:59.077256+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:23.542209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":598,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076589+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:30:59.076589+0000","last_peered":"2024-04-26T12:30:59.076589+0000","last_clean":"2024-04-26T12:30:59.076589+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:30:59.076589+0000","last_undegraded":"2024-04-26T12:30:59.076589+0000","last_fullsized":"2024-04-26T12:30:59.076589+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:05.679997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":565,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078891+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:31:00.078891+0000","last_peered":"2024-04-26T12:31:00.078891+0000","last_clean":"2024-04-26T12:31:00.078891+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:31:00.078891+0000","last_undegraded":"2024-04-26T12:31:00.078891+0000","last_fullsized":"2024-04-26T12:31:00.078891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:44.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077378+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:30:59.077378+0000","last_peered":"2024-04-26T12:30:59.077378+0000","last_clean":"2024-04-26T12:30:59.077378+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:30:59.077378+0000","last_undegraded":"2024-04-26T12:30:59.077378+0000","last_fullsized":"2024-04-26T12:30:59.077378+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:26.236223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'105","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077011+0000","last_change":"2024-04-26T12:30:44.028851+0000","last_active":"2024-04-26T12:30:59.077011+0000","last_peered":"2024-04-26T12:30:59.077011+0000","last_clean":"2024-04-26T12:30:59.077011+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:30:59.077011+0000","last_undegraded":"2024-04-26T12:30:59.077011+0000","last_fullsized":"2024-04-26T12:30:59.077011+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:13.939165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078426+0000","last_change":"2024-04-26T12:30:57.078892+0000","last_active":"2024-04-26T12:30:59.078426+0000","last_peered":"2024-04-26T12:30:59.078426+0000","last_clean":"2024-04-26T12:30:59.078426+0000","last_became_active":"2024-04-26T12:30:57.077779+0000","last_became_peered":"2024-04-26T12:30:57.077779+0000","last_unstale":"2024-04-26T12:30:59.078426+0000","last_undegraded":"2024-04-26T12:30:59.078426+0000","last_fullsized":"2024-04-26T12:30:59.078426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:07.812506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078778+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:31:00.078778+0000","last_peered":"2024-04-26T12:31:00.078778+0000","last_clean":"2024-04-26T12:31:00.078778+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:31:00.078778+0000","last_undegraded":"2024-04-26T12:31:00.078778+0000","last_fullsized":"2024-04-26T12:31:00.078778+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:31.181549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077119+0000","last_change":"2024-04-26T12:30:41.026137+0000","last_active":"2024-04-26T12:30:59.077119+0000","last_peered":"2024-04-26T12:30:59.077119+0000","last_clean":"2024-04-26T12:30:59.077119+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:30:59.077119+0000","last_undegraded":"2024-04-26T12:30:59.077119+0000","last_fullsized":"2024-04-26T12:30:59.077119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:08.225745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":520,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077810+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:31:00.077810+0000","last_peered":"2024-04-26T12:31:00.077810+0000","last_clean":"2024-04-26T12:31:00.077810+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:31:00.077810+0000","last_undegraded":"2024-04-26T12:31:00.077810+0000","last_fullsized":"2024-04-26T12:31:00.077810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:59.042431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077074+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:30:59.077074+0000","last_peered":"2024-04-26T12:30:59.077074+0000","last_clean":"2024-04-26T12:30:59.077074+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:30:59.077074+0000","last_undegraded":"2024-04-26T12:30:59.077074+0000","last_fullsized":"2024-04-26T12:30:59.077074+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:51.609322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076973+0000","last_change":"2024-04-26T12:30:41.030157+0000","last_active":"2024-04-26T12:30:59.076973+0000","last_peered":"2024-04-26T12:30:59.076973+0000","last_clean":"2024-04-26T12:30:59.076973+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:59.076973+0000","last_undegraded":"2024-04-26T12:30:59.076973+0000","last_fullsized":"2024-04-26T12:30:59.076973+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:14:32.867679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":500,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.081711+0000","last_change":"2024-04-26T12:31:00.081711+0000","last_active":"2024-04-26T12:31:00.081711+0000","last_peered":"2024-04-26T12:31:00.081711+0000","last_clean":"2024-04-26T12:31:00.081711+0000","last_became_active":"2024-04-26T12:31:00.079504+0000","last_became_peered":"2024-04-26T12:31:00.079504+0000","last_unstale":"2024-04-26T12:31:00.081711+0000","last_undegraded":"2024-04-26T12:31:00.081711+0000","last_fullsized":"2024-04-26T12:31:00.081711+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:17.125482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078428+0000","last_change":"2024-04-26T12:30:46.080509+0000","last_active":"2024-04-26T12:30:59.078428+0000","last_peered":"2024-04-26T12:30:59.078428+0000","last_clean":"2024-04-26T12:30:59.078428+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:30:59.078428+0000","last_undegraded":"2024-04-26T12:30:59.078428+0000","last_fullsized":"2024-04-26T12:30:59.078428+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:40.037270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'82","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077350+0000","last_change":"2024-04-26T12:30:46.086027+0000","last_active":"2024-04-26T12:30:59.077350+0000","last_peered":"2024-04-26T12:30:59.077350+0000","last_clean":"2024-04-26T12:30:59.077350+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:30:59.077350+0000","last_undegraded":"2024-04-26T12:30:59.077350+0000","last_fullsized":"2024-04-26T12:30:59.077350+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:13.543414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":606,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077942+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:31:00.077942+0000","last_peered":"2024-04-26T12:31:00.077942+0000","last_clean":"2024-04-26T12:31:00.077942+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:31:00.077942+0000","last_undegraded":"2024-04-26T12:31:00.077942+0000","last_fullsized":"2024-04-26T12:31:00.077942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:17.390151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077612+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:30:59.077612+0000","last_peered":"2024-04-26T12:30:59.077612+0000","last_clean":"2024-04-26T12:30:59.077612+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:30:59.077612+0000","last_undegraded":"2024-04-26T12:30:59.077612+0000","last_fullsized":"2024-04-26T12:30:59.077612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:45.312112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":855,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078064+0000","last_change":"2024-04-26T12:30:53.079043+0000","last_active":"2024-04-26T12:30:59.078064+0000","last_peered":"2024-04-26T12:30:59.078064+0000","last_clean":"2024-04-26T12:30:59.078064+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:30:59.078064+0000","last_undegraded":"2024-04-26T12:30:59.078064+0000","last_fullsized":"2024-04-26T12:30:59.078064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:00.091756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":311,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078038+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:30:59.078038+0000","last_peered":"2024-04-26T12:30:59.078038+0000","last_clean":"2024-04-26T12:30:59.078038+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:30:59.078038+0000","last_undegraded":"2024-04-26T12:30:59.078038+0000","last_fullsized":"2024-04-26T12:30:59.078038+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:43.044883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":798,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077365+0000","last_change":"2024-04-26T12:30:48.088039+0000","last_active":"2024-04-26T12:30:59.077365+0000","last_peered":"2024-04-26T12:30:59.077365+0000","last_clean":"2024-04-26T12:30:59.077365+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:30:59.077365+0000","last_undegraded":"2024-04-26T12:30:59.077365+0000","last_fullsized":"2024-04-26T12:30:59.077365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:03.967118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"58'314","reported_seq":395,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077986+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:30:59.077986+0000","last_peered":"2024-04-26T12:30:59.077986+0000","last_clean":"2024-04-26T12:30:59.077986+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:30:59.077986+0000","last_undegraded":"2024-04-26T12:30:59.077986+0000","last_fullsized":"2024-04-26T12:30:59.077986+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:01.530104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":872,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077302+0000","last_change":"2024-04-26T12:30:52.079092+0000","last_active":"2024-04-26T12:30:59.077302+0000","last_peered":"2024-04-26T12:30:59.077302+0000","last_clean":"2024-04-26T12:30:59.077302+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:30:59.077302+0000","last_undegraded":"2024-04-26T12:30:59.077302+0000","last_fullsized":"2024-04-26T12:30:59.077302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:10.253347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"58'76","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077223+0000","last_change":"2024-04-26T12:30:41.050653+0000","last_active":"2024-04-26T12:30:59.077223+0000","last_peered":"2024-04-26T12:30:59.077223+0000","last_clean":"2024-04-26T12:30:59.077223+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:30:59.077223+0000","last_undegraded":"2024-04-26T12:30:59.077223+0000","last_fullsized":"2024-04-26T12:30:59.077223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:17.874875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":542,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076883+0000","last_change":"2024-04-26T12:28:00.707724+0000","last_active":"2024-04-26T12:30:59.076883+0000","last_peered":"2024-04-26T12:30:59.076883+0000","last_clean":"2024-04-26T12:30:59.076883+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:30:59.076883+0000","last_undegraded":"2024-04-26T12:30:59.076883+0000","last_fullsized":"2024-04-26T12:30:59.076883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:20.384961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":52,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077310+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:30:59.077310+0000","last_peered":"2024-04-26T12:30:59.077310+0000","last_clean":"2024-04-26T12:30:59.077310+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:30:59.077310+0000","last_undegraded":"2024-04-26T12:30:59.077310+0000","last_fullsized":"2024-04-26T12:30:59.077310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:40.007809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077689+0000","last_change":"2024-04-26T12:30:51.076207+0000","last_active":"2024-04-26T12:30:59.077689+0000","last_peered":"2024-04-26T12:30:59.077689+0000","last_clean":"2024-04-26T12:30:59.077689+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:30:59.077689+0000","last_undegraded":"2024-04-26T12:30:59.077689+0000","last_fullsized":"2024-04-26T12:30:59.077689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:05.869282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":863,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.077482+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:30:59.077482+0000","last_peered":"2024-04-26T12:30:59.077482+0000","last_clean":"2024-04-26T12:30:59.077482+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:30:59.077482+0000","last_undegraded":"2024-04-26T12:30:59.077482+0000","last_fullsized":"2024-04-26T12:30:59.077482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:50.433671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076889+0000","last_change":"2024-04-26T12:30:54.080153+0000","last_active":"2024-04-26T12:30:59.076889+0000","last_peered":"2024-04-26T12:30:59.076889+0000","last_clean":"2024-04-26T12:30:59.076889+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:30:59.076889+0000","last_undegraded":"2024-04-26T12:30:59.076889+0000","last_fullsized":"2024-04-26T12:30:59.076889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:48.057283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":629,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078217+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:31:00.078217+0000","last_peered":"2024-04-26T12:31:00.078217+0000","last_clean":"2024-04-26T12:31:00.078217+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:31:00.078217+0000","last_undegraded":"2024-04-26T12:31:00.078217+0000","last_fullsized":"2024-04-26T12:31:00.078217+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:51:39.086568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":515,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.076733+0000","last_change":"2024-04-26T12:30:50.086765+0000","last_active":"2024-04-26T12:30:59.076733+0000","last_peered":"2024-04-26T12:30:59.076733+0000","last_clean":"2024-04-26T12:30:59.076733+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:30:59.076733+0000","last_undegraded":"2024-04-26T12:30:59.076733+0000","last_fullsized":"2024-04-26T12:30:59.076733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:36.313767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":511,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T12:30:59.078165+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:30:59.078165+0000","last_peered":"2024-04-26T12:30:59.078165+0000","last_clean":"2024-04-26T12:30:59.078165+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:30:59.078165+0000","last_undegraded":"2024-04-26T12:30:59.078165+0000","last_fullsized":"2024-04-26T12:30:59.078165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:35.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79134720,"data_stored":256449018,"data_compressed":38844374,"data_compressed_allocated":48693248,"data_compressed_original":226074624,"omap_allocated":5343,"internal_metadata":0},"log_size":7508,"ondisk_log_size":7508,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738425,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130116,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94241724,"statfs":{"total":96636764160,"available":96503525376,"internally_reserved":0,"allocated":31711232,"data_stored":85785287,"data_compressed":12062822,"data_compressed_allocated":15765504,"data_compressed_original":70336512,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.23599999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.61799999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131340,"kb_used_data":32188,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94240500,"statfs":{"total":96636764160,"available":96502272000,"internally_reserved":0,"allocated":32960512,"data_stored":91451171,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Apr 26 12:30:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.30399999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.625,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.442}]}]},{"osd":1,"up_from":64,"seq":274877906952,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62340,"kb_used_data":16760,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309500,"statfs":{"total":96636764160,"available":96572928000,"internally_reserved":0,"allocated":17162240,"data_stored":81548386,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30789632,"data_stored":84809889,"data_compressed":12028675,"data_compressed_allocated":15720448,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:13.563 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.563 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.563 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.564 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.564 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.564 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.564 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.564 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.564 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.564 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.564 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.564 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.564 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.565 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.565 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.565 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.565 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.565 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.565 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.565 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.565 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.565 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.566 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.566 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.566 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.566 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.566 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.566 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.566 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.566 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.566 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.567 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.567 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.567 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.567 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.567 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.567 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.567 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.567 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.567 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.567 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.568 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.568 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.568 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.568 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.568 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.568 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.568 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.568 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.568 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.569 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.569 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.569 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.569 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.569 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.569 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.570 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.570 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.570 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.570 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.570 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.570 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.571 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.571 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.571 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.571 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.571 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.571 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.571 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.572 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.572 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.572 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.572 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.572 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.572 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.572 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:26:45.798066+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.573 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.573 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.573 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.573 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.573 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.573 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.573 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.573 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.573 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.574 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.574 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.574 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.574 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.574 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.575 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.575 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.575 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.575 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.575 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.576 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.576 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.576 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.576 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.576 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.576 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.576 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.576 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.576 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.577 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:13.577 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:31:33.578 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:33.938 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:31:33.939 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:31:33.949 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-04-26T12:31:33.366359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6546,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34355,"ondisk_log_size":34355,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":323780,"kb_used_data":79916,"kb_used_omap":9,"kb_used_meta":243830,"kb_avail":282791740,"statfs":{"total":289910292480,"available":289578741760,"internally_reserved":0,"allocated":81833984,"data_stored":258784844,"data_compressed":38912668,"data_compressed_allocated":48783360,"data_compressed_original":227221504,"omap_allocated":10125,"internal_metadata":249682035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003073"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":913,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:18.003472+0000","last_change":"2024-04-26T12:31:18.003585+0000","last_active":"2024-04-26T12:31:18.003472+0000","last_peered":"2024-04-26T12:31:18.003472+0000","last_clean":"2024-04-26T12:31:18.003472+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:31:18.003472+0000","last_undegraded":"2024-04-26T12:31:18.003472+0000","last_fullsized":"2024-04-26T12:31:18.003472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:18.003445+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:18.003445+0000","last_clean_scrub_stamp":"2024-04-26T12:31:18.003445+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:47.444600+0000","scrub_duration":0.0019588980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":958,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364439+0000","last_change":"2024-04-26T12:30:56.085870+0000","last_active":"2024-04-26T12:31:05.364439+0000","last_peered":"2024-04-26T12:31:05.364439+0000","last_clean":"2024-04-26T12:31:05.364439+0000","last_became_active":"2024-04-26T12:30:56.084642+0000","last_became_peered":"2024-04-26T12:30:56.084642+0000","last_unstale":"2024-04-26T12:31:05.364439+0000","last_undegraded":"2024-04-26T12:31:05.364439+0000","last_fullsized":"2024-04-26T12:31:05.364439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":496,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078732+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:31:00.078732+0000","last_peered":"2024-04-26T12:31:00.078732+0000","last_clean":"2024-04-26T12:31:00.078732+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:31:00.078732+0000","last_undegraded":"2024-04-26T12:31:00.078732+0000","last_fullsized":"2024-04-26T12:31:00.078732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":868,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078660+0000","last_change":"2024-04-26T12:30:48.089842+0000","last_active":"2024-04-26T12:31:00.078660+0000","last_peered":"2024-04-26T12:31:00.078660+0000","last_clean":"2024-04-26T12:31:00.078660+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:31:00.078660+0000","last_undegraded":"2024-04-26T12:31:00.078660+0000","last_fullsized":"2024-04-26T12:31:00.078660+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":940,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077820+0000","last_change":"2024-04-26T12:30:48.089460+0000","last_active":"2024-04-26T12:31:00.077820+0000","last_peered":"2024-04-26T12:31:00.077820+0000","last_clean":"2024-04-26T12:31:00.077820+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:31:00.077820+0000","last_undegraded":"2024-04-26T12:31:00.077820+0000","last_fullsized":"2024-04-26T12:31:00.077820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":489,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:15.202084+0000","last_change":"2024-04-26T12:31:15.202198+0000","last_active":"2024-04-26T12:31:15.202084+0000","last_peered":"2024-04-26T12:31:15.202084+0000","last_clean":"2024-04-26T12:31:15.202084+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:31:15.202084+0000","last_undegraded":"2024-04-26T12:31:15.202084+0000","last_fullsized":"2024-04-26T12:31:15.202084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:31:15.202057+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:31:15.202057+0000","last_clean_scrub_stamp":"2024-04-26T12:31:15.202057+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:36.672446+0000","scrub_duration":0.002466312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1029,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078177+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:31:00.078177+0000","last_peered":"2024-04-26T12:31:00.078177+0000","last_clean":"2024-04-26T12:31:00.078177+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:31:00.078177+0000","last_undegraded":"2024-04-26T12:31:00.078177+0000","last_fullsized":"2024-04-26T12:31:00.078177+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":768,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077732+0000","last_change":"2024-04-26T12:30:49.082511+0000","last_active":"2024-04-26T12:31:00.077732+0000","last_peered":"2024-04-26T12:31:00.077732+0000","last_clean":"2024-04-26T12:31:00.077732+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:31:00.077732+0000","last_undegraded":"2024-04-26T12:31:00.077732+0000","last_fullsized":"2024-04-26T12:31:00.077732+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":499,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.079150+0000","last_change":"2024-04-26T12:30:56.079114+0000","last_active":"2024-04-26T12:31:00.079150+0000","last_peered":"2024-04-26T12:31:00.079150+0000","last_clean":"2024-04-26T12:31:00.079150+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:31:00.079150+0000","last_undegraded":"2024-04-26T12:31:00.079150+0000","last_fullsized":"2024-04-26T12:31:00.079150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":912,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078526+0000","last_change":"2024-04-26T12:30:56.087672+0000","last_active":"2024-04-26T12:31:00.078526+0000","last_peered":"2024-04-26T12:31:00.078526+0000","last_clean":"2024-04-26T12:31:00.078526+0000","last_became_active":"2024-04-26T12:30:56.085904+0000","last_became_peered":"2024-04-26T12:30:56.085904+0000","last_unstale":"2024-04-26T12:31:00.078526+0000","last_undegraded":"2024-04-26T12:31:00.078526+0000","last_fullsized":"2024-04-26T12:31:00.078526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":606,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.239455+0000","last_change":"2024-04-26T12:31:14.239557+0000","last_active":"2024-04-26T12:31:14.239455+0000","last_peered":"2024-04-26T12:31:14.239455+0000","last_clean":"2024-04-26T12:31:14.239455+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:31:14.239455+0000","last_undegraded":"2024-04-26T12:31:14.239455+0000","last_fullsized":"2024-04-26T12:31:14.239455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'366","last_scrub_stamp":"2024-04-26T12:31:14.239429+0000","last_deep_scrub":"60'366","last_deep_scrub_stamp":"2024-04-26T12:31:14.239429+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.239429+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:48.735192+0000","scrub_duration":0.0022088089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":513,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078052+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:31:00.078052+0000","last_peered":"2024-04-26T12:31:00.078052+0000","last_clean":"2024-04-26T12:31:00.078052+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:31:00.078052+0000","last_undegraded":"2024-04-26T12:31:00.078052+0000","last_fullsized":"2024-04-26T12:31:00.078052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":884,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078023+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:31:00.078023+0000","last_peered":"2024-04-26T12:31:00.078023+0000","last_clean":"2024-04-26T12:31:00.078023+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:31:00.078023+0000","last_undegraded":"2024-04-26T12:31:00.078023+0000","last_fullsized":"2024-04-26T12:31:00.078023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":521,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078873+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:31:00.078873+0000","last_peered":"2024-04-26T12:31:00.078873+0000","last_clean":"2024-04-26T12:31:00.078873+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:31:00.078873+0000","last_undegraded":"2024-04-26T12:31:00.078873+0000","last_fullsized":"2024-04-26T12:31:00.078873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":541,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077883+0000","last_change":"2024-04-26T12:30:47.080645+0000","last_active":"2024-04-26T12:31:00.077883+0000","last_peered":"2024-04-26T12:31:00.077883+0000","last_clean":"2024-04-26T12:31:00.077883+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:31:00.077883+0000","last_undegraded":"2024-04-26T12:31:00.077883+0000","last_fullsized":"2024-04-26T12:31:00.077883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":927,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077781+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:31:00.077781+0000","last_peered":"2024-04-26T12:31:00.077781+0000","last_clean":"2024-04-26T12:31:00.077781+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:31:00.077781+0000","last_undegraded":"2024-04-26T12:31:00.077781+0000","last_fullsized":"2024-04-26T12:31:00.077781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":494,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.079064+0000","last_change":"2024-04-26T12:30:55.090347+0000","last_active":"2024-04-26T12:31:00.079064+0000","last_peered":"2024-04-26T12:31:00.079064+0000","last_clean":"2024-04-26T12:31:00.079064+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:31:00.079064+0000","last_undegraded":"2024-04-26T12:31:00.079064+0000","last_fullsized":"2024-04-26T12:31:00.079064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":913,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078648+0000","last_change":"2024-04-26T12:30:57.084445+0000","last_active":"2024-04-26T12:31:00.078648+0000","last_peered":"2024-04-26T12:31:00.078648+0000","last_clean":"2024-04-26T12:31:00.078648+0000","last_became_active":"2024-04-26T12:30:57.083026+0000","last_became_peered":"2024-04-26T12:30:57.083026+0000","last_unstale":"2024-04-26T12:31:00.078648+0000","last_undegraded":"2024-04-26T12:31:00.078648+0000","last_fullsized":"2024-04-26T12:31:00.078648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":527,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078585+0000","last_change":"2024-04-26T12:30:51.076894+0000","last_active":"2024-04-26T12:31:00.078585+0000","last_peered":"2024-04-26T12:31:00.078585+0000","last_clean":"2024-04-26T12:31:00.078585+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:31:00.078585+0000","last_undegraded":"2024-04-26T12:31:00.078585+0000","last_fullsized":"2024-04-26T12:31:00.078585+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1072,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149835+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:31:12.149835+0000","last_peered":"2024-04-26T12:31:12.149835+0000","last_clean":"2024-04-26T12:31:12.149835+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:31:12.149835+0000","last_undegraded":"2024-04-26T12:31:12.149835+0000","last_fullsized":"2024-04-26T12:31:12.149835+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":954,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149824+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:31:12.149824+0000","last_peered":"2024-04-26T12:31:12.149824+0000","last_clean":"2024-04-26T12:31:12.149824+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:31:12.149824+0000","last_undegraded":"2024-04-26T12:31:12.149824+0000","last_fullsized":"2024-04-26T12:31:12.149824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":593,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:23.051416+0000","last_change":"2024-04-26T12:31:23.051416+0000","last_active":"2024-04-26T12:31:23.051416+0000","last_peered":"2024-04-26T12:31:23.051416+0000","last_clean":"2024-04-26T12:31:23.051416+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:31:23.051416+0000","last_undegraded":"2024-04-26T12:31:23.051416+0000","last_fullsized":"2024-04-26T12:31:23.051416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:31:23.051248+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:31:23.051248+0000","last_clean_scrub_stamp":"2024-04-26T12:31:23.051248+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:26.481350+0000","scrub_duration":0.0028000099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":496,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.087485+0000","last_change":"2024-04-26T12:31:00.082038+0000","last_active":"2024-04-26T12:31:00.087485+0000","last_peered":"2024-04-26T12:31:00.087485+0000","last_clean":"2024-04-26T12:31:00.087485+0000","last_became_active":"2024-04-26T12:31:00.079766+0000","last_became_peered":"2024-04-26T12:31:00.079766+0000","last_unstale":"2024-04-26T12:31:00.087485+0000","last_undegraded":"2024-04-26T12:31:00.087485+0000","last_fullsized":"2024-04-26T12:31:00.087485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":1019,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.184084+0000","last_change":"2024-04-26T12:30:58.079466+0000","last_active":"2024-04-26T12:31:13.184084+0000","last_peered":"2024-04-26T12:31:13.184084+0000","last_clean":"2024-04-26T12:31:13.184084+0000","last_became_active":"2024-04-26T12:30:58.078211+0000","last_became_peered":"2024-04-26T12:30:58.078211+0000","last_unstale":"2024-04-26T12:31:13.184084+0000","last_undegraded":"2024-04-26T12:31:13.184084+0000","last_fullsized":"2024-04-26T12:31:13.184084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":550,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.184049+0000","last_change":"2024-04-26T12:26:53.265592+0000","last_active":"2024-04-26T12:31:13.184049+0000","last_peered":"2024-04-26T12:31:13.184049+0000","last_clean":"2024-04-26T12:31:13.184049+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:31:13.184049+0000","last_undegraded":"2024-04-26T12:31:13.184049+0000","last_fullsized":"2024-04-26T12:31:13.184049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":586,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.079050+0000","last_change":"2024-04-26T12:30:46.089997+0000","last_active":"2024-04-26T12:31:00.079050+0000","last_peered":"2024-04-26T12:31:00.079050+0000","last_clean":"2024-04-26T12:31:00.079050+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:31:00.079050+0000","last_undegraded":"2024-04-26T12:31:00.079050+0000","last_fullsized":"2024-04-26T12:31:00.079050+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":515,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149844+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:31:12.149844+0000","last_peered":"2024-04-26T12:31:12.149844+0000","last_clean":"2024-04-26T12:31:12.149844+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:31:12.149844+0000","last_undegraded":"2024-04-26T12:31:12.149844+0000","last_fullsized":"2024-04-26T12:31:12.149844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":568,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078077+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:31:00.078077+0000","last_peered":"2024-04-26T12:31:00.078077+0000","last_clean":"2024-04-26T12:31:00.078077+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:31:00.078077+0000","last_undegraded":"2024-04-26T12:31:00.078077+0000","last_fullsized":"2024-04-26T12:31:00.078077+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":483,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078745+0000","last_change":"2024-04-26T12:26:53.266251+0000","last_active":"2024-04-26T12:31:00.078745+0000","last_peered":"2024-04-26T12:31:00.078745+0000","last_clean":"2024-04-26T12:31:00.078745+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:31:00.078745+0000","last_undegraded":"2024-04-26T12:31:00.078745+0000","last_fullsized":"2024-04-26T12:31:00.078745+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":411,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077566+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:31:00.077566+0000","last_peered":"2024-04-26T12:31:00.077566+0000","last_clean":"2024-04-26T12:31:00.077566+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:31:00.077566+0000","last_undegraded":"2024-04-26T12:31:00.077566+0000","last_fullsized":"2024-04-26T12:31:00.077566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":478,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078895+0000","last_change":"2024-04-26T12:30:58.081169+0000","last_active":"2024-04-26T12:31:00.078895+0000","last_peered":"2024-04-26T12:31:00.078895+0000","last_clean":"2024-04-26T12:31:00.078895+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:31:00.078895+0000","last_undegraded":"2024-04-26T12:31:00.078895+0000","last_fullsized":"2024-04-26T12:31:00.078895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"58'708","reported_seq":779,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077482+0000","last_change":"2024-04-26T12:30:44.022038+0000","last_active":"2024-04-26T12:31:00.077482+0000","last_peered":"2024-04-26T12:31:00.077482+0000","last_clean":"2024-04-26T12:31:00.077482+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:31:00.077482+0000","last_undegraded":"2024-04-26T12:31:00.077482+0000","last_fullsized":"2024-04-26T12:31:00.077482+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":512,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.113289+0000","last_change":"2024-04-26T12:31:26.113397+0000","last_active":"2024-04-26T12:31:26.113289+0000","last_peered":"2024-04-26T12:31:26.113289+0000","last_clean":"2024-04-26T12:31:26.113289+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:31:26.113289+0000","last_undegraded":"2024-04-26T12:31:26.113289+0000","last_fullsized":"2024-04-26T12:31:26.113289+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:31:26.113263+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:31:26.113263+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.113263+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:51.012642+0000","scrub_duration":0.001900838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078860+0000","last_change":"2024-04-26T12:30:41.018067+0000","last_active":"2024-04-26T12:31:00.078860+0000","last_peered":"2024-04-26T12:31:00.078860+0000","last_clean":"2024-04-26T12:31:00.078860+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:31:00.078860+0000","last_undegraded":"2024-04-26T12:31:00.078860+0000","last_fullsized":"2024-04-26T12:31:00.078860+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":595,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077789+0000","last_change":"2024-04-26T12:30:58.081823+0000","last_active":"2024-04-26T12:31:00.077789+0000","last_peered":"2024-04-26T12:31:00.077789+0000","last_clean":"2024-04-26T12:31:00.077789+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:31:00.077789+0000","last_undegraded":"2024-04-26T12:31:00.077789+0000","last_fullsized":"2024-04-26T12:31:00.077789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"85'356","reported_seq":390,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.259385+0000","last_change":"2024-04-26T12:31:12.259503+0000","last_active":"2024-04-26T12:31:12.259385+0000","last_peered":"2024-04-26T12:31:12.259385+0000","last_clean":"2024-04-26T12:31:12.259385+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:31:12.259385+0000","last_undegraded":"2024-04-26T12:31:12.259385+0000","last_fullsized":"2024-04-26T12:31:12.259385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'356","last_scrub_stamp":"2024-04-26T12:31:12.259359+0000","last_deep_scrub":"85'356","last_deep_scrub_stamp":"2024-04-26T12:31:12.259359+0000","last_clean_scrub_stamp":"2024-04-26T12:31:12.259359+0000","objects_scrubbed":1,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:29.053825+0000","scrub_duration":0.015931049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":721,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077641+0000","last_change":"2024-04-26T12:30:46.034642+0000","last_active":"2024-04-26T12:31:00.077641+0000","last_peered":"2024-04-26T12:31:00.077641+0000","last_clean":"2024-04-26T12:31:00.077641+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:31:00.077641+0000","last_undegraded":"2024-04-26T12:31:00.077641+0000","last_fullsized":"2024-04-26T12:31:00.077641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":168,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078544+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:31:00.078544+0000","last_peered":"2024-04-26T12:31:00.078544+0000","last_clean":"2024-04-26T12:31:00.078544+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:31:00.078544+0000","last_undegraded":"2024-04-26T12:31:00.078544+0000","last_fullsized":"2024-04-26T12:31:00.078544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":512,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077916+0000","last_change":"2024-04-26T12:30:45.022716+0000","last_active":"2024-04-26T12:31:00.077916+0000","last_peered":"2024-04-26T12:31:00.077916+0000","last_clean":"2024-04-26T12:31:00.077916+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:31:00.077916+0000","last_undegraded":"2024-04-26T12:31:00.077916+0000","last_fullsized":"2024-04-26T12:31:00.077916+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"85'380","reported_seq":457,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.301720+0000","last_change":"2024-04-26T12:31:26.301826+0000","last_active":"2024-04-26T12:31:26.301720+0000","last_peered":"2024-04-26T12:31:26.301720+0000","last_clean":"2024-04-26T12:31:26.301720+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:31:26.301720+0000","last_undegraded":"2024-04-26T12:31:26.301720+0000","last_fullsized":"2024-04-26T12:31:26.301720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'380","last_scrub_stamp":"2024-04-26T12:31:26.301693+0000","last_deep_scrub":"85'380","last_deep_scrub_stamp":"2024-04-26T12:31:26.301693+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.301693+0000","objects_scrubbed":6,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:55.160179+0000","scrub_duration":0.02593227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":518,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.325418+0000","last_change":"2024-04-26T12:31:25.325525+0000","last_active":"2024-04-26T12:31:25.325418+0000","last_peered":"2024-04-26T12:31:25.325418+0000","last_clean":"2024-04-26T12:31:25.325418+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:31:25.325418+0000","last_undegraded":"2024-04-26T12:31:25.325418+0000","last_fullsized":"2024-04-26T12:31:25.325418+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:25.325392+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:25.325392+0000","last_clean_scrub_stamp":"2024-04-26T12:31:25.325392+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:47.712840+0000","scrub_duration":0.0026314070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":649,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078496+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:31:00.078496+0000","last_peered":"2024-04-26T12:31:00.078496+0000","last_clean":"2024-04-26T12:31:00.078496+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:31:00.078496+0000","last_undegraded":"2024-04-26T12:31:00.078496+0000","last_fullsized":"2024-04-26T12:31:00.078496+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":795,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078308+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:31:00.078308+0000","last_peered":"2024-04-26T12:31:00.078308+0000","last_clean":"2024-04-26T12:31:00.078308+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:31:00.078308+0000","last_undegraded":"2024-04-26T12:31:00.078308+0000","last_fullsized":"2024-04-26T12:31:00.078308+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077742+0000","last_change":"2024-04-26T12:30:46.089052+0000","last_active":"2024-04-26T12:31:00.077742+0000","last_peered":"2024-04-26T12:31:00.077742+0000","last_clean":"2024-04-26T12:31:00.077742+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:31:00.077742+0000","last_undegraded":"2024-04-26T12:31:00.077742+0000","last_fullsized":"2024-04-26T12:31:00.077742+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":872,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:29.158400+0000","last_change":"2024-04-26T12:31:29.158519+0000","last_active":"2024-04-26T12:31:29.158400+0000","last_peered":"2024-04-26T12:31:29.158400+0000","last_clean":"2024-04-26T12:31:29.158400+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:31:29.158400+0000","last_undegraded":"2024-04-26T12:31:29.158400+0000","last_fullsized":"2024-04-26T12:31:29.158400+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'390","last_scrub_stamp":"2024-04-26T12:31:29.158376+0000","last_deep_scrub":"60'390","last_deep_scrub_stamp":"2024-04-26T12:31:29.158376+0000","last_clean_scrub_stamp":"2024-04-26T12:31:29.158376+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:29.361899+0000","scrub_duration":0.0022476710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":139,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077944+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:31:00.077944+0000","last_peered":"2024-04-26T12:31:00.077944+0000","last_clean":"2024-04-26T12:31:00.077944+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:31:00.077944+0000","last_undegraded":"2024-04-26T12:31:00.077944+0000","last_fullsized":"2024-04-26T12:31:00.077944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":501,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.079002+0000","last_change":"2024-04-26T12:30:59.083411+0000","last_active":"2024-04-26T12:31:00.079002+0000","last_peered":"2024-04-26T12:31:00.079002+0000","last_clean":"2024-04-26T12:31:00.079002+0000","last_became_active":"2024-04-26T12:30:59.081424+0000","last_became_peered":"2024-04-26T12:30:59.081424+0000","last_unstale":"2024-04-26T12:31:00.079002+0000","last_undegraded":"2024-04-26T12:31:00.079002+0000","last_fullsized":"2024-04-26T12:31:00.079002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'54","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078021+0000","last_change":"2024-04-26T12:30:46.082166+0000","last_active":"2024-04-26T12:31:00.078021+0000","last_peered":"2024-04-26T12:31:00.078021+0000","last_clean":"2024-04-26T12:31:00.078021+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:31:00.078021+0000","last_undegraded":"2024-04-26T12:31:00.078021+0000","last_fullsized":"2024-04-26T12:31:00.078021+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":539,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.079167+0000","last_change":"2024-04-26T12:30:59.084548+0000","last_active":"2024-04-26T12:31:00.079167+0000","last_peered":"2024-04-26T12:31:00.079167+0000","last_clean":"2024-04-26T12:31:00.079167+0000","last_became_active":"2024-04-26T12:30:59.081463+0000","last_became_peered":"2024-04-26T12:30:59.081463+0000","last_unstale":"2024-04-26T12:31:00.079167+0000","last_undegraded":"2024-04-26T12:31:00.079167+0000","last_fullsized":"2024-04-26T12:31:00.079167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"58'186","reported_seq":210,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078920+0000","last_change":"2024-04-26T12:30:46.080074+0000","last_active":"2024-04-26T12:31:00.078920+0000","last_peered":"2024-04-26T12:31:00.078920+0000","last_clean":"2024-04-26T12:31:00.078920+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:31:00.078920+0000","last_undegraded":"2024-04-26T12:31:00.078920+0000","last_fullsized":"2024-04-26T12:31:00.078920+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":533,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183956+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:31:13.183956+0000","last_peered":"2024-04-26T12:31:13.183956+0000","last_clean":"2024-04-26T12:31:13.183956+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:31:13.183956+0000","last_undegraded":"2024-04-26T12:31:13.183956+0000","last_fullsized":"2024-04-26T12:31:13.183956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":442,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183744+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:31:13.183744+0000","last_peered":"2024-04-26T12:31:13.183744+0000","last_clean":"2024-04-26T12:31:13.183744+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:31:13.183744+0000","last_undegraded":"2024-04-26T12:31:13.183744+0000","last_fullsized":"2024-04-26T12:31:13.183744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":978,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183896+0000","last_change":"2024-04-26T12:30:52.078990+0000","last_active":"2024-04-26T12:31:13.183896+0000","last_peered":"2024-04-26T12:31:13.183896+0000","last_clean":"2024-04-26T12:31:13.183896+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:31:13.183896+0000","last_undegraded":"2024-04-26T12:31:13.183896+0000","last_fullsized":"2024-04-26T12:31:13.183896+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":515,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078761+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:31:00.078761+0000","last_peered":"2024-04-26T12:31:00.078761+0000","last_clean":"2024-04-26T12:31:00.078761+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:31:00.078761+0000","last_undegraded":"2024-04-26T12:31:00.078761+0000","last_fullsized":"2024-04-26T12:31:00.078761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":503,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.254729+0000","last_change":"2024-04-26T12:31:22.254831+0000","last_active":"2024-04-26T12:31:22.254729+0000","last_peered":"2024-04-26T12:31:22.254729+0000","last_clean":"2024-04-26T12:31:22.254729+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:31:22.254729+0000","last_undegraded":"2024-04-26T12:31:22.254729+0000","last_fullsized":"2024-04-26T12:31:22.254729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:31:22.254705+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:31:22.254705+0000","last_clean_scrub_stamp":"2024-04-26T12:31:22.254705+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:09.032368+0000","scrub_duration":0.0022442209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149539+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:12.149539+0000","last_peered":"2024-04-26T12:31:12.149539+0000","last_clean":"2024-04-26T12:31:12.149539+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:31:12.149539+0000","last_undegraded":"2024-04-26T12:31:12.149539+0000","last_fullsized":"2024-04-26T12:31:12.149539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":560,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078080+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:31:00.078080+0000","last_peered":"2024-04-26T12:31:00.078080+0000","last_clean":"2024-04-26T12:31:00.078080+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:31:00.078080+0000","last_undegraded":"2024-04-26T12:31:00.078080+0000","last_fullsized":"2024-04-26T12:31:00.078080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":253,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077791+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:31:00.077791+0000","last_peered":"2024-04-26T12:31:00.077791+0000","last_clean":"2024-04-26T12:31:00.077791+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:31:00.077791+0000","last_undegraded":"2024-04-26T12:31:00.077791+0000","last_fullsized":"2024-04-26T12:31:00.077791+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":538,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078279+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:31:00.078279+0000","last_peered":"2024-04-26T12:31:00.078279+0000","last_clean":"2024-04-26T12:31:00.078279+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:31:00.078279+0000","last_undegraded":"2024-04-26T12:31:00.078279+0000","last_fullsized":"2024-04-26T12:31:00.078279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":270,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149551+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:31:12.149551+0000","last_peered":"2024-04-26T12:31:12.149551+0000","last_clean":"2024-04-26T12:31:12.149551+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:31:12.149551+0000","last_undegraded":"2024-04-26T12:31:12.149551+0000","last_fullsized":"2024-04-26T12:31:12.149551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:20.233238+0000","last_change":"2024-04-26T12:31:20.233368+0000","last_active":"2024-04-26T12:31:20.233238+0000","last_peered":"2024-04-26T12:31:20.233238+0000","last_clean":"2024-04-26T12:31:20.233238+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:31:20.233238+0000","last_undegraded":"2024-04-26T12:31:20.233238+0000","last_fullsized":"2024-04-26T12:31:20.233238+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:31:20.233200+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:31:20.233200+0000","last_clean_scrub_stamp":"2024-04-26T12:31:20.233200+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:03.311719+0000","scrub_duration":0.0025721490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183710+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:31:13.183710+0000","last_peered":"2024-04-26T12:31:13.183710+0000","last_clean":"2024-04-26T12:31:13.183710+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:31:13.183710+0000","last_undegraded":"2024-04-26T12:31:13.183710+0000","last_fullsized":"2024-04-26T12:31:13.183710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":494,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149680+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:31:12.149680+0000","last_peered":"2024-04-26T12:31:12.149680+0000","last_clean":"2024-04-26T12:31:12.149680+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:31:12.149680+0000","last_undegraded":"2024-04-26T12:31:12.149680+0000","last_fullsized":"2024-04-26T12:31:12.149680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":590,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183740+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:31:13.183740+0000","last_peered":"2024-04-26T12:31:13.183740+0000","last_clean":"2024-04-26T12:31:13.183740+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:31:13.183740+0000","last_undegraded":"2024-04-26T12:31:13.183740+0000","last_fullsized":"2024-04-26T12:31:13.183740+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":499,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.079065+0000","last_change":"2024-04-26T12:30:55.090354+0000","last_active":"2024-04-26T12:31:00.079065+0000","last_peered":"2024-04-26T12:31:00.079065+0000","last_clean":"2024-04-26T12:31:00.079065+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:31:00.079065+0000","last_undegraded":"2024-04-26T12:31:00.079065+0000","last_fullsized":"2024-04-26T12:31:00.079065+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:23.972595+0000","last_change":"2024-04-26T12:31:23.972717+0000","last_active":"2024-04-26T12:31:23.972595+0000","last_peered":"2024-04-26T12:31:23.972595+0000","last_clean":"2024-04-26T12:31:23.972595+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:31:23.972595+0000","last_undegraded":"2024-04-26T12:31:23.972595+0000","last_fullsized":"2024-04-26T12:31:23.972595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:23.972571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:23.972571+0000","last_clean_scrub_stamp":"2024-04-26T12:31:23.972571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:28.883121+0000","scrub_duration":0.0019705149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"58'454","reported_seq":481,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078851+0000","last_change":"2024-04-26T12:30:46.079367+0000","last_active":"2024-04-26T12:31:00.078851+0000","last_peered":"2024-04-26T12:31:00.078851+0000","last_clean":"2024-04-26T12:31:00.078851+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:31:00.078851+0000","last_undegraded":"2024-04-26T12:31:00.078851+0000","last_fullsized":"2024-04-26T12:31:00.078851+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":474,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364337+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:31:05.364337+0000","last_peered":"2024-04-26T12:31:05.364337+0000","last_clean":"2024-04-26T12:31:05.364337+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:31:05.364337+0000","last_undegraded":"2024-04-26T12:31:05.364337+0000","last_fullsized":"2024-04-26T12:31:05.364337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.331035+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:31:00.331035+0000","last_peered":"2024-04-26T12:31:00.331035+0000","last_clean":"2024-04-26T12:31:00.331035+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:31:00.331035+0000","last_undegraded":"2024-04-26T12:31:00.331035+0000","last_fullsized":"2024-04-26T12:31:00.331035+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.331856+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:05.331856+0000","last_peered":"2024-04-26T12:31:05.331856+0000","last_clean":"2024-04-26T12:31:05.331856+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:31:05.331856+0000","last_undegraded":"2024-04-26T12:31:05.331856+0000","last_fullsized":"2024-04-26T12:31:05.331856+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":500,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078329+0000","last_change":"2024-04-26T12:30:46.033999+0000","last_active":"2024-04-26T12:31:00.078329+0000","last_peered":"2024-04-26T12:31:00.078329+0000","last_clean":"2024-04-26T12:31:00.078329+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:31:00.078329+0000","last_undegraded":"2024-04-26T12:31:00.078329+0000","last_fullsized":"2024-04-26T12:31:00.078329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077929+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:31:00.077929+0000","last_peered":"2024-04-26T12:31:00.077929+0000","last_clean":"2024-04-26T12:31:00.077929+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:31:00.077929+0000","last_undegraded":"2024-04-26T12:31:00.077929+0000","last_fullsized":"2024-04-26T12:31:00.077929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":399,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077767+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:31:00.077767+0000","last_peered":"2024-04-26T12:31:00.077767+0000","last_clean":"2024-04-26T12:31:00.077767+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:31:00.077767+0000","last_undegraded":"2024-04-26T12:31:00.077767+0000","last_fullsized":"2024-04-26T12:31:00.077767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":433,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078924+0000","last_change":"2024-04-26T12:30:54.081099+0000","last_active":"2024-04-26T12:31:00.078924+0000","last_peered":"2024-04-26T12:31:00.078924+0000","last_clean":"2024-04-26T12:31:00.078924+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:31:00.078924+0000","last_undegraded":"2024-04-26T12:31:00.078924+0000","last_fullsized":"2024-04-26T12:31:00.078924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078392+0000","last_change":"2024-04-26T12:30:46.082961+0000","last_active":"2024-04-26T12:31:00.078392+0000","last_peered":"2024-04-26T12:31:00.078392+0000","last_clean":"2024-04-26T12:31:00.078392+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:31:00.078392+0000","last_undegraded":"2024-04-26T12:31:00.078392+0000","last_fullsized":"2024-04-26T12:31:00.078392+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":264,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077875+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:31:00.077875+0000","last_peered":"2024-04-26T12:31:00.077875+0000","last_clean":"2024-04-26T12:31:00.077875+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:31:00.077875+0000","last_undegraded":"2024-04-26T12:31:00.077875+0000","last_fullsized":"2024-04-26T12:31:00.077875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":599,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078026+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:31:00.078026+0000","last_peered":"2024-04-26T12:31:00.078026+0000","last_clean":"2024-04-26T12:31:00.078026+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:31:00.078026+0000","last_undegraded":"2024-04-26T12:31:00.078026+0000","last_fullsized":"2024-04-26T12:31:00.078026+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":566,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.331963+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:31:05.331963+0000","last_peered":"2024-04-26T12:31:05.331963+0000","last_clean":"2024-04-26T12:31:05.331963+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:31:05.331963+0000","last_undegraded":"2024-04-26T12:31:05.331963+0000","last_fullsized":"2024-04-26T12:31:05.331963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077904+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:31:00.077904+0000","last_peered":"2024-04-26T12:31:00.077904+0000","last_clean":"2024-04-26T12:31:00.077904+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:31:00.077904+0000","last_undegraded":"2024-04-26T12:31:00.077904+0000","last_fullsized":"2024-04-26T12:31:00.077904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"85'106","reported_seq":235,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:24.978985+0000","last_change":"2024-04-26T12:31:24.979101+0000","last_active":"2024-04-26T12:31:24.978985+0000","last_peered":"2024-04-26T12:31:24.978985+0000","last_clean":"2024-04-26T12:31:24.978985+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:31:24.978985+0000","last_undegraded":"2024-04-26T12:31:24.978985+0000","last_fullsized":"2024-04-26T12:31:24.978985+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'106","last_scrub_stamp":"2024-04-26T12:31:24.978960+0000","last_deep_scrub":"85'106","last_deep_scrub_stamp":"2024-04-26T12:31:24.978960+0000","last_clean_scrub_stamp":"2024-04-26T12:31:24.978960+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:36.841285+0000","scrub_duration":0.0061135809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":969,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183862+0000","last_change":"2024-04-26T12:30:57.078892+0000","last_active":"2024-04-26T12:31:13.183862+0000","last_peered":"2024-04-26T12:31:13.183862+0000","last_clean":"2024-04-26T12:31:13.183862+0000","last_became_active":"2024-04-26T12:30:57.077779+0000","last_became_peered":"2024-04-26T12:30:57.077779+0000","last_unstale":"2024-04-26T12:31:13.183862+0000","last_undegraded":"2024-04-26T12:31:13.183862+0000","last_fullsized":"2024-04-26T12:31:13.183862+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.363755+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:31:00.363755+0000","last_peered":"2024-04-26T12:31:00.363755+0000","last_clean":"2024-04-26T12:31:00.363755+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:31:00.363755+0000","last_undegraded":"2024-04-26T12:31:00.363755+0000","last_fullsized":"2024-04-26T12:31:00.363755+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078634+0000","last_change":"2024-04-26T12:30:41.026137+0000","last_active":"2024-04-26T12:31:00.078634+0000","last_peered":"2024-04-26T12:31:00.078634+0000","last_clean":"2024-04-26T12:31:00.078634+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:31:00.078634+0000","last_undegraded":"2024-04-26T12:31:00.078634+0000","last_fullsized":"2024-04-26T12:31:00.078634+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":521,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364366+0000","last_change":"2024-04-26T12:26:53.265604+0000","last_active":"2024-04-26T12:31:05.364366+0000","last_peered":"2024-04-26T12:31:05.364366+0000","last_clean":"2024-04-26T12:31:05.364366+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:31:05.364366+0000","last_undegraded":"2024-04-26T12:31:05.364366+0000","last_fullsized":"2024-04-26T12:31:05.364366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078804+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:31:00.078804+0000","last_peered":"2024-04-26T12:31:00.078804+0000","last_clean":"2024-04-26T12:31:00.078804+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:31:00.078804+0000","last_undegraded":"2024-04-26T12:31:00.078804+0000","last_fullsized":"2024-04-26T12:31:00.078804+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.965267+0000","last_change":"2024-04-26T12:31:26.965364+0000","last_active":"2024-04-26T12:31:26.965267+0000","last_peered":"2024-04-26T12:31:26.965267+0000","last_clean":"2024-04-26T12:31:26.965267+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:31:26.965267+0000","last_undegraded":"2024-04-26T12:31:26.965267+0000","last_fullsized":"2024-04-26T12:31:26.965267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:26.965245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:26.965245+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.965245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:27.319599+0000","scrub_duration":0.0017909270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":501,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.084805+0000","last_change":"2024-04-26T12:31:00.081711+0000","last_active":"2024-04-26T12:31:00.084805+0000","last_peered":"2024-04-26T12:31:00.084805+0000","last_clean":"2024-04-26T12:31:00.084805+0000","last_became_active":"2024-04-26T12:31:00.079504+0000","last_became_peered":"2024-04-26T12:31:00.079504+0000","last_unstale":"2024-04-26T12:31:00.084805+0000","last_undegraded":"2024-04-26T12:31:00.084805+0000","last_fullsized":"2024-04-26T12:31:00.084805+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":69,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.079008+0000","last_change":"2024-04-26T12:30:46.080509+0000","last_active":"2024-04-26T12:31:00.079008+0000","last_peered":"2024-04-26T12:31:00.079008+0000","last_clean":"2024-04-26T12:31:00.079008+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:31:00.079008+0000","last_undegraded":"2024-04-26T12:31:00.079008+0000","last_fullsized":"2024-04-26T12:31:00.079008+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"85'83","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.000547+0000","last_change":"2024-04-26T12:31:14.000699+0000","last_active":"2024-04-26T12:31:14.000547+0000","last_peered":"2024-04-26T12:31:14.000547+0000","last_clean":"2024-04-26T12:31:14.000547+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:31:14.000547+0000","last_undegraded":"2024-04-26T12:31:14.000547+0000","last_fullsized":"2024-04-26T12:31:14.000547+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'83","last_scrub_stamp":"2024-04-26T12:31:14.000521+0000","last_deep_scrub":"85'83","last_deep_scrub_stamp":"2024-04-26T12:31:14.000521+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.000521+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:11.290115+0000","scrub_duration":0.0069472290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":607,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364304+0000","last_change":"2024-04-26T12:26:53.260849+0000","last_active":"2024-04-26T12:31:05.364304+0000","last_peered":"2024-04-26T12:31:05.364304+0000","last_clean":"2024-04-26T12:31:05.364304+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:31:05.364304+0000","last_undegraded":"2024-04-26T12:31:05.364304+0000","last_fullsized":"2024-04-26T12:31:05.364304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":174,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077958+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:31:00.077958+0000","last_peered":"2024-04-26T12:31:00.077958+0000","last_clean":"2024-04-26T12:31:00.077958+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:31:00.077958+0000","last_undegraded":"2024-04-26T12:31:00.077958+0000","last_fullsized":"2024-04-26T12:31:00.077958+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":867,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:28.143113+0000","last_change":"2024-04-26T12:31:28.143238+0000","last_active":"2024-04-26T12:31:28.143113+0000","last_peered":"2024-04-26T12:31:28.143113+0000","last_clean":"2024-04-26T12:31:28.143113+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:31:28.143113+0000","last_undegraded":"2024-04-26T12:31:28.143113+0000","last_fullsized":"2024-04-26T12:31:28.143113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:31:28.143070+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:31:28.143070+0000","last_clean_scrub_stamp":"2024-04-26T12:31:28.143070+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:55.111541+0000","scrub_duration":0.0024435799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":312,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078444+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:31:00.078444+0000","last_peered":"2024-04-26T12:31:00.078444+0000","last_clean":"2024-04-26T12:31:00.078444+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:31:00.078444+0000","last_undegraded":"2024-04-26T12:31:00.078444+0000","last_fullsized":"2024-04-26T12:31:00.078444+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":799,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078233+0000","last_change":"2024-04-26T12:30:48.088039+0000","last_active":"2024-04-26T12:31:00.078233+0000","last_peered":"2024-04-26T12:31:00.078233+0000","last_clean":"2024-04-26T12:31:00.078233+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:31:00.078233+0000","last_undegraded":"2024-04-26T12:31:00.078233+0000","last_fullsized":"2024-04-26T12:31:00.078233+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"58'314","reported_seq":396,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078636+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:31:00.078636+0000","last_peered":"2024-04-26T12:31:00.078636+0000","last_clean":"2024-04-26T12:31:00.078636+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:31:00.078636+0000","last_undegraded":"2024-04-26T12:31:00.078636+0000","last_fullsized":"2024-04-26T12:31:00.078636+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":873,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078565+0000","last_change":"2024-04-26T12:30:52.079092+0000","last_active":"2024-04-26T12:31:00.078565+0000","last_peered":"2024-04-26T12:31:00.078565+0000","last_clean":"2024-04-26T12:31:00.078565+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:31:00.078565+0000","last_undegraded":"2024-04-26T12:31:00.078565+0000","last_fullsized":"2024-04-26T12:31:00.078565+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"85'77","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.984350+0000","last_change":"2024-04-26T12:31:14.984448+0000","last_active":"2024-04-26T12:31:14.984350+0000","last_peered":"2024-04-26T12:31:14.984350+0000","last_clean":"2024-04-26T12:31:14.984350+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:31:14.984350+0000","last_undegraded":"2024-04-26T12:31:14.984350+0000","last_fullsized":"2024-04-26T12:31:14.984350+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'77","last_scrub_stamp":"2024-04-26T12:31:14.984325+0000","last_deep_scrub":"85'77","last_deep_scrub_stamp":"2024-04-26T12:31:14.984325+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.984325+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:53.595109+0000","scrub_duration":0.010871390999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":543,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077702+0000","last_change":"2024-04-26T12:28:00.707724+0000","last_active":"2024-04-26T12:31:00.077702+0000","last_peered":"2024-04-26T12:31:00.077702+0000","last_clean":"2024-04-26T12:31:00.077702+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:31:00.077702+0000","last_undegraded":"2024-04-26T12:31:00.077702+0000","last_fullsized":"2024-04-26T12:31:00.077702+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078962+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:31:00.078962+0000","last_peered":"2024-04-26T12:31:00.078962+0000","last_clean":"2024-04-26T12:31:00.078962+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:31:00.078962+0000","last_undegraded":"2024-04-26T12:31:00.078962+0000","last_fullsized":"2024-04-26T12:31:00.078962+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":979,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:18.220035+0000","last_change":"2024-04-26T12:31:18.220147+0000","last_active":"2024-04-26T12:31:18.220035+0000","last_peered":"2024-04-26T12:31:18.220035+0000","last_clean":"2024-04-26T12:31:18.220035+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:31:18.220035+0000","last_undegraded":"2024-04-26T12:31:18.220035+0000","last_fullsized":"2024-04-26T12:31:18.220035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'473","last_scrub_stamp":"2024-04-26T12:31:18.220009+0000","last_deep_scrub":"60'473","last_deep_scrub_stamp":"2024-04-26T12:31:18.220009+0000","last_clean_scrub_stamp":"2024-04-26T12:31:18.220009+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:07.523749+0000","scrub_duration":0.0022384369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":864,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078030+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:31:00.078030+0000","last_peered":"2024-04-26T12:31:00.078030+0000","last_clean":"2024-04-26T12:31:00.078030+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:31:00.078030+0000","last_undegraded":"2024-04-26T12:31:00.078030+0000","last_fullsized":"2024-04-26T12:31:00.078030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":529,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078046+0000","last_change":"2024-04-26T12:30:54.080153+0000","last_active":"2024-04-26T12:31:00.078046+0000","last_peered":"2024-04-26T12:31:00.078046+0000","last_clean":"2024-04-26T12:31:00.078046+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:31:00.078046+0000","last_undegraded":"2024-04-26T12:31:00.078046+0000","last_fullsized":"2024-04-26T12:31:00.078046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":630,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364349+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:31:05.364349+0000","last_peered":"2024-04-26T12:31:05.364349+0000","last_clean":"2024-04-26T12:31:05.364349+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:31:05.364349+0000","last_undegraded":"2024-04-26T12:31:05.364349+0000","last_fullsized":"2024-04-26T12:31:05.364349+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":516,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078249+0000","last_change":"2024-04-26T12:30:50.086765+0000","last_active":"2024-04-26T12:31:00.078249+0000","last_peered":"2024-04-26T12:31:00.078249+0000","last_clean":"2024-04-26T12:31:00.078249+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:31:00.078249+0000","last_undegraded":"2024-04-26T12:31:00.078249+0000","last_fullsized":"2024-04-26T12:31:00.078249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":513,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183993+0000","last_change":"2024-04-26T12:26:53.265512+0000","last_active":"2024-04-26T12:31:13.183993+0000","last_peered":"2024-04-26T12:31:13.183993+0000","last_clean":"2024-04-26T12:31:13.183993+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:31:13.183993+0000","last_undegraded":"2024-04-26T12:31:13.183993+0000","last_fullsized":"2024-04-26T12:31:13.183993+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79134720,"data_stored":256449018,"data_compressed":38844374,"data_compressed_allocated":48693248,"data_compressed_original":226074624,"omap_allocated":5343,"internal_metadata":0},"log_size":7518,"ondisk_log_size":7518,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130112,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94241728,"statfs":{"total":96636764160,"available":96503529472,"internally_reserved":0,"allocated":31711232,"data_stored":85785287,"data_compressed":12062822,"data_compressed_allocated":15765504,"data_compressed_original":70336512,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.23599999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Apr 26 12:27:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.53100000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131332,"kb_used_data":32188,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94240508,"statfs":{"total":96636764160,"available":96502280192,"internally_reserved":0,"allocated":32960512,"data_stored":91451171,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:27:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Apr 26 12:30:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.437,"15min":0.45100000000000001},"min":{"1min":0.30399999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.625,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.191,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.52000000000000002}]}]},{"osd":1,"up_from":64,"seq":274877906956,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62336,"kb_used_data":16760,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309504,"statfs":{"total":96636764160,"available":96572932096,"internally_reserved":0,"allocated":17162240,"data_stored":81548386,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30789632,"data_stored":84809889,"data_compressed":12028675,"data_compressed_allocated":15720448,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:33.956 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.956 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.956 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.956 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.956 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.956 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.956 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.956 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.957 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.957 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.957 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.957 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.957 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.957 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.957 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.957 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.957 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.958 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.958 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.958 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.958 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.958 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.958 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.958 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.958 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.958 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.959 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.959 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.959 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.959 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.959 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.959 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.959 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.959 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.959 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.960 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.960 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.960 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.960 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.960 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.960 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.960 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.960 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.960 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.961 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.961 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.961 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.961 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.961 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.961 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.961 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.961 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.962 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.962 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.962 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.962 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.962 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.962 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.962 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.962 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.962 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.963 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.963 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.963 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:26:45.798066+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.963 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.963 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.963 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.963 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.963 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.963 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.964 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.964 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.964 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.964 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.964 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.964 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.964 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.964 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.964 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.965 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.965 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.965 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.965 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.965 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.965 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.965 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.965 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:33.965 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:31:53.966 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:31:54.328 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:31:54.330 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:31:54.340 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-04-26T12:31:53.372091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6546,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":323780,"kb_used_data":79916,"kb_used_omap":9,"kb_used_meta":243830,"kb_avail":282791740,"statfs":{"total":289910292480,"available":289578741760,"internally_reserved":0,"allocated":81833984,"data_stored":258784844,"data_compressed":38912668,"data_compressed_allocated":48783360,"data_compressed_original":227221504,"omap_allocated":10125,"internal_metadata":249682035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003571"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":913,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:18.003472+0000","last_change":"2024-04-26T12:31:18.003585+0000","last_active":"2024-04-26T12:31:18.003472+0000","last_peered":"2024-04-26T12:31:18.003472+0000","last_clean":"2024-04-26T12:31:18.003472+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:31:18.003472+0000","last_undegraded":"2024-04-26T12:31:18.003472+0000","last_fullsized":"2024-04-26T12:31:18.003472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:18.003445+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:18.003445+0000","last_clean_scrub_stamp":"2024-04-26T12:31:18.003445+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:47.444600+0000","scrub_duration":0.0019588980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":958,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364439+0000","last_change":"2024-04-26T12:30:56.085870+0000","last_active":"2024-04-26T12:31:05.364439+0000","last_peered":"2024-04-26T12:31:05.364439+0000","last_clean":"2024-04-26T12:31:05.364439+0000","last_became_active":"2024-04-26T12:30:56.084642+0000","last_became_peered":"2024-04-26T12:30:56.084642+0000","last_unstale":"2024-04-26T12:31:05.364439+0000","last_undegraded":"2024-04-26T12:31:05.364439+0000","last_fullsized":"2024-04-26T12:31:05.364439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":496,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078732+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:31:00.078732+0000","last_peered":"2024-04-26T12:31:00.078732+0000","last_clean":"2024-04-26T12:31:00.078732+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:31:00.078732+0000","last_undegraded":"2024-04-26T12:31:00.078732+0000","last_fullsized":"2024-04-26T12:31:00.078732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":879,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:41.224563+0000","last_change":"2024-04-26T12:31:41.224731+0000","last_active":"2024-04-26T12:31:41.224563+0000","last_peered":"2024-04-26T12:31:41.224563+0000","last_clean":"2024-04-26T12:31:41.224563+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:31:41.224563+0000","last_undegraded":"2024-04-26T12:31:41.224563+0000","last_fullsized":"2024-04-26T12:31:41.224563+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:31:41.224537+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:31:41.224537+0000","last_clean_scrub_stamp":"2024-04-26T12:31:41.224537+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:31.770929+0000","scrub_duration":0.0021526079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":951,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:44.166035+0000","last_change":"2024-04-26T12:31:44.166192+0000","last_active":"2024-04-26T12:31:44.166035+0000","last_peered":"2024-04-26T12:31:44.166035+0000","last_clean":"2024-04-26T12:31:44.166035+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:31:44.166035+0000","last_undegraded":"2024-04-26T12:31:44.166035+0000","last_fullsized":"2024-04-26T12:31:44.166035+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'430","last_scrub_stamp":"2024-04-26T12:31:44.165994+0000","last_deep_scrub":"60'430","last_deep_scrub_stamp":"2024-04-26T12:31:44.165994+0000","last_clean_scrub_stamp":"2024-04-26T12:31:44.165994+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:15.166663+0000","scrub_duration":0.0026340479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":489,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:15.202084+0000","last_change":"2024-04-26T12:31:15.202198+0000","last_active":"2024-04-26T12:31:15.202084+0000","last_peered":"2024-04-26T12:31:15.202084+0000","last_clean":"2024-04-26T12:31:15.202084+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:31:15.202084+0000","last_undegraded":"2024-04-26T12:31:15.202084+0000","last_fullsized":"2024-04-26T12:31:15.202084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:31:15.202057+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:31:15.202057+0000","last_clean_scrub_stamp":"2024-04-26T12:31:15.202057+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:36.672446+0000","scrub_duration":0.002466312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1029,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078177+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:31:00.078177+0000","last_peered":"2024-04-26T12:31:00.078177+0000","last_clean":"2024-04-26T12:31:00.078177+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:31:00.078177+0000","last_undegraded":"2024-04-26T12:31:00.078177+0000","last_fullsized":"2024-04-26T12:31:00.078177+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":768,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077732+0000","last_change":"2024-04-26T12:30:49.082511+0000","last_active":"2024-04-26T12:31:00.077732+0000","last_peered":"2024-04-26T12:31:00.077732+0000","last_clean":"2024-04-26T12:31:00.077732+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:31:00.077732+0000","last_undegraded":"2024-04-26T12:31:00.077732+0000","last_fullsized":"2024-04-26T12:31:00.077732+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":510,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:44.945930+0000","last_change":"2024-04-26T12:31:44.946041+0000","last_active":"2024-04-26T12:31:44.945930+0000","last_peered":"2024-04-26T12:31:44.945930+0000","last_clean":"2024-04-26T12:31:44.945930+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:31:44.945930+0000","last_undegraded":"2024-04-26T12:31:44.945930+0000","last_fullsized":"2024-04-26T12:31:44.945930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'417","last_scrub_stamp":"2024-04-26T12:31:44.945906+0000","last_deep_scrub":"60'417","last_deep_scrub_stamp":"2024-04-26T12:31:44.945906+0000","last_clean_scrub_stamp":"2024-04-26T12:31:44.945906+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:35.883858+0000","scrub_duration":0.001923143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":913,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.184127+0000","last_change":"2024-04-26T12:30:56.087672+0000","last_active":"2024-04-26T12:31:13.184127+0000","last_peered":"2024-04-26T12:31:13.184127+0000","last_clean":"2024-04-26T12:31:13.184127+0000","last_became_active":"2024-04-26T12:30:56.085904+0000","last_became_peered":"2024-04-26T12:30:56.085904+0000","last_unstale":"2024-04-26T12:31:13.184127+0000","last_undegraded":"2024-04-26T12:31:13.184127+0000","last_fullsized":"2024-04-26T12:31:13.184127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":606,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.239455+0000","last_change":"2024-04-26T12:31:14.239557+0000","last_active":"2024-04-26T12:31:14.239455+0000","last_peered":"2024-04-26T12:31:14.239455+0000","last_clean":"2024-04-26T12:31:14.239455+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:31:14.239455+0000","last_undegraded":"2024-04-26T12:31:14.239455+0000","last_fullsized":"2024-04-26T12:31:14.239455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'366","last_scrub_stamp":"2024-04-26T12:31:14.239429+0000","last_deep_scrub":"60'366","last_deep_scrub_stamp":"2024-04-26T12:31:14.239429+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.239429+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:48.735192+0000","scrub_duration":0.0022088089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":514,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.184090+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:31:13.184090+0000","last_peered":"2024-04-26T12:31:13.184090+0000","last_clean":"2024-04-26T12:31:13.184090+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:31:13.184090+0000","last_undegraded":"2024-04-26T12:31:13.184090+0000","last_fullsized":"2024-04-26T12:31:13.184090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":885,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.184037+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:31:13.184037+0000","last_peered":"2024-04-26T12:31:13.184037+0000","last_clean":"2024-04-26T12:31:13.184037+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:31:13.184037+0000","last_undegraded":"2024-04-26T12:31:13.184037+0000","last_fullsized":"2024-04-26T12:31:13.184037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":522,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149863+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:31:12.149863+0000","last_peered":"2024-04-26T12:31:12.149863+0000","last_clean":"2024-04-26T12:31:12.149863+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:31:12.149863+0000","last_undegraded":"2024-04-26T12:31:12.149863+0000","last_fullsized":"2024-04-26T12:31:12.149863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":541,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077883+0000","last_change":"2024-04-26T12:30:47.080645+0000","last_active":"2024-04-26T12:31:00.077883+0000","last_peered":"2024-04-26T12:31:00.077883+0000","last_clean":"2024-04-26T12:31:00.077883+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:31:00.077883+0000","last_undegraded":"2024-04-26T12:31:00.077883+0000","last_fullsized":"2024-04-26T12:31:00.077883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":927,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077781+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:31:00.077781+0000","last_peered":"2024-04-26T12:31:00.077781+0000","last_clean":"2024-04-26T12:31:00.077781+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:31:00.077781+0000","last_undegraded":"2024-04-26T12:31:00.077781+0000","last_fullsized":"2024-04-26T12:31:00.077781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":505,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.966702+0000","last_change":"2024-04-26T12:31:36.966807+0000","last_active":"2024-04-26T12:31:36.966702+0000","last_peered":"2024-04-26T12:31:36.966702+0000","last_clean":"2024-04-26T12:31:36.966702+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:31:36.966702+0000","last_undegraded":"2024-04-26T12:31:36.966702+0000","last_fullsized":"2024-04-26T12:31:36.966702+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-04-26T12:31:36.966676+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-04-26T12:31:36.966676+0000","last_clean_scrub_stamp":"2024-04-26T12:31:36.966676+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:18.037732+0000","scrub_duration":0.0019413729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":925,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.169611+0000","last_change":"2024-04-26T12:31:36.170108+0000","last_active":"2024-04-26T12:31:36.169611+0000","last_peered":"2024-04-26T12:31:36.169611+0000","last_clean":"2024-04-26T12:31:36.169611+0000","last_became_active":"2024-04-26T12:30:57.083026+0000","last_became_peered":"2024-04-26T12:30:57.083026+0000","last_unstale":"2024-04-26T12:31:36.169611+0000","last_undegraded":"2024-04-26T12:31:36.169611+0000","last_fullsized":"2024-04-26T12:31:36.169611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:36.169585+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:36.169585+0000","last_clean_scrub_stamp":"2024-04-26T12:31:36.169585+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:42.604764+0000","scrub_duration":0.0025888259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":538,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.935524+0000","last_change":"2024-04-26T12:31:37.935658+0000","last_active":"2024-04-26T12:31:37.935524+0000","last_peered":"2024-04-26T12:31:37.935524+0000","last_clean":"2024-04-26T12:31:37.935524+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:31:37.935524+0000","last_undegraded":"2024-04-26T12:31:37.935524+0000","last_fullsized":"2024-04-26T12:31:37.935524+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'434","last_scrub_stamp":"2024-04-26T12:31:37.935496+0000","last_deep_scrub":"60'434","last_deep_scrub_stamp":"2024-04-26T12:31:37.935496+0000","last_clean_scrub_stamp":"2024-04-26T12:31:37.935496+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:23.917082+0000","scrub_duration":0.0023281170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1072,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149835+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:31:12.149835+0000","last_peered":"2024-04-26T12:31:12.149835+0000","last_clean":"2024-04-26T12:31:12.149835+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:31:12.149835+0000","last_undegraded":"2024-04-26T12:31:12.149835+0000","last_fullsized":"2024-04-26T12:31:12.149835+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":954,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149824+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:31:12.149824+0000","last_peered":"2024-04-26T12:31:12.149824+0000","last_clean":"2024-04-26T12:31:12.149824+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:31:12.149824+0000","last_undegraded":"2024-04-26T12:31:12.149824+0000","last_fullsized":"2024-04-26T12:31:12.149824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":593,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:23.051416+0000","last_change":"2024-04-26T12:31:23.051416+0000","last_active":"2024-04-26T12:31:23.051416+0000","last_peered":"2024-04-26T12:31:23.051416+0000","last_clean":"2024-04-26T12:31:23.051416+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:31:23.051416+0000","last_undegraded":"2024-04-26T12:31:23.051416+0000","last_fullsized":"2024-04-26T12:31:23.051416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:31:23.051248+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:31:23.051248+0000","last_clean_scrub_stamp":"2024-04-26T12:31:23.051248+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:26.481350+0000","scrub_duration":0.0028000099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":496,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.087485+0000","last_change":"2024-04-26T12:31:00.082038+0000","last_active":"2024-04-26T12:31:00.087485+0000","last_peered":"2024-04-26T12:31:00.087485+0000","last_clean":"2024-04-26T12:31:00.087485+0000","last_became_active":"2024-04-26T12:31:00.079766+0000","last_became_peered":"2024-04-26T12:31:00.079766+0000","last_unstale":"2024-04-26T12:31:00.087485+0000","last_undegraded":"2024-04-26T12:31:00.087485+0000","last_fullsized":"2024-04-26T12:31:00.087485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":1030,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:38.161560+0000","last_change":"2024-04-26T12:31:38.162058+0000","last_active":"2024-04-26T12:31:38.161560+0000","last_peered":"2024-04-26T12:31:38.161560+0000","last_clean":"2024-04-26T12:31:38.161560+0000","last_became_active":"2024-04-26T12:30:58.078211+0000","last_became_peered":"2024-04-26T12:30:58.078211+0000","last_unstale":"2024-04-26T12:31:38.161560+0000","last_undegraded":"2024-04-26T12:31:38.161560+0000","last_fullsized":"2024-04-26T12:31:38.161560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'446","last_scrub_stamp":"2024-04-26T12:31:38.161525+0000","last_deep_scrub":"60'446","last_deep_scrub_stamp":"2024-04-26T12:31:38.161525+0000","last_clean_scrub_stamp":"2024-04-26T12:31:38.161525+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:54.390254+0000","scrub_duration":0.002528092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":561,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:50.233810+0000","last_change":"2024-04-26T12:31:50.233922+0000","last_active":"2024-04-26T12:31:50.233810+0000","last_peered":"2024-04-26T12:31:50.233810+0000","last_clean":"2024-04-26T12:31:50.233810+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:31:50.233810+0000","last_undegraded":"2024-04-26T12:31:50.233810+0000","last_fullsized":"2024-04-26T12:31:50.233810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-04-26T12:31:50.233783+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-04-26T12:31:50.233783+0000","last_clean_scrub_stamp":"2024-04-26T12:31:50.233783+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:54.618065+0000","scrub_duration":0.0025007240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":597,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.010285+0000","last_change":"2024-04-26T12:31:47.010394+0000","last_active":"2024-04-26T12:31:47.010285+0000","last_peered":"2024-04-26T12:31:47.010285+0000","last_clean":"2024-04-26T12:31:47.010285+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:31:47.010285+0000","last_undegraded":"2024-04-26T12:31:47.010285+0000","last_fullsized":"2024-04-26T12:31:47.010285+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'467","last_scrub_stamp":"2024-04-26T12:31:47.010262+0000","last_deep_scrub":"60'467","last_deep_scrub_stamp":"2024-04-26T12:31:47.010262+0000","last_clean_scrub_stamp":"2024-04-26T12:31:47.010262+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:06.785529+0000","scrub_duration":0.002479153,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":515,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149844+0000","last_change":"2024-04-26T12:26:53.265933+0000","last_active":"2024-04-26T12:31:12.149844+0000","last_peered":"2024-04-26T12:31:12.149844+0000","last_clean":"2024-04-26T12:31:12.149844+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:31:12.149844+0000","last_undegraded":"2024-04-26T12:31:12.149844+0000","last_fullsized":"2024-04-26T12:31:12.149844+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":568,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078077+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:31:00.078077+0000","last_peered":"2024-04-26T12:31:00.078077+0000","last_clean":"2024-04-26T12:31:00.078077+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:31:00.078077+0000","last_undegraded":"2024-04-26T12:31:00.078077+0000","last_fullsized":"2024-04-26T12:31:00.078077+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":494,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.208576+0000","last_change":"2024-04-26T12:31:46.208695+0000","last_active":"2024-04-26T12:31:46.208576+0000","last_peered":"2024-04-26T12:31:46.208576+0000","last_clean":"2024-04-26T12:31:46.208576+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:31:46.208576+0000","last_undegraded":"2024-04-26T12:31:46.208576+0000","last_fullsized":"2024-04-26T12:31:46.208576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'386","last_scrub_stamp":"2024-04-26T12:31:46.208542+0000","last_deep_scrub":"60'386","last_deep_scrub_stamp":"2024-04-26T12:31:46.208542+0000","last_clean_scrub_stamp":"2024-04-26T12:31:46.208542+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:45.386754+0000","scrub_duration":0.0025680009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":411,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077566+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:31:00.077566+0000","last_peered":"2024-04-26T12:31:00.077566+0000","last_clean":"2024-04-26T12:31:00.077566+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:31:00.077566+0000","last_undegraded":"2024-04-26T12:31:00.077566+0000","last_fullsized":"2024-04-26T12:31:00.077566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":478,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078895+0000","last_change":"2024-04-26T12:30:58.081169+0000","last_active":"2024-04-26T12:31:00.078895+0000","last_peered":"2024-04-26T12:31:00.078895+0000","last_clean":"2024-04-26T12:31:00.078895+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:31:00.078895+0000","last_undegraded":"2024-04-26T12:31:00.078895+0000","last_fullsized":"2024-04-26T12:31:00.078895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"58'708","reported_seq":779,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077482+0000","last_change":"2024-04-26T12:30:44.022038+0000","last_active":"2024-04-26T12:31:00.077482+0000","last_peered":"2024-04-26T12:31:00.077482+0000","last_clean":"2024-04-26T12:31:00.077482+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:31:00.077482+0000","last_undegraded":"2024-04-26T12:31:00.077482+0000","last_fullsized":"2024-04-26T12:31:00.077482+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":512,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.113289+0000","last_change":"2024-04-26T12:31:26.113397+0000","last_active":"2024-04-26T12:31:26.113289+0000","last_peered":"2024-04-26T12:31:26.113289+0000","last_clean":"2024-04-26T12:31:26.113289+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:31:26.113289+0000","last_undegraded":"2024-04-26T12:31:26.113289+0000","last_fullsized":"2024-04-26T12:31:26.113289+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:31:26.113263+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:31:26.113263+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.113263+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:51.012642+0000","scrub_duration":0.001900838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:45.981808+0000","last_change":"2024-04-26T12:31:45.981948+0000","last_active":"2024-04-26T12:31:45.981808+0000","last_peered":"2024-04-26T12:31:45.981808+0000","last_clean":"2024-04-26T12:31:45.981808+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:31:45.981808+0000","last_undegraded":"2024-04-26T12:31:45.981808+0000","last_fullsized":"2024-04-26T12:31:45.981808+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'58","last_scrub_stamp":"2024-04-26T12:31:45.981781+0000","last_deep_scrub":"58'58","last_deep_scrub_stamp":"2024-04-26T12:31:45.981781+0000","last_clean_scrub_stamp":"2024-04-26T12:31:45.981781+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:52.325021+0000","scrub_duration":0.0016923179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":595,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077789+0000","last_change":"2024-04-26T12:30:58.081823+0000","last_active":"2024-04-26T12:31:00.077789+0000","last_peered":"2024-04-26T12:31:00.077789+0000","last_clean":"2024-04-26T12:31:00.077789+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:31:00.077789+0000","last_undegraded":"2024-04-26T12:31:00.077789+0000","last_fullsized":"2024-04-26T12:31:00.077789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"85'356","reported_seq":390,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.259385+0000","last_change":"2024-04-26T12:31:12.259503+0000","last_active":"2024-04-26T12:31:12.259385+0000","last_peered":"2024-04-26T12:31:12.259385+0000","last_clean":"2024-04-26T12:31:12.259385+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:31:12.259385+0000","last_undegraded":"2024-04-26T12:31:12.259385+0000","last_fullsized":"2024-04-26T12:31:12.259385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'356","last_scrub_stamp":"2024-04-26T12:31:12.259359+0000","last_deep_scrub":"85'356","last_deep_scrub_stamp":"2024-04-26T12:31:12.259359+0000","last_clean_scrub_stamp":"2024-04-26T12:31:12.259359+0000","objects_scrubbed":1,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:29.053825+0000","scrub_duration":0.015931049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":721,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077641+0000","last_change":"2024-04-26T12:30:46.034642+0000","last_active":"2024-04-26T12:31:00.077641+0000","last_peered":"2024-04-26T12:31:00.077641+0000","last_clean":"2024-04-26T12:31:00.077641+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:31:00.077641+0000","last_undegraded":"2024-04-26T12:31:00.077641+0000","last_fullsized":"2024-04-26T12:31:00.077641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":169,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183738+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:31:13.183738+0000","last_peered":"2024-04-26T12:31:13.183738+0000","last_clean":"2024-04-26T12:31:13.183738+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:31:13.183738+0000","last_undegraded":"2024-04-26T12:31:13.183738+0000","last_fullsized":"2024-04-26T12:31:13.183738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":512,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077916+0000","last_change":"2024-04-26T12:30:45.022716+0000","last_active":"2024-04-26T12:31:00.077916+0000","last_peered":"2024-04-26T12:31:00.077916+0000","last_clean":"2024-04-26T12:31:00.077916+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:31:00.077916+0000","last_undegraded":"2024-04-26T12:31:00.077916+0000","last_fullsized":"2024-04-26T12:31:00.077916+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"85'380","reported_seq":457,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.301720+0000","last_change":"2024-04-26T12:31:26.301826+0000","last_active":"2024-04-26T12:31:26.301720+0000","last_peered":"2024-04-26T12:31:26.301720+0000","last_clean":"2024-04-26T12:31:26.301720+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:31:26.301720+0000","last_undegraded":"2024-04-26T12:31:26.301720+0000","last_fullsized":"2024-04-26T12:31:26.301720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'380","last_scrub_stamp":"2024-04-26T12:31:26.301693+0000","last_deep_scrub":"85'380","last_deep_scrub_stamp":"2024-04-26T12:31:26.301693+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.301693+0000","objects_scrubbed":6,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:55.160179+0000","scrub_duration":0.02593227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":518,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.325418+0000","last_change":"2024-04-26T12:31:25.325525+0000","last_active":"2024-04-26T12:31:25.325418+0000","last_peered":"2024-04-26T12:31:25.325418+0000","last_clean":"2024-04-26T12:31:25.325418+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:31:25.325418+0000","last_undegraded":"2024-04-26T12:31:25.325418+0000","last_fullsized":"2024-04-26T12:31:25.325418+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:25.325392+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:25.325392+0000","last_clean_scrub_stamp":"2024-04-26T12:31:25.325392+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:47.712840+0000","scrub_duration":0.0026314070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":650,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149571+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:31:12.149571+0000","last_peered":"2024-04-26T12:31:12.149571+0000","last_clean":"2024-04-26T12:31:12.149571+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:31:12.149571+0000","last_undegraded":"2024-04-26T12:31:12.149571+0000","last_fullsized":"2024-04-26T12:31:12.149571+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":796,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183891+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:31:13.183891+0000","last_peered":"2024-04-26T12:31:13.183891+0000","last_clean":"2024-04-26T12:31:13.183891+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:31:13.183891+0000","last_undegraded":"2024-04-26T12:31:13.183891+0000","last_fullsized":"2024-04-26T12:31:13.183891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077742+0000","last_change":"2024-04-26T12:30:46.089052+0000","last_active":"2024-04-26T12:31:00.077742+0000","last_peered":"2024-04-26T12:31:00.077742+0000","last_clean":"2024-04-26T12:31:00.077742+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:31:00.077742+0000","last_undegraded":"2024-04-26T12:31:00.077742+0000","last_fullsized":"2024-04-26T12:31:00.077742+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":873,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:29.158519+0000","last_change":"2024-04-26T12:31:29.158519+0000","last_active":"2024-04-26T12:31:29.158519+0000","last_peered":"2024-04-26T12:31:29.158519+0000","last_clean":"2024-04-26T12:31:29.158519+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:31:29.158519+0000","last_undegraded":"2024-04-26T12:31:29.158519+0000","last_fullsized":"2024-04-26T12:31:29.158519+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'390","last_scrub_stamp":"2024-04-26T12:31:29.158376+0000","last_deep_scrub":"60'390","last_deep_scrub_stamp":"2024-04-26T12:31:29.158376+0000","last_clean_scrub_stamp":"2024-04-26T12:31:29.158376+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:29.361899+0000","scrub_duration":0.0022476710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183784+0000","last_change":"2024-04-26T12:26:52.838230+0000","last_active":"2024-04-26T12:31:13.183784+0000","last_peered":"2024-04-26T12:31:13.183784+0000","last_clean":"2024-04-26T12:31:13.183784+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:31:13.183784+0000","last_undegraded":"2024-04-26T12:31:13.183784+0000","last_fullsized":"2024-04-26T12:31:13.183784+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":501,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.079002+0000","last_change":"2024-04-26T12:30:59.083411+0000","last_active":"2024-04-26T12:31:00.079002+0000","last_peered":"2024-04-26T12:31:00.079002+0000","last_clean":"2024-04-26T12:31:00.079002+0000","last_became_active":"2024-04-26T12:30:59.081424+0000","last_became_peered":"2024-04-26T12:30:59.081424+0000","last_unstale":"2024-04-26T12:31:00.079002+0000","last_undegraded":"2024-04-26T12:31:00.079002+0000","last_fullsized":"2024-04-26T12:31:00.079002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"85'58","reported_seq":89,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:50.029082+0000","last_change":"2024-04-26T12:31:50.029193+0000","last_active":"2024-04-26T12:31:50.029082+0000","last_peered":"2024-04-26T12:31:50.029082+0000","last_clean":"2024-04-26T12:31:50.029082+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:31:50.029082+0000","last_undegraded":"2024-04-26T12:31:50.029082+0000","last_fullsized":"2024-04-26T12:31:50.029082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'58","last_scrub_stamp":"2024-04-26T12:31:50.029051+0000","last_deep_scrub":"85'58","last_deep_scrub_stamp":"2024-04-26T12:31:50.029051+0000","last_clean_scrub_stamp":"2024-04-26T12:31:50.029051+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:06.160429+0000","scrub_duration":0.0043989739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":539,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.079167+0000","last_change":"2024-04-26T12:30:59.084548+0000","last_active":"2024-04-26T12:31:00.079167+0000","last_peered":"2024-04-26T12:31:00.079167+0000","last_clean":"2024-04-26T12:31:00.079167+0000","last_became_active":"2024-04-26T12:30:59.081463+0000","last_became_peered":"2024-04-26T12:30:59.081463+0000","last_unstale":"2024-04-26T12:31:00.079167+0000","last_undegraded":"2024-04-26T12:31:00.079167+0000","last_fullsized":"2024-04-26T12:31:00.079167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"85'188","reported_seq":223,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.348255+0000","last_change":"2024-04-26T12:31:31.348379+0000","last_active":"2024-04-26T12:31:31.348255+0000","last_peered":"2024-04-26T12:31:31.348255+0000","last_clean":"2024-04-26T12:31:31.348255+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:31:31.348255+0000","last_undegraded":"2024-04-26T12:31:31.348255+0000","last_fullsized":"2024-04-26T12:31:31.348255+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'188","last_scrub_stamp":"2024-04-26T12:31:31.348227+0000","last_deep_scrub":"85'188","last_deep_scrub_stamp":"2024-04-26T12:31:31.348227+0000","last_clean_scrub_stamp":"2024-04-26T12:31:31.348227+0000","objects_scrubbed":2,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:59.084157+0000","scrub_duration":0.015480226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":533,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183956+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:31:13.183956+0000","last_peered":"2024-04-26T12:31:13.183956+0000","last_clean":"2024-04-26T12:31:13.183956+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:31:13.183956+0000","last_undegraded":"2024-04-26T12:31:13.183956+0000","last_fullsized":"2024-04-26T12:31:13.183956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":442,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183744+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:31:13.183744+0000","last_peered":"2024-04-26T12:31:13.183744+0000","last_clean":"2024-04-26T12:31:13.183744+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:31:13.183744+0000","last_undegraded":"2024-04-26T12:31:13.183744+0000","last_fullsized":"2024-04-26T12:31:13.183744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":989,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:33.193482+0000","last_change":"2024-04-26T12:31:33.193590+0000","last_active":"2024-04-26T12:31:33.193482+0000","last_peered":"2024-04-26T12:31:33.193482+0000","last_clean":"2024-04-26T12:31:33.193482+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:31:33.193482+0000","last_undegraded":"2024-04-26T12:31:33.193482+0000","last_fullsized":"2024-04-26T12:31:33.193482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'437","last_scrub_stamp":"2024-04-26T12:31:33.193453+0000","last_deep_scrub":"60'437","last_deep_scrub_stamp":"2024-04-26T12:31:33.193453+0000","last_clean_scrub_stamp":"2024-04-26T12:31:33.193453+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:25.293233+0000","scrub_duration":0.0023129719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":515,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078761+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:31:00.078761+0000","last_peered":"2024-04-26T12:31:00.078761+0000","last_clean":"2024-04-26T12:31:00.078761+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:31:00.078761+0000","last_undegraded":"2024-04-26T12:31:00.078761+0000","last_fullsized":"2024-04-26T12:31:00.078761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":503,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.254729+0000","last_change":"2024-04-26T12:31:22.254831+0000","last_active":"2024-04-26T12:31:22.254729+0000","last_peered":"2024-04-26T12:31:22.254729+0000","last_clean":"2024-04-26T12:31:22.254729+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:31:22.254729+0000","last_undegraded":"2024-04-26T12:31:22.254729+0000","last_fullsized":"2024-04-26T12:31:22.254729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:31:22.254705+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:31:22.254705+0000","last_clean_scrub_stamp":"2024-04-26T12:31:22.254705+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:09.032368+0000","scrub_duration":0.0022442209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149539+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:12.149539+0000","last_peered":"2024-04-26T12:31:12.149539+0000","last_clean":"2024-04-26T12:31:12.149539+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:31:12.149539+0000","last_undegraded":"2024-04-26T12:31:12.149539+0000","last_fullsized":"2024-04-26T12:31:12.149539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":560,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078080+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:31:00.078080+0000","last_peered":"2024-04-26T12:31:00.078080+0000","last_clean":"2024-04-26T12:31:00.078080+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:31:00.078080+0000","last_undegraded":"2024-04-26T12:31:00.078080+0000","last_fullsized":"2024-04-26T12:31:00.078080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":253,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077791+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:31:00.077791+0000","last_peered":"2024-04-26T12:31:00.077791+0000","last_clean":"2024-04-26T12:31:00.077791+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:31:00.077791+0000","last_undegraded":"2024-04-26T12:31:00.077791+0000","last_fullsized":"2024-04-26T12:31:00.077791+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":538,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078279+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:31:00.078279+0000","last_peered":"2024-04-26T12:31:00.078279+0000","last_clean":"2024-04-26T12:31:00.078279+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:31:00.078279+0000","last_undegraded":"2024-04-26T12:31:00.078279+0000","last_fullsized":"2024-04-26T12:31:00.078279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":270,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149551+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:31:12.149551+0000","last_peered":"2024-04-26T12:31:12.149551+0000","last_clean":"2024-04-26T12:31:12.149551+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:31:12.149551+0000","last_undegraded":"2024-04-26T12:31:12.149551+0000","last_fullsized":"2024-04-26T12:31:12.149551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:20.233238+0000","last_change":"2024-04-26T12:31:20.233368+0000","last_active":"2024-04-26T12:31:20.233238+0000","last_peered":"2024-04-26T12:31:20.233238+0000","last_clean":"2024-04-26T12:31:20.233238+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:31:20.233238+0000","last_undegraded":"2024-04-26T12:31:20.233238+0000","last_fullsized":"2024-04-26T12:31:20.233238+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:31:20.233200+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:31:20.233200+0000","last_clean_scrub_stamp":"2024-04-26T12:31:20.233200+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:03.311719+0000","scrub_duration":0.0025721490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183710+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:31:13.183710+0000","last_peered":"2024-04-26T12:31:13.183710+0000","last_clean":"2024-04-26T12:31:13.183710+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:31:13.183710+0000","last_undegraded":"2024-04-26T12:31:13.183710+0000","last_fullsized":"2024-04-26T12:31:13.183710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":494,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149680+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:31:12.149680+0000","last_peered":"2024-04-26T12:31:12.149680+0000","last_clean":"2024-04-26T12:31:12.149680+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:31:12.149680+0000","last_undegraded":"2024-04-26T12:31:12.149680+0000","last_fullsized":"2024-04-26T12:31:12.149680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":590,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183740+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:31:13.183740+0000","last_peered":"2024-04-26T12:31:13.183740+0000","last_clean":"2024-04-26T12:31:13.183740+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:31:13.183740+0000","last_undegraded":"2024-04-26T12:31:13.183740+0000","last_fullsized":"2024-04-26T12:31:13.183740+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":510,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.890612+0000","last_change":"2024-04-26T12:31:31.890716+0000","last_active":"2024-04-26T12:31:31.890612+0000","last_peered":"2024-04-26T12:31:31.890612+0000","last_clean":"2024-04-26T12:31:31.890612+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:31:31.890612+0000","last_undegraded":"2024-04-26T12:31:31.890612+0000","last_fullsized":"2024-04-26T12:31:31.890612+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'402","last_scrub_stamp":"2024-04-26T12:31:31.890586+0000","last_deep_scrub":"60'402","last_deep_scrub_stamp":"2024-04-26T12:31:31.890586+0000","last_clean_scrub_stamp":"2024-04-26T12:31:31.890586+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:10.281743+0000","scrub_duration":0.0021503030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:23.972595+0000","last_change":"2024-04-26T12:31:23.972717+0000","last_active":"2024-04-26T12:31:23.972595+0000","last_peered":"2024-04-26T12:31:23.972595+0000","last_clean":"2024-04-26T12:31:23.972595+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:31:23.972595+0000","last_undegraded":"2024-04-26T12:31:23.972595+0000","last_fullsized":"2024-04-26T12:31:23.972595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:23.972571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:23.972571+0000","last_clean_scrub_stamp":"2024-04-26T12:31:23.972571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:28.883121+0000","scrub_duration":0.0019705149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"85'455","reported_seq":493,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:48.063732+0000","last_change":"2024-04-26T12:31:48.063866+0000","last_active":"2024-04-26T12:31:48.063732+0000","last_peered":"2024-04-26T12:31:48.063732+0000","last_clean":"2024-04-26T12:31:48.063732+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:31:48.063732+0000","last_undegraded":"2024-04-26T12:31:48.063732+0000","last_fullsized":"2024-04-26T12:31:48.063732+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'455","last_scrub_stamp":"2024-04-26T12:31:48.063706+0000","last_deep_scrub":"85'455","last_deep_scrub_stamp":"2024-04-26T12:31:48.063706+0000","last_clean_scrub_stamp":"2024-04-26T12:31:48.063706+0000","objects_scrubbed":1,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:01.639711+0000","scrub_duration":0.015622934999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":474,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364337+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:31:05.364337+0000","last_peered":"2024-04-26T12:31:05.364337+0000","last_clean":"2024-04-26T12:31:05.364337+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:31:05.364337+0000","last_undegraded":"2024-04-26T12:31:05.364337+0000","last_fullsized":"2024-04-26T12:31:05.364337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.331035+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:31:00.331035+0000","last_peered":"2024-04-26T12:31:00.331035+0000","last_clean":"2024-04-26T12:31:00.331035+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:31:00.331035+0000","last_undegraded":"2024-04-26T12:31:00.331035+0000","last_fullsized":"2024-04-26T12:31:00.331035+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.331856+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:05.331856+0000","last_peered":"2024-04-26T12:31:05.331856+0000","last_clean":"2024-04-26T12:31:05.331856+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:31:05.331856+0000","last_undegraded":"2024-04-26T12:31:05.331856+0000","last_fullsized":"2024-04-26T12:31:05.331856+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":500,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078329+0000","last_change":"2024-04-26T12:30:46.033999+0000","last_active":"2024-04-26T12:31:00.078329+0000","last_peered":"2024-04-26T12:31:00.078329+0000","last_clean":"2024-04-26T12:31:00.078329+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:31:00.078329+0000","last_undegraded":"2024-04-26T12:31:00.078329+0000","last_fullsized":"2024-04-26T12:31:00.078329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077929+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:31:00.077929+0000","last_peered":"2024-04-26T12:31:00.077929+0000","last_clean":"2024-04-26T12:31:00.077929+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:31:00.077929+0000","last_undegraded":"2024-04-26T12:31:00.077929+0000","last_fullsized":"2024-04-26T12:31:00.077929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":399,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077767+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:31:00.077767+0000","last_peered":"2024-04-26T12:31:00.077767+0000","last_clean":"2024-04-26T12:31:00.077767+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:31:00.077767+0000","last_undegraded":"2024-04-26T12:31:00.077767+0000","last_fullsized":"2024-04-26T12:31:00.077767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":444,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:34.956541+0000","last_change":"2024-04-26T12:31:34.956674+0000","last_active":"2024-04-26T12:31:34.956541+0000","last_peered":"2024-04-26T12:31:34.956541+0000","last_clean":"2024-04-26T12:31:34.956541+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:31:34.956541+0000","last_undegraded":"2024-04-26T12:31:34.956541+0000","last_fullsized":"2024-04-26T12:31:34.956541+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'339","last_scrub_stamp":"2024-04-26T12:31:34.956499+0000","last_deep_scrub":"60'339","last_deep_scrub_stamp":"2024-04-26T12:31:34.956499+0000","last_clean_scrub_stamp":"2024-04-26T12:31:34.956499+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:59.720417+0000","scrub_duration":0.0021999369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:32.328731+0000","last_change":"2024-04-26T12:31:32.328853+0000","last_active":"2024-04-26T12:31:32.328731+0000","last_peered":"2024-04-26T12:31:32.328731+0000","last_clean":"2024-04-26T12:31:32.328731+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:31:32.328731+0000","last_undegraded":"2024-04-26T12:31:32.328731+0000","last_fullsized":"2024-04-26T12:31:32.328731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:32.328709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:32.328709+0000","last_clean_scrub_stamp":"2024-04-26T12:31:32.328709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:20.941744+0000","scrub_duration":0.0019425169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":264,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077875+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:31:00.077875+0000","last_peered":"2024-04-26T12:31:00.077875+0000","last_clean":"2024-04-26T12:31:00.077875+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:31:00.077875+0000","last_undegraded":"2024-04-26T12:31:00.077875+0000","last_fullsized":"2024-04-26T12:31:00.077875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":599,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078026+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:31:00.078026+0000","last_peered":"2024-04-26T12:31:00.078026+0000","last_clean":"2024-04-26T12:31:00.078026+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:31:00.078026+0000","last_undegraded":"2024-04-26T12:31:00.078026+0000","last_fullsized":"2024-04-26T12:31:00.078026+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":566,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.331963+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:31:05.331963+0000","last_peered":"2024-04-26T12:31:05.331963+0000","last_clean":"2024-04-26T12:31:05.331963+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:31:05.331963+0000","last_undegraded":"2024-04-26T12:31:05.331963+0000","last_fullsized":"2024-04-26T12:31:05.331963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077904+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:31:00.077904+0000","last_peered":"2024-04-26T12:31:00.077904+0000","last_clean":"2024-04-26T12:31:00.077904+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:31:00.077904+0000","last_undegraded":"2024-04-26T12:31:00.077904+0000","last_fullsized":"2024-04-26T12:31:00.077904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"85'106","reported_seq":235,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:24.978985+0000","last_change":"2024-04-26T12:31:24.979101+0000","last_active":"2024-04-26T12:31:24.978985+0000","last_peered":"2024-04-26T12:31:24.978985+0000","last_clean":"2024-04-26T12:31:24.978985+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:31:24.978985+0000","last_undegraded":"2024-04-26T12:31:24.978985+0000","last_fullsized":"2024-04-26T12:31:24.978985+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'106","last_scrub_stamp":"2024-04-26T12:31:24.978960+0000","last_deep_scrub":"85'106","last_deep_scrub_stamp":"2024-04-26T12:31:24.978960+0000","last_clean_scrub_stamp":"2024-04-26T12:31:24.978960+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:36.841285+0000","scrub_duration":0.0061135809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":969,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183862+0000","last_change":"2024-04-26T12:30:57.078892+0000","last_active":"2024-04-26T12:31:13.183862+0000","last_peered":"2024-04-26T12:31:13.183862+0000","last_clean":"2024-04-26T12:31:13.183862+0000","last_became_active":"2024-04-26T12:30:57.077779+0000","last_became_peered":"2024-04-26T12:30:57.077779+0000","last_unstale":"2024-04-26T12:31:13.183862+0000","last_undegraded":"2024-04-26T12:31:13.183862+0000","last_fullsized":"2024-04-26T12:31:13.183862+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.363755+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:31:00.363755+0000","last_peered":"2024-04-26T12:31:00.363755+0000","last_clean":"2024-04-26T12:31:00.363755+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:31:00.363755+0000","last_undegraded":"2024-04-26T12:31:00.363755+0000","last_fullsized":"2024-04-26T12:31:00.363755+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:39.992680+0000","last_change":"2024-04-26T12:31:39.992792+0000","last_active":"2024-04-26T12:31:39.992680+0000","last_peered":"2024-04-26T12:31:39.992680+0000","last_clean":"2024-04-26T12:31:39.992680+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:31:39.992680+0000","last_undegraded":"2024-04-26T12:31:39.992680+0000","last_fullsized":"2024-04-26T12:31:39.992680+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'59","last_scrub_stamp":"2024-04-26T12:31:39.992655+0000","last_deep_scrub":"58'59","last_deep_scrub_stamp":"2024-04-26T12:31:39.992655+0000","last_clean_scrub_stamp":"2024-04-26T12:31:39.992655+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:05.570619+0000","scrub_duration":0.001782435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":532,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:45.214912+0000","last_change":"2024-04-26T12:31:45.215071+0000","last_active":"2024-04-26T12:31:45.214912+0000","last_peered":"2024-04-26T12:31:45.214912+0000","last_clean":"2024-04-26T12:31:45.214912+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:31:45.214912+0000","last_undegraded":"2024-04-26T12:31:45.214912+0000","last_fullsized":"2024-04-26T12:31:45.214912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'418","last_scrub_stamp":"2024-04-26T12:31:45.214875+0000","last_deep_scrub":"60'418","last_deep_scrub_stamp":"2024-04-26T12:31:45.214875+0000","last_clean_scrub_stamp":"2024-04-26T12:31:45.214875+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:16.419048+0000","scrub_duration":0.0026123359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078804+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:31:00.078804+0000","last_peered":"2024-04-26T12:31:00.078804+0000","last_clean":"2024-04-26T12:31:00.078804+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:31:00.078804+0000","last_undegraded":"2024-04-26T12:31:00.078804+0000","last_fullsized":"2024-04-26T12:31:00.078804+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.965267+0000","last_change":"2024-04-26T12:31:26.965364+0000","last_active":"2024-04-26T12:31:26.965267+0000","last_peered":"2024-04-26T12:31:26.965267+0000","last_clean":"2024-04-26T12:31:26.965267+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:31:26.965267+0000","last_undegraded":"2024-04-26T12:31:26.965267+0000","last_fullsized":"2024-04-26T12:31:26.965267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:26.965245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:26.965245+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.965245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:27.319599+0000","scrub_duration":0.0017909270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":501,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.084805+0000","last_change":"2024-04-26T12:31:00.081711+0000","last_active":"2024-04-26T12:31:00.084805+0000","last_peered":"2024-04-26T12:31:00.084805+0000","last_clean":"2024-04-26T12:31:00.084805+0000","last_became_active":"2024-04-26T12:31:00.079504+0000","last_became_peered":"2024-04-26T12:31:00.079504+0000","last_unstale":"2024-04-26T12:31:00.084805+0000","last_undegraded":"2024-04-26T12:31:00.084805+0000","last_fullsized":"2024-04-26T12:31:00.084805+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:35.265345+0000","last_change":"2024-04-26T12:31:35.265446+0000","last_active":"2024-04-26T12:31:35.265345+0000","last_peered":"2024-04-26T12:31:35.265345+0000","last_clean":"2024-04-26T12:31:35.265345+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:31:35.265345+0000","last_undegraded":"2024-04-26T12:31:35.265345+0000","last_fullsized":"2024-04-26T12:31:35.265345+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:35.265322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:35.265322+0000","last_clean_scrub_stamp":"2024-04-26T12:31:35.265322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:21.847498+0000","scrub_duration":0.001727751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"85'83","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.000547+0000","last_change":"2024-04-26T12:31:14.000699+0000","last_active":"2024-04-26T12:31:14.000547+0000","last_peered":"2024-04-26T12:31:14.000547+0000","last_clean":"2024-04-26T12:31:14.000547+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:31:14.000547+0000","last_undegraded":"2024-04-26T12:31:14.000547+0000","last_fullsized":"2024-04-26T12:31:14.000547+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'83","last_scrub_stamp":"2024-04-26T12:31:14.000521+0000","last_deep_scrub":"85'83","last_deep_scrub_stamp":"2024-04-26T12:31:14.000521+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.000521+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:11.290115+0000","scrub_duration":0.0069472290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":618,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.173074+0000","last_change":"2024-04-26T12:31:47.173213+0000","last_active":"2024-04-26T12:31:47.173074+0000","last_peered":"2024-04-26T12:31:47.173074+0000","last_clean":"2024-04-26T12:31:47.173074+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:31:47.173074+0000","last_undegraded":"2024-04-26T12:31:47.173074+0000","last_fullsized":"2024-04-26T12:31:47.173074+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-04-26T12:31:47.173047+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-04-26T12:31:47.173047+0000","last_clean_scrub_stamp":"2024-04-26T12:31:47.173047+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:10.331132+0000","scrub_duration":0.002517961,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":174,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077958+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:31:00.077958+0000","last_peered":"2024-04-26T12:31:00.077958+0000","last_clean":"2024-04-26T12:31:00.077958+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:31:00.077958+0000","last_undegraded":"2024-04-26T12:31:00.077958+0000","last_fullsized":"2024-04-26T12:31:00.077958+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":867,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:28.143113+0000","last_change":"2024-04-26T12:31:28.143238+0000","last_active":"2024-04-26T12:31:28.143113+0000","last_peered":"2024-04-26T12:31:28.143113+0000","last_clean":"2024-04-26T12:31:28.143113+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:31:28.143113+0000","last_undegraded":"2024-04-26T12:31:28.143113+0000","last_fullsized":"2024-04-26T12:31:28.143113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:31:28.143070+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:31:28.143070+0000","last_clean_scrub_stamp":"2024-04-26T12:31:28.143070+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:55.111541+0000","scrub_duration":0.0024435799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":312,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078444+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:31:00.078444+0000","last_peered":"2024-04-26T12:31:00.078444+0000","last_clean":"2024-04-26T12:31:00.078444+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:31:00.078444+0000","last_undegraded":"2024-04-26T12:31:00.078444+0000","last_fullsized":"2024-04-26T12:31:00.078444+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":799,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078233+0000","last_change":"2024-04-26T12:30:48.088039+0000","last_active":"2024-04-26T12:31:00.078233+0000","last_peered":"2024-04-26T12:31:00.078233+0000","last_clean":"2024-04-26T12:31:00.078233+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:31:00.078233+0000","last_undegraded":"2024-04-26T12:31:00.078233+0000","last_fullsized":"2024-04-26T12:31:00.078233+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"58'314","reported_seq":396,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078636+0000","last_change":"2024-04-26T12:26:52.840841+0000","last_active":"2024-04-26T12:31:00.078636+0000","last_peered":"2024-04-26T12:31:00.078636+0000","last_clean":"2024-04-26T12:31:00.078636+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:31:00.078636+0000","last_undegraded":"2024-04-26T12:31:00.078636+0000","last_fullsized":"2024-04-26T12:31:00.078636+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":884,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:49.040357+0000","last_change":"2024-04-26T12:31:49.040500+0000","last_active":"2024-04-26T12:31:49.040357+0000","last_peered":"2024-04-26T12:31:49.040357+0000","last_clean":"2024-04-26T12:31:49.040357+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:31:49.040357+0000","last_undegraded":"2024-04-26T12:31:49.040357+0000","last_fullsized":"2024-04-26T12:31:49.040357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:31:49.040316+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:31:49.040316+0000","last_clean_scrub_stamp":"2024-04-26T12:31:49.040316+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:51.229337+0000","scrub_duration":0.0025244709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"85'77","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.984350+0000","last_change":"2024-04-26T12:31:14.984448+0000","last_active":"2024-04-26T12:31:14.984350+0000","last_peered":"2024-04-26T12:31:14.984350+0000","last_clean":"2024-04-26T12:31:14.984350+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:31:14.984350+0000","last_undegraded":"2024-04-26T12:31:14.984350+0000","last_fullsized":"2024-04-26T12:31:14.984350+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'77","last_scrub_stamp":"2024-04-26T12:31:14.984325+0000","last_deep_scrub":"85'77","last_deep_scrub_stamp":"2024-04-26T12:31:14.984325+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.984325+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:53.595109+0000","scrub_duration":0.010871390999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:33.279712+0000","last_change":"2024-04-26T12:31:33.279814+0000","last_active":"2024-04-26T12:31:33.279712+0000","last_peered":"2024-04-26T12:31:33.279712+0000","last_clean":"2024-04-26T12:31:33.279712+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:31:33.279712+0000","last_undegraded":"2024-04-26T12:31:33.279712+0000","last_fullsized":"2024-04-26T12:31:33.279712+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'438","last_scrub_stamp":"2024-04-26T12:31:33.279688+0000","last_deep_scrub":"60'438","last_deep_scrub_stamp":"2024-04-26T12:31:33.279688+0000","last_clean_scrub_stamp":"2024-04-26T12:31:33.279688+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:47.222045+0000","scrub_duration":0.0024948520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078962+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:31:00.078962+0000","last_peered":"2024-04-26T12:31:00.078962+0000","last_clean":"2024-04-26T12:31:00.078962+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:31:00.078962+0000","last_undegraded":"2024-04-26T12:31:00.078962+0000","last_fullsized":"2024-04-26T12:31:00.078962+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":979,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:18.220035+0000","last_change":"2024-04-26T12:31:18.220147+0000","last_active":"2024-04-26T12:31:18.220035+0000","last_peered":"2024-04-26T12:31:18.220035+0000","last_clean":"2024-04-26T12:31:18.220035+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:31:18.220035+0000","last_undegraded":"2024-04-26T12:31:18.220035+0000","last_fullsized":"2024-04-26T12:31:18.220035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'473","last_scrub_stamp":"2024-04-26T12:31:18.220009+0000","last_deep_scrub":"60'473","last_deep_scrub_stamp":"2024-04-26T12:31:18.220009+0000","last_clean_scrub_stamp":"2024-04-26T12:31:18.220009+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:07.523749+0000","scrub_duration":0.0022384369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":864,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078030+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:31:00.078030+0000","last_peered":"2024-04-26T12:31:00.078030+0000","last_clean":"2024-04-26T12:31:00.078030+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:31:00.078030+0000","last_undegraded":"2024-04-26T12:31:00.078030+0000","last_fullsized":"2024-04-26T12:31:00.078030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":540,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:40.993627+0000","last_change":"2024-04-26T12:31:40.993749+0000","last_active":"2024-04-26T12:31:40.993627+0000","last_peered":"2024-04-26T12:31:40.993627+0000","last_clean":"2024-04-26T12:31:40.993627+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:31:40.993627+0000","last_undegraded":"2024-04-26T12:31:40.993627+0000","last_fullsized":"2024-04-26T12:31:40.993627+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'446","last_scrub_stamp":"2024-04-26T12:31:40.993603+0000","last_deep_scrub":"60'446","last_deep_scrub_stamp":"2024-04-26T12:31:40.993603+0000","last_clean_scrub_stamp":"2024-04-26T12:31:40.993603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:27.297067+0000","scrub_duration":0.0020716889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":630,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364349+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:31:05.364349+0000","last_peered":"2024-04-26T12:31:05.364349+0000","last_clean":"2024-04-26T12:31:05.364349+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:31:05.364349+0000","last_undegraded":"2024-04-26T12:31:05.364349+0000","last_fullsized":"2024-04-26T12:31:05.364349+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":527,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:48.035520+0000","last_change":"2024-04-26T12:31:48.035660+0000","last_active":"2024-04-26T12:31:48.035520+0000","last_peered":"2024-04-26T12:31:48.035520+0000","last_clean":"2024-04-26T12:31:48.035520+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:31:48.035520+0000","last_undegraded":"2024-04-26T12:31:48.035520+0000","last_fullsized":"2024-04-26T12:31:48.035520+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'384","last_scrub_stamp":"2024-04-26T12:31:48.035480+0000","last_deep_scrub":"60'384","last_deep_scrub_stamp":"2024-04-26T12:31:48.035480+0000","last_clean_scrub_stamp":"2024-04-26T12:31:48.035480+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:18.919037+0000","scrub_duration":0.002218383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":524,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:40.177293+0000","last_change":"2024-04-26T12:31:40.177393+0000","last_active":"2024-04-26T12:31:40.177293+0000","last_peered":"2024-04-26T12:31:40.177293+0000","last_clean":"2024-04-26T12:31:40.177293+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:31:40.177293+0000","last_undegraded":"2024-04-26T12:31:40.177293+0000","last_fullsized":"2024-04-26T12:31:40.177293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'380","last_scrub_stamp":"2024-04-26T12:31:40.177270+0000","last_deep_scrub":"60'380","last_deep_scrub_stamp":"2024-04-26T12:31:40.177270+0000","last_clean_scrub_stamp":"2024-04-26T12:31:40.177270+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:45.516828+0000","scrub_duration":0.0024862170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79134720,"data_stored":256449018,"data_compressed":38844374,"data_compressed_allocated":48693248,"data_compressed_original":226074624,"omap_allocated":5343,"internal_metadata":0},"log_size":7525,"ondisk_log_size":7525,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130112,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94241728,"statfs":{"total":96636764160,"available":96503529472,"internally_reserved":0,"allocated":31711232,"data_stored":85785287,"data_compressed":12062822,"data_compressed_allocated":15765504,"data_compressed_original":70336512,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:30:52 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.433},"min":{"1min":0.23599999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.41199999999999998,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:31:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.49399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738433,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131332,"kb_used_data":32188,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94240508,"statfs":{"total":96636764160,"available":96502280192,"internally_reserved":0,"allocated":32960512,"data_stored":91451171,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:31:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:31:47 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.44400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33600000000000002,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.59199999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.44500000000000001,"15min":0.46700000000000003},"min":{"1min":0.318,"5min":0.191,"15min":0.191},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.47699999999999998}]}]},{"osd":1,"up_from":64,"seq":274877906960,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62336,"kb_used_data":16760,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309504,"statfs":{"total":96636764160,"available":96572932096,"internally_reserved":0,"allocated":17162240,"data_stored":81548386,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:40 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Apr 26 12:31:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.57299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30789632,"data_stored":84809889,"data_compressed":12028675,"data_compressed_allocated":15720448,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:31:54.345 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.345 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.345 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.345 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.346 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.346 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.346 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.346 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.346 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.346 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.346 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.347 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.347 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.347 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.347 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.347 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.347 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.347 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.347 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.348 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.348 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.348 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.348 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.348 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.348 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.349 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.349 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.349 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.349 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.349 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.349 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.349 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.349 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.350 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.350 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.350 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.350 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.350 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.350 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.350 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.351 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.351 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.351 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.351 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.351 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.351 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:26:45.798066+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.351 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.351 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.351 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.352 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.352 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.352 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.352 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.352 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.352 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.352 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.352 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.353 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.353 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.353 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:31:54.353 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:32:14.354 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:32:14.714 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:32:14.715 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:32:14.726 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-04-26T12:32:13.376787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6546,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34368,"ondisk_log_size":34368,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":323780,"kb_used_data":79916,"kb_used_omap":9,"kb_used_meta":243830,"kb_avail":282791740,"statfs":{"total":289910292480,"available":289578741760,"internally_reserved":0,"allocated":81833984,"data_stored":258784844,"data_compressed":38912668,"data_compressed_allocated":48783360,"data_compressed_original":227221504,"omap_allocated":10125,"internal_metadata":249682035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003150"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":913,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:18.003472+0000","last_change":"2024-04-26T12:31:18.003585+0000","last_active":"2024-04-26T12:31:18.003472+0000","last_peered":"2024-04-26T12:31:18.003472+0000","last_clean":"2024-04-26T12:31:18.003472+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:31:18.003472+0000","last_undegraded":"2024-04-26T12:31:18.003472+0000","last_fullsized":"2024-04-26T12:31:18.003472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:18.003445+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:18.003445+0000","last_clean_scrub_stamp":"2024-04-26T12:31:18.003445+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:47.444600+0000","scrub_duration":0.0019588980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":958,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364439+0000","last_change":"2024-04-26T12:30:56.085870+0000","last_active":"2024-04-26T12:31:05.364439+0000","last_peered":"2024-04-26T12:31:05.364439+0000","last_clean":"2024-04-26T12:31:05.364439+0000","last_became_active":"2024-04-26T12:30:56.084642+0000","last_became_peered":"2024-04-26T12:30:56.084642+0000","last_unstale":"2024-04-26T12:31:05.364439+0000","last_undegraded":"2024-04-26T12:31:05.364439+0000","last_fullsized":"2024-04-26T12:31:05.364439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":496,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078732+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:31:00.078732+0000","last_peered":"2024-04-26T12:31:00.078732+0000","last_clean":"2024-04-26T12:31:00.078732+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:31:00.078732+0000","last_undegraded":"2024-04-26T12:31:00.078732+0000","last_fullsized":"2024-04-26T12:31:00.078732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":879,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:41.224563+0000","last_change":"2024-04-26T12:31:41.224731+0000","last_active":"2024-04-26T12:31:41.224563+0000","last_peered":"2024-04-26T12:31:41.224563+0000","last_clean":"2024-04-26T12:31:41.224563+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:31:41.224563+0000","last_undegraded":"2024-04-26T12:31:41.224563+0000","last_fullsized":"2024-04-26T12:31:41.224563+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:31:41.224537+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:31:41.224537+0000","last_clean_scrub_stamp":"2024-04-26T12:31:41.224537+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:31.770929+0000","scrub_duration":0.0021526079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":952,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:44.166192+0000","last_change":"2024-04-26T12:31:44.166192+0000","last_active":"2024-04-26T12:31:44.166192+0000","last_peered":"2024-04-26T12:31:44.166192+0000","last_clean":"2024-04-26T12:31:44.166192+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:31:44.166192+0000","last_undegraded":"2024-04-26T12:31:44.166192+0000","last_fullsized":"2024-04-26T12:31:44.166192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'430","last_scrub_stamp":"2024-04-26T12:31:44.165994+0000","last_deep_scrub":"60'430","last_deep_scrub_stamp":"2024-04-26T12:31:44.165994+0000","last_clean_scrub_stamp":"2024-04-26T12:31:44.165994+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:15.166663+0000","scrub_duration":0.0026340479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":489,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:15.202084+0000","last_change":"2024-04-26T12:31:15.202198+0000","last_active":"2024-04-26T12:31:15.202084+0000","last_peered":"2024-04-26T12:31:15.202084+0000","last_clean":"2024-04-26T12:31:15.202084+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:31:15.202084+0000","last_undegraded":"2024-04-26T12:31:15.202084+0000","last_fullsized":"2024-04-26T12:31:15.202084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:31:15.202057+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:31:15.202057+0000","last_clean_scrub_stamp":"2024-04-26T12:31:15.202057+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:36.672446+0000","scrub_duration":0.002466312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1030,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149934+0000","last_change":"2024-04-26T12:30:44.030412+0000","last_active":"2024-04-26T12:31:12.149934+0000","last_peered":"2024-04-26T12:31:12.149934+0000","last_clean":"2024-04-26T12:31:12.149934+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:31:12.149934+0000","last_undegraded":"2024-04-26T12:31:12.149934+0000","last_fullsized":"2024-04-26T12:31:12.149934+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":779,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:03.106167+0000","last_change":"2024-04-26T12:32:03.106311+0000","last_active":"2024-04-26T12:32:03.106167+0000","last_peered":"2024-04-26T12:32:03.106167+0000","last_clean":"2024-04-26T12:32:03.106167+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:32:03.106167+0000","last_undegraded":"2024-04-26T12:32:03.106167+0000","last_fullsized":"2024-04-26T12:32:03.106167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'371","last_scrub_stamp":"2024-04-26T12:32:03.106125+0000","last_deep_scrub":"60'371","last_deep_scrub_stamp":"2024-04-26T12:32:03.106125+0000","last_clean_scrub_stamp":"2024-04-26T12:32:03.106125+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:10.173340+0000","scrub_duration":0.002253672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":510,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:44.945930+0000","last_change":"2024-04-26T12:31:44.946041+0000","last_active":"2024-04-26T12:31:44.945930+0000","last_peered":"2024-04-26T12:31:44.945930+0000","last_clean":"2024-04-26T12:31:44.945930+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:31:44.945930+0000","last_undegraded":"2024-04-26T12:31:44.945930+0000","last_fullsized":"2024-04-26T12:31:44.945930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'417","last_scrub_stamp":"2024-04-26T12:31:44.945906+0000","last_deep_scrub":"60'417","last_deep_scrub_stamp":"2024-04-26T12:31:44.945906+0000","last_clean_scrub_stamp":"2024-04-26T12:31:44.945906+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:35.883858+0000","scrub_duration":0.001923143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":913,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.184127+0000","last_change":"2024-04-26T12:30:56.087672+0000","last_active":"2024-04-26T12:31:13.184127+0000","last_peered":"2024-04-26T12:31:13.184127+0000","last_clean":"2024-04-26T12:31:13.184127+0000","last_became_active":"2024-04-26T12:30:56.085904+0000","last_became_peered":"2024-04-26T12:30:56.085904+0000","last_unstale":"2024-04-26T12:31:13.184127+0000","last_undegraded":"2024-04-26T12:31:13.184127+0000","last_fullsized":"2024-04-26T12:31:13.184127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":606,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.239455+0000","last_change":"2024-04-26T12:31:14.239557+0000","last_active":"2024-04-26T12:31:14.239455+0000","last_peered":"2024-04-26T12:31:14.239455+0000","last_clean":"2024-04-26T12:31:14.239455+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:31:14.239455+0000","last_undegraded":"2024-04-26T12:31:14.239455+0000","last_fullsized":"2024-04-26T12:31:14.239455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'366","last_scrub_stamp":"2024-04-26T12:31:14.239429+0000","last_deep_scrub":"60'366","last_deep_scrub_stamp":"2024-04-26T12:31:14.239429+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.239429+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:48.735192+0000","scrub_duration":0.0022088089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":514,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.184090+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:31:13.184090+0000","last_peered":"2024-04-26T12:31:13.184090+0000","last_clean":"2024-04-26T12:31:13.184090+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:31:13.184090+0000","last_undegraded":"2024-04-26T12:31:13.184090+0000","last_fullsized":"2024-04-26T12:31:13.184090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":885,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.184037+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:31:13.184037+0000","last_peered":"2024-04-26T12:31:13.184037+0000","last_clean":"2024-04-26T12:31:13.184037+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:31:13.184037+0000","last_undegraded":"2024-04-26T12:31:13.184037+0000","last_fullsized":"2024-04-26T12:31:13.184037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":522,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149863+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:31:12.149863+0000","last_peered":"2024-04-26T12:31:12.149863+0000","last_clean":"2024-04-26T12:31:12.149863+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:31:12.149863+0000","last_undegraded":"2024-04-26T12:31:12.149863+0000","last_fullsized":"2024-04-26T12:31:12.149863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":552,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:10.151046+0000","last_change":"2024-04-26T12:32:10.151151+0000","last_active":"2024-04-26T12:32:10.151046+0000","last_peered":"2024-04-26T12:32:10.151046+0000","last_clean":"2024-04-26T12:32:10.151046+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:32:10.151046+0000","last_undegraded":"2024-04-26T12:32:10.151046+0000","last_fullsized":"2024-04-26T12:32:10.151046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'429","last_scrub_stamp":"2024-04-26T12:32:10.151020+0000","last_deep_scrub":"60'429","last_deep_scrub_stamp":"2024-04-26T12:32:10.151020+0000","last_clean_scrub_stamp":"2024-04-26T12:32:10.151020+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:54.533321+0000","scrub_duration":0.0024815969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":927,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077781+0000","last_change":"2024-04-26T12:30:50.086415+0000","last_active":"2024-04-26T12:31:00.077781+0000","last_peered":"2024-04-26T12:31:00.077781+0000","last_clean":"2024-04-26T12:31:00.077781+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:31:00.077781+0000","last_undegraded":"2024-04-26T12:31:00.077781+0000","last_fullsized":"2024-04-26T12:31:00.077781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":505,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.966702+0000","last_change":"2024-04-26T12:31:36.966807+0000","last_active":"2024-04-26T12:31:36.966702+0000","last_peered":"2024-04-26T12:31:36.966702+0000","last_clean":"2024-04-26T12:31:36.966702+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:31:36.966702+0000","last_undegraded":"2024-04-26T12:31:36.966702+0000","last_fullsized":"2024-04-26T12:31:36.966702+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-04-26T12:31:36.966676+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-04-26T12:31:36.966676+0000","last_clean_scrub_stamp":"2024-04-26T12:31:36.966676+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:18.037732+0000","scrub_duration":0.0019413729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":925,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.169611+0000","last_change":"2024-04-26T12:31:36.170108+0000","last_active":"2024-04-26T12:31:36.169611+0000","last_peered":"2024-04-26T12:31:36.169611+0000","last_clean":"2024-04-26T12:31:36.169611+0000","last_became_active":"2024-04-26T12:30:57.083026+0000","last_became_peered":"2024-04-26T12:30:57.083026+0000","last_unstale":"2024-04-26T12:31:36.169611+0000","last_undegraded":"2024-04-26T12:31:36.169611+0000","last_fullsized":"2024-04-26T12:31:36.169611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:36.169585+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:36.169585+0000","last_clean_scrub_stamp":"2024-04-26T12:31:36.169585+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:42.604764+0000","scrub_duration":0.0025888259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":538,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.935524+0000","last_change":"2024-04-26T12:31:37.935658+0000","last_active":"2024-04-26T12:31:37.935524+0000","last_peered":"2024-04-26T12:31:37.935524+0000","last_clean":"2024-04-26T12:31:37.935524+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:31:37.935524+0000","last_undegraded":"2024-04-26T12:31:37.935524+0000","last_fullsized":"2024-04-26T12:31:37.935524+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'434","last_scrub_stamp":"2024-04-26T12:31:37.935496+0000","last_deep_scrub":"60'434","last_deep_scrub_stamp":"2024-04-26T12:31:37.935496+0000","last_clean_scrub_stamp":"2024-04-26T12:31:37.935496+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:23.917082+0000","scrub_duration":0.0023281170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1072,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149835+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:31:12.149835+0000","last_peered":"2024-04-26T12:31:12.149835+0000","last_clean":"2024-04-26T12:31:12.149835+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:31:12.149835+0000","last_undegraded":"2024-04-26T12:31:12.149835+0000","last_fullsized":"2024-04-26T12:31:12.149835+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":954,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149824+0000","last_change":"2024-04-26T12:30:46.081416+0000","last_active":"2024-04-26T12:31:12.149824+0000","last_peered":"2024-04-26T12:31:12.149824+0000","last_clean":"2024-04-26T12:31:12.149824+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:31:12.149824+0000","last_undegraded":"2024-04-26T12:31:12.149824+0000","last_fullsized":"2024-04-26T12:31:12.149824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":593,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:23.051416+0000","last_change":"2024-04-26T12:31:23.051416+0000","last_active":"2024-04-26T12:31:23.051416+0000","last_peered":"2024-04-26T12:31:23.051416+0000","last_clean":"2024-04-26T12:31:23.051416+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:31:23.051416+0000","last_undegraded":"2024-04-26T12:31:23.051416+0000","last_fullsized":"2024-04-26T12:31:23.051416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:31:23.051248+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:31:23.051248+0000","last_clean_scrub_stamp":"2024-04-26T12:31:23.051248+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:26.481350+0000","scrub_duration":0.0028000099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":496,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.087485+0000","last_change":"2024-04-26T12:31:00.082038+0000","last_active":"2024-04-26T12:31:00.087485+0000","last_peered":"2024-04-26T12:31:00.087485+0000","last_clean":"2024-04-26T12:31:00.087485+0000","last_became_active":"2024-04-26T12:31:00.079766+0000","last_became_peered":"2024-04-26T12:31:00.079766+0000","last_unstale":"2024-04-26T12:31:00.087485+0000","last_undegraded":"2024-04-26T12:31:00.087485+0000","last_fullsized":"2024-04-26T12:31:00.087485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":1030,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:38.161560+0000","last_change":"2024-04-26T12:31:38.162058+0000","last_active":"2024-04-26T12:31:38.161560+0000","last_peered":"2024-04-26T12:31:38.161560+0000","last_clean":"2024-04-26T12:31:38.161560+0000","last_became_active":"2024-04-26T12:30:58.078211+0000","last_became_peered":"2024-04-26T12:30:58.078211+0000","last_unstale":"2024-04-26T12:31:38.161560+0000","last_undegraded":"2024-04-26T12:31:38.161560+0000","last_fullsized":"2024-04-26T12:31:38.161560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'446","last_scrub_stamp":"2024-04-26T12:31:38.161525+0000","last_deep_scrub":"60'446","last_deep_scrub_stamp":"2024-04-26T12:31:38.161525+0000","last_clean_scrub_stamp":"2024-04-26T12:31:38.161525+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:54.390254+0000","scrub_duration":0.002528092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":561,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:50.233810+0000","last_change":"2024-04-26T12:31:50.233922+0000","last_active":"2024-04-26T12:31:50.233810+0000","last_peered":"2024-04-26T12:31:50.233810+0000","last_clean":"2024-04-26T12:31:50.233810+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:31:50.233810+0000","last_undegraded":"2024-04-26T12:31:50.233810+0000","last_fullsized":"2024-04-26T12:31:50.233810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-04-26T12:31:50.233783+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-04-26T12:31:50.233783+0000","last_clean_scrub_stamp":"2024-04-26T12:31:50.233783+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:54.618065+0000","scrub_duration":0.0025007240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":597,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.010285+0000","last_change":"2024-04-26T12:31:47.010394+0000","last_active":"2024-04-26T12:31:47.010285+0000","last_peered":"2024-04-26T12:31:47.010285+0000","last_clean":"2024-04-26T12:31:47.010285+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:31:47.010285+0000","last_undegraded":"2024-04-26T12:31:47.010285+0000","last_fullsized":"2024-04-26T12:31:47.010285+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'467","last_scrub_stamp":"2024-04-26T12:31:47.010262+0000","last_deep_scrub":"60'467","last_deep_scrub_stamp":"2024-04-26T12:31:47.010262+0000","last_clean_scrub_stamp":"2024-04-26T12:31:47.010262+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:06.785529+0000","scrub_duration":0.002479153,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":526,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:09.153818+0000","last_change":"2024-04-26T12:32:09.153927+0000","last_active":"2024-04-26T12:32:09.153818+0000","last_peered":"2024-04-26T12:32:09.153818+0000","last_clean":"2024-04-26T12:32:09.153818+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:32:09.153818+0000","last_undegraded":"2024-04-26T12:32:09.153818+0000","last_fullsized":"2024-04-26T12:32:09.153818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'398","last_scrub_stamp":"2024-04-26T12:32:09.153791+0000","last_deep_scrub":"60'398","last_deep_scrub_stamp":"2024-04-26T12:32:09.153791+0000","last_clean_scrub_stamp":"2024-04-26T12:32:09.153791+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:18.465189+0000","scrub_duration":0.0028129969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"58'457","reported_seq":569,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183772+0000","last_change":"2024-04-26T12:30:44.022127+0000","last_active":"2024-04-26T12:31:13.183772+0000","last_peered":"2024-04-26T12:31:13.183772+0000","last_clean":"2024-04-26T12:31:13.183772+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:31:13.183772+0000","last_undegraded":"2024-04-26T12:31:13.183772+0000","last_fullsized":"2024-04-26T12:31:13.183772+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.208695+0000","last_change":"2024-04-26T12:31:46.208695+0000","last_active":"2024-04-26T12:31:46.208695+0000","last_peered":"2024-04-26T12:31:46.208695+0000","last_clean":"2024-04-26T12:31:46.208695+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:31:46.208695+0000","last_undegraded":"2024-04-26T12:31:46.208695+0000","last_fullsized":"2024-04-26T12:31:46.208695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'386","last_scrub_stamp":"2024-04-26T12:31:46.208542+0000","last_deep_scrub":"60'386","last_deep_scrub_stamp":"2024-04-26T12:31:46.208542+0000","last_clean_scrub_stamp":"2024-04-26T12:31:46.208542+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:45.386754+0000","scrub_duration":0.0025680009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":411,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077566+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:31:00.077566+0000","last_peered":"2024-04-26T12:31:00.077566+0000","last_clean":"2024-04-26T12:31:00.077566+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:31:00.077566+0000","last_undegraded":"2024-04-26T12:31:00.077566+0000","last_fullsized":"2024-04-26T12:31:00.077566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":478,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078895+0000","last_change":"2024-04-26T12:30:58.081169+0000","last_active":"2024-04-26T12:31:00.078895+0000","last_peered":"2024-04-26T12:31:00.078895+0000","last_clean":"2024-04-26T12:31:00.078895+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:31:00.078895+0000","last_undegraded":"2024-04-26T12:31:00.078895+0000","last_fullsized":"2024-04-26T12:31:00.078895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"85'710","reported_seq":792,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:56.110182+0000","last_change":"2024-04-26T12:31:56.110289+0000","last_active":"2024-04-26T12:31:56.110182+0000","last_peered":"2024-04-26T12:31:56.110182+0000","last_clean":"2024-04-26T12:31:56.110182+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:31:56.110182+0000","last_undegraded":"2024-04-26T12:31:56.110182+0000","last_fullsized":"2024-04-26T12:31:56.110182+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'710","last_scrub_stamp":"2024-04-26T12:31:56.110156+0000","last_deep_scrub":"85'710","last_deep_scrub_stamp":"2024-04-26T12:31:56.110156+0000","last_clean_scrub_stamp":"2024-04-26T12:31:56.110156+0000","objects_scrubbed":2,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:27.621679+0000","scrub_duration":0.025669368000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":512,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.113289+0000","last_change":"2024-04-26T12:31:26.113397+0000","last_active":"2024-04-26T12:31:26.113289+0000","last_peered":"2024-04-26T12:31:26.113289+0000","last_clean":"2024-04-26T12:31:26.113289+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:31:26.113289+0000","last_undegraded":"2024-04-26T12:31:26.113289+0000","last_fullsized":"2024-04-26T12:31:26.113289+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:31:26.113263+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:31:26.113263+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.113263+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:51.012642+0000","scrub_duration":0.001900838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:45.981808+0000","last_change":"2024-04-26T12:31:45.981948+0000","last_active":"2024-04-26T12:31:45.981808+0000","last_peered":"2024-04-26T12:31:45.981808+0000","last_clean":"2024-04-26T12:31:45.981808+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:31:45.981808+0000","last_undegraded":"2024-04-26T12:31:45.981808+0000","last_fullsized":"2024-04-26T12:31:45.981808+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'58","last_scrub_stamp":"2024-04-26T12:31:45.981781+0000","last_deep_scrub":"58'58","last_deep_scrub_stamp":"2024-04-26T12:31:45.981781+0000","last_clean_scrub_stamp":"2024-04-26T12:31:45.981781+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:52.325021+0000","scrub_duration":0.0016923179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":595,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077789+0000","last_change":"2024-04-26T12:30:58.081823+0000","last_active":"2024-04-26T12:31:00.077789+0000","last_peered":"2024-04-26T12:31:00.077789+0000","last_clean":"2024-04-26T12:31:00.077789+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:31:00.077789+0000","last_undegraded":"2024-04-26T12:31:00.077789+0000","last_fullsized":"2024-04-26T12:31:00.077789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"85'356","reported_seq":390,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.259385+0000","last_change":"2024-04-26T12:31:12.259503+0000","last_active":"2024-04-26T12:31:12.259385+0000","last_peered":"2024-04-26T12:31:12.259385+0000","last_clean":"2024-04-26T12:31:12.259385+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:31:12.259385+0000","last_undegraded":"2024-04-26T12:31:12.259385+0000","last_fullsized":"2024-04-26T12:31:12.259385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'356","last_scrub_stamp":"2024-04-26T12:31:12.259359+0000","last_deep_scrub":"85'356","last_deep_scrub_stamp":"2024-04-26T12:31:12.259359+0000","last_clean_scrub_stamp":"2024-04-26T12:31:12.259359+0000","objects_scrubbed":1,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:29.053825+0000","scrub_duration":0.015931049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":732,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:01.093626+0000","last_change":"2024-04-26T12:32:01.093764+0000","last_active":"2024-04-26T12:32:01.093626+0000","last_peered":"2024-04-26T12:32:01.093626+0000","last_clean":"2024-04-26T12:32:01.093626+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:32:01.093626+0000","last_undegraded":"2024-04-26T12:32:01.093626+0000","last_fullsized":"2024-04-26T12:32:01.093626+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'528","last_scrub_stamp":"2024-04-26T12:32:01.093601+0000","last_deep_scrub":"60'528","last_deep_scrub_stamp":"2024-04-26T12:32:01.093601+0000","last_clean_scrub_stamp":"2024-04-26T12:32:01.093601+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:13.828455+0000","scrub_duration":0.0023344469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'86","reported_seq":169,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183738+0000","last_change":"2024-04-26T12:26:52.840928+0000","last_active":"2024-04-26T12:31:13.183738+0000","last_peered":"2024-04-26T12:31:13.183738+0000","last_clean":"2024-04-26T12:31:13.183738+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:31:13.183738+0000","last_undegraded":"2024-04-26T12:31:13.183738+0000","last_fullsized":"2024-04-26T12:31:13.183738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":523,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:04.095180+0000","last_change":"2024-04-26T12:32:04.095303+0000","last_active":"2024-04-26T12:32:04.095180+0000","last_peered":"2024-04-26T12:32:04.095180+0000","last_clean":"2024-04-26T12:32:04.095180+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:32:04.095180+0000","last_undegraded":"2024-04-26T12:32:04.095180+0000","last_fullsized":"2024-04-26T12:32:04.095180+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-04-26T12:32:04.095151+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-04-26T12:32:04.095151+0000","last_clean_scrub_stamp":"2024-04-26T12:32:04.095151+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:13.337155+0000","scrub_duration":0.0023191150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"85'380","reported_seq":457,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.301720+0000","last_change":"2024-04-26T12:31:26.301826+0000","last_active":"2024-04-26T12:31:26.301720+0000","last_peered":"2024-04-26T12:31:26.301720+0000","last_clean":"2024-04-26T12:31:26.301720+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:31:26.301720+0000","last_undegraded":"2024-04-26T12:31:26.301720+0000","last_fullsized":"2024-04-26T12:31:26.301720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'380","last_scrub_stamp":"2024-04-26T12:31:26.301693+0000","last_deep_scrub":"85'380","last_deep_scrub_stamp":"2024-04-26T12:31:26.301693+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.301693+0000","objects_scrubbed":6,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:55.160179+0000","scrub_duration":0.02593227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":518,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.325418+0000","last_change":"2024-04-26T12:31:25.325525+0000","last_active":"2024-04-26T12:31:25.325418+0000","last_peered":"2024-04-26T12:31:25.325418+0000","last_clean":"2024-04-26T12:31:25.325418+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:31:25.325418+0000","last_undegraded":"2024-04-26T12:31:25.325418+0000","last_fullsized":"2024-04-26T12:31:25.325418+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:25.325392+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:25.325392+0000","last_clean_scrub_stamp":"2024-04-26T12:31:25.325392+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:47.712840+0000","scrub_duration":0.0026314070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":650,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149571+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:31:12.149571+0000","last_peered":"2024-04-26T12:31:12.149571+0000","last_clean":"2024-04-26T12:31:12.149571+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:31:12.149571+0000","last_undegraded":"2024-04-26T12:31:12.149571+0000","last_fullsized":"2024-04-26T12:31:12.149571+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":796,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183891+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:31:13.183891+0000","last_peered":"2024-04-26T12:31:13.183891+0000","last_clean":"2024-04-26T12:31:13.183891+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:31:13.183891+0000","last_undegraded":"2024-04-26T12:31:13.183891+0000","last_fullsized":"2024-04-26T12:31:13.183891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:54.112706+0000","last_change":"2024-04-26T12:31:54.112814+0000","last_active":"2024-04-26T12:31:54.112706+0000","last_peered":"2024-04-26T12:31:54.112706+0000","last_clean":"2024-04-26T12:31:54.112706+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:31:54.112706+0000","last_undegraded":"2024-04-26T12:31:54.112706+0000","last_fullsized":"2024-04-26T12:31:54.112706+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'63","last_scrub_stamp":"2024-04-26T12:31:54.112680+0000","last_deep_scrub":"58'63","last_deep_scrub_stamp":"2024-04-26T12:31:54.112680+0000","last_clean_scrub_stamp":"2024-04-26T12:31:54.112680+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:58.061070+0000","scrub_duration":0.0018177499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":873,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:29.158519+0000","last_change":"2024-04-26T12:31:29.158519+0000","last_active":"2024-04-26T12:31:29.158519+0000","last_peered":"2024-04-26T12:31:29.158519+0000","last_clean":"2024-04-26T12:31:29.158519+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:31:29.158519+0000","last_undegraded":"2024-04-26T12:31:29.158519+0000","last_fullsized":"2024-04-26T12:31:29.158519+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'390","last_scrub_stamp":"2024-04-26T12:31:29.158376+0000","last_deep_scrub":"60'390","last_deep_scrub_stamp":"2024-04-26T12:31:29.158376+0000","last_clean_scrub_stamp":"2024-04-26T12:31:29.158376+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:29.361899+0000","scrub_duration":0.0022476710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:09.385378+0000","last_change":"2024-04-26T12:32:09.385498+0000","last_active":"2024-04-26T12:32:09.385378+0000","last_peered":"2024-04-26T12:32:09.385378+0000","last_clean":"2024-04-26T12:32:09.385378+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:32:09.385378+0000","last_undegraded":"2024-04-26T12:32:09.385378+0000","last_fullsized":"2024-04-26T12:32:09.385378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'57","last_scrub_stamp":"2024-04-26T12:32:09.385336+0000","last_deep_scrub":"58'57","last_deep_scrub_stamp":"2024-04-26T12:32:09.385336+0000","last_clean_scrub_stamp":"2024-04-26T12:32:09.385336+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:11.337234+0000","scrub_duration":0.0017443039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":501,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.079002+0000","last_change":"2024-04-26T12:30:59.083411+0000","last_active":"2024-04-26T12:31:00.079002+0000","last_peered":"2024-04-26T12:31:00.079002+0000","last_clean":"2024-04-26T12:31:00.079002+0000","last_became_active":"2024-04-26T12:30:59.081424+0000","last_became_peered":"2024-04-26T12:30:59.081424+0000","last_unstale":"2024-04-26T12:31:00.079002+0000","last_undegraded":"2024-04-26T12:31:00.079002+0000","last_fullsized":"2024-04-26T12:31:00.079002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"85'58","reported_seq":89,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:50.029082+0000","last_change":"2024-04-26T12:31:50.029193+0000","last_active":"2024-04-26T12:31:50.029082+0000","last_peered":"2024-04-26T12:31:50.029082+0000","last_clean":"2024-04-26T12:31:50.029082+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:31:50.029082+0000","last_undegraded":"2024-04-26T12:31:50.029082+0000","last_fullsized":"2024-04-26T12:31:50.029082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'58","last_scrub_stamp":"2024-04-26T12:31:50.029051+0000","last_deep_scrub":"85'58","last_deep_scrub_stamp":"2024-04-26T12:31:50.029051+0000","last_clean_scrub_stamp":"2024-04-26T12:31:50.029051+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:06.160429+0000","scrub_duration":0.0043989739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":539,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.079167+0000","last_change":"2024-04-26T12:30:59.084548+0000","last_active":"2024-04-26T12:31:00.079167+0000","last_peered":"2024-04-26T12:31:00.079167+0000","last_clean":"2024-04-26T12:31:00.079167+0000","last_became_active":"2024-04-26T12:30:59.081463+0000","last_became_peered":"2024-04-26T12:30:59.081463+0000","last_unstale":"2024-04-26T12:31:00.079167+0000","last_undegraded":"2024-04-26T12:31:00.079167+0000","last_fullsized":"2024-04-26T12:31:00.079167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"85'188","reported_seq":223,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.348255+0000","last_change":"2024-04-26T12:31:31.348379+0000","last_active":"2024-04-26T12:31:31.348255+0000","last_peered":"2024-04-26T12:31:31.348255+0000","last_clean":"2024-04-26T12:31:31.348255+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:31:31.348255+0000","last_undegraded":"2024-04-26T12:31:31.348255+0000","last_fullsized":"2024-04-26T12:31:31.348255+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'188","last_scrub_stamp":"2024-04-26T12:31:31.348227+0000","last_deep_scrub":"85'188","last_deep_scrub_stamp":"2024-04-26T12:31:31.348227+0000","last_clean_scrub_stamp":"2024-04-26T12:31:31.348227+0000","objects_scrubbed":2,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:59.084157+0000","scrub_duration":0.015480226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":533,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183956+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:31:13.183956+0000","last_peered":"2024-04-26T12:31:13.183956+0000","last_clean":"2024-04-26T12:31:13.183956+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:31:13.183956+0000","last_undegraded":"2024-04-26T12:31:13.183956+0000","last_fullsized":"2024-04-26T12:31:13.183956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"58'321","reported_seq":442,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183744+0000","last_change":"2024-04-26T12:30:46.080707+0000","last_active":"2024-04-26T12:31:13.183744+0000","last_peered":"2024-04-26T12:31:13.183744+0000","last_clean":"2024-04-26T12:31:13.183744+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:31:13.183744+0000","last_undegraded":"2024-04-26T12:31:13.183744+0000","last_fullsized":"2024-04-26T12:31:13.183744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":989,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:33.193482+0000","last_change":"2024-04-26T12:31:33.193590+0000","last_active":"2024-04-26T12:31:33.193482+0000","last_peered":"2024-04-26T12:31:33.193482+0000","last_clean":"2024-04-26T12:31:33.193482+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:31:33.193482+0000","last_undegraded":"2024-04-26T12:31:33.193482+0000","last_fullsized":"2024-04-26T12:31:33.193482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'437","last_scrub_stamp":"2024-04-26T12:31:33.193453+0000","last_deep_scrub":"60'437","last_deep_scrub_stamp":"2024-04-26T12:31:33.193453+0000","last_clean_scrub_stamp":"2024-04-26T12:31:33.193453+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:25.293233+0000","scrub_duration":0.0023129719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":515,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078761+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:31:00.078761+0000","last_peered":"2024-04-26T12:31:00.078761+0000","last_clean":"2024-04-26T12:31:00.078761+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:31:00.078761+0000","last_undegraded":"2024-04-26T12:31:00.078761+0000","last_fullsized":"2024-04-26T12:31:00.078761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":503,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.254729+0000","last_change":"2024-04-26T12:31:22.254831+0000","last_active":"2024-04-26T12:31:22.254729+0000","last_peered":"2024-04-26T12:31:22.254729+0000","last_clean":"2024-04-26T12:31:22.254729+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:31:22.254729+0000","last_undegraded":"2024-04-26T12:31:22.254729+0000","last_fullsized":"2024-04-26T12:31:22.254729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:31:22.254705+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:31:22.254705+0000","last_clean_scrub_stamp":"2024-04-26T12:31:22.254705+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:09.032368+0000","scrub_duration":0.0022442209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149539+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:12.149539+0000","last_peered":"2024-04-26T12:31:12.149539+0000","last_clean":"2024-04-26T12:31:12.149539+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:31:12.149539+0000","last_undegraded":"2024-04-26T12:31:12.149539+0000","last_fullsized":"2024-04-26T12:31:12.149539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":560,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078080+0000","last_change":"2024-04-26T12:30:48.087858+0000","last_active":"2024-04-26T12:31:00.078080+0000","last_peered":"2024-04-26T12:31:00.078080+0000","last_clean":"2024-04-26T12:31:00.078080+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:31:00.078080+0000","last_undegraded":"2024-04-26T12:31:00.078080+0000","last_fullsized":"2024-04-26T12:31:00.078080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":253,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077791+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:31:00.077791+0000","last_peered":"2024-04-26T12:31:00.077791+0000","last_clean":"2024-04-26T12:31:00.077791+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:31:00.077791+0000","last_undegraded":"2024-04-26T12:31:00.077791+0000","last_fullsized":"2024-04-26T12:31:00.077791+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":538,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078279+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:31:00.078279+0000","last_peered":"2024-04-26T12:31:00.078279+0000","last_clean":"2024-04-26T12:31:00.078279+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:31:00.078279+0000","last_undegraded":"2024-04-26T12:31:00.078279+0000","last_fullsized":"2024-04-26T12:31:00.078279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":270,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149551+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:31:12.149551+0000","last_peered":"2024-04-26T12:31:12.149551+0000","last_clean":"2024-04-26T12:31:12.149551+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:31:12.149551+0000","last_undegraded":"2024-04-26T12:31:12.149551+0000","last_fullsized":"2024-04-26T12:31:12.149551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:20.233238+0000","last_change":"2024-04-26T12:31:20.233368+0000","last_active":"2024-04-26T12:31:20.233238+0000","last_peered":"2024-04-26T12:31:20.233238+0000","last_clean":"2024-04-26T12:31:20.233238+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:31:20.233238+0000","last_undegraded":"2024-04-26T12:31:20.233238+0000","last_fullsized":"2024-04-26T12:31:20.233238+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:31:20.233200+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:31:20.233200+0000","last_clean_scrub_stamp":"2024-04-26T12:31:20.233200+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:03.311719+0000","scrub_duration":0.0025721490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183710+0000","last_change":"2024-04-26T12:30:46.079486+0000","last_active":"2024-04-26T12:31:13.183710+0000","last_peered":"2024-04-26T12:31:13.183710+0000","last_clean":"2024-04-26T12:31:13.183710+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:31:13.183710+0000","last_undegraded":"2024-04-26T12:31:13.183710+0000","last_fullsized":"2024-04-26T12:31:13.183710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":494,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149680+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:31:12.149680+0000","last_peered":"2024-04-26T12:31:12.149680+0000","last_clean":"2024-04-26T12:31:12.149680+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:31:12.149680+0000","last_undegraded":"2024-04-26T12:31:12.149680+0000","last_fullsized":"2024-04-26T12:31:12.149680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":590,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183740+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:31:13.183740+0000","last_peered":"2024-04-26T12:31:13.183740+0000","last_clean":"2024-04-26T12:31:13.183740+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:31:13.183740+0000","last_undegraded":"2024-04-26T12:31:13.183740+0000","last_fullsized":"2024-04-26T12:31:13.183740+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":510,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.890612+0000","last_change":"2024-04-26T12:31:31.890716+0000","last_active":"2024-04-26T12:31:31.890612+0000","last_peered":"2024-04-26T12:31:31.890612+0000","last_clean":"2024-04-26T12:31:31.890612+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:31:31.890612+0000","last_undegraded":"2024-04-26T12:31:31.890612+0000","last_fullsized":"2024-04-26T12:31:31.890612+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'402","last_scrub_stamp":"2024-04-26T12:31:31.890586+0000","last_deep_scrub":"60'402","last_deep_scrub_stamp":"2024-04-26T12:31:31.890586+0000","last_clean_scrub_stamp":"2024-04-26T12:31:31.890586+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:10.281743+0000","scrub_duration":0.0021503030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:23.972595+0000","last_change":"2024-04-26T12:31:23.972717+0000","last_active":"2024-04-26T12:31:23.972595+0000","last_peered":"2024-04-26T12:31:23.972595+0000","last_clean":"2024-04-26T12:31:23.972595+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:31:23.972595+0000","last_undegraded":"2024-04-26T12:31:23.972595+0000","last_fullsized":"2024-04-26T12:31:23.972595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:23.972571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:23.972571+0000","last_clean_scrub_stamp":"2024-04-26T12:31:23.972571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:28.883121+0000","scrub_duration":0.0019705149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"85'455","reported_seq":493,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:48.063732+0000","last_change":"2024-04-26T12:31:48.063866+0000","last_active":"2024-04-26T12:31:48.063732+0000","last_peered":"2024-04-26T12:31:48.063732+0000","last_clean":"2024-04-26T12:31:48.063732+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:31:48.063732+0000","last_undegraded":"2024-04-26T12:31:48.063732+0000","last_fullsized":"2024-04-26T12:31:48.063732+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'455","last_scrub_stamp":"2024-04-26T12:31:48.063706+0000","last_deep_scrub":"85'455","last_deep_scrub_stamp":"2024-04-26T12:31:48.063706+0000","last_clean_scrub_stamp":"2024-04-26T12:31:48.063706+0000","objects_scrubbed":1,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:01.639711+0000","scrub_duration":0.015622934999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":474,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364337+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:31:05.364337+0000","last_peered":"2024-04-26T12:31:05.364337+0000","last_clean":"2024-04-26T12:31:05.364337+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:31:05.364337+0000","last_undegraded":"2024-04-26T12:31:05.364337+0000","last_fullsized":"2024-04-26T12:31:05.364337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.331035+0000","last_change":"2024-04-26T12:30:41.016996+0000","last_active":"2024-04-26T12:31:00.331035+0000","last_peered":"2024-04-26T12:31:00.331035+0000","last_clean":"2024-04-26T12:31:00.331035+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:31:00.331035+0000","last_undegraded":"2024-04-26T12:31:00.331035+0000","last_fullsized":"2024-04-26T12:31:00.331035+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.331856+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:05.331856+0000","last_peered":"2024-04-26T12:31:05.331856+0000","last_clean":"2024-04-26T12:31:05.331856+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:31:05.331856+0000","last_undegraded":"2024-04-26T12:31:05.331856+0000","last_fullsized":"2024-04-26T12:31:05.331856+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":511,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:55.133014+0000","last_change":"2024-04-26T12:31:55.133138+0000","last_active":"2024-04-26T12:31:55.133014+0000","last_peered":"2024-04-26T12:31:55.133014+0000","last_clean":"2024-04-26T12:31:55.133014+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:31:55.133014+0000","last_undegraded":"2024-04-26T12:31:55.133014+0000","last_fullsized":"2024-04-26T12:31:55.133014+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'404","last_scrub_stamp":"2024-04-26T12:31:55.132989+0000","last_deep_scrub":"60'404","last_deep_scrub_stamp":"2024-04-26T12:31:55.132989+0000","last_clean_scrub_stamp":"2024-04-26T12:31:55.132989+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:09.806981+0000","scrub_duration":0.0022071650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077929+0000","last_change":"2024-04-26T12:30:41.025844+0000","last_active":"2024-04-26T12:31:00.077929+0000","last_peered":"2024-04-26T12:31:00.077929+0000","last_clean":"2024-04-26T12:31:00.077929+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:31:00.077929+0000","last_undegraded":"2024-04-26T12:31:00.077929+0000","last_fullsized":"2024-04-26T12:31:00.077929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"58'316","reported_seq":399,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077767+0000","last_change":"2024-04-26T12:26:52.838033+0000","last_active":"2024-04-26T12:31:00.077767+0000","last_peered":"2024-04-26T12:31:00.077767+0000","last_clean":"2024-04-26T12:31:00.077767+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:31:00.077767+0000","last_undegraded":"2024-04-26T12:31:00.077767+0000","last_fullsized":"2024-04-26T12:31:00.077767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":444,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:34.956541+0000","last_change":"2024-04-26T12:31:34.956674+0000","last_active":"2024-04-26T12:31:34.956541+0000","last_peered":"2024-04-26T12:31:34.956541+0000","last_clean":"2024-04-26T12:31:34.956541+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:31:34.956541+0000","last_undegraded":"2024-04-26T12:31:34.956541+0000","last_fullsized":"2024-04-26T12:31:34.956541+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'339","last_scrub_stamp":"2024-04-26T12:31:34.956499+0000","last_deep_scrub":"60'339","last_deep_scrub_stamp":"2024-04-26T12:31:34.956499+0000","last_clean_scrub_stamp":"2024-04-26T12:31:34.956499+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:59.720417+0000","scrub_duration":0.0021999369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:32.328731+0000","last_change":"2024-04-26T12:31:32.328853+0000","last_active":"2024-04-26T12:31:32.328731+0000","last_peered":"2024-04-26T12:31:32.328731+0000","last_clean":"2024-04-26T12:31:32.328731+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:31:32.328731+0000","last_undegraded":"2024-04-26T12:31:32.328731+0000","last_fullsized":"2024-04-26T12:31:32.328731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:32.328709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:32.328709+0000","last_clean_scrub_stamp":"2024-04-26T12:31:32.328709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:20.941744+0000","scrub_duration":0.0019425169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":264,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077875+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:31:00.077875+0000","last_peered":"2024-04-26T12:31:00.077875+0000","last_clean":"2024-04-26T12:31:00.077875+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:31:00.077875+0000","last_undegraded":"2024-04-26T12:31:00.077875+0000","last_fullsized":"2024-04-26T12:31:00.077875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"58'528","reported_seq":599,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078026+0000","last_change":"2024-04-26T12:30:44.023259+0000","last_active":"2024-04-26T12:31:00.078026+0000","last_peered":"2024-04-26T12:31:00.078026+0000","last_clean":"2024-04-26T12:31:00.078026+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:31:00.078026+0000","last_undegraded":"2024-04-26T12:31:00.078026+0000","last_fullsized":"2024-04-26T12:31:00.078026+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":566,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.331963+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:31:05.331963+0000","last_peered":"2024-04-26T12:31:05.331963+0000","last_clean":"2024-04-26T12:31:05.331963+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:31:05.331963+0000","last_undegraded":"2024-04-26T12:31:05.331963+0000","last_fullsized":"2024-04-26T12:31:05.331963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077904+0000","last_change":"2024-04-26T12:26:47.809789+0000","last_active":"2024-04-26T12:31:00.077904+0000","last_peered":"2024-04-26T12:31:00.077904+0000","last_clean":"2024-04-26T12:31:00.077904+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:31:00.077904+0000","last_undegraded":"2024-04-26T12:31:00.077904+0000","last_fullsized":"2024-04-26T12:31:00.077904+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"85'106","reported_seq":235,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:24.978985+0000","last_change":"2024-04-26T12:31:24.979101+0000","last_active":"2024-04-26T12:31:24.978985+0000","last_peered":"2024-04-26T12:31:24.978985+0000","last_clean":"2024-04-26T12:31:24.978985+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:31:24.978985+0000","last_undegraded":"2024-04-26T12:31:24.978985+0000","last_fullsized":"2024-04-26T12:31:24.978985+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'106","last_scrub_stamp":"2024-04-26T12:31:24.978960+0000","last_deep_scrub":"85'106","last_deep_scrub_stamp":"2024-04-26T12:31:24.978960+0000","last_clean_scrub_stamp":"2024-04-26T12:31:24.978960+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:36.841285+0000","scrub_duration":0.0061135809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":980,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:59.363426+0000","last_change":"2024-04-26T12:31:59.363532+0000","last_active":"2024-04-26T12:31:59.363426+0000","last_peered":"2024-04-26T12:31:59.363426+0000","last_clean":"2024-04-26T12:31:59.363426+0000","last_became_active":"2024-04-26T12:30:57.077779+0000","last_became_peered":"2024-04-26T12:30:57.077779+0000","last_unstale":"2024-04-26T12:31:59.363426+0000","last_undegraded":"2024-04-26T12:31:59.363426+0000","last_fullsized":"2024-04-26T12:31:59.363426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'438","last_scrub_stamp":"2024-04-26T12:31:59.363398+0000","last_deep_scrub":"60'438","last_deep_scrub_stamp":"2024-04-26T12:31:59.363398+0000","last_clean_scrub_stamp":"2024-04-26T12:31:59.363398+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:03.749621+0000","scrub_duration":0.0022297010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.363755+0000","last_change":"2024-04-26T12:30:41.028705+0000","last_active":"2024-04-26T12:31:00.363755+0000","last_peered":"2024-04-26T12:31:00.363755+0000","last_clean":"2024-04-26T12:31:00.363755+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:31:00.363755+0000","last_undegraded":"2024-04-26T12:31:00.363755+0000","last_fullsized":"2024-04-26T12:31:00.363755+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:46.799248+0000","last_clean_scrub_stamp":"2024-04-26T12:26:46.799248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:39.992680+0000","last_change":"2024-04-26T12:31:39.992792+0000","last_active":"2024-04-26T12:31:39.992680+0000","last_peered":"2024-04-26T12:31:39.992680+0000","last_clean":"2024-04-26T12:31:39.992680+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:31:39.992680+0000","last_undegraded":"2024-04-26T12:31:39.992680+0000","last_fullsized":"2024-04-26T12:31:39.992680+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'59","last_scrub_stamp":"2024-04-26T12:31:39.992655+0000","last_deep_scrub":"58'59","last_deep_scrub_stamp":"2024-04-26T12:31:39.992655+0000","last_clean_scrub_stamp":"2024-04-26T12:31:39.992655+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:05.570619+0000","scrub_duration":0.001782435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":532,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:45.214912+0000","last_change":"2024-04-26T12:31:45.215071+0000","last_active":"2024-04-26T12:31:45.214912+0000","last_peered":"2024-04-26T12:31:45.214912+0000","last_clean":"2024-04-26T12:31:45.214912+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:31:45.214912+0000","last_undegraded":"2024-04-26T12:31:45.214912+0000","last_fullsized":"2024-04-26T12:31:45.214912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'418","last_scrub_stamp":"2024-04-26T12:31:45.214875+0000","last_deep_scrub":"60'418","last_deep_scrub_stamp":"2024-04-26T12:31:45.214875+0000","last_clean_scrub_stamp":"2024-04-26T12:31:45.214875+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:16.419048+0000","scrub_duration":0.0026123359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"59'62","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078804+0000","last_change":"2024-04-26T12:30:41.029709+0000","last_active":"2024-04-26T12:31:00.078804+0000","last_peered":"2024-04-26T12:31:00.078804+0000","last_clean":"2024-04-26T12:31:00.078804+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:31:00.078804+0000","last_undegraded":"2024-04-26T12:31:00.078804+0000","last_fullsized":"2024-04-26T12:31:00.078804+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.965267+0000","last_change":"2024-04-26T12:31:26.965364+0000","last_active":"2024-04-26T12:31:26.965267+0000","last_peered":"2024-04-26T12:31:26.965267+0000","last_clean":"2024-04-26T12:31:26.965267+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:31:26.965267+0000","last_undegraded":"2024-04-26T12:31:26.965267+0000","last_fullsized":"2024-04-26T12:31:26.965267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:26.965245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:26.965245+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.965245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:27.319599+0000","scrub_duration":0.0017909270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":501,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.084805+0000","last_change":"2024-04-26T12:31:00.081711+0000","last_active":"2024-04-26T12:31:00.084805+0000","last_peered":"2024-04-26T12:31:00.084805+0000","last_clean":"2024-04-26T12:31:00.084805+0000","last_became_active":"2024-04-26T12:31:00.079504+0000","last_became_peered":"2024-04-26T12:31:00.079504+0000","last_unstale":"2024-04-26T12:31:00.084805+0000","last_undegraded":"2024-04-26T12:31:00.084805+0000","last_fullsized":"2024-04-26T12:31:00.084805+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:35.265345+0000","last_change":"2024-04-26T12:31:35.265446+0000","last_active":"2024-04-26T12:31:35.265345+0000","last_peered":"2024-04-26T12:31:35.265345+0000","last_clean":"2024-04-26T12:31:35.265345+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:31:35.265345+0000","last_undegraded":"2024-04-26T12:31:35.265345+0000","last_fullsized":"2024-04-26T12:31:35.265345+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:35.265322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:35.265322+0000","last_clean_scrub_stamp":"2024-04-26T12:31:35.265322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:21.847498+0000","scrub_duration":0.001727751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"85'83","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.000547+0000","last_change":"2024-04-26T12:31:14.000699+0000","last_active":"2024-04-26T12:31:14.000547+0000","last_peered":"2024-04-26T12:31:14.000547+0000","last_clean":"2024-04-26T12:31:14.000547+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:31:14.000547+0000","last_undegraded":"2024-04-26T12:31:14.000547+0000","last_fullsized":"2024-04-26T12:31:14.000547+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'83","last_scrub_stamp":"2024-04-26T12:31:14.000521+0000","last_deep_scrub":"85'83","last_deep_scrub_stamp":"2024-04-26T12:31:14.000521+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.000521+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:11.290115+0000","scrub_duration":0.0069472290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":618,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.173074+0000","last_change":"2024-04-26T12:31:47.173213+0000","last_active":"2024-04-26T12:31:47.173074+0000","last_peered":"2024-04-26T12:31:47.173074+0000","last_clean":"2024-04-26T12:31:47.173074+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:31:47.173074+0000","last_undegraded":"2024-04-26T12:31:47.173074+0000","last_fullsized":"2024-04-26T12:31:47.173074+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-04-26T12:31:47.173047+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-04-26T12:31:47.173047+0000","last_clean_scrub_stamp":"2024-04-26T12:31:47.173047+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:10.331132+0000","scrub_duration":0.002517961,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":175,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183759+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:31:13.183759+0000","last_peered":"2024-04-26T12:31:13.183759+0000","last_clean":"2024-04-26T12:31:13.183759+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:31:13.183759+0000","last_undegraded":"2024-04-26T12:31:13.183759+0000","last_fullsized":"2024-04-26T12:31:13.183759+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":868,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:28.143238+0000","last_change":"2024-04-26T12:31:28.143238+0000","last_active":"2024-04-26T12:31:28.143238+0000","last_peered":"2024-04-26T12:31:28.143238+0000","last_clean":"2024-04-26T12:31:28.143238+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:31:28.143238+0000","last_undegraded":"2024-04-26T12:31:28.143238+0000","last_fullsized":"2024-04-26T12:31:28.143238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:31:28.143070+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:31:28.143070+0000","last_clean_scrub_stamp":"2024-04-26T12:31:28.143070+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:55.111541+0000","scrub_duration":0.0024435799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":312,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078444+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:31:00.078444+0000","last_peered":"2024-04-26T12:31:00.078444+0000","last_clean":"2024-04-26T12:31:00.078444+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:31:00.078444+0000","last_undegraded":"2024-04-26T12:31:00.078444+0000","last_fullsized":"2024-04-26T12:31:00.078444+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":811,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:58.101978+0000","last_change":"2024-04-26T12:31:58.102086+0000","last_active":"2024-04-26T12:31:58.101978+0000","last_peered":"2024-04-26T12:31:58.101978+0000","last_clean":"2024-04-26T12:31:58.101978+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:31:58.101978+0000","last_undegraded":"2024-04-26T12:31:58.101978+0000","last_fullsized":"2024-04-26T12:31:58.101978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'376","last_scrub_stamp":"2024-04-26T12:31:58.101950+0000","last_deep_scrub":"60'376","last_deep_scrub_stamp":"2024-04-26T12:31:58.101950+0000","last_clean_scrub_stamp":"2024-04-26T12:31:58.101950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:13.898836+0000","scrub_duration":0.0019261320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"85'318","reported_seq":412,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:58.388469+0000","last_change":"2024-04-26T12:31:58.388584+0000","last_active":"2024-04-26T12:31:58.388469+0000","last_peered":"2024-04-26T12:31:58.388469+0000","last_clean":"2024-04-26T12:31:58.388469+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:31:58.388469+0000","last_undegraded":"2024-04-26T12:31:58.388469+0000","last_fullsized":"2024-04-26T12:31:58.388469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'318","last_scrub_stamp":"2024-04-26T12:31:58.388443+0000","last_deep_scrub":"85'318","last_deep_scrub_stamp":"2024-04-26T12:31:58.388443+0000","last_clean_scrub_stamp":"2024-04-26T12:31:58.388443+0000","objects_scrubbed":4,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:31.773997+0000","scrub_duration":0.029898854999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":885,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:49.040500+0000","last_change":"2024-04-26T12:31:49.040500+0000","last_active":"2024-04-26T12:31:49.040500+0000","last_peered":"2024-04-26T12:31:49.040500+0000","last_clean":"2024-04-26T12:31:49.040500+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:31:49.040500+0000","last_undegraded":"2024-04-26T12:31:49.040500+0000","last_fullsized":"2024-04-26T12:31:49.040500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:31:49.040316+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:31:49.040316+0000","last_clean_scrub_stamp":"2024-04-26T12:31:49.040316+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:51.229337+0000","scrub_duration":0.0025244709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"85'77","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.984350+0000","last_change":"2024-04-26T12:31:14.984448+0000","last_active":"2024-04-26T12:31:14.984350+0000","last_peered":"2024-04-26T12:31:14.984350+0000","last_clean":"2024-04-26T12:31:14.984350+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:31:14.984350+0000","last_undegraded":"2024-04-26T12:31:14.984350+0000","last_fullsized":"2024-04-26T12:31:14.984350+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'77","last_scrub_stamp":"2024-04-26T12:31:14.984325+0000","last_deep_scrub":"85'77","last_deep_scrub_stamp":"2024-04-26T12:31:14.984325+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.984325+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:53.595109+0000","scrub_duration":0.010871390999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:33.279712+0000","last_change":"2024-04-26T12:31:33.279814+0000","last_active":"2024-04-26T12:31:33.279712+0000","last_peered":"2024-04-26T12:31:33.279712+0000","last_clean":"2024-04-26T12:31:33.279712+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:31:33.279712+0000","last_undegraded":"2024-04-26T12:31:33.279712+0000","last_fullsized":"2024-04-26T12:31:33.279712+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'438","last_scrub_stamp":"2024-04-26T12:31:33.279688+0000","last_deep_scrub":"60'438","last_deep_scrub_stamp":"2024-04-26T12:31:33.279688+0000","last_clean_scrub_stamp":"2024-04-26T12:31:33.279688+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:47.222045+0000","scrub_duration":0.0024948520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"58'50","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078962+0000","last_change":"2024-04-26T12:30:46.080124+0000","last_active":"2024-04-26T12:31:00.078962+0000","last_peered":"2024-04-26T12:31:00.078962+0000","last_clean":"2024-04-26T12:31:00.078962+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:31:00.078962+0000","last_undegraded":"2024-04-26T12:31:00.078962+0000","last_fullsized":"2024-04-26T12:31:00.078962+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":979,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:18.220035+0000","last_change":"2024-04-26T12:31:18.220147+0000","last_active":"2024-04-26T12:31:18.220035+0000","last_peered":"2024-04-26T12:31:18.220035+0000","last_clean":"2024-04-26T12:31:18.220035+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:31:18.220035+0000","last_undegraded":"2024-04-26T12:31:18.220035+0000","last_fullsized":"2024-04-26T12:31:18.220035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'473","last_scrub_stamp":"2024-04-26T12:31:18.220009+0000","last_deep_scrub":"60'473","last_deep_scrub_stamp":"2024-04-26T12:31:18.220009+0000","last_clean_scrub_stamp":"2024-04-26T12:31:18.220009+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:07.523749+0000","scrub_duration":0.0022384369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":864,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078030+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:31:00.078030+0000","last_peered":"2024-04-26T12:31:00.078030+0000","last_clean":"2024-04-26T12:31:00.078030+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:31:00.078030+0000","last_undegraded":"2024-04-26T12:31:00.078030+0000","last_fullsized":"2024-04-26T12:31:00.078030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":540,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:40.993627+0000","last_change":"2024-04-26T12:31:40.993749+0000","last_active":"2024-04-26T12:31:40.993627+0000","last_peered":"2024-04-26T12:31:40.993627+0000","last_clean":"2024-04-26T12:31:40.993627+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:31:40.993627+0000","last_undegraded":"2024-04-26T12:31:40.993627+0000","last_fullsized":"2024-04-26T12:31:40.993627+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'446","last_scrub_stamp":"2024-04-26T12:31:40.993603+0000","last_deep_scrub":"60'446","last_deep_scrub_stamp":"2024-04-26T12:31:40.993603+0000","last_clean_scrub_stamp":"2024-04-26T12:31:40.993603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:27.297067+0000","scrub_duration":0.0020716889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":630,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364349+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:31:05.364349+0000","last_peered":"2024-04-26T12:31:05.364349+0000","last_clean":"2024-04-26T12:31:05.364349+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:31:05.364349+0000","last_undegraded":"2024-04-26T12:31:05.364349+0000","last_fullsized":"2024-04-26T12:31:05.364349+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":527,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:48.035520+0000","last_change":"2024-04-26T12:31:48.035660+0000","last_active":"2024-04-26T12:31:48.035520+0000","last_peered":"2024-04-26T12:31:48.035520+0000","last_clean":"2024-04-26T12:31:48.035520+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:31:48.035520+0000","last_undegraded":"2024-04-26T12:31:48.035520+0000","last_fullsized":"2024-04-26T12:31:48.035520+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'384","last_scrub_stamp":"2024-04-26T12:31:48.035480+0000","last_deep_scrub":"60'384","last_deep_scrub_stamp":"2024-04-26T12:31:48.035480+0000","last_clean_scrub_stamp":"2024-04-26T12:31:48.035480+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:18.919037+0000","scrub_duration":0.002218383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":524,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:40.177293+0000","last_change":"2024-04-26T12:31:40.177393+0000","last_active":"2024-04-26T12:31:40.177293+0000","last_peered":"2024-04-26T12:31:40.177293+0000","last_clean":"2024-04-26T12:31:40.177293+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:31:40.177293+0000","last_undegraded":"2024-04-26T12:31:40.177293+0000","last_fullsized":"2024-04-26T12:31:40.177293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'380","last_scrub_stamp":"2024-04-26T12:31:40.177270+0000","last_deep_scrub":"60'380","last_deep_scrub_stamp":"2024-04-26T12:31:40.177270+0000","last_clean_scrub_stamp":"2024-04-26T12:31:40.177270+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:45.516828+0000","scrub_duration":0.0024862170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79134720,"data_stored":256449018,"data_compressed":38844374,"data_compressed_allocated":48693248,"data_compressed_original":226074624,"omap_allocated":5343,"internal_metadata":0},"log_size":7531,"ondisk_log_size":7531,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738437,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130112,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94241728,"statfs":{"total":96636764160,"available":96503529472,"internally_reserved":0,"allocated":31711232,"data_stored":85785287,"data_compressed":12062822,"data_compressed_allocated":15765504,"data_compressed_original":70336512,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.435},"min":{"1min":0.38100000000000001,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.442},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.41699999999999998,"15min":0.42699999999999999},"min":{"1min":0.35499999999999998,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57599999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Apr 26 12:31:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.47399999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131332,"kb_used_data":32188,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94240508,"statfs":{"total":96636764160,"available":96502280192,"internally_reserved":0,"allocated":32960512,"data_stored":91451171,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:31:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Apr 26 12:31:47 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.44400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33600000000000002,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.59199999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.44500000000000001,"15min":0.46700000000000003},"min":{"1min":0.318,"5min":0.191,"15min":0.191},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.69599999999999995}]}]},{"osd":1,"up_from":64,"seq":274877906964,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62336,"kb_used_data":16760,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309504,"statfs":{"total":96636764160,"available":96572932096,"internally_reserved":0,"allocated":17162240,"data_stored":81548386,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:40 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Apr 26 12:31:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.5}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30789632,"data_stored":84809889,"data_compressed":12028675,"data_compressed_allocated":15720448,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:32:14.732 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.733 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.733 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.733 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.733 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.733 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.733 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.733 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.734 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.734 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.734 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.734 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.734 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.734 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.734 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.735 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.735 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.735 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.735 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.735 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.735 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.735 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.735 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.736 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.736 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.736 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.736 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.736 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.736 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.736 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.736 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.736 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.737 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.737 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.737 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.737 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.737 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:26:45.798066+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.737 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.737 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.737 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.737 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:26:46.799248+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.738 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.738 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.738 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.738 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.738 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.738 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.738 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:14.739 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:32:34.740 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:32:35.102 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:32:35.105 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:32:35.111 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-26T12:32:33.382707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6546,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34383,"ondisk_log_size":34383,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":323780,"kb_used_data":79916,"kb_used_omap":9,"kb_used_meta":243830,"kb_avail":282791740,"statfs":{"total":289910292480,"available":289578741760,"internally_reserved":0,"allocated":81833984,"data_stored":258784844,"data_compressed":38912668,"data_compressed_allocated":48783360,"data_compressed_original":227221504,"omap_allocated":10125,"internal_metadata":249682035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003513"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":913,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:18.003472+0000","last_change":"2024-04-26T12:31:18.003585+0000","last_active":"2024-04-26T12:31:18.003472+0000","last_peered":"2024-04-26T12:31:18.003472+0000","last_clean":"2024-04-26T12:31:18.003472+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:31:18.003472+0000","last_undegraded":"2024-04-26T12:31:18.003472+0000","last_fullsized":"2024-04-26T12:31:18.003472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:18.003445+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:18.003445+0000","last_clean_scrub_stamp":"2024-04-26T12:31:18.003445+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:47.444600+0000","scrub_duration":0.0019588980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":958,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364439+0000","last_change":"2024-04-26T12:30:56.085870+0000","last_active":"2024-04-26T12:31:05.364439+0000","last_peered":"2024-04-26T12:31:05.364439+0000","last_clean":"2024-04-26T12:31:05.364439+0000","last_became_active":"2024-04-26T12:30:56.084642+0000","last_became_peered":"2024-04-26T12:30:56.084642+0000","last_unstale":"2024-04-26T12:31:05.364439+0000","last_undegraded":"2024-04-26T12:31:05.364439+0000","last_fullsized":"2024-04-26T12:31:05.364439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":496,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078732+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:31:00.078732+0000","last_peered":"2024-04-26T12:31:00.078732+0000","last_clean":"2024-04-26T12:31:00.078732+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:31:00.078732+0000","last_undegraded":"2024-04-26T12:31:00.078732+0000","last_fullsized":"2024-04-26T12:31:00.078732+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":879,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:41.224563+0000","last_change":"2024-04-26T12:31:41.224731+0000","last_active":"2024-04-26T12:31:41.224563+0000","last_peered":"2024-04-26T12:31:41.224563+0000","last_clean":"2024-04-26T12:31:41.224563+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:31:41.224563+0000","last_undegraded":"2024-04-26T12:31:41.224563+0000","last_fullsized":"2024-04-26T12:31:41.224563+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:31:41.224537+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:31:41.224537+0000","last_clean_scrub_stamp":"2024-04-26T12:31:41.224537+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:31.770929+0000","scrub_duration":0.0021526079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":952,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:44.166192+0000","last_change":"2024-04-26T12:31:44.166192+0000","last_active":"2024-04-26T12:31:44.166192+0000","last_peered":"2024-04-26T12:31:44.166192+0000","last_clean":"2024-04-26T12:31:44.166192+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:31:44.166192+0000","last_undegraded":"2024-04-26T12:31:44.166192+0000","last_fullsized":"2024-04-26T12:31:44.166192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'430","last_scrub_stamp":"2024-04-26T12:31:44.165994+0000","last_deep_scrub":"60'430","last_deep_scrub_stamp":"2024-04-26T12:31:44.165994+0000","last_clean_scrub_stamp":"2024-04-26T12:31:44.165994+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:15.166663+0000","scrub_duration":0.0026340479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":489,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:15.202084+0000","last_change":"2024-04-26T12:31:15.202198+0000","last_active":"2024-04-26T12:31:15.202084+0000","last_peered":"2024-04-26T12:31:15.202084+0000","last_clean":"2024-04-26T12:31:15.202084+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:31:15.202084+0000","last_undegraded":"2024-04-26T12:31:15.202084+0000","last_fullsized":"2024-04-26T12:31:15.202084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:31:15.202057+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:31:15.202057+0000","last_clean_scrub_stamp":"2024-04-26T12:31:15.202057+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:36.672446+0000","scrub_duration":0.002466312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1041,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:14.136714+0000","last_change":"2024-04-26T12:32:14.136872+0000","last_active":"2024-04-26T12:32:14.136714+0000","last_peered":"2024-04-26T12:32:14.136714+0000","last_clean":"2024-04-26T12:32:14.136714+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:32:14.136714+0000","last_undegraded":"2024-04-26T12:32:14.136714+0000","last_fullsized":"2024-04-26T12:32:14.136714+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'457","last_scrub_stamp":"2024-04-26T12:32:14.136690+0000","last_deep_scrub":"60'457","last_deep_scrub_stamp":"2024-04-26T12:32:14.136690+0000","last_clean_scrub_stamp":"2024-04-26T12:32:14.136690+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:05.085896+0000","scrub_duration":0.0024392419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":779,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:03.106167+0000","last_change":"2024-04-26T12:32:03.106311+0000","last_active":"2024-04-26T12:32:03.106167+0000","last_peered":"2024-04-26T12:32:03.106167+0000","last_clean":"2024-04-26T12:32:03.106167+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:32:03.106167+0000","last_undegraded":"2024-04-26T12:32:03.106167+0000","last_fullsized":"2024-04-26T12:32:03.106167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'371","last_scrub_stamp":"2024-04-26T12:32:03.106125+0000","last_deep_scrub":"60'371","last_deep_scrub_stamp":"2024-04-26T12:32:03.106125+0000","last_clean_scrub_stamp":"2024-04-26T12:32:03.106125+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:10.173340+0000","scrub_duration":0.002253672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":510,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:44.945930+0000","last_change":"2024-04-26T12:31:44.946041+0000","last_active":"2024-04-26T12:31:44.945930+0000","last_peered":"2024-04-26T12:31:44.945930+0000","last_clean":"2024-04-26T12:31:44.945930+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:31:44.945930+0000","last_undegraded":"2024-04-26T12:31:44.945930+0000","last_fullsized":"2024-04-26T12:31:44.945930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'417","last_scrub_stamp":"2024-04-26T12:31:44.945906+0000","last_deep_scrub":"60'417","last_deep_scrub_stamp":"2024-04-26T12:31:44.945906+0000","last_clean_scrub_stamp":"2024-04-26T12:31:44.945906+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:35.883858+0000","scrub_duration":0.001923143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":913,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.184127+0000","last_change":"2024-04-26T12:30:56.087672+0000","last_active":"2024-04-26T12:31:13.184127+0000","last_peered":"2024-04-26T12:31:13.184127+0000","last_clean":"2024-04-26T12:31:13.184127+0000","last_became_active":"2024-04-26T12:30:56.085904+0000","last_became_peered":"2024-04-26T12:30:56.085904+0000","last_unstale":"2024-04-26T12:31:13.184127+0000","last_undegraded":"2024-04-26T12:31:13.184127+0000","last_fullsized":"2024-04-26T12:31:13.184127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":606,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.239455+0000","last_change":"2024-04-26T12:31:14.239557+0000","last_active":"2024-04-26T12:31:14.239455+0000","last_peered":"2024-04-26T12:31:14.239455+0000","last_clean":"2024-04-26T12:31:14.239455+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:31:14.239455+0000","last_undegraded":"2024-04-26T12:31:14.239455+0000","last_fullsized":"2024-04-26T12:31:14.239455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'366","last_scrub_stamp":"2024-04-26T12:31:14.239429+0000","last_deep_scrub":"60'366","last_deep_scrub_stamp":"2024-04-26T12:31:14.239429+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.239429+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:48.735192+0000","scrub_duration":0.0022088089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":514,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.184090+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:31:13.184090+0000","last_peered":"2024-04-26T12:31:13.184090+0000","last_clean":"2024-04-26T12:31:13.184090+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:31:13.184090+0000","last_undegraded":"2024-04-26T12:31:13.184090+0000","last_fullsized":"2024-04-26T12:31:13.184090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":885,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.184037+0000","last_change":"2024-04-26T12:30:49.083891+0000","last_active":"2024-04-26T12:31:13.184037+0000","last_peered":"2024-04-26T12:31:13.184037+0000","last_clean":"2024-04-26T12:31:13.184037+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:31:13.184037+0000","last_undegraded":"2024-04-26T12:31:13.184037+0000","last_fullsized":"2024-04-26T12:31:13.184037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":522,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149863+0000","last_change":"2024-04-26T12:26:53.259412+0000","last_active":"2024-04-26T12:31:12.149863+0000","last_peered":"2024-04-26T12:31:12.149863+0000","last_clean":"2024-04-26T12:31:12.149863+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:31:12.149863+0000","last_undegraded":"2024-04-26T12:31:12.149863+0000","last_fullsized":"2024-04-26T12:31:12.149863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":552,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:10.151046+0000","last_change":"2024-04-26T12:32:10.151151+0000","last_active":"2024-04-26T12:32:10.151046+0000","last_peered":"2024-04-26T12:32:10.151046+0000","last_clean":"2024-04-26T12:32:10.151046+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:32:10.151046+0000","last_undegraded":"2024-04-26T12:32:10.151046+0000","last_fullsized":"2024-04-26T12:32:10.151046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'429","last_scrub_stamp":"2024-04-26T12:32:10.151020+0000","last_deep_scrub":"60'429","last_deep_scrub_stamp":"2024-04-26T12:32:10.151020+0000","last_clean_scrub_stamp":"2024-04-26T12:32:10.151020+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:54.533321+0000","scrub_duration":0.0024815969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":938,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:13.091942+0000","last_change":"2024-04-26T12:32:13.092103+0000","last_active":"2024-04-26T12:32:13.091942+0000","last_peered":"2024-04-26T12:32:13.091942+0000","last_clean":"2024-04-26T12:32:13.091942+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:32:13.091942+0000","last_undegraded":"2024-04-26T12:32:13.091942+0000","last_fullsized":"2024-04-26T12:32:13.091942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'452","last_scrub_stamp":"2024-04-26T12:32:13.091905+0000","last_deep_scrub":"60'452","last_deep_scrub_stamp":"2024-04-26T12:32:13.091905+0000","last_clean_scrub_stamp":"2024-04-26T12:32:13.091905+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:11.459487+0000","scrub_duration":0.002399418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":505,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.966702+0000","last_change":"2024-04-26T12:31:36.966807+0000","last_active":"2024-04-26T12:31:36.966702+0000","last_peered":"2024-04-26T12:31:36.966702+0000","last_clean":"2024-04-26T12:31:36.966702+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:31:36.966702+0000","last_undegraded":"2024-04-26T12:31:36.966702+0000","last_fullsized":"2024-04-26T12:31:36.966702+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-04-26T12:31:36.966676+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-04-26T12:31:36.966676+0000","last_clean_scrub_stamp":"2024-04-26T12:31:36.966676+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:18.037732+0000","scrub_duration":0.0019413729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":925,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.169611+0000","last_change":"2024-04-26T12:31:36.170108+0000","last_active":"2024-04-26T12:31:36.169611+0000","last_peered":"2024-04-26T12:31:36.169611+0000","last_clean":"2024-04-26T12:31:36.169611+0000","last_became_active":"2024-04-26T12:30:57.083026+0000","last_became_peered":"2024-04-26T12:30:57.083026+0000","last_unstale":"2024-04-26T12:31:36.169611+0000","last_undegraded":"2024-04-26T12:31:36.169611+0000","last_fullsized":"2024-04-26T12:31:36.169611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:36.169585+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:36.169585+0000","last_clean_scrub_stamp":"2024-04-26T12:31:36.169585+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:42.604764+0000","scrub_duration":0.0025888259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":538,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.935524+0000","last_change":"2024-04-26T12:31:37.935658+0000","last_active":"2024-04-26T12:31:37.935524+0000","last_peered":"2024-04-26T12:31:37.935524+0000","last_clean":"2024-04-26T12:31:37.935524+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:31:37.935524+0000","last_undegraded":"2024-04-26T12:31:37.935524+0000","last_fullsized":"2024-04-26T12:31:37.935524+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'434","last_scrub_stamp":"2024-04-26T12:31:37.935496+0000","last_deep_scrub":"60'434","last_deep_scrub_stamp":"2024-04-26T12:31:37.935496+0000","last_clean_scrub_stamp":"2024-04-26T12:31:37.935496+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:23.917082+0000","scrub_duration":0.0023281170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1072,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149835+0000","last_change":"2024-04-26T12:30:45.023936+0000","last_active":"2024-04-26T12:31:12.149835+0000","last_peered":"2024-04-26T12:31:12.149835+0000","last_clean":"2024-04-26T12:31:12.149835+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:31:12.149835+0000","last_undegraded":"2024-04-26T12:31:12.149835+0000","last_fullsized":"2024-04-26T12:31:12.149835+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":965,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:12.130632+0000","last_change":"2024-04-26T12:32:12.130753+0000","last_active":"2024-04-26T12:32:12.130632+0000","last_peered":"2024-04-26T12:32:12.130632+0000","last_clean":"2024-04-26T12:32:12.130632+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:32:12.130632+0000","last_undegraded":"2024-04-26T12:32:12.130632+0000","last_fullsized":"2024-04-26T12:32:12.130632+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-04-26T12:32:12.130588+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-04-26T12:32:12.130588+0000","last_clean_scrub_stamp":"2024-04-26T12:32:12.130588+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:08.462918+0000","scrub_duration":0.0024608970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":593,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:23.051416+0000","last_change":"2024-04-26T12:31:23.051416+0000","last_active":"2024-04-26T12:31:23.051416+0000","last_peered":"2024-04-26T12:31:23.051416+0000","last_clean":"2024-04-26T12:31:23.051416+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:31:23.051416+0000","last_undegraded":"2024-04-26T12:31:23.051416+0000","last_fullsized":"2024-04-26T12:31:23.051416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:31:23.051248+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:31:23.051248+0000","last_clean_scrub_stamp":"2024-04-26T12:31:23.051248+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:26.481350+0000","scrub_duration":0.0028000099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":496,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.087485+0000","last_change":"2024-04-26T12:31:00.082038+0000","last_active":"2024-04-26T12:31:00.087485+0000","last_peered":"2024-04-26T12:31:00.087485+0000","last_clean":"2024-04-26T12:31:00.087485+0000","last_became_active":"2024-04-26T12:31:00.079766+0000","last_became_peered":"2024-04-26T12:31:00.079766+0000","last_unstale":"2024-04-26T12:31:00.087485+0000","last_undegraded":"2024-04-26T12:31:00.087485+0000","last_fullsized":"2024-04-26T12:31:00.087485+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":1030,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:38.161560+0000","last_change":"2024-04-26T12:31:38.162058+0000","last_active":"2024-04-26T12:31:38.161560+0000","last_peered":"2024-04-26T12:31:38.161560+0000","last_clean":"2024-04-26T12:31:38.161560+0000","last_became_active":"2024-04-26T12:30:58.078211+0000","last_became_peered":"2024-04-26T12:30:58.078211+0000","last_unstale":"2024-04-26T12:31:38.161560+0000","last_undegraded":"2024-04-26T12:31:38.161560+0000","last_fullsized":"2024-04-26T12:31:38.161560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'446","last_scrub_stamp":"2024-04-26T12:31:38.161525+0000","last_deep_scrub":"60'446","last_deep_scrub_stamp":"2024-04-26T12:31:38.161525+0000","last_clean_scrub_stamp":"2024-04-26T12:31:38.161525+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:54.390254+0000","scrub_duration":0.002528092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":561,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:50.233810+0000","last_change":"2024-04-26T12:31:50.233922+0000","last_active":"2024-04-26T12:31:50.233810+0000","last_peered":"2024-04-26T12:31:50.233810+0000","last_clean":"2024-04-26T12:31:50.233810+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:31:50.233810+0000","last_undegraded":"2024-04-26T12:31:50.233810+0000","last_fullsized":"2024-04-26T12:31:50.233810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-04-26T12:31:50.233783+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-04-26T12:31:50.233783+0000","last_clean_scrub_stamp":"2024-04-26T12:31:50.233783+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:54.618065+0000","scrub_duration":0.0025007240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":597,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.010285+0000","last_change":"2024-04-26T12:31:47.010394+0000","last_active":"2024-04-26T12:31:47.010285+0000","last_peered":"2024-04-26T12:31:47.010285+0000","last_clean":"2024-04-26T12:31:47.010285+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:31:47.010285+0000","last_undegraded":"2024-04-26T12:31:47.010285+0000","last_fullsized":"2024-04-26T12:31:47.010285+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'467","last_scrub_stamp":"2024-04-26T12:31:47.010262+0000","last_deep_scrub":"60'467","last_deep_scrub_stamp":"2024-04-26T12:31:47.010262+0000","last_clean_scrub_stamp":"2024-04-26T12:31:47.010262+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:06.785529+0000","scrub_duration":0.002479153,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":526,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:09.153818+0000","last_change":"2024-04-26T12:32:09.153927+0000","last_active":"2024-04-26T12:32:09.153818+0000","last_peered":"2024-04-26T12:32:09.153818+0000","last_clean":"2024-04-26T12:32:09.153818+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:32:09.153818+0000","last_undegraded":"2024-04-26T12:32:09.153818+0000","last_fullsized":"2024-04-26T12:32:09.153818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'398","last_scrub_stamp":"2024-04-26T12:32:09.153791+0000","last_deep_scrub":"60'398","last_deep_scrub_stamp":"2024-04-26T12:32:09.153791+0000","last_clean_scrub_stamp":"2024-04-26T12:32:09.153791+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:18.465189+0000","scrub_duration":0.0028129969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"85'460","reported_seq":583,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.260820+0000","last_change":"2024-04-26T12:32:23.260981+0000","last_active":"2024-04-26T12:32:23.260820+0000","last_peered":"2024-04-26T12:32:23.260820+0000","last_clean":"2024-04-26T12:32:23.260820+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:32:23.260820+0000","last_undegraded":"2024-04-26T12:32:23.260820+0000","last_fullsized":"2024-04-26T12:32:23.260820+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'460","last_scrub_stamp":"2024-04-26T12:32:23.260772+0000","last_deep_scrub":"85'460","last_deep_scrub_stamp":"2024-04-26T12:32:23.260772+0000","last_clean_scrub_stamp":"2024-04-26T12:32:23.260772+0000","objects_scrubbed":3,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:42.904353+0000","scrub_duration":0.031187894000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.208695+0000","last_change":"2024-04-26T12:31:46.208695+0000","last_active":"2024-04-26T12:31:46.208695+0000","last_peered":"2024-04-26T12:31:46.208695+0000","last_clean":"2024-04-26T12:31:46.208695+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:31:46.208695+0000","last_undegraded":"2024-04-26T12:31:46.208695+0000","last_fullsized":"2024-04-26T12:31:46.208695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'386","last_scrub_stamp":"2024-04-26T12:31:46.208542+0000","last_deep_scrub":"60'386","last_deep_scrub_stamp":"2024-04-26T12:31:46.208542+0000","last_clean_scrub_stamp":"2024-04-26T12:31:46.208542+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:45.386754+0000","scrub_duration":0.0025680009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"58'342","reported_seq":411,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077566+0000","last_change":"2024-04-26T12:30:46.080358+0000","last_active":"2024-04-26T12:31:00.077566+0000","last_peered":"2024-04-26T12:31:00.077566+0000","last_clean":"2024-04-26T12:31:00.077566+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:31:00.077566+0000","last_undegraded":"2024-04-26T12:31:00.077566+0000","last_fullsized":"2024-04-26T12:31:00.077566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":478,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078895+0000","last_change":"2024-04-26T12:30:58.081169+0000","last_active":"2024-04-26T12:31:00.078895+0000","last_peered":"2024-04-26T12:31:00.078895+0000","last_clean":"2024-04-26T12:31:00.078895+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:31:00.078895+0000","last_undegraded":"2024-04-26T12:31:00.078895+0000","last_fullsized":"2024-04-26T12:31:00.078895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"85'710","reported_seq":792,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:56.110182+0000","last_change":"2024-04-26T12:31:56.110289+0000","last_active":"2024-04-26T12:31:56.110182+0000","last_peered":"2024-04-26T12:31:56.110182+0000","last_clean":"2024-04-26T12:31:56.110182+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:31:56.110182+0000","last_undegraded":"2024-04-26T12:31:56.110182+0000","last_fullsized":"2024-04-26T12:31:56.110182+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'710","last_scrub_stamp":"2024-04-26T12:31:56.110156+0000","last_deep_scrub":"85'710","last_deep_scrub_stamp":"2024-04-26T12:31:56.110156+0000","last_clean_scrub_stamp":"2024-04-26T12:31:56.110156+0000","objects_scrubbed":2,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:27.621679+0000","scrub_duration":0.025669368000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":512,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.113289+0000","last_change":"2024-04-26T12:31:26.113397+0000","last_active":"2024-04-26T12:31:26.113289+0000","last_peered":"2024-04-26T12:31:26.113289+0000","last_clean":"2024-04-26T12:31:26.113289+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:31:26.113289+0000","last_undegraded":"2024-04-26T12:31:26.113289+0000","last_fullsized":"2024-04-26T12:31:26.113289+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:31:26.113263+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:31:26.113263+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.113263+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:51.012642+0000","scrub_duration":0.001900838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:45.981808+0000","last_change":"2024-04-26T12:31:45.981948+0000","last_active":"2024-04-26T12:31:45.981808+0000","last_peered":"2024-04-26T12:31:45.981808+0000","last_clean":"2024-04-26T12:31:45.981808+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:31:45.981808+0000","last_undegraded":"2024-04-26T12:31:45.981808+0000","last_fullsized":"2024-04-26T12:31:45.981808+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'58","last_scrub_stamp":"2024-04-26T12:31:45.981781+0000","last_deep_scrub":"58'58","last_deep_scrub_stamp":"2024-04-26T12:31:45.981781+0000","last_clean_scrub_stamp":"2024-04-26T12:31:45.981781+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:52.325021+0000","scrub_duration":0.0016923179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":606,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:24.080832+0000","last_change":"2024-04-26T12:32:24.080935+0000","last_active":"2024-04-26T12:32:24.080832+0000","last_peered":"2024-04-26T12:32:24.080832+0000","last_clean":"2024-04-26T12:32:24.080832+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:32:24.080832+0000","last_undegraded":"2024-04-26T12:32:24.080832+0000","last_fullsized":"2024-04-26T12:32:24.080832+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'473","last_scrub_stamp":"2024-04-26T12:32:24.080805+0000","last_deep_scrub":"60'473","last_deep_scrub_stamp":"2024-04-26T12:32:24.080805+0000","last_clean_scrub_stamp":"2024-04-26T12:32:24.080805+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:06.211096+0000","scrub_duration":0.0026229529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"85'356","reported_seq":390,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.259385+0000","last_change":"2024-04-26T12:31:12.259503+0000","last_active":"2024-04-26T12:31:12.259385+0000","last_peered":"2024-04-26T12:31:12.259385+0000","last_clean":"2024-04-26T12:31:12.259385+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:31:12.259385+0000","last_undegraded":"2024-04-26T12:31:12.259385+0000","last_fullsized":"2024-04-26T12:31:12.259385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'356","last_scrub_stamp":"2024-04-26T12:31:12.259359+0000","last_deep_scrub":"85'356","last_deep_scrub_stamp":"2024-04-26T12:31:12.259359+0000","last_clean_scrub_stamp":"2024-04-26T12:31:12.259359+0000","objects_scrubbed":1,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:29.053825+0000","scrub_duration":0.015931049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":732,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:01.093626+0000","last_change":"2024-04-26T12:32:01.093764+0000","last_active":"2024-04-26T12:32:01.093626+0000","last_peered":"2024-04-26T12:32:01.093626+0000","last_clean":"2024-04-26T12:32:01.093626+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:32:01.093626+0000","last_undegraded":"2024-04-26T12:32:01.093626+0000","last_fullsized":"2024-04-26T12:32:01.093626+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'528","last_scrub_stamp":"2024-04-26T12:32:01.093601+0000","last_deep_scrub":"60'528","last_deep_scrub_stamp":"2024-04-26T12:32:01.093601+0000","last_clean_scrub_stamp":"2024-04-26T12:32:01.093601+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:13.828455+0000","scrub_duration":0.0023344469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"85'88","reported_seq":182,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.241699+0000","last_change":"2024-04-26T12:32:22.241832+0000","last_active":"2024-04-26T12:32:22.241699+0000","last_peered":"2024-04-26T12:32:22.241699+0000","last_clean":"2024-04-26T12:32:22.241699+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:32:22.241699+0000","last_undegraded":"2024-04-26T12:32:22.241699+0000","last_fullsized":"2024-04-26T12:32:22.241699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'88","last_scrub_stamp":"2024-04-26T12:32:22.241659+0000","last_deep_scrub":"85'88","last_deep_scrub_stamp":"2024-04-26T12:32:22.241659+0000","last_clean_scrub_stamp":"2024-04-26T12:32:22.241659+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:01.912257+0000","scrub_duration":0.0038713139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":523,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:04.095180+0000","last_change":"2024-04-26T12:32:04.095303+0000","last_active":"2024-04-26T12:32:04.095180+0000","last_peered":"2024-04-26T12:32:04.095180+0000","last_clean":"2024-04-26T12:32:04.095180+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:32:04.095180+0000","last_undegraded":"2024-04-26T12:32:04.095180+0000","last_fullsized":"2024-04-26T12:32:04.095180+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-04-26T12:32:04.095151+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-04-26T12:32:04.095151+0000","last_clean_scrub_stamp":"2024-04-26T12:32:04.095151+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:13.337155+0000","scrub_duration":0.0023191150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"85'380","reported_seq":457,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.301720+0000","last_change":"2024-04-26T12:31:26.301826+0000","last_active":"2024-04-26T12:31:26.301720+0000","last_peered":"2024-04-26T12:31:26.301720+0000","last_clean":"2024-04-26T12:31:26.301720+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:31:26.301720+0000","last_undegraded":"2024-04-26T12:31:26.301720+0000","last_fullsized":"2024-04-26T12:31:26.301720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'380","last_scrub_stamp":"2024-04-26T12:31:26.301693+0000","last_deep_scrub":"85'380","last_deep_scrub_stamp":"2024-04-26T12:31:26.301693+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.301693+0000","objects_scrubbed":6,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:55.160179+0000","scrub_duration":0.02593227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":518,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.325418+0000","last_change":"2024-04-26T12:31:25.325525+0000","last_active":"2024-04-26T12:31:25.325418+0000","last_peered":"2024-04-26T12:31:25.325418+0000","last_clean":"2024-04-26T12:31:25.325418+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:31:25.325418+0000","last_undegraded":"2024-04-26T12:31:25.325418+0000","last_fullsized":"2024-04-26T12:31:25.325418+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:25.325392+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:25.325392+0000","last_clean_scrub_stamp":"2024-04-26T12:31:25.325392+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:47.712840+0000","scrub_duration":0.0026314070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"58'540","reported_seq":650,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149571+0000","last_change":"2024-04-26T12:30:44.028941+0000","last_active":"2024-04-26T12:31:12.149571+0000","last_peered":"2024-04-26T12:31:12.149571+0000","last_clean":"2024-04-26T12:31:12.149571+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:31:12.149571+0000","last_undegraded":"2024-04-26T12:31:12.149571+0000","last_fullsized":"2024-04-26T12:31:12.149571+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":796,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183891+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:31:13.183891+0000","last_peered":"2024-04-26T12:31:13.183891+0000","last_clean":"2024-04-26T12:31:13.183891+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:31:13.183891+0000","last_undegraded":"2024-04-26T12:31:13.183891+0000","last_fullsized":"2024-04-26T12:31:13.183891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:54.112706+0000","last_change":"2024-04-26T12:31:54.112814+0000","last_active":"2024-04-26T12:31:54.112706+0000","last_peered":"2024-04-26T12:31:54.112706+0000","last_clean":"2024-04-26T12:31:54.112706+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:31:54.112706+0000","last_undegraded":"2024-04-26T12:31:54.112706+0000","last_fullsized":"2024-04-26T12:31:54.112706+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'63","last_scrub_stamp":"2024-04-26T12:31:54.112680+0000","last_deep_scrub":"58'63","last_deep_scrub_stamp":"2024-04-26T12:31:54.112680+0000","last_clean_scrub_stamp":"2024-04-26T12:31:54.112680+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:58.061070+0000","scrub_duration":0.0018177499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":873,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:29.158519+0000","last_change":"2024-04-26T12:31:29.158519+0000","last_active":"2024-04-26T12:31:29.158519+0000","last_peered":"2024-04-26T12:31:29.158519+0000","last_clean":"2024-04-26T12:31:29.158519+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:31:29.158519+0000","last_undegraded":"2024-04-26T12:31:29.158519+0000","last_fullsized":"2024-04-26T12:31:29.158519+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'390","last_scrub_stamp":"2024-04-26T12:31:29.158376+0000","last_deep_scrub":"60'390","last_deep_scrub_stamp":"2024-04-26T12:31:29.158376+0000","last_clean_scrub_stamp":"2024-04-26T12:31:29.158376+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:29.361899+0000","scrub_duration":0.0022476710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:09.385378+0000","last_change":"2024-04-26T12:32:09.385498+0000","last_active":"2024-04-26T12:32:09.385378+0000","last_peered":"2024-04-26T12:32:09.385378+0000","last_clean":"2024-04-26T12:32:09.385378+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:32:09.385378+0000","last_undegraded":"2024-04-26T12:32:09.385378+0000","last_fullsized":"2024-04-26T12:32:09.385378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'57","last_scrub_stamp":"2024-04-26T12:32:09.385336+0000","last_deep_scrub":"58'57","last_deep_scrub_stamp":"2024-04-26T12:32:09.385336+0000","last_clean_scrub_stamp":"2024-04-26T12:32:09.385336+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:11.337234+0000","scrub_duration":0.0017443039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":501,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.079002+0000","last_change":"2024-04-26T12:30:59.083411+0000","last_active":"2024-04-26T12:31:00.079002+0000","last_peered":"2024-04-26T12:31:00.079002+0000","last_clean":"2024-04-26T12:31:00.079002+0000","last_became_active":"2024-04-26T12:30:59.081424+0000","last_became_peered":"2024-04-26T12:30:59.081424+0000","last_unstale":"2024-04-26T12:31:00.079002+0000","last_undegraded":"2024-04-26T12:31:00.079002+0000","last_fullsized":"2024-04-26T12:31:00.079002+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"85'58","reported_seq":89,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:50.029082+0000","last_change":"2024-04-26T12:31:50.029193+0000","last_active":"2024-04-26T12:31:50.029082+0000","last_peered":"2024-04-26T12:31:50.029082+0000","last_clean":"2024-04-26T12:31:50.029082+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:31:50.029082+0000","last_undegraded":"2024-04-26T12:31:50.029082+0000","last_fullsized":"2024-04-26T12:31:50.029082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'58","last_scrub_stamp":"2024-04-26T12:31:50.029051+0000","last_deep_scrub":"85'58","last_deep_scrub_stamp":"2024-04-26T12:31:50.029051+0000","last_clean_scrub_stamp":"2024-04-26T12:31:50.029051+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:06.160429+0000","scrub_duration":0.0043989739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":539,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.079167+0000","last_change":"2024-04-26T12:30:59.084548+0000","last_active":"2024-04-26T12:31:00.079167+0000","last_peered":"2024-04-26T12:31:00.079167+0000","last_clean":"2024-04-26T12:31:00.079167+0000","last_became_active":"2024-04-26T12:30:59.081463+0000","last_became_peered":"2024-04-26T12:30:59.081463+0000","last_unstale":"2024-04-26T12:31:00.079167+0000","last_undegraded":"2024-04-26T12:31:00.079167+0000","last_fullsized":"2024-04-26T12:31:00.079167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"85'188","reported_seq":223,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.348255+0000","last_change":"2024-04-26T12:31:31.348379+0000","last_active":"2024-04-26T12:31:31.348255+0000","last_peered":"2024-04-26T12:31:31.348255+0000","last_clean":"2024-04-26T12:31:31.348255+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:31:31.348255+0000","last_undegraded":"2024-04-26T12:31:31.348255+0000","last_fullsized":"2024-04-26T12:31:31.348255+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'188","last_scrub_stamp":"2024-04-26T12:31:31.348227+0000","last_deep_scrub":"85'188","last_deep_scrub_stamp":"2024-04-26T12:31:31.348227+0000","last_clean_scrub_stamp":"2024-04-26T12:31:31.348227+0000","objects_scrubbed":2,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:59.084157+0000","scrub_duration":0.015480226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":533,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183956+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:31:13.183956+0000","last_peered":"2024-04-26T12:31:13.183956+0000","last_clean":"2024-04-26T12:31:13.183956+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:31:13.183956+0000","last_undegraded":"2024-04-26T12:31:13.183956+0000","last_fullsized":"2024-04-26T12:31:13.183956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"85'323","reported_seq":455,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:21.284562+0000","last_change":"2024-04-26T12:32:21.284688+0000","last_active":"2024-04-26T12:32:21.284562+0000","last_peered":"2024-04-26T12:32:21.284562+0000","last_clean":"2024-04-26T12:32:21.284562+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:32:21.284562+0000","last_undegraded":"2024-04-26T12:32:21.284562+0000","last_fullsized":"2024-04-26T12:32:21.284562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'323","last_scrub_stamp":"2024-04-26T12:32:21.284529+0000","last_deep_scrub":"85'323","last_deep_scrub_stamp":"2024-04-26T12:32:21.284529+0000","last_clean_scrub_stamp":"2024-04-26T12:32:21.284529+0000","objects_scrubbed":2,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.109193+0000","scrub_duration":0.015639103000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":989,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:33.193482+0000","last_change":"2024-04-26T12:31:33.193590+0000","last_active":"2024-04-26T12:31:33.193482+0000","last_peered":"2024-04-26T12:31:33.193482+0000","last_clean":"2024-04-26T12:31:33.193482+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:31:33.193482+0000","last_undegraded":"2024-04-26T12:31:33.193482+0000","last_fullsized":"2024-04-26T12:31:33.193482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'437","last_scrub_stamp":"2024-04-26T12:31:33.193453+0000","last_deep_scrub":"60'437","last_deep_scrub_stamp":"2024-04-26T12:31:33.193453+0000","last_clean_scrub_stamp":"2024-04-26T12:31:33.193453+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:25.293233+0000","scrub_duration":0.0023129719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":515,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078761+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:31:00.078761+0000","last_peered":"2024-04-26T12:31:00.078761+0000","last_clean":"2024-04-26T12:31:00.078761+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:31:00.078761+0000","last_undegraded":"2024-04-26T12:31:00.078761+0000","last_fullsized":"2024-04-26T12:31:00.078761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":503,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.254729+0000","last_change":"2024-04-26T12:31:22.254831+0000","last_active":"2024-04-26T12:31:22.254729+0000","last_peered":"2024-04-26T12:31:22.254729+0000","last_clean":"2024-04-26T12:31:22.254729+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:31:22.254729+0000","last_undegraded":"2024-04-26T12:31:22.254729+0000","last_fullsized":"2024-04-26T12:31:22.254729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:31:22.254705+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:31:22.254705+0000","last_clean_scrub_stamp":"2024-04-26T12:31:22.254705+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:09.032368+0000","scrub_duration":0.0022442209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149539+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:12.149539+0000","last_peered":"2024-04-26T12:31:12.149539+0000","last_clean":"2024-04-26T12:31:12.149539+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:31:12.149539+0000","last_undegraded":"2024-04-26T12:31:12.149539+0000","last_fullsized":"2024-04-26T12:31:12.149539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":571,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.059321+0000","last_change":"2024-04-26T12:32:22.059419+0000","last_active":"2024-04-26T12:32:22.059321+0000","last_peered":"2024-04-26T12:32:22.059321+0000","last_clean":"2024-04-26T12:32:22.059321+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:32:22.059321+0000","last_undegraded":"2024-04-26T12:32:22.059321+0000","last_fullsized":"2024-04-26T12:32:22.059321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'433","last_scrub_stamp":"2024-04-26T12:32:22.059294+0000","last_deep_scrub":"60'433","last_deep_scrub_stamp":"2024-04-26T12:32:22.059294+0000","last_clean_scrub_stamp":"2024-04-26T12:32:22.059294+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:35.581218+0000","scrub_duration":0.0019914970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'181","reported_seq":253,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077791+0000","last_change":"2024-04-26T12:30:46.082490+0000","last_active":"2024-04-26T12:31:00.077791+0000","last_peered":"2024-04-26T12:31:00.077791+0000","last_clean":"2024-04-26T12:31:00.077791+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:31:00.077791+0000","last_undegraded":"2024-04-26T12:31:00.077791+0000","last_fullsized":"2024-04-26T12:31:00.077791+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":538,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078279+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:31:00.078279+0000","last_peered":"2024-04-26T12:31:00.078279+0000","last_clean":"2024-04-26T12:31:00.078279+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:31:00.078279+0000","last_undegraded":"2024-04-26T12:31:00.078279+0000","last_fullsized":"2024-04-26T12:31:00.078279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"58'163","reported_seq":270,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149551+0000","last_change":"2024-04-26T12:30:44.028698+0000","last_active":"2024-04-26T12:31:12.149551+0000","last_peered":"2024-04-26T12:31:12.149551+0000","last_clean":"2024-04-26T12:31:12.149551+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:31:12.149551+0000","last_undegraded":"2024-04-26T12:31:12.149551+0000","last_fullsized":"2024-04-26T12:31:12.149551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:20.233238+0000","last_change":"2024-04-26T12:31:20.233368+0000","last_active":"2024-04-26T12:31:20.233238+0000","last_peered":"2024-04-26T12:31:20.233238+0000","last_clean":"2024-04-26T12:31:20.233238+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:31:20.233238+0000","last_undegraded":"2024-04-26T12:31:20.233238+0000","last_fullsized":"2024-04-26T12:31:20.233238+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:31:20.233200+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:31:20.233200+0000","last_clean_scrub_stamp":"2024-04-26T12:31:20.233200+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:03.311719+0000","scrub_duration":0.0025721490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":175,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:15.309765+0000","last_change":"2024-04-26T12:32:15.309882+0000","last_active":"2024-04-26T12:32:15.309765+0000","last_peered":"2024-04-26T12:32:15.309765+0000","last_clean":"2024-04-26T12:32:15.309765+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:32:15.309765+0000","last_undegraded":"2024-04-26T12:32:15.309765+0000","last_fullsized":"2024-04-26T12:32:15.309765+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'55","last_scrub_stamp":"2024-04-26T12:32:15.309740+0000","last_deep_scrub":"58'55","last_deep_scrub_stamp":"2024-04-26T12:32:15.309740+0000","last_clean_scrub_stamp":"2024-04-26T12:32:15.309740+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:50.961431+0000","scrub_duration":0.0023593640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":494,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149680+0000","last_change":"2024-04-26T12:26:53.265396+0000","last_active":"2024-04-26T12:31:12.149680+0000","last_peered":"2024-04-26T12:31:12.149680+0000","last_clean":"2024-04-26T12:31:12.149680+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:31:12.149680+0000","last_undegraded":"2024-04-26T12:31:12.149680+0000","last_fullsized":"2024-04-26T12:31:12.149680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"58'483","reported_seq":590,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183740+0000","last_change":"2024-04-26T12:30:44.022112+0000","last_active":"2024-04-26T12:31:13.183740+0000","last_peered":"2024-04-26T12:31:13.183740+0000","last_clean":"2024-04-26T12:31:13.183740+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:31:13.183740+0000","last_undegraded":"2024-04-26T12:31:13.183740+0000","last_fullsized":"2024-04-26T12:31:13.183740+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":510,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.890612+0000","last_change":"2024-04-26T12:31:31.890716+0000","last_active":"2024-04-26T12:31:31.890612+0000","last_peered":"2024-04-26T12:31:31.890612+0000","last_clean":"2024-04-26T12:31:31.890612+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:31:31.890612+0000","last_undegraded":"2024-04-26T12:31:31.890612+0000","last_fullsized":"2024-04-26T12:31:31.890612+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'402","last_scrub_stamp":"2024-04-26T12:31:31.890586+0000","last_deep_scrub":"60'402","last_deep_scrub_stamp":"2024-04-26T12:31:31.890586+0000","last_clean_scrub_stamp":"2024-04-26T12:31:31.890586+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:10.281743+0000","scrub_duration":0.0021503030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:23.972595+0000","last_change":"2024-04-26T12:31:23.972717+0000","last_active":"2024-04-26T12:31:23.972595+0000","last_peered":"2024-04-26T12:31:23.972595+0000","last_clean":"2024-04-26T12:31:23.972595+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:31:23.972595+0000","last_undegraded":"2024-04-26T12:31:23.972595+0000","last_fullsized":"2024-04-26T12:31:23.972595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:23.972571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:23.972571+0000","last_clean_scrub_stamp":"2024-04-26T12:31:23.972571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:28.883121+0000","scrub_duration":0.0019705149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"85'455","reported_seq":493,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:48.063732+0000","last_change":"2024-04-26T12:31:48.063866+0000","last_active":"2024-04-26T12:31:48.063732+0000","last_peered":"2024-04-26T12:31:48.063732+0000","last_clean":"2024-04-26T12:31:48.063732+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:31:48.063732+0000","last_undegraded":"2024-04-26T12:31:48.063732+0000","last_fullsized":"2024-04-26T12:31:48.063732+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'455","last_scrub_stamp":"2024-04-26T12:31:48.063706+0000","last_deep_scrub":"85'455","last_deep_scrub_stamp":"2024-04-26T12:31:48.063706+0000","last_clean_scrub_stamp":"2024-04-26T12:31:48.063706+0000","objects_scrubbed":1,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:01.639711+0000","scrub_duration":0.015622934999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":474,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364337+0000","last_change":"2024-04-26T12:26:53.265571+0000","last_active":"2024-04-26T12:31:05.364337+0000","last_peered":"2024-04-26T12:31:05.364337+0000","last_clean":"2024-04-26T12:31:05.364337+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:31:05.364337+0000","last_undegraded":"2024-04-26T12:31:05.364337+0000","last_fullsized":"2024-04-26T12:31:05.364337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:21.978689+0000","last_change":"2024-04-26T12:32:21.978811+0000","last_active":"2024-04-26T12:32:21.978689+0000","last_peered":"2024-04-26T12:32:21.978689+0000","last_clean":"2024-04-26T12:32:21.978689+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:32:21.978689+0000","last_undegraded":"2024-04-26T12:32:21.978689+0000","last_fullsized":"2024-04-26T12:32:21.978689+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:21.978665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:21.978665+0000","last_clean_scrub_stamp":"2024-04-26T12:32:21.978665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:43.330392+0000","scrub_duration":0.001858333,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.331856+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:05.331856+0000","last_peered":"2024-04-26T12:31:05.331856+0000","last_clean":"2024-04-26T12:31:05.331856+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:31:05.331856+0000","last_undegraded":"2024-04-26T12:31:05.331856+0000","last_fullsized":"2024-04-26T12:31:05.331856+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":511,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:55.133014+0000","last_change":"2024-04-26T12:31:55.133138+0000","last_active":"2024-04-26T12:31:55.133014+0000","last_peered":"2024-04-26T12:31:55.133014+0000","last_clean":"2024-04-26T12:31:55.133014+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:31:55.133014+0000","last_undegraded":"2024-04-26T12:31:55.133014+0000","last_fullsized":"2024-04-26T12:31:55.133014+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'404","last_scrub_stamp":"2024-04-26T12:31:55.132989+0000","last_deep_scrub":"60'404","last_deep_scrub_stamp":"2024-04-26T12:31:55.132989+0000","last_clean_scrub_stamp":"2024-04-26T12:31:55.132989+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:09.806981+0000","scrub_duration":0.0022071650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:15.991038+0000","last_change":"2024-04-26T12:32:15.991158+0000","last_active":"2024-04-26T12:32:15.991038+0000","last_peered":"2024-04-26T12:32:15.991038+0000","last_clean":"2024-04-26T12:32:15.991038+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:32:15.991038+0000","last_undegraded":"2024-04-26T12:32:15.991038+0000","last_fullsized":"2024-04-26T12:32:15.991038+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:15.991015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:15.991015+0000","last_clean_scrub_stamp":"2024-04-26T12:32:15.991015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:54.413627+0000","scrub_duration":0.0021248650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"85'318","reported_seq":412,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:14.328479+0000","last_change":"2024-04-26T12:32:14.328682+0000","last_active":"2024-04-26T12:32:14.328479+0000","last_peered":"2024-04-26T12:32:14.328479+0000","last_clean":"2024-04-26T12:32:14.328479+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:32:14.328479+0000","last_undegraded":"2024-04-26T12:32:14.328479+0000","last_fullsized":"2024-04-26T12:32:14.328479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'318","last_scrub_stamp":"2024-04-26T12:32:14.328453+0000","last_deep_scrub":"85'318","last_deep_scrub_stamp":"2024-04-26T12:32:14.328453+0000","last_clean_scrub_stamp":"2024-04-26T12:32:14.328453+0000","objects_scrubbed":2,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:16.594609+0000","scrub_duration":0.022414826999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":444,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:34.956541+0000","last_change":"2024-04-26T12:31:34.956674+0000","last_active":"2024-04-26T12:31:34.956541+0000","last_peered":"2024-04-26T12:31:34.956541+0000","last_clean":"2024-04-26T12:31:34.956541+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:31:34.956541+0000","last_undegraded":"2024-04-26T12:31:34.956541+0000","last_fullsized":"2024-04-26T12:31:34.956541+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'339","last_scrub_stamp":"2024-04-26T12:31:34.956499+0000","last_deep_scrub":"60'339","last_deep_scrub_stamp":"2024-04-26T12:31:34.956499+0000","last_clean_scrub_stamp":"2024-04-26T12:31:34.956499+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:59.720417+0000","scrub_duration":0.0021999369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":85,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:32.328731+0000","last_change":"2024-04-26T12:31:32.328853+0000","last_active":"2024-04-26T12:31:32.328731+0000","last_peered":"2024-04-26T12:31:32.328731+0000","last_clean":"2024-04-26T12:31:32.328731+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:31:32.328731+0000","last_undegraded":"2024-04-26T12:31:32.328731+0000","last_fullsized":"2024-04-26T12:31:32.328731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:32.328709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:32.328709+0000","last_clean_scrub_stamp":"2024-04-26T12:31:32.328709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:20.941744+0000","scrub_duration":0.0019425169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":264,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.077875+0000","last_change":"2024-04-26T12:30:47.083198+0000","last_active":"2024-04-26T12:31:00.077875+0000","last_peered":"2024-04-26T12:31:00.077875+0000","last_clean":"2024-04-26T12:31:00.077875+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:31:00.077875+0000","last_undegraded":"2024-04-26T12:31:00.077875+0000","last_fullsized":"2024-04-26T12:31:00.077875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:45.798066+0000","last_clean_scrub_stamp":"2024-04-26T12:26:45.798066+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"85'530","reported_seq":612,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:13.979225+0000","last_change":"2024-04-26T12:32:13.979318+0000","last_active":"2024-04-26T12:32:13.979225+0000","last_peered":"2024-04-26T12:32:13.979225+0000","last_clean":"2024-04-26T12:32:13.979225+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:32:13.979225+0000","last_undegraded":"2024-04-26T12:32:13.979225+0000","last_fullsized":"2024-04-26T12:32:13.979225+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'530","last_scrub_stamp":"2024-04-26T12:32:13.979200+0000","last_deep_scrub":"85'530","last_deep_scrub_stamp":"2024-04-26T12:32:13.979200+0000","last_clean_scrub_stamp":"2024-04-26T12:32:13.979200+0000","objects_scrubbed":2,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:32.615284+0000","scrub_duration":0.026609192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":566,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.331963+0000","last_change":"2024-04-26T12:26:53.264262+0000","last_active":"2024-04-26T12:31:05.331963+0000","last_peered":"2024-04-26T12:31:05.331963+0000","last_clean":"2024-04-26T12:31:05.331963+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:31:05.331963+0000","last_undegraded":"2024-04-26T12:31:05.331963+0000","last_fullsized":"2024-04-26T12:31:05.331963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:29.947678+0000","last_change":"2024-04-26T12:32:29.947802+0000","last_active":"2024-04-26T12:32:29.947678+0000","last_peered":"2024-04-26T12:32:29.947678+0000","last_clean":"2024-04-26T12:32:29.947678+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:32:29.947678+0000","last_undegraded":"2024-04-26T12:32:29.947678+0000","last_fullsized":"2024-04-26T12:32:29.947678+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:29.947653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:29.947653+0000","last_clean_scrub_stamp":"2024-04-26T12:32:29.947653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:09.849742+0000","scrub_duration":0.0021636390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"85'106","reported_seq":235,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:24.978985+0000","last_change":"2024-04-26T12:31:24.979101+0000","last_active":"2024-04-26T12:31:24.978985+0000","last_peered":"2024-04-26T12:31:24.978985+0000","last_clean":"2024-04-26T12:31:24.978985+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:31:24.978985+0000","last_undegraded":"2024-04-26T12:31:24.978985+0000","last_fullsized":"2024-04-26T12:31:24.978985+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'106","last_scrub_stamp":"2024-04-26T12:31:24.978960+0000","last_deep_scrub":"85'106","last_deep_scrub_stamp":"2024-04-26T12:31:24.978960+0000","last_clean_scrub_stamp":"2024-04-26T12:31:24.978960+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:36.841285+0000","scrub_duration":0.0061135809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":980,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:59.363426+0000","last_change":"2024-04-26T12:31:59.363532+0000","last_active":"2024-04-26T12:31:59.363426+0000","last_peered":"2024-04-26T12:31:59.363426+0000","last_clean":"2024-04-26T12:31:59.363426+0000","last_became_active":"2024-04-26T12:30:57.077779+0000","last_became_peered":"2024-04-26T12:30:57.077779+0000","last_unstale":"2024-04-26T12:31:59.363426+0000","last_undegraded":"2024-04-26T12:31:59.363426+0000","last_fullsized":"2024-04-26T12:31:59.363426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'438","last_scrub_stamp":"2024-04-26T12:31:59.363398+0000","last_deep_scrub":"60'438","last_deep_scrub_stamp":"2024-04-26T12:31:59.363398+0000","last_clean_scrub_stamp":"2024-04-26T12:31:59.363398+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:03.749621+0000","scrub_duration":0.0022297010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:13.324894+0000","last_change":"2024-04-26T12:32:13.325002+0000","last_active":"2024-04-26T12:32:13.324894+0000","last_peered":"2024-04-26T12:32:13.324894+0000","last_clean":"2024-04-26T12:32:13.324894+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:32:13.324894+0000","last_undegraded":"2024-04-26T12:32:13.324894+0000","last_fullsized":"2024-04-26T12:32:13.324894+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:13.324871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:13.324871+0000","last_clean_scrub_stamp":"2024-04-26T12:32:13.324871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.136071+0000","scrub_duration":0.001814179,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:39.992680+0000","last_change":"2024-04-26T12:31:39.992792+0000","last_active":"2024-04-26T12:31:39.992680+0000","last_peered":"2024-04-26T12:31:39.992680+0000","last_clean":"2024-04-26T12:31:39.992680+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:31:39.992680+0000","last_undegraded":"2024-04-26T12:31:39.992680+0000","last_fullsized":"2024-04-26T12:31:39.992680+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'59","last_scrub_stamp":"2024-04-26T12:31:39.992655+0000","last_deep_scrub":"58'59","last_deep_scrub_stamp":"2024-04-26T12:31:39.992655+0000","last_clean_scrub_stamp":"2024-04-26T12:31:39.992655+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:05.570619+0000","scrub_duration":0.001782435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":532,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:45.214912+0000","last_change":"2024-04-26T12:31:45.215071+0000","last_active":"2024-04-26T12:31:45.214912+0000","last_peered":"2024-04-26T12:31:45.214912+0000","last_clean":"2024-04-26T12:31:45.214912+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:31:45.214912+0000","last_undegraded":"2024-04-26T12:31:45.214912+0000","last_fullsized":"2024-04-26T12:31:45.214912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'418","last_scrub_stamp":"2024-04-26T12:31:45.214875+0000","last_deep_scrub":"60'418","last_deep_scrub_stamp":"2024-04-26T12:31:45.214875+0000","last_clean_scrub_stamp":"2024-04-26T12:31:45.214875+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:16.419048+0000","scrub_duration":0.0026123359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'63","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:25.111529+0000","last_change":"2024-04-26T12:32:25.111634+0000","last_active":"2024-04-26T12:32:25.111529+0000","last_peered":"2024-04-26T12:32:25.111529+0000","last_clean":"2024-04-26T12:32:25.111529+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:32:25.111529+0000","last_undegraded":"2024-04-26T12:32:25.111529+0000","last_fullsized":"2024-04-26T12:32:25.111529+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'63","last_scrub_stamp":"2024-04-26T12:32:25.111502+0000","last_deep_scrub":"85'63","last_deep_scrub_stamp":"2024-04-26T12:32:25.111502+0000","last_clean_scrub_stamp":"2024-04-26T12:32:25.111502+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:19.495601+0000","scrub_duration":0.003363904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.965267+0000","last_change":"2024-04-26T12:31:26.965364+0000","last_active":"2024-04-26T12:31:26.965267+0000","last_peered":"2024-04-26T12:31:26.965267+0000","last_clean":"2024-04-26T12:31:26.965267+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:31:26.965267+0000","last_undegraded":"2024-04-26T12:31:26.965267+0000","last_fullsized":"2024-04-26T12:31:26.965267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:26.965245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:26.965245+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.965245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:27.319599+0000","scrub_duration":0.0017909270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":501,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.084805+0000","last_change":"2024-04-26T12:31:00.081711+0000","last_active":"2024-04-26T12:31:00.084805+0000","last_peered":"2024-04-26T12:31:00.084805+0000","last_clean":"2024-04-26T12:31:00.084805+0000","last_became_active":"2024-04-26T12:31:00.079504+0000","last_became_peered":"2024-04-26T12:31:00.079504+0000","last_unstale":"2024-04-26T12:31:00.084805+0000","last_undegraded":"2024-04-26T12:31:00.084805+0000","last_fullsized":"2024-04-26T12:31:00.084805+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:35.265345+0000","last_change":"2024-04-26T12:31:35.265446+0000","last_active":"2024-04-26T12:31:35.265345+0000","last_peered":"2024-04-26T12:31:35.265345+0000","last_clean":"2024-04-26T12:31:35.265345+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:31:35.265345+0000","last_undegraded":"2024-04-26T12:31:35.265345+0000","last_fullsized":"2024-04-26T12:31:35.265345+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:35.265322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:35.265322+0000","last_clean_scrub_stamp":"2024-04-26T12:31:35.265322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:21.847498+0000","scrub_duration":0.001727751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"85'83","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.000547+0000","last_change":"2024-04-26T12:31:14.000699+0000","last_active":"2024-04-26T12:31:14.000547+0000","last_peered":"2024-04-26T12:31:14.000547+0000","last_clean":"2024-04-26T12:31:14.000547+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:31:14.000547+0000","last_undegraded":"2024-04-26T12:31:14.000547+0000","last_fullsized":"2024-04-26T12:31:14.000547+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'83","last_scrub_stamp":"2024-04-26T12:31:14.000521+0000","last_deep_scrub":"85'83","last_deep_scrub_stamp":"2024-04-26T12:31:14.000521+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.000521+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:11.290115+0000","scrub_duration":0.0069472290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":618,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.173074+0000","last_change":"2024-04-26T12:31:47.173213+0000","last_active":"2024-04-26T12:31:47.173074+0000","last_peered":"2024-04-26T12:31:47.173074+0000","last_clean":"2024-04-26T12:31:47.173074+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:31:47.173074+0000","last_undegraded":"2024-04-26T12:31:47.173074+0000","last_fullsized":"2024-04-26T12:31:47.173074+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-04-26T12:31:47.173047+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-04-26T12:31:47.173047+0000","last_clean_scrub_stamp":"2024-04-26T12:31:47.173047+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:10.331132+0000","scrub_duration":0.002517961,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"58'62","reported_seq":175,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183759+0000","last_change":"2024-04-26T12:30:46.080411+0000","last_active":"2024-04-26T12:31:13.183759+0000","last_peered":"2024-04-26T12:31:13.183759+0000","last_clean":"2024-04-26T12:31:13.183759+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:31:13.183759+0000","last_undegraded":"2024-04-26T12:31:13.183759+0000","last_fullsized":"2024-04-26T12:31:13.183759+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":868,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:28.143238+0000","last_change":"2024-04-26T12:31:28.143238+0000","last_active":"2024-04-26T12:31:28.143238+0000","last_peered":"2024-04-26T12:31:28.143238+0000","last_clean":"2024-04-26T12:31:28.143238+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:31:28.143238+0000","last_undegraded":"2024-04-26T12:31:28.143238+0000","last_fullsized":"2024-04-26T12:31:28.143238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:31:28.143070+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:31:28.143070+0000","last_clean_scrub_stamp":"2024-04-26T12:31:28.143070+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:55.111541+0000","scrub_duration":0.0024435799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":312,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078444+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:31:00.078444+0000","last_peered":"2024-04-26T12:31:00.078444+0000","last_clean":"2024-04-26T12:31:00.078444+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:31:00.078444+0000","last_undegraded":"2024-04-26T12:31:00.078444+0000","last_fullsized":"2024-04-26T12:31:00.078444+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":811,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:58.101978+0000","last_change":"2024-04-26T12:31:58.102086+0000","last_active":"2024-04-26T12:31:58.101978+0000","last_peered":"2024-04-26T12:31:58.101978+0000","last_clean":"2024-04-26T12:31:58.101978+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:31:58.101978+0000","last_undegraded":"2024-04-26T12:31:58.101978+0000","last_fullsized":"2024-04-26T12:31:58.101978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'376","last_scrub_stamp":"2024-04-26T12:31:58.101950+0000","last_deep_scrub":"60'376","last_deep_scrub_stamp":"2024-04-26T12:31:58.101950+0000","last_clean_scrub_stamp":"2024-04-26T12:31:58.101950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:13.898836+0000","scrub_duration":0.0019261320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"85'318","reported_seq":412,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:58.388469+0000","last_change":"2024-04-26T12:31:58.388584+0000","last_active":"2024-04-26T12:31:58.388469+0000","last_peered":"2024-04-26T12:31:58.388469+0000","last_clean":"2024-04-26T12:31:58.388469+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:31:58.388469+0000","last_undegraded":"2024-04-26T12:31:58.388469+0000","last_fullsized":"2024-04-26T12:31:58.388469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'318","last_scrub_stamp":"2024-04-26T12:31:58.388443+0000","last_deep_scrub":"85'318","last_deep_scrub_stamp":"2024-04-26T12:31:58.388443+0000","last_clean_scrub_stamp":"2024-04-26T12:31:58.388443+0000","objects_scrubbed":4,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:31.773997+0000","scrub_duration":0.029898854999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":885,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:49.040500+0000","last_change":"2024-04-26T12:31:49.040500+0000","last_active":"2024-04-26T12:31:49.040500+0000","last_peered":"2024-04-26T12:31:49.040500+0000","last_clean":"2024-04-26T12:31:49.040500+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:31:49.040500+0000","last_undegraded":"2024-04-26T12:31:49.040500+0000","last_fullsized":"2024-04-26T12:31:49.040500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:31:49.040316+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:31:49.040316+0000","last_clean_scrub_stamp":"2024-04-26T12:31:49.040316+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:51.229337+0000","scrub_duration":0.0025244709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"85'77","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.984350+0000","last_change":"2024-04-26T12:31:14.984448+0000","last_active":"2024-04-26T12:31:14.984350+0000","last_peered":"2024-04-26T12:31:14.984350+0000","last_clean":"2024-04-26T12:31:14.984350+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:31:14.984350+0000","last_undegraded":"2024-04-26T12:31:14.984350+0000","last_fullsized":"2024-04-26T12:31:14.984350+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'77","last_scrub_stamp":"2024-04-26T12:31:14.984325+0000","last_deep_scrub":"85'77","last_deep_scrub_stamp":"2024-04-26T12:31:14.984325+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.984325+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:53.595109+0000","scrub_duration":0.010871390999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":554,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:33.279712+0000","last_change":"2024-04-26T12:31:33.279814+0000","last_active":"2024-04-26T12:31:33.279712+0000","last_peered":"2024-04-26T12:31:33.279712+0000","last_clean":"2024-04-26T12:31:33.279712+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:31:33.279712+0000","last_undegraded":"2024-04-26T12:31:33.279712+0000","last_fullsized":"2024-04-26T12:31:33.279712+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'438","last_scrub_stamp":"2024-04-26T12:31:33.279688+0000","last_deep_scrub":"60'438","last_deep_scrub_stamp":"2024-04-26T12:31:33.279688+0000","last_clean_scrub_stamp":"2024-04-26T12:31:33.279688+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:47.222045+0000","scrub_duration":0.0024948520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"85'53","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:26.092803+0000","last_change":"2024-04-26T12:32:26.092908+0000","last_active":"2024-04-26T12:32:26.092803+0000","last_peered":"2024-04-26T12:32:26.092803+0000","last_clean":"2024-04-26T12:32:26.092803+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:32:26.092803+0000","last_undegraded":"2024-04-26T12:32:26.092803+0000","last_fullsized":"2024-04-26T12:32:26.092803+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'53","last_scrub_stamp":"2024-04-26T12:32:26.092771+0000","last_deep_scrub":"85'53","last_deep_scrub_stamp":"2024-04-26T12:32:26.092771+0000","last_clean_scrub_stamp":"2024-04-26T12:32:26.092771+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:02.205832+0000","scrub_duration":0.011348034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":979,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:18.220035+0000","last_change":"2024-04-26T12:31:18.220147+0000","last_active":"2024-04-26T12:31:18.220035+0000","last_peered":"2024-04-26T12:31:18.220035+0000","last_clean":"2024-04-26T12:31:18.220035+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:31:18.220035+0000","last_undegraded":"2024-04-26T12:31:18.220035+0000","last_fullsized":"2024-04-26T12:31:18.220035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'473","last_scrub_stamp":"2024-04-26T12:31:18.220009+0000","last_deep_scrub":"60'473","last_deep_scrub_stamp":"2024-04-26T12:31:18.220009+0000","last_clean_scrub_stamp":"2024-04-26T12:31:18.220009+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:07.523749+0000","scrub_duration":0.0022384369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":864,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078030+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:31:00.078030+0000","last_peered":"2024-04-26T12:31:00.078030+0000","last_clean":"2024-04-26T12:31:00.078030+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:31:00.078030+0000","last_undegraded":"2024-04-26T12:31:00.078030+0000","last_fullsized":"2024-04-26T12:31:00.078030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":540,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:40.993627+0000","last_change":"2024-04-26T12:31:40.993749+0000","last_active":"2024-04-26T12:31:40.993627+0000","last_peered":"2024-04-26T12:31:40.993627+0000","last_clean":"2024-04-26T12:31:40.993627+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:31:40.993627+0000","last_undegraded":"2024-04-26T12:31:40.993627+0000","last_fullsized":"2024-04-26T12:31:40.993627+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'446","last_scrub_stamp":"2024-04-26T12:31:40.993603+0000","last_deep_scrub":"60'446","last_deep_scrub_stamp":"2024-04-26T12:31:40.993603+0000","last_clean_scrub_stamp":"2024-04-26T12:31:40.993603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:27.297067+0000","scrub_duration":0.0020716889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":630,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364349+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:31:05.364349+0000","last_peered":"2024-04-26T12:31:05.364349+0000","last_clean":"2024-04-26T12:31:05.364349+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:31:05.364349+0000","last_undegraded":"2024-04-26T12:31:05.364349+0000","last_fullsized":"2024-04-26T12:31:05.364349+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":527,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:48.035520+0000","last_change":"2024-04-26T12:31:48.035660+0000","last_active":"2024-04-26T12:31:48.035520+0000","last_peered":"2024-04-26T12:31:48.035520+0000","last_clean":"2024-04-26T12:31:48.035520+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:31:48.035520+0000","last_undegraded":"2024-04-26T12:31:48.035520+0000","last_fullsized":"2024-04-26T12:31:48.035520+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'384","last_scrub_stamp":"2024-04-26T12:31:48.035480+0000","last_deep_scrub":"60'384","last_deep_scrub_stamp":"2024-04-26T12:31:48.035480+0000","last_clean_scrub_stamp":"2024-04-26T12:31:48.035480+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:18.919037+0000","scrub_duration":0.002218383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":524,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:40.177293+0000","last_change":"2024-04-26T12:31:40.177393+0000","last_active":"2024-04-26T12:31:40.177293+0000","last_peered":"2024-04-26T12:31:40.177293+0000","last_clean":"2024-04-26T12:31:40.177293+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:31:40.177293+0000","last_undegraded":"2024-04-26T12:31:40.177293+0000","last_fullsized":"2024-04-26T12:31:40.177293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'380","last_scrub_stamp":"2024-04-26T12:31:40.177270+0000","last_deep_scrub":"60'380","last_deep_scrub_stamp":"2024-04-26T12:31:40.177270+0000","last_clean_scrub_stamp":"2024-04-26T12:31:40.177270+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:45.516828+0000","scrub_duration":0.0024862170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79134720,"data_stored":256449018,"data_compressed":38844374,"data_compressed_allocated":48693248,"data_compressed_original":226074624,"omap_allocated":5343,"internal_metadata":0},"log_size":7546,"ondisk_log_size":7546,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738441,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130112,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94241728,"statfs":{"total":96636764160,"available":96503529472,"internally_reserved":0,"allocated":31711232,"data_stored":85785287,"data_compressed":12062822,"data_compressed_allocated":15765504,"data_compressed_original":70336512,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:52 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.435},"min":{"1min":0.38100000000000001,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.41699999999999998,"15min":0.42699999999999999},"min":{"1min":0.35499999999999998,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57599999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.33200000000000002}]},{"osd":1,"last update":"Fri Apr 26 12:31:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.38500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131332,"kb_used_data":32188,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94240508,"statfs":{"total":96636764160,"available":96502280192,"internally_reserved":0,"allocated":32960512,"data_stored":91451171,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:31:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Fri Apr 26 12:31:47 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.44400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33600000000000002,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.59199999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.44500000000000001,"15min":0.46700000000000003},"min":{"1min":0.318,"5min":0.191,"15min":0.191},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.53700000000000003}]}]},{"osd":1,"up_from":64,"seq":274877906968,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62336,"kb_used_data":16760,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309504,"statfs":{"total":96636764160,"available":96572932096,"internally_reserved":0,"allocated":17162240,"data_stored":81548386,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:31:40 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.45400000000000001}]},{"osd":2,"last update":"Fri Apr 26 12:31:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30789632,"data_stored":84809889,"data_compressed":12028675,"data_compressed_allocated":15720448,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:32:35.120 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.120 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.120 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.121 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.121 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.121 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.122 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.122 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.123 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.123 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.123 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.124 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.124 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.124 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.125 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.125 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.125 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.125 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.126 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.126 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.126 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.126 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.127 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.127 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.128 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:26:45.798066+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.128 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.128 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.129 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.129 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.129 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.129 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:35.130 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:32:55.130 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:32:55.494 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:32:55.496 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:32:55.506 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-04-26T12:32:55.387963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6546,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34396,"ondisk_log_size":34396,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":323780,"kb_used_data":79916,"kb_used_omap":9,"kb_used_meta":243830,"kb_avail":282791740,"statfs":{"total":289910292480,"available":289578741760,"internally_reserved":0,"allocated":81833984,"data_stored":258784844,"data_compressed":38912668,"data_compressed_allocated":48783360,"data_compressed_original":227221504,"omap_allocated":10125,"internal_metadata":249682035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002684"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":913,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:18.003472+0000","last_change":"2024-04-26T12:31:18.003585+0000","last_active":"2024-04-26T12:31:18.003472+0000","last_peered":"2024-04-26T12:31:18.003472+0000","last_clean":"2024-04-26T12:31:18.003472+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:31:18.003472+0000","last_undegraded":"2024-04-26T12:31:18.003472+0000","last_fullsized":"2024-04-26T12:31:18.003472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:18.003445+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:18.003445+0000","last_clean_scrub_stamp":"2024-04-26T12:31:18.003445+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:47.444600+0000","scrub_duration":0.0019588980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":958,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364439+0000","last_change":"2024-04-26T12:30:56.085870+0000","last_active":"2024-04-26T12:31:05.364439+0000","last_peered":"2024-04-26T12:31:05.364439+0000","last_clean":"2024-04-26T12:31:05.364439+0000","last_became_active":"2024-04-26T12:30:56.084642+0000","last_became_peered":"2024-04-26T12:30:56.084642+0000","last_unstale":"2024-04-26T12:31:05.364439+0000","last_undegraded":"2024-04-26T12:31:05.364439+0000","last_fullsized":"2024-04-26T12:31:05.364439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":497,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149997+0000","last_change":"2024-04-26T12:30:48.089174+0000","last_active":"2024-04-26T12:31:12.149997+0000","last_peered":"2024-04-26T12:31:12.149997+0000","last_clean":"2024-04-26T12:31:12.149997+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:31:12.149997+0000","last_undegraded":"2024-04-26T12:31:12.149997+0000","last_fullsized":"2024-04-26T12:31:12.149997+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":880,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:41.224731+0000","last_change":"2024-04-26T12:31:41.224731+0000","last_active":"2024-04-26T12:31:41.224731+0000","last_peered":"2024-04-26T12:31:41.224731+0000","last_clean":"2024-04-26T12:31:41.224731+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:31:41.224731+0000","last_undegraded":"2024-04-26T12:31:41.224731+0000","last_fullsized":"2024-04-26T12:31:41.224731+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:31:41.224537+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:31:41.224537+0000","last_clean_scrub_stamp":"2024-04-26T12:31:41.224537+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:31.770929+0000","scrub_duration":0.0021526079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":952,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:44.166192+0000","last_change":"2024-04-26T12:31:44.166192+0000","last_active":"2024-04-26T12:31:44.166192+0000","last_peered":"2024-04-26T12:31:44.166192+0000","last_clean":"2024-04-26T12:31:44.166192+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:31:44.166192+0000","last_undegraded":"2024-04-26T12:31:44.166192+0000","last_fullsized":"2024-04-26T12:31:44.166192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'430","last_scrub_stamp":"2024-04-26T12:31:44.165994+0000","last_deep_scrub":"60'430","last_deep_scrub_stamp":"2024-04-26T12:31:44.165994+0000","last_clean_scrub_stamp":"2024-04-26T12:31:44.165994+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:15.166663+0000","scrub_duration":0.0026340479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":489,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:15.202084+0000","last_change":"2024-04-26T12:31:15.202198+0000","last_active":"2024-04-26T12:31:15.202084+0000","last_peered":"2024-04-26T12:31:15.202084+0000","last_clean":"2024-04-26T12:31:15.202084+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:31:15.202084+0000","last_undegraded":"2024-04-26T12:31:15.202084+0000","last_fullsized":"2024-04-26T12:31:15.202084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:31:15.202057+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:31:15.202057+0000","last_clean_scrub_stamp":"2024-04-26T12:31:15.202057+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:36.672446+0000","scrub_duration":0.002466312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1041,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:14.136714+0000","last_change":"2024-04-26T12:32:14.136872+0000","last_active":"2024-04-26T12:32:14.136714+0000","last_peered":"2024-04-26T12:32:14.136714+0000","last_clean":"2024-04-26T12:32:14.136714+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:32:14.136714+0000","last_undegraded":"2024-04-26T12:32:14.136714+0000","last_fullsized":"2024-04-26T12:32:14.136714+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'457","last_scrub_stamp":"2024-04-26T12:32:14.136690+0000","last_deep_scrub":"60'457","last_deep_scrub_stamp":"2024-04-26T12:32:14.136690+0000","last_clean_scrub_stamp":"2024-04-26T12:32:14.136690+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:05.085896+0000","scrub_duration":0.0024392419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":779,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:03.106167+0000","last_change":"2024-04-26T12:32:03.106311+0000","last_active":"2024-04-26T12:32:03.106167+0000","last_peered":"2024-04-26T12:32:03.106167+0000","last_clean":"2024-04-26T12:32:03.106167+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:32:03.106167+0000","last_undegraded":"2024-04-26T12:32:03.106167+0000","last_fullsized":"2024-04-26T12:32:03.106167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'371","last_scrub_stamp":"2024-04-26T12:32:03.106125+0000","last_deep_scrub":"60'371","last_deep_scrub_stamp":"2024-04-26T12:32:03.106125+0000","last_clean_scrub_stamp":"2024-04-26T12:32:03.106125+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:10.173340+0000","scrub_duration":0.002253672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":510,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:44.945930+0000","last_change":"2024-04-26T12:31:44.946041+0000","last_active":"2024-04-26T12:31:44.945930+0000","last_peered":"2024-04-26T12:31:44.945930+0000","last_clean":"2024-04-26T12:31:44.945930+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:31:44.945930+0000","last_undegraded":"2024-04-26T12:31:44.945930+0000","last_fullsized":"2024-04-26T12:31:44.945930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'417","last_scrub_stamp":"2024-04-26T12:31:44.945906+0000","last_deep_scrub":"60'417","last_deep_scrub_stamp":"2024-04-26T12:31:44.945906+0000","last_clean_scrub_stamp":"2024-04-26T12:31:44.945906+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:35.883858+0000","scrub_duration":0.001923143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":913,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.184127+0000","last_change":"2024-04-26T12:30:56.087672+0000","last_active":"2024-04-26T12:31:13.184127+0000","last_peered":"2024-04-26T12:31:13.184127+0000","last_clean":"2024-04-26T12:31:13.184127+0000","last_became_active":"2024-04-26T12:30:56.085904+0000","last_became_peered":"2024-04-26T12:30:56.085904+0000","last_unstale":"2024-04-26T12:31:13.184127+0000","last_undegraded":"2024-04-26T12:31:13.184127+0000","last_fullsized":"2024-04-26T12:31:13.184127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":606,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.239455+0000","last_change":"2024-04-26T12:31:14.239557+0000","last_active":"2024-04-26T12:31:14.239455+0000","last_peered":"2024-04-26T12:31:14.239455+0000","last_clean":"2024-04-26T12:31:14.239455+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:31:14.239455+0000","last_undegraded":"2024-04-26T12:31:14.239455+0000","last_fullsized":"2024-04-26T12:31:14.239455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'366","last_scrub_stamp":"2024-04-26T12:31:14.239429+0000","last_deep_scrub":"60'366","last_deep_scrub_stamp":"2024-04-26T12:31:14.239429+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.239429+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:48.735192+0000","scrub_duration":0.0022088089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":514,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.184090+0000","last_change":"2024-04-26T12:26:53.260401+0000","last_active":"2024-04-26T12:31:13.184090+0000","last_peered":"2024-04-26T12:31:13.184090+0000","last_clean":"2024-04-26T12:31:13.184090+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:31:13.184090+0000","last_undegraded":"2024-04-26T12:31:13.184090+0000","last_fullsized":"2024-04-26T12:31:13.184090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":896,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:51.325991+0000","last_change":"2024-04-26T12:32:51.326108+0000","last_active":"2024-04-26T12:32:51.325991+0000","last_peered":"2024-04-26T12:32:51.325991+0000","last_clean":"2024-04-26T12:32:51.325991+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:32:51.325991+0000","last_undegraded":"2024-04-26T12:32:51.325991+0000","last_fullsized":"2024-04-26T12:32:51.325991+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'420","last_scrub_stamp":"2024-04-26T12:32:51.325964+0000","last_deep_scrub":"60'420","last_deep_scrub_stamp":"2024-04-26T12:32:51.325964+0000","last_clean_scrub_stamp":"2024-04-26T12:32:51.325964+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:21.753699+0000","scrub_duration":0.001947617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":533,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:41.944310+0000","last_change":"2024-04-26T12:32:41.944416+0000","last_active":"2024-04-26T12:32:41.944310+0000","last_peered":"2024-04-26T12:32:41.944310+0000","last_clean":"2024-04-26T12:32:41.944310+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:32:41.944310+0000","last_undegraded":"2024-04-26T12:32:41.944310+0000","last_fullsized":"2024-04-26T12:32:41.944310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'418","last_scrub_stamp":"2024-04-26T12:32:41.944281+0000","last_deep_scrub":"60'418","last_deep_scrub_stamp":"2024-04-26T12:32:41.944281+0000","last_clean_scrub_stamp":"2024-04-26T12:32:41.944281+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:20.201209+0000","scrub_duration":0.0033717819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":552,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:10.151046+0000","last_change":"2024-04-26T12:32:10.151151+0000","last_active":"2024-04-26T12:32:10.151046+0000","last_peered":"2024-04-26T12:32:10.151046+0000","last_clean":"2024-04-26T12:32:10.151046+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:32:10.151046+0000","last_undegraded":"2024-04-26T12:32:10.151046+0000","last_fullsized":"2024-04-26T12:32:10.151046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'429","last_scrub_stamp":"2024-04-26T12:32:10.151020+0000","last_deep_scrub":"60'429","last_deep_scrub_stamp":"2024-04-26T12:32:10.151020+0000","last_clean_scrub_stamp":"2024-04-26T12:32:10.151020+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:54.533321+0000","scrub_duration":0.0024815969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":938,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:13.091942+0000","last_change":"2024-04-26T12:32:13.092103+0000","last_active":"2024-04-26T12:32:13.091942+0000","last_peered":"2024-04-26T12:32:13.091942+0000","last_clean":"2024-04-26T12:32:13.091942+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:32:13.091942+0000","last_undegraded":"2024-04-26T12:32:13.091942+0000","last_fullsized":"2024-04-26T12:32:13.091942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'452","last_scrub_stamp":"2024-04-26T12:32:13.091905+0000","last_deep_scrub":"60'452","last_deep_scrub_stamp":"2024-04-26T12:32:13.091905+0000","last_clean_scrub_stamp":"2024-04-26T12:32:13.091905+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:11.459487+0000","scrub_duration":0.002399418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":505,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.966702+0000","last_change":"2024-04-26T12:31:36.966807+0000","last_active":"2024-04-26T12:31:36.966702+0000","last_peered":"2024-04-26T12:31:36.966702+0000","last_clean":"2024-04-26T12:31:36.966702+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:31:36.966702+0000","last_undegraded":"2024-04-26T12:31:36.966702+0000","last_fullsized":"2024-04-26T12:31:36.966702+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-04-26T12:31:36.966676+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-04-26T12:31:36.966676+0000","last_clean_scrub_stamp":"2024-04-26T12:31:36.966676+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:18.037732+0000","scrub_duration":0.0019413729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":925,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.169611+0000","last_change":"2024-04-26T12:31:36.170108+0000","last_active":"2024-04-26T12:31:36.169611+0000","last_peered":"2024-04-26T12:31:36.169611+0000","last_clean":"2024-04-26T12:31:36.169611+0000","last_became_active":"2024-04-26T12:30:57.083026+0000","last_became_peered":"2024-04-26T12:30:57.083026+0000","last_unstale":"2024-04-26T12:31:36.169611+0000","last_undegraded":"2024-04-26T12:31:36.169611+0000","last_fullsized":"2024-04-26T12:31:36.169611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:36.169585+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:36.169585+0000","last_clean_scrub_stamp":"2024-04-26T12:31:36.169585+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:42.604764+0000","scrub_duration":0.0025888259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":539,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.935658+0000","last_change":"2024-04-26T12:31:37.935658+0000","last_active":"2024-04-26T12:31:37.935658+0000","last_peered":"2024-04-26T12:31:37.935658+0000","last_clean":"2024-04-26T12:31:37.935658+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:31:37.935658+0000","last_undegraded":"2024-04-26T12:31:37.935658+0000","last_fullsized":"2024-04-26T12:31:37.935658+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'434","last_scrub_stamp":"2024-04-26T12:31:37.935496+0000","last_deep_scrub":"60'434","last_deep_scrub_stamp":"2024-04-26T12:31:37.935496+0000","last_clean_scrub_stamp":"2024-04-26T12:31:37.935496+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:23.917082+0000","scrub_duration":0.0023281170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1083,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:52.995900+0000","last_change":"2024-04-26T12:32:52.996009+0000","last_active":"2024-04-26T12:32:52.995900+0000","last_peered":"2024-04-26T12:32:52.995900+0000","last_clean":"2024-04-26T12:32:52.995900+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:32:52.995900+0000","last_undegraded":"2024-04-26T12:32:52.995900+0000","last_fullsized":"2024-04-26T12:32:52.995900+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'478","last_scrub_stamp":"2024-04-26T12:32:52.995859+0000","last_deep_scrub":"60'478","last_deep_scrub_stamp":"2024-04-26T12:32:52.995859+0000","last_clean_scrub_stamp":"2024-04-26T12:32:52.995859+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.131912+0000","scrub_duration":0.002097369,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":965,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:12.130632+0000","last_change":"2024-04-26T12:32:12.130753+0000","last_active":"2024-04-26T12:32:12.130632+0000","last_peered":"2024-04-26T12:32:12.130632+0000","last_clean":"2024-04-26T12:32:12.130632+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:32:12.130632+0000","last_undegraded":"2024-04-26T12:32:12.130632+0000","last_fullsized":"2024-04-26T12:32:12.130632+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-04-26T12:32:12.130588+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-04-26T12:32:12.130588+0000","last_clean_scrub_stamp":"2024-04-26T12:32:12.130588+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:08.462918+0000","scrub_duration":0.0024608970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":593,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:23.051416+0000","last_change":"2024-04-26T12:31:23.051416+0000","last_active":"2024-04-26T12:31:23.051416+0000","last_peered":"2024-04-26T12:31:23.051416+0000","last_clean":"2024-04-26T12:31:23.051416+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:31:23.051416+0000","last_undegraded":"2024-04-26T12:31:23.051416+0000","last_fullsized":"2024-04-26T12:31:23.051416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:31:23.051248+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:31:23.051248+0000","last_clean_scrub_stamp":"2024-04-26T12:31:23.051248+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:26.481350+0000","scrub_duration":0.0028000099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":508,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:46.004411+0000","last_change":"2024-04-26T12:32:46.004411+0000","last_active":"2024-04-26T12:32:46.004411+0000","last_peered":"2024-04-26T12:32:46.004411+0000","last_clean":"2024-04-26T12:32:46.004411+0000","last_became_active":"2024-04-26T12:31:00.079766+0000","last_became_peered":"2024-04-26T12:31:00.079766+0000","last_unstale":"2024-04-26T12:32:46.004411+0000","last_undegraded":"2024-04-26T12:32:46.004411+0000","last_fullsized":"2024-04-26T12:32:46.004411+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-04-26T12:32:46.004284+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-04-26T12:32:46.004284+0000","last_clean_scrub_stamp":"2024-04-26T12:32:46.004284+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:44.748451+0000","scrub_duration":0.0021761100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":1030,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:38.161560+0000","last_change":"2024-04-26T12:31:38.162058+0000","last_active":"2024-04-26T12:31:38.161560+0000","last_peered":"2024-04-26T12:31:38.161560+0000","last_clean":"2024-04-26T12:31:38.161560+0000","last_became_active":"2024-04-26T12:30:58.078211+0000","last_became_peered":"2024-04-26T12:30:58.078211+0000","last_unstale":"2024-04-26T12:31:38.161560+0000","last_undegraded":"2024-04-26T12:31:38.161560+0000","last_fullsized":"2024-04-26T12:31:38.161560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'446","last_scrub_stamp":"2024-04-26T12:31:38.161525+0000","last_deep_scrub":"60'446","last_deep_scrub_stamp":"2024-04-26T12:31:38.161525+0000","last_clean_scrub_stamp":"2024-04-26T12:31:38.161525+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:54.390254+0000","scrub_duration":0.002528092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":561,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:50.233810+0000","last_change":"2024-04-26T12:31:50.233922+0000","last_active":"2024-04-26T12:31:50.233810+0000","last_peered":"2024-04-26T12:31:50.233810+0000","last_clean":"2024-04-26T12:31:50.233810+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:31:50.233810+0000","last_undegraded":"2024-04-26T12:31:50.233810+0000","last_fullsized":"2024-04-26T12:31:50.233810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-04-26T12:31:50.233783+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-04-26T12:31:50.233783+0000","last_clean_scrub_stamp":"2024-04-26T12:31:50.233783+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:54.618065+0000","scrub_duration":0.0025007240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":598,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.010394+0000","last_change":"2024-04-26T12:31:47.010394+0000","last_active":"2024-04-26T12:31:47.010394+0000","last_peered":"2024-04-26T12:31:47.010394+0000","last_clean":"2024-04-26T12:31:47.010394+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:31:47.010394+0000","last_undegraded":"2024-04-26T12:31:47.010394+0000","last_fullsized":"2024-04-26T12:31:47.010394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'467","last_scrub_stamp":"2024-04-26T12:31:47.010262+0000","last_deep_scrub":"60'467","last_deep_scrub_stamp":"2024-04-26T12:31:47.010262+0000","last_clean_scrub_stamp":"2024-04-26T12:31:47.010262+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:06.785529+0000","scrub_duration":0.002479153,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":526,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:09.153818+0000","last_change":"2024-04-26T12:32:09.153927+0000","last_active":"2024-04-26T12:32:09.153818+0000","last_peered":"2024-04-26T12:32:09.153818+0000","last_clean":"2024-04-26T12:32:09.153818+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:32:09.153818+0000","last_undegraded":"2024-04-26T12:32:09.153818+0000","last_fullsized":"2024-04-26T12:32:09.153818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'398","last_scrub_stamp":"2024-04-26T12:32:09.153791+0000","last_deep_scrub":"60'398","last_deep_scrub_stamp":"2024-04-26T12:32:09.153791+0000","last_clean_scrub_stamp":"2024-04-26T12:32:09.153791+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:18.465189+0000","scrub_duration":0.0028129969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"85'460","reported_seq":583,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.260820+0000","last_change":"2024-04-26T12:32:23.260981+0000","last_active":"2024-04-26T12:32:23.260820+0000","last_peered":"2024-04-26T12:32:23.260820+0000","last_clean":"2024-04-26T12:32:23.260820+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:32:23.260820+0000","last_undegraded":"2024-04-26T12:32:23.260820+0000","last_fullsized":"2024-04-26T12:32:23.260820+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'460","last_scrub_stamp":"2024-04-26T12:32:23.260772+0000","last_deep_scrub":"85'460","last_deep_scrub_stamp":"2024-04-26T12:32:23.260772+0000","last_clean_scrub_stamp":"2024-04-26T12:32:23.260772+0000","objects_scrubbed":3,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:42.904353+0000","scrub_duration":0.031187894000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.208695+0000","last_change":"2024-04-26T12:31:46.208695+0000","last_active":"2024-04-26T12:31:46.208695+0000","last_peered":"2024-04-26T12:31:46.208695+0000","last_clean":"2024-04-26T12:31:46.208695+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:31:46.208695+0000","last_undegraded":"2024-04-26T12:31:46.208695+0000","last_fullsized":"2024-04-26T12:31:46.208695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'386","last_scrub_stamp":"2024-04-26T12:31:46.208542+0000","last_deep_scrub":"60'386","last_deep_scrub_stamp":"2024-04-26T12:31:46.208542+0000","last_clean_scrub_stamp":"2024-04-26T12:31:46.208542+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:45.386754+0000","scrub_duration":0.0025680009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"85'343","reported_seq":423,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:32.019967+0000","last_change":"2024-04-26T12:32:32.020118+0000","last_active":"2024-04-26T12:32:32.019967+0000","last_peered":"2024-04-26T12:32:32.019967+0000","last_clean":"2024-04-26T12:32:32.019967+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:32:32.019967+0000","last_undegraded":"2024-04-26T12:32:32.019967+0000","last_fullsized":"2024-04-26T12:32:32.019967+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'343","last_scrub_stamp":"2024-04-26T12:32:32.019929+0000","last_deep_scrub":"85'343","last_deep_scrub_stamp":"2024-04-26T12:32:32.019929+0000","last_clean_scrub_stamp":"2024-04-26T12:32:32.019929+0000","objects_scrubbed":1,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:20.752633+0000","scrub_duration":0.014563081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":490,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.968391+0000","last_change":"2024-04-26T12:32:37.968391+0000","last_active":"2024-04-26T12:32:37.968391+0000","last_peered":"2024-04-26T12:32:37.968391+0000","last_clean":"2024-04-26T12:32:37.968391+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:32:37.968391+0000","last_undegraded":"2024-04-26T12:32:37.968391+0000","last_fullsized":"2024-04-26T12:32:37.968391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'398","last_scrub_stamp":"2024-04-26T12:32:37.968259+0000","last_deep_scrub":"60'398","last_deep_scrub_stamp":"2024-04-26T12:32:37.968259+0000","last_clean_scrub_stamp":"2024-04-26T12:32:37.968259+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:51.732088+0000","scrub_duration":0.002548804,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"85'710","reported_seq":792,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:56.110182+0000","last_change":"2024-04-26T12:31:56.110289+0000","last_active":"2024-04-26T12:31:56.110182+0000","last_peered":"2024-04-26T12:31:56.110182+0000","last_clean":"2024-04-26T12:31:56.110182+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:31:56.110182+0000","last_undegraded":"2024-04-26T12:31:56.110182+0000","last_fullsized":"2024-04-26T12:31:56.110182+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'710","last_scrub_stamp":"2024-04-26T12:31:56.110156+0000","last_deep_scrub":"85'710","last_deep_scrub_stamp":"2024-04-26T12:31:56.110156+0000","last_clean_scrub_stamp":"2024-04-26T12:31:56.110156+0000","objects_scrubbed":2,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:27.621679+0000","scrub_duration":0.025669368000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":512,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.113289+0000","last_change":"2024-04-26T12:31:26.113397+0000","last_active":"2024-04-26T12:31:26.113289+0000","last_peered":"2024-04-26T12:31:26.113289+0000","last_clean":"2024-04-26T12:31:26.113289+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:31:26.113289+0000","last_undegraded":"2024-04-26T12:31:26.113289+0000","last_fullsized":"2024-04-26T12:31:26.113289+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:31:26.113263+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:31:26.113263+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.113263+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:51.012642+0000","scrub_duration":0.001900838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:45.981808+0000","last_change":"2024-04-26T12:31:45.981948+0000","last_active":"2024-04-26T12:31:45.981808+0000","last_peered":"2024-04-26T12:31:45.981808+0000","last_clean":"2024-04-26T12:31:45.981808+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:31:45.981808+0000","last_undegraded":"2024-04-26T12:31:45.981808+0000","last_fullsized":"2024-04-26T12:31:45.981808+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'58","last_scrub_stamp":"2024-04-26T12:31:45.981781+0000","last_deep_scrub":"58'58","last_deep_scrub_stamp":"2024-04-26T12:31:45.981781+0000","last_clean_scrub_stamp":"2024-04-26T12:31:45.981781+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:52.325021+0000","scrub_duration":0.0016923179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":606,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:24.080832+0000","last_change":"2024-04-26T12:32:24.080935+0000","last_active":"2024-04-26T12:32:24.080832+0000","last_peered":"2024-04-26T12:32:24.080832+0000","last_clean":"2024-04-26T12:32:24.080832+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:32:24.080832+0000","last_undegraded":"2024-04-26T12:32:24.080832+0000","last_fullsized":"2024-04-26T12:32:24.080832+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'473","last_scrub_stamp":"2024-04-26T12:32:24.080805+0000","last_deep_scrub":"60'473","last_deep_scrub_stamp":"2024-04-26T12:32:24.080805+0000","last_clean_scrub_stamp":"2024-04-26T12:32:24.080805+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:06.211096+0000","scrub_duration":0.0026229529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"85'356","reported_seq":390,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.259385+0000","last_change":"2024-04-26T12:31:12.259503+0000","last_active":"2024-04-26T12:31:12.259385+0000","last_peered":"2024-04-26T12:31:12.259385+0000","last_clean":"2024-04-26T12:31:12.259385+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:31:12.259385+0000","last_undegraded":"2024-04-26T12:31:12.259385+0000","last_fullsized":"2024-04-26T12:31:12.259385+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'356","last_scrub_stamp":"2024-04-26T12:31:12.259359+0000","last_deep_scrub":"85'356","last_deep_scrub_stamp":"2024-04-26T12:31:12.259359+0000","last_clean_scrub_stamp":"2024-04-26T12:31:12.259359+0000","objects_scrubbed":1,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:29.053825+0000","scrub_duration":0.015931049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":732,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:01.093626+0000","last_change":"2024-04-26T12:32:01.093764+0000","last_active":"2024-04-26T12:32:01.093626+0000","last_peered":"2024-04-26T12:32:01.093626+0000","last_clean":"2024-04-26T12:32:01.093626+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:32:01.093626+0000","last_undegraded":"2024-04-26T12:32:01.093626+0000","last_fullsized":"2024-04-26T12:32:01.093626+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'528","last_scrub_stamp":"2024-04-26T12:32:01.093601+0000","last_deep_scrub":"60'528","last_deep_scrub_stamp":"2024-04-26T12:32:01.093601+0000","last_clean_scrub_stamp":"2024-04-26T12:32:01.093601+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:13.828455+0000","scrub_duration":0.0023344469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"85'88","reported_seq":182,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.241699+0000","last_change":"2024-04-26T12:32:22.241832+0000","last_active":"2024-04-26T12:32:22.241699+0000","last_peered":"2024-04-26T12:32:22.241699+0000","last_clean":"2024-04-26T12:32:22.241699+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:32:22.241699+0000","last_undegraded":"2024-04-26T12:32:22.241699+0000","last_fullsized":"2024-04-26T12:32:22.241699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'88","last_scrub_stamp":"2024-04-26T12:32:22.241659+0000","last_deep_scrub":"85'88","last_deep_scrub_stamp":"2024-04-26T12:32:22.241659+0000","last_clean_scrub_stamp":"2024-04-26T12:32:22.241659+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:01.912257+0000","scrub_duration":0.0038713139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":523,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:04.095180+0000","last_change":"2024-04-26T12:32:04.095303+0000","last_active":"2024-04-26T12:32:04.095180+0000","last_peered":"2024-04-26T12:32:04.095180+0000","last_clean":"2024-04-26T12:32:04.095180+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:32:04.095180+0000","last_undegraded":"2024-04-26T12:32:04.095180+0000","last_fullsized":"2024-04-26T12:32:04.095180+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-04-26T12:32:04.095151+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-04-26T12:32:04.095151+0000","last_clean_scrub_stamp":"2024-04-26T12:32:04.095151+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:13.337155+0000","scrub_duration":0.0023191150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"85'380","reported_seq":457,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.301720+0000","last_change":"2024-04-26T12:31:26.301826+0000","last_active":"2024-04-26T12:31:26.301720+0000","last_peered":"2024-04-26T12:31:26.301720+0000","last_clean":"2024-04-26T12:31:26.301720+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:31:26.301720+0000","last_undegraded":"2024-04-26T12:31:26.301720+0000","last_fullsized":"2024-04-26T12:31:26.301720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'380","last_scrub_stamp":"2024-04-26T12:31:26.301693+0000","last_deep_scrub":"85'380","last_deep_scrub_stamp":"2024-04-26T12:31:26.301693+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.301693+0000","objects_scrubbed":6,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:55.160179+0000","scrub_duration":0.02593227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":518,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.325418+0000","last_change":"2024-04-26T12:31:25.325525+0000","last_active":"2024-04-26T12:31:25.325418+0000","last_peered":"2024-04-26T12:31:25.325418+0000","last_clean":"2024-04-26T12:31:25.325418+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:31:25.325418+0000","last_undegraded":"2024-04-26T12:31:25.325418+0000","last_fullsized":"2024-04-26T12:31:25.325418+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:25.325392+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:25.325392+0000","last_clean_scrub_stamp":"2024-04-26T12:31:25.325392+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:47.712840+0000","scrub_duration":0.0026314070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"85'544","reported_seq":665,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:40.950666+0000","last_change":"2024-04-26T12:32:40.950798+0000","last_active":"2024-04-26T12:32:40.950666+0000","last_peered":"2024-04-26T12:32:40.950666+0000","last_clean":"2024-04-26T12:32:40.950666+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:32:40.950666+0000","last_undegraded":"2024-04-26T12:32:40.950666+0000","last_fullsized":"2024-04-26T12:32:40.950666+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'544","last_scrub_stamp":"2024-04-26T12:32:40.950641+0000","last_deep_scrub":"85'544","last_deep_scrub_stamp":"2024-04-26T12:32:40.950641+0000","last_clean_scrub_stamp":"2024-04-26T12:32:40.950641+0000","objects_scrubbed":4,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:59.355168+0000","scrub_duration":0.024502327000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":796,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183891+0000","last_change":"2024-04-26T12:30:46.082735+0000","last_active":"2024-04-26T12:31:13.183891+0000","last_peered":"2024-04-26T12:31:13.183891+0000","last_clean":"2024-04-26T12:31:13.183891+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:31:13.183891+0000","last_undegraded":"2024-04-26T12:31:13.183891+0000","last_fullsized":"2024-04-26T12:31:13.183891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:54.112706+0000","last_change":"2024-04-26T12:31:54.112814+0000","last_active":"2024-04-26T12:31:54.112706+0000","last_peered":"2024-04-26T12:31:54.112706+0000","last_clean":"2024-04-26T12:31:54.112706+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:31:54.112706+0000","last_undegraded":"2024-04-26T12:31:54.112706+0000","last_fullsized":"2024-04-26T12:31:54.112706+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'63","last_scrub_stamp":"2024-04-26T12:31:54.112680+0000","last_deep_scrub":"58'63","last_deep_scrub_stamp":"2024-04-26T12:31:54.112680+0000","last_clean_scrub_stamp":"2024-04-26T12:31:54.112680+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:58.061070+0000","scrub_duration":0.0018177499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":873,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:29.158519+0000","last_change":"2024-04-26T12:31:29.158519+0000","last_active":"2024-04-26T12:31:29.158519+0000","last_peered":"2024-04-26T12:31:29.158519+0000","last_clean":"2024-04-26T12:31:29.158519+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:31:29.158519+0000","last_undegraded":"2024-04-26T12:31:29.158519+0000","last_fullsized":"2024-04-26T12:31:29.158519+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'390","last_scrub_stamp":"2024-04-26T12:31:29.158376+0000","last_deep_scrub":"60'390","last_deep_scrub_stamp":"2024-04-26T12:31:29.158376+0000","last_clean_scrub_stamp":"2024-04-26T12:31:29.158376+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:29.361899+0000","scrub_duration":0.0022476710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:09.385378+0000","last_change":"2024-04-26T12:32:09.385498+0000","last_active":"2024-04-26T12:32:09.385378+0000","last_peered":"2024-04-26T12:32:09.385378+0000","last_clean":"2024-04-26T12:32:09.385378+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:32:09.385378+0000","last_undegraded":"2024-04-26T12:32:09.385378+0000","last_fullsized":"2024-04-26T12:32:09.385378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'57","last_scrub_stamp":"2024-04-26T12:32:09.385336+0000","last_deep_scrub":"58'57","last_deep_scrub_stamp":"2024-04-26T12:32:09.385336+0000","last_clean_scrub_stamp":"2024-04-26T12:32:09.385336+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:11.337234+0000","scrub_duration":0.0017443039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":512,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:39.940249+0000","last_change":"2024-04-26T12:32:39.940373+0000","last_active":"2024-04-26T12:32:39.940249+0000","last_peered":"2024-04-26T12:32:39.940249+0000","last_clean":"2024-04-26T12:32:39.940249+0000","last_became_active":"2024-04-26T12:30:59.081424+0000","last_became_peered":"2024-04-26T12:30:59.081424+0000","last_unstale":"2024-04-26T12:32:39.940249+0000","last_undegraded":"2024-04-26T12:32:39.940249+0000","last_fullsized":"2024-04-26T12:32:39.940249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'433","last_scrub_stamp":"2024-04-26T12:32:39.940210+0000","last_deep_scrub":"60'433","last_deep_scrub_stamp":"2024-04-26T12:32:39.940210+0000","last_clean_scrub_stamp":"2024-04-26T12:32:39.940210+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:20.854291+0000","scrub_duration":0.0021880409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"85'58","reported_seq":89,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:50.029082+0000","last_change":"2024-04-26T12:31:50.029193+0000","last_active":"2024-04-26T12:31:50.029082+0000","last_peered":"2024-04-26T12:31:50.029082+0000","last_clean":"2024-04-26T12:31:50.029082+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:31:50.029082+0000","last_undegraded":"2024-04-26T12:31:50.029082+0000","last_fullsized":"2024-04-26T12:31:50.029082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'58","last_scrub_stamp":"2024-04-26T12:31:50.029051+0000","last_deep_scrub":"85'58","last_deep_scrub_stamp":"2024-04-26T12:31:50.029051+0000","last_clean_scrub_stamp":"2024-04-26T12:31:50.029051+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:06.160429+0000","scrub_duration":0.0043989739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":550,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:40.942516+0000","last_change":"2024-04-26T12:32:40.942639+0000","last_active":"2024-04-26T12:32:40.942516+0000","last_peered":"2024-04-26T12:32:40.942516+0000","last_clean":"2024-04-26T12:32:40.942516+0000","last_became_active":"2024-04-26T12:30:59.081463+0000","last_became_peered":"2024-04-26T12:30:59.081463+0000","last_unstale":"2024-04-26T12:32:40.942516+0000","last_undegraded":"2024-04-26T12:32:40.942516+0000","last_fullsized":"2024-04-26T12:32:40.942516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:32:40.942475+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:32:40.942475+0000","last_clean_scrub_stamp":"2024-04-26T12:32:40.942475+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:36.581399+0000","scrub_duration":0.001801637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"85'188","reported_seq":223,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.348255+0000","last_change":"2024-04-26T12:31:31.348379+0000","last_active":"2024-04-26T12:31:31.348255+0000","last_peered":"2024-04-26T12:31:31.348255+0000","last_clean":"2024-04-26T12:31:31.348255+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:31:31.348255+0000","last_undegraded":"2024-04-26T12:31:31.348255+0000","last_fullsized":"2024-04-26T12:31:31.348255+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'188","last_scrub_stamp":"2024-04-26T12:31:31.348227+0000","last_deep_scrub":"85'188","last_deep_scrub_stamp":"2024-04-26T12:31:31.348227+0000","last_clean_scrub_stamp":"2024-04-26T12:31:31.348227+0000","objects_scrubbed":2,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:59.084157+0000","scrub_duration":0.015480226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":533,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:13.183956+0000","last_change":"2024-04-26T12:26:53.266556+0000","last_active":"2024-04-26T12:31:13.183956+0000","last_peered":"2024-04-26T12:31:13.183956+0000","last_clean":"2024-04-26T12:31:13.183956+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:31:13.183956+0000","last_undegraded":"2024-04-26T12:31:13.183956+0000","last_fullsized":"2024-04-26T12:31:13.183956+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"85'323","reported_seq":455,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:21.284562+0000","last_change":"2024-04-26T12:32:21.284688+0000","last_active":"2024-04-26T12:32:21.284562+0000","last_peered":"2024-04-26T12:32:21.284562+0000","last_clean":"2024-04-26T12:32:21.284562+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:32:21.284562+0000","last_undegraded":"2024-04-26T12:32:21.284562+0000","last_fullsized":"2024-04-26T12:32:21.284562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'323","last_scrub_stamp":"2024-04-26T12:32:21.284529+0000","last_deep_scrub":"85'323","last_deep_scrub_stamp":"2024-04-26T12:32:21.284529+0000","last_clean_scrub_stamp":"2024-04-26T12:32:21.284529+0000","objects_scrubbed":2,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.109193+0000","scrub_duration":0.015639103000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":989,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:33.193482+0000","last_change":"2024-04-26T12:31:33.193590+0000","last_active":"2024-04-26T12:31:33.193482+0000","last_peered":"2024-04-26T12:31:33.193482+0000","last_clean":"2024-04-26T12:31:33.193482+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:31:33.193482+0000","last_undegraded":"2024-04-26T12:31:33.193482+0000","last_fullsized":"2024-04-26T12:31:33.193482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'437","last_scrub_stamp":"2024-04-26T12:31:33.193453+0000","last_deep_scrub":"60'437","last_deep_scrub_stamp":"2024-04-26T12:31:33.193453+0000","last_clean_scrub_stamp":"2024-04-26T12:31:33.193453+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:25.293233+0000","scrub_duration":0.0023129719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"58'477","reported_seq":515,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078761+0000","last_change":"2024-04-26T12:30:48.089199+0000","last_active":"2024-04-26T12:31:00.078761+0000","last_peered":"2024-04-26T12:31:00.078761+0000","last_clean":"2024-04-26T12:31:00.078761+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:31:00.078761+0000","last_undegraded":"2024-04-26T12:31:00.078761+0000","last_fullsized":"2024-04-26T12:31:00.078761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":503,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.254729+0000","last_change":"2024-04-26T12:31:22.254831+0000","last_active":"2024-04-26T12:31:22.254729+0000","last_peered":"2024-04-26T12:31:22.254729+0000","last_clean":"2024-04-26T12:31:22.254729+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:31:22.254729+0000","last_undegraded":"2024-04-26T12:31:22.254729+0000","last_fullsized":"2024-04-26T12:31:22.254729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:31:22.254705+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:31:22.254705+0000","last_clean_scrub_stamp":"2024-04-26T12:31:22.254705+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:09.032368+0000","scrub_duration":0.0022442209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149539+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:12.149539+0000","last_peered":"2024-04-26T12:31:12.149539+0000","last_clean":"2024-04-26T12:31:12.149539+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:31:12.149539+0000","last_undegraded":"2024-04-26T12:31:12.149539+0000","last_fullsized":"2024-04-26T12:31:12.149539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":572,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.059419+0000","last_change":"2024-04-26T12:32:22.059419+0000","last_active":"2024-04-26T12:32:22.059419+0000","last_peered":"2024-04-26T12:32:22.059419+0000","last_clean":"2024-04-26T12:32:22.059419+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:32:22.059419+0000","last_undegraded":"2024-04-26T12:32:22.059419+0000","last_fullsized":"2024-04-26T12:32:22.059419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'433","last_scrub_stamp":"2024-04-26T12:32:22.059294+0000","last_deep_scrub":"60'433","last_deep_scrub_stamp":"2024-04-26T12:32:22.059294+0000","last_clean_scrub_stamp":"2024-04-26T12:32:22.059294+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:35.581218+0000","scrub_duration":0.0019914970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"85'184","reported_seq":268,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.972802+0000","last_change":"2024-04-26T12:32:33.972802+0000","last_active":"2024-04-26T12:32:33.972802+0000","last_peered":"2024-04-26T12:32:33.972802+0000","last_clean":"2024-04-26T12:32:33.972802+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:32:33.972802+0000","last_undegraded":"2024-04-26T12:32:33.972802+0000","last_fullsized":"2024-04-26T12:32:33.972802+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'184","last_scrub_stamp":"2024-04-26T12:32:33.972630+0000","last_deep_scrub":"85'184","last_deep_scrub_stamp":"2024-04-26T12:32:33.972630+0000","last_clean_scrub_stamp":"2024-04-26T12:32:33.972630+0000","objects_scrubbed":3,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:48.201253+0000","scrub_duration":0.019072424000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":538,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078279+0000","last_change":"2024-04-26T12:30:48.090057+0000","last_active":"2024-04-26T12:31:00.078279+0000","last_peered":"2024-04-26T12:31:00.078279+0000","last_clean":"2024-04-26T12:31:00.078279+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:31:00.078279+0000","last_undegraded":"2024-04-26T12:31:00.078279+0000","last_fullsized":"2024-04-26T12:31:00.078279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"85'164","reported_seq":282,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.870309+0000","last_change":"2024-04-26T12:32:37.870414+0000","last_active":"2024-04-26T12:32:37.870309+0000","last_peered":"2024-04-26T12:32:37.870309+0000","last_clean":"2024-04-26T12:32:37.870309+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:32:37.870309+0000","last_undegraded":"2024-04-26T12:32:37.870309+0000","last_fullsized":"2024-04-26T12:32:37.870309+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'164","last_scrub_stamp":"2024-04-26T12:32:37.870280+0000","last_deep_scrub":"85'164","last_deep_scrub_stamp":"2024-04-26T12:32:37.870280+0000","last_clean_scrub_stamp":"2024-04-26T12:32:37.870280+0000","objects_scrubbed":1,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:23.644955+0000","scrub_duration":0.015156388,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:20.233238+0000","last_change":"2024-04-26T12:31:20.233368+0000","last_active":"2024-04-26T12:31:20.233238+0000","last_peered":"2024-04-26T12:31:20.233238+0000","last_clean":"2024-04-26T12:31:20.233238+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:31:20.233238+0000","last_undegraded":"2024-04-26T12:31:20.233238+0000","last_fullsized":"2024-04-26T12:31:20.233238+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:31:20.233200+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:31:20.233200+0000","last_clean_scrub_stamp":"2024-04-26T12:31:20.233200+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:03.311719+0000","scrub_duration":0.0025721490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":175,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:15.309765+0000","last_change":"2024-04-26T12:32:15.309882+0000","last_active":"2024-04-26T12:32:15.309765+0000","last_peered":"2024-04-26T12:32:15.309765+0000","last_clean":"2024-04-26T12:32:15.309765+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:32:15.309765+0000","last_undegraded":"2024-04-26T12:32:15.309765+0000","last_fullsized":"2024-04-26T12:32:15.309765+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'55","last_scrub_stamp":"2024-04-26T12:32:15.309740+0000","last_deep_scrub":"58'55","last_deep_scrub_stamp":"2024-04-26T12:32:15.309740+0000","last_clean_scrub_stamp":"2024-04-26T12:32:15.309740+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:50.961431+0000","scrub_duration":0.0023593640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":505,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:44.982096+0000","last_change":"2024-04-26T12:32:44.982209+0000","last_active":"2024-04-26T12:32:44.982096+0000","last_peered":"2024-04-26T12:32:44.982096+0000","last_clean":"2024-04-26T12:32:44.982096+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:32:44.982096+0000","last_undegraded":"2024-04-26T12:32:44.982096+0000","last_fullsized":"2024-04-26T12:32:44.982096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'363","last_scrub_stamp":"2024-04-26T12:32:44.982071+0000","last_deep_scrub":"60'363","last_deep_scrub_stamp":"2024-04-26T12:32:44.982071+0000","last_clean_scrub_stamp":"2024-04-26T12:32:44.982071+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:40.857857+0000","scrub_duration":0.0031791319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"85'484","reported_seq":602,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:46.379613+0000","last_change":"2024-04-26T12:32:46.379741+0000","last_active":"2024-04-26T12:32:46.379613+0000","last_peered":"2024-04-26T12:32:46.379613+0000","last_clean":"2024-04-26T12:32:46.379613+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:32:46.379613+0000","last_undegraded":"2024-04-26T12:32:46.379613+0000","last_fullsized":"2024-04-26T12:32:46.379613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'484","last_scrub_stamp":"2024-04-26T12:32:46.379587+0000","last_deep_scrub":"85'484","last_deep_scrub_stamp":"2024-04-26T12:32:46.379587+0000","last_clean_scrub_stamp":"2024-04-26T12:32:46.379587+0000","objects_scrubbed":1,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:27.037656+0000","scrub_duration":0.01793469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":511,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.890716+0000","last_change":"2024-04-26T12:31:31.890716+0000","last_active":"2024-04-26T12:31:31.890716+0000","last_peered":"2024-04-26T12:31:31.890716+0000","last_clean":"2024-04-26T12:31:31.890716+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:31:31.890716+0000","last_undegraded":"2024-04-26T12:31:31.890716+0000","last_fullsized":"2024-04-26T12:31:31.890716+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'402","last_scrub_stamp":"2024-04-26T12:31:31.890586+0000","last_deep_scrub":"60'402","last_deep_scrub_stamp":"2024-04-26T12:31:31.890586+0000","last_clean_scrub_stamp":"2024-04-26T12:31:31.890586+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:10.281743+0000","scrub_duration":0.0021503030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:23.972717+0000","last_change":"2024-04-26T12:31:23.972717+0000","last_active":"2024-04-26T12:31:23.972717+0000","last_peered":"2024-04-26T12:31:23.972717+0000","last_clean":"2024-04-26T12:31:23.972717+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:31:23.972717+0000","last_undegraded":"2024-04-26T12:31:23.972717+0000","last_fullsized":"2024-04-26T12:31:23.972717+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:23.972571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:23.972571+0000","last_clean_scrub_stamp":"2024-04-26T12:31:23.972571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:28.883121+0000","scrub_duration":0.0019705149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"85'455","reported_seq":494,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:48.063866+0000","last_change":"2024-04-26T12:31:48.063866+0000","last_active":"2024-04-26T12:31:48.063866+0000","last_peered":"2024-04-26T12:31:48.063866+0000","last_clean":"2024-04-26T12:31:48.063866+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:31:48.063866+0000","last_undegraded":"2024-04-26T12:31:48.063866+0000","last_fullsized":"2024-04-26T12:31:48.063866+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'455","last_scrub_stamp":"2024-04-26T12:31:48.063706+0000","last_deep_scrub":"85'455","last_deep_scrub_stamp":"2024-04-26T12:31:48.063706+0000","last_clean_scrub_stamp":"2024-04-26T12:31:48.063706+0000","objects_scrubbed":1,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:01.639711+0000","scrub_duration":0.015622934999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":485,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.354634+0000","last_change":"2024-04-26T12:32:48.354748+0000","last_active":"2024-04-26T12:32:48.354634+0000","last_peered":"2024-04-26T12:32:48.354634+0000","last_clean":"2024-04-26T12:32:48.354634+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:32:48.354634+0000","last_undegraded":"2024-04-26T12:32:48.354634+0000","last_fullsized":"2024-04-26T12:32:48.354634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'369","last_scrub_stamp":"2024-04-26T12:32:48.354608+0000","last_deep_scrub":"60'369","last_deep_scrub_stamp":"2024-04-26T12:32:48.354608+0000","last_clean_scrub_stamp":"2024-04-26T12:32:48.354608+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:11.799788+0000","scrub_duration":0.0028242369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:21.978689+0000","last_change":"2024-04-26T12:32:21.978811+0000","last_active":"2024-04-26T12:32:21.978689+0000","last_peered":"2024-04-26T12:32:21.978689+0000","last_clean":"2024-04-26T12:32:21.978689+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:32:21.978689+0000","last_undegraded":"2024-04-26T12:32:21.978689+0000","last_fullsized":"2024-04-26T12:32:21.978689+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:21.978665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:21.978665+0000","last_clean_scrub_stamp":"2024-04-26T12:32:21.978665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:43.330392+0000","scrub_duration":0.001858333,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.331856+0000","last_change":"2024-04-26T12:30:48.089896+0000","last_active":"2024-04-26T12:31:05.331856+0000","last_peered":"2024-04-26T12:31:05.331856+0000","last_clean":"2024-04-26T12:31:05.331856+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:31:05.331856+0000","last_undegraded":"2024-04-26T12:31:05.331856+0000","last_fullsized":"2024-04-26T12:31:05.331856+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":512,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:55.133138+0000","last_change":"2024-04-26T12:31:55.133138+0000","last_active":"2024-04-26T12:31:55.133138+0000","last_peered":"2024-04-26T12:31:55.133138+0000","last_clean":"2024-04-26T12:31:55.133138+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:31:55.133138+0000","last_undegraded":"2024-04-26T12:31:55.133138+0000","last_fullsized":"2024-04-26T12:31:55.133138+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'404","last_scrub_stamp":"2024-04-26T12:31:55.132989+0000","last_deep_scrub":"60'404","last_deep_scrub_stamp":"2024-04-26T12:31:55.132989+0000","last_clean_scrub_stamp":"2024-04-26T12:31:55.132989+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:09.806981+0000","scrub_duration":0.0022071650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:15.991158+0000","last_change":"2024-04-26T12:32:15.991158+0000","last_active":"2024-04-26T12:32:15.991158+0000","last_peered":"2024-04-26T12:32:15.991158+0000","last_clean":"2024-04-26T12:32:15.991158+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:32:15.991158+0000","last_undegraded":"2024-04-26T12:32:15.991158+0000","last_fullsized":"2024-04-26T12:32:15.991158+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:15.991015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:15.991015+0000","last_clean_scrub_stamp":"2024-04-26T12:32:15.991015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:54.413627+0000","scrub_duration":0.0021248650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"85'318","reported_seq":413,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:14.328682+0000","last_change":"2024-04-26T12:32:14.328682+0000","last_active":"2024-04-26T12:32:14.328682+0000","last_peered":"2024-04-26T12:32:14.328682+0000","last_clean":"2024-04-26T12:32:14.328682+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:32:14.328682+0000","last_undegraded":"2024-04-26T12:32:14.328682+0000","last_fullsized":"2024-04-26T12:32:14.328682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'318","last_scrub_stamp":"2024-04-26T12:32:14.328453+0000","last_deep_scrub":"85'318","last_deep_scrub_stamp":"2024-04-26T12:32:14.328453+0000","last_clean_scrub_stamp":"2024-04-26T12:32:14.328453+0000","objects_scrubbed":2,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:16.594609+0000","scrub_duration":0.022414826999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":445,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:34.956674+0000","last_change":"2024-04-26T12:31:34.956674+0000","last_active":"2024-04-26T12:31:34.956674+0000","last_peered":"2024-04-26T12:31:34.956674+0000","last_clean":"2024-04-26T12:31:34.956674+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:31:34.956674+0000","last_undegraded":"2024-04-26T12:31:34.956674+0000","last_fullsized":"2024-04-26T12:31:34.956674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'339","last_scrub_stamp":"2024-04-26T12:31:34.956499+0000","last_deep_scrub":"60'339","last_deep_scrub_stamp":"2024-04-26T12:31:34.956499+0000","last_clean_scrub_stamp":"2024-04-26T12:31:34.956499+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:59.720417+0000","scrub_duration":0.0021999369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:32.328853+0000","last_change":"2024-04-26T12:31:32.328853+0000","last_active":"2024-04-26T12:31:32.328853+0000","last_peered":"2024-04-26T12:31:32.328853+0000","last_clean":"2024-04-26T12:31:32.328853+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:31:32.328853+0000","last_undegraded":"2024-04-26T12:31:32.328853+0000","last_fullsized":"2024-04-26T12:31:32.328853+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:32.328709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:32.328709+0000","last_clean_scrub_stamp":"2024-04-26T12:31:32.328709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:20.941744+0000","scrub_duration":0.0019425169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"85'159","reported_seq":278,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:53.976254+0000","last_change":"2024-04-26T12:32:53.976363+0000","last_active":"2024-04-26T12:32:53.976254+0000","last_peered":"2024-04-26T12:32:53.976254+0000","last_clean":"2024-04-26T12:32:53.976254+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:32:53.976254+0000","last_undegraded":"2024-04-26T12:32:53.976254+0000","last_fullsized":"2024-04-26T12:32:53.976254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'159","last_scrub_stamp":"2024-04-26T12:32:53.976229+0000","last_deep_scrub":"85'159","last_deep_scrub_stamp":"2024-04-26T12:32:53.976229+0000","last_clean_scrub_stamp":"2024-04-26T12:32:53.976229+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:18.300219+0000","scrub_duration":0.0046407640000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"85'530","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:13.979318+0000","last_change":"2024-04-26T12:32:13.979318+0000","last_active":"2024-04-26T12:32:13.979318+0000","last_peered":"2024-04-26T12:32:13.979318+0000","last_clean":"2024-04-26T12:32:13.979318+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:32:13.979318+0000","last_undegraded":"2024-04-26T12:32:13.979318+0000","last_fullsized":"2024-04-26T12:32:13.979318+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'530","last_scrub_stamp":"2024-04-26T12:32:13.979200+0000","last_deep_scrub":"85'530","last_deep_scrub_stamp":"2024-04-26T12:32:13.979200+0000","last_clean_scrub_stamp":"2024-04-26T12:32:13.979200+0000","objects_scrubbed":2,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:32.615284+0000","scrub_duration":0.026609192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":577,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.980867+0000","last_change":"2024-04-26T12:32:43.980975+0000","last_active":"2024-04-26T12:32:43.980867+0000","last_peered":"2024-04-26T12:32:43.980867+0000","last_clean":"2024-04-26T12:32:43.980867+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:32:43.980867+0000","last_undegraded":"2024-04-26T12:32:43.980867+0000","last_fullsized":"2024-04-26T12:32:43.980867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'436","last_scrub_stamp":"2024-04-26T12:32:43.980841+0000","last_deep_scrub":"60'436","last_deep_scrub_stamp":"2024-04-26T12:32:43.980841+0000","last_clean_scrub_stamp":"2024-04-26T12:32:43.980841+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:58.984555+0000","scrub_duration":0.002707508,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:29.947802+0000","last_change":"2024-04-26T12:32:29.947802+0000","last_active":"2024-04-26T12:32:29.947802+0000","last_peered":"2024-04-26T12:32:29.947802+0000","last_clean":"2024-04-26T12:32:29.947802+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:32:29.947802+0000","last_undegraded":"2024-04-26T12:32:29.947802+0000","last_fullsized":"2024-04-26T12:32:29.947802+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:29.947653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:29.947653+0000","last_clean_scrub_stamp":"2024-04-26T12:32:29.947653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:09.849742+0000","scrub_duration":0.0021636390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"85'106","reported_seq":236,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:24.979101+0000","last_change":"2024-04-26T12:31:24.979101+0000","last_active":"2024-04-26T12:31:24.979101+0000","last_peered":"2024-04-26T12:31:24.979101+0000","last_clean":"2024-04-26T12:31:24.979101+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:31:24.979101+0000","last_undegraded":"2024-04-26T12:31:24.979101+0000","last_fullsized":"2024-04-26T12:31:24.979101+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'106","last_scrub_stamp":"2024-04-26T12:31:24.978960+0000","last_deep_scrub":"85'106","last_deep_scrub_stamp":"2024-04-26T12:31:24.978960+0000","last_clean_scrub_stamp":"2024-04-26T12:31:24.978960+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:36.841285+0000","scrub_duration":0.0061135809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":980,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:59.363426+0000","last_change":"2024-04-26T12:31:59.363532+0000","last_active":"2024-04-26T12:31:59.363426+0000","last_peered":"2024-04-26T12:31:59.363426+0000","last_clean":"2024-04-26T12:31:59.363426+0000","last_became_active":"2024-04-26T12:30:57.077779+0000","last_became_peered":"2024-04-26T12:30:57.077779+0000","last_unstale":"2024-04-26T12:31:59.363426+0000","last_undegraded":"2024-04-26T12:31:59.363426+0000","last_fullsized":"2024-04-26T12:31:59.363426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'438","last_scrub_stamp":"2024-04-26T12:31:59.363398+0000","last_deep_scrub":"60'438","last_deep_scrub_stamp":"2024-04-26T12:31:59.363398+0000","last_clean_scrub_stamp":"2024-04-26T12:31:59.363398+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:03.749621+0000","scrub_duration":0.0022297010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:13.324894+0000","last_change":"2024-04-26T12:32:13.325002+0000","last_active":"2024-04-26T12:32:13.324894+0000","last_peered":"2024-04-26T12:32:13.324894+0000","last_clean":"2024-04-26T12:32:13.324894+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:32:13.324894+0000","last_undegraded":"2024-04-26T12:32:13.324894+0000","last_fullsized":"2024-04-26T12:32:13.324894+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:13.324871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:13.324871+0000","last_clean_scrub_stamp":"2024-04-26T12:32:13.324871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.136071+0000","scrub_duration":0.001814179,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:39.992792+0000","last_change":"2024-04-26T12:31:39.992792+0000","last_active":"2024-04-26T12:31:39.992792+0000","last_peered":"2024-04-26T12:31:39.992792+0000","last_clean":"2024-04-26T12:31:39.992792+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:31:39.992792+0000","last_undegraded":"2024-04-26T12:31:39.992792+0000","last_fullsized":"2024-04-26T12:31:39.992792+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'59","last_scrub_stamp":"2024-04-26T12:31:39.992655+0000","last_deep_scrub":"58'59","last_deep_scrub_stamp":"2024-04-26T12:31:39.992655+0000","last_clean_scrub_stamp":"2024-04-26T12:31:39.992655+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:05.570619+0000","scrub_duration":0.001782435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":532,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:45.214912+0000","last_change":"2024-04-26T12:31:45.215071+0000","last_active":"2024-04-26T12:31:45.214912+0000","last_peered":"2024-04-26T12:31:45.214912+0000","last_clean":"2024-04-26T12:31:45.214912+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:31:45.214912+0000","last_undegraded":"2024-04-26T12:31:45.214912+0000","last_fullsized":"2024-04-26T12:31:45.214912+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'418","last_scrub_stamp":"2024-04-26T12:31:45.214875+0000","last_deep_scrub":"60'418","last_deep_scrub_stamp":"2024-04-26T12:31:45.214875+0000","last_clean_scrub_stamp":"2024-04-26T12:31:45.214875+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:16.419048+0000","scrub_duration":0.0026123359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'63","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:25.111634+0000","last_change":"2024-04-26T12:32:25.111634+0000","last_active":"2024-04-26T12:32:25.111634+0000","last_peered":"2024-04-26T12:32:25.111634+0000","last_clean":"2024-04-26T12:32:25.111634+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:32:25.111634+0000","last_undegraded":"2024-04-26T12:32:25.111634+0000","last_fullsized":"2024-04-26T12:32:25.111634+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'63","last_scrub_stamp":"2024-04-26T12:32:25.111502+0000","last_deep_scrub":"85'63","last_deep_scrub_stamp":"2024-04-26T12:32:25.111502+0000","last_clean_scrub_stamp":"2024-04-26T12:32:25.111502+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:19.495601+0000","scrub_duration":0.003363904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.965364+0000","last_change":"2024-04-26T12:31:26.965364+0000","last_active":"2024-04-26T12:31:26.965364+0000","last_peered":"2024-04-26T12:31:26.965364+0000","last_clean":"2024-04-26T12:31:26.965364+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:31:26.965364+0000","last_undegraded":"2024-04-26T12:31:26.965364+0000","last_fullsized":"2024-04-26T12:31:26.965364+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:26.965245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:26.965245+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.965245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:27.319599+0000","scrub_duration":0.0017909270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":513,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.983743+0000","last_change":"2024-04-26T12:32:43.983883+0000","last_active":"2024-04-26T12:32:43.983743+0000","last_peered":"2024-04-26T12:32:43.983743+0000","last_clean":"2024-04-26T12:32:43.983743+0000","last_became_active":"2024-04-26T12:31:00.079504+0000","last_became_peered":"2024-04-26T12:31:00.079504+0000","last_unstale":"2024-04-26T12:32:43.983743+0000","last_undegraded":"2024-04-26T12:32:43.983743+0000","last_fullsized":"2024-04-26T12:32:43.983743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'416","last_scrub_stamp":"2024-04-26T12:32:43.983712+0000","last_deep_scrub":"60'416","last_deep_scrub_stamp":"2024-04-26T12:32:43.983712+0000","last_clean_scrub_stamp":"2024-04-26T12:32:43.983712+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:38.828275+0000","scrub_duration":0.0020127650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:35.265345+0000","last_change":"2024-04-26T12:31:35.265446+0000","last_active":"2024-04-26T12:31:35.265345+0000","last_peered":"2024-04-26T12:31:35.265345+0000","last_clean":"2024-04-26T12:31:35.265345+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:31:35.265345+0000","last_undegraded":"2024-04-26T12:31:35.265345+0000","last_fullsized":"2024-04-26T12:31:35.265345+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:35.265322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:35.265322+0000","last_clean_scrub_stamp":"2024-04-26T12:31:35.265322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:21.847498+0000","scrub_duration":0.001727751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"85'83","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.000699+0000","last_change":"2024-04-26T12:31:14.000699+0000","last_active":"2024-04-26T12:31:14.000699+0000","last_peered":"2024-04-26T12:31:14.000699+0000","last_clean":"2024-04-26T12:31:14.000699+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:31:14.000699+0000","last_undegraded":"2024-04-26T12:31:14.000699+0000","last_fullsized":"2024-04-26T12:31:14.000699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'83","last_scrub_stamp":"2024-04-26T12:31:14.000521+0000","last_deep_scrub":"85'83","last_deep_scrub_stamp":"2024-04-26T12:31:14.000521+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.000521+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:11.290115+0000","scrub_duration":0.0069472290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":618,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.173074+0000","last_change":"2024-04-26T12:31:47.173213+0000","last_active":"2024-04-26T12:31:47.173074+0000","last_peered":"2024-04-26T12:31:47.173074+0000","last_clean":"2024-04-26T12:31:47.173074+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:31:47.173074+0000","last_undegraded":"2024-04-26T12:31:47.173074+0000","last_fullsized":"2024-04-26T12:31:47.173074+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-04-26T12:31:47.173047+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-04-26T12:31:47.173047+0000","last_clean_scrub_stamp":"2024-04-26T12:31:47.173047+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:10.331132+0000","scrub_duration":0.002517961,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"85'63","reported_seq":187,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.295559+0000","last_change":"2024-04-26T12:32:33.295684+0000","last_active":"2024-04-26T12:32:33.295559+0000","last_peered":"2024-04-26T12:32:33.295559+0000","last_clean":"2024-04-26T12:32:33.295559+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:32:33.295559+0000","last_undegraded":"2024-04-26T12:32:33.295559+0000","last_fullsized":"2024-04-26T12:32:33.295559+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'63","last_scrub_stamp":"2024-04-26T12:32:33.295525+0000","last_deep_scrub":"85'63","last_deep_scrub_stamp":"2024-04-26T12:32:33.295525+0000","last_clean_scrub_stamp":"2024-04-26T12:32:33.295525+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:28.721614+0000","scrub_duration":0.011210543999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":868,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:28.143238+0000","last_change":"2024-04-26T12:31:28.143238+0000","last_active":"2024-04-26T12:31:28.143238+0000","last_peered":"2024-04-26T12:31:28.143238+0000","last_clean":"2024-04-26T12:31:28.143238+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:31:28.143238+0000","last_undegraded":"2024-04-26T12:31:28.143238+0000","last_fullsized":"2024-04-26T12:31:28.143238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:31:28.143070+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:31:28.143070+0000","last_clean_scrub_stamp":"2024-04-26T12:31:28.143070+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:55.111541+0000","scrub_duration":0.0024435799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"58'308","reported_seq":312,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:00.078444+0000","last_change":"2024-04-26T12:30:48.090145+0000","last_active":"2024-04-26T12:31:00.078444+0000","last_peered":"2024-04-26T12:31:00.078444+0000","last_clean":"2024-04-26T12:31:00.078444+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:31:00.078444+0000","last_undegraded":"2024-04-26T12:31:00.078444+0000","last_fullsized":"2024-04-26T12:31:00.078444+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:51.814712+0000","last_clean_scrub_stamp":"2024-04-26T12:26:51.814712+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":811,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:58.101978+0000","last_change":"2024-04-26T12:31:58.102086+0000","last_active":"2024-04-26T12:31:58.101978+0000","last_peered":"2024-04-26T12:31:58.101978+0000","last_clean":"2024-04-26T12:31:58.101978+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:31:58.101978+0000","last_undegraded":"2024-04-26T12:31:58.101978+0000","last_fullsized":"2024-04-26T12:31:58.101978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'376","last_scrub_stamp":"2024-04-26T12:31:58.101950+0000","last_deep_scrub":"60'376","last_deep_scrub_stamp":"2024-04-26T12:31:58.101950+0000","last_clean_scrub_stamp":"2024-04-26T12:31:58.101950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:13.898836+0000","scrub_duration":0.0019261320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"85'318","reported_seq":412,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:58.388469+0000","last_change":"2024-04-26T12:31:58.388584+0000","last_active":"2024-04-26T12:31:58.388469+0000","last_peered":"2024-04-26T12:31:58.388469+0000","last_clean":"2024-04-26T12:31:58.388469+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:31:58.388469+0000","last_undegraded":"2024-04-26T12:31:58.388469+0000","last_fullsized":"2024-04-26T12:31:58.388469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'318","last_scrub_stamp":"2024-04-26T12:31:58.388443+0000","last_deep_scrub":"85'318","last_deep_scrub_stamp":"2024-04-26T12:31:58.388443+0000","last_clean_scrub_stamp":"2024-04-26T12:31:58.388443+0000","objects_scrubbed":4,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:31.773997+0000","scrub_duration":0.029898854999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":885,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:49.040500+0000","last_change":"2024-04-26T12:31:49.040500+0000","last_active":"2024-04-26T12:31:49.040500+0000","last_peered":"2024-04-26T12:31:49.040500+0000","last_clean":"2024-04-26T12:31:49.040500+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:31:49.040500+0000","last_undegraded":"2024-04-26T12:31:49.040500+0000","last_fullsized":"2024-04-26T12:31:49.040500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:31:49.040316+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:31:49.040316+0000","last_clean_scrub_stamp":"2024-04-26T12:31:49.040316+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:51.229337+0000","scrub_duration":0.0025244709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"85'77","reported_seq":60,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.984448+0000","last_change":"2024-04-26T12:31:14.984448+0000","last_active":"2024-04-26T12:31:14.984448+0000","last_peered":"2024-04-26T12:31:14.984448+0000","last_clean":"2024-04-26T12:31:14.984448+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:31:14.984448+0000","last_undegraded":"2024-04-26T12:31:14.984448+0000","last_fullsized":"2024-04-26T12:31:14.984448+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'77","last_scrub_stamp":"2024-04-26T12:31:14.984325+0000","last_deep_scrub":"85'77","last_deep_scrub_stamp":"2024-04-26T12:31:14.984325+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.984325+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:53.595109+0000","scrub_duration":0.010871390999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":555,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:33.279814+0000","last_change":"2024-04-26T12:31:33.279814+0000","last_active":"2024-04-26T12:31:33.279814+0000","last_peered":"2024-04-26T12:31:33.279814+0000","last_clean":"2024-04-26T12:31:33.279814+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:31:33.279814+0000","last_undegraded":"2024-04-26T12:31:33.279814+0000","last_fullsized":"2024-04-26T12:31:33.279814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'438","last_scrub_stamp":"2024-04-26T12:31:33.279688+0000","last_deep_scrub":"60'438","last_deep_scrub_stamp":"2024-04-26T12:31:33.279688+0000","last_clean_scrub_stamp":"2024-04-26T12:31:33.279688+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:47.222045+0000","scrub_duration":0.0024948520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"85'53","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:26.092908+0000","last_change":"2024-04-26T12:32:26.092908+0000","last_active":"2024-04-26T12:32:26.092908+0000","last_peered":"2024-04-26T12:32:26.092908+0000","last_clean":"2024-04-26T12:32:26.092908+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:32:26.092908+0000","last_undegraded":"2024-04-26T12:32:26.092908+0000","last_fullsized":"2024-04-26T12:32:26.092908+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'53","last_scrub_stamp":"2024-04-26T12:32:26.092771+0000","last_deep_scrub":"85'53","last_deep_scrub_stamp":"2024-04-26T12:32:26.092771+0000","last_clean_scrub_stamp":"2024-04-26T12:32:26.092771+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:02.205832+0000","scrub_duration":0.011348034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":979,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:18.220035+0000","last_change":"2024-04-26T12:31:18.220147+0000","last_active":"2024-04-26T12:31:18.220035+0000","last_peered":"2024-04-26T12:31:18.220035+0000","last_clean":"2024-04-26T12:31:18.220035+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:31:18.220035+0000","last_undegraded":"2024-04-26T12:31:18.220035+0000","last_fullsized":"2024-04-26T12:31:18.220035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'473","last_scrub_stamp":"2024-04-26T12:31:18.220009+0000","last_deep_scrub":"60'473","last_deep_scrub_stamp":"2024-04-26T12:31:18.220009+0000","last_clean_scrub_stamp":"2024-04-26T12:31:18.220009+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:07.523749+0000","scrub_duration":0.0022384369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":865,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149838+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:31:12.149838+0000","last_peered":"2024-04-26T12:31:12.149838+0000","last_clean":"2024-04-26T12:31:12.149838+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:31:12.149838+0000","last_undegraded":"2024-04-26T12:31:12.149838+0000","last_fullsized":"2024-04-26T12:31:12.149838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":541,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:40.993749+0000","last_change":"2024-04-26T12:31:40.993749+0000","last_active":"2024-04-26T12:31:40.993749+0000","last_peered":"2024-04-26T12:31:40.993749+0000","last_clean":"2024-04-26T12:31:40.993749+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:31:40.993749+0000","last_undegraded":"2024-04-26T12:31:40.993749+0000","last_fullsized":"2024-04-26T12:31:40.993749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'446","last_scrub_stamp":"2024-04-26T12:31:40.993603+0000","last_deep_scrub":"60'446","last_deep_scrub_stamp":"2024-04-26T12:31:40.993603+0000","last_clean_scrub_stamp":"2024-04-26T12:31:40.993603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:27.297067+0000","scrub_duration":0.0020716889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":630,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:05.364349+0000","last_change":"2024-04-26T12:26:53.265644+0000","last_active":"2024-04-26T12:31:05.364349+0000","last_peered":"2024-04-26T12:31:05.364349+0000","last_clean":"2024-04-26T12:31:05.364349+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:31:05.364349+0000","last_undegraded":"2024-04-26T12:31:05.364349+0000","last_fullsized":"2024-04-26T12:31:05.364349+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":528,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:48.035660+0000","last_change":"2024-04-26T12:31:48.035660+0000","last_active":"2024-04-26T12:31:48.035660+0000","last_peered":"2024-04-26T12:31:48.035660+0000","last_clean":"2024-04-26T12:31:48.035660+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:31:48.035660+0000","last_undegraded":"2024-04-26T12:31:48.035660+0000","last_fullsized":"2024-04-26T12:31:48.035660+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'384","last_scrub_stamp":"2024-04-26T12:31:48.035480+0000","last_deep_scrub":"60'384","last_deep_scrub_stamp":"2024-04-26T12:31:48.035480+0000","last_clean_scrub_stamp":"2024-04-26T12:31:48.035480+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:18.919037+0000","scrub_duration":0.002218383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":524,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:40.177293+0000","last_change":"2024-04-26T12:31:40.177393+0000","last_active":"2024-04-26T12:31:40.177293+0000","last_peered":"2024-04-26T12:31:40.177293+0000","last_clean":"2024-04-26T12:31:40.177293+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:31:40.177293+0000","last_undegraded":"2024-04-26T12:31:40.177293+0000","last_fullsized":"2024-04-26T12:31:40.177293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'380","last_scrub_stamp":"2024-04-26T12:31:40.177270+0000","last_deep_scrub":"60'380","last_deep_scrub_stamp":"2024-04-26T12:31:40.177270+0000","last_clean_scrub_stamp":"2024-04-26T12:31:40.177270+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:45.516828+0000","scrub_duration":0.0024862170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79134720,"data_stored":256449018,"data_compressed":38844374,"data_compressed_allocated":48693248,"data_compressed_original":226074624,"omap_allocated":5343,"internal_metadata":0},"log_size":7557,"ondisk_log_size":7557,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738446,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130112,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94241728,"statfs":{"total":96636764160,"available":96503529472,"internally_reserved":0,"allocated":31711232,"data_stored":85785287,"data_compressed":12062822,"data_compressed_allocated":15765504,"data_compressed_original":70336512,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.30399999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.63,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.28000000000000003,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Apr 26 12:32:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.42299999999999999},"min":{"1min":0.35599999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.436,"15min":0.43099999999999999},"min":{"1min":0.372,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.495}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131332,"kb_used_data":32188,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94240508,"statfs":{"total":96636764160,"available":96502280192,"internally_reserved":0,"allocated":32960512,"data_stored":91451171,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:32:42 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.44700000000000001},"min":{"1min":0.372,"5min":0.186,"15min":0.186},"max":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.47799999999999998,"15min":0.46999999999999997},"min":{"1min":0.39700000000000002,"5min":0.222,"15min":0.222},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.62}]},{"osd":2,"last update":"Fri Apr 26 12:32:47 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.38,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.61499999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.46200000000000002,"15min":0.47199999999999998},"min":{"1min":0.34699999999999998,"5min":0.191,"15min":0.191},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.63400000000000001}]}]},{"osd":1,"up_from":64,"seq":274877906973,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62336,"kb_used_data":16760,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309504,"statfs":{"total":96636764160,"available":96572932096,"internally_reserved":0,"allocated":17162240,"data_stored":81548386,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.29699999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.58699999999999997,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.443,"15min":0.436},"min":{"1min":0.30499999999999999,"5min":0.224,"15min":0.224},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.44}]},{"osd":2,"last update":"Fri Apr 26 12:32:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44,"15min":0.42699999999999999},"min":{"1min":0.42699999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.61899999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.432},"min":{"1min":0.41299999999999998,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.61699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30789632,"data_stored":84809889,"data_compressed":12028675,"data_compressed_allocated":15720448,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:32:55.511 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:55.511 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:55.511 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:55.511 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:55.511 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:55.512 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:55.512 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:55.512 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:55.512 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:55.512 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:55.513 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:26:51.814712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:55.513 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:55.513 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:32:55.513 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:33:15.514 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:33:15.874 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:33:15.876 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:33:15.885 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":276,"stamp":"2024-04-26T12:33:15.392683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6546,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34400,"ondisk_log_size":34400,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":323780,"kb_used_data":79916,"kb_used_omap":9,"kb_used_meta":243830,"kb_avail":282791740,"statfs":{"total":289910292480,"available":289578741760,"internally_reserved":0,"allocated":81833984,"data_stored":258784844,"data_compressed":38912668,"data_compressed_allocated":48783360,"data_compressed_original":227221504,"omap_allocated":10125,"internal_metadata":249682035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002761"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":914,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:18.003585+0000","last_change":"2024-04-26T12:31:18.003585+0000","last_active":"2024-04-26T12:31:18.003585+0000","last_peered":"2024-04-26T12:31:18.003585+0000","last_clean":"2024-04-26T12:31:18.003585+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:31:18.003585+0000","last_undegraded":"2024-04-26T12:31:18.003585+0000","last_fullsized":"2024-04-26T12:31:18.003585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:18.003445+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:18.003445+0000","last_clean_scrub_stamp":"2024-04-26T12:31:18.003445+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:47.444600+0000","scrub_duration":0.0019588980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":970,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:02.342325+0000","last_change":"2024-04-26T12:33:02.342325+0000","last_active":"2024-04-26T12:33:02.342325+0000","last_peered":"2024-04-26T12:33:02.342325+0000","last_clean":"2024-04-26T12:33:02.342325+0000","last_became_active":"2024-04-26T12:30:56.084642+0000","last_became_peered":"2024-04-26T12:30:56.084642+0000","last_unstale":"2024-04-26T12:33:02.342325+0000","last_undegraded":"2024-04-26T12:33:02.342325+0000","last_fullsized":"2024-04-26T12:33:02.342325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:33:02.342128+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:33:02.342128+0000","last_clean_scrub_stamp":"2024-04-26T12:33:02.342128+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:13.280168+0000","scrub_duration":0.002725824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":508,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:12.142540+0000","last_change":"2024-04-26T12:33:12.142656+0000","last_active":"2024-04-26T12:33:12.142540+0000","last_peered":"2024-04-26T12:33:12.142540+0000","last_clean":"2024-04-26T12:33:12.142540+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:33:12.142540+0000","last_undegraded":"2024-04-26T12:33:12.142540+0000","last_fullsized":"2024-04-26T12:33:12.142540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:33:12.142515+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:33:12.142515+0000","last_clean_scrub_stamp":"2024-04-26T12:33:12.142515+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:42.932290+0000","scrub_duration":0.0027180809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":880,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:41.224731+0000","last_change":"2024-04-26T12:31:41.224731+0000","last_active":"2024-04-26T12:31:41.224731+0000","last_peered":"2024-04-26T12:31:41.224731+0000","last_clean":"2024-04-26T12:31:41.224731+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:31:41.224731+0000","last_undegraded":"2024-04-26T12:31:41.224731+0000","last_fullsized":"2024-04-26T12:31:41.224731+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:31:41.224537+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:31:41.224537+0000","last_clean_scrub_stamp":"2024-04-26T12:31:41.224537+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:31.770929+0000","scrub_duration":0.0021526079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":952,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:44.166192+0000","last_change":"2024-04-26T12:31:44.166192+0000","last_active":"2024-04-26T12:31:44.166192+0000","last_peered":"2024-04-26T12:31:44.166192+0000","last_clean":"2024-04-26T12:31:44.166192+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:31:44.166192+0000","last_undegraded":"2024-04-26T12:31:44.166192+0000","last_fullsized":"2024-04-26T12:31:44.166192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'430","last_scrub_stamp":"2024-04-26T12:31:44.165994+0000","last_deep_scrub":"60'430","last_deep_scrub_stamp":"2024-04-26T12:31:44.165994+0000","last_clean_scrub_stamp":"2024-04-26T12:31:44.165994+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:15.166663+0000","scrub_duration":0.0026340479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":489,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:15.202084+0000","last_change":"2024-04-26T12:31:15.202198+0000","last_active":"2024-04-26T12:31:15.202084+0000","last_peered":"2024-04-26T12:31:15.202084+0000","last_clean":"2024-04-26T12:31:15.202084+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:31:15.202084+0000","last_undegraded":"2024-04-26T12:31:15.202084+0000","last_fullsized":"2024-04-26T12:31:15.202084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:31:15.202057+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:31:15.202057+0000","last_clean_scrub_stamp":"2024-04-26T12:31:15.202057+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:36.672446+0000","scrub_duration":0.002466312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1041,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:14.136714+0000","last_change":"2024-04-26T12:32:14.136872+0000","last_active":"2024-04-26T12:32:14.136714+0000","last_peered":"2024-04-26T12:32:14.136714+0000","last_clean":"2024-04-26T12:32:14.136714+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:32:14.136714+0000","last_undegraded":"2024-04-26T12:32:14.136714+0000","last_fullsized":"2024-04-26T12:32:14.136714+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'457","last_scrub_stamp":"2024-04-26T12:32:14.136690+0000","last_deep_scrub":"60'457","last_deep_scrub_stamp":"2024-04-26T12:32:14.136690+0000","last_clean_scrub_stamp":"2024-04-26T12:32:14.136690+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:05.085896+0000","scrub_duration":0.0024392419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":779,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:03.106167+0000","last_change":"2024-04-26T12:32:03.106311+0000","last_active":"2024-04-26T12:32:03.106167+0000","last_peered":"2024-04-26T12:32:03.106167+0000","last_clean":"2024-04-26T12:32:03.106167+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:32:03.106167+0000","last_undegraded":"2024-04-26T12:32:03.106167+0000","last_fullsized":"2024-04-26T12:32:03.106167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'371","last_scrub_stamp":"2024-04-26T12:32:03.106125+0000","last_deep_scrub":"60'371","last_deep_scrub_stamp":"2024-04-26T12:32:03.106125+0000","last_clean_scrub_stamp":"2024-04-26T12:32:03.106125+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:10.173340+0000","scrub_duration":0.002253672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":511,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:44.946041+0000","last_change":"2024-04-26T12:31:44.946041+0000","last_active":"2024-04-26T12:31:44.946041+0000","last_peered":"2024-04-26T12:31:44.946041+0000","last_clean":"2024-04-26T12:31:44.946041+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:31:44.946041+0000","last_undegraded":"2024-04-26T12:31:44.946041+0000","last_fullsized":"2024-04-26T12:31:44.946041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'417","last_scrub_stamp":"2024-04-26T12:31:44.945906+0000","last_deep_scrub":"60'417","last_deep_scrub_stamp":"2024-04-26T12:31:44.945906+0000","last_clean_scrub_stamp":"2024-04-26T12:31:44.945906+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:35.883858+0000","scrub_duration":0.001923143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":924,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:56.314967+0000","last_change":"2024-04-26T12:32:56.315070+0000","last_active":"2024-04-26T12:32:56.314967+0000","last_peered":"2024-04-26T12:32:56.314967+0000","last_clean":"2024-04-26T12:32:56.314967+0000","last_became_active":"2024-04-26T12:30:56.085904+0000","last_became_peered":"2024-04-26T12:30:56.085904+0000","last_unstale":"2024-04-26T12:32:56.314967+0000","last_undegraded":"2024-04-26T12:32:56.314967+0000","last_fullsized":"2024-04-26T12:32:56.314967+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'420","last_scrub_stamp":"2024-04-26T12:32:56.314940+0000","last_deep_scrub":"60'420","last_deep_scrub_stamp":"2024-04-26T12:32:56.314940+0000","last_clean_scrub_stamp":"2024-04-26T12:32:56.314940+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:52.935078+0000","scrub_duration":0.0021464190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":607,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.239557+0000","last_change":"2024-04-26T12:31:14.239557+0000","last_active":"2024-04-26T12:31:14.239557+0000","last_peered":"2024-04-26T12:31:14.239557+0000","last_clean":"2024-04-26T12:31:14.239557+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:31:14.239557+0000","last_undegraded":"2024-04-26T12:31:14.239557+0000","last_fullsized":"2024-04-26T12:31:14.239557+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'366","last_scrub_stamp":"2024-04-26T12:31:14.239429+0000","last_deep_scrub":"60'366","last_deep_scrub_stamp":"2024-04-26T12:31:14.239429+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.239429+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:48.735192+0000","scrub_duration":0.0022088089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":525,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:04.314890+0000","last_change":"2024-04-26T12:33:04.315070+0000","last_active":"2024-04-26T12:33:04.314890+0000","last_peered":"2024-04-26T12:33:04.314890+0000","last_clean":"2024-04-26T12:33:04.314890+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:33:04.314890+0000","last_undegraded":"2024-04-26T12:33:04.314890+0000","last_fullsized":"2024-04-26T12:33:04.314890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'360","last_scrub_stamp":"2024-04-26T12:33:04.314848+0000","last_deep_scrub":"60'360","last_deep_scrub_stamp":"2024-04-26T12:33:04.314848+0000","last_clean_scrub_stamp":"2024-04-26T12:33:04.314848+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:17.513182+0000","scrub_duration":0.003258389,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":896,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:51.325991+0000","last_change":"2024-04-26T12:32:51.326108+0000","last_active":"2024-04-26T12:32:51.325991+0000","last_peered":"2024-04-26T12:32:51.325991+0000","last_clean":"2024-04-26T12:32:51.325991+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:32:51.325991+0000","last_undegraded":"2024-04-26T12:32:51.325991+0000","last_fullsized":"2024-04-26T12:32:51.325991+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'420","last_scrub_stamp":"2024-04-26T12:32:51.325964+0000","last_deep_scrub":"60'420","last_deep_scrub_stamp":"2024-04-26T12:32:51.325964+0000","last_clean_scrub_stamp":"2024-04-26T12:32:51.325964+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:21.753699+0000","scrub_duration":0.001947617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":533,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:41.944310+0000","last_change":"2024-04-26T12:32:41.944416+0000","last_active":"2024-04-26T12:32:41.944310+0000","last_peered":"2024-04-26T12:32:41.944310+0000","last_clean":"2024-04-26T12:32:41.944310+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:32:41.944310+0000","last_undegraded":"2024-04-26T12:32:41.944310+0000","last_fullsized":"2024-04-26T12:32:41.944310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'418","last_scrub_stamp":"2024-04-26T12:32:41.944281+0000","last_deep_scrub":"60'418","last_deep_scrub_stamp":"2024-04-26T12:32:41.944281+0000","last_clean_scrub_stamp":"2024-04-26T12:32:41.944281+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:20.201209+0000","scrub_duration":0.0033717819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":553,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:10.151151+0000","last_change":"2024-04-26T12:32:10.151151+0000","last_active":"2024-04-26T12:32:10.151151+0000","last_peered":"2024-04-26T12:32:10.151151+0000","last_clean":"2024-04-26T12:32:10.151151+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:32:10.151151+0000","last_undegraded":"2024-04-26T12:32:10.151151+0000","last_fullsized":"2024-04-26T12:32:10.151151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'429","last_scrub_stamp":"2024-04-26T12:32:10.151020+0000","last_deep_scrub":"60'429","last_deep_scrub_stamp":"2024-04-26T12:32:10.151020+0000","last_clean_scrub_stamp":"2024-04-26T12:32:10.151020+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:54.533321+0000","scrub_duration":0.0024815969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":939,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:13.092103+0000","last_change":"2024-04-26T12:32:13.092103+0000","last_active":"2024-04-26T12:32:13.092103+0000","last_peered":"2024-04-26T12:32:13.092103+0000","last_clean":"2024-04-26T12:32:13.092103+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:32:13.092103+0000","last_undegraded":"2024-04-26T12:32:13.092103+0000","last_fullsized":"2024-04-26T12:32:13.092103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'452","last_scrub_stamp":"2024-04-26T12:32:13.091905+0000","last_deep_scrub":"60'452","last_deep_scrub_stamp":"2024-04-26T12:32:13.091905+0000","last_clean_scrub_stamp":"2024-04-26T12:32:13.091905+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:11.459487+0000","scrub_duration":0.002399418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":506,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.966807+0000","last_change":"2024-04-26T12:31:36.966807+0000","last_active":"2024-04-26T12:31:36.966807+0000","last_peered":"2024-04-26T12:31:36.966807+0000","last_clean":"2024-04-26T12:31:36.966807+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:31:36.966807+0000","last_undegraded":"2024-04-26T12:31:36.966807+0000","last_fullsized":"2024-04-26T12:31:36.966807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-04-26T12:31:36.966676+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-04-26T12:31:36.966676+0000","last_clean_scrub_stamp":"2024-04-26T12:31:36.966676+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:18.037732+0000","scrub_duration":0.0019413729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":925,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.169611+0000","last_change":"2024-04-26T12:31:36.170108+0000","last_active":"2024-04-26T12:31:36.169611+0000","last_peered":"2024-04-26T12:31:36.169611+0000","last_clean":"2024-04-26T12:31:36.169611+0000","last_became_active":"2024-04-26T12:30:57.083026+0000","last_became_peered":"2024-04-26T12:30:57.083026+0000","last_unstale":"2024-04-26T12:31:36.169611+0000","last_undegraded":"2024-04-26T12:31:36.169611+0000","last_fullsized":"2024-04-26T12:31:36.169611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:36.169585+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:36.169585+0000","last_clean_scrub_stamp":"2024-04-26T12:31:36.169585+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:42.604764+0000","scrub_duration":0.0025888259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":539,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.935658+0000","last_change":"2024-04-26T12:31:37.935658+0000","last_active":"2024-04-26T12:31:37.935658+0000","last_peered":"2024-04-26T12:31:37.935658+0000","last_clean":"2024-04-26T12:31:37.935658+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:31:37.935658+0000","last_undegraded":"2024-04-26T12:31:37.935658+0000","last_fullsized":"2024-04-26T12:31:37.935658+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'434","last_scrub_stamp":"2024-04-26T12:31:37.935496+0000","last_deep_scrub":"60'434","last_deep_scrub_stamp":"2024-04-26T12:31:37.935496+0000","last_clean_scrub_stamp":"2024-04-26T12:31:37.935496+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:23.917082+0000","scrub_duration":0.0023281170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1083,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:52.995900+0000","last_change":"2024-04-26T12:32:52.996009+0000","last_active":"2024-04-26T12:32:52.995900+0000","last_peered":"2024-04-26T12:32:52.995900+0000","last_clean":"2024-04-26T12:32:52.995900+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:32:52.995900+0000","last_undegraded":"2024-04-26T12:32:52.995900+0000","last_fullsized":"2024-04-26T12:32:52.995900+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'478","last_scrub_stamp":"2024-04-26T12:32:52.995859+0000","last_deep_scrub":"60'478","last_deep_scrub_stamp":"2024-04-26T12:32:52.995859+0000","last_clean_scrub_stamp":"2024-04-26T12:32:52.995859+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.131912+0000","scrub_duration":0.002097369,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":965,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:12.130632+0000","last_change":"2024-04-26T12:32:12.130753+0000","last_active":"2024-04-26T12:32:12.130632+0000","last_peered":"2024-04-26T12:32:12.130632+0000","last_clean":"2024-04-26T12:32:12.130632+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:32:12.130632+0000","last_undegraded":"2024-04-26T12:32:12.130632+0000","last_fullsized":"2024-04-26T12:32:12.130632+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-04-26T12:32:12.130588+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-04-26T12:32:12.130588+0000","last_clean_scrub_stamp":"2024-04-26T12:32:12.130588+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:08.462918+0000","scrub_duration":0.0024608970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":593,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:23.051416+0000","last_change":"2024-04-26T12:31:23.051416+0000","last_active":"2024-04-26T12:31:23.051416+0000","last_peered":"2024-04-26T12:31:23.051416+0000","last_clean":"2024-04-26T12:31:23.051416+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:31:23.051416+0000","last_undegraded":"2024-04-26T12:31:23.051416+0000","last_fullsized":"2024-04-26T12:31:23.051416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:31:23.051248+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:31:23.051248+0000","last_clean_scrub_stamp":"2024-04-26T12:31:23.051248+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:26.481350+0000","scrub_duration":0.0028000099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":508,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:46.004411+0000","last_change":"2024-04-26T12:32:46.004411+0000","last_active":"2024-04-26T12:32:46.004411+0000","last_peered":"2024-04-26T12:32:46.004411+0000","last_clean":"2024-04-26T12:32:46.004411+0000","last_became_active":"2024-04-26T12:31:00.079766+0000","last_became_peered":"2024-04-26T12:31:00.079766+0000","last_unstale":"2024-04-26T12:32:46.004411+0000","last_undegraded":"2024-04-26T12:32:46.004411+0000","last_fullsized":"2024-04-26T12:32:46.004411+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-04-26T12:32:46.004284+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-04-26T12:32:46.004284+0000","last_clean_scrub_stamp":"2024-04-26T12:32:46.004284+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:44.748451+0000","scrub_duration":0.0021761100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":1030,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:38.161560+0000","last_change":"2024-04-26T12:31:38.162058+0000","last_active":"2024-04-26T12:31:38.161560+0000","last_peered":"2024-04-26T12:31:38.161560+0000","last_clean":"2024-04-26T12:31:38.161560+0000","last_became_active":"2024-04-26T12:30:58.078211+0000","last_became_peered":"2024-04-26T12:30:58.078211+0000","last_unstale":"2024-04-26T12:31:38.161560+0000","last_undegraded":"2024-04-26T12:31:38.161560+0000","last_fullsized":"2024-04-26T12:31:38.161560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'446","last_scrub_stamp":"2024-04-26T12:31:38.161525+0000","last_deep_scrub":"60'446","last_deep_scrub_stamp":"2024-04-26T12:31:38.161525+0000","last_clean_scrub_stamp":"2024-04-26T12:31:38.161525+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:54.390254+0000","scrub_duration":0.002528092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":561,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:50.233810+0000","last_change":"2024-04-26T12:31:50.233922+0000","last_active":"2024-04-26T12:31:50.233810+0000","last_peered":"2024-04-26T12:31:50.233810+0000","last_clean":"2024-04-26T12:31:50.233810+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:31:50.233810+0000","last_undegraded":"2024-04-26T12:31:50.233810+0000","last_fullsized":"2024-04-26T12:31:50.233810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-04-26T12:31:50.233783+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-04-26T12:31:50.233783+0000","last_clean_scrub_stamp":"2024-04-26T12:31:50.233783+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:54.618065+0000","scrub_duration":0.0025007240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":598,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.010394+0000","last_change":"2024-04-26T12:31:47.010394+0000","last_active":"2024-04-26T12:31:47.010394+0000","last_peered":"2024-04-26T12:31:47.010394+0000","last_clean":"2024-04-26T12:31:47.010394+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:31:47.010394+0000","last_undegraded":"2024-04-26T12:31:47.010394+0000","last_fullsized":"2024-04-26T12:31:47.010394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'467","last_scrub_stamp":"2024-04-26T12:31:47.010262+0000","last_deep_scrub":"60'467","last_deep_scrub_stamp":"2024-04-26T12:31:47.010262+0000","last_clean_scrub_stamp":"2024-04-26T12:31:47.010262+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:06.785529+0000","scrub_duration":0.002479153,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":526,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:09.153818+0000","last_change":"2024-04-26T12:32:09.153927+0000","last_active":"2024-04-26T12:32:09.153818+0000","last_peered":"2024-04-26T12:32:09.153818+0000","last_clean":"2024-04-26T12:32:09.153818+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:32:09.153818+0000","last_undegraded":"2024-04-26T12:32:09.153818+0000","last_fullsized":"2024-04-26T12:32:09.153818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'398","last_scrub_stamp":"2024-04-26T12:32:09.153791+0000","last_deep_scrub":"60'398","last_deep_scrub_stamp":"2024-04-26T12:32:09.153791+0000","last_clean_scrub_stamp":"2024-04-26T12:32:09.153791+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:18.465189+0000","scrub_duration":0.0028129969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"85'460","reported_seq":583,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.260820+0000","last_change":"2024-04-26T12:32:23.260981+0000","last_active":"2024-04-26T12:32:23.260820+0000","last_peered":"2024-04-26T12:32:23.260820+0000","last_clean":"2024-04-26T12:32:23.260820+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:32:23.260820+0000","last_undegraded":"2024-04-26T12:32:23.260820+0000","last_fullsized":"2024-04-26T12:32:23.260820+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'460","last_scrub_stamp":"2024-04-26T12:32:23.260772+0000","last_deep_scrub":"85'460","last_deep_scrub_stamp":"2024-04-26T12:32:23.260772+0000","last_clean_scrub_stamp":"2024-04-26T12:32:23.260772+0000","objects_scrubbed":3,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:42.904353+0000","scrub_duration":0.031187894000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.208695+0000","last_change":"2024-04-26T12:31:46.208695+0000","last_active":"2024-04-26T12:31:46.208695+0000","last_peered":"2024-04-26T12:31:46.208695+0000","last_clean":"2024-04-26T12:31:46.208695+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:31:46.208695+0000","last_undegraded":"2024-04-26T12:31:46.208695+0000","last_fullsized":"2024-04-26T12:31:46.208695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'386","last_scrub_stamp":"2024-04-26T12:31:46.208542+0000","last_deep_scrub":"60'386","last_deep_scrub_stamp":"2024-04-26T12:31:46.208542+0000","last_clean_scrub_stamp":"2024-04-26T12:31:46.208542+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:45.386754+0000","scrub_duration":0.0025680009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"85'343","reported_seq":424,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:32.020118+0000","last_change":"2024-04-26T12:32:32.020118+0000","last_active":"2024-04-26T12:32:32.020118+0000","last_peered":"2024-04-26T12:32:32.020118+0000","last_clean":"2024-04-26T12:32:32.020118+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:32:32.020118+0000","last_undegraded":"2024-04-26T12:32:32.020118+0000","last_fullsized":"2024-04-26T12:32:32.020118+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'343","last_scrub_stamp":"2024-04-26T12:32:32.019929+0000","last_deep_scrub":"85'343","last_deep_scrub_stamp":"2024-04-26T12:32:32.019929+0000","last_clean_scrub_stamp":"2024-04-26T12:32:32.019929+0000","objects_scrubbed":1,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:20.752633+0000","scrub_duration":0.014563081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":490,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.968391+0000","last_change":"2024-04-26T12:32:37.968391+0000","last_active":"2024-04-26T12:32:37.968391+0000","last_peered":"2024-04-26T12:32:37.968391+0000","last_clean":"2024-04-26T12:32:37.968391+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:32:37.968391+0000","last_undegraded":"2024-04-26T12:32:37.968391+0000","last_fullsized":"2024-04-26T12:32:37.968391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'398","last_scrub_stamp":"2024-04-26T12:32:37.968259+0000","last_deep_scrub":"60'398","last_deep_scrub_stamp":"2024-04-26T12:32:37.968259+0000","last_clean_scrub_stamp":"2024-04-26T12:32:37.968259+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:51.732088+0000","scrub_duration":0.002548804,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"85'710","reported_seq":793,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:56.110289+0000","last_change":"2024-04-26T12:31:56.110289+0000","last_active":"2024-04-26T12:31:56.110289+0000","last_peered":"2024-04-26T12:31:56.110289+0000","last_clean":"2024-04-26T12:31:56.110289+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:31:56.110289+0000","last_undegraded":"2024-04-26T12:31:56.110289+0000","last_fullsized":"2024-04-26T12:31:56.110289+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'710","last_scrub_stamp":"2024-04-26T12:31:56.110156+0000","last_deep_scrub":"85'710","last_deep_scrub_stamp":"2024-04-26T12:31:56.110156+0000","last_clean_scrub_stamp":"2024-04-26T12:31:56.110156+0000","objects_scrubbed":2,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:27.621679+0000","scrub_duration":0.025669368000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":513,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.113397+0000","last_change":"2024-04-26T12:31:26.113397+0000","last_active":"2024-04-26T12:31:26.113397+0000","last_peered":"2024-04-26T12:31:26.113397+0000","last_clean":"2024-04-26T12:31:26.113397+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:31:26.113397+0000","last_undegraded":"2024-04-26T12:31:26.113397+0000","last_fullsized":"2024-04-26T12:31:26.113397+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:31:26.113263+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:31:26.113263+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.113263+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:51.012642+0000","scrub_duration":0.001900838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:45.981948+0000","last_change":"2024-04-26T12:31:45.981948+0000","last_active":"2024-04-26T12:31:45.981948+0000","last_peered":"2024-04-26T12:31:45.981948+0000","last_clean":"2024-04-26T12:31:45.981948+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:31:45.981948+0000","last_undegraded":"2024-04-26T12:31:45.981948+0000","last_fullsized":"2024-04-26T12:31:45.981948+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'58","last_scrub_stamp":"2024-04-26T12:31:45.981781+0000","last_deep_scrub":"58'58","last_deep_scrub_stamp":"2024-04-26T12:31:45.981781+0000","last_clean_scrub_stamp":"2024-04-26T12:31:45.981781+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:52.325021+0000","scrub_duration":0.0016923179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":607,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:24.080935+0000","last_change":"2024-04-26T12:32:24.080935+0000","last_active":"2024-04-26T12:32:24.080935+0000","last_peered":"2024-04-26T12:32:24.080935+0000","last_clean":"2024-04-26T12:32:24.080935+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:32:24.080935+0000","last_undegraded":"2024-04-26T12:32:24.080935+0000","last_fullsized":"2024-04-26T12:32:24.080935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'473","last_scrub_stamp":"2024-04-26T12:32:24.080805+0000","last_deep_scrub":"60'473","last_deep_scrub_stamp":"2024-04-26T12:32:24.080805+0000","last_clean_scrub_stamp":"2024-04-26T12:32:24.080805+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:06.211096+0000","scrub_duration":0.0026229529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"85'356","reported_seq":391,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.259503+0000","last_change":"2024-04-26T12:31:12.259503+0000","last_active":"2024-04-26T12:31:12.259503+0000","last_peered":"2024-04-26T12:31:12.259503+0000","last_clean":"2024-04-26T12:31:12.259503+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:31:12.259503+0000","last_undegraded":"2024-04-26T12:31:12.259503+0000","last_fullsized":"2024-04-26T12:31:12.259503+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'356","last_scrub_stamp":"2024-04-26T12:31:12.259359+0000","last_deep_scrub":"85'356","last_deep_scrub_stamp":"2024-04-26T12:31:12.259359+0000","last_clean_scrub_stamp":"2024-04-26T12:31:12.259359+0000","objects_scrubbed":1,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:29.053825+0000","scrub_duration":0.015931049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":733,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:01.093764+0000","last_change":"2024-04-26T12:32:01.093764+0000","last_active":"2024-04-26T12:32:01.093764+0000","last_peered":"2024-04-26T12:32:01.093764+0000","last_clean":"2024-04-26T12:32:01.093764+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:32:01.093764+0000","last_undegraded":"2024-04-26T12:32:01.093764+0000","last_fullsized":"2024-04-26T12:32:01.093764+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'528","last_scrub_stamp":"2024-04-26T12:32:01.093601+0000","last_deep_scrub":"60'528","last_deep_scrub_stamp":"2024-04-26T12:32:01.093601+0000","last_clean_scrub_stamp":"2024-04-26T12:32:01.093601+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:13.828455+0000","scrub_duration":0.0023344469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"85'88","reported_seq":182,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.241699+0000","last_change":"2024-04-26T12:32:22.241832+0000","last_active":"2024-04-26T12:32:22.241699+0000","last_peered":"2024-04-26T12:32:22.241699+0000","last_clean":"2024-04-26T12:32:22.241699+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:32:22.241699+0000","last_undegraded":"2024-04-26T12:32:22.241699+0000","last_fullsized":"2024-04-26T12:32:22.241699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'88","last_scrub_stamp":"2024-04-26T12:32:22.241659+0000","last_deep_scrub":"85'88","last_deep_scrub_stamp":"2024-04-26T12:32:22.241659+0000","last_clean_scrub_stamp":"2024-04-26T12:32:22.241659+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:01.912257+0000","scrub_duration":0.0038713139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":524,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:04.095303+0000","last_change":"2024-04-26T12:32:04.095303+0000","last_active":"2024-04-26T12:32:04.095303+0000","last_peered":"2024-04-26T12:32:04.095303+0000","last_clean":"2024-04-26T12:32:04.095303+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:32:04.095303+0000","last_undegraded":"2024-04-26T12:32:04.095303+0000","last_fullsized":"2024-04-26T12:32:04.095303+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-04-26T12:32:04.095151+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-04-26T12:32:04.095151+0000","last_clean_scrub_stamp":"2024-04-26T12:32:04.095151+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:13.337155+0000","scrub_duration":0.0023191150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"85'380","reported_seq":458,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.301826+0000","last_change":"2024-04-26T12:31:26.301826+0000","last_active":"2024-04-26T12:31:26.301826+0000","last_peered":"2024-04-26T12:31:26.301826+0000","last_clean":"2024-04-26T12:31:26.301826+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:31:26.301826+0000","last_undegraded":"2024-04-26T12:31:26.301826+0000","last_fullsized":"2024-04-26T12:31:26.301826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'380","last_scrub_stamp":"2024-04-26T12:31:26.301693+0000","last_deep_scrub":"85'380","last_deep_scrub_stamp":"2024-04-26T12:31:26.301693+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.301693+0000","objects_scrubbed":6,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:55.160179+0000","scrub_duration":0.02593227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":519,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.325525+0000","last_change":"2024-04-26T12:31:25.325525+0000","last_active":"2024-04-26T12:31:25.325525+0000","last_peered":"2024-04-26T12:31:25.325525+0000","last_clean":"2024-04-26T12:31:25.325525+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:31:25.325525+0000","last_undegraded":"2024-04-26T12:31:25.325525+0000","last_fullsized":"2024-04-26T12:31:25.325525+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:25.325392+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:25.325392+0000","last_clean_scrub_stamp":"2024-04-26T12:31:25.325392+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:47.712840+0000","scrub_duration":0.0026314070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"85'544","reported_seq":665,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:40.950666+0000","last_change":"2024-04-26T12:32:40.950798+0000","last_active":"2024-04-26T12:32:40.950666+0000","last_peered":"2024-04-26T12:32:40.950666+0000","last_clean":"2024-04-26T12:32:40.950666+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:32:40.950666+0000","last_undegraded":"2024-04-26T12:32:40.950666+0000","last_fullsized":"2024-04-26T12:32:40.950666+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'544","last_scrub_stamp":"2024-04-26T12:32:40.950641+0000","last_deep_scrub":"85'544","last_deep_scrub_stamp":"2024-04-26T12:32:40.950641+0000","last_clean_scrub_stamp":"2024-04-26T12:32:40.950641+0000","objects_scrubbed":4,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:59.355168+0000","scrub_duration":0.024502327000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":807,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:57.323515+0000","last_change":"2024-04-26T12:32:57.323660+0000","last_active":"2024-04-26T12:32:57.323515+0000","last_peered":"2024-04-26T12:32:57.323515+0000","last_clean":"2024-04-26T12:32:57.323515+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:32:57.323515+0000","last_undegraded":"2024-04-26T12:32:57.323515+0000","last_fullsized":"2024-04-26T12:32:57.323515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'370","last_scrub_stamp":"2024-04-26T12:32:57.323467+0000","last_deep_scrub":"60'370","last_deep_scrub_stamp":"2024-04-26T12:32:57.323467+0000","last_clean_scrub_stamp":"2024-04-26T12:32:57.323467+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:56.114102+0000","scrub_duration":0.0021430479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:54.112814+0000","last_change":"2024-04-26T12:31:54.112814+0000","last_active":"2024-04-26T12:31:54.112814+0000","last_peered":"2024-04-26T12:31:54.112814+0000","last_clean":"2024-04-26T12:31:54.112814+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:31:54.112814+0000","last_undegraded":"2024-04-26T12:31:54.112814+0000","last_fullsized":"2024-04-26T12:31:54.112814+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'63","last_scrub_stamp":"2024-04-26T12:31:54.112680+0000","last_deep_scrub":"58'63","last_deep_scrub_stamp":"2024-04-26T12:31:54.112680+0000","last_clean_scrub_stamp":"2024-04-26T12:31:54.112680+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:58.061070+0000","scrub_duration":0.0018177499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":873,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:29.158519+0000","last_change":"2024-04-26T12:31:29.158519+0000","last_active":"2024-04-26T12:31:29.158519+0000","last_peered":"2024-04-26T12:31:29.158519+0000","last_clean":"2024-04-26T12:31:29.158519+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:31:29.158519+0000","last_undegraded":"2024-04-26T12:31:29.158519+0000","last_fullsized":"2024-04-26T12:31:29.158519+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'390","last_scrub_stamp":"2024-04-26T12:31:29.158376+0000","last_deep_scrub":"60'390","last_deep_scrub_stamp":"2024-04-26T12:31:29.158376+0000","last_clean_scrub_stamp":"2024-04-26T12:31:29.158376+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:29.361899+0000","scrub_duration":0.0022476710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:09.385378+0000","last_change":"2024-04-26T12:32:09.385498+0000","last_active":"2024-04-26T12:32:09.385378+0000","last_peered":"2024-04-26T12:32:09.385378+0000","last_clean":"2024-04-26T12:32:09.385378+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:32:09.385378+0000","last_undegraded":"2024-04-26T12:32:09.385378+0000","last_fullsized":"2024-04-26T12:32:09.385378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'57","last_scrub_stamp":"2024-04-26T12:32:09.385336+0000","last_deep_scrub":"58'57","last_deep_scrub_stamp":"2024-04-26T12:32:09.385336+0000","last_clean_scrub_stamp":"2024-04-26T12:32:09.385336+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:11.337234+0000","scrub_duration":0.0017443039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":513,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:39.940373+0000","last_change":"2024-04-26T12:32:39.940373+0000","last_active":"2024-04-26T12:32:39.940373+0000","last_peered":"2024-04-26T12:32:39.940373+0000","last_clean":"2024-04-26T12:32:39.940373+0000","last_became_active":"2024-04-26T12:30:59.081424+0000","last_became_peered":"2024-04-26T12:30:59.081424+0000","last_unstale":"2024-04-26T12:32:39.940373+0000","last_undegraded":"2024-04-26T12:32:39.940373+0000","last_fullsized":"2024-04-26T12:32:39.940373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'433","last_scrub_stamp":"2024-04-26T12:32:39.940210+0000","last_deep_scrub":"60'433","last_deep_scrub_stamp":"2024-04-26T12:32:39.940210+0000","last_clean_scrub_stamp":"2024-04-26T12:32:39.940210+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:20.854291+0000","scrub_duration":0.0021880409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"85'58","reported_seq":90,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:50.029193+0000","last_change":"2024-04-26T12:31:50.029193+0000","last_active":"2024-04-26T12:31:50.029193+0000","last_peered":"2024-04-26T12:31:50.029193+0000","last_clean":"2024-04-26T12:31:50.029193+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:31:50.029193+0000","last_undegraded":"2024-04-26T12:31:50.029193+0000","last_fullsized":"2024-04-26T12:31:50.029193+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'58","last_scrub_stamp":"2024-04-26T12:31:50.029051+0000","last_deep_scrub":"85'58","last_deep_scrub_stamp":"2024-04-26T12:31:50.029051+0000","last_clean_scrub_stamp":"2024-04-26T12:31:50.029051+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:06.160429+0000","scrub_duration":0.0043989739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":551,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:40.942639+0000","last_change":"2024-04-26T12:32:40.942639+0000","last_active":"2024-04-26T12:32:40.942639+0000","last_peered":"2024-04-26T12:32:40.942639+0000","last_clean":"2024-04-26T12:32:40.942639+0000","last_became_active":"2024-04-26T12:30:59.081463+0000","last_became_peered":"2024-04-26T12:30:59.081463+0000","last_unstale":"2024-04-26T12:32:40.942639+0000","last_undegraded":"2024-04-26T12:32:40.942639+0000","last_fullsized":"2024-04-26T12:32:40.942639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:32:40.942475+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:32:40.942475+0000","last_clean_scrub_stamp":"2024-04-26T12:32:40.942475+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:36.581399+0000","scrub_duration":0.001801637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"85'188","reported_seq":224,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.348379+0000","last_change":"2024-04-26T12:31:31.348379+0000","last_active":"2024-04-26T12:31:31.348379+0000","last_peered":"2024-04-26T12:31:31.348379+0000","last_clean":"2024-04-26T12:31:31.348379+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:31:31.348379+0000","last_undegraded":"2024-04-26T12:31:31.348379+0000","last_fullsized":"2024-04-26T12:31:31.348379+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'188","last_scrub_stamp":"2024-04-26T12:31:31.348227+0000","last_deep_scrub":"85'188","last_deep_scrub_stamp":"2024-04-26T12:31:31.348227+0000","last_clean_scrub_stamp":"2024-04-26T12:31:31.348227+0000","objects_scrubbed":2,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:59.084157+0000","scrub_duration":0.015480226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":544,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:58.302487+0000","last_change":"2024-04-26T12:32:58.302619+0000","last_active":"2024-04-26T12:32:58.302487+0000","last_peered":"2024-04-26T12:32:58.302487+0000","last_clean":"2024-04-26T12:32:58.302487+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:32:58.302487+0000","last_undegraded":"2024-04-26T12:32:58.302487+0000","last_fullsized":"2024-04-26T12:32:58.302487+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:32:58.302459+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:32:58.302459+0000","last_clean_scrub_stamp":"2024-04-26T12:32:58.302459+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:17.750884+0000","scrub_duration":0.0029558000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"85'323","reported_seq":455,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:21.284562+0000","last_change":"2024-04-26T12:32:21.284688+0000","last_active":"2024-04-26T12:32:21.284562+0000","last_peered":"2024-04-26T12:32:21.284562+0000","last_clean":"2024-04-26T12:32:21.284562+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:32:21.284562+0000","last_undegraded":"2024-04-26T12:32:21.284562+0000","last_fullsized":"2024-04-26T12:32:21.284562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'323","last_scrub_stamp":"2024-04-26T12:32:21.284529+0000","last_deep_scrub":"85'323","last_deep_scrub_stamp":"2024-04-26T12:32:21.284529+0000","last_clean_scrub_stamp":"2024-04-26T12:32:21.284529+0000","objects_scrubbed":2,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.109193+0000","scrub_duration":0.015639103000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":989,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:33.193482+0000","last_change":"2024-04-26T12:31:33.193590+0000","last_active":"2024-04-26T12:31:33.193482+0000","last_peered":"2024-04-26T12:31:33.193482+0000","last_clean":"2024-04-26T12:31:33.193482+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:31:33.193482+0000","last_undegraded":"2024-04-26T12:31:33.193482+0000","last_fullsized":"2024-04-26T12:31:33.193482+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'437","last_scrub_stamp":"2024-04-26T12:31:33.193453+0000","last_deep_scrub":"60'437","last_deep_scrub_stamp":"2024-04-26T12:31:33.193453+0000","last_clean_scrub_stamp":"2024-04-26T12:31:33.193453+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:25.293233+0000","scrub_duration":0.0023129719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'479","reported_seq":529,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:57.983000+0000","last_change":"2024-04-26T12:32:57.983000+0000","last_active":"2024-04-26T12:32:57.983000+0000","last_peered":"2024-04-26T12:32:57.983000+0000","last_clean":"2024-04-26T12:32:57.983000+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:32:57.983000+0000","last_undegraded":"2024-04-26T12:32:57.983000+0000","last_fullsized":"2024-04-26T12:32:57.983000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'479","last_scrub_stamp":"2024-04-26T12:32:57.982823+0000","last_deep_scrub":"85'479","last_deep_scrub_stamp":"2024-04-26T12:32:57.982823+0000","last_clean_scrub_stamp":"2024-04-26T12:32:57.982823+0000","objects_scrubbed":2,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:42.694178+0000","scrub_duration":0.019827221999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":504,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.254831+0000","last_change":"2024-04-26T12:31:22.254831+0000","last_active":"2024-04-26T12:31:22.254831+0000","last_peered":"2024-04-26T12:31:22.254831+0000","last_clean":"2024-04-26T12:31:22.254831+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:31:22.254831+0000","last_undegraded":"2024-04-26T12:31:22.254831+0000","last_fullsized":"2024-04-26T12:31:22.254831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:31:22.254705+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:31:22.254705+0000","last_clean_scrub_stamp":"2024-04-26T12:31:22.254705+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:09.032368+0000","scrub_duration":0.0022442209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:04.101407+0000","last_change":"2024-04-26T12:33:04.101540+0000","last_active":"2024-04-26T12:33:04.101407+0000","last_peered":"2024-04-26T12:33:04.101407+0000","last_clean":"2024-04-26T12:33:04.101407+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:33:04.101407+0000","last_undegraded":"2024-04-26T12:33:04.101407+0000","last_fullsized":"2024-04-26T12:33:04.101407+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'62","last_scrub_stamp":"2024-04-26T12:33:04.101380+0000","last_deep_scrub":"58'62","last_deep_scrub_stamp":"2024-04-26T12:33:04.101380+0000","last_clean_scrub_stamp":"2024-04-26T12:33:04.101380+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:30.757133+0000","scrub_duration":0.001694217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":572,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.059419+0000","last_change":"2024-04-26T12:32:22.059419+0000","last_active":"2024-04-26T12:32:22.059419+0000","last_peered":"2024-04-26T12:32:22.059419+0000","last_clean":"2024-04-26T12:32:22.059419+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:32:22.059419+0000","last_undegraded":"2024-04-26T12:32:22.059419+0000","last_fullsized":"2024-04-26T12:32:22.059419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'433","last_scrub_stamp":"2024-04-26T12:32:22.059294+0000","last_deep_scrub":"60'433","last_deep_scrub_stamp":"2024-04-26T12:32:22.059294+0000","last_clean_scrub_stamp":"2024-04-26T12:32:22.059294+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:35.581218+0000","scrub_duration":0.0019914970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"85'184","reported_seq":268,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.972802+0000","last_change":"2024-04-26T12:32:33.972802+0000","last_active":"2024-04-26T12:32:33.972802+0000","last_peered":"2024-04-26T12:32:33.972802+0000","last_clean":"2024-04-26T12:32:33.972802+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:32:33.972802+0000","last_undegraded":"2024-04-26T12:32:33.972802+0000","last_fullsized":"2024-04-26T12:32:33.972802+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'184","last_scrub_stamp":"2024-04-26T12:32:33.972630+0000","last_deep_scrub":"85'184","last_deep_scrub_stamp":"2024-04-26T12:32:33.972630+0000","last_clean_scrub_stamp":"2024-04-26T12:32:33.972630+0000","objects_scrubbed":3,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:48.201253+0000","scrub_duration":0.019072424000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":550,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:09.037376+0000","last_change":"2024-04-26T12:33:09.037502+0000","last_active":"2024-04-26T12:33:09.037376+0000","last_peered":"2024-04-26T12:33:09.037376+0000","last_clean":"2024-04-26T12:33:09.037376+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:33:09.037376+0000","last_undegraded":"2024-04-26T12:33:09.037376+0000","last_fullsized":"2024-04-26T12:33:09.037376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'454","last_scrub_stamp":"2024-04-26T12:33:09.037343+0000","last_deep_scrub":"60'454","last_deep_scrub_stamp":"2024-04-26T12:33:09.037343+0000","last_clean_scrub_stamp":"2024-04-26T12:33:09.037343+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:51.637846+0000","scrub_duration":0.001962026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"85'164","reported_seq":282,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.870309+0000","last_change":"2024-04-26T12:32:37.870414+0000","last_active":"2024-04-26T12:32:37.870309+0000","last_peered":"2024-04-26T12:32:37.870309+0000","last_clean":"2024-04-26T12:32:37.870309+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:32:37.870309+0000","last_undegraded":"2024-04-26T12:32:37.870309+0000","last_fullsized":"2024-04-26T12:32:37.870309+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'164","last_scrub_stamp":"2024-04-26T12:32:37.870280+0000","last_deep_scrub":"85'164","last_deep_scrub_stamp":"2024-04-26T12:32:37.870280+0000","last_clean_scrub_stamp":"2024-04-26T12:32:37.870280+0000","objects_scrubbed":1,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:23.644955+0000","scrub_duration":0.015156388,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":496,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:20.233368+0000","last_change":"2024-04-26T12:31:20.233368+0000","last_active":"2024-04-26T12:31:20.233368+0000","last_peered":"2024-04-26T12:31:20.233368+0000","last_clean":"2024-04-26T12:31:20.233368+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:31:20.233368+0000","last_undegraded":"2024-04-26T12:31:20.233368+0000","last_fullsized":"2024-04-26T12:31:20.233368+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:31:20.233200+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:31:20.233200+0000","last_clean_scrub_stamp":"2024-04-26T12:31:20.233200+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:03.311719+0000","scrub_duration":0.0025721490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":175,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:15.309765+0000","last_change":"2024-04-26T12:32:15.309882+0000","last_active":"2024-04-26T12:32:15.309765+0000","last_peered":"2024-04-26T12:32:15.309765+0000","last_clean":"2024-04-26T12:32:15.309765+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:32:15.309765+0000","last_undegraded":"2024-04-26T12:32:15.309765+0000","last_fullsized":"2024-04-26T12:32:15.309765+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'55","last_scrub_stamp":"2024-04-26T12:32:15.309740+0000","last_deep_scrub":"58'55","last_deep_scrub_stamp":"2024-04-26T12:32:15.309740+0000","last_clean_scrub_stamp":"2024-04-26T12:32:15.309740+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:50.961431+0000","scrub_duration":0.0023593640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":505,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:44.982096+0000","last_change":"2024-04-26T12:32:44.982209+0000","last_active":"2024-04-26T12:32:44.982096+0000","last_peered":"2024-04-26T12:32:44.982096+0000","last_clean":"2024-04-26T12:32:44.982096+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:32:44.982096+0000","last_undegraded":"2024-04-26T12:32:44.982096+0000","last_fullsized":"2024-04-26T12:32:44.982096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'363","last_scrub_stamp":"2024-04-26T12:32:44.982071+0000","last_deep_scrub":"60'363","last_deep_scrub_stamp":"2024-04-26T12:32:44.982071+0000","last_clean_scrub_stamp":"2024-04-26T12:32:44.982071+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:40.857857+0000","scrub_duration":0.0031791319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"85'484","reported_seq":602,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:46.379613+0000","last_change":"2024-04-26T12:32:46.379741+0000","last_active":"2024-04-26T12:32:46.379613+0000","last_peered":"2024-04-26T12:32:46.379613+0000","last_clean":"2024-04-26T12:32:46.379613+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:32:46.379613+0000","last_undegraded":"2024-04-26T12:32:46.379613+0000","last_fullsized":"2024-04-26T12:32:46.379613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'484","last_scrub_stamp":"2024-04-26T12:32:46.379587+0000","last_deep_scrub":"85'484","last_deep_scrub_stamp":"2024-04-26T12:32:46.379587+0000","last_clean_scrub_stamp":"2024-04-26T12:32:46.379587+0000","objects_scrubbed":1,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:27.037656+0000","scrub_duration":0.01793469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":511,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.890716+0000","last_change":"2024-04-26T12:31:31.890716+0000","last_active":"2024-04-26T12:31:31.890716+0000","last_peered":"2024-04-26T12:31:31.890716+0000","last_clean":"2024-04-26T12:31:31.890716+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:31:31.890716+0000","last_undegraded":"2024-04-26T12:31:31.890716+0000","last_fullsized":"2024-04-26T12:31:31.890716+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'402","last_scrub_stamp":"2024-04-26T12:31:31.890586+0000","last_deep_scrub":"60'402","last_deep_scrub_stamp":"2024-04-26T12:31:31.890586+0000","last_clean_scrub_stamp":"2024-04-26T12:31:31.890586+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:10.281743+0000","scrub_duration":0.0021503030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:23.972717+0000","last_change":"2024-04-26T12:31:23.972717+0000","last_active":"2024-04-26T12:31:23.972717+0000","last_peered":"2024-04-26T12:31:23.972717+0000","last_clean":"2024-04-26T12:31:23.972717+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:31:23.972717+0000","last_undegraded":"2024-04-26T12:31:23.972717+0000","last_fullsized":"2024-04-26T12:31:23.972717+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:23.972571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:23.972571+0000","last_clean_scrub_stamp":"2024-04-26T12:31:23.972571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:28.883121+0000","scrub_duration":0.0019705149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"85'455","reported_seq":494,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:48.063866+0000","last_change":"2024-04-26T12:31:48.063866+0000","last_active":"2024-04-26T12:31:48.063866+0000","last_peered":"2024-04-26T12:31:48.063866+0000","last_clean":"2024-04-26T12:31:48.063866+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:31:48.063866+0000","last_undegraded":"2024-04-26T12:31:48.063866+0000","last_fullsized":"2024-04-26T12:31:48.063866+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'455","last_scrub_stamp":"2024-04-26T12:31:48.063706+0000","last_deep_scrub":"85'455","last_deep_scrub_stamp":"2024-04-26T12:31:48.063706+0000","last_clean_scrub_stamp":"2024-04-26T12:31:48.063706+0000","objects_scrubbed":1,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:01.639711+0000","scrub_duration":0.015622934999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":486,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.354748+0000","last_change":"2024-04-26T12:32:48.354748+0000","last_active":"2024-04-26T12:32:48.354748+0000","last_peered":"2024-04-26T12:32:48.354748+0000","last_clean":"2024-04-26T12:32:48.354748+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:32:48.354748+0000","last_undegraded":"2024-04-26T12:32:48.354748+0000","last_fullsized":"2024-04-26T12:32:48.354748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'369","last_scrub_stamp":"2024-04-26T12:32:48.354608+0000","last_deep_scrub":"60'369","last_deep_scrub_stamp":"2024-04-26T12:32:48.354608+0000","last_clean_scrub_stamp":"2024-04-26T12:32:48.354608+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:11.799788+0000","scrub_duration":0.0028242369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:21.978811+0000","last_change":"2024-04-26T12:32:21.978811+0000","last_active":"2024-04-26T12:32:21.978811+0000","last_peered":"2024-04-26T12:32:21.978811+0000","last_clean":"2024-04-26T12:32:21.978811+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:32:21.978811+0000","last_undegraded":"2024-04-26T12:32:21.978811+0000","last_fullsized":"2024-04-26T12:32:21.978811+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:21.978665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:21.978665+0000","last_clean_scrub_stamp":"2024-04-26T12:32:21.978665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:43.330392+0000","scrub_duration":0.001858333,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:07.025571+0000","last_change":"2024-04-26T12:33:07.025571+0000","last_active":"2024-04-26T12:33:07.025571+0000","last_peered":"2024-04-26T12:33:07.025571+0000","last_clean":"2024-04-26T12:33:07.025571+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:33:07.025571+0000","last_undegraded":"2024-04-26T12:33:07.025571+0000","last_fullsized":"2024-04-26T12:33:07.025571+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'70","last_scrub_stamp":"2024-04-26T12:33:07.025430+0000","last_deep_scrub":"58'70","last_deep_scrub_stamp":"2024-04-26T12:33:07.025430+0000","last_clean_scrub_stamp":"2024-04-26T12:33:07.025430+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:01.297847+0000","scrub_duration":0.0017168769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":512,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:55.133138+0000","last_change":"2024-04-26T12:31:55.133138+0000","last_active":"2024-04-26T12:31:55.133138+0000","last_peered":"2024-04-26T12:31:55.133138+0000","last_clean":"2024-04-26T12:31:55.133138+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:31:55.133138+0000","last_undegraded":"2024-04-26T12:31:55.133138+0000","last_fullsized":"2024-04-26T12:31:55.133138+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'404","last_scrub_stamp":"2024-04-26T12:31:55.132989+0000","last_deep_scrub":"60'404","last_deep_scrub_stamp":"2024-04-26T12:31:55.132989+0000","last_clean_scrub_stamp":"2024-04-26T12:31:55.132989+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:09.806981+0000","scrub_duration":0.0022071650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:15.991158+0000","last_change":"2024-04-26T12:32:15.991158+0000","last_active":"2024-04-26T12:32:15.991158+0000","last_peered":"2024-04-26T12:32:15.991158+0000","last_clean":"2024-04-26T12:32:15.991158+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:32:15.991158+0000","last_undegraded":"2024-04-26T12:32:15.991158+0000","last_fullsized":"2024-04-26T12:32:15.991158+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:15.991015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:15.991015+0000","last_clean_scrub_stamp":"2024-04-26T12:32:15.991015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:54.413627+0000","scrub_duration":0.0021248650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"85'318","reported_seq":413,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:14.328682+0000","last_change":"2024-04-26T12:32:14.328682+0000","last_active":"2024-04-26T12:32:14.328682+0000","last_peered":"2024-04-26T12:32:14.328682+0000","last_clean":"2024-04-26T12:32:14.328682+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:32:14.328682+0000","last_undegraded":"2024-04-26T12:32:14.328682+0000","last_fullsized":"2024-04-26T12:32:14.328682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'318","last_scrub_stamp":"2024-04-26T12:32:14.328453+0000","last_deep_scrub":"85'318","last_deep_scrub_stamp":"2024-04-26T12:32:14.328453+0000","last_clean_scrub_stamp":"2024-04-26T12:32:14.328453+0000","objects_scrubbed":2,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:16.594609+0000","scrub_duration":0.022414826999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":445,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:34.956674+0000","last_change":"2024-04-26T12:31:34.956674+0000","last_active":"2024-04-26T12:31:34.956674+0000","last_peered":"2024-04-26T12:31:34.956674+0000","last_clean":"2024-04-26T12:31:34.956674+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:31:34.956674+0000","last_undegraded":"2024-04-26T12:31:34.956674+0000","last_fullsized":"2024-04-26T12:31:34.956674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'339","last_scrub_stamp":"2024-04-26T12:31:34.956499+0000","last_deep_scrub":"60'339","last_deep_scrub_stamp":"2024-04-26T12:31:34.956499+0000","last_clean_scrub_stamp":"2024-04-26T12:31:34.956499+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:59.720417+0000","scrub_duration":0.0021999369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:32.328853+0000","last_change":"2024-04-26T12:31:32.328853+0000","last_active":"2024-04-26T12:31:32.328853+0000","last_peered":"2024-04-26T12:31:32.328853+0000","last_clean":"2024-04-26T12:31:32.328853+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:31:32.328853+0000","last_undegraded":"2024-04-26T12:31:32.328853+0000","last_fullsized":"2024-04-26T12:31:32.328853+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:32.328709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:32.328709+0000","last_clean_scrub_stamp":"2024-04-26T12:31:32.328709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:20.941744+0000","scrub_duration":0.0019425169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"85'159","reported_seq":278,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:53.976254+0000","last_change":"2024-04-26T12:32:53.976363+0000","last_active":"2024-04-26T12:32:53.976254+0000","last_peered":"2024-04-26T12:32:53.976254+0000","last_clean":"2024-04-26T12:32:53.976254+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:32:53.976254+0000","last_undegraded":"2024-04-26T12:32:53.976254+0000","last_fullsized":"2024-04-26T12:32:53.976254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'159","last_scrub_stamp":"2024-04-26T12:32:53.976229+0000","last_deep_scrub":"85'159","last_deep_scrub_stamp":"2024-04-26T12:32:53.976229+0000","last_clean_scrub_stamp":"2024-04-26T12:32:53.976229+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:18.300219+0000","scrub_duration":0.0046407640000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"85'530","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:13.979318+0000","last_change":"2024-04-26T12:32:13.979318+0000","last_active":"2024-04-26T12:32:13.979318+0000","last_peered":"2024-04-26T12:32:13.979318+0000","last_clean":"2024-04-26T12:32:13.979318+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:32:13.979318+0000","last_undegraded":"2024-04-26T12:32:13.979318+0000","last_fullsized":"2024-04-26T12:32:13.979318+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'530","last_scrub_stamp":"2024-04-26T12:32:13.979200+0000","last_deep_scrub":"85'530","last_deep_scrub_stamp":"2024-04-26T12:32:13.979200+0000","last_clean_scrub_stamp":"2024-04-26T12:32:13.979200+0000","objects_scrubbed":2,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:32.615284+0000","scrub_duration":0.026609192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":578,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.980975+0000","last_change":"2024-04-26T12:32:43.980975+0000","last_active":"2024-04-26T12:32:43.980975+0000","last_peered":"2024-04-26T12:32:43.980975+0000","last_clean":"2024-04-26T12:32:43.980975+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:32:43.980975+0000","last_undegraded":"2024-04-26T12:32:43.980975+0000","last_fullsized":"2024-04-26T12:32:43.980975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'436","last_scrub_stamp":"2024-04-26T12:32:43.980841+0000","last_deep_scrub":"60'436","last_deep_scrub_stamp":"2024-04-26T12:32:43.980841+0000","last_clean_scrub_stamp":"2024-04-26T12:32:43.980841+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:58.984555+0000","scrub_duration":0.002707508,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:29.947802+0000","last_change":"2024-04-26T12:32:29.947802+0000","last_active":"2024-04-26T12:32:29.947802+0000","last_peered":"2024-04-26T12:32:29.947802+0000","last_clean":"2024-04-26T12:32:29.947802+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:32:29.947802+0000","last_undegraded":"2024-04-26T12:32:29.947802+0000","last_fullsized":"2024-04-26T12:32:29.947802+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:29.947653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:29.947653+0000","last_clean_scrub_stamp":"2024-04-26T12:32:29.947653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:09.849742+0000","scrub_duration":0.0021636390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"85'106","reported_seq":236,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:24.979101+0000","last_change":"2024-04-26T12:31:24.979101+0000","last_active":"2024-04-26T12:31:24.979101+0000","last_peered":"2024-04-26T12:31:24.979101+0000","last_clean":"2024-04-26T12:31:24.979101+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:31:24.979101+0000","last_undegraded":"2024-04-26T12:31:24.979101+0000","last_fullsized":"2024-04-26T12:31:24.979101+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'106","last_scrub_stamp":"2024-04-26T12:31:24.978960+0000","last_deep_scrub":"85'106","last_deep_scrub_stamp":"2024-04-26T12:31:24.978960+0000","last_clean_scrub_stamp":"2024-04-26T12:31:24.978960+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:36.841285+0000","scrub_duration":0.0061135809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":980,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:59.363426+0000","last_change":"2024-04-26T12:31:59.363532+0000","last_active":"2024-04-26T12:31:59.363426+0000","last_peered":"2024-04-26T12:31:59.363426+0000","last_clean":"2024-04-26T12:31:59.363426+0000","last_became_active":"2024-04-26T12:30:57.077779+0000","last_became_peered":"2024-04-26T12:30:57.077779+0000","last_unstale":"2024-04-26T12:31:59.363426+0000","last_undegraded":"2024-04-26T12:31:59.363426+0000","last_fullsized":"2024-04-26T12:31:59.363426+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'438","last_scrub_stamp":"2024-04-26T12:31:59.363398+0000","last_deep_scrub":"60'438","last_deep_scrub_stamp":"2024-04-26T12:31:59.363398+0000","last_clean_scrub_stamp":"2024-04-26T12:31:59.363398+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:03.749621+0000","scrub_duration":0.0022297010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:13.325002+0000","last_change":"2024-04-26T12:32:13.325002+0000","last_active":"2024-04-26T12:32:13.325002+0000","last_peered":"2024-04-26T12:32:13.325002+0000","last_clean":"2024-04-26T12:32:13.325002+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:32:13.325002+0000","last_undegraded":"2024-04-26T12:32:13.325002+0000","last_fullsized":"2024-04-26T12:32:13.325002+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:13.324871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:13.324871+0000","last_clean_scrub_stamp":"2024-04-26T12:32:13.324871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.136071+0000","scrub_duration":0.001814179,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:39.992792+0000","last_change":"2024-04-26T12:31:39.992792+0000","last_active":"2024-04-26T12:31:39.992792+0000","last_peered":"2024-04-26T12:31:39.992792+0000","last_clean":"2024-04-26T12:31:39.992792+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:31:39.992792+0000","last_undegraded":"2024-04-26T12:31:39.992792+0000","last_fullsized":"2024-04-26T12:31:39.992792+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'59","last_scrub_stamp":"2024-04-26T12:31:39.992655+0000","last_deep_scrub":"58'59","last_deep_scrub_stamp":"2024-04-26T12:31:39.992655+0000","last_clean_scrub_stamp":"2024-04-26T12:31:39.992655+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:05.570619+0000","scrub_duration":0.001782435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":533,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:45.215071+0000","last_change":"2024-04-26T12:31:45.215071+0000","last_active":"2024-04-26T12:31:45.215071+0000","last_peered":"2024-04-26T12:31:45.215071+0000","last_clean":"2024-04-26T12:31:45.215071+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:31:45.215071+0000","last_undegraded":"2024-04-26T12:31:45.215071+0000","last_fullsized":"2024-04-26T12:31:45.215071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'418","last_scrub_stamp":"2024-04-26T12:31:45.214875+0000","last_deep_scrub":"60'418","last_deep_scrub_stamp":"2024-04-26T12:31:45.214875+0000","last_clean_scrub_stamp":"2024-04-26T12:31:45.214875+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:16.419048+0000","scrub_duration":0.0026123359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'63","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:25.111634+0000","last_change":"2024-04-26T12:32:25.111634+0000","last_active":"2024-04-26T12:32:25.111634+0000","last_peered":"2024-04-26T12:32:25.111634+0000","last_clean":"2024-04-26T12:32:25.111634+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:32:25.111634+0000","last_undegraded":"2024-04-26T12:32:25.111634+0000","last_fullsized":"2024-04-26T12:32:25.111634+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'63","last_scrub_stamp":"2024-04-26T12:32:25.111502+0000","last_deep_scrub":"85'63","last_deep_scrub_stamp":"2024-04-26T12:32:25.111502+0000","last_clean_scrub_stamp":"2024-04-26T12:32:25.111502+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:19.495601+0000","scrub_duration":0.003363904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.965364+0000","last_change":"2024-04-26T12:31:26.965364+0000","last_active":"2024-04-26T12:31:26.965364+0000","last_peered":"2024-04-26T12:31:26.965364+0000","last_clean":"2024-04-26T12:31:26.965364+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:31:26.965364+0000","last_undegraded":"2024-04-26T12:31:26.965364+0000","last_fullsized":"2024-04-26T12:31:26.965364+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:26.965245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:26.965245+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.965245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:27.319599+0000","scrub_duration":0.0017909270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":513,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.983743+0000","last_change":"2024-04-26T12:32:43.983883+0000","last_active":"2024-04-26T12:32:43.983743+0000","last_peered":"2024-04-26T12:32:43.983743+0000","last_clean":"2024-04-26T12:32:43.983743+0000","last_became_active":"2024-04-26T12:31:00.079504+0000","last_became_peered":"2024-04-26T12:31:00.079504+0000","last_unstale":"2024-04-26T12:32:43.983743+0000","last_undegraded":"2024-04-26T12:32:43.983743+0000","last_fullsized":"2024-04-26T12:32:43.983743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'416","last_scrub_stamp":"2024-04-26T12:32:43.983712+0000","last_deep_scrub":"60'416","last_deep_scrub_stamp":"2024-04-26T12:32:43.983712+0000","last_clean_scrub_stamp":"2024-04-26T12:32:43.983712+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:38.828275+0000","scrub_duration":0.0020127650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:35.265446+0000","last_change":"2024-04-26T12:31:35.265446+0000","last_active":"2024-04-26T12:31:35.265446+0000","last_peered":"2024-04-26T12:31:35.265446+0000","last_clean":"2024-04-26T12:31:35.265446+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:31:35.265446+0000","last_undegraded":"2024-04-26T12:31:35.265446+0000","last_fullsized":"2024-04-26T12:31:35.265446+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:35.265322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:35.265322+0000","last_clean_scrub_stamp":"2024-04-26T12:31:35.265322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:21.847498+0000","scrub_duration":0.001727751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"85'83","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.000699+0000","last_change":"2024-04-26T12:31:14.000699+0000","last_active":"2024-04-26T12:31:14.000699+0000","last_peered":"2024-04-26T12:31:14.000699+0000","last_clean":"2024-04-26T12:31:14.000699+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:31:14.000699+0000","last_undegraded":"2024-04-26T12:31:14.000699+0000","last_fullsized":"2024-04-26T12:31:14.000699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'83","last_scrub_stamp":"2024-04-26T12:31:14.000521+0000","last_deep_scrub":"85'83","last_deep_scrub_stamp":"2024-04-26T12:31:14.000521+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.000521+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:11.290115+0000","scrub_duration":0.0069472290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":619,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.173213+0000","last_change":"2024-04-26T12:31:47.173213+0000","last_active":"2024-04-26T12:31:47.173213+0000","last_peered":"2024-04-26T12:31:47.173213+0000","last_clean":"2024-04-26T12:31:47.173213+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:31:47.173213+0000","last_undegraded":"2024-04-26T12:31:47.173213+0000","last_fullsized":"2024-04-26T12:31:47.173213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-04-26T12:31:47.173047+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-04-26T12:31:47.173047+0000","last_clean_scrub_stamp":"2024-04-26T12:31:47.173047+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:10.331132+0000","scrub_duration":0.002517961,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"85'63","reported_seq":187,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.295559+0000","last_change":"2024-04-26T12:32:33.295684+0000","last_active":"2024-04-26T12:32:33.295559+0000","last_peered":"2024-04-26T12:32:33.295559+0000","last_clean":"2024-04-26T12:32:33.295559+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:32:33.295559+0000","last_undegraded":"2024-04-26T12:32:33.295559+0000","last_fullsized":"2024-04-26T12:32:33.295559+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'63","last_scrub_stamp":"2024-04-26T12:32:33.295525+0000","last_deep_scrub":"85'63","last_deep_scrub_stamp":"2024-04-26T12:32:33.295525+0000","last_clean_scrub_stamp":"2024-04-26T12:32:33.295525+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:28.721614+0000","scrub_duration":0.011210543999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":868,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:28.143238+0000","last_change":"2024-04-26T12:31:28.143238+0000","last_active":"2024-04-26T12:31:28.143238+0000","last_peered":"2024-04-26T12:31:28.143238+0000","last_clean":"2024-04-26T12:31:28.143238+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:31:28.143238+0000","last_undegraded":"2024-04-26T12:31:28.143238+0000","last_fullsized":"2024-04-26T12:31:28.143238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:31:28.143070+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:31:28.143070+0000","last_clean_scrub_stamp":"2024-04-26T12:31:28.143070+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:55.111541+0000","scrub_duration":0.0024435799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"85'310","reported_seq":325,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:15.172232+0000","last_change":"2024-04-26T12:33:15.172342+0000","last_active":"2024-04-26T12:33:15.172232+0000","last_peered":"2024-04-26T12:33:15.172232+0000","last_clean":"2024-04-26T12:33:15.172232+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:33:15.172232+0000","last_undegraded":"2024-04-26T12:33:15.172232+0000","last_fullsized":"2024-04-26T12:33:15.172232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'310","last_scrub_stamp":"2024-04-26T12:33:15.172206+0000","last_deep_scrub":"85'310","last_deep_scrub_stamp":"2024-04-26T12:33:15.172206+0000","last_clean_scrub_stamp":"2024-04-26T12:33:15.172206+0000","objects_scrubbed":2,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:57.763312+0000","scrub_duration":0.017317318000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":811,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:58.101978+0000","last_change":"2024-04-26T12:31:58.102086+0000","last_active":"2024-04-26T12:31:58.101978+0000","last_peered":"2024-04-26T12:31:58.101978+0000","last_clean":"2024-04-26T12:31:58.101978+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:31:58.101978+0000","last_undegraded":"2024-04-26T12:31:58.101978+0000","last_fullsized":"2024-04-26T12:31:58.101978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'376","last_scrub_stamp":"2024-04-26T12:31:58.101950+0000","last_deep_scrub":"60'376","last_deep_scrub_stamp":"2024-04-26T12:31:58.101950+0000","last_clean_scrub_stamp":"2024-04-26T12:31:58.101950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:13.898836+0000","scrub_duration":0.0019261320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"85'318","reported_seq":412,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:58.388469+0000","last_change":"2024-04-26T12:31:58.388584+0000","last_active":"2024-04-26T12:31:58.388469+0000","last_peered":"2024-04-26T12:31:58.388469+0000","last_clean":"2024-04-26T12:31:58.388469+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:31:58.388469+0000","last_undegraded":"2024-04-26T12:31:58.388469+0000","last_fullsized":"2024-04-26T12:31:58.388469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'318","last_scrub_stamp":"2024-04-26T12:31:58.388443+0000","last_deep_scrub":"85'318","last_deep_scrub_stamp":"2024-04-26T12:31:58.388443+0000","last_clean_scrub_stamp":"2024-04-26T12:31:58.388443+0000","objects_scrubbed":4,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:31.773997+0000","scrub_duration":0.029898854999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":885,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:49.040500+0000","last_change":"2024-04-26T12:31:49.040500+0000","last_active":"2024-04-26T12:31:49.040500+0000","last_peered":"2024-04-26T12:31:49.040500+0000","last_clean":"2024-04-26T12:31:49.040500+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:31:49.040500+0000","last_undegraded":"2024-04-26T12:31:49.040500+0000","last_fullsized":"2024-04-26T12:31:49.040500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:31:49.040316+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:31:49.040316+0000","last_clean_scrub_stamp":"2024-04-26T12:31:49.040316+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:51.229337+0000","scrub_duration":0.0025244709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"85'77","reported_seq":60,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.984448+0000","last_change":"2024-04-26T12:31:14.984448+0000","last_active":"2024-04-26T12:31:14.984448+0000","last_peered":"2024-04-26T12:31:14.984448+0000","last_clean":"2024-04-26T12:31:14.984448+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:31:14.984448+0000","last_undegraded":"2024-04-26T12:31:14.984448+0000","last_fullsized":"2024-04-26T12:31:14.984448+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'77","last_scrub_stamp":"2024-04-26T12:31:14.984325+0000","last_deep_scrub":"85'77","last_deep_scrub_stamp":"2024-04-26T12:31:14.984325+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.984325+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:53.595109+0000","scrub_duration":0.010871390999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":555,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:33.279814+0000","last_change":"2024-04-26T12:31:33.279814+0000","last_active":"2024-04-26T12:31:33.279814+0000","last_peered":"2024-04-26T12:31:33.279814+0000","last_clean":"2024-04-26T12:31:33.279814+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:31:33.279814+0000","last_undegraded":"2024-04-26T12:31:33.279814+0000","last_fullsized":"2024-04-26T12:31:33.279814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'438","last_scrub_stamp":"2024-04-26T12:31:33.279688+0000","last_deep_scrub":"60'438","last_deep_scrub_stamp":"2024-04-26T12:31:33.279688+0000","last_clean_scrub_stamp":"2024-04-26T12:31:33.279688+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:47.222045+0000","scrub_duration":0.0024948520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"85'53","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:26.092908+0000","last_change":"2024-04-26T12:32:26.092908+0000","last_active":"2024-04-26T12:32:26.092908+0000","last_peered":"2024-04-26T12:32:26.092908+0000","last_clean":"2024-04-26T12:32:26.092908+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:32:26.092908+0000","last_undegraded":"2024-04-26T12:32:26.092908+0000","last_fullsized":"2024-04-26T12:32:26.092908+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'53","last_scrub_stamp":"2024-04-26T12:32:26.092771+0000","last_deep_scrub":"85'53","last_deep_scrub_stamp":"2024-04-26T12:32:26.092771+0000","last_clean_scrub_stamp":"2024-04-26T12:32:26.092771+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:02.205832+0000","scrub_duration":0.011348034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":980,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:18.220147+0000","last_change":"2024-04-26T12:31:18.220147+0000","last_active":"2024-04-26T12:31:18.220147+0000","last_peered":"2024-04-26T12:31:18.220147+0000","last_clean":"2024-04-26T12:31:18.220147+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:31:18.220147+0000","last_undegraded":"2024-04-26T12:31:18.220147+0000","last_fullsized":"2024-04-26T12:31:18.220147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'473","last_scrub_stamp":"2024-04-26T12:31:18.220009+0000","last_deep_scrub":"60'473","last_deep_scrub_stamp":"2024-04-26T12:31:18.220009+0000","last_clean_scrub_stamp":"2024-04-26T12:31:18.220009+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:07.523749+0000","scrub_duration":0.0022384369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":865,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.149838+0000","last_change":"2024-04-26T12:30:53.079050+0000","last_active":"2024-04-26T12:31:12.149838+0000","last_peered":"2024-04-26T12:31:12.149838+0000","last_clean":"2024-04-26T12:31:12.149838+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:31:12.149838+0000","last_undegraded":"2024-04-26T12:31:12.149838+0000","last_fullsized":"2024-04-26T12:31:12.149838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:26:52.819811+0000","last_clean_scrub_stamp":"2024-04-26T12:26:52.819811+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":541,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:40.993749+0000","last_change":"2024-04-26T12:31:40.993749+0000","last_active":"2024-04-26T12:31:40.993749+0000","last_peered":"2024-04-26T12:31:40.993749+0000","last_clean":"2024-04-26T12:31:40.993749+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:31:40.993749+0000","last_undegraded":"2024-04-26T12:31:40.993749+0000","last_fullsized":"2024-04-26T12:31:40.993749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'446","last_scrub_stamp":"2024-04-26T12:31:40.993603+0000","last_deep_scrub":"60'446","last_deep_scrub_stamp":"2024-04-26T12:31:40.993603+0000","last_clean_scrub_stamp":"2024-04-26T12:31:40.993603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:27.297067+0000","scrub_duration":0.0020716889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":642,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:59.321665+0000","last_change":"2024-04-26T12:32:59.321665+0000","last_active":"2024-04-26T12:32:59.321665+0000","last_peered":"2024-04-26T12:32:59.321665+0000","last_clean":"2024-04-26T12:32:59.321665+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:32:59.321665+0000","last_undegraded":"2024-04-26T12:32:59.321665+0000","last_fullsized":"2024-04-26T12:32:59.321665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'483","last_scrub_stamp":"2024-04-26T12:32:59.321521+0000","last_deep_scrub":"60'483","last_deep_scrub_stamp":"2024-04-26T12:32:59.321521+0000","last_clean_scrub_stamp":"2024-04-26T12:32:59.321521+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:32.246379+0000","scrub_duration":0.0025561960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":528,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:48.035660+0000","last_change":"2024-04-26T12:31:48.035660+0000","last_active":"2024-04-26T12:31:48.035660+0000","last_peered":"2024-04-26T12:31:48.035660+0000","last_clean":"2024-04-26T12:31:48.035660+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:31:48.035660+0000","last_undegraded":"2024-04-26T12:31:48.035660+0000","last_fullsized":"2024-04-26T12:31:48.035660+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'384","last_scrub_stamp":"2024-04-26T12:31:48.035480+0000","last_deep_scrub":"60'384","last_deep_scrub_stamp":"2024-04-26T12:31:48.035480+0000","last_clean_scrub_stamp":"2024-04-26T12:31:48.035480+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:18.919037+0000","scrub_duration":0.002218383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":524,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:40.177293+0000","last_change":"2024-04-26T12:31:40.177393+0000","last_active":"2024-04-26T12:31:40.177293+0000","last_peered":"2024-04-26T12:31:40.177293+0000","last_clean":"2024-04-26T12:31:40.177293+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:31:40.177293+0000","last_undegraded":"2024-04-26T12:31:40.177293+0000","last_fullsized":"2024-04-26T12:31:40.177293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'380","last_scrub_stamp":"2024-04-26T12:31:40.177270+0000","last_deep_scrub":"60'380","last_deep_scrub_stamp":"2024-04-26T12:31:40.177270+0000","last_clean_scrub_stamp":"2024-04-26T12:31:40.177270+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:45.516828+0000","scrub_duration":0.0024862170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79134720,"data_stored":256449018,"data_compressed":38844374,"data_compressed_allocated":48693248,"data_compressed_original":226074624,"omap_allocated":5343,"internal_metadata":0},"log_size":7561,"ondisk_log_size":7561,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738450,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130112,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94241728,"statfs":{"total":96636764160,"available":96503529472,"internally_reserved":0,"allocated":31711232,"data_stored":85785287,"data_compressed":12062822,"data_compressed_allocated":15765504,"data_compressed_original":70336512,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.30399999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.63,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.28000000000000003,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Apr 26 12:32:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.42299999999999999},"min":{"1min":0.35599999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.436,"15min":0.43099999999999999},"min":{"1min":0.372,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.47099999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131332,"kb_used_data":32188,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94240508,"statfs":{"total":96636764160,"available":96502280192,"internally_reserved":0,"allocated":32960512,"data_stored":91451171,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:32:42 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.44700000000000001},"min":{"1min":0.372,"5min":0.186,"15min":0.186},"max":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.47799999999999998,"15min":0.46999999999999997},"min":{"1min":0.39700000000000002,"5min":0.222,"15min":0.222},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.55000000000000004}]},{"osd":2,"last update":"Fri Apr 26 12:32:47 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.38,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.61499999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.46200000000000002,"15min":0.47199999999999998},"min":{"1min":0.34699999999999998,"5min":0.191,"15min":0.191},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.46400000000000002}]}]},{"osd":1,"up_from":64,"seq":274877906977,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62336,"kb_used_data":16760,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309504,"statfs":{"total":96636764160,"available":96572932096,"internally_reserved":0,"allocated":17162240,"data_stored":81548386,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.29699999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.58699999999999997,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.443,"15min":0.436},"min":{"1min":0.30499999999999999,"5min":0.224,"15min":0.224},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.499}]},{"osd":2,"last update":"Fri Apr 26 12:32:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44,"15min":0.42699999999999999},"min":{"1min":0.42699999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.61899999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.432},"min":{"1min":0.41299999999999998,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.443}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30789632,"data_stored":84809889,"data_compressed":12028675,"data_compressed_allocated":15720448,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:33:15.892 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:26:52.819811+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=26, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=31, tm_sec=10, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:33:15.892 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:33:35.892 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:33:36.252 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:33:36.254 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-04-26T12:33:36.264 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-04-26T12:33:35.397533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":128814877,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2936,"num_read_kb":1438629,"num_write":30412,"num_write_kb":4332960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6546,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34400,"ondisk_log_size":34400,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":323780,"kb_used_data":79916,"kb_used_omap":9,"kb_used_meta":243830,"kb_avail":282791740,"statfs":{"total":289910292480,"available":289578741760,"internally_reserved":0,"allocated":81833984,"data_stored":258784844,"data_compressed":38912668,"data_compressed_allocated":48783360,"data_compressed_original":227221504,"omap_allocated":10125,"internal_metadata":249682035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002800"},"pg_stats":[{"pgid":"4.3f","version":"60'414","reported_seq":914,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:18.003585+0000","last_change":"2024-04-26T12:31:18.003585+0000","last_active":"2024-04-26T12:31:18.003585+0000","last_peered":"2024-04-26T12:31:18.003585+0000","last_clean":"2024-04-26T12:31:18.003585+0000","last_became_active":"2024-04-26T12:30:54.079224+0000","last_became_peered":"2024-04-26T12:30:54.079224+0000","last_unstale":"2024-04-26T12:31:18.003585+0000","last_undegraded":"2024-04-26T12:31:18.003585+0000","last_fullsized":"2024-04-26T12:31:18.003585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:18.003445+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:18.003445+0000","last_clean_scrub_stamp":"2024-04-26T12:31:18.003445+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:47.444600+0000","scrub_duration":0.0019588980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":21007,"num_write":375,"num_write_kb":58764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"60'424","reported_seq":970,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:02.342325+0000","last_change":"2024-04-26T12:33:02.342325+0000","last_active":"2024-04-26T12:33:02.342325+0000","last_peered":"2024-04-26T12:33:02.342325+0000","last_clean":"2024-04-26T12:33:02.342325+0000","last_became_active":"2024-04-26T12:30:56.084642+0000","last_became_peered":"2024-04-26T12:30:56.084642+0000","last_unstale":"2024-04-26T12:33:02.342325+0000","last_undegraded":"2024-04-26T12:33:02.342325+0000","last_fullsized":"2024-04-26T12:33:02.342325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:33:02.342128+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:33:02.342128+0000","last_clean_scrub_stamp":"2024-04-26T12:33:02.342128+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:13.280168+0000","scrub_duration":0.002725824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32688,"num_write":400,"num_write_kb":84052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"60'381","reported_seq":508,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:12.142540+0000","last_change":"2024-04-26T12:33:12.142656+0000","last_active":"2024-04-26T12:33:12.142540+0000","last_peered":"2024-04-26T12:33:12.142540+0000","last_clean":"2024-04-26T12:33:12.142540+0000","last_became_active":"2024-04-26T12:30:48.086840+0000","last_became_peered":"2024-04-26T12:30:48.086840+0000","last_unstale":"2024-04-26T12:33:12.142540+0000","last_undegraded":"2024-04-26T12:33:12.142540+0000","last_fullsized":"2024-04-26T12:33:12.142540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:33:12.142515+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:33:12.142515+0000","last_clean_scrub_stamp":"2024-04-26T12:33:12.142515+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:42.932290+0000","scrub_duration":0.0027180809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":12910,"num_write":355,"num_write_kb":26887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"60'393","reported_seq":880,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:41.224731+0000","last_change":"2024-04-26T12:31:41.224731+0000","last_active":"2024-04-26T12:31:41.224731+0000","last_peered":"2024-04-26T12:31:41.224731+0000","last_clean":"2024-04-26T12:31:41.224731+0000","last_became_active":"2024-04-26T12:30:48.086176+0000","last_became_peered":"2024-04-26T12:30:48.086176+0000","last_unstale":"2024-04-26T12:31:41.224731+0000","last_undegraded":"2024-04-26T12:31:41.224731+0000","last_fullsized":"2024-04-26T12:31:41.224731+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:31:41.224537+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:31:41.224537+0000","last_clean_scrub_stamp":"2024-04-26T12:31:41.224537+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:31.770929+0000","scrub_duration":0.0021526079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23473,"num_write":362,"num_write_kb":92011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"60'430","reported_seq":952,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:44.166192+0000","last_change":"2024-04-26T12:31:44.166192+0000","last_active":"2024-04-26T12:31:44.166192+0000","last_peered":"2024-04-26T12:31:44.166192+0000","last_clean":"2024-04-26T12:31:44.166192+0000","last_became_active":"2024-04-26T12:30:48.088106+0000","last_became_peered":"2024-04-26T12:30:48.088106+0000","last_unstale":"2024-04-26T12:31:44.166192+0000","last_undegraded":"2024-04-26T12:31:44.166192+0000","last_fullsized":"2024-04-26T12:31:44.166192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'430","last_scrub_stamp":"2024-04-26T12:31:44.165994+0000","last_deep_scrub":"60'430","last_deep_scrub_stamp":"2024-04-26T12:31:44.165994+0000","last_clean_scrub_stamp":"2024-04-26T12:31:44.165994+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:15.166663+0000","scrub_duration":0.0026340479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20164,"num_write":396,"num_write_kb":88281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"60'399","reported_seq":490,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:15.202198+0000","last_change":"2024-04-26T12:31:15.202198+0000","last_active":"2024-04-26T12:31:15.202198+0000","last_peered":"2024-04-26T12:31:15.202198+0000","last_clean":"2024-04-26T12:31:15.202198+0000","last_became_active":"2024-04-26T12:30:48.089046+0000","last_became_peered":"2024-04-26T12:30:48.089046+0000","last_unstale":"2024-04-26T12:31:15.202198+0000","last_undegraded":"2024-04-26T12:31:15.202198+0000","last_fullsized":"2024-04-26T12:31:15.202198+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:31:15.202057+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:31:15.202057+0000","last_clean_scrub_stamp":"2024-04-26T12:31:15.202057+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:36.672446+0000","scrub_duration":0.002466312,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":12559,"num_write":379,"num_write_kb":66478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"60'457","reported_seq":1041,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:14.136714+0000","last_change":"2024-04-26T12:32:14.136872+0000","last_active":"2024-04-26T12:32:14.136714+0000","last_peered":"2024-04-26T12:32:14.136714+0000","last_clean":"2024-04-26T12:32:14.136714+0000","last_became_active":"2024-04-26T12:30:44.029153+0000","last_became_peered":"2024-04-26T12:30:44.029153+0000","last_unstale":"2024-04-26T12:32:14.136714+0000","last_undegraded":"2024-04-26T12:32:14.136714+0000","last_fullsized":"2024-04-26T12:32:14.136714+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'457","last_scrub_stamp":"2024-04-26T12:32:14.136690+0000","last_deep_scrub":"60'457","last_deep_scrub_stamp":"2024-04-26T12:32:14.136690+0000","last_clean_scrub_stamp":"2024-04-26T12:32:14.136690+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:05.085896+0000","scrub_duration":0.0024392419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":49433,"num_write":428,"num_write_kb":96577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"60'371","reported_seq":780,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:03.106311+0000","last_change":"2024-04-26T12:32:03.106311+0000","last_active":"2024-04-26T12:32:03.106311+0000","last_peered":"2024-04-26T12:32:03.106311+0000","last_clean":"2024-04-26T12:32:03.106311+0000","last_became_active":"2024-04-26T12:30:49.080558+0000","last_became_peered":"2024-04-26T12:30:49.080558+0000","last_unstale":"2024-04-26T12:32:03.106311+0000","last_undegraded":"2024-04-26T12:32:03.106311+0000","last_fullsized":"2024-04-26T12:32:03.106311+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'371","last_scrub_stamp":"2024-04-26T12:32:03.106125+0000","last_deep_scrub":"60'371","last_deep_scrub_stamp":"2024-04-26T12:32:03.106125+0000","last_clean_scrub_stamp":"2024-04-26T12:32:03.106125+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:10.173340+0000","scrub_duration":0.002253672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":10789,"num_write":334,"num_write_kb":39278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"60'417","reported_seq":511,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:44.946041+0000","last_change":"2024-04-26T12:31:44.946041+0000","last_active":"2024-04-26T12:31:44.946041+0000","last_peered":"2024-04-26T12:31:44.946041+0000","last_clean":"2024-04-26T12:31:44.946041+0000","last_became_active":"2024-04-26T12:30:56.076502+0000","last_became_peered":"2024-04-26T12:30:56.076502+0000","last_unstale":"2024-04-26T12:31:44.946041+0000","last_undegraded":"2024-04-26T12:31:44.946041+0000","last_fullsized":"2024-04-26T12:31:44.946041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'417","last_scrub_stamp":"2024-04-26T12:31:44.945906+0000","last_deep_scrub":"60'417","last_deep_scrub_stamp":"2024-04-26T12:31:44.945906+0000","last_clean_scrub_stamp":"2024-04-26T12:31:44.945906+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:35.883858+0000","scrub_duration":0.001923143,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13815,"num_write":383,"num_write_kb":66926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"60'420","reported_seq":924,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:56.314967+0000","last_change":"2024-04-26T12:32:56.315070+0000","last_active":"2024-04-26T12:32:56.314967+0000","last_peered":"2024-04-26T12:32:56.314967+0000","last_clean":"2024-04-26T12:32:56.314967+0000","last_became_active":"2024-04-26T12:30:56.085904+0000","last_became_peered":"2024-04-26T12:30:56.085904+0000","last_unstale":"2024-04-26T12:32:56.314967+0000","last_undegraded":"2024-04-26T12:32:56.314967+0000","last_fullsized":"2024-04-26T12:32:56.314967+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'420","last_scrub_stamp":"2024-04-26T12:32:56.314940+0000","last_deep_scrub":"60'420","last_deep_scrub_stamp":"2024-04-26T12:32:56.314940+0000","last_clean_scrub_stamp":"2024-04-26T12:32:56.314940+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:52.935078+0000","scrub_duration":0.0021464190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25366,"num_write":375,"num_write_kb":71762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"60'366","reported_seq":607,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.239557+0000","last_change":"2024-04-26T12:31:14.239557+0000","last_active":"2024-04-26T12:31:14.239557+0000","last_peered":"2024-04-26T12:31:14.239557+0000","last_clean":"2024-04-26T12:31:14.239557+0000","last_became_active":"2024-04-26T12:30:48.086234+0000","last_became_peered":"2024-04-26T12:30:48.086234+0000","last_unstale":"2024-04-26T12:31:14.239557+0000","last_undegraded":"2024-04-26T12:31:14.239557+0000","last_fullsized":"2024-04-26T12:31:14.239557+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'366","last_scrub_stamp":"2024-04-26T12:31:14.239429+0000","last_deep_scrub":"60'366","last_deep_scrub_stamp":"2024-04-26T12:31:14.239429+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.239429+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:48.735192+0000","scrub_duration":0.0022088089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4800,"num_write":346,"num_write_kb":25887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"60'360","reported_seq":525,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:04.314890+0000","last_change":"2024-04-26T12:33:04.315070+0000","last_active":"2024-04-26T12:33:04.314890+0000","last_peered":"2024-04-26T12:33:04.314890+0000","last_clean":"2024-04-26T12:33:04.314890+0000","last_became_active":"2024-04-26T12:26:53.259916+0000","last_became_peered":"2024-04-26T12:26:53.259916+0000","last_unstale":"2024-04-26T12:33:04.314890+0000","last_undegraded":"2024-04-26T12:33:04.314890+0000","last_fullsized":"2024-04-26T12:33:04.314890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'360","last_scrub_stamp":"2024-04-26T12:33:04.314848+0000","last_deep_scrub":"60'360","last_deep_scrub_stamp":"2024-04-26T12:33:04.314848+0000","last_clean_scrub_stamp":"2024-04-26T12:33:04.314848+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:17.513182+0000","scrub_duration":0.003258389,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":37857,"num_write":335,"num_write_kb":50997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"60'420","reported_seq":896,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:51.325991+0000","last_change":"2024-04-26T12:32:51.326108+0000","last_active":"2024-04-26T12:32:51.325991+0000","last_peered":"2024-04-26T12:32:51.325991+0000","last_clean":"2024-04-26T12:32:51.325991+0000","last_became_active":"2024-04-26T12:30:49.082740+0000","last_became_peered":"2024-04-26T12:30:49.082740+0000","last_unstale":"2024-04-26T12:32:51.325991+0000","last_undegraded":"2024-04-26T12:32:51.325991+0000","last_fullsized":"2024-04-26T12:32:51.325991+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'420","last_scrub_stamp":"2024-04-26T12:32:51.325964+0000","last_deep_scrub":"60'420","last_deep_scrub_stamp":"2024-04-26T12:32:51.325964+0000","last_clean_scrub_stamp":"2024-04-26T12:32:51.325964+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:21.753699+0000","scrub_duration":0.001947617,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5577,"num_write":385,"num_write_kb":96353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"60'418","reported_seq":533,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:41.944310+0000","last_change":"2024-04-26T12:32:41.944416+0000","last_active":"2024-04-26T12:32:41.944310+0000","last_peered":"2024-04-26T12:32:41.944310+0000","last_clean":"2024-04-26T12:32:41.944310+0000","last_became_active":"2024-04-26T12:26:53.258493+0000","last_became_peered":"2024-04-26T12:26:53.258493+0000","last_unstale":"2024-04-26T12:32:41.944310+0000","last_undegraded":"2024-04-26T12:32:41.944310+0000","last_fullsized":"2024-04-26T12:32:41.944310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'418","last_scrub_stamp":"2024-04-26T12:32:41.944281+0000","last_deep_scrub":"60'418","last_deep_scrub_stamp":"2024-04-26T12:32:41.944281+0000","last_clean_scrub_stamp":"2024-04-26T12:32:41.944281+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:20.201209+0000","scrub_duration":0.0033717819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24664,"num_write":388,"num_write_kb":75737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"60'429","reported_seq":553,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:10.151151+0000","last_change":"2024-04-26T12:32:10.151151+0000","last_active":"2024-04-26T12:32:10.151151+0000","last_peered":"2024-04-26T12:32:10.151151+0000","last_clean":"2024-04-26T12:32:10.151151+0000","last_became_active":"2024-04-26T12:30:47.077414+0000","last_became_peered":"2024-04-26T12:30:47.077414+0000","last_unstale":"2024-04-26T12:32:10.151151+0000","last_undegraded":"2024-04-26T12:32:10.151151+0000","last_fullsized":"2024-04-26T12:32:10.151151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'429","last_scrub_stamp":"2024-04-26T12:32:10.151020+0000","last_deep_scrub":"60'429","last_deep_scrub_stamp":"2024-04-26T12:32:10.151020+0000","last_clean_scrub_stamp":"2024-04-26T12:32:10.151020+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:54.533321+0000","scrub_duration":0.0024815969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31989,"num_write":390,"num_write_kb":88227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"60'452","reported_seq":939,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:13.092103+0000","last_change":"2024-04-26T12:32:13.092103+0000","last_active":"2024-04-26T12:32:13.092103+0000","last_peered":"2024-04-26T12:32:13.092103+0000","last_clean":"2024-04-26T12:32:13.092103+0000","last_became_active":"2024-04-26T12:30:50.085170+0000","last_became_peered":"2024-04-26T12:30:50.085170+0000","last_unstale":"2024-04-26T12:32:13.092103+0000","last_undegraded":"2024-04-26T12:32:13.092103+0000","last_fullsized":"2024-04-26T12:32:13.092103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'452","last_scrub_stamp":"2024-04-26T12:32:13.091905+0000","last_deep_scrub":"60'452","last_deep_scrub_stamp":"2024-04-26T12:32:13.091905+0000","last_clean_scrub_stamp":"2024-04-26T12:32:13.091905+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:11.459487+0000","scrub_duration":0.002399418,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18358,"num_write":421,"num_write_kb":87653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"60'415","reported_seq":506,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.966807+0000","last_change":"2024-04-26T12:31:36.966807+0000","last_active":"2024-04-26T12:31:36.966807+0000","last_peered":"2024-04-26T12:31:36.966807+0000","last_clean":"2024-04-26T12:31:36.966807+0000","last_became_active":"2024-04-26T12:30:55.087362+0000","last_became_peered":"2024-04-26T12:30:55.087362+0000","last_unstale":"2024-04-26T12:31:36.966807+0000","last_undegraded":"2024-04-26T12:31:36.966807+0000","last_fullsized":"2024-04-26T12:31:36.966807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-04-26T12:31:36.966676+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-04-26T12:31:36.966676+0000","last_clean_scrub_stamp":"2024-04-26T12:31:36.966676+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:18.037732+0000","scrub_duration":0.0019413729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10016,"num_write":375,"num_write_kb":37949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"60'414","reported_seq":925,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:36.169611+0000","last_change":"2024-04-26T12:31:36.170108+0000","last_active":"2024-04-26T12:31:36.169611+0000","last_peered":"2024-04-26T12:31:36.169611+0000","last_clean":"2024-04-26T12:31:36.169611+0000","last_became_active":"2024-04-26T12:30:57.083026+0000","last_became_peered":"2024-04-26T12:30:57.083026+0000","last_unstale":"2024-04-26T12:31:36.169611+0000","last_undegraded":"2024-04-26T12:31:36.169611+0000","last_fullsized":"2024-04-26T12:31:36.169611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:36.169585+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:36.169585+0000","last_clean_scrub_stamp":"2024-04-26T12:31:36.169585+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:58:42.604764+0000","scrub_duration":0.0025888259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":23392,"num_write":376,"num_write_kb":62686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"60'434","reported_seq":539,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:37.935658+0000","last_change":"2024-04-26T12:31:37.935658+0000","last_active":"2024-04-26T12:31:37.935658+0000","last_peered":"2024-04-26T12:31:37.935658+0000","last_clean":"2024-04-26T12:31:37.935658+0000","last_became_active":"2024-04-26T12:30:51.074947+0000","last_became_peered":"2024-04-26T12:30:51.074947+0000","last_unstale":"2024-04-26T12:31:37.935658+0000","last_undegraded":"2024-04-26T12:31:37.935658+0000","last_fullsized":"2024-04-26T12:31:37.935658+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'434","last_scrub_stamp":"2024-04-26T12:31:37.935496+0000","last_deep_scrub":"60'434","last_deep_scrub_stamp":"2024-04-26T12:31:37.935496+0000","last_clean_scrub_stamp":"2024-04-26T12:31:37.935496+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:23.917082+0000","scrub_duration":0.0023281170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13489,"num_write":389,"num_write_kb":51295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"60'478","reported_seq":1083,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:52.995900+0000","last_change":"2024-04-26T12:32:52.996009+0000","last_active":"2024-04-26T12:32:52.995900+0000","last_peered":"2024-04-26T12:32:52.995900+0000","last_clean":"2024-04-26T12:32:52.995900+0000","last_became_active":"2024-04-26T12:30:45.022654+0000","last_became_peered":"2024-04-26T12:30:45.022654+0000","last_unstale":"2024-04-26T12:32:52.995900+0000","last_undegraded":"2024-04-26T12:32:52.995900+0000","last_fullsized":"2024-04-26T12:32:52.995900+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'478","last_scrub_stamp":"2024-04-26T12:32:52.995859+0000","last_deep_scrub":"60'478","last_deep_scrub_stamp":"2024-04-26T12:32:52.995859+0000","last_clean_scrub_stamp":"2024-04-26T12:32:52.995859+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:59.131912+0000","scrub_duration":0.002097369,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":56014,"num_write":447,"num_write_kb":105473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"60'426","reported_seq":965,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:12.130632+0000","last_change":"2024-04-26T12:32:12.130753+0000","last_active":"2024-04-26T12:32:12.130632+0000","last_peered":"2024-04-26T12:32:12.130632+0000","last_clean":"2024-04-26T12:32:12.130632+0000","last_became_active":"2024-04-26T12:30:46.079700+0000","last_became_peered":"2024-04-26T12:30:46.079700+0000","last_unstale":"2024-04-26T12:32:12.130632+0000","last_undegraded":"2024-04-26T12:32:12.130632+0000","last_fullsized":"2024-04-26T12:32:12.130632+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'426","last_scrub_stamp":"2024-04-26T12:32:12.130588+0000","last_deep_scrub":"60'426","last_deep_scrub_stamp":"2024-04-26T12:32:12.130588+0000","last_clean_scrub_stamp":"2024-04-26T12:32:12.130588+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:08.462918+0000","scrub_duration":0.0024608970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38346,"num_write":388,"num_write_kb":84302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"60'448","reported_seq":593,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:23.051416+0000","last_change":"2024-04-26T12:31:23.051416+0000","last_active":"2024-04-26T12:31:23.051416+0000","last_peered":"2024-04-26T12:31:23.051416+0000","last_clean":"2024-04-26T12:31:23.051416+0000","last_became_active":"2024-04-26T12:26:53.260184+0000","last_became_peered":"2024-04-26T12:26:53.260184+0000","last_unstale":"2024-04-26T12:31:23.051416+0000","last_undegraded":"2024-04-26T12:31:23.051416+0000","last_fullsized":"2024-04-26T12:31:23.051416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'448","last_scrub_stamp":"2024-04-26T12:31:23.051248+0000","last_deep_scrub":"60'448","last_deep_scrub_stamp":"2024-04-26T12:31:23.051248+0000","last_clean_scrub_stamp":"2024-04-26T12:31:23.051248+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:26.481350+0000","scrub_duration":0.0028000099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24875,"num_write":410,"num_write_kb":55506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"60'415","reported_seq":508,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:46.004411+0000","last_change":"2024-04-26T12:32:46.004411+0000","last_active":"2024-04-26T12:32:46.004411+0000","last_peered":"2024-04-26T12:32:46.004411+0000","last_clean":"2024-04-26T12:32:46.004411+0000","last_became_active":"2024-04-26T12:31:00.079766+0000","last_became_peered":"2024-04-26T12:31:00.079766+0000","last_unstale":"2024-04-26T12:32:46.004411+0000","last_undegraded":"2024-04-26T12:32:46.004411+0000","last_fullsized":"2024-04-26T12:32:46.004411+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-04-26T12:32:46.004284+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-04-26T12:32:46.004284+0000","last_clean_scrub_stamp":"2024-04-26T12:32:46.004284+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:44.748451+0000","scrub_duration":0.0021761100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":17765,"num_write":387,"num_write_kb":80260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"60'446","reported_seq":1031,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:38.162058+0000","last_change":"2024-04-26T12:31:38.162058+0000","last_active":"2024-04-26T12:31:38.162058+0000","last_peered":"2024-04-26T12:31:38.162058+0000","last_clean":"2024-04-26T12:31:38.162058+0000","last_became_active":"2024-04-26T12:30:58.078211+0000","last_became_peered":"2024-04-26T12:30:58.078211+0000","last_unstale":"2024-04-26T12:31:38.162058+0000","last_undegraded":"2024-04-26T12:31:38.162058+0000","last_fullsized":"2024-04-26T12:31:38.162058+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'446","last_scrub_stamp":"2024-04-26T12:31:38.161525+0000","last_deep_scrub":"60'446","last_deep_scrub_stamp":"2024-04-26T12:31:38.161525+0000","last_clean_scrub_stamp":"2024-04-26T12:31:38.161525+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:54.390254+0000","scrub_duration":0.002528092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":41275,"num_write":418,"num_write_kb":67659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"60'431","reported_seq":562,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:50.233922+0000","last_change":"2024-04-26T12:31:50.233922+0000","last_active":"2024-04-26T12:31:50.233922+0000","last_peered":"2024-04-26T12:31:50.233922+0000","last_clean":"2024-04-26T12:31:50.233922+0000","last_became_active":"2024-04-26T12:26:53.265067+0000","last_became_peered":"2024-04-26T12:26:53.265067+0000","last_unstale":"2024-04-26T12:31:50.233922+0000","last_undegraded":"2024-04-26T12:31:50.233922+0000","last_fullsized":"2024-04-26T12:31:50.233922+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'431","last_scrub_stamp":"2024-04-26T12:31:50.233783+0000","last_deep_scrub":"60'431","last_deep_scrub_stamp":"2024-04-26T12:31:50.233783+0000","last_clean_scrub_stamp":"2024-04-26T12:31:50.233783+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:54.618065+0000","scrub_duration":0.0025007240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":13252,"num_write":407,"num_write_kb":29887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"60'467","reported_seq":598,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.010394+0000","last_change":"2024-04-26T12:31:47.010394+0000","last_active":"2024-04-26T12:31:47.010394+0000","last_peered":"2024-04-26T12:31:47.010394+0000","last_clean":"2024-04-26T12:31:47.010394+0000","last_became_active":"2024-04-26T12:30:46.084472+0000","last_became_peered":"2024-04-26T12:30:46.084472+0000","last_unstale":"2024-04-26T12:31:47.010394+0000","last_undegraded":"2024-04-26T12:31:47.010394+0000","last_fullsized":"2024-04-26T12:31:47.010394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'467","last_scrub_stamp":"2024-04-26T12:31:47.010262+0000","last_deep_scrub":"60'467","last_deep_scrub_stamp":"2024-04-26T12:31:47.010262+0000","last_clean_scrub_stamp":"2024-04-26T12:31:47.010262+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:06.785529+0000","scrub_duration":0.002479153,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28739,"num_write":425,"num_write_kb":55215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"60'398","reported_seq":527,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:09.153927+0000","last_change":"2024-04-26T12:32:09.153927+0000","last_active":"2024-04-26T12:32:09.153927+0000","last_peered":"2024-04-26T12:32:09.153927+0000","last_clean":"2024-04-26T12:32:09.153927+0000","last_became_active":"2024-04-26T12:26:53.265491+0000","last_became_peered":"2024-04-26T12:26:53.265491+0000","last_unstale":"2024-04-26T12:32:09.153927+0000","last_undegraded":"2024-04-26T12:32:09.153927+0000","last_fullsized":"2024-04-26T12:32:09.153927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'398","last_scrub_stamp":"2024-04-26T12:32:09.153791+0000","last_deep_scrub":"60'398","last_deep_scrub_stamp":"2024-04-26T12:32:09.153791+0000","last_clean_scrub_stamp":"2024-04-26T12:32:09.153791+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:18.465189+0000","scrub_duration":0.0028129969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":17795,"num_write":363,"num_write_kb":67417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"85'460","reported_seq":583,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:23.260820+0000","last_change":"2024-04-26T12:32:23.260981+0000","last_active":"2024-04-26T12:32:23.260820+0000","last_peered":"2024-04-26T12:32:23.260820+0000","last_clean":"2024-04-26T12:32:23.260820+0000","last_became_active":"2024-04-26T12:30:44.021218+0000","last_became_peered":"2024-04-26T12:30:44.021218+0000","last_unstale":"2024-04-26T12:32:23.260820+0000","last_undegraded":"2024-04-26T12:32:23.260820+0000","last_fullsized":"2024-04-26T12:32:23.260820+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'460","last_scrub_stamp":"2024-04-26T12:32:23.260772+0000","last_deep_scrub":"85'460","last_deep_scrub_stamp":"2024-04-26T12:32:23.260772+0000","last_clean_scrub_stamp":"2024-04-26T12:32:23.260772+0000","objects_scrubbed":3,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:42.904353+0000","scrub_duration":0.031187894000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":12525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"60'386","reported_seq":495,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:46.208695+0000","last_change":"2024-04-26T12:31:46.208695+0000","last_active":"2024-04-26T12:31:46.208695+0000","last_peered":"2024-04-26T12:31:46.208695+0000","last_clean":"2024-04-26T12:31:46.208695+0000","last_became_active":"2024-04-26T12:26:53.265343+0000","last_became_peered":"2024-04-26T12:26:53.265343+0000","last_unstale":"2024-04-26T12:31:46.208695+0000","last_undegraded":"2024-04-26T12:31:46.208695+0000","last_fullsized":"2024-04-26T12:31:46.208695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'386","last_scrub_stamp":"2024-04-26T12:31:46.208542+0000","last_deep_scrub":"60'386","last_deep_scrub_stamp":"2024-04-26T12:31:46.208542+0000","last_clean_scrub_stamp":"2024-04-26T12:31:46.208542+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:45.386754+0000","scrub_duration":0.0025680009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9145,"num_write":335,"num_write_kb":51953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"85'343","reported_seq":424,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:32.020118+0000","last_change":"2024-04-26T12:32:32.020118+0000","last_active":"2024-04-26T12:32:32.020118+0000","last_peered":"2024-04-26T12:32:32.020118+0000","last_clean":"2024-04-26T12:32:32.020118+0000","last_became_active":"2024-04-26T12:30:46.078905+0000","last_became_peered":"2024-04-26T12:30:46.078905+0000","last_unstale":"2024-04-26T12:32:32.020118+0000","last_undegraded":"2024-04-26T12:32:32.020118+0000","last_fullsized":"2024-04-26T12:32:32.020118+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'343","last_scrub_stamp":"2024-04-26T12:32:32.019929+0000","last_deep_scrub":"85'343","last_deep_scrub_stamp":"2024-04-26T12:32:32.019929+0000","last_clean_scrub_stamp":"2024-04-26T12:32:32.019929+0000","objects_scrubbed":1,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:20.752633+0000","scrub_duration":0.014563081,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"60'398","reported_seq":490,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.968391+0000","last_change":"2024-04-26T12:32:37.968391+0000","last_active":"2024-04-26T12:32:37.968391+0000","last_peered":"2024-04-26T12:32:37.968391+0000","last_clean":"2024-04-26T12:32:37.968391+0000","last_became_active":"2024-04-26T12:30:58.078539+0000","last_became_peered":"2024-04-26T12:30:58.078539+0000","last_unstale":"2024-04-26T12:32:37.968391+0000","last_undegraded":"2024-04-26T12:32:37.968391+0000","last_fullsized":"2024-04-26T12:32:37.968391+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'398","last_scrub_stamp":"2024-04-26T12:32:37.968259+0000","last_deep_scrub":"60'398","last_deep_scrub_stamp":"2024-04-26T12:32:37.968259+0000","last_clean_scrub_stamp":"2024-04-26T12:32:37.968259+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:51.732088+0000","scrub_duration":0.002548804,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":19095,"num_write":362,"num_write_kb":59164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"85'710","reported_seq":793,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:56.110289+0000","last_change":"2024-04-26T12:31:56.110289+0000","last_active":"2024-04-26T12:31:56.110289+0000","last_peered":"2024-04-26T12:31:56.110289+0000","last_clean":"2024-04-26T12:31:56.110289+0000","last_became_active":"2024-04-26T12:30:44.021682+0000","last_became_peered":"2024-04-26T12:30:44.021682+0000","last_unstale":"2024-04-26T12:31:56.110289+0000","last_undegraded":"2024-04-26T12:31:56.110289+0000","last_fullsized":"2024-04-26T12:31:56.110289+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'710","last_scrub_stamp":"2024-04-26T12:31:56.110156+0000","last_deep_scrub":"85'710","last_deep_scrub_stamp":"2024-04-26T12:31:56.110156+0000","last_clean_scrub_stamp":"2024-04-26T12:31:56.110156+0000","objects_scrubbed":2,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:27.621679+0000","scrub_duration":0.025669368000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":8507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"60'381","reported_seq":513,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.113397+0000","last_change":"2024-04-26T12:31:26.113397+0000","last_active":"2024-04-26T12:31:26.113397+0000","last_peered":"2024-04-26T12:31:26.113397+0000","last_clean":"2024-04-26T12:31:26.113397+0000","last_became_active":"2024-04-26T12:30:47.079792+0000","last_became_peered":"2024-04-26T12:30:47.079792+0000","last_unstale":"2024-04-26T12:31:26.113397+0000","last_undegraded":"2024-04-26T12:31:26.113397+0000","last_fullsized":"2024-04-26T12:31:26.113397+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:31:26.113263+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:31:26.113263+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.113263+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:51.012642+0000","scrub_duration":0.001900838,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6047,"num_write":350,"num_write_kb":71455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"58'58","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:45.981948+0000","last_change":"2024-04-26T12:31:45.981948+0000","last_active":"2024-04-26T12:31:45.981948+0000","last_peered":"2024-04-26T12:31:45.981948+0000","last_clean":"2024-04-26T12:31:45.981948+0000","last_became_active":"2024-04-26T12:30:41.017448+0000","last_became_peered":"2024-04-26T12:30:41.017448+0000","last_unstale":"2024-04-26T12:31:45.981948+0000","last_undegraded":"2024-04-26T12:31:45.981948+0000","last_fullsized":"2024-04-26T12:31:45.981948+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'58","last_scrub_stamp":"2024-04-26T12:31:45.981781+0000","last_deep_scrub":"58'58","last_deep_scrub_stamp":"2024-04-26T12:31:45.981781+0000","last_clean_scrub_stamp":"2024-04-26T12:31:45.981781+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:52.325021+0000","scrub_duration":0.0016923179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"60'473","reported_seq":607,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:24.080935+0000","last_change":"2024-04-26T12:32:24.080935+0000","last_active":"2024-04-26T12:32:24.080935+0000","last_peered":"2024-04-26T12:32:24.080935+0000","last_clean":"2024-04-26T12:32:24.080935+0000","last_became_active":"2024-04-26T12:30:58.078744+0000","last_became_peered":"2024-04-26T12:30:58.078744+0000","last_unstale":"2024-04-26T12:32:24.080935+0000","last_undegraded":"2024-04-26T12:32:24.080935+0000","last_fullsized":"2024-04-26T12:32:24.080935+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'473","last_scrub_stamp":"2024-04-26T12:32:24.080805+0000","last_deep_scrub":"60'473","last_deep_scrub_stamp":"2024-04-26T12:32:24.080805+0000","last_clean_scrub_stamp":"2024-04-26T12:32:24.080805+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:06.211096+0000","scrub_duration":0.0026229529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":31510,"num_write":439,"num_write_kb":108611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"85'356","reported_seq":391,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:12.259503+0000","last_change":"2024-04-26T12:31:12.259503+0000","last_active":"2024-04-26T12:31:12.259503+0000","last_peered":"2024-04-26T12:31:12.259503+0000","last_clean":"2024-04-26T12:31:12.259503+0000","last_became_active":"2024-04-26T12:30:48.086408+0000","last_became_peered":"2024-04-26T12:30:48.086408+0000","last_unstale":"2024-04-26T12:31:12.259503+0000","last_undegraded":"2024-04-26T12:31:12.259503+0000","last_fullsized":"2024-04-26T12:31:12.259503+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'356","last_scrub_stamp":"2024-04-26T12:31:12.259359+0000","last_deep_scrub":"85'356","last_deep_scrub_stamp":"2024-04-26T12:31:12.259359+0000","last_clean_scrub_stamp":"2024-04-26T12:31:12.259359+0000","objects_scrubbed":1,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:29.053825+0000","scrub_duration":0.015931049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"60'528","reported_seq":733,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:01.093764+0000","last_change":"2024-04-26T12:32:01.093764+0000","last_active":"2024-04-26T12:32:01.093764+0000","last_peered":"2024-04-26T12:32:01.093764+0000","last_clean":"2024-04-26T12:32:01.093764+0000","last_became_active":"2024-04-26T12:30:46.031506+0000","last_became_peered":"2024-04-26T12:30:46.031506+0000","last_unstale":"2024-04-26T12:32:01.093764+0000","last_undegraded":"2024-04-26T12:32:01.093764+0000","last_fullsized":"2024-04-26T12:32:01.093764+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'528","last_scrub_stamp":"2024-04-26T12:32:01.093601+0000","last_deep_scrub":"60'528","last_deep_scrub_stamp":"2024-04-26T12:32:01.093601+0000","last_clean_scrub_stamp":"2024-04-26T12:32:01.093601+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:13.828455+0000","scrub_duration":0.0023344469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":66820,"num_write":500,"num_write_kb":183750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"85'88","reported_seq":182,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.241699+0000","last_change":"2024-04-26T12:32:22.241832+0000","last_active":"2024-04-26T12:32:22.241699+0000","last_peered":"2024-04-26T12:32:22.241699+0000","last_clean":"2024-04-26T12:32:22.241699+0000","last_became_active":"2024-04-26T12:26:52.840582+0000","last_became_peered":"2024-04-26T12:26:52.840582+0000","last_unstale":"2024-04-26T12:32:22.241699+0000","last_undegraded":"2024-04-26T12:32:22.241699+0000","last_fullsized":"2024-04-26T12:32:22.241699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'88","last_scrub_stamp":"2024-04-26T12:32:22.241659+0000","last_deep_scrub":"85'88","last_deep_scrub_stamp":"2024-04-26T12:32:22.241659+0000","last_clean_scrub_stamp":"2024-04-26T12:32:22.241659+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:01.912257+0000","scrub_duration":0.0038713139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"60'415","reported_seq":524,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:04.095303+0000","last_change":"2024-04-26T12:32:04.095303+0000","last_active":"2024-04-26T12:32:04.095303+0000","last_peered":"2024-04-26T12:32:04.095303+0000","last_clean":"2024-04-26T12:32:04.095303+0000","last_became_active":"2024-04-26T12:30:45.019337+0000","last_became_peered":"2024-04-26T12:30:45.019337+0000","last_unstale":"2024-04-26T12:32:04.095303+0000","last_undegraded":"2024-04-26T12:32:04.095303+0000","last_fullsized":"2024-04-26T12:32:04.095303+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'415","last_scrub_stamp":"2024-04-26T12:32:04.095151+0000","last_deep_scrub":"60'415","last_deep_scrub_stamp":"2024-04-26T12:32:04.095151+0000","last_clean_scrub_stamp":"2024-04-26T12:32:04.095151+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:13.337155+0000","scrub_duration":0.0023191150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10539,"num_write":379,"num_write_kb":51084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"85'380","reported_seq":458,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.301826+0000","last_change":"2024-04-26T12:31:26.301826+0000","last_active":"2024-04-26T12:31:26.301826+0000","last_peered":"2024-04-26T12:31:26.301826+0000","last_clean":"2024-04-26T12:31:26.301826+0000","last_became_active":"2024-04-26T12:30:46.079194+0000","last_became_peered":"2024-04-26T12:30:46.079194+0000","last_unstale":"2024-04-26T12:31:26.301826+0000","last_undegraded":"2024-04-26T12:31:26.301826+0000","last_fullsized":"2024-04-26T12:31:26.301826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'380","last_scrub_stamp":"2024-04-26T12:31:26.301693+0000","last_deep_scrub":"85'380","last_deep_scrub_stamp":"2024-04-26T12:31:26.301693+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.301693+0000","objects_scrubbed":6,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:55.160179+0000","scrub_duration":0.02593227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9312235,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":9292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"60'414","reported_seq":519,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:25.325525+0000","last_change":"2024-04-26T12:31:25.325525+0000","last_active":"2024-04-26T12:31:25.325525+0000","last_peered":"2024-04-26T12:31:25.325525+0000","last_clean":"2024-04-26T12:31:25.325525+0000","last_became_active":"2024-04-26T12:30:47.079737+0000","last_became_peered":"2024-04-26T12:30:47.079737+0000","last_unstale":"2024-04-26T12:31:25.325525+0000","last_undegraded":"2024-04-26T12:31:25.325525+0000","last_fullsized":"2024-04-26T12:31:25.325525+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:31:25.325392+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:31:25.325392+0000","last_clean_scrub_stamp":"2024-04-26T12:31:25.325392+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:47.712840+0000","scrub_duration":0.0026314070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":39838,"num_write":374,"num_write_kb":69994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"85'544","reported_seq":665,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:40.950666+0000","last_change":"2024-04-26T12:32:40.950798+0000","last_active":"2024-04-26T12:32:40.950666+0000","last_peered":"2024-04-26T12:32:40.950666+0000","last_clean":"2024-04-26T12:32:40.950666+0000","last_became_active":"2024-04-26T12:30:44.028551+0000","last_became_peered":"2024-04-26T12:30:44.028551+0000","last_unstale":"2024-04-26T12:32:40.950666+0000","last_undegraded":"2024-04-26T12:32:40.950666+0000","last_fullsized":"2024-04-26T12:32:40.950666+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'544","last_scrub_stamp":"2024-04-26T12:32:40.950641+0000","last_deep_scrub":"85'544","last_deep_scrub_stamp":"2024-04-26T12:32:40.950641+0000","last_clean_scrub_stamp":"2024-04-26T12:32:40.950641+0000","objects_scrubbed":4,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:59.355168+0000","scrub_duration":0.024502327000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"60'370","reported_seq":807,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:57.323515+0000","last_change":"2024-04-26T12:32:57.323660+0000","last_active":"2024-04-26T12:32:57.323515+0000","last_peered":"2024-04-26T12:32:57.323515+0000","last_clean":"2024-04-26T12:32:57.323515+0000","last_became_active":"2024-04-26T12:30:46.079265+0000","last_became_peered":"2024-04-26T12:30:46.079265+0000","last_unstale":"2024-04-26T12:32:57.323515+0000","last_undegraded":"2024-04-26T12:32:57.323515+0000","last_fullsized":"2024-04-26T12:32:57.323515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'370","last_scrub_stamp":"2024-04-26T12:32:57.323467+0000","last_deep_scrub":"60'370","last_deep_scrub_stamp":"2024-04-26T12:32:57.323467+0000","last_clean_scrub_stamp":"2024-04-26T12:32:57.323467+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:56.114102+0000","scrub_duration":0.0021430479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":697,"num_write":332,"num_write_kb":14058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"58'63","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:54.112814+0000","last_change":"2024-04-26T12:31:54.112814+0000","last_active":"2024-04-26T12:31:54.112814+0000","last_peered":"2024-04-26T12:31:54.112814+0000","last_clean":"2024-04-26T12:31:54.112814+0000","last_became_active":"2024-04-26T12:30:46.088593+0000","last_became_peered":"2024-04-26T12:30:46.088593+0000","last_unstale":"2024-04-26T12:31:54.112814+0000","last_undegraded":"2024-04-26T12:31:54.112814+0000","last_fullsized":"2024-04-26T12:31:54.112814+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'63","last_scrub_stamp":"2024-04-26T12:31:54.112680+0000","last_deep_scrub":"58'63","last_deep_scrub_stamp":"2024-04-26T12:31:54.112680+0000","last_clean_scrub_stamp":"2024-04-26T12:31:54.112680+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:58.061070+0000","scrub_duration":0.0018177499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"60'390","reported_seq":873,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:29.158519+0000","last_change":"2024-04-26T12:31:29.158519+0000","last_active":"2024-04-26T12:31:29.158519+0000","last_peered":"2024-04-26T12:31:29.158519+0000","last_clean":"2024-04-26T12:31:29.158519+0000","last_became_active":"2024-04-26T12:30:50.085196+0000","last_became_peered":"2024-04-26T12:30:50.085196+0000","last_unstale":"2024-04-26T12:31:29.158519+0000","last_undegraded":"2024-04-26T12:31:29.158519+0000","last_fullsized":"2024-04-26T12:31:29.158519+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'390","last_scrub_stamp":"2024-04-26T12:31:29.158376+0000","last_deep_scrub":"60'390","last_deep_scrub_stamp":"2024-04-26T12:31:29.158376+0000","last_clean_scrub_stamp":"2024-04-26T12:31:29.158376+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:29.361899+0000","scrub_duration":0.0022476710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":22161,"num_write":354,"num_write_kb":75546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"58'57","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:09.385378+0000","last_change":"2024-04-26T12:32:09.385498+0000","last_active":"2024-04-26T12:32:09.385378+0000","last_peered":"2024-04-26T12:32:09.385378+0000","last_clean":"2024-04-26T12:32:09.385378+0000","last_became_active":"2024-04-26T12:26:52.837834+0000","last_became_peered":"2024-04-26T12:26:52.837834+0000","last_unstale":"2024-04-26T12:32:09.385378+0000","last_undegraded":"2024-04-26T12:32:09.385378+0000","last_fullsized":"2024-04-26T12:32:09.385378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'57","last_scrub_stamp":"2024-04-26T12:32:09.385336+0000","last_deep_scrub":"58'57","last_deep_scrub_stamp":"2024-04-26T12:32:09.385336+0000","last_clean_scrub_stamp":"2024-04-26T12:32:09.385336+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:11.337234+0000","scrub_duration":0.0017443039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'433","reported_seq":513,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:39.940373+0000","last_change":"2024-04-26T12:32:39.940373+0000","last_active":"2024-04-26T12:32:39.940373+0000","last_peered":"2024-04-26T12:32:39.940373+0000","last_clean":"2024-04-26T12:32:39.940373+0000","last_became_active":"2024-04-26T12:30:59.081424+0000","last_became_peered":"2024-04-26T12:30:59.081424+0000","last_unstale":"2024-04-26T12:32:39.940373+0000","last_undegraded":"2024-04-26T12:32:39.940373+0000","last_fullsized":"2024-04-26T12:32:39.940373+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'433","last_scrub_stamp":"2024-04-26T12:32:39.940210+0000","last_deep_scrub":"60'433","last_deep_scrub_stamp":"2024-04-26T12:32:39.940210+0000","last_clean_scrub_stamp":"2024-04-26T12:32:39.940210+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:20.854291+0000","scrub_duration":0.0021880409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":5229,"num_write":399,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"85'58","reported_seq":90,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:50.029193+0000","last_change":"2024-04-26T12:31:50.029193+0000","last_active":"2024-04-26T12:31:50.029193+0000","last_peered":"2024-04-26T12:31:50.029193+0000","last_clean":"2024-04-26T12:31:50.029193+0000","last_became_active":"2024-04-26T12:30:46.081930+0000","last_became_peered":"2024-04-26T12:30:46.081930+0000","last_unstale":"2024-04-26T12:31:50.029193+0000","last_undegraded":"2024-04-26T12:31:50.029193+0000","last_fullsized":"2024-04-26T12:31:50.029193+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'58","last_scrub_stamp":"2024-04-26T12:31:50.029051+0000","last_deep_scrub":"85'58","last_deep_scrub_stamp":"2024-04-26T12:31:50.029051+0000","last_clean_scrub_stamp":"2024-04-26T12:31:50.029051+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:06.160429+0000","scrub_duration":0.0043989739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"60'399","reported_seq":551,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:40.942639+0000","last_change":"2024-04-26T12:32:40.942639+0000","last_active":"2024-04-26T12:32:40.942639+0000","last_peered":"2024-04-26T12:32:40.942639+0000","last_clean":"2024-04-26T12:32:40.942639+0000","last_became_active":"2024-04-26T12:30:59.081463+0000","last_became_peered":"2024-04-26T12:30:59.081463+0000","last_unstale":"2024-04-26T12:32:40.942639+0000","last_undegraded":"2024-04-26T12:32:40.942639+0000","last_fullsized":"2024-04-26T12:32:40.942639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'399","last_scrub_stamp":"2024-04-26T12:32:40.942475+0000","last_deep_scrub":"60'399","last_deep_scrub_stamp":"2024-04-26T12:32:40.942475+0000","last_clean_scrub_stamp":"2024-04-26T12:32:40.942475+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:36.581399+0000","scrub_duration":0.001801637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":43764,"num_write":368,"num_write_kb":55251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"85'188","reported_seq":224,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.348379+0000","last_change":"2024-04-26T12:31:31.348379+0000","last_active":"2024-04-26T12:31:31.348379+0000","last_peered":"2024-04-26T12:31:31.348379+0000","last_clean":"2024-04-26T12:31:31.348379+0000","last_became_active":"2024-04-26T12:30:46.079742+0000","last_became_peered":"2024-04-26T12:30:46.079742+0000","last_unstale":"2024-04-26T12:31:31.348379+0000","last_undegraded":"2024-04-26T12:31:31.348379+0000","last_fullsized":"2024-04-26T12:31:31.348379+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'188","last_scrub_stamp":"2024-04-26T12:31:31.348227+0000","last_deep_scrub":"85'188","last_deep_scrub_stamp":"2024-04-26T12:31:31.348227+0000","last_clean_scrub_stamp":"2024-04-26T12:31:31.348227+0000","objects_scrubbed":2,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:59.084157+0000","scrub_duration":0.015480226,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":4181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"60'414","reported_seq":545,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:58.302619+0000","last_change":"2024-04-26T12:32:58.302619+0000","last_active":"2024-04-26T12:32:58.302619+0000","last_peered":"2024-04-26T12:32:58.302619+0000","last_clean":"2024-04-26T12:32:58.302619+0000","last_became_active":"2024-04-26T12:26:53.266003+0000","last_became_peered":"2024-04-26T12:26:53.266003+0000","last_unstale":"2024-04-26T12:32:58.302619+0000","last_undegraded":"2024-04-26T12:32:58.302619+0000","last_fullsized":"2024-04-26T12:32:58.302619+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'414","last_scrub_stamp":"2024-04-26T12:32:58.302459+0000","last_deep_scrub":"60'414","last_deep_scrub_stamp":"2024-04-26T12:32:58.302459+0000","last_clean_scrub_stamp":"2024-04-26T12:32:58.302459+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:17.750884+0000","scrub_duration":0.0029558000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":19508,"num_write":376,"num_write_kb":67148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"85'323","reported_seq":455,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:21.284562+0000","last_change":"2024-04-26T12:32:21.284688+0000","last_active":"2024-04-26T12:32:21.284562+0000","last_peered":"2024-04-26T12:32:21.284562+0000","last_clean":"2024-04-26T12:32:21.284562+0000","last_became_active":"2024-04-26T12:30:46.078593+0000","last_became_peered":"2024-04-26T12:30:46.078593+0000","last_unstale":"2024-04-26T12:32:21.284562+0000","last_undegraded":"2024-04-26T12:32:21.284562+0000","last_fullsized":"2024-04-26T12:32:21.284562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'323","last_scrub_stamp":"2024-04-26T12:32:21.284529+0000","last_deep_scrub":"85'323","last_deep_scrub_stamp":"2024-04-26T12:32:21.284529+0000","last_clean_scrub_stamp":"2024-04-26T12:32:21.284529+0000","objects_scrubbed":2,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.109193+0000","scrub_duration":0.015639103000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"60'437","reported_seq":990,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:33.193590+0000","last_change":"2024-04-26T12:31:33.193590+0000","last_active":"2024-04-26T12:31:33.193590+0000","last_peered":"2024-04-26T12:31:33.193590+0000","last_clean":"2024-04-26T12:31:33.193590+0000","last_became_active":"2024-04-26T12:30:52.077619+0000","last_became_peered":"2024-04-26T12:30:52.077619+0000","last_unstale":"2024-04-26T12:31:33.193590+0000","last_undegraded":"2024-04-26T12:31:33.193590+0000","last_fullsized":"2024-04-26T12:31:33.193590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'437","last_scrub_stamp":"2024-04-26T12:31:33.193453+0000","last_deep_scrub":"60'437","last_deep_scrub_stamp":"2024-04-26T12:31:33.193453+0000","last_clean_scrub_stamp":"2024-04-26T12:31:33.193453+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:25.293233+0000","scrub_duration":0.0023129719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":15206,"num_write":406,"num_write_kb":22443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'479","reported_seq":529,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:57.983000+0000","last_change":"2024-04-26T12:32:57.983000+0000","last_active":"2024-04-26T12:32:57.983000+0000","last_peered":"2024-04-26T12:32:57.983000+0000","last_clean":"2024-04-26T12:32:57.983000+0000","last_became_active":"2024-04-26T12:30:48.088255+0000","last_became_peered":"2024-04-26T12:30:48.088255+0000","last_unstale":"2024-04-26T12:32:57.983000+0000","last_undegraded":"2024-04-26T12:32:57.983000+0000","last_fullsized":"2024-04-26T12:32:57.983000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'479","last_scrub_stamp":"2024-04-26T12:32:57.982823+0000","last_deep_scrub":"85'479","last_deep_scrub_stamp":"2024-04-26T12:32:57.982823+0000","last_clean_scrub_stamp":"2024-04-26T12:32:57.982823+0000","objects_scrubbed":2,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:42.694178+0000","scrub_duration":0.019827221999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"60'424","reported_seq":504,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:22.254831+0000","last_change":"2024-04-26T12:31:22.254831+0000","last_active":"2024-04-26T12:31:22.254831+0000","last_peered":"2024-04-26T12:31:22.254831+0000","last_clean":"2024-04-26T12:31:22.254831+0000","last_became_active":"2024-04-26T12:30:48.086356+0000","last_became_peered":"2024-04-26T12:30:48.086356+0000","last_unstale":"2024-04-26T12:31:22.254831+0000","last_undegraded":"2024-04-26T12:31:22.254831+0000","last_fullsized":"2024-04-26T12:31:22.254831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'424","last_scrub_stamp":"2024-04-26T12:31:22.254705+0000","last_deep_scrub":"60'424","last_deep_scrub_stamp":"2024-04-26T12:31:22.254705+0000","last_clean_scrub_stamp":"2024-04-26T12:31:22.254705+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:09.032368+0000","scrub_duration":0.0022442209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":11035,"num_write":390,"num_write_kb":63077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"58'62","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:04.101407+0000","last_change":"2024-04-26T12:33:04.101540+0000","last_active":"2024-04-26T12:33:04.101407+0000","last_peered":"2024-04-26T12:33:04.101407+0000","last_clean":"2024-04-26T12:33:04.101407+0000","last_became_active":"2024-04-26T12:30:48.089068+0000","last_became_peered":"2024-04-26T12:30:48.089068+0000","last_unstale":"2024-04-26T12:33:04.101407+0000","last_undegraded":"2024-04-26T12:33:04.101407+0000","last_fullsized":"2024-04-26T12:33:04.101407+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'62","last_scrub_stamp":"2024-04-26T12:33:04.101380+0000","last_deep_scrub":"58'62","last_deep_scrub_stamp":"2024-04-26T12:33:04.101380+0000","last_clean_scrub_stamp":"2024-04-26T12:33:04.101380+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:30.757133+0000","scrub_duration":0.001694217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"60'433","reported_seq":572,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:22.059419+0000","last_change":"2024-04-26T12:32:22.059419+0000","last_active":"2024-04-26T12:32:22.059419+0000","last_peered":"2024-04-26T12:32:22.059419+0000","last_clean":"2024-04-26T12:32:22.059419+0000","last_became_active":"2024-04-26T12:30:48.085982+0000","last_became_peered":"2024-04-26T12:30:48.085982+0000","last_unstale":"2024-04-26T12:32:22.059419+0000","last_undegraded":"2024-04-26T12:32:22.059419+0000","last_fullsized":"2024-04-26T12:32:22.059419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'433","last_scrub_stamp":"2024-04-26T12:32:22.059294+0000","last_deep_scrub":"60'433","last_deep_scrub_stamp":"2024-04-26T12:32:22.059294+0000","last_clean_scrub_stamp":"2024-04-26T12:32:22.059294+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:35.581218+0000","scrub_duration":0.0019914970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":35002,"num_write":399,"num_write_kb":63012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"85'184","reported_seq":268,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.972802+0000","last_change":"2024-04-26T12:32:33.972802+0000","last_active":"2024-04-26T12:32:33.972802+0000","last_peered":"2024-04-26T12:32:33.972802+0000","last_clean":"2024-04-26T12:32:33.972802+0000","last_became_active":"2024-04-26T12:30:46.082117+0000","last_became_peered":"2024-04-26T12:30:46.082117+0000","last_unstale":"2024-04-26T12:32:33.972802+0000","last_undegraded":"2024-04-26T12:32:33.972802+0000","last_fullsized":"2024-04-26T12:32:33.972802+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'184","last_scrub_stamp":"2024-04-26T12:32:33.972630+0000","last_deep_scrub":"85'184","last_deep_scrub_stamp":"2024-04-26T12:32:33.972630+0000","last_clean_scrub_stamp":"2024-04-26T12:32:33.972630+0000","objects_scrubbed":3,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:44:48.201253+0000","scrub_duration":0.019072424000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'454","reported_seq":550,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:09.037376+0000","last_change":"2024-04-26T12:33:09.037502+0000","last_active":"2024-04-26T12:33:09.037376+0000","last_peered":"2024-04-26T12:33:09.037376+0000","last_clean":"2024-04-26T12:33:09.037376+0000","last_became_active":"2024-04-26T12:30:48.086116+0000","last_became_peered":"2024-04-26T12:30:48.086116+0000","last_unstale":"2024-04-26T12:33:09.037376+0000","last_undegraded":"2024-04-26T12:33:09.037376+0000","last_fullsized":"2024-04-26T12:33:09.037376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'454","last_scrub_stamp":"2024-04-26T12:33:09.037343+0000","last_deep_scrub":"60'454","last_deep_scrub_stamp":"2024-04-26T12:33:09.037343+0000","last_clean_scrub_stamp":"2024-04-26T12:33:09.037343+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:51.637846+0000","scrub_duration":0.001962026,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":31206,"num_write":419,"num_write_kb":63454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"85'164","reported_seq":283,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:37.870414+0000","last_change":"2024-04-26T12:32:37.870414+0000","last_active":"2024-04-26T12:32:37.870414+0000","last_peered":"2024-04-26T12:32:37.870414+0000","last_clean":"2024-04-26T12:32:37.870414+0000","last_became_active":"2024-04-26T12:30:44.028451+0000","last_became_peered":"2024-04-26T12:30:44.028451+0000","last_unstale":"2024-04-26T12:32:37.870414+0000","last_undegraded":"2024-04-26T12:32:37.870414+0000","last_fullsized":"2024-04-26T12:32:37.870414+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'164","last_scrub_stamp":"2024-04-26T12:32:37.870280+0000","last_deep_scrub":"85'164","last_deep_scrub_stamp":"2024-04-26T12:32:37.870280+0000","last_clean_scrub_stamp":"2024-04-26T12:32:37.870280+0000","objects_scrubbed":1,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:23.644955+0000","scrub_duration":0.015156388,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"60'405","reported_seq":496,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:20.233368+0000","last_change":"2024-04-26T12:31:20.233368+0000","last_active":"2024-04-26T12:31:20.233368+0000","last_peered":"2024-04-26T12:31:20.233368+0000","last_clean":"2024-04-26T12:31:20.233368+0000","last_became_active":"2024-04-26T12:30:47.080682+0000","last_became_peered":"2024-04-26T12:30:47.080682+0000","last_unstale":"2024-04-26T12:31:20.233368+0000","last_undegraded":"2024-04-26T12:31:20.233368+0000","last_fullsized":"2024-04-26T12:31:20.233368+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'405","last_scrub_stamp":"2024-04-26T12:31:20.233200+0000","last_deep_scrub":"60'405","last_deep_scrub_stamp":"2024-04-26T12:31:20.233200+0000","last_clean_scrub_stamp":"2024-04-26T12:31:20.233200+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:03.311719+0000","scrub_duration":0.0025721490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":15494,"num_write":372,"num_write_kb":51022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"58'55","reported_seq":176,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:15.309882+0000","last_change":"2024-04-26T12:32:15.309882+0000","last_active":"2024-04-26T12:32:15.309882+0000","last_peered":"2024-04-26T12:32:15.309882+0000","last_clean":"2024-04-26T12:32:15.309882+0000","last_became_active":"2024-04-26T12:30:46.078475+0000","last_became_peered":"2024-04-26T12:30:46.078475+0000","last_unstale":"2024-04-26T12:32:15.309882+0000","last_undegraded":"2024-04-26T12:32:15.309882+0000","last_fullsized":"2024-04-26T12:32:15.309882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'55","last_scrub_stamp":"2024-04-26T12:32:15.309740+0000","last_deep_scrub":"58'55","last_deep_scrub_stamp":"2024-04-26T12:32:15.309740+0000","last_clean_scrub_stamp":"2024-04-26T12:32:15.309740+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:50.961431+0000","scrub_duration":0.0023593640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"60'363","reported_seq":505,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:44.982096+0000","last_change":"2024-04-26T12:32:44.982209+0000","last_active":"2024-04-26T12:32:44.982096+0000","last_peered":"2024-04-26T12:32:44.982096+0000","last_clean":"2024-04-26T12:32:44.982096+0000","last_became_active":"2024-04-26T12:26:53.264621+0000","last_became_peered":"2024-04-26T12:26:53.264621+0000","last_unstale":"2024-04-26T12:32:44.982096+0000","last_undegraded":"2024-04-26T12:32:44.982096+0000","last_fullsized":"2024-04-26T12:32:44.982096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'363","last_scrub_stamp":"2024-04-26T12:32:44.982071+0000","last_deep_scrub":"60'363","last_deep_scrub_stamp":"2024-04-26T12:32:44.982071+0000","last_clean_scrub_stamp":"2024-04-26T12:32:44.982071+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:40.857857+0000","scrub_duration":0.0031791319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":21099,"num_write":333,"num_write_kb":46543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"85'484","reported_seq":603,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:46.379741+0000","last_change":"2024-04-26T12:32:46.379741+0000","last_active":"2024-04-26T12:32:46.379741+0000","last_peered":"2024-04-26T12:32:46.379741+0000","last_clean":"2024-04-26T12:32:46.379741+0000","last_became_active":"2024-04-26T12:30:44.021739+0000","last_became_peered":"2024-04-26T12:30:44.021739+0000","last_unstale":"2024-04-26T12:32:46.379741+0000","last_undegraded":"2024-04-26T12:32:46.379741+0000","last_fullsized":"2024-04-26T12:32:46.379741+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'484","last_scrub_stamp":"2024-04-26T12:32:46.379587+0000","last_deep_scrub":"85'484","last_deep_scrub_stamp":"2024-04-26T12:32:46.379587+0000","last_clean_scrub_stamp":"2024-04-26T12:32:46.379587+0000","objects_scrubbed":1,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:27.037656+0000","scrub_duration":0.01793469,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"60'402","reported_seq":511,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:31.890716+0000","last_change":"2024-04-26T12:31:31.890716+0000","last_active":"2024-04-26T12:31:31.890716+0000","last_peered":"2024-04-26T12:31:31.890716+0000","last_clean":"2024-04-26T12:31:31.890716+0000","last_became_active":"2024-04-26T12:30:55.087309+0000","last_became_peered":"2024-04-26T12:30:55.087309+0000","last_unstale":"2024-04-26T12:31:31.890716+0000","last_undegraded":"2024-04-26T12:31:31.890716+0000","last_fullsized":"2024-04-26T12:31:31.890716+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'402","last_scrub_stamp":"2024-04-26T12:31:31.890586+0000","last_deep_scrub":"60'402","last_deep_scrub_stamp":"2024-04-26T12:31:31.890586+0000","last_clean_scrub_stamp":"2024-04-26T12:31:31.890586+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:10.281743+0000","scrub_duration":0.0021503030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":23760,"num_write":366,"num_write_kb":59326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:23.972717+0000","last_change":"2024-04-26T12:31:23.972717+0000","last_active":"2024-04-26T12:31:23.972717+0000","last_peered":"2024-04-26T12:31:23.972717+0000","last_clean":"2024-04-26T12:31:23.972717+0000","last_became_active":"2024-04-26T12:30:41.025771+0000","last_became_peered":"2024-04-26T12:30:41.025771+0000","last_unstale":"2024-04-26T12:31:23.972717+0000","last_undegraded":"2024-04-26T12:31:23.972717+0000","last_fullsized":"2024-04-26T12:31:23.972717+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:23.972571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:23.972571+0000","last_clean_scrub_stamp":"2024-04-26T12:31:23.972571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:28.883121+0000","scrub_duration":0.0019705149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"85'455","reported_seq":494,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:48.063866+0000","last_change":"2024-04-26T12:31:48.063866+0000","last_active":"2024-04-26T12:31:48.063866+0000","last_peered":"2024-04-26T12:31:48.063866+0000","last_clean":"2024-04-26T12:31:48.063866+0000","last_became_active":"2024-04-26T12:30:46.078958+0000","last_became_peered":"2024-04-26T12:30:46.078958+0000","last_unstale":"2024-04-26T12:31:48.063866+0000","last_undegraded":"2024-04-26T12:31:48.063866+0000","last_fullsized":"2024-04-26T12:31:48.063866+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'455","last_scrub_stamp":"2024-04-26T12:31:48.063706+0000","last_deep_scrub":"85'455","last_deep_scrub_stamp":"2024-04-26T12:31:48.063706+0000","last_clean_scrub_stamp":"2024-04-26T12:31:48.063706+0000","objects_scrubbed":1,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:01.639711+0000","scrub_duration":0.015622934999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":4362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"60'369","reported_seq":486,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:48.354748+0000","last_change":"2024-04-26T12:32:48.354748+0000","last_active":"2024-04-26T12:32:48.354748+0000","last_peered":"2024-04-26T12:32:48.354748+0000","last_clean":"2024-04-26T12:32:48.354748+0000","last_became_active":"2024-04-26T12:26:53.265243+0000","last_became_peered":"2024-04-26T12:26:53.265243+0000","last_unstale":"2024-04-26T12:32:48.354748+0000","last_undegraded":"2024-04-26T12:32:48.354748+0000","last_fullsized":"2024-04-26T12:32:48.354748+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'369","last_scrub_stamp":"2024-04-26T12:32:48.354608+0000","last_deep_scrub":"60'369","last_deep_scrub_stamp":"2024-04-26T12:32:48.354608+0000","last_clean_scrub_stamp":"2024-04-26T12:32:48.354608+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:11.799788+0000","scrub_duration":0.0028242369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7048,"num_write":336,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:21.978811+0000","last_change":"2024-04-26T12:32:21.978811+0000","last_active":"2024-04-26T12:32:21.978811+0000","last_peered":"2024-04-26T12:32:21.978811+0000","last_clean":"2024-04-26T12:32:21.978811+0000","last_became_active":"2024-04-26T12:30:41.016711+0000","last_became_peered":"2024-04-26T12:30:41.016711+0000","last_unstale":"2024-04-26T12:32:21.978811+0000","last_undegraded":"2024-04-26T12:32:21.978811+0000","last_fullsized":"2024-04-26T12:32:21.978811+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:21.978665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:21.978665+0000","last_clean_scrub_stamp":"2024-04-26T12:32:21.978665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:43.330392+0000","scrub_duration":0.001858333,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"58'70","reported_seq":155,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:07.025571+0000","last_change":"2024-04-26T12:33:07.025571+0000","last_active":"2024-04-26T12:33:07.025571+0000","last_peered":"2024-04-26T12:33:07.025571+0000","last_clean":"2024-04-26T12:33:07.025571+0000","last_became_active":"2024-04-26T12:30:48.088278+0000","last_became_peered":"2024-04-26T12:30:48.088278+0000","last_unstale":"2024-04-26T12:33:07.025571+0000","last_undegraded":"2024-04-26T12:33:07.025571+0000","last_fullsized":"2024-04-26T12:33:07.025571+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'70","last_scrub_stamp":"2024-04-26T12:33:07.025430+0000","last_deep_scrub":"58'70","last_deep_scrub_stamp":"2024-04-26T12:33:07.025430+0000","last_clean_scrub_stamp":"2024-04-26T12:33:07.025430+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:01.297847+0000","scrub_duration":0.0017168769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"60'404","reported_seq":512,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:55.133138+0000","last_change":"2024-04-26T12:31:55.133138+0000","last_active":"2024-04-26T12:31:55.133138+0000","last_peered":"2024-04-26T12:31:55.133138+0000","last_clean":"2024-04-26T12:31:55.133138+0000","last_became_active":"2024-04-26T12:30:46.032216+0000","last_became_peered":"2024-04-26T12:30:46.032216+0000","last_unstale":"2024-04-26T12:31:55.133138+0000","last_undegraded":"2024-04-26T12:31:55.133138+0000","last_fullsized":"2024-04-26T12:31:55.133138+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'404","last_scrub_stamp":"2024-04-26T12:31:55.132989+0000","last_deep_scrub":"60'404","last_deep_scrub_stamp":"2024-04-26T12:31:55.132989+0000","last_clean_scrub_stamp":"2024-04-26T12:31:55.132989+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:09.806981+0000","scrub_duration":0.0022071650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":10985,"num_write":372,"num_write_kb":68211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:15.991158+0000","last_change":"2024-04-26T12:32:15.991158+0000","last_active":"2024-04-26T12:32:15.991158+0000","last_peered":"2024-04-26T12:32:15.991158+0000","last_clean":"2024-04-26T12:32:15.991158+0000","last_became_active":"2024-04-26T12:30:41.025543+0000","last_became_peered":"2024-04-26T12:30:41.025543+0000","last_unstale":"2024-04-26T12:32:15.991158+0000","last_undegraded":"2024-04-26T12:32:15.991158+0000","last_fullsized":"2024-04-26T12:32:15.991158+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:15.991015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:15.991015+0000","last_clean_scrub_stamp":"2024-04-26T12:32:15.991015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:54.413627+0000","scrub_duration":0.0021248650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"85'318","reported_seq":413,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:14.328682+0000","last_change":"2024-04-26T12:32:14.328682+0000","last_active":"2024-04-26T12:32:14.328682+0000","last_peered":"2024-04-26T12:32:14.328682+0000","last_clean":"2024-04-26T12:32:14.328682+0000","last_became_active":"2024-04-26T12:26:52.837746+0000","last_became_peered":"2024-04-26T12:26:52.837746+0000","last_unstale":"2024-04-26T12:32:14.328682+0000","last_undegraded":"2024-04-26T12:32:14.328682+0000","last_fullsized":"2024-04-26T12:32:14.328682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'318","last_scrub_stamp":"2024-04-26T12:32:14.328453+0000","last_deep_scrub":"85'318","last_deep_scrub_stamp":"2024-04-26T12:32:14.328453+0000","last_clean_scrub_stamp":"2024-04-26T12:32:14.328453+0000","objects_scrubbed":2,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:16.594609+0000","scrub_duration":0.022414826999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'339","reported_seq":445,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:34.956674+0000","last_change":"2024-04-26T12:31:34.956674+0000","last_active":"2024-04-26T12:31:34.956674+0000","last_peered":"2024-04-26T12:31:34.956674+0000","last_clean":"2024-04-26T12:31:34.956674+0000","last_became_active":"2024-04-26T12:30:54.079522+0000","last_became_peered":"2024-04-26T12:30:54.079522+0000","last_unstale":"2024-04-26T12:31:34.956674+0000","last_undegraded":"2024-04-26T12:31:34.956674+0000","last_fullsized":"2024-04-26T12:31:34.956674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'339","last_scrub_stamp":"2024-04-26T12:31:34.956499+0000","last_deep_scrub":"60'339","last_deep_scrub_stamp":"2024-04-26T12:31:34.956499+0000","last_clean_scrub_stamp":"2024-04-26T12:31:34.956499+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:59.720417+0000","scrub_duration":0.0021999369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15133,"num_write":320,"num_write_kb":50747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:32.328853+0000","last_change":"2024-04-26T12:31:32.328853+0000","last_active":"2024-04-26T12:31:32.328853+0000","last_peered":"2024-04-26T12:31:32.328853+0000","last_clean":"2024-04-26T12:31:32.328853+0000","last_became_active":"2024-04-26T12:30:46.082792+0000","last_became_peered":"2024-04-26T12:30:46.082792+0000","last_unstale":"2024-04-26T12:31:32.328853+0000","last_undegraded":"2024-04-26T12:31:32.328853+0000","last_fullsized":"2024-04-26T12:31:32.328853+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:32.328709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:32.328709+0000","last_clean_scrub_stamp":"2024-04-26T12:31:32.328709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:20.941744+0000","scrub_duration":0.0019425169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"85'159","reported_seq":278,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:53.976254+0000","last_change":"2024-04-26T12:32:53.976363+0000","last_active":"2024-04-26T12:32:53.976254+0000","last_peered":"2024-04-26T12:32:53.976254+0000","last_clean":"2024-04-26T12:32:53.976254+0000","last_became_active":"2024-04-26T12:30:47.081538+0000","last_became_peered":"2024-04-26T12:30:47.081538+0000","last_unstale":"2024-04-26T12:32:53.976254+0000","last_undegraded":"2024-04-26T12:32:53.976254+0000","last_fullsized":"2024-04-26T12:32:53.976254+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'159","last_scrub_stamp":"2024-04-26T12:32:53.976229+0000","last_deep_scrub":"85'159","last_deep_scrub_stamp":"2024-04-26T12:32:53.976229+0000","last_clean_scrub_stamp":"2024-04-26T12:32:53.976229+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:18.300219+0000","scrub_duration":0.0046407640000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"85'530","reported_seq":613,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:13.979318+0000","last_change":"2024-04-26T12:32:13.979318+0000","last_active":"2024-04-26T12:32:13.979318+0000","last_peered":"2024-04-26T12:32:13.979318+0000","last_clean":"2024-04-26T12:32:13.979318+0000","last_became_active":"2024-04-26T12:30:44.022903+0000","last_became_peered":"2024-04-26T12:30:44.022903+0000","last_unstale":"2024-04-26T12:32:13.979318+0000","last_undegraded":"2024-04-26T12:32:13.979318+0000","last_fullsized":"2024-04-26T12:32:13.979318+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'530","last_scrub_stamp":"2024-04-26T12:32:13.979200+0000","last_deep_scrub":"85'530","last_deep_scrub_stamp":"2024-04-26T12:32:13.979200+0000","last_clean_scrub_stamp":"2024-04-26T12:32:13.979200+0000","objects_scrubbed":2,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:32.615284+0000","scrub_duration":0.026609192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":8418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"60'436","reported_seq":578,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.980975+0000","last_change":"2024-04-26T12:32:43.980975+0000","last_active":"2024-04-26T12:32:43.980975+0000","last_peered":"2024-04-26T12:32:43.980975+0000","last_clean":"2024-04-26T12:32:43.980975+0000","last_became_active":"2024-04-26T12:26:53.263276+0000","last_became_peered":"2024-04-26T12:26:53.263276+0000","last_unstale":"2024-04-26T12:32:43.980975+0000","last_undegraded":"2024-04-26T12:32:43.980975+0000","last_fullsized":"2024-04-26T12:32:43.980975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'436","last_scrub_stamp":"2024-04-26T12:32:43.980841+0000","last_deep_scrub":"60'436","last_deep_scrub_stamp":"2024-04-26T12:32:43.980841+0000","last_clean_scrub_stamp":"2024-04-26T12:32:43.980841+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:58.984555+0000","scrub_duration":0.002707508,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":29510,"num_write":395,"num_write_kb":83825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:29.947802+0000","last_change":"2024-04-26T12:32:29.947802+0000","last_active":"2024-04-26T12:32:29.947802+0000","last_peered":"2024-04-26T12:32:29.947802+0000","last_clean":"2024-04-26T12:32:29.947802+0000","last_became_active":"2024-04-26T12:26:47.809579+0000","last_became_peered":"2024-04-26T12:26:47.809579+0000","last_unstale":"2024-04-26T12:32:29.947802+0000","last_undegraded":"2024-04-26T12:32:29.947802+0000","last_fullsized":"2024-04-26T12:32:29.947802+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:29.947653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:29.947653+0000","last_clean_scrub_stamp":"2024-04-26T12:32:29.947653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:09.849742+0000","scrub_duration":0.0021636390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"85'106","reported_seq":236,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:24.979101+0000","last_change":"2024-04-26T12:31:24.979101+0000","last_active":"2024-04-26T12:31:24.979101+0000","last_peered":"2024-04-26T12:31:24.979101+0000","last_clean":"2024-04-26T12:31:24.979101+0000","last_became_active":"2024-04-26T12:30:44.028503+0000","last_became_peered":"2024-04-26T12:30:44.028503+0000","last_unstale":"2024-04-26T12:31:24.979101+0000","last_undegraded":"2024-04-26T12:31:24.979101+0000","last_fullsized":"2024-04-26T12:31:24.979101+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'106","last_scrub_stamp":"2024-04-26T12:31:24.978960+0000","last_deep_scrub":"85'106","last_deep_scrub_stamp":"2024-04-26T12:31:24.978960+0000","last_clean_scrub_stamp":"2024-04-26T12:31:24.978960+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:36.841285+0000","scrub_duration":0.0061135809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470964,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":47,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1470964,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"60'438","reported_seq":981,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:59.363532+0000","last_change":"2024-04-26T12:31:59.363532+0000","last_active":"2024-04-26T12:31:59.363532+0000","last_peered":"2024-04-26T12:31:59.363532+0000","last_clean":"2024-04-26T12:31:59.363532+0000","last_became_active":"2024-04-26T12:30:57.077779+0000","last_became_peered":"2024-04-26T12:30:57.077779+0000","last_unstale":"2024-04-26T12:31:59.363532+0000","last_undegraded":"2024-04-26T12:31:59.363532+0000","last_fullsized":"2024-04-26T12:31:59.363532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'438","last_scrub_stamp":"2024-04-26T12:31:59.363398+0000","last_deep_scrub":"60'438","last_deep_scrub_stamp":"2024-04-26T12:31:59.363398+0000","last_clean_scrub_stamp":"2024-04-26T12:31:59.363398+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:03.749621+0000","scrub_duration":0.0022297010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":20774,"num_write":403,"num_write_kb":59415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:13.325002+0000","last_change":"2024-04-26T12:32:13.325002+0000","last_active":"2024-04-26T12:32:13.325002+0000","last_peered":"2024-04-26T12:32:13.325002+0000","last_clean":"2024-04-26T12:32:13.325002+0000","last_became_active":"2024-04-26T12:30:41.028378+0000","last_became_peered":"2024-04-26T12:30:41.028378+0000","last_unstale":"2024-04-26T12:32:13.325002+0000","last_undegraded":"2024-04-26T12:32:13.325002+0000","last_fullsized":"2024-04-26T12:32:13.325002+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:32:13.324871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:32:13.324871+0000","last_clean_scrub_stamp":"2024-04-26T12:32:13.324871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:14.136071+0000","scrub_duration":0.001814179,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"58'59","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:39.992792+0000","last_change":"2024-04-26T12:31:39.992792+0000","last_active":"2024-04-26T12:31:39.992792+0000","last_peered":"2024-04-26T12:31:39.992792+0000","last_clean":"2024-04-26T12:31:39.992792+0000","last_became_active":"2024-04-26T12:30:41.025782+0000","last_became_peered":"2024-04-26T12:30:41.025782+0000","last_unstale":"2024-04-26T12:31:39.992792+0000","last_undegraded":"2024-04-26T12:31:39.992792+0000","last_fullsized":"2024-04-26T12:31:39.992792+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'59","last_scrub_stamp":"2024-04-26T12:31:39.992655+0000","last_deep_scrub":"58'59","last_deep_scrub_stamp":"2024-04-26T12:31:39.992655+0000","last_clean_scrub_stamp":"2024-04-26T12:31:39.992655+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:05.570619+0000","scrub_duration":0.001782435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"60'418","reported_seq":533,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:45.215071+0000","last_change":"2024-04-26T12:31:45.215071+0000","last_active":"2024-04-26T12:31:45.215071+0000","last_peered":"2024-04-26T12:31:45.215071+0000","last_clean":"2024-04-26T12:31:45.215071+0000","last_became_active":"2024-04-26T12:26:53.264939+0000","last_became_peered":"2024-04-26T12:26:53.264939+0000","last_unstale":"2024-04-26T12:31:45.215071+0000","last_undegraded":"2024-04-26T12:31:45.215071+0000","last_fullsized":"2024-04-26T12:31:45.215071+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'418","last_scrub_stamp":"2024-04-26T12:31:45.214875+0000","last_deep_scrub":"60'418","last_deep_scrub_stamp":"2024-04-26T12:31:45.214875+0000","last_clean_scrub_stamp":"2024-04-26T12:31:45.214875+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:16.419048+0000","scrub_duration":0.0026123359999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12958,"num_write":380,"num_write_kb":51324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'63","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:25.111634+0000","last_change":"2024-04-26T12:32:25.111634+0000","last_active":"2024-04-26T12:32:25.111634+0000","last_peered":"2024-04-26T12:32:25.111634+0000","last_clean":"2024-04-26T12:32:25.111634+0000","last_became_active":"2024-04-26T12:30:41.029346+0000","last_became_peered":"2024-04-26T12:30:41.029346+0000","last_unstale":"2024-04-26T12:32:25.111634+0000","last_undegraded":"2024-04-26T12:32:25.111634+0000","last_fullsized":"2024-04-26T12:32:25.111634+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'63","last_scrub_stamp":"2024-04-26T12:32:25.111502+0000","last_deep_scrub":"85'63","last_deep_scrub_stamp":"2024-04-26T12:32:25.111502+0000","last_clean_scrub_stamp":"2024-04-26T12:32:25.111502+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:19.495601+0000","scrub_duration":0.003363904,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:26.965364+0000","last_change":"2024-04-26T12:31:26.965364+0000","last_active":"2024-04-26T12:31:26.965364+0000","last_peered":"2024-04-26T12:31:26.965364+0000","last_clean":"2024-04-26T12:31:26.965364+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:31:26.965364+0000","last_undegraded":"2024-04-26T12:31:26.965364+0000","last_fullsized":"2024-04-26T12:31:26.965364+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:26.965245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:26.965245+0000","last_clean_scrub_stamp":"2024-04-26T12:31:26.965245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:27.319599+0000","scrub_duration":0.0017909270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'416","reported_seq":513,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:43.983743+0000","last_change":"2024-04-26T12:32:43.983883+0000","last_active":"2024-04-26T12:32:43.983743+0000","last_peered":"2024-04-26T12:32:43.983743+0000","last_clean":"2024-04-26T12:32:43.983743+0000","last_became_active":"2024-04-26T12:31:00.079504+0000","last_became_peered":"2024-04-26T12:31:00.079504+0000","last_unstale":"2024-04-26T12:32:43.983743+0000","last_undegraded":"2024-04-26T12:32:43.983743+0000","last_fullsized":"2024-04-26T12:32:43.983743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'416","last_scrub_stamp":"2024-04-26T12:32:43.983712+0000","last_deep_scrub":"60'416","last_deep_scrub_stamp":"2024-04-26T12:32:43.983712+0000","last_clean_scrub_stamp":"2024-04-26T12:32:43.983712+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:38.828275+0000","scrub_duration":0.0020127650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":20612,"num_write":376,"num_write_kb":38277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:35.265446+0000","last_change":"2024-04-26T12:31:35.265446+0000","last_active":"2024-04-26T12:31:35.265446+0000","last_peered":"2024-04-26T12:31:35.265446+0000","last_clean":"2024-04-26T12:31:35.265446+0000","last_became_active":"2024-04-26T12:30:46.080280+0000","last_became_peered":"2024-04-26T12:30:46.080280+0000","last_unstale":"2024-04-26T12:31:35.265446+0000","last_undegraded":"2024-04-26T12:31:35.265446+0000","last_fullsized":"2024-04-26T12:31:35.265446+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:31:35.265322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:31:35.265322+0000","last_clean_scrub_stamp":"2024-04-26T12:31:35.265322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:21.847498+0000","scrub_duration":0.001727751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"85'83","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.000699+0000","last_change":"2024-04-26T12:31:14.000699+0000","last_active":"2024-04-26T12:31:14.000699+0000","last_peered":"2024-04-26T12:31:14.000699+0000","last_clean":"2024-04-26T12:31:14.000699+0000","last_became_active":"2024-04-26T12:30:46.084671+0000","last_became_peered":"2024-04-26T12:30:46.084671+0000","last_unstale":"2024-04-26T12:31:14.000699+0000","last_undegraded":"2024-04-26T12:31:14.000699+0000","last_fullsized":"2024-04-26T12:31:14.000699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'83","last_scrub_stamp":"2024-04-26T12:31:14.000521+0000","last_deep_scrub":"85'83","last_deep_scrub_stamp":"2024-04-26T12:31:14.000521+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.000521+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:11.290115+0000","scrub_duration":0.0069472290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"60'439","reported_seq":619,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:47.173213+0000","last_change":"2024-04-26T12:31:47.173213+0000","last_active":"2024-04-26T12:31:47.173213+0000","last_peered":"2024-04-26T12:31:47.173213+0000","last_clean":"2024-04-26T12:31:47.173213+0000","last_became_active":"2024-04-26T12:26:53.260370+0000","last_became_peered":"2024-04-26T12:26:53.260370+0000","last_unstale":"2024-04-26T12:31:47.173213+0000","last_undegraded":"2024-04-26T12:31:47.173213+0000","last_fullsized":"2024-04-26T12:31:47.173213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'439","last_scrub_stamp":"2024-04-26T12:31:47.173047+0000","last_deep_scrub":"60'439","last_deep_scrub_stamp":"2024-04-26T12:31:47.173047+0000","last_clean_scrub_stamp":"2024-04-26T12:31:47.173047+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:10.331132+0000","scrub_duration":0.002517961,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":58560,"num_write":408,"num_write_kb":122301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"85'63","reported_seq":187,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:33.295559+0000","last_change":"2024-04-26T12:32:33.295684+0000","last_active":"2024-04-26T12:32:33.295559+0000","last_peered":"2024-04-26T12:32:33.295559+0000","last_clean":"2024-04-26T12:32:33.295559+0000","last_became_active":"2024-04-26T12:30:46.079261+0000","last_became_peered":"2024-04-26T12:30:46.079261+0000","last_unstale":"2024-04-26T12:32:33.295559+0000","last_undegraded":"2024-04-26T12:32:33.295559+0000","last_fullsized":"2024-04-26T12:32:33.295559+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'63","last_scrub_stamp":"2024-04-26T12:32:33.295525+0000","last_deep_scrub":"85'63","last_deep_scrub_stamp":"2024-04-26T12:32:33.295525+0000","last_clean_scrub_stamp":"2024-04-26T12:32:33.295525+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:28.721614+0000","scrub_duration":0.011210543999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"60'381","reported_seq":868,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:28.143238+0000","last_change":"2024-04-26T12:31:28.143238+0000","last_active":"2024-04-26T12:31:28.143238+0000","last_peered":"2024-04-26T12:31:28.143238+0000","last_clean":"2024-04-26T12:31:28.143238+0000","last_became_active":"2024-04-26T12:30:53.076996+0000","last_became_peered":"2024-04-26T12:30:53.076996+0000","last_unstale":"2024-04-26T12:31:28.143238+0000","last_undegraded":"2024-04-26T12:31:28.143238+0000","last_fullsized":"2024-04-26T12:31:28.143238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'381","last_scrub_stamp":"2024-04-26T12:31:28.143070+0000","last_deep_scrub":"60'381","last_deep_scrub_stamp":"2024-04-26T12:31:28.143070+0000","last_clean_scrub_stamp":"2024-04-26T12:31:28.143070+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:55.111541+0000","scrub_duration":0.0024435799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":20954,"num_write":349,"num_write_kb":59141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"85'310","reported_seq":326,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:15.172342+0000","last_change":"2024-04-26T12:33:15.172342+0000","last_active":"2024-04-26T12:33:15.172342+0000","last_peered":"2024-04-26T12:33:15.172342+0000","last_clean":"2024-04-26T12:33:15.172342+0000","last_became_active":"2024-04-26T12:30:48.089512+0000","last_became_peered":"2024-04-26T12:30:48.089512+0000","last_unstale":"2024-04-26T12:33:15.172342+0000","last_undegraded":"2024-04-26T12:33:15.172342+0000","last_fullsized":"2024-04-26T12:33:15.172342+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'310","last_scrub_stamp":"2024-04-26T12:33:15.172206+0000","last_deep_scrub":"85'310","last_deep_scrub_stamp":"2024-04-26T12:33:15.172206+0000","last_clean_scrub_stamp":"2024-04-26T12:33:15.172206+0000","objects_scrubbed":2,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:57.763312+0000","scrub_duration":0.017317318000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"60'376","reported_seq":811,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:58.101978+0000","last_change":"2024-04-26T12:31:58.102086+0000","last_active":"2024-04-26T12:31:58.101978+0000","last_peered":"2024-04-26T12:31:58.101978+0000","last_clean":"2024-04-26T12:31:58.101978+0000","last_became_active":"2024-04-26T12:30:48.086005+0000","last_became_peered":"2024-04-26T12:30:48.086005+0000","last_unstale":"2024-04-26T12:31:58.101978+0000","last_undegraded":"2024-04-26T12:31:58.101978+0000","last_fullsized":"2024-04-26T12:31:58.101978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'376","last_scrub_stamp":"2024-04-26T12:31:58.101950+0000","last_deep_scrub":"60'376","last_deep_scrub_stamp":"2024-04-26T12:31:58.101950+0000","last_clean_scrub_stamp":"2024-04-26T12:31:58.101950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:13.898836+0000","scrub_duration":0.0019261320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4132,"num_write":349,"num_write_kb":54443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"85'318","reported_seq":412,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:58.388469+0000","last_change":"2024-04-26T12:31:58.388584+0000","last_active":"2024-04-26T12:31:58.388469+0000","last_peered":"2024-04-26T12:31:58.388469+0000","last_clean":"2024-04-26T12:31:58.388469+0000","last_became_active":"2024-04-26T12:26:52.840503+0000","last_became_peered":"2024-04-26T12:26:52.840503+0000","last_unstale":"2024-04-26T12:31:58.388469+0000","last_undegraded":"2024-04-26T12:31:58.388469+0000","last_fullsized":"2024-04-26T12:31:58.388469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'318","last_scrub_stamp":"2024-04-26T12:31:58.388443+0000","last_deep_scrub":"85'318","last_deep_scrub_stamp":"2024-04-26T12:31:58.388443+0000","last_clean_scrub_stamp":"2024-04-26T12:31:58.388443+0000","objects_scrubbed":4,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:31.773997+0000","scrub_duration":0.029898854999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":12443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"60'393","reported_seq":885,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:49.040500+0000","last_change":"2024-04-26T12:31:49.040500+0000","last_active":"2024-04-26T12:31:49.040500+0000","last_peered":"2024-04-26T12:31:49.040500+0000","last_clean":"2024-04-26T12:31:49.040500+0000","last_became_active":"2024-04-26T12:30:52.077895+0000","last_became_peered":"2024-04-26T12:30:52.077895+0000","last_unstale":"2024-04-26T12:31:49.040500+0000","last_undegraded":"2024-04-26T12:31:49.040500+0000","last_fullsized":"2024-04-26T12:31:49.040500+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'393","last_scrub_stamp":"2024-04-26T12:31:49.040316+0000","last_deep_scrub":"60'393","last_deep_scrub_stamp":"2024-04-26T12:31:49.040316+0000","last_clean_scrub_stamp":"2024-04-26T12:31:49.040316+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:51.229337+0000","scrub_duration":0.0025244709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8428,"num_write":356,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"85'77","reported_seq":60,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:14.984448+0000","last_change":"2024-04-26T12:31:14.984448+0000","last_active":"2024-04-26T12:31:14.984448+0000","last_peered":"2024-04-26T12:31:14.984448+0000","last_clean":"2024-04-26T12:31:14.984448+0000","last_became_active":"2024-04-26T12:30:41.029844+0000","last_became_peered":"2024-04-26T12:30:41.029844+0000","last_unstale":"2024-04-26T12:31:14.984448+0000","last_undegraded":"2024-04-26T12:31:14.984448+0000","last_fullsized":"2024-04-26T12:31:14.984448+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'77","last_scrub_stamp":"2024-04-26T12:31:14.984325+0000","last_deep_scrub":"85'77","last_deep_scrub_stamp":"2024-04-26T12:31:14.984325+0000","last_clean_scrub_stamp":"2024-04-26T12:31:14.984325+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:53.595109+0000","scrub_duration":0.010871390999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"60'438","reported_seq":555,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:33.279814+0000","last_change":"2024-04-26T12:31:33.279814+0000","last_active":"2024-04-26T12:31:33.279814+0000","last_peered":"2024-04-26T12:31:33.279814+0000","last_clean":"2024-04-26T12:31:33.279814+0000","last_became_active":"2024-04-26T12:28:00.707438+0000","last_became_peered":"2024-04-26T12:28:00.707438+0000","last_unstale":"2024-04-26T12:31:33.279814+0000","last_undegraded":"2024-04-26T12:31:33.279814+0000","last_fullsized":"2024-04-26T12:31:33.279814+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'438","last_scrub_stamp":"2024-04-26T12:31:33.279688+0000","last_deep_scrub":"60'438","last_deep_scrub_stamp":"2024-04-26T12:31:33.279688+0000","last_clean_scrub_stamp":"2024-04-26T12:31:33.279688+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:47.222045+0000","scrub_duration":0.0024948520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":26762,"num_write":400,"num_write_kb":108824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"85'53","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:26.092908+0000","last_change":"2024-04-26T12:32:26.092908+0000","last_active":"2024-04-26T12:32:26.092908+0000","last_peered":"2024-04-26T12:32:26.092908+0000","last_clean":"2024-04-26T12:32:26.092908+0000","last_became_active":"2024-04-26T12:30:46.078809+0000","last_became_peered":"2024-04-26T12:30:46.078809+0000","last_unstale":"2024-04-26T12:32:26.092908+0000","last_undegraded":"2024-04-26T12:32:26.092908+0000","last_fullsized":"2024-04-26T12:32:26.092908+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"85'53","last_scrub_stamp":"2024-04-26T12:32:26.092771+0000","last_deep_scrub":"85'53","last_deep_scrub_stamp":"2024-04-26T12:32:26.092771+0000","last_clean_scrub_stamp":"2024-04-26T12:32:26.092771+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:02.205832+0000","scrub_duration":0.011348034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4194886,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"60'473","reported_seq":980,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:18.220147+0000","last_change":"2024-04-26T12:31:18.220147+0000","last_active":"2024-04-26T12:31:18.220147+0000","last_peered":"2024-04-26T12:31:18.220147+0000","last_clean":"2024-04-26T12:31:18.220147+0000","last_became_active":"2024-04-26T12:30:51.074915+0000","last_became_peered":"2024-04-26T12:30:51.074915+0000","last_unstale":"2024-04-26T12:31:18.220147+0000","last_undegraded":"2024-04-26T12:31:18.220147+0000","last_fullsized":"2024-04-26T12:31:18.220147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'473","last_scrub_stamp":"2024-04-26T12:31:18.220009+0000","last_deep_scrub":"60'473","last_deep_scrub_stamp":"2024-04-26T12:31:18.220009+0000","last_clean_scrub_stamp":"2024-04-26T12:31:18.220009+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:07.523749+0000","scrub_duration":0.0022384369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26037,"num_write":443,"num_write_kb":108290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"60'425","reported_seq":876,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:33:19.161935+0000","last_change":"2024-04-26T12:33:19.162044+0000","last_active":"2024-04-26T12:33:19.161935+0000","last_peered":"2024-04-26T12:33:19.161935+0000","last_clean":"2024-04-26T12:33:19.161935+0000","last_became_active":"2024-04-26T12:30:53.077614+0000","last_became_peered":"2024-04-26T12:30:53.077614+0000","last_unstale":"2024-04-26T12:33:19.161935+0000","last_undegraded":"2024-04-26T12:33:19.161935+0000","last_fullsized":"2024-04-26T12:33:19.161935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'425","last_scrub_stamp":"2024-04-26T12:33:19.161909+0000","last_deep_scrub":"60'425","last_deep_scrub_stamp":"2024-04-26T12:33:19.161909+0000","last_clean_scrub_stamp":"2024-04-26T12:33:19.161909+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:06.969506+0000","scrub_duration":0.002450631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9367,"num_write":391,"num_write_kb":46463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"60'446","reported_seq":541,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:40.993749+0000","last_change":"2024-04-26T12:31:40.993749+0000","last_active":"2024-04-26T12:31:40.993749+0000","last_peered":"2024-04-26T12:31:40.993749+0000","last_clean":"2024-04-26T12:31:40.993749+0000","last_became_active":"2024-04-26T12:30:54.077813+0000","last_became_peered":"2024-04-26T12:30:54.077813+0000","last_unstale":"2024-04-26T12:31:40.993749+0000","last_undegraded":"2024-04-26T12:31:40.993749+0000","last_fullsized":"2024-04-26T12:31:40.993749+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'446","last_scrub_stamp":"2024-04-26T12:31:40.993603+0000","last_deep_scrub":"60'446","last_deep_scrub_stamp":"2024-04-26T12:31:40.993603+0000","last_clean_scrub_stamp":"2024-04-26T12:31:40.993603+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:42:27.297067+0000","scrub_duration":0.0020716889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":7086,"num_write":413,"num_write_kb":69187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"60'483","reported_seq":642,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:32:59.321665+0000","last_change":"2024-04-26T12:32:59.321665+0000","last_active":"2024-04-26T12:32:59.321665+0000","last_peered":"2024-04-26T12:32:59.321665+0000","last_clean":"2024-04-26T12:32:59.321665+0000","last_became_active":"2024-04-26T12:26:53.265212+0000","last_became_peered":"2024-04-26T12:26:53.265212+0000","last_unstale":"2024-04-26T12:32:59.321665+0000","last_undegraded":"2024-04-26T12:32:59.321665+0000","last_fullsized":"2024-04-26T12:32:59.321665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'483","last_scrub_stamp":"2024-04-26T12:32:59.321521+0000","last_deep_scrub":"60'483","last_deep_scrub_stamp":"2024-04-26T12:32:59.321521+0000","last_clean_scrub_stamp":"2024-04-26T12:32:59.321521+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:32.246379+0000","scrub_duration":0.0025561960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":37080,"num_write":449,"num_write_kb":92362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"60'384","reported_seq":528,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:48.035660+0000","last_change":"2024-04-26T12:31:48.035660+0000","last_active":"2024-04-26T12:31:48.035660+0000","last_peered":"2024-04-26T12:31:48.035660+0000","last_clean":"2024-04-26T12:31:48.035660+0000","last_became_active":"2024-04-26T12:30:50.085115+0000","last_became_peered":"2024-04-26T12:30:50.085115+0000","last_unstale":"2024-04-26T12:31:48.035660+0000","last_undegraded":"2024-04-26T12:31:48.035660+0000","last_fullsized":"2024-04-26T12:31:48.035660+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'384","last_scrub_stamp":"2024-04-26T12:31:48.035480+0000","last_deep_scrub":"60'384","last_deep_scrub_stamp":"2024-04-26T12:31:48.035480+0000","last_clean_scrub_stamp":"2024-04-26T12:31:48.035480+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:18.919037+0000","scrub_duration":0.002218383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40030,"num_write":351,"num_write_kb":54887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"60'380","reported_seq":525,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-26T12:31:40.177393+0000","last_change":"2024-04-26T12:31:40.177393+0000","last_active":"2024-04-26T12:31:40.177393+0000","last_peered":"2024-04-26T12:31:40.177393+0000","last_clean":"2024-04-26T12:31:40.177393+0000","last_became_active":"2024-04-26T12:26:53.264989+0000","last_became_peered":"2024-04-26T12:26:53.264989+0000","last_unstale":"2024-04-26T12:31:40.177393+0000","last_undegraded":"2024-04-26T12:31:40.177393+0000","last_fullsized":"2024-04-26T12:31:40.177393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'380","last_scrub_stamp":"2024-04-26T12:31:40.177270+0000","last_deep_scrub":"60'380","last_deep_scrub_stamp":"2024-04-26T12:31:40.177270+0000","last_clean_scrub_stamp":"2024-04-26T12:31:40.177270+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:45.516828+0000","scrub_duration":0.0024862170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24027,"num_write":348,"num_write_kb":43071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2753,"num_read_kb":1437045,"num_write":24529,"num_write_kb":4200299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6519,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26680,"ondisk_log_size":26680,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128224509,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":47,"num_read_kb":1466,"num_write":5680,"num_write_kb":129201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":81163322,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79134720,"data_stored":256449018,"data_compressed":38844374,"data_compressed_allocated":48693248,"data_compressed_original":226074624,"omap_allocated":5343,"internal_metadata":0},"log_size":7561,"ondisk_log_size":7561,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":68294,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738454,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130112,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94241728,"statfs":{"total":96636764160,"available":96503529472,"internally_reserved":0,"allocated":31711232,"data_stored":85785287,"data_compressed":12062822,"data_compressed_allocated":15765504,"data_compressed_original":70336512,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:52 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.435},"min":{"1min":0.30399999999999999,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.63,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.28000000000000003,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Apr 26 12:32:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.42299999999999999},"min":{"1min":0.35599999999999998,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.436,"15min":0.43099999999999999},"min":{"1min":0.372,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.437}]}]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131332,"kb_used_data":32188,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94240508,"statfs":{"total":96636764160,"available":96502280192,"internally_reserved":0,"allocated":32960512,"data_stored":91451171,"data_compressed":12881926,"data_compressed_allocated":16723968,"data_compressed_original":75722752,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 12:32:42 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.44700000000000001},"min":{"1min":0.372,"5min":0.186,"15min":0.186},"max":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.47799999999999998,"15min":0.46999999999999997},"min":{"1min":0.39700000000000002,"5min":0.222,"15min":0.222},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Apr 26 12:32:47 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.38,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.61499999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.46200000000000002,"15min":0.47199999999999998},"min":{"1min":0.34699999999999998,"5min":0.191,"15min":0.191},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.41499999999999998}]}]},{"osd":1,"up_from":64,"seq":274877906981,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62336,"kb_used_data":16760,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94309504,"statfs":{"total":96636764160,"available":96572932096,"internally_reserved":0,"allocated":17162240,"data_stored":81548386,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":6937,"internal_metadata":46654695},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 12:32:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.433,"15min":0.433},"min":{"1min":0.29699999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.58699999999999997,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.436},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.443,"15min":0.436},"min":{"1min":0.30499999999999999,"5min":0.224,"15min":0.224},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Apr 26 12:32:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44,"15min":0.42699999999999999},"min":{"1min":0.42699999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.61899999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.432},"min":{"1min":0.41299999999999998,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.53700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34147,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32038912,"data_stored":90475773,"data_compressed":12847779,"data_compressed_allocated":16678912,"data_compressed_original":75149312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16306176,"data_stored":81163356,"data_compressed":13967920,"data_compressed_allocated":16293888,"data_compressed_original":81162240,"omap_allocated":5343,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30789632,"data_stored":84809889,"data_compressed":12028675,"data_compressed_allocated":15720448,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:33:36.270 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T12:33:36.659 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T12:33:36.659 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:33:37.041 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:33:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:26:53.244246+0000","modified":"2024-04-26T12:26:56.250552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14150":{"gid":14150,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6803/2009845799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2009845799},{"type":"v1","addr":"172.21.15.46:6803","nonce":2009845799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:33:37.044 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 6 2024-04-26T12:33:37.055 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T12:33:37.442 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:33:37.442 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T12:26:53.244246+0000","modified":"2024-04-26T12:26:56.250552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14150":{"gid":14150,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6803/2009845799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":2009845799},{"type":"v1","addr":"172.21.15.46:6803","nonce":2009845799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T12:33:37.444 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 6 2024-04-26T12:33:37.456 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:33:37.799 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-04-26T12:33:37.800 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":85,"fsid":"3dd84416-f290-4721-94ce-52b0ffaacf34","created":"2024-04-26T12:26:36.091476+0000","modified":"2024-04-26T12:31:00.074154+0000","last_up_change":"2024-04-26T12:30:39.998401+0000","last_in_change":"2024-04-26T12:26:37.993949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:26:45.341269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:26:45.839095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T12:26:51.091400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T12:26:52.222159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06efe013-b786-41a5-b434-e2198a85a028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":41431},{"type":"v1","addr":"172.21.15.115:6801","nonce":41431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":41431},{"type":"v1","addr":"172.21.15.115:6803","nonce":41431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":41431},{"type":"v1","addr":"172.21.15.115:6807","nonce":41431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":41431},{"type":"v1","addr":"172.21.15.115:6805","nonce":41431}]},"public_addr":"172.21.15.115:6801/41431","cluster_addr":"172.21.15.115:6803/41431","heartbeat_back_addr":"172.21.15.115:6807/41431","heartbeat_front_addr":"172.21.15.115:6805/41431","state":["exists","up"]},{"osd":1,"uuid":"13cadead-33ea-4874-9a87-7419790ff37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":29,"up_from":64,"up_thru":84,"down_at":30,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":6156},{"type":"v1","addr":"172.21.15.136:6801","nonce":6156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":6156},{"type":"v1","addr":"172.21.15.136:6803","nonce":6156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":6156},{"type":"v1","addr":"172.21.15.136:6807","nonce":6156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":6156},{"type":"v1","addr":"172.21.15.136:6805","nonce":6156}]},"public_addr":"172.21.15.136:6801/6156","cluster_addr":"172.21.15.136:6803/6156","heartbeat_back_addr":"172.21.15.136:6807/6156","heartbeat_front_addr":"172.21.15.136:6805/6156","state":["exists","up"]},{"osd":2,"uuid":"4e4c8095-c2d1-42a3-8da1-e3b41ca2a870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":41547},{"type":"v1","addr":"172.21.15.142:6801","nonce":41547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":41547},{"type":"v1","addr":"172.21.15.142:6803","nonce":41547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":41547},{"type":"v1","addr":"172.21.15.142:6807","nonce":41547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":41547},{"type":"v1","addr":"172.21.15.142:6805","nonce":41547}]},"public_addr":"172.21.15.142:6801/41547","cluster_addr":"172.21.15.142:6803/41547","heartbeat_back_addr":"172.21.15.142:6807/41547","heartbeat_front_addr":"172.21.15.142:6805/41547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.065520+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.774900+0000","dead_epoch":29},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:26:43.024152+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.19","osds":[0,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:33:37.814 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T12:33:38.210 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T12:33:38.222 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T12:33:38.246 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-04-26T12:33:39.227 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T12:33:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2024-04-26T12:33:40.231 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T12:33:41.221 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2024-04-26T12:33:41.236 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T12:33:41.236 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T12:33:41.236 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:33:41.245 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T12:33:41.246 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T12:33:41.246 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T12:33:41.246 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:33:41.285 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T12:33:41.285 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T12:33:41.285 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:33:41.319 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T12:33:41.319 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T12:33:41.319 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:33:41.361 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T12:33:41.361 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T12:33:41.362 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T12:33:41.362 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:33:41.390 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T12:33:41.390 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T12:33:41.390 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:33:41.458 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T12:33:41.458 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T12:33:41.458 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T12:33:41.458 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:33:41.511 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T12:33:41.511 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T12:33:41.511 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:33:41.563 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T12:33:41.563 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T12:33:41.563 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:33:41.614 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T12:33:41.615 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T12:33:41.615 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-26T12:33:41.693 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi115.front.sepia.ceph.com 2024-04-26T12:33:41.693 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T12:33:41.833 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T12:33:41.833 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T12:33:41.988 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T12:33:41.988 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T12:33:42.114 INFO:tasks.ceph:Archiving mon data... 2024-04-26T12:33:42.115 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/data/mon.a.tgz 2024-04-26T12:33:42.116 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-04-26T12:33:42.139 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.Ro1auwCSdQ 2024-04-26T12:33:42.139 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Ro1auwCSdQ 2024-04-26T12:33:42.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.Ro1auwCSdQ 2024-04-26T12:33:42.383 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.Ro1auwCSdQ is 404KB 2024-04-26T12:33:42.481 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.Ro1auwCSdQ 2024-04-26T12:33:42.499 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/data/mon.b.tgz 2024-04-26T12:33:42.500 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-04-26T12:33:42.556 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.E1We55iMXq 2024-04-26T12:33:42.557 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.E1We55iMXq 2024-04-26T12:33:42.737 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.E1We55iMXq 2024-04-26T12:33:42.827 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.E1We55iMXq is 555KB 2024-04-26T12:33:42.926 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.E1We55iMXq 2024-04-26T12:33:42.944 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/data/mon.c.tgz 2024-04-26T12:33:42.944 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-04-26T12:33:43.003 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.sVBvHk5FgT 2024-04-26T12:33:43.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.sVBvHk5FgT 2024-04-26T12:33:43.184 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.sVBvHk5FgT 2024-04-26T12:33:43.271 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.sVBvHk5FgT is 553KB 2024-04-26T12:33:43.371 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.sVBvHk5FgT 2024-04-26T12:33:43.388 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T12:33:43.389 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:33:43.431 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:33:43.433 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:33:43.436 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:33:43.475 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-26T12:33:43.475 DEBUG:teuthology.orchestra.run.smithi046:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:33:43.500 DEBUG:teuthology.orchestra.run.smithi115:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:33:43.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:33:43.517 DEBUG:teuthology.orchestra.run.smithi142:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T12:33:43.526 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:33:43.536 INFO:teuthology.orchestra.run.smithi115.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:33:43.549 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:33:43.560 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T12:33:43.566 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T12:33:43.568 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/remote/smithi046/crash 2024-04-26T12:33:43.569 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:33:43.601 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/remote/smithi115/crash 2024-04-26T12:33:43.602 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:33:43.649 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/remote/smithi136/crash 2024-04-26T12:33:43.650 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:33:43.687 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/remote/smithi142/crash 2024-04-26T12:33:43.688 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:33:43.729 INFO:tasks.ceph:Compressing logs... 2024-04-26T12:33:43.729 DEBUG:teuthology.orchestra.run.smithi046:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:33:43.732 DEBUG:teuthology.orchestra.run.smithi115:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:33:43.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:33:43.739 DEBUG:teuthology.orchestra.run.smithi142:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:33:52.546 INFO:tasks.ceph:Archiving logs... 2024-04-26T12:33:52.546 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/remote/smithi046/log 2024-04-26T12:33:52.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:33:52.909 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/remote/smithi115/log 2024-04-26T12:33:52.910 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:33:53.458 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/remote/smithi136/log 2024-04-26T12:33:53.459 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:33:53.619 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/remote/smithi142/log 2024-04-26T12:33:53.620 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:33:54.651 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T12:33:54.661 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T12:33:54.661 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:33:54.663 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:33:54.666 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:33:54.669 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:33:54.800 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T12:33:54.810 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T12:33:54.810 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:33:54.813 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:33:54.815 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:33:54.818 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:33:54.831 INFO:teuthology.orchestra.run.smithi046.stderr:bash: ntpq: command not found 2024-04-26T12:33:54.833 INFO:teuthology.orchestra.run.smithi115.stderr:bash: ntpq: command not found 2024-04-26T12:33:54.836 INFO:teuthology.orchestra.run.smithi136.stderr:bash: ntpq: command not found 2024-04-26T12:33:54.837 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:33:54.837 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-04-26T12:33:54.837 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 19 +800us[ +800us] +/- 44ms 2024-04-26T12:33:54.837 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv02.front.sepia.ceph.com 3 6 377 19 -1272us[-1269us] +/- 63ms 2024-04-26T12:33:54.837 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 +387us[ +389us] +/- 84ms 2024-04-26T12:33:54.837 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:33:54.838 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:33:54.838 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-04-26T12:33:54.838 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 21 +794us[ +800us] +/- 44ms 2024-04-26T12:33:54.838 INFO:teuthology.orchestra.run.smithi115.stdout:^* hv02.front.sepia.ceph.com 3 6 377 18 -1279us[-1274us] +/- 63ms 2024-04-26T12:33:54.839 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 +384us[ +390us] +/- 84ms 2024-04-26T12:33:54.839 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:33:54.839 INFO:teuthology.orchestra.run.smithi142.stderr:bash: ntpq: command not found 2024-04-26T12:33:54.840 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:33:54.840 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-04-26T12:33:54.840 INFO:teuthology.orchestra.run.smithi136.stdout:^* hv01.front.sepia.ceph.com 3 6 77 11 +851us[ +828us] +/- 45ms 2024-04-26T12:33:54.840 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 12 -1216us[-1239us] +/- 63ms 2024-04-26T12:33:54.841 INFO:teuthology.orchestra.run.smithi136.stdout:^- hv03.front.sepia.ceph.com 3 6 177 13 +455us[ +432us] +/- 84ms 2024-04-26T12:33:54.841 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:33:54.842 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T12:33:54.843 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-04-26T12:33:54.843 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 20 +810us[ +826us] +/- 44ms 2024-04-26T12:33:54.843 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv02.front.sepia.ceph.com 3 6 377 19 -1259us[-1242us] +/- 63ms 2024-04-26T12:33:54.843 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 +409us[ +409us] +/- 84ms 2024-04-26T12:33:54.843 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T12:33:54.844 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T12:33:54.853 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T12:33:54.854 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T12:33:54.888 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:33:54.966 DEBUG:teuthology.orchestra.run.smithi115:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:33:55.038 DEBUG:teuthology.orchestra.run.smithi136:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:33:55.149 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T12:33:55.223 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:33:55.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:33:55.259 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:33:55.294 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:33:55.295 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:33:55.326 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:33:55.327 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T12:33:55.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:33:55.360 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T12:33:55.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T12:33:55.398 INFO:teuthology.task.internal:Duration was 982.668150 seconds 2024-04-26T12:33:55.398 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T12:33:55.439 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T12:33:55.439 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:33:55.443 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:33:55.446 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:33:55.448 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:33:55.496 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:33:55.496 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:33:55.497 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:33:55.522 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T12:33:55.771 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T12:33:55.771 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-04-26T12:33:55.771 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:33:55.799 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2024-04-26T12:33:55.800 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:33:55.825 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T12:33:55.825 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:33:55.849 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T12:33:55.850 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:33:55.874 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T12:33:55.875 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:33:55.877 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:33:55.880 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:33:55.892 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:33:55.966 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T12:33:55.966 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:33:55.968 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:33:55.971 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:33:55.973 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:33:56.046 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T12:33:56.057 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T12:33:56.057 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:33:56.086 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:33:56.114 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:33:56.141 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:33:56.169 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T12:33:56.179 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:33:56.182 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:33:56.184 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:33:56.186 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:33:56.208 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-04-26T12:33:56.208 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2024-04-26T12:33:56.220 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-04-26T12:33:56.235 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-04-26T12:33:56.283 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:33:56.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:33:56.301 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:33:56.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:33:56.318 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:33:56.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:33:56.336 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:33:56.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:33:56.353 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T12:33:56.370 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T12:33:56.372 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/remote/smithi046 2024-04-26T12:33:56.372 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:33:56.422 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/remote/smithi115 2024-04-26T12:33:56.422 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:33:56.466 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/remote/smithi136 2024-04-26T12:33:56.466 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:33:56.505 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674214/remote/smithi142 2024-04-26T12:33:56.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:33:56.543 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T12:33:56.543 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:33:56.546 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:33:56.548 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:33:56.550 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:33:56.595 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T12:33:56.609 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T12:33:56.609 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T12:33:56.631 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T12:33:56.631 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:33:56.634 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:33:56.637 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:33:56.639 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:33:56.650 INFO:teuthology.orchestra.run.smithi046.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:33 /home/ubuntu/cephtest 2024-04-26T12:33:56.651 INFO:teuthology.orchestra.run.smithi115.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:33 /home/ubuntu/cephtest 2024-04-26T12:33:56.654 INFO:teuthology.orchestra.run.smithi136.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:33 /home/ubuntu/cephtest 2024-04-26T12:33:56.656 INFO:teuthology.orchestra.run.smithi142.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:33 /home/ubuntu/cephtest 2024-04-26T12:33:56.658 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T12:33:56.673 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T12:33:56.767 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 982.6681499481201 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-26T12:33:56.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T12:33:56.852 INFO:teuthology.run:pass